Seems like only comparing a checksum is a recipe for disaster, especially when hosting an enormous amount of files. Comparing checksum (or multiple checksums) and file size would drastically reduce the amount of false-positives.
Googling DS_Store it contains the folder customization metadata which backs up my first instinct. These are almost certainly identical byte for byte recreations of DS_Store with probably default settings.
Neither hashes nor file sizes are how copyright works—I don't make a work free by adding a space to it. So it would be a bit weird if Google implemented it that way. Rolling hashes—maybe.
It's a pity that we don't get to see the supposed ‘copyright holder’ like on YouTube—it would add nicely to the bureaucratic surrealism.
I wonder if the Docs team saw how great and flawlessly YouTube's ‘Content ID’ works, and implemented about the same. And now they match files against some clerk's entire disk that was uploaded into the system.
I'd be kind of shocked if that was the case. Either it means that Google isn't also comparing file sizes or that whoever is creating these tiny DS files/one-byte files is incredibly lucky matching tiny copyrighted material.
Comments
The author speculates that this was just a hash collision. Seems like the most plausible scenario in this case.
Seems like only comparing a checksum is a recipe for disaster, especially when hosting an enormous amount of files. Comparing checksum (or multiple checksums) and file size would drastically reduce the amount of false-positives.
Googling DS_Store it contains the folder customization metadata which backs up my first instinct. These are almost certainly identical byte for byte recreations of DS_Store with probably default settings.
Neither hashes nor file sizes are how copyright works—I don't make a work free by adding a space to it. So it would be a bit weird if Google implemented it that way. Rolling hashes—maybe.
It's a pity that we don't get to see the supposed ‘copyright holder’ like on YouTube—it would add nicely to the bureaucratic surrealism.
I wonder if the Docs team saw how great and flawlessly YouTube's ‘Content ID’ works, and implemented about the same. And now they match files against some clerk's entire disk that was uploaded into the system.
Hey, maybe don't do hash checks on files less than 1KB in size? It's not difficult to solve.
What hash are they using? CRC32/CRC64? Even md5 shouldn't produce collisions unless you're actively hunting for them.
I'd be kind of shocked if that was the case. Either it means that Google isn't also comparing file sizes or that whoever is creating these tiny DS files/one-byte files is incredibly lucky matching tiny copyrighted material.
Then use a bigger hash!