They only had to pay for storing the books on a server for later possible use. They did not have to pay anything for the training which was declared fair use.
This actually undermines the argument that distilling is harmless because its founded on the idea that Anthropic did the same thing and didn’t have any repercussions.
Comments
What of the costs for creating the data that was used to train the model being distilled?
At least 1.5B by stealing books, per a recent ruling.
I don’t feel sorry for the model companies
They only had to pay for storing the books on a server for later possible use. They did not have to pay anything for the training which was declared fair use.
This actually undermines the argument that distilling is harmless because its founded on the idea that Anthropic did the same thing and didn’t have any repercussions.
Do you people seriously believe that Moonshot and the Chinese personal-cult-state dont possess and train on the same torrents?
They aren’t hypocritically crying foul about it, so no we don’t care if they do.
Well of course. But they dont hate Chinese model companies.