Safety controls may be lost – models trained on Claude's Outputs won't have our safety measures, potentially leading to harmful or dangerous AI systems. We also have no visibility into deployment, meaning we cannot monitor how these distilled models are used or prevent misuse.
So was that why your models caused three real-world security incidents?
Comments
Apart from the usual hypocrisy,
So was that why your models caused three real-world security incidents?
Isn't that someone else's problem anyway? Someone else's model trained on your outputs is still someone else's model.
which is fine since they are none of your (their) business..
I think the only possible concern is using their models name - making it clear it's a new model merely trained in another one should fix that.
No, that was just marketing :)