If ChatGPT is able to emit output that is watermarked such that it can detect itself as Scott Aaronson and others are working on for OpenAI (source: https://techcrunch.com/2022/12/10/openais-attempts-to-waterm... ) this “resonance”/feedback/eating-itself can be avoided.
Comments
If ChatGPT is able to emit output that is watermarked such that it can detect itself as Scott Aaronson and others are working on for OpenAI (source: https://techcrunch.com/2022/12/10/openais-attempts-to-waterm... ) this “resonance”/feedback/eating-itself can be avoided.
I think this assumes there's no other AI spewing data on the Internet, and that people continue to share information.
The amusing thing is that controlling nonlinear multivariate feedback systems is an unsolved problem.
But what if it eats Bard data, which is maybe even worse?
Or more generally, you end up with a cycle:
ChatGPT trains Bard which trains Bing which trains ChatGPT, etc.
Nailed it!
Then the watermark should be made public. We need a way to tell ai-generated content from human-generated content without actually having to read it.
I wonder how difficult it will be to apply the filter to human generated content.