Skip to content

Comment on Reducing Doom Loops with Final Token Preference Optimization

Comments

Somewhere around the initial ChatGPT release, I was experimenting with having the model draw various types of ASCII art. I believe the first time I ran into a doom loop might have been when I asked it to draw a giraffe; it started with a head, then a line of | | for the neck, and then it just repeated that, ad infinitum. I am not really sure what the cause was, but clearly it wanted to make a long-ish neck, and ran out of a way to determine how many lines it had already produced, so just kept going.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.