Good question. Had exactly this conversation yesterday. There were two
groups of opinions. Positive feedback usually does one of these two
things:
1 - It will deflate
2 - It will explode
Deflation is where the output of system tends toward a fixed point (AI
art gets blander and blander). As it feeds on it's own output (which
becomes the dominant training material because its cheap and
plentiful) each vector is compressed.
Chaos (explosion) is where the output gets less predictable and more
crazy on each iteration. Who knows what emerges before the system
breaks.
Positive feedback systems are generally bad. For example, in
biology/food; we started feeding cattle on the rendered down remains
of other dead cattle. The result was Bovine Spongiform Encephalopathy,
a lethal prion that thrived within the feedback loop.
Comments
Good question. Had exactly this conversation yesterday. There were two groups of opinions. Positive feedback usually does one of these two things:
1 - It will deflate
2 - It will explode
Deflation is where the output of system tends toward a fixed point (AI art gets blander and blander). As it feeds on it's own output (which becomes the dominant training material because its cheap and plentiful) each vector is compressed.
Chaos (explosion) is where the output gets less predictable and more crazy on each iteration. Who knows what emerges before the system breaks.
Positive feedback systems are generally bad. For example, in biology/food; we started feeding cattle on the rendered down remains of other dead cattle. The result was Bovine Spongiform Encephalopathy, a lethal prion that thrived within the feedback loop.