The problem is less that the context runs out (although for a full novel, it does become a challenge, since 32k tokens is only about half a book).
The problem is more than the AI has no concept of actually telling a coherent story. It doesn't tell anything exciting or novel or cohesive - it just spits out similar literary sentences, and the more it spits out sentences that look like random novel content, the less cohesive the story gets as it matches more an more strongly on previous content that looks like random novel.
Honestly, it's less like a real novel, and more like a panorama of small chunks of all sorts of different stories - Mostly unrelated and uninteresting.
Comments
The problem is less that the context runs out (although for a full novel, it does become a challenge, since 32k tokens is only about half a book).
The problem is more than the AI has no concept of actually telling a coherent story. It doesn't tell anything exciting or novel or cohesive - it just spits out similar literary sentences, and the more it spits out sentences that look like random novel content, the less cohesive the story gets as it matches more an more strongly on previous content that looks like random novel.
Honestly, it's less like a real novel, and more like a panorama of small chunks of all sorts of different stories - Mostly unrelated and uninteresting.