Skip to content

The way ChatGPT handles large text files is great – how?

1 pointis-is-odd1 comment
On HN

if you upload a large pdf/txt of a book, it's able to be aware of specific content on any page far beyond the context window limit as per the API. so they must be handling the files differently than loading the contents into the prompt. what techniques are there to handle a large amount of info like all the text from a book? this isn't available through the API

Comments

Retrieval Augmented Generation, probably.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.