Skip to content

Ask HN: Questions about LLM context window

1 pointsc077ydiscuss
On HN

I've recently come to learn that filling the context window up completely makes the results worse and the llm struggles to acquire the tokens in the middle of the prompt. So my question is : Are there any studies on this and what is the appropriate fill for a context window ?

Comments

No comments yet.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.