Skip to content

Comment on OpenAI reasoning models: Advice on prompting

Comments

Limit additional context in retrieval-augmented generation (RAG): When providing additional context or documents, include only the most relevant information to prevent the model from overcomplicating its response.

This databricks blog/paper seemingly contradicts this:

OpenAI o1 models show a consistent improvement over Anthropic and Google models on our long context RAG Benchmark up to 128k tokens.

https://www.databricks.com/blog/long-context-rag-capabilitie...

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.