re: legal, I saw a post on this idea where their RAG system was designed to return the actual text from the document rather than a LLM response or summary. The LLM played a role in turning the query into the search params, but the insight was that for certain kinds of documents, you want the actual source because of the existing, human written summary or the detailed nuances therein
Comments
re: legal, I saw a post on this idea where their RAG system was designed to return the actual text from the document rather than a LLM response or summary. The LLM played a role in turning the query into the search params, but the insight was that for certain kinds of documents, you want the actual source because of the existing, human written summary or the detailed nuances therein
Sounds more like Generation Augmented Retrieval in that case.
It wasn't this GAR post, I remember them calling out legal docs explicitly, might have seen it on Twitter
https://blog.luk.sh/rag-vs-gar
Do you happen to have any good references for GAR implementation?