A lightweight CLI tool for Retrieval-Augmented Generation (RAG) over local documents built with LangChain, Chroma, and Ollama. Hybrid database (vector + BM25 index) and embedding generation run fully locally. Answer generation can run either via a local LLM or remotely using an API key. raggy supports most common document formats and handles images/scans automatically via OCR.
Built this for myself, curious if others may find it useful :)
Cool, how does it differ from other similar tools? If you tried some out? I'm looking to start using something like this, but it's a jungle of options out there.
Comments
A lightweight CLI tool for Retrieval-Augmented Generation (RAG) over local documents built with LangChain, Chroma, and Ollama. Hybrid database (vector + BM25 index) and embedding generation run fully locally. Answer generation can run either via a local LLM or remotely using an API key. raggy supports most common document formats and handles images/scans automatically via OCR.
Built this for myself, curious if others may find it useful :)
Cool, how does it differ from other similar tools? If you tried some out? I'm looking to start using something like this, but it's a jungle of options out there.
Haven't done a comparison with other tools, just wanted to build something I can fully customize -- including pipeline logic, models used, etc.