Very good knowledge of history, science, technology, everything
All of English Wikipedia is about 100 GB. A local LLM that can run searches against a local Kiwix server would work. Local LLMs can’t really do this correctly yet, but it’s not inconceivable in 1-2 years.
What I'm thinking is a bit more than that. E.g. it should consume all books in the world for topics I'm interested in. Wikipedia is too shallow for in-depth discussions but it's a good "appetizer".
Comments
All of English Wikipedia is about 100 GB. A local LLM that can run searches against a local Kiwix server would work. Local LLMs can’t really do this correctly yet, but it’s not inconceivable in 1-2 years.
What I'm thinking is a bit more than that. E.g. it should consume all books in the world for topics I'm interested in. Wikipedia is too shallow for in-depth discussions but it's a good "appetizer".