I guess https://grep.app (discussed here [0]) becomes even more useful now. Although not sure what exactly are they indexing.
And for anyone using Github to search in their own code -- Ripgrep works really well even if you run it against your whole code directory and gives you instantaneous results (if you usean SSD!). I'm describing my code search setup with ripgrep + emacs here [1]
Comments
I guess https://grep.app (discussed here [0]) becomes even more useful now. Although not sure what exactly are they indexing.
And for anyone using Github to search in their own code -- Ripgrep works really well even if you run it against your whole code directory and gives you instantaneous results (if you usean SSD!). I'm describing my code search setup with ripgrep + emacs here [1]
[0] https://news.ycombinator.com/item?id=22396824
[1] https://beepb00p.xyz/pkm-search.html#code
I built a web UI on top of ripgrep a few weeks ago - just a few dozen lines of Python - and it's fantastically useful.
I already find myself using it a lot - recent example search: ehttps://ripgrep.datasette.io/-/ripgrep?pattern=changelog&ign...
More about that project here: https://simonwillison.net/2020/Nov/28/datasette-ripgrep/
Man I remember when the thread was active, the OP got contacted by 2 CEOs and a CTO immediately because his search was so blazing fast.
I wish I was half as good at building a program like him. Instead I'm here struggling building my own RPI4 Radio player =(
Don’t let your dreams be dreams.
The author did give some hints on how he built it, e.g. indexing/search is driven by Apache Solr on a couple of 20-core machines.
Regarding data ingestion you probably can look at some prior art like this: https://github.com/garysieling/solr-git
There are also some pretty decent books referenced in the Solr docs: https://lucene.apache.org/solr/resources.html
Yeah, and for even more context, it was CTO of Github! Wonder what happened there ¯\_(ツ)_/¯