Seems like a perfect use case for local models. Not sure I want to be sending my .bash_profile or .bash_history (or local env vars...) to OpenAI. And I can't imagine doing anything in the terminal that llama2-code-7b couldn't make sense of. That can trivially run on an M1 with 8GB.
Comments
Seems like a perfect use case for local models. Not sure I want to be sending my .bash_profile or .bash_history (or local env vars...) to OpenAI. And I can't imagine doing anything in the terminal that llama2-code-7b couldn't make sense of. That can trivially run on an M1 with 8GB.
Pretty easy to see in the code that it is not sending any of that to OpenAI. It's only sending the prompt, OS info, and shell type:
https://github.com/searchableguy/whiz/blob/main/src/commands...
https://github.com/searchableguy/whiz/blob/main/src/completi...
That said, OP, it's perhaps worth making this extremely clear in the README as it's a reasonable concern.
Thanks. I will add a note on privacy.