Comment on Local LLM inference – impressive but too hard to work withComments−anarticle1ySeems fine to me, I use it like a local google for software eng questions, or rig it into aider to write tests while I'm doing something else. Keeps me focused and out of my web browser frankly.EDIT: oh! It's also fantastic if you're on a plane!
Comments
Seems fine to me, I use it like a local google for software eng questions, or rig it into aider to write tests while I'm doing something else. Keeps me focused and out of my web browser frankly.
EDIT: oh! It's also fantastic if you're on a plane!