I've been playing with local LLMs on a 4 year old Mac Studio and have been quite impressed. I keep remembering that the LLM I have available to me today is the worst it will ever be. It will just keep getting better. I'm super interested in and curious about the path forward for local inference.
Comments
I've been playing with local LLMs on a 4 year old Mac Studio and have been quite impressed. I keep remembering that the LLM I have available to me today is the worst it will ever be. It will just keep getting better. I'm super interested in and curious about the path forward for local inference.