Comment on Ask HN: How can I experiment with LLMs with a old machine?Comments−tarun_anand1yI am on a 2019 mac and finding it difficult too.Best bet would be to start with a small language model?−hedgehog0OP1yMay I ask how small? From what I see on r/localllama, it seems that at least 3B and 7B ones are starting to be useful? Also I cannot use CUDA or modern AMD cards..
Comments
I am on a 2019 mac and finding it difficult too.
Best bet would be to start with a small language model?
May I ask how small? From what I see on r/localllama, it seems that at least 3B and 7B ones are starting to be useful? Also I cannot use CUDA or modern AMD cards..