For anything other than a toy, I would recommend at least a Max processor and at least 32 GB memory, depending on what you're doing. I do a lot of text, audio, and NLP stuff, so I'm running smaller models and my 36GB is plenty.
Ultra processors are priced high enough, I'd be asking myself if I'm serious about local LLM work and do a cost analysis.
Comments
For anything other than a toy, I would recommend at least a Max processor and at least 32 GB memory, depending on what you're doing. I do a lot of text, audio, and NLP stuff, so I'm running smaller models and my 36GB is plenty.
Ultra processors are priced high enough, I'd be asking myself if I'm serious about local LLM work and do a cost analysis.