Comment on Ask HN: Anyone Using a Mac Studio for Local AI/LLM?Comments−b_brief7moMy experience with Mac Studio is that memory bandwidth matters more than raw cores for reasonable LLM throughput locally; curious what others find for models >13B parameters?
Comments
My experience with Mac Studio is that memory bandwidth matters more than raw cores for reasonable LLM throughput locally; curious what others find for models >13B parameters?