I had an old Tesla M40 12 GB lying around and figured I’d try it out with some 8-13B llms, but was disappointed to find that it’s around the same speed as my mac mini m2. I suppose the mac mini is a 10 years newer chip, but it’s crazy that mobile today matches data center from 10 years ago