Comment on Smollm3: Smol, multilingual, long-context reasoner LLMparentComments−tripplyons1yHave you tried setting device="mps" to use Metal? It should be faster than PyTorch's "cpu" device on Mac.
Comments
Have you tried setting device="mps" to use Metal? It should be faster than PyTorch's "cpu" device on Mac.