Comment on Show HN: Shoehorn – Quantize any model down to run on your machineparentComments−rhgraysoniiOP25dYes that is exactly what this does.−kennywinker25dCould you explain what happens when you try to shoehorn a 2.4T parameter model into a 24gb m4 mac?−metalliqaz23dextreme divergence would be my guess−akshay_akula25dWondering the same thing but for 48gb M5 Max.
Comments
Yes that is exactly what this does.
Could you explain what happens when you try to shoehorn a 2.4T parameter model into a 24gb m4 mac?
extreme divergence would be my guess
Wondering the same thing but for 48gb M5 Max.