Comment on Show HN: Shoehorn – Quantize any model down to run on your machineparentComments−kennywinker25dCould you explain what happens when you try to shoehorn a 2.4T parameter model into a 24gb m4 mac?−metalliqaz22dextreme divergence would be my guess−akshay_akula25dWondering the same thing but for 48gb M5 Max.
Comments
Could you explain what happens when you try to shoehorn a 2.4T parameter model into a 24gb m4 mac?
extreme divergence would be my guess
Wondering the same thing but for 48gb M5 Max.