Comment on Show HN: Running 104GB Qwen3.8-Flash-Next on 48GB Mac with at ~12 tok/sparentComments−ig0r011dyes, with qwen3.8-27b-4bit run via rapid-mlx i can get to about 200k−metadat11dNice.. and how many toks/sec?−ig0r010dAround 20
Comments
yes, with qwen3.8-27b-4bit run via rapid-mlx i can get to about 200k
Nice.. and how many toks/sec?
Around 20