Comment on Fable 5 pushed Gemma 4 to 255 tok/s on WebGPUparentComments−pornel2moHas extra KV cache on SSD, and lots more options to tweak. There's experimental TurboQuant and multi token prediction support.
Comments
Has extra KV cache on SSD, and lots more options to tweak. There's experimental TurboQuant and multi token prediction support.