Comment on Fable 5 pushed Gemma 4 to 255 tok/s on WebGPUparentComments−karussell2moWhy would you need Omlx? For speed up?−pornel2moHas extra KV cache on SSD, and lots more options to tweak. There's experimental TurboQuant and multi token prediction support.
Comments
Why would you need Omlx? For speed up?
Has extra KV cache on SSD, and lots more options to tweak. There's experimental TurboQuant and multi token prediction support.