Comment on The mysterious Hy3 LLM is topping OpenRouter Model Rankings by a large marginparentComments−throwa3562623moI belive no sane provider, antropic and openai included, serve BF16.Side note: I suspect Antropic was experimenting with changing quant level based on server load a few months back which is what caused that major quality drop we saw then.
Comments
I belive no sane provider, antropic and openai included, serve BF16.
Side note: I suspect Antropic was experimenting with changing quant level based on server load a few months back which is what caused that major quality drop we saw then.