Comment on Benchmarks and comparison of LLM AI models and API hosting providersparentComments−YetAnotherNick2yCan quality score be added for each inference provider for the same model. Many of them use different quantization and approximation so that it's not just price and throughput that's important. Specially for model like Mixtral.
Comments
Can quality score be added for each inference provider for the same model. Many of them use different quantization and approximation so that it's not just price and throughput that's important. Specially for model like Mixtral.