Comment on Surpassing vLLM with a Generated Inference StackparentComments−lukebechtelOP6moGood questions! It's clear I need to gather more metrics from our next generated inference library.
Comments
Good questions! It's clear I need to gather more metrics from our next generated inference library.