Comment on Deploy dedicated DeepSeek 32B on L40 GPUs ($8/hour)Comments−ashenWon1yIs this running ollama, vllm or sglang under the hood? Curious about these performance numbers.
Comments
Is this running ollama, vllm or sglang under the hood? Curious about these performance numbers.