Comment on GroqchatparentComments−razorguymania2yGPUs can't scale single user performance beyond a certain limit. You can throw 100s of GPUs at it but the latency will never be as good.
Comments
GPUs can't scale single user performance beyond a certain limit. You can throw 100s of GPUs at it but the latency will never be as good.