Comment on Kaist develops next-generation ultra-low power LLM acceleratorparentComments−5424582yIf you believe the marketing material it’s lower. Their API is the cheapest around, so either it’s true or they’re subsidizing.−hackerlight2yAnother consideration: Even if it's slightly more expensive, that can be OK if you care about inference speed. I'd pay 50% more for GPT-4 if it could deliver results that quick.
Comments
If you believe the marketing material it’s lower. Their API is the cheapest around, so either it’s true or they’re subsidizing.
Another consideration: Even if it's slightly more expensive, that can be OK if you care about inference speed. I'd pay 50% more for GPT-4 if it could deliver results that quick.