Running big LLMs is expensive, but not nearly expensive as hiring people. Employees are very expensive, well beyond their wages that you see. Everything from employment taxes (employer paid) to hiring additional people to manage the people and their HR needs.
Even if it took $10 to run everything to handle each request, that’s far cheaper than even a minimum wage employee when you consider all of the employment overhead.
Comments
Running big LLMs is expensive, but not nearly expensive as hiring people. Employees are very expensive, well beyond their wages that you see. Everything from employment taxes (employer paid) to hiring additional people to manage the people and their HR needs.
Even if it took $10 to run everything to handle each request, that’s far cheaper than even a minimum wage employee when you consider all of the employment overhead.