Comment on Ask HN: Why call it "inference" instead of just "model hosting"?Comments−dtagames1moLike so many things in computing, we like to make up words and also reuse old ones for completely different things.I'd say "hosting" means making something available to you in the cloud. Model makers don't offer that.They sell "inference," which is a compute task with real hardware costs for them. The task runs against their model, which is not hosted for you.
Comments
Like so many things in computing, we like to make up words and also reuse old ones for completely different things.
I'd say "hosting" means making something available to you in the cloud. Model makers don't offer that.
They sell "inference," which is a compute task with real hardware costs for them. The task runs against their model, which is not hosted for you.