What is the typical job title and/or skillset for this?
It can be any one of many jobs depending on how high close to the metal one's focus is, but the highest headcount role is usually SRE/Infra/Ops with GPU knowledge sprinkled on top. That is to say Linux sysadmin, networking, fleet management, scaling, incident troubleshooting, etc.
Comments
What is the typical job title and/or skillset for this?
I've seen this called MLOps.
MLOps though typically wouldn't been going quantization? It requires some careful testing of accuracy and performance even today.
Applied ML Research Engineer or something maybe, not that I have ever seen that title. Maybe just catchall ML Engineer...
Latent space is calling the whole subject "inference engineering" in their episode https://www.latent.space/p/inference-eng
What is the typical job title and/or skillset for this?
It can be any one of many jobs depending on how high close to the metal one's focus is, but the highest headcount role is usually SRE/Infra/Ops with GPU knowledge sprinkled on top. That is to say Linux sysadmin, networking, fleet management, scaling, incident troubleshooting, etc.