Yes. The whole point is that you have a slow process train the model offline on very large volumes of sample data, then use that trained model to make actual inferences based on data you find in the field. As those models become bigger and more complex, it takes progressively more computing power to run inference on those models. These ML accelerators are effectively the new GPUs — highly specialised processors designed to more efficiently handle highly specialised workloads.
Comments
Yes. The whole point is that you have a slow process train the model offline on very large volumes of sample data, then use that trained model to make actual inferences based on data you find in the field. As those models become bigger and more complex, it takes progressively more computing power to run inference on those models. These ML accelerators are effectively the new GPUs — highly specialised processors designed to more efficiently handle highly specialised workloads.