Comment on Show HN: Deploy Scikit and Keras Models with a Simple Drag and DropComments−ebalit6yI see that you accept models up to 1 GB. It seems the inference time might be high for models of this size on CPUs. Do you use GPUs to speed up inference for deep learning models ?−theo31OP6yWe don’t offer GPU accelerated inference for now. However it’s on our roadmap, sign up for inferrd to get updates!
Comments
I see that you accept models up to 1 GB. It seems the inference time might be high for models of this size on CPUs. Do you use GPUs to speed up inference for deep learning models ?
We don’t offer GPU accelerated inference for now. However it’s on our roadmap, sign up for inferrd to get updates!