Totally. With computer vision especially, you often want to deploy the model on an edge device with limited bandwidth, power, and footprint (think remote camera monitoring, drones, robots, and autonomous vehicles).
Requiring a huge desktop or server-grade graphics card (much less a box full of many of them) to fit the model into memory misses the mark.
We’ve done a lot of work getting models to be performant on the Luxonis OAK (OpenCV AI Kit) and NVIDIA Jetson devices.
Comments
Totally. With computer vision especially, you often want to deploy the model on an edge device with limited bandwidth, power, and footprint (think remote camera monitoring, drones, robots, and autonomous vehicles).
Requiring a huge desktop or server-grade graphics card (much less a box full of many of them) to fit the model into memory misses the mark.
We’ve done a lot of work getting models to be performant on the Luxonis OAK (OpenCV AI Kit) and NVIDIA Jetson devices.