Controlling a 3D graph with hand and voice commandstwitter.com 3 pointsgetToTheChopin1 year ago1 commentSaveHideCopy link On HNComments−getToTheChopinOP1yUsing speech recognition to toggle between drag / rotate / zoom interactions, and hand gestures to move the nodes of the graphCreated with threejs, rosebud AI, mediapipe computer vision, web speech API, and Vasco Asturiano's 3D-force-graph libraryRuns in real-time in the browser using a regular laptop + webcamLive demo (works best on chrome desktop): https://rosebud.ai/p/557dbe2b-b037-42df-a137-249f8a57341d
Comments
Using speech recognition to toggle between drag / rotate / zoom interactions, and hand gestures to move the nodes of the graph
Created with threejs, rosebud AI, mediapipe computer vision, web speech API, and Vasco Asturiano's 3D-force-graph library
Runs in real-time in the browser using a regular laptop + webcam
Live demo (works best on chrome desktop): https://rosebud.ai/p/557dbe2b-b037-42df-a137-249f8a57341d