I think you hit the nail on the head.

First step would be to establish a few simple gestures that everyone can learn rather than try to create an entire OS with it.