Few months back, there was a story here at HN about someone writing just such game to be played over a SSH connection. There were huge problems with the fact that you cannot reliably detect when the user stops pressing a key.

IIRC, it was an action/arcade game, though, so it might be more tolerable for something not twitch-based.