Exercise ball is cheap, but you probably won't use it very long (if you're anything like me).

Standing desk is more expensive but probably more effective.