Errbit can literally be set up in 5 or 10 minutes. Either on Heroku or on your own server. And if you are currently using Airbrake in your Rails app, all you need to do is add one line to your config, and it's done.

That's a great point about Heroku though - there should definitely be an open source EC2 framework that provides a similar infrastructure...