Aider sounds like a cool tool, I'll have to try it out. I'm assuming it makes use of your local files and edits them for you?

Are there any other programming assistant packages that use the chatgpt api like this?

Regarding rate limits, it might be an idea to have configurable delays built in to the testing code to prevent hitting limits.