Stemming from OpenAI's APIs being down the last few days (and us being down subsequently), we launched an open source OpenAI + Azure fallback and retry tool: https://github.com/Spryngtime/openai-load-balancer
This open source library helps you mitigate errors & downtime from @OpenAI's APIs by retrying and falling back to Azure (and vice versa).
About 5 minutes to setup - syntatically the exact same as OpenAI's library.
If you need expedited access to Azure, feel free to email me - I can get you connected to our Azure account executive! (Startups with funding ONLY please!)
Comments
Stemming from OpenAI's APIs being down the last few days (and us being down subsequently), we launched an open source OpenAI + Azure fallback and retry tool: https://github.com/Spryngtime/openai-load-balancer
This open source library helps you mitigate errors & downtime from @OpenAI's APIs by retrying and falling back to Azure (and vice versa).
About 5 minutes to setup - syntatically the exact same as OpenAI's library.
If you need expedited access to Azure, feel free to email me - I can get you connected to our Azure account executive! (Startups with funding ONLY please!)
Hope this helps some people out there!