You can override the default OpenAI url using an environment variable (iirc, OPENAI_API_BASE). Any LLM provider / inference server offering an OpenAI-compatible API will work.
Granted they use the `openai` python library (or other library/implementation that uses that same env var), hence my question in the previous-previous comment...
Comments
You can override the default OpenAI url using an environment variable (iirc, OPENAI_API_BASE). Any LLM provider / inference server offering an OpenAI-compatible API will work.
Granted they use the `openai` python library (or other library/implementation that uses that same env var), hence my question in the previous-previous comment...