I've built a lightweight package that provides a standard interface to the LLM providers, as well as taking care of boilerplate around structured outputs, function calling, and opentelemetry/tracing. It's hopefully a good compromise between ease-of-use and complexity.
Comments
It is indeed a terrible library on multiple levels. Get rid of it. Just use the "native" Python SDK for the LLMs you are using for your POC.
I've built a lightweight package that provides a standard interface to the LLM providers, as well as taking care of boilerplate around structured outputs, function calling, and opentelemetry/tracing. It's hopefully a good compromise between ease-of-use and complexity.
https://github.com/jackmpcollins/magentic