Nice template notebook. It would be really good if by default it used local-first / open LLM models, I see AIConfig currently requires an extension to use these - really I think they should be first class citizens.
Thanks! That’s a great callout. For the gradio experience we package the hugging face AIConfig extension into the gradio-notebook package by default, so you don’t need to import it separately.
For the core AIConfig, we got feedback from people trying to run it on AWS lambda that the package size got too bloated, so we are trying to have an extension ecosystem that allows us to ship the core framework independently of other models (currently it does ship with OpenAI, Google, and Claude by default though).
Would love your feedback on the space itself, as well on AIConfig!
Comments
Nice template notebook. It would be really good if by default it used local-first / open LLM models, I see AIConfig currently requires an extension to use these - really I think they should be first class citizens.
Thanks! That’s a great callout. For the gradio experience we package the hugging face AIConfig extension into the gradio-notebook package by default, so you don’t need to import it separately.
For the core AIConfig, we got feedback from people trying to run it on AWS lambda that the package size got too bloated, so we are trying to have an extension ecosystem that allows us to ship the core framework independently of other models (currently it does ship with OpenAI, Google, and Claude by default though).
Would love your feedback on the space itself, as well on AIConfig!