This is wonderful, I have been struggling to find a viable way to deploy private llms, this seems like the perfect option. Thanks for sharing!