Distributing pre-built images can help minimize this: https://hub.docker.com/r/nezhar/claude-container/tags.

I'm not sure how large the image becomes on the VM or if the distribution process is straightforward.