oh, I'm very aware that I've brought this upon myself, but I'm sticking out for the greater good (and stubbornness.)
specifically, I'm trying to benchmark a bunch of different GPU configurations on different workloads on vast.ai, which uses Docker containers. I abhor Dockerfiles and my experience building containers with nix has been pleasant, so that's what I'm doing and why. fortunately I think I'm getting past the learning curve.
did our channel survive the demise of freenode? I was andares, I think I used to be annoying but I've gotten better.
I finished my work on poetry2nix and submitted a PR which works perfectly (at least with preferWheels=true.) now I have a wonderful live environment with torch, triton, transformers, etc. Docker builds are fast and lightweight since I use buildLayeredImage. it is, truly, the promised land my forefathers prophesized.
Comments
oh, I'm very aware that I've brought this upon myself, but I'm sticking out for the greater good (and stubbornness.)
specifically, I'm trying to benchmark a bunch of different GPU configurations on different workloads on vast.ai, which uses Docker containers. I abhor Dockerfiles and my experience building containers with nix has been pleasant, so that's what I'm doing and why. fortunately I think I'm getting past the learning curve.
did our channel survive the demise of freenode? I was andares, I think I used to be annoying but I've gotten better.
Ah. Hi! Yes. We still exist in the same place but on libera now.
Care to share some of your progress? I have similar (stronger?) feelings regarding Dockerfile's big-ball-of-state nonsense.
(The irony of holding this opinion while dealing with pre-trained AI models is not lost)
I finished my work on poetry2nix and submitted a PR which works perfectly (at least with preferWheels=true.) now I have a wonderful live environment with torch, triton, transformers, etc. Docker builds are fast and lightweight since I use buildLayeredImage. it is, truly, the promised land my forefathers prophesized.