If you have a use case where you utilize Hetzner's RTX4000 GPU 24/7/365 around the clock, then it's a great deal. However, I think many people will just load some quantized LLMs into it and call it a few dozen times per day. For the latter use case, €2,200 is a bit too much, I think.
Comments
2208 EUR per year.
I think RTX 3070 is roughly equivivalent to RTX4000 20GB.Time used to setup and maintenance makes this valuable. Otherwise you can just buy similar system and pay for electricity.
If you have a use case where you utilize Hetzner's RTX4000 GPU 24/7/365 around the clock, then it's a great deal. However, I think many people will just load some quantized LLMs into it and call it a few dozen times per day. For the latter use case, €2,200 is a bit too much, I think.