If you have a use case where you utilize Hetzner's RTX4000 GPU 24/7/365 around the clock, then it's a great deal. However, I think many people will just load some quantized LLMs into it and call it a few dozen times per day. For the latter use case, €2,200 is a bit too much, I think.
Comments
If you have a use case where you utilize Hetzner's RTX4000 GPU 24/7/365 around the clock, then it's a great deal. However, I think many people will just load some quantized LLMs into it and call it a few dozen times per day. For the latter use case, €2,200 is a bit too much, I think.