Skip to content

Comment on Show HN: Self-host open-source LLMs on AWS with scale-to-zero

Comments

What happens when AWS interrupts a Spot instance? I don't see an ASG in the architecture — does the controller detect the terminated worker and provision a replacement automatically?

Great question. The controller provision a replacement automatically. The controller runs continuous health-check polls against the worker’s, if it doesn't respond, provisions a new one.

Why not use a AASG?

I chose to use a controller to make the solution cloud agnostic.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.