Skip to content

Comment on Fault Tolerant Llama training

Comments

This is awesome, can’t wait to try out these techniques. At least a week a year of my time for the past few years has gone towards recovering from a fault crashing a training run. Sometimes environment related, sometimes shared storage, sometimes just because a slightly faulty IB cable.

Let me know how it goes! If you're interested in chatting / run into any problems feel free to reach out via the links in my profile

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.