Skip to content

Comment on Infrastructure setup and open-source scripts to train 70B model from bare metal

Comments

This was discussed on the Latent Space podcast a few days ago: https://www.latent.space/p/llm-training-2024

That was a good episode, worth listening to for hearing justifications behind some of these decisions.

thank you for listening!

im not used to conducting these kinds of interviews and felt out of my depth. please suggestions questions that you felt should have been asked but werent.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.