Skip to content

Comment on Training a 3.8B LLM to 0.384 CORE for $998parent

Comments

I think I am on your arc as well. My learning on different topics is growing every day, but there’s a limit to how much I can absorb. With the LLMs the experiments stay just beyond that horizon and I keep chasing.

Stated too strongly, but I think this could be the model for education (some subjects anyway). Everything personalized to your learning goals, grounded in experiments that give a tight feedback loop and with a model that never gets tired of re-explaining something for the 10th time.

Yes they are great for learning at own pace, trying out new things.

I have accepted two things that make me a happy engineer now: AGI is not here no matter what they say and LLMs are still very useful if one knows how to use them.

They are another layer of abstraction and like you said they do not tire. There is a lot of optimization needed so we can reduce wastage (running 1T+ LLMs for most work is wastage).

Guys, you are the 1%; 99% of LLM will be Wall-E.

Haha, I thought about this today. I'm traveling and walked through a university campus. The new students are coming in and I thought wow, wouldn't it be wild to be a fresh in student in the age of AI (it's been a long time since I was college). But, then I thought, actually this could be an incredible time to be a student. If your curious and motivated the agents can be amazing partners. I think the students who crack how to use AI now are going to be the ones who really run the table as this economic wave crests. But, yeah, you're right on with the Wall-E comment. I would guess many (most?) will turn their brain off and then what's the point of even being there?

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.