Skip to content

Comment on Ask HN: Kind of data needed to build a language model?

Comments

I'd recommend to look at the FastAi NLP course[1]. The relevant lessons are videos 8, 9 and crucially - 10. (the first minutes is about an ethics conference, then the lecture starts in earnest). Basically, you can then do similar things using HuggingFace, as indeed many have (you can explore the models in their hub)[2]

[1] https://www.youtube.com/playlist?list=PLtmWHNX-gukKocXQOkQju...

[2] https://github.com/huggingface/notebooks/blob/main/examples/...

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.