Comment on LeJEPA: Provable and Scalable Self-Supervised Learning Without the HeuristicsComments−XTXinverseXTYOP9moSeems like this signals Yann Lecun's direction now that he's leaving MetaThe EMA teacher model still seems like black magic to me (present in DINO and JEPA series but gone now)
Comments
Seems like this signals Yann Lecun's direction now that he's leaving Meta
The EMA teacher model still seems like black magic to me (present in DINO and JEPA series but gone now)