Maybe it is assumed in this video, but Yann Lecun and many other demonstrated how physics remains a big, completely unsolved challenge for LLMs with no solution in sight due to its nature.

But I'm not at all an expert in the domain and I might have misunderstood something please feel free to contradict me!