Failure to learn seems almost synonymous with overfitting. It’s the failure to distinguish noise from signal due to lack of data (or just lack of imagination and ability to quickly see the general pattern, or even that there might be one).
That would indeed be a nice use of LLMs, although for mathematics I wouldn’t feel I could trust them not to warp the meaning badly. You’d probably have to check each generation carefully by hand.
Comments
Failure to learn seems almost synonymous with overfitting. It’s the failure to distinguish noise from signal due to lack of data (or just lack of imagination and ability to quickly see the general pattern, or even that there might be one).
That would indeed be a nice use of LLMs, although for mathematics I wouldn’t feel I could trust them not to warp the meaning badly. You’d probably have to check each generation carefully by hand.