Comment on Pretraining Under Infinite ComputeComments−jedharrisOP11mo"Our results show that simple algorithmic improvements can enable significantly more data-efficient pre-training in a compute-rich future."
Comments
"Our results show that simple algorithmic improvements can enable significantly more data-efficient pre-training in a compute-rich future."