Comment on DenseFormer: Enhancing Information Flow in TransformersparentComments−quotemstr2yI wonder whether we're missing out on techniques that work well on large models but that don't show promise on small ones−hackerlight2yMore like we're missing out on techniques full stop. Proving things at scale is GPU expensive and gatekeeps publication and therefore accessibility.
Comments
I wonder whether we're missing out on techniques that work well on large models but that don't show promise on small ones
More like we're missing out on techniques full stop. Proving things at scale is GPU expensive and gatekeeps publication and therefore accessibility.