Comment on DenseFormer: Enhancing Information Flow in TransformersComments−matteopagli2yI'm one of the authors, happy to answer questions.−EvkoGS2yIs it possible to combine your approach with NATTEN? It seems that both approaches are optimizing from different directions and can be combined with significant throughput and small performance improvements?
Comments
I'm one of the authors, happy to answer questions.
Is it possible to combine your approach with NATTEN? It seems that both approaches are optimizing from different directions and can be combined with significant throughput and small performance improvements?