Comment on Retrospectively Reverse-Engineering Apple's Neural EngineComments−hn9zmdcaou9hPorted a transformer to ANE and the whole job was pretending it was a CNN, 4D tensors with seq in the last axis and 1x1 convs instead of matmuls.
Comments
Ported a transformer to ANE and the whole job was pretending it was a CNN, 4D tensors with seq in the last axis and 1x1 convs instead of matmuls.