Linear-Transformer

January 7, 2021 ยท View on GitHub

Transformer are RNNs: Fast Autoregressive Transformer with Linear Attention