In this repository, I will implement neural attention mechanisms as I need them.

Supported mechanisms

If I add an algorithm, I will list it here.

• Soft alignments - attention traditionally used for machine translation.