about-NLP.md

General knowledge

• NLP for You, by Lena Voita. One of the best NLP courses online, really step by step and nice to read.
• The NLP Course, by Hugging Face. Extremely complete, with lots of code snippets so you can get started fast!

Understanding LLM architectures

• The Annotated Encoder Decoder, by Jasmijn Bastings. Walks you through the 2015 Bahdanau paper introducing the encoder decoder with attention for recurrent networks, with code explanations at each step.
• The Annotated Transformers, by Sasha Rush. Walks you through the 2016 Vaswani paper introducing the transformers, with code explanations at each step.
• The Illustrated Transformers, by Jay Alammar. Good complement to the previous link, with visualisations instead of code.
• The Annotated S4, by Sasha Rush. Walks you through the Structured State Space for Sequence Modeling paper, with code at each step. If you've wonder what state spaces models are, take a look!
• A Visual Guide to MoE, by Maarten Grootendorst. First get a read of one of the transformers guide above, then have a look at this guide! A lot of nice visualisations.

Prompting

• Show me the prompt