This Repo conduct three NLP task: Neural Machine Translation, Abstractive Summarization, and Language Modeling.

Requirements and Installation

• PyTorch version == 1.8
• Python version >= 3.6

To install fairseq from source and develop locally:

git clone https://github.com/dropreg/R-Drop.git
cd R-Drop/fairseq_src/
pip install --editable .

Examples

• Nerual Translation Task: R-Drop transformer models are available
• Abstractive Summarization Task: R-Drop transformer models are available
• Language Modeling Task: R-Drop transformer models are available