DeepSpeed Huggingface Translation Examples

October 13, 2022 ยท View on GitHub

Setup

Python dependencies:

pip install -r requirements.txt

Usage

Examples can be run as follows:

deepspeed --num_gpus [number of GPUs] test-[model].py

Example Output

Command:

deepspeed --num_gpus 1 test-t5-base.py

Output:

[{'translation_text': 'Le renard brun rapide saute au-dessus du chien lazy.'}]