DeepSpeed Huggingface Translation Examples
October 13, 2022 ยท View on GitHub
Setup
Python dependencies:
pip install -r requirements.txt
Usage
Examples can be run as follows:
deepspeed --num_gpus [number of GPUs] test-[model].py
Example Output
Command:
deepspeed --num_gpus 1 test-t5-base.py
Output:
[{'translation_text': 'Le renard brun rapide saute au-dessus du chien lazy.'}]