Setup

Python dependencies:

pip install -r requirements.txt

Usage

Examples can be run as follows:

deepspeed --num_gpus [number of GPUs] test-[model].py

Example Output

Command:

deepspeed --num_gpus 1 test-t5.py

Output:

[{'generated_text': 'd review: this is the best cast iron skillet. Great review! Great review! Great'}]