Model Benchmarks

September 13, 2022 ยท View on GitHub

Quick Start

cd codewithgpu/benchmarks
python bench_model.py -f ./results.json

For more usages, see "--help" argument:

python bench_model.py --help

Training Baselines

ResNet50

BackendDevicePrecPerf (TFLOPS)Time (FPS)
torch_vmM1 ProFP324.661
torch_vmTITAN VFP16110661
torch_vmTITAN VFP3214.9289

ViT-Base

BackendDevicePrecPerf (TFLOPS)Time (FPS)
torch_vmM1 ProFP324.622
torch_vmTITAN VFP16110333
torch_vmTITAN VFP3214.986

MobileNetV3

BackendDevicePrecPerf (TFLOPS)Time (FPS)
torch_vmM1 ProFP324.685
torch_vmTITAN VFP161101527
torch_vmTITAN VFP3214.9878

Inference Baselines

ResNet50

BackendDevicePrecPerf (TFLOPS)Time (FPS)
torch_vmM1 ProFP324.6214
torch_vmTITAN VFP161102071
torch_vmTITAN VFP3214.9940

ViT-Base

BackendDevicePrecPerf (TFLOPS)Time (FPS)
torch_vmM1 ProFP324.661
torch_vmTITAN VFP161101033
torch_vmTITAN VFP3214.9262

MobileNetV3

BackendDevicePrecPerf (TFLOPS)Time (FPS)
torch_vmM1 ProFP324.6382
torch_vmTITAN VFP161106504
torch_vmTITAN VFP3214.93807