Benchmark Report
November 26, 2020 ยท View on GitHub
We have tested kinds of neural network models with Bolt(v1.0.0) on HUAWEI 810 mobile phone and HUAWEI 990 mobile phone respectively. The benchmark data are given under different operating systems, different computing cores, and different inference accuracy. For more detailed evaluation data, please refer to the following table.
| Model | Framework | Os | Compiler | Kirin Soc Version | Core | Precision | Cpu or Gpu | Thread | Input Size | avg_time |
|---|---|---|---|---|---|---|---|---|---|---|
| tinybert | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp32 | cpu | 1 | 32+32+32 | 16.605225 |
| tinybert | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp16 | cpu | 1 | 32+32+32 | 9.114014 |
| tinybert | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | int8 | cpu | 1 | 32+32+32 | 7.108154 |
| tinybert | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp32 | cpu | 1 | 32+32+32 | 4.708984 |
| tinybert | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp16 | cpu | 1 | 32+32+32 | 3.208984 |
| tinybert | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | int8 | cpu | 1 | 32+32+32 | 2.205811 |
| tinybert | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp32 | cpu | 1 | 32+32+32 | 17.630127 |
| tinybert | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp16 | cpu | 1 | 32+32+32 | 9.800049 |
| tinybert | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | int8 | cpu | 1 | 32+32+32 | 7.642090 |
| tinybert | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp32 | cpu | 1 | 32+32+32 | 4.029053 |
| tinybert | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp16 | cpu | 1 | 32+32+32 | 2.835938 |
| tinybert | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | int8 | cpu | 1 | 32+32+32 | 1.875977 |
| tinybert | caffe | ubuntu16_04 | llvm | 810 | A55 | fp32 | cpu | 1 | 32+32+32 | 16.586914 |
| tinybert | caffe | ubuntu16_04 | llvm | 810 | A55 | fp16 | cpu | 1 | 32+32+32 | 9.926025 |
| tinybert | caffe | ubuntu16_04 | llvm | 810 | A55 | int8 | cpu | 1 | 32+32+32 | 8.780029 |
| tinybert | caffe | ubuntu16_04 | llvm | 810 | A76 | fp32 | cpu | 1 | 32+32+32 | 4.817139 |
| tinybert | caffe | ubuntu16_04 | llvm | 810 | A76 | fp16 | cpu | 1 | 32+32+32 | 3.411133 |
| tinybert | caffe | ubuntu16_04 | llvm | 810 | A76 | int8 | cpu | 1 | 32+32+32 | 2.603027 |
| tinybert | caffe | ubuntu16_04 | llvm | 990 | A55 | fp32 | cpu | 1 | 32+32+32 | 17.857910 |
| tinybert | caffe | ubuntu16_04 | llvm | 990 | A55 | fp16 | cpu | 1 | 32+32+32 | 10.166016 |
| tinybert | caffe | ubuntu16_04 | llvm | 990 | A55 | int8 | cpu | 1 | 32+32+32 | 9.524902 |
| tinybert | caffe | ubuntu16_04 | llvm | 990 | A76 | fp32 | cpu | 1 | 32+32+32 | 4.157959 |
| tinybert | caffe | ubuntu16_04 | llvm | 990 | A76 | fp16 | cpu | 1 | 32+32+32 | 2.849854 |
| tinybert | caffe | ubuntu16_04 | llvm | 990 | A76 | int8 | cpu | 1 | 32+32+32 | 2.161865 |
| nmt | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp32 | cpu | 1 | 32+32+32 | 642.424072 |
| nmt | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp16 | cpu | 1 | 32+32+32 | 356.841064 |
| nmt | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp32 | cpu | 1 | 32+32+32 | 232.143066 |
| nmt | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp16 | cpu | 1 | 32+32+32 | 116.806885 |
| nmt | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp32 | cpu | 1 | 32+32+32 | 710.650879 |
| nmt | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp16 | cpu | 1 | 32+32+32 | 373.492920 |
| nmt | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp32 | cpu | 1 | 32+32+32 | 188.436035 |
| nmt | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp16 | cpu | 1 | 32+32+32 | 95.020996 |
| nmt | caffe | ubuntu16_04 | llvm | 810 | A55 | fp32 | cpu | 1 | 32+32+32 | 656.012939 |
| nmt | caffe | ubuntu16_04 | llvm | 810 | A55 | fp16 | cpu | 1 | 32+32+32 | 355.530029 |
| nmt | caffe | ubuntu16_04 | llvm | 810 | A76 | fp32 | cpu | 1 | 32+32+32 | 233.974854 |
| nmt | caffe | ubuntu16_04 | llvm | 810 | A76 | fp16 | cpu | 1 | 32+32+32 | 120.966797 |
| nmt | caffe | ubuntu16_04 | llvm | 990 | A55 | fp32 | cpu | 1 | 32+32+32 | 694.150146 |
| nmt | caffe | ubuntu16_04 | llvm | 990 | A55 | fp16 | cpu | 1 | 32+32+32 | 370.792969 |
| nmt | caffe | ubuntu16_04 | llvm | 990 | A76 | fp32 | cpu | 1 | 32+32+32 | 191.239014 |
| nmt | caffe | ubuntu16_04 | llvm | 990 | A76 | fp16 | cpu | 1 | 32+32+32 | 96.389893 |
| ghostnet | onnx | ubuntu16_04 | gcc8.3 | 810 | A55 | fp32 | cpu | 1 | 1/3/224/224 | 59.0912 |
| ghostnet | onnx | ubuntu16_04 | gcc8.3 | 810 | A55 | fp16 | cpu | 1 | 1/3/224/224 | 29.1388 |
| ghostnet | onnx | ubuntu16_04 | gcc8.3 | 810 | A76 | fp32 | cpu | 1 | 1/3/224/224 | 18.4675 |
| ghostnet | onnx | ubuntu16_04 | gcc8.3 | 810 | A76 | fp16 | cpu | 1 | 1/3/224/224 | 8.85982 |
| ghostnet | onnx | ubuntu16_04 | gcc8.3 | 990 | A55 | fp32 | cpu | 1 | 1/3/224/224 | 59.8203 |
| ghostnet | onnx | ubuntu16_04 | gcc8.3 | 990 | A55 | fp16 | cpu | 1 | 1/3/224/224 | 28.1741 |
| ghostnet | onnx | ubuntu16_04 | gcc8.3 | 990 | A76 | fp32 | cpu | 1 | 1/3/224/224 | 13.4824 |
| ghostnet | onnx | ubuntu16_04 | gcc8.3 | 990 | A76 | fp16 | cpu | 1 | 1/3/224/224 | 7.01458 |
| ghostnet | onnx | ubuntu16_04 | llvm | 810 | A55 | fp32 | cpu | 1 | 1/3/224/224 | 67.9283 |
| ghostnet | onnx | ubuntu16_04 | llvm | 810 | A55 | fp16 | cpu | 1 | 1/3/224/224 | 33.2657 |
| ghostnet | onnx | ubuntu16_04 | llvm | 810 | A76 | fp32 | cpu | 1 | 1/3/224/224 | 18.8378 |
| ghostnet | onnx | ubuntu16_04 | llvm | 810 | A76 | fp16 | cpu | 1 | 1/3/224/224 | 9.45095 |
| ghostnet | onnx | ubuntu16_04 | llvm | 990 | A55 | fp32 | cpu | 1 | 1/3/224/224 | 61.4079 |
| ghostnet | onnx | ubuntu16_04 | llvm | 990 | A55 | fp16 | cpu | 1 | 1/3/224/224 | 29.9928 |
| ghostnet | onnx | ubuntu16_04 | llvm | 990 | A76 | fp32 | cpu | 1 | 1/3/224/224 | 14.0345 |
| ghostnet | onnx | ubuntu16_04 | llvm | 990 | A76 | fp16 | cpu | 1 | 1/3/224/224 | 7.38781 |
| mobilenet_v1 | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp32 | cpu | 1 | 1/3/224/224 | 157.002292 |
| mobilenet_v1 | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp16 | cpu | 1 | 1/3/224/224 | 58.171620 |
| mobilenet_v1 | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp32 | cpu | 1 | 1/3/224/224 | 39.825202 |
| mobilenet_v1 | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp16 | cpu | 1 | 1/3/224/224 | 19.578837 |
| mobilenet_v1 | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp32 | cpu | 1 | 1/3/224/224 | 162.878805 |
| mobilenet_v1 | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp16 | cpu | 1 | 1/3/224/224 | 60.626796 |
| mobilenet_v1 | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp32 | cpu | 1 | 1/3/224/224 | 34.055518 |
| mobilenet_v1 | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp16 | cpu | 1 | 1/3/224/224 | 16.632785 |
| mobilenet_v1 | caffe | ubuntu16_04 | llvm | 810 | A55 | fp32 | cpu | 1 | 1/3/224/224 | 146.566687 |
| mobilenet_v1 | caffe | ubuntu16_04 | llvm | 810 | A55 | fp16 | cpu | 1 | 1/3/224/224 | 56.444002 |
| mobilenet_v1 | caffe | ubuntu16_04 | llvm | 810 | A76 | fp32 | cpu | 1 | 1/3/224/224 | 41.474450 |
| mobilenet_v1 | caffe | ubuntu16_04 | llvm | 810 | A76 | fp16 | cpu | 1 | 1/3/224/224 | 19.824521 |
| mobilenet_v1 | caffe | ubuntu16_04 | llvm | 990 | A55 | fp32 | cpu | 1 | 1/3/224/224 | 154.871895 |
| mobilenet_v1 | caffe | ubuntu16_04 | llvm | 990 | A55 | fp16 | cpu | 1 | 1/3/224/224 | 58.995204 |
| mobilenet_v1 | caffe | ubuntu16_04 | llvm | 990 | A76 | fp32 | cpu | 1 | 1/3/224/224 | 35.317029 |
| mobilenet_v1 | caffe | ubuntu16_04 | llvm | 990 | A76 | fp16 | cpu | 1 | 1/3/224/224 | 17.012493 |
| mobilenet_v2 | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp32 | cpu | 1 | 1/3/224/224 | 128.224905 |
| mobilenet_v2 | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp16 | cpu | 1 | 1/3/224/224 | 52.524629 |
| mobilenet_v2 | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp32 | cpu | 1 | 1/3/224/224 | 37.341060 |
| mobilenet_v2 | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp16 | cpu | 1 | 1/3/224/224 | 17.874094 |
| mobilenet_v2 | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp32 | cpu | 1 | 1/3/224/224 | 133.358493 |
| mobilenet_v2 | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp16 | cpu | 1 | 1/3/224/224 | 54.601522 |
| mobilenet_v2 | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp32 | cpu | 1 | 1/3/224/224 | 30.195150 |
| mobilenet_v2 | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp16 | cpu | 1 | 1/3/224/224 | 14.732285 |
| mobilenet_v2 | caffe | ubuntu16_04 | llvm | 810 | A55 | fp32 | cpu | 1 | 1/3/224/224 | 128.164528 |
| mobilenet_v2 | caffe | ubuntu16_04 | llvm | 810 | A55 | fp16 | cpu | 1 | 1/3/224/224 | 52.918264 |
| mobilenet_v2 | caffe | ubuntu16_04 | llvm | 810 | A76 | fp32 | cpu | 1 | 1/3/224/224 | 39.283749 |
| mobilenet_v2 | caffe | ubuntu16_04 | llvm | 810 | A76 | fp16 | cpu | 1 | 1/3/224/224 | 18.219124 |
| mobilenet_v2 | caffe | ubuntu16_04 | llvm | 990 | A55 | fp32 | cpu | 1 | 1/3/224/224 | 135.029091 |
| mobilenet_v2 | caffe | ubuntu16_04 | llvm | 990 | A55 | fp16 | cpu | 1 | 1/3/224/224 | 53.469070 |
| mobilenet_v2 | caffe | ubuntu16_04 | llvm | 990 | A76 | fp32 | cpu | 1 | 1/3/224/224 | 31.188000 |
| mobilenet_v2 | caffe | ubuntu16_04 | llvm | 990 | A76 | fp16 | cpu | 1 | 1/3/224/224 | 14.823740 |
| squeezenet | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp32 | cpu | 1 | 1/3/224/224 | 81.188454 |
| squeezenet | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp16 | cpu | 1 | 1/3/224/224 | 41.068093 |
| squeezenet | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | int8 | cpu | 1 | 1/3/224/224 | 40.926114 |
| squeezenet | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp32 | cpu | 1 | 1/3/224/224 | 22.351720 |
| squeezenet | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp16 | cpu | 1 | 1/3/224/224 | 12.302643 |
| squeezenet | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | int8 | cpu | 1 | 1/3/224/224 | 12.866001 |
| squeezenet | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp32 | cpu | 1 | 1/3/224/224 | 83.545513 |
| squeezenet | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp16 | cpu | 1 | 1/3/224/224 | 38.876539 |
| squeezenet | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | int8 | cpu | 1 | 1/3/224/224 | 42.012501 |
| squeezenet | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp32 | cpu | 1 | 1/3/224/224 | 18.350247 |
| squeezenet | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp16 | cpu | 1 | 1/3/224/224 | 10.457777 |
| squeezenet | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | int8 | cpu | 1 | 1/3/224/224 | 10.791769 |
| squeezenet | caffe | ubuntu16_04 | llvm | 810 | A55 | fp32 | cpu | 1 | 1/3/224/224 | 87.881422 |
| squeezenet | caffe | ubuntu16_04 | llvm | 810 | A55 | fp16 | cpu | 1 | 1/3/224/224 | 41.555842 |
| squeezenet | caffe | ubuntu16_04 | llvm | 810 | A55 | int8 | cpu | 1 | 1/3/224/224 | 42.674965 |
| squeezenet | caffe | ubuntu16_04 | llvm | 810 | A76 | fp32 | cpu | 1 | 1/3/224/224 | 23.652636 |
| squeezenet | caffe | ubuntu16_04 | llvm | 810 | A76 | fp16 | cpu | 1 | 1/3/224/224 | 12.840966 |
| squeezenet | caffe | ubuntu16_04 | llvm | 990 | A55 | fp32 | cpu | 1 | 1/3/224/224 | 83.131129 |
| squeezenet | caffe | ubuntu16_04 | llvm | 990 | A55 | fp16 | cpu | 1 | 1/3/224/224 | 40.010485 |
| squeezenet | caffe | ubuntu16_04 | llvm | 990 | A55 | int8 | cpu | 1 | 1/3/224/224 | 42.526015 |
| squeezenet | caffe | ubuntu16_04 | llvm | 990 | A76 | fp32 | cpu | 1 | 1/3/224/224 | 18.508339 |
| squeezenet | caffe | ubuntu16_04 | llvm | 990 | A76 | fp16 | cpu | 1 | 1/3/224/224 | 10.512915 |
| squeezenet | caffe | ubuntu16_04 | llvm | 990 | A76 | int8 | cpu | 1 | 1/3/224/224 | 10.664495 |
| resnet50 | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp32 | cpu | 1 | 1/3/224/224 | 671.152633 |
| resnet50 | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp16 | cpu | 1 | 1/3/224/224 | 285.339836 |
| resnet50 | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | int8 | cpu | 1 | 1/3/224/224 | 392.863447 |
| resnet50 | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | int8 | cpu | 1 | 1/3/224/224 | 238.454521 |
| resnet50 | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp32 | cpu | 1 | 1/3/224/224 | 704.473506 |
| resnet50 | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp16 | cpu | 1 | 1/3/224/224 | 305.267536 |
| resnet50 | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | int8 | cpu | 1 | 1/3/224/224 | 415.956299 |
| resnet50 | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp32 | cpu | 1 | 1/3/224/224 | 163.979900 |
| resnet50 | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp16 | cpu | 1 | 1/3/224/224 | 84.558313 |
| resnet50 | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | int8 | cpu | 1 | 1/3/224/224 | 107.986291 |
| resnet50 | caffe | ubuntu16_04 | llvm | 810 | A55 | fp32 | cpu | 1 | 1/3/224/224 | 659.161729 |
| resnet50 | caffe | ubuntu16_04 | llvm | 810 | A55 | fp16 | cpu | 1 | 1/3/224/224 | 291.172460 |
| resnet50 | caffe | ubuntu16_04 | llvm | 810 | A55 | int8 | cpu | 1 | 1/3/224/224 | 364.732873 |
| resnet50 | caffe | ubuntu16_04 | llvm | 810 | A76 | fp32 | cpu | 1 | 1/3/224/224 | 192.280511 |
| resnet50 | caffe | ubuntu16_04 | llvm | 810 | A76 | fp16 | cpu | 1 | 1/3/224/224 | 104.545466 |
| resnet50 | caffe | ubuntu16_04 | llvm | 810 | A76 | int8 | cpu | 1 | 1/3/224/224 | 106.067036 |
| resnet50 | caffe | ubuntu16_04 | llvm | 990 | A55 | fp32 | cpu | 1 | 1/3/224/224 | 696.839442 |
| resnet50 | caffe | ubuntu16_04 | llvm | 990 | A55 | fp16 | cpu | 1 | 1/3/224/224 | 305.819625 |
| resnet50 | caffe | ubuntu16_04 | llvm | 990 | A55 | int8 | cpu | 1 | 1/3/224/224 | 384.351028 |
| resnet50 | caffe | ubuntu16_04 | llvm | 990 | A76 | fp32 | cpu | 1 | 1/3/224/224 | 162.355430 |
| resnet50 | caffe | ubuntu16_04 | llvm | 990 | A76 | fp16 | cpu | 1 | 1/3/224/224 | 85.032211 |
| resnet50 | caffe | ubuntu16_04 | llvm | 990 | A76 | int8 | cpu | 1 | 1/3/224/224 | 87.458490 |
| mobilenet_v3 | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp32 | cpu | 1 | 1/3/224/224 | 26.322640 |
| mobilenet_v3 | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp16 | cpu | 1 | 1/3/224/224 | 13.424403 |
| mobilenet_v3 | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp32 | cpu | 1 | 1/3/224/224 | 6.937206 |
| mobilenet_v3 | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp16 | cpu | 1 | 1/3/224/224 | 4.120585 |
| mobilenet_v3 | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp32 | cpu | 1 | 1/3/224/224 | 27.295058 |
| mobilenet_v3 | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp16 | cpu | 1 | 1/3/224/224 | 14.080605 |
| mobilenet_v3 | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp32 | cpu | 1 | 1/3/224/224 | 5.702913 |
| mobilenet_v3 | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp16 | cpu | 1 | 1/3/224/224 | 3.402296 |
| mobilenet_v3 | caffe | ubuntu16_04 | llvm | 810 | A55 | fp32 | cpu | 1 | 1/3/224/224 | 27.603806 |
| mobilenet_v3 | caffe | ubuntu16_04 | llvm | 810 | A55 | fp16 | cpu | 1 | 1/3/224/224 | 13.785805 |
| mobilenet_v3 | caffe | ubuntu16_04 | llvm | 810 | A76 | fp32 | cpu | 1 | 1/3/224/224 | 7.579590 |
| mobilenet_v3 | caffe | ubuntu16_04 | llvm | 810 | A76 | fp16 | cpu | 1 | 1/3/224/224 | 4.360988 |
| mobilenet_v3 | caffe | ubuntu16_04 | llvm | 990 | A55 | fp32 | cpu | 1 | 1/3/224/224 | 29.233688 |
| mobilenet_v3 | caffe | ubuntu16_04 | llvm | 990 | A55 | fp16 | cpu | 1 | 1/3/224/224 | 14.552715 |
| mobilenet_v3 | caffe | ubuntu16_04 | llvm | 990 | A76 | fp32 | cpu | 1 | 1/3/224/224 | 6.072735 |
| mobilenet_v3 | caffe | ubuntu16_04 | llvm | 990 | A76 | fp16 | cpu | 1 | 1/3/224/224 | 3.545582 |
| asr_rnnt | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp32 | cpu | 1 | / | 1394.038574 |
| asr_rnnt | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp16 | cpu | 1 | / | 647.142578 |
| asr_rnnt | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp32 | cpu | 1 | / | 491.428833 |
| asr_rnnt | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp16 | cpu | 1 | / | 253.110596 |
| asr_rnnt | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp32 | cpu | 1 | / | 1431.238037 |
| asr_rnnt | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp16 | cpu | 1 | / | 717.116455 |
| asr_rnnt | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp32 | cpu | 1 | / | 406.063965 |
| asr_rnnt | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp16 | cpu | 1 | / | 201.946533 |
| asr_rnnt | caffe | ubuntu16_04 | llvm | 810 | A55 | fp32 | cpu | 1 | / | 1373.467163 |
| asr_rnnt | caffe | ubuntu16_04 | llvm | 810 | A55 | fp16 | cpu | 1 | / | 645.445068 |
| asr_rnnt | caffe | ubuntu16_04 | llvm | 810 | A76 | fp32 | cpu | 1 | / | 513.895874 |
| asr_rnnt | caffe | ubuntu16_04 | llvm | 810 | A76 | fp16 | cpu | 1 | / | 258.136353 |
| asr_rnnt | caffe | ubuntu16_04 | llvm | 990 | A55 | fp32 | cpu | 1 | / | 1390.146973 |
| asr_rnnt | caffe | ubuntu16_04 | llvm | 990 | A55 | fp16 | cpu | 1 | / | 689.771851 |
| asr_rnnt | caffe | ubuntu16_04 | llvm | 990 | A76 | fp32 | cpu | 1 | / | 407.601929 |
| asr_rnnt | caffe | ubuntu16_04 | llvm | 990 | A76 | fp16 | cpu | 1 | / | 204.034424 |
| asr_convolution_transformer_encoder | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp32 | cpu | 1 | / | 73.672119 |
| asr_convolution_transformer_encoder | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp16 | cpu | 1 | / | 38.642822 |
| asr_convolution_transformer_encoder | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp32 | cpu | 1 | / | 20.154053 |
| asr_convolution_transformer_encoder | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp16 | cpu | 1 | / | 11.269043 |
| asr_convolution_transformer_encoder | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp32 | cpu | 1 | / | 80.286865 |
| asr_convolution_transformer_encoder | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp16 | cpu | 1 | / | 43.187988 |
| asr_convolution_transformer_encoder | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp32 | cpu | 1 | / | 17.701904 |
| asr_convolution_transformer_encoder | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp16 | cpu | 1 | / | 9.718018 |
| asr_convolution_transformer_encoder | caffe | ubuntu16_04 | llvm | 810 | A55 | fp32 | cpu | 1 | / | 70.837158 |
| asr_convolution_transformer_encoder | caffe | ubuntu16_04 | llvm | 810 | A55 | fp16 | cpu | 1 | / | 38.571045 |
| asr_convolution_transformer_encoder | caffe | ubuntu16_04 | llvm | 810 | A76 | fp32 | cpu | 1 | / | 20.748047 |
| asr_convolution_transformer_encoder | caffe | ubuntu16_04 | llvm | 810 | A76 | fp16 | cpu | 1 | / | 11.482910 |
| asr_convolution_transformer_encoder | caffe | ubuntu16_04 | llvm | 990 | A55 | fp32 | cpu | 1 | / | 78.658203 |
| asr_convolution_transformer_encoder | caffe | ubuntu16_04 | llvm | 990 | A55 | fp16 | cpu | 1 | / | 41.130127 |
| asr_convolution_transformer_encoder | caffe | ubuntu16_04 | llvm | 990 | A76 | fp32 | cpu | 1 | / | 17.866943 |
| asr_convolution_transformer_encoder | caffe | ubuntu16_04 | llvm | 990 | A76 | fp16 | cpu | 1 | / | 9.725830 |
| asr_convolution_transformer_joint_net | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp32 | cpu | 1 | / | 1.088867 |
| asr_convolution_transformer_joint_net | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp16 | cpu | 1 | / | 0.776123 |
| asr_convolution_transformer_joint_net | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp32 | cpu | 1 | / | 0.474121 |
| asr_convolution_transformer_joint_net | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp16 | cpu | 1 | / | 0.277832 |
| asr_convolution_transformer_joint_net | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp32 | cpu | 1 | / | 1.187012 |
| asr_convolution_transformer_joint_net | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp16 | cpu | 1 | / | 0.599854 |
| asr_convolution_transformer_joint_net | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp32 | cpu | 1 | / | 0.366211 |
| asr_convolution_transformer_joint_net | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp16 | cpu | 1 | / | 0.197021 |
| asr_convolution_transformer_prediction_net | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp32 | cpu | 1 | / | 12.655029 |
| asr_convolution_transformer_prediction_net | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp16 | cpu | 1 | / | 5.782227 |
| asr_convolution_transformer_prediction_net | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp32 | cpu | 1 | / | 3.854980 |
| asr_convolution_transformer_prediction_net | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp16 | cpu | 1 | / | 2.052002 |
| asr_convolution_transformer_prediction_net | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp32 | cpu | 1 | / | 12.645996 |
| asr_convolution_transformer_prediction_net | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp16 | cpu | 1 | / | 6.840088 |
| asr_convolution_transformer_prediction_net | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp32 | cpu | 1 | / | 3.276123 |
| asr_convolution_transformer_prediction_net | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp16 | cpu | 1 | / | 1.738037 |
| asr_convolution_transformer_prediction_net | caffe | ubuntu16_04 | llvm | 810 | A55 | fp32 | cpu | 1 | / | 11.480957 |
| asr_convolution_transformer_prediction_net | caffe | ubuntu16_04 | llvm | 810 | A55 | fp16 | cpu | 1 | / | 6.652100 |
| asr_convolution_transformer_prediction_net | caffe | ubuntu16_04 | llvm | 810 | A76 | fp32 | cpu | 1 | / | 3.854004 |
| asr_convolution_transformer_prediction_net | caffe | ubuntu16_04 | llvm | 810 | A76 | fp16 | cpu | 1 | / | 2.174072 |
| asr_convolution_transformer_prediction_net | caffe | ubuntu16_04 | llvm | 990 | A55 | fp32 | cpu | 1 | / | 12.539062 |
| asr_convolution_transformer_prediction_net | caffe | ubuntu16_04 | llvm | 990 | A55 | fp16 | cpu | 1 | / | 6.432129 |
| asr_convolution_transformer_prediction_net | caffe | ubuntu16_04 | llvm | 990 | A76 | fp32 | cpu | 1 | / | 3.377930 |
| asr_convolution_transformer_prediction_net | caffe | ubuntu16_04 | llvm | 990 | A76 | fp16 | cpu | 1 | / | 1.842041 |
| birealnet18 | onnx | ubuntu16_04 | gcc8.3 | 810 | A55 | fp16 | cpu | 1 | / | 68.122700 |
| birealnet18 | onnx | ubuntu16_04 | gcc8.3 | 810 | A76 | fp16 | cpu | 1 | / | 27.371033 |
| birealnet18 | onnx | ubuntu16_04 | gcc8.3 | 990 | A55 | fp16 | cpu | 1 | / | 72.439991 |
| birealnet18 | onnx | ubuntu16_04 | gcc8.3 | 990 | A76 | fp16 | cpu | 1 | / | 22.747310 |
| birealnet18 | onnx | ubuntu16_04 | llvm | 810 | A55 | fp16 | cpu | 1 | / | 64.079100 |
| birealnet18 | onnx | ubuntu16_04 | llvm | 810 | A76 | fp16 | cpu | 1 | / | 23.102961 |
| birealnet18 | onnx | ubuntu16_04 | llvm | 990 | A55 | fp16 | cpu | 1 | / | 68.148505 |
| birealnet18 | onnx | ubuntu16_04 | llvm | 990 | A76 | fp16 | cpu | 1 | / | 19.146468 |
| fingerprint_resnet18 | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp32 | cpu | 1 | / | 10.235107 |
| fingerprint_resnet18 | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp16 | cpu | 1 | / | 5.970947 |
| fingerprint_resnet18 | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp32 | cpu | 1 | / | 2.722900 |
| fingerprint_resnet18 | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp16 | cpu | 1 | / | 1.936035 |
| fingerprint_resnet18 | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp32 | cpu | 1 | / | 10.719971 |
| fingerprint_resnet18 | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp16 | cpu | 1 | / | 6.263916 |
| fingerprint_resnet18 | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp32 | cpu | 1 | / | 2.169189 |
| fingerprint_resnet18 | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp16 | cpu | 1 | / | 1.608887 |
| fingerprint_resnet18 | caffe | ubuntu16_04 | llvm | 810 | A55 | fp32 | cpu | 1 | / | 9.856934 |
| fingerprint_resnet18 | caffe | ubuntu16_04 | llvm | 810 | A55 | fp16 | cpu | 1 | / | 6.613037 |
| fingerprint_resnet18 | caffe | ubuntu16_04 | llvm | 810 | A76 | fp32 | cpu | 1 | / | 2.770996 |
| fingerprint_resnet18 | caffe | ubuntu16_04 | llvm | 810 | A76 | fp16 | cpu | 1 | / | 1.895996 |
| fingerprint_resnet18 | caffe | ubuntu16_04 | llvm | 990 | A55 | fp32 | cpu | 1 | / | 9.671875 |
| fingerprint_resnet18 | caffe | ubuntu16_04 | llvm | 990 | A55 | fp16 | cpu | 1 | / | 6.834961 |
| fingerprint_resnet18 | caffe | ubuntu16_04 | llvm | 990 | A76 | fp32 | cpu | 1 | / | 2.219971 |
| fingerprint_resnet18 | caffe | ubuntu16_04 | llvm | 990 | A76 | fp16 | cpu | 1 | / | 1.579102 |
| tinybert384 | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp32 | cpu | 1 | / | 22.581055 |
| tinybert384 | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp16 | cpu | 1 | / | 11.834961 |
| tinybert384 | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | int8 | cpu | 1 | / | 9.236084 |
| tinybert384 | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp32 | cpu | 1 | / | 6.566895 |
| tinybert384 | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp16 | cpu | 1 | / | 4.331055 |
| tinybert384 | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | int8 | cpu | 1 | / | 2.608154 |
| tinybert384 | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp32 | cpu | 1 | / | 25.033936 |
| tinybert384 | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp16 | cpu | 1 | / | 12.445801 |
| tinybert384 | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | int8 | cpu | 1 | / | 8.791992 |
| tinybert384 | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp32 | cpu | 1 | / | 5.834229 |
| tinybert384 | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp16 | cpu | 1 | / | 4.145020 |
| tinybert384 | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | int8 | cpu | 1 | / | 2.248047 |
| tinybert384 | caffe | ubuntu16_04 | llvm | 810 | A55 | fp32 | cpu | 1 | / | 23.499023 |
| tinybert384 | caffe | ubuntu16_04 | llvm | 810 | A55 | fp16 | cpu | 1 | / | 11.804932 |
| tinybert384 | caffe | ubuntu16_04 | llvm | 810 | A55 | int8 | cpu | 1 | / | 10.481934 |
| tinybert384 | caffe | ubuntu16_04 | llvm | 810 | A76 | fp32 | cpu | 1 | / | 6.758057 |
| tinybert384 | caffe | ubuntu16_04 | llvm | 810 | A76 | fp16 | cpu | 1 | / | 4.487061 |
| tinybert384 | caffe | ubuntu16_04 | llvm | 810 | A76 | int8 | cpu | 1 | / | 2.980957 |
| tinybert384 | caffe | ubuntu16_04 | llvm | 990 | A55 | fp32 | cpu | 1 | / | 24.321045 |
| tinybert384 | caffe | ubuntu16_04 | llvm | 990 | A55 | fp16 | cpu | 1 | / | 11.989014 |
| tinybert384 | caffe | ubuntu16_04 | llvm | 990 | A55 | int8 | cpu | 1 | / | 11.645020 |
| tinybert384 | caffe | ubuntu16_04 | llvm | 990 | A76 | fp32 | cpu | 1 | / | 5.864990 |
| tinybert384 | caffe | ubuntu16_04 | llvm | 990 | A76 | fp16 | cpu | 1 | / | 3.717041 |
| tinybert384 | caffe | ubuntu16_04 | llvm | 990 | A76 | int8 | cpu | 1 | / | 2.541992 |
| tts_postnet | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp32 | cpu | 1 | / | 190.645020 |
| tts_postnet | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp16 | cpu | 1 | / | 76.032959 |
| tts_postnet | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp32 | cpu | 1 | / | 50.892822 |
| tts_postnet | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp16 | cpu | 1 | / | 26.031006 |
| tts_postnet | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp32 | cpu | 1 | / | 196.128906 |
| tts_postnet | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp16 | cpu | 1 | / | 78.461182 |
| tts_postnet | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp32 | cpu | 1 | / | 45.419922 |
| tts_postnet | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp16 | cpu | 1 | / | 23.227051 |
| tts_postnet | caffe | ubuntu16_04 | llvm | 810 | A55 | fp32 | cpu | 1 | / | 177.791016 |
| tts_postnet | caffe | ubuntu16_04 | llvm | 810 | A55 | fp16 | cpu | 1 | / | 76.929932 |
| tts_postnet | caffe | ubuntu16_04 | llvm | 810 | A76 | fp32 | cpu | 1 | / | 50.316162 |
| tts_postnet | caffe | ubuntu16_04 | llvm | 810 | A76 | fp16 | cpu | 1 | / | 26.363037 |
| tts_postnet | caffe | ubuntu16_04 | llvm | 990 | A55 | fp32 | cpu | 1 | / | 187.880859 |
| tts_postnet | caffe | ubuntu16_04 | llvm | 990 | A55 | fp16 | cpu | 1 | / | 77.622070 |
| tts_postnet | caffe | ubuntu16_04 | llvm | 990 | A76 | fp32 | cpu | 1 | / | 45.151123 |
| tts_postnet | caffe | ubuntu16_04 | llvm | 990 | A76 | fp16 | cpu | 1 | / | 23.705078 |
| tinybert_onnx | onnx | ubuntu16_04 | gcc8.3 | 810 | A55 | fp32 | cpu | 1 | / | 16.797119 |
| tinybert_onnx | onnx | ubuntu16_04 | gcc8.3 | 810 | A55 | fp16 | cpu | 1 | / | 9.298096 |
| tinybert_onnx | onnx | ubuntu16_04 | gcc8.3 | 810 | A76 | fp32 | cpu | 1 | / | 4.791992 |
| tinybert_onnx | onnx | ubuntu16_04 | gcc8.3 | 810 | A76 | fp16 | cpu | 1 | / | 3.198975 |
| tinybert_onnx | onnx | ubuntu16_04 | gcc8.3 | 990 | A55 | fp32 | cpu | 1 | / | 18.088135 |
| tinybert_onnx | onnx | ubuntu16_04 | gcc8.3 | 990 | A55 | fp16 | cpu | 1 | / | 9.281006 |
| tinybert_onnx | onnx | ubuntu16_04 | gcc8.3 | 990 | A76 | fp32 | cpu | 1 | / | 4.185059 |
| tinybert_onnx | onnx | ubuntu16_04 | gcc8.3 | 990 | A76 | fp16 | cpu | 1 | / | 2.751953 |
| tinybert_onnx | onnx | ubuntu16_04 | llvm | 810 | A55 | fp32 | cpu | 1 | / | 17.781006 |
| tinybert_onnx | onnx | ubuntu16_04 | llvm | 810 | A55 | fp16 | cpu | 1 | / | 10.011963 |
| tinybert_onnx | onnx | ubuntu16_04 | llvm | 810 | A76 | fp32 | cpu | 1 | / | 5.114014 |
| tinybert_onnx | onnx | ubuntu16_04 | llvm | 810 | A76 | fp16 | cpu | 1 | / | 3.356934 |
| tinybert_onnx | onnx | ubuntu16_04 | llvm | 990 | A55 | fp32 | cpu | 1 | / | 19.456055 |
| tinybert_onnx | onnx | ubuntu16_04 | llvm | 990 | A55 | fp16 | cpu | 1 | / | 10.182861 |
| tinybert_onnx | onnx | ubuntu16_04 | llvm | 990 | A76 | fp32 | cpu | 1 | / | 4.295898 |
| tinybert_onnx | onnx | ubuntu16_04 | llvm | 990 | A76 | fp16 | cpu | 1 | / | 2.818848 |
| tts_melgan_vocoder | onnx | ubuntu16_04 | gcc8.3 | 810 | A55 | fp32 | cpu | 1 | / | 1678.862793 |
| tts_melgan_vocoder | onnx | ubuntu16_04 | gcc8.3 | 810 | A55 | fp16 | cpu | 1 | / | 776.404053 |
| tts_melgan_vocoder | onnx | ubuntu16_04 | gcc8.3 | 810 | A76 | fp32 | cpu | 1 | / | 525.206055 |
| tts_melgan_vocoder | onnx | ubuntu16_04 | gcc8.3 | 810 | A76 | fp16 | cpu | 1 | / | 263.708008 |
| tts_melgan_vocoder | onnx | ubuntu16_04 | gcc8.3 | 990 | A55 | fp32 | cpu | 1 | / | 1764.489014 |
| tts_melgan_vocoder | onnx | ubuntu16_04 | gcc8.3 | 990 | A55 | fp16 | cpu | 1 | / | 813.339844 |
| tts_melgan_vocoder | onnx | ubuntu16_04 | gcc8.3 | 990 | A76 | fp32 | cpu | 1 | / | 417.965088 |
| tts_melgan_vocoder | onnx | ubuntu16_04 | gcc8.3 | 990 | A76 | fp16 | cpu | 1 | / | 215.749023 |
| tts_melgan_vocoder | onnx | ubuntu16_04 | llvm | 810 | A55 | fp32 | cpu | 1 | / | 1681.593994 |
| tts_melgan_vocoder | onnx | ubuntu16_04 | llvm | 810 | A55 | fp16 | cpu | 1 | / | 745.455078 |
| tts_melgan_vocoder | onnx | ubuntu16_04 | llvm | 810 | A76 | fp32 | cpu | 1 | / | 493.489014 |
| tts_melgan_vocoder | onnx | ubuntu16_04 | llvm | 810 | A76 | fp16 | cpu | 1 | / | 261.107910 |
| tts_melgan_vocoder | onnx | ubuntu16_04 | llvm | 990 | A55 | fp32 | cpu | 1 | / | 1768.612061 |
| tts_melgan_vocoder | onnx | ubuntu16_04 | llvm | 990 | A55 | fp16 | cpu | 1 | / | 784.126953 |
| tts_melgan_vocoder | onnx | ubuntu16_04 | llvm | 990 | A76 | fp32 | cpu | 1 | / | 410.212891 |
| tts_melgan_vocoder | onnx | ubuntu16_04 | llvm | 990 | A76 | fp16 | cpu | 1 | / | 211.166016 |
| tts_encoder_decoder | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp32 | cpu | 1 | / | 420.667969 |
| tts_encoder_decoder | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp16 | cpu | 1 | / | 216.756104 |
| tts_encoder_decoder | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp32 | cpu | 1 | / | 150.831055 |
| tts_encoder_decoder | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp16 | cpu | 1 | / | 76.963867 |
| tts_encoder_decoder | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp32 | cpu | 1 | / | 452.342041 |
| tts_encoder_decoder | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp16 | cpu | 1 | / | 227.301025 |
| tts_encoder_decoder | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp32 | cpu | 1 | / | 126.700195 |
| tts_encoder_decoder | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp16 | cpu | 1 | / | 64.525879 |
| tts_encoder_decoder | caffe | ubuntu16_04 | llvm | 810 | A55 | fp32 | cpu | 1 | / | 418.912109 |
| tts_encoder_decoder | caffe | ubuntu16_04 | llvm | 810 | A55 | fp16 | cpu | 1 | / | 210.114990 |
| tts_encoder_decoder | caffe | ubuntu16_04 | llvm | 810 | A76 | fp32 | cpu | 1 | / | 150.854004 |
| tts_encoder_decoder | caffe | ubuntu16_04 | llvm | 810 | A76 | fp16 | cpu | 1 | / | 76.160156 |
| tts_encoder_decoder | caffe | ubuntu16_04 | llvm | 990 | A55 | fp32 | cpu | 1 | / | 449.791016 |
| tts_encoder_decoder | caffe | ubuntu16_04 | llvm | 990 | A55 | fp16 | cpu | 1 | / | 222.086914 |
| tts_encoder_decoder | caffe | ubuntu16_04 | llvm | 990 | A76 | fp32 | cpu | 1 | / | 124.972168 |
| tts_encoder_decoder | caffe | ubuntu16_04 | llvm | 990 | A76 | fp16 | cpu | 1 | / | 65.025146 |
| vad | tflite | ubuntu16_04 | gcc8.3 | 810 | A55 | fp32 | cpu | 1 | / | 10.746826 |
| vad | tflite | ubuntu16_04 | gcc8.3 | 810 | A55 | fp16 | cpu | 1 | / | 8.893066 |
| vad | tflite | ubuntu16_04 | gcc8.3 | 810 | A76 | fp32 | cpu | 1 | / | 2.525146 |
| vad | tflite | ubuntu16_04 | gcc8.3 | 810 | A76 | fp16 | cpu | 1 | / | 2.598145 |
| vad | tflite | ubuntu16_04 | gcc8.3 | 990 | A55 | fp32 | cpu | 1 | / | 10.649902 |
| vad | tflite | ubuntu16_04 | gcc8.3 | 990 | A55 | fp16 | cpu | 1 | / | 8.578857 |
| vad | tflite | ubuntu16_04 | gcc8.3 | 990 | A76 | fp32 | cpu | 1 | / | 2.264893 |
| vad | tflite | ubuntu16_04 | gcc8.3 | 990 | A76 | fp16 | cpu | 1 | / | 2.222168 |
| vad | tflite | ubuntu16_04 | llvm | 810 | A55 | fp32 | cpu | 1 | / | 11.018066 |
| vad | tflite | ubuntu16_04 | llvm | 810 | A55 | fp16 | cpu | 1 | / | 11.024170 |
| vad | tflite | ubuntu16_04 | llvm | 810 | A76 | fp32 | cpu | 1 | / | 3.061035 |
| vad | tflite | ubuntu16_04 | llvm | 810 | A76 | fp16 | cpu | 1 | / | 2.907959 |
| vad | tflite | ubuntu16_04 | llvm | 990 | A55 | fp32 | cpu | 1 | / | 11.968994 |
| vad | tflite | ubuntu16_04 | llvm | 990 | A55 | fp16 | cpu | 1 | / | 11.719971 |
| vad | tflite | ubuntu16_04 | llvm | 990 | A76 | fp32 | cpu | 1 | / | 2.645020 |
| vad | tflite | ubuntu16_04 | llvm | 990 | A76 | fp16 | cpu | 1 | / | 2.597900 |