speech_recognition/FunASR
1
0
Fork 0
mirror of https://github.com/modelscope/FunASR synced 2025-09-15 14:48:36 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
495e7071ea
FunASR/funasr/runtime/python
History
游雁 495e7071ea benchmark cpu
2023-03-15 21:44:31 +08:00
..
grpc modify grpc environment dependencies 2023-03-02 10:17:11 +08:00
libtorch paraformer_onnx and paraformer_bin batch inference 2023-03-03 19:18:50 +08:00
onnxruntime rtf 2023-03-13 20:00:42 +08:00
__init__.py export model 2023-02-13 17:43:01 +08:00
README.md benchmark cpu 2023-03-15 21:44:31 +08:00

README.md

Benchmark Paraformer-large based on Aishell1 test set , the total audio duration is 36108.919 seconds.

(Note: The service has been fully warm up.)

Intel(R) Xeon(R) Platinum 8369B CPU @ 2.90GHz 16core-32processor with avx512_vnni

concurrent-tasks processing time(s) RTF Speedup Rate
1 (onnx fp32) 2806 0.0777 12.9
1 (onnx int8) 1611 0.0446 22.4
8 (onnx fp32) 538 0.0149 67.1
8 (onnx int8) 210 0.0058 172.4
16 (onnx fp32) 288 0.0080 125.2
16 (onnx int8) 117 0.0032 309.9
32 (onnx fp32) 167 0.0046 216.5
32 (onnx int8) 107 0.0030 338.0
64 (onnx fp32) 158 0.0044 228.1
64 (onnx int8) 82 0.0023 442.8
96 (onnx fp32) 151 0.0042 238.0
96 (onnx int8) 80 0.0022 452.0