FunASR/export.py
will_wang 0c3c9be2c4
paraformer onnx fp16导出方案 (#2264)
* onnx fp16模型

* paraformer-offline [fp32 fp16 onnx-gpu]

* paraformer-offline [fp32 fp16 onnx-gpu]

* Update export.py

---------

Co-authored-by: zhifu gao <zhifu.gzf@alibaba-inc.com>
2024-12-04 17:47:31 +08:00

10 lines
420 B
Python

# method2, inference from local path
from funasr import AutoModel
model = AutoModel(
model="/raid/t3cv/wangch/WORK_SAPCE/ASR/models/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch"
)
res = model.export(type="onnx", quantize=False, opset_version=13, device='cuda') # fp32 onnx-gpu
# res = model.export(type="onnx_fp16", quantize=False, opset_version=13, device='cuda') # fp16 onnx-gpu