FunASR/runtime/ios
Yabin Li 702ec03ad8
Dev new (#1065)
* add hotword for deploy_tools

* Support wfst decoder and contextual biasing (#1039)

* Support wfst decoder and contextual biasing

* Turn on fstbin compilation

---------

Co-authored-by: gongbo.gb <gongbo.gb@alibaba-inc.com>

* mv funasr/runtime runtime

* Fix crash caused by OOV in hotwords list

* funasr infer

* funasr infer

* funasr infer

* funasr infer

* funasr infer

* fix some bugs about fst hotword; support wfst for websocket server and clients; mv runtime out of funasr; modify relative docs

* del onnxruntime/include/gflags

* update tensor.h

* update run_server.sh

* update deploy tools

* update deploy tools

* update websocket-server

* update funasr-wss-server

* Remove self loop propagation

* Update websocket_protocol_zh.md

* Update websocket_protocol_zh.md

* update hotword protocol

* author zhaomingwork: change hotwords for h5 and java

* update hotword protocol

* catch exception for json_fst_hws

* update hotword on message

* update onnx benchmark for ngram&hotword

* update docs

* update funasr-wss-serve

* add NONE for LM_DIR

* update docs

* update run_server.sh

* add whats-new

* modify whats-new

* update whats-new

* update whats-new

* Support decoder option for beam searching

* update benchmark_onnx_cpp

* Support decoder option for websocket

* fix bug of CompileHotwordEmbedding

* update html client

* update docs

---------

Co-authored-by: gongbo.gb <35997837+aibulamusi@users.noreply.github.com>
Co-authored-by: gongbo.gb <gongbo.gb@alibaba-inc.com>
Co-authored-by: 游雁 <zhifu.gzf@alibaba-inc.com>
2023-11-07 18:34:29 +08:00
..
paraformer_online Dev new (#1065) 2023-11-07 18:34:29 +08:00
Readme.md Dev new (#1065) 2023-11-07 18:34:29 +08:00

Paraformer online

该项目是一个基于iOS端的Paraformer流式识别的demo。该项目是基于onnx的推理c++版本。不需要依赖其他库和额外的配置直接在xcode上编译运行即可。

获取模型

  1. 通过命令 git clone https://www.modelscope.cn/damo/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-online-onnx.git 下载模型
  2. 下载的是量化后的模型该iOS项目需要用到四个文件model_quant.onnxdecoder_quant.onnxam.mvnconfig.yaml
  3. 将上面四个文件拖入xcode项目中的model文件夹下建议在打开xcode项目后再拖入。

识别流程

  1. mac设备上确保安装xcode
  2. 由于onnx是xcode的一个cocopod包需要先依赖onnx环境打开终端去到包含Podfile文件的文件夹下执行pod install拉取onnx环境
  3. mac连接iPhone设备双击paraformer_online.xcworkspace自动打开xcode直接运行该xcode工程。

未来工作

  • coreml支持
  • 加入流式标点