FunASR/runtime/tools/fst/collect_resource_file.sh
Yabin Li 702ec03ad8
Dev new (#1065)
* add hotword for deploy_tools

* Support wfst decoder and contextual biasing (#1039)

* Support wfst decoder and contextual biasing

* Turn on fstbin compilation

---------

Co-authored-by: gongbo.gb <gongbo.gb@alibaba-inc.com>

* mv funasr/runtime runtime

* Fix crash caused by OOV in hotwords list

* funasr infer

* funasr infer

* funasr infer

* funasr infer

* funasr infer

* fix some bugs about fst hotword; support wfst for websocket server and clients; mv runtime out of funasr; modify relative docs

* del onnxruntime/include/gflags

* update tensor.h

* update run_server.sh

* update deploy tools

* update deploy tools

* update websocket-server

* update funasr-wss-server

* Remove self loop propagation

* Update websocket_protocol_zh.md

* Update websocket_protocol_zh.md

* update hotword protocol

* author zhaomingwork: change hotwords for h5 and java

* update hotword protocol

* catch exception for json_fst_hws

* update hotword on message

* update onnx benchmark for ngram&hotword

* update docs

* update funasr-wss-serve

* add NONE for LM_DIR

* update docs

* update run_server.sh

* add whats-new

* modify whats-new

* update whats-new

* update whats-new

* Support decoder option for beam searching

* update benchmark_onnx_cpp

* Support decoder option for websocket

* fix bug of CompileHotwordEmbedding

* update html client

* update docs

---------

Co-authored-by: gongbo.gb <35997837+aibulamusi@users.noreply.github.com>
Co-authored-by: gongbo.gb <gongbo.gb@alibaba-inc.com>
Co-authored-by: 游雁 <zhifu.gzf@alibaba-inc.com>
2023-11-07 18:34:29 +08:00

31 lines
508 B
Bash
Executable File

#!/bin/bash
# Collect TLG.fst
lm_dir=$1
tgt_dir=$2
tlg=${lm_dir}/lang/TLG.fst
[ ! -f $tlg ] && echo No TLG file $tlg && exit 1;
rm -rf $tgt_dir
mkdir -p $tgt_dir
cp -r $tlg ${tgt_dir}/TLG.fst
# Generate configuration file
wd_file=${lm_dir}/lang/words.txt
cfg_file=${tgt_dir}/config.yaml
[ ! -f $wd_file ] && echo No words list $wd_file && exit 1;
cat $wd_file | awk '{print $1}' | awk '
BEGIN {
print "token_list:";
}
{
printf("- \"%s\"\n", $1);
}
END {
}' > $cfg_file || exit 1;