speech_recognition/FunASR
1
0
Fork 0
mirror of https://github.com/modelscope/FunASR synced 2025-09-15 14:48:36 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
5ee2f382b3
FunASR/funasr/tokenizer
History
zhifu gao 2196844d1d
Dev kws (#2105) 
* multi tokenizer

* support fsmn_kws, fsmn_kws_mt, sanm_kws, sanm_kws_streaming training

* kws

---------

Co-authored-by: pengteng.spt <pengteng.spt@alibaba-inc.com>
2024-09-25 15:10:50 +08:00
..
__init__.py update funasr.text -> funasr.tokenizer fix bug export 2023-11-23 11:43:05 +08:00
abs_tokenizer.py Dev gzf exp (#1678) 2024-04-29 14:52:20 +08:00
build_tokenizer.py Dev gzf exp (#1654) 2024-04-24 16:03:38 +08:00
char_tokenizer.py Dev kws (#2105) 2024-09-25 15:10:50 +08:00
cleaner.py Dev gzf exp (#1654) 2024-04-24 16:03:38 +08:00
hf_tokenizer.py Dev gzf exp (#1654) 2024-04-24 16:03:38 +08:00
korean_cleaner.py Dev gzf exp (#1654) 2024-04-24 16:03:38 +08:00
phoneme_tokenizer.py Dev gzf exp (#1654) 2024-04-24 16:03:38 +08:00
sentencepiece_tokenizer.py Dev gzf deepspeed (#1844) 2024-06-24 17:06:21 +08:00
token_id_converter.py Dev gzf exp (#1654) 2024-04-24 16:03:38 +08:00
whisper_tokenizer.py Dev gzf exp (#1654) 2024-04-24 16:03:38 +08:00
word_tokenizer.py Dev gzf exp (#1654) 2024-04-24 16:03:38 +08:00