Commit Graph

177 Commits

Author SHA1 Message Date
游雁
24aea85b5b trainer 2024-03-21 14:01:45 +08:00
zhifu gao
4482bbcbb9
train (#1521)
* trainer

* trainer

* trainer

* trainer

* trainer

* trainer

* trainer

* trainer

* trainer

* trainer

* trainer

* trainer

* trainer

* trainer

* trainer

* trainer
2024-03-21 11:49:30 +08:00
zhifu gao
3ac03e448b
train & finetune llm-asr (#1519)
* trainer

* trainer

* trainer

* trainer

* trainer

* trainer

* trainer

* trainer

* trainer

* trainer

* trainer
2024-03-21 01:36:39 +08:00
zhifu gao
5023dd0422
Dev gzf llm (#1503)
* update

* update

* update

* update onnx

* update with main (#1492)

* contextual&seaco ONNX export (#1481)

* contextual&seaco ONNX export

* update ContextualEmbedderExport2

* update ContextualEmbedderExport2

* update code

* onnx (#1482)

* qwenaudio qwenaudiochat

* qwenaudio qwenaudiochat

* whisper

* whisper

* llm

* llm

* llm

* llm

* llm

* llm

* llm

* llm

* export onnx

* export onnx

* export onnx

* dingding

* dingding

* llm

* doc

* onnx

* onnx

* onnx

* onnx

* onnx

* onnx

* v1.0.15

* qwenaudio

* qwenaudio

* issue doc

* update

* update

* bugfix

* onnx

* update export calling

* update codes

* remove useless code

* update code

---------

Co-authored-by: zhifu gao <zhifu.gzf@alibaba-inc.com>

* acknowledge

---------

Co-authored-by: Shi Xian <40013335+R1ckShi@users.noreply.github.com>

* update onnx

* update onnx

* train update

* train update

* train update

* train update

---------

Co-authored-by: Shi Xian <40013335+R1ckShi@users.noreply.github.com>
2024-03-15 16:24:29 +08:00
zhifu gao
35b1c051f6
Dev gzf llm (#1493)
* update

* update

* update

* update onnx

* update with main (#1492)

* contextual&seaco ONNX export (#1481)

* contextual&seaco ONNX export

* update ContextualEmbedderExport2

* update ContextualEmbedderExport2

* update code

* onnx (#1482)

* qwenaudio qwenaudiochat

* qwenaudio qwenaudiochat

* whisper

* whisper

* llm

* llm

* llm

* llm

* llm

* llm

* llm

* llm

* export onnx

* export onnx

* export onnx

* dingding

* dingding

* llm

* doc

* onnx

* onnx

* onnx

* onnx

* onnx

* onnx

* v1.0.15

* qwenaudio

* qwenaudio

* issue doc

* update

* update

* bugfix

* onnx

* update export calling

* update codes

* remove useless code

* update code

---------

Co-authored-by: zhifu gao <zhifu.gzf@alibaba-inc.com>

* acknowledge

---------

Co-authored-by: Shi Xian <40013335+R1ckShi@users.noreply.github.com>

* update onnx

* update onnx

---------

Co-authored-by: Shi Xian <40013335+R1ckShi@users.noreply.github.com>
2024-03-14 09:33:30 +08:00
zhifu gao
c3192dffdd
Dev gzf (#1480)
* qwenaudio qwenaudiochat

* qwenaudio qwenaudiochat

* whisper

* whisper

* llm

* llm

* llm

* llm

* llm

* llm

* llm

* llm

* export onnx

* export onnx

* export onnx

* dingding

* dingding

* llm

* doc

* onnx

* onnx

* onnx

* onnx

* onnx

* onnx

* v1.0.15

* qwenaudio

* qwenaudio

* issue doc

* update

* update

* bugfix
2024-03-12 17:27:02 +08:00
zhifu gao
68f0603b10
Dev gzf (#1475)
* qwenaudio qwenaudiochat

* qwenaudio qwenaudiochat

* whisper

* whisper

* llm

* llm

* llm

* llm

* llm

* llm

* llm

* llm

* export onnx

* export onnx

* export onnx

* dingding

* dingding

* llm

* doc

* onnx

* onnx

* onnx

* onnx

* onnx

* onnx

* v1.0.15

* qwenaudio

* qwenaudio

* issue doc
2024-03-12 09:23:04 +08:00
zhifu gao
4a7a984a5f
Dev gzf (#1465)
* qwenaudio qwenaudiochat

* qwenaudio qwenaudiochat

* whisper

* whisper

* llm

* llm

* llm

* llm

* llm

* llm

* llm

* llm

* export onnx

* export onnx

* export onnx

* dingding

* dingding

* llm
2024-03-11 17:56:30 +08:00
zhifu gao
f2d8ded57f
export onnx (#1455)
* qwenaudio qwenaudiochat

* qwenaudio qwenaudiochat

* whisper

* whisper

* llm

* llm

* llm

* llm

* llm

* llm

* llm

* llm

* export onnx
2024-03-11 01:24:43 +08:00
Shi Xian
8cd896d984
update hotword finetuning (#1452)
* update hotword finetuning

* update scripts
2024-03-09 13:55:54 +08:00
zhifu gao
500197b8ad
Dev gzf (#1443)
* whisper

* llm
2024-03-07 15:24:42 +08:00
zhifu gao
341182c3bf
Dev gzf (#1440)
* qwenaudio qwenaudiochat

* qwenaudio qwenaudiochat

* whisper

* whisper

* llm
2024-03-07 10:03:02 +08:00
游雁
cce5d9999d add 2024-02-29 17:19:32 +08:00
游雁
47395c976f update 2024-02-23 14:10:47 +08:00
游雁
fa6f60fa76 update 2024-02-23 14:01:44 +08:00
游雁
54b6ff5764 fp16 2024-02-22 23:52:22 +08:00
游雁
2bc330a599 update trainer 2024-02-21 19:22:01 +08:00
游雁
45d9ccafef train finetune 2024-02-20 17:48:53 +08:00
游雁
cb8b09e085 update 2024-02-20 16:42:09 +08:00
游雁
ce4235b1c8 aishell example 2024-02-19 22:11:49 +08:00
游雁
ff4306346e aishell example 2024-02-19 21:26:25 +08:00
游雁
6a9c21a408 aishell example 2024-02-19 17:05:49 +08:00
游雁
1448e021ac aishell example 2024-02-19 14:59:26 +08:00
zhifu gao
d92cd5ae03
Funasr1.0 (#1362)
* funasr1.0.5

* funasr1.0.5 audio samples input

* batch_type token

* batch_type token

* huggingface model zoo

* dataloader

* dataloader

* fbank input

* vad is_final=True bugfix
2024-02-06 21:22:21 +08:00
zhifu gao
2ddfc27d5b
Funasr1.0 (#1343)
* funasr1.0.5

* funasr1.0.5 audio samples input

* batch_type token

* batch_type token
2024-02-01 17:29:28 +08:00
zhifu gao
37d7764ecf
Funasr1.0 (#1277)
* funasr1.0 funetine

* funasr1.0 pbar

* update with main (#1260)

* Update websocket_protocol_zh.md

* update

---------

Co-authored-by: Yabin Li <wucong.lyb@alibaba-inc.com>
Co-authored-by: shixian.shi <shixian.shi@alibaba-inc.com>

* update with main (#1264)

* Funasr1.0 (#1261)

* funasr1.0 funetine

* funasr1.0 pbar

* update with main (#1260)

* Update websocket_protocol_zh.md

* update

---------

Co-authored-by: Yabin Li <wucong.lyb@alibaba-inc.com>
Co-authored-by: shixian.shi <shixian.shi@alibaba-inc.com>

---------

Co-authored-by: Yabin Li <wucong.lyb@alibaba-inc.com>
Co-authored-by: shixian.shi <shixian.shi@alibaba-inc.com>

* bug fix

---------

Co-authored-by: Yabin Li <wucong.lyb@alibaba-inc.com>
Co-authored-by: shixian.shi <shixian.shi@alibaba-inc.com>

* funasr1.0 sanm scama

* funasr1.0 infer_after_finetune

* funasr1.0 fsmn-vad bug fix

* funasr1.0 fsmn-vad bug fix

* funasr1.0 fsmn-vad bug fix

* funasr1.0 finetune

* funasr1.0 finetune

* funasr1.0 finetune

* funasr1.0 finetune

---------

Co-authored-by: Yabin Li <wucong.lyb@alibaba-inc.com>
Co-authored-by: shixian.shi <shixian.shi@alibaba-inc.com>
2024-01-21 21:06:52 +08:00
zhifu gao
2cca8104d2
Funasr1.0 (#1275)
* funasr1.0 funetine

* funasr1.0 pbar

* update with main (#1260)

* Update websocket_protocol_zh.md

* update

---------

Co-authored-by: Yabin Li <wucong.lyb@alibaba-inc.com>
Co-authored-by: shixian.shi <shixian.shi@alibaba-inc.com>

* update with main (#1264)

* Funasr1.0 (#1261)

* funasr1.0 funetine

* funasr1.0 pbar

* update with main (#1260)

* Update websocket_protocol_zh.md

* update

---------

Co-authored-by: Yabin Li <wucong.lyb@alibaba-inc.com>
Co-authored-by: shixian.shi <shixian.shi@alibaba-inc.com>

---------

Co-authored-by: Yabin Li <wucong.lyb@alibaba-inc.com>
Co-authored-by: shixian.shi <shixian.shi@alibaba-inc.com>

* bug fix

---------

Co-authored-by: Yabin Li <wucong.lyb@alibaba-inc.com>
Co-authored-by: shixian.shi <shixian.shi@alibaba-inc.com>

* funasr1.0 sanm scama

* funasr1.0 infer_after_finetune

* funasr1.0 fsmn-vad bug fix

* funasr1.0 fsmn-vad bug fix

* funasr1.0 fsmn-vad bug fix

* funasr1.0 finetune

* funasr1.0 finetune

* funasr1.0 finetune

---------

Co-authored-by: Yabin Li <wucong.lyb@alibaba-inc.com>
Co-authored-by: shixian.shi <shixian.shi@alibaba-inc.com>
2024-01-19 17:05:08 +08:00
zhifu gao
9a9c3b75b5
Funasr1.0 (#1261)
* funasr1.0 funetine

* funasr1.0 pbar

* update with main (#1260)

* Update websocket_protocol_zh.md

* update

---------

Co-authored-by: Yabin Li <wucong.lyb@alibaba-inc.com>
Co-authored-by: shixian.shi <shixian.shi@alibaba-inc.com>

---------

Co-authored-by: Yabin Li <wucong.lyb@alibaba-inc.com>
Co-authored-by: shixian.shi <shixian.shi@alibaba-inc.com>
2024-01-17 18:28:28 +08:00
游雁
2ed3f46f40 funasr1.0 finetune 2024-01-16 18:42:37 +08:00
游雁
bb97d3ed19 fix win bug 2024-01-16 15:47:01 +08:00
shixian.shi
1233c0d3ff code update 2024-01-15 20:34:47 +08:00
游雁
2a0b2c795b funasr1.0 2024-01-15 11:51:26 +08:00
游雁
8912e0696a Resolve merge conflict 2024-01-14 23:42:11 +08:00
游雁
ccac6ceea9 fix punc model 2024-01-13 22:35:20 +08:00
zhifu gao
08f7eaff95
Dev cmz (#1244)
* fix offline mode split text in the asr pipeline

* simplify code in split_word

---------

Co-authored-by: mengzhe.cmz <mengzhe.cmz@alibaba-inc.com>
2024-01-13 13:52:36 +08:00
游雁
4f98546f36 load_audio_text_image_video 2024-01-05 16:55:07 +08:00
游雁
32905d8cde funasr1.0 2024-01-05 11:52:48 +08:00
游雁
a1b0cd33d5 rename register tables 2023-12-21 14:20:21 +08:00
游雁
c8bae0ec85 funasr2 2023-12-21 13:29:37 +08:00
游雁
0e622e694e funasr2 2023-12-19 21:58:14 +08:00
游雁
298ddd13fb funasr2 2023-12-15 23:46:41 +08:00
游雁
806a03609d funasr2 paraformer biciparaformer contextuaparaformer 2023-12-13 19:43:13 +08:00
游雁
d77910eb6d funasr2 2023-12-11 13:42:40 +08:00
zhifu gao
172e7ac986
Revert "Dev gzf funasr2" (#1164) 2023-12-11 10:17:22 +08:00
游雁
27f31cd42b funasr2 2023-12-06 17:01:12 +08:00
游雁
4bdf1c2e71 dataloader 2023-11-28 10:24:39 +08:00
游雁
54a9119490 dataloader 2023-11-27 14:11:54 +08:00
游雁
b5d3df75cf setup jamo 2023-11-24 00:54:44 +08:00
游雁
afae93b43d merge 2023-11-24 00:29:08 +08:00
游雁
c408a8847d merge 2023-11-23 23:24:57 +08:00