Commit Graph

524 Commits

Author SHA1 Message Date
游雁
0bf8edca37 find_unused_parameters 2024-09-30 15:43:13 +08:00
游雁
5d35b3c70b find_unused_parameters 2024-09-30 12:28:16 +08:00
zhifu gao
2196844d1d
Dev kws (#2105)
* multi tokenizer

* support fsmn_kws, fsmn_kws_mt, sanm_kws, sanm_kws_streaming training

* kws

---------

Co-authored-by: pengteng.spt <pengteng.spt@alibaba-inc.com>
2024-09-25 15:10:50 +08:00
游雁
0650696dd0 update 2024-07-01 11:08:32 +08:00
游雁
caf70826a6 decoding 2024-06-13 17:52:07 +08:00
游雁
dce53b268b decoding 2024-06-13 09:56:44 +08:00
游雁
f97f3e8dd5 decoding 2024-06-13 09:52:10 +08:00
游雁
407625a734 decoding 2024-06-12 15:18:42 +08:00
游雁
05f05e7421 decoding 2024-06-11 19:00:55 +08:00
游雁
ea85c483ad fix bug 2024-06-10 21:47:58 +08:00
游雁
b75d1e89bb fix bug 2024-06-09 00:32:57 +08:00
游雁
1c8b46a233 fix bug 2024-06-09 00:21:44 +08:00
游雁
55e7a2d880 wenetspeech 2024-05-22 16:33:17 +08:00
游雁
0b764d3350 wenetspeech 2024-05-22 16:20:24 +08:00
游雁
b37e7b15e0 wenetspeech 2024-05-22 15:11:08 +08:00
游雁
bbd300a911 ds 2024-05-20 15:27:24 +08:00
游雁
86ada491e0 deepspeed 2024-05-17 12:38:24 +08:00
游雁
d3ff05837b deepspeed 2024-05-17 11:47:27 +08:00
游雁
f68ae892be deepspeed 2024-05-17 10:32:34 +08:00
游雁
403033a15f add 2024-05-14 15:45:35 +08:00
游雁
9be30f99dd update avg slice 2024-05-10 10:16:28 +08:00
游雁
f775e0e41c start_data_split_i=0 2024-05-09 10:15:44 +08:00
游雁
46e5beede9 decoding key 2024-05-07 22:12:05 +08:00
游雁
9bbb476908 train_loss_avg train_acc_avg 2024-04-30 15:46:38 +08:00
游雁
9a8086bdf5 batch 2024-04-30 10:48:31 +08:00
zhifu gao
b7ae3d5268
Dev gzf exp (#1672)
* resume from step

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch
2024-04-28 17:42:33 +08:00
zhifu gao
93ef505e2d
Dev gzf exp (#1670)
* resume from step

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch
2024-04-28 15:14:57 +08:00
zhifu gao
fc68b5ffe4
Dev gzf exp (#1661)
* rwkv 5

* rwkv v4

* rwkv v4

* rwkv

* rwkv

* update

* resume from step

* resume from step

* resume from step

* resume from step

* resume from step

* resume from step

* resume from step

* resume from step

* resume from step

* resume from step

* resume from step

* resume from step

* resume from step
2024-04-25 21:43:47 +08:00
zhifu gao
80bd14e6bb
Dev gzf exp (#1657)
* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* bugfix

* update with main (#1631)

* update seaco finetune

* v1.0.24

---------

Co-authored-by: 维石 <shixian.shi@alibaba-inc.com>

* sensevoice

* sensevoice

* sensevoice

* update with main (#1638)

* update seaco finetune

* v1.0.24

* update rwkv template

---------

Co-authored-by: 维石 <shixian.shi@alibaba-inc.com>

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* whisper

* whisper

* update style

* update style

* oom

---------

Co-authored-by: 维石 <shixian.shi@alibaba-inc.com>
2024-04-25 10:41:14 +08:00
zhifu gao
861147c730
Dev gzf exp (#1654)
* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* bugfix

* update with main (#1631)

* update seaco finetune

* v1.0.24

---------

Co-authored-by: 维石 <shixian.shi@alibaba-inc.com>

* sensevoice

* sensevoice

* sensevoice

* update with main (#1638)

* update seaco finetune

* v1.0.24

* update rwkv template

---------

Co-authored-by: 维石 <shixian.shi@alibaba-inc.com>

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* whisper

* whisper

* update style

* update style

---------

Co-authored-by: 维石 <shixian.shi@alibaba-inc.com>
2024-04-24 16:03:38 +08:00
zhifu gao
2ac38adbe5
Dev gzf exp (#1647)
* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* bugfix

* update with main (#1631)

* update seaco finetune

* v1.0.24

---------

Co-authored-by: 维石 <shixian.shi@alibaba-inc.com>

* sensevoice

* sensevoice

* sensevoice

* update with main (#1638)

* update seaco finetune

* v1.0.24

* update rwkv template

---------

Co-authored-by: 维石 <shixian.shi@alibaba-inc.com>

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

---------

Co-authored-by: 维石 <shixian.shi@alibaba-inc.com>
2024-04-23 18:08:57 +08:00
zhifu gao
0a4a1d5257
Dev gzf exp (#1645)
* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* bugfix

* update with main (#1631)

* update seaco finetune

* v1.0.24

---------

Co-authored-by: 维石 <shixian.shi@alibaba-inc.com>

* sensevoice

* sensevoice

* sensevoice

* update with main (#1638)

* update seaco finetune

* v1.0.24

* update rwkv template

---------

Co-authored-by: 维石 <shixian.shi@alibaba-inc.com>

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sense voice

* sense voice

* sense voice

* sense voice

---------

Co-authored-by: 维石 <shixian.shi@alibaba-inc.com>
2024-04-23 12:48:52 +08:00
zhifu gao
824377d2aa
Dev gzf exp (#1626)
* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune
2024-04-17 16:59:29 +08:00
zhifu gao
eaf9dda9e4
Dev gzf exp (#1624)
* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune
2024-04-17 15:05:37 +08:00
游雁
9b4e9cc8a0 train update 2024-03-27 16:05:29 +08:00
游雁
ed952ff630 finetune 2024-03-24 15:11:02 +08:00
游雁
ed22e34d65 finetune 2024-03-24 15:03:54 +08:00
游雁
a70f5b3edf finetune 2024-03-24 01:44:18 +08:00
游雁
16a976a01d finetune 2024-03-24 01:27:08 +08:00
游雁
873cfae5c3 update 2024-03-24 00:45:45 +08:00
游雁
d929c8e0f7 update 2024-03-22 19:37:41 +08:00
游雁
fcbbe8af9f update 2024-03-22 19:25:29 +08:00
zhifu gao
4482bbcbb9
train (#1521)
* trainer

* trainer

* trainer

* trainer

* trainer

* trainer

* trainer

* trainer

* trainer

* trainer

* trainer

* trainer

* trainer

* trainer

* trainer

* trainer
2024-03-21 11:49:30 +08:00
zhifu gao
3ac03e448b
train & finetune llm-asr (#1519)
* trainer

* trainer

* trainer

* trainer

* trainer

* trainer

* trainer

* trainer

* trainer

* trainer

* trainer
2024-03-21 01:36:39 +08:00
zhifu gao
5023dd0422
Dev gzf llm (#1503)
* update

* update

* update

* update onnx

* update with main (#1492)

* contextual&seaco ONNX export (#1481)

* contextual&seaco ONNX export

* update ContextualEmbedderExport2

* update ContextualEmbedderExport2

* update code

* onnx (#1482)

* qwenaudio qwenaudiochat

* qwenaudio qwenaudiochat

* whisper

* whisper

* llm

* llm

* llm

* llm

* llm

* llm

* llm

* llm

* export onnx

* export onnx

* export onnx

* dingding

* dingding

* llm

* doc

* onnx

* onnx

* onnx

* onnx

* onnx

* onnx

* v1.0.15

* qwenaudio

* qwenaudio

* issue doc

* update

* update

* bugfix

* onnx

* update export calling

* update codes

* remove useless code

* update code

---------

Co-authored-by: zhifu gao <zhifu.gzf@alibaba-inc.com>

* acknowledge

---------

Co-authored-by: Shi Xian <40013335+R1ckShi@users.noreply.github.com>

* update onnx

* update onnx

* train update

* train update

* train update

* train update

---------

Co-authored-by: Shi Xian <40013335+R1ckShi@users.noreply.github.com>
2024-03-15 16:24:29 +08:00
zhifu gao
35b1c051f6
Dev gzf llm (#1493)
* update

* update

* update

* update onnx

* update with main (#1492)

* contextual&seaco ONNX export (#1481)

* contextual&seaco ONNX export

* update ContextualEmbedderExport2

* update ContextualEmbedderExport2

* update code

* onnx (#1482)

* qwenaudio qwenaudiochat

* qwenaudio qwenaudiochat

* whisper

* whisper

* llm

* llm

* llm

* llm

* llm

* llm

* llm

* llm

* export onnx

* export onnx

* export onnx

* dingding

* dingding

* llm

* doc

* onnx

* onnx

* onnx

* onnx

* onnx

* onnx

* v1.0.15

* qwenaudio

* qwenaudio

* issue doc

* update

* update

* bugfix

* onnx

* update export calling

* update codes

* remove useless code

* update code

---------

Co-authored-by: zhifu gao <zhifu.gzf@alibaba-inc.com>

* acknowledge

---------

Co-authored-by: Shi Xian <40013335+R1ckShi@users.noreply.github.com>

* update onnx

* update onnx

---------

Co-authored-by: Shi Xian <40013335+R1ckShi@users.noreply.github.com>
2024-03-14 09:33:30 +08:00
zhifu gao
a7d7a0f3a2
Dev gzf (#1467)
* qwenaudio qwenaudiochat

* qwenaudio qwenaudiochat

* whisper

* whisper

* llm

* llm

* llm

* llm

* llm

* llm

* llm

* llm

* export onnx

* export onnx

* export onnx

* dingding

* dingding

* llm

* doc

* onnx
2024-03-11 19:24:44 +08:00
zhifu gao
4a7a984a5f
Dev gzf (#1465)
* qwenaudio qwenaudiochat

* qwenaudio qwenaudiochat

* whisper

* whisper

* llm

* llm

* llm

* llm

* llm

* llm

* llm

* llm

* export onnx

* export onnx

* export onnx

* dingding

* dingding

* llm
2024-03-11 17:56:30 +08:00
zhifu gao
9d48230c4f
export onnx (#1457)
* qwenaudio qwenaudiochat

* qwenaudio qwenaudiochat

* whisper

* whisper

* llm

* llm

* llm

* llm

* llm

* llm

* llm

* llm

* export onnx

* export onnx
2024-03-11 10:48:50 +08:00
zhifu gao
f2d8ded57f
export onnx (#1455)
* qwenaudio qwenaudiochat

* qwenaudio qwenaudiochat

* whisper

* whisper

* llm

* llm

* llm

* llm

* llm

* llm

* llm

* llm

* export onnx
2024-03-11 01:24:43 +08:00