Commit Graph

285 Commits

Author SHA1 Message Date
zhifu gao
961ec280af
Dev gzf deepspeed (#1736)
* resume from step

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* train_loss_avg train_acc_avg

* train_loss_avg train_acc_avg

* train_loss_avg train_acc_avg

* log step

* wav is not exist

* wav is not exist

* decoding

* decoding

* decoding

* wechat

* decoding key

* decoding key

* decoding key

* decoding key

* decoding key

* decoding key

* dynamic batch

* start_data_split_i=0

* total_time/accum_grad

* total_time/accum_grad

* total_time/accum_grad

* update avg slice

* update avg slice

* sensevoice sanm

* sensevoice sanm

* add

* add

* add

* add

* deepspeed

* update with main (#1731)

* c++ runtime adapt to 1.0 (#1724)

* adapt vad runtime to 1.0

* add json

* change yml name

* add func LoadVocabFromJson

* add token file for InitAsr

* add token path for OfflineStream

* add funcOpenYaml

* add token file for InitPunc

* add token file for stream

* update punc-model

* update funasr-wss-server

* update runtime_sdk_download_tool.py

* update docker list

* Delete docs/images/wechat.png

* Add files via upload

* Emo2Vec限定选择的情感类别 (#1730)

* 限定选择的情感类别

* 使用none来禁用情感标签输出

* 修改输出接口

* 使用unuse来禁用token

---------

Co-authored-by: 常材 <gaochangfeng.gcf@alibaba-inc.com>

* bugfix

* v1.0.27

* update docs

* hf hub

* Fix incorrect assignment of 'end' attribute to 'start' in sentences list comprehension (#1680)

---------

Co-authored-by: Yabin Li <wucong.lyb@alibaba-inc.com>
Co-authored-by: gaochangfeng <54253717+gaochangfeng@users.noreply.github.com>
Co-authored-by: 常材 <gaochangfeng.gcf@alibaba-inc.com>
Co-authored-by: nsdou <168500039+nsdou@users.noreply.github.com>

* docs

* docs

* deepspeed

* deepspeed

* deepspeed

* deepspeed

* update

* ds

* ds

* ds

* ds

* ds

* ds

* ds

---------

Co-authored-by: Yabin Li <wucong.lyb@alibaba-inc.com>
Co-authored-by: gaochangfeng <54253717+gaochangfeng@users.noreply.github.com>
Co-authored-by: 常材 <gaochangfeng.gcf@alibaba-inc.com>
Co-authored-by: nsdou <168500039+nsdou@users.noreply.github.com>
2024-05-20 15:31:46 +08:00
zhifu gao
2f27b16555
Add files via upload 2024-05-14 09:54:08 +08:00
zhifu gao
efecacbdc4
Delete docs/images/wechat.png 2024-05-14 09:53:51 +08:00
zhifu gao
a7bc099548
Dev gzf exp (#1705)
* resume from step

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* train_loss_avg train_acc_avg

* train_loss_avg train_acc_avg

* train_loss_avg train_acc_avg

* log step

* wav is not exist

* wav is not exist

* decoding

* decoding

* decoding

* wechat

* decoding key

* decoding key

* decoding key

* decoding key

* decoding key

* Gcf (#1704)

* 添加富文本解码约束

* special token

* bug fix

* fix

---------

Co-authored-by: 常材 <gaochangfeng.gcf@alibaba-inc.com>

* decoding key

---------

Co-authored-by: 常材 <gaochangfeng.gcf@alibaba-inc.com>
2024-05-08 17:32:36 +08:00
zhifu gao
f9710e54ce
Dev gzf exp (#1697)
* resume from step

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* train_loss_avg train_acc_avg

* train_loss_avg train_acc_avg

* train_loss_avg train_acc_avg

* log step

* wav is not exist

* wav is not exist

* decoding

* decoding

* decoding

* wechat
2024-05-06 22:51:55 +08:00
zhifu gao
93ef505e2d
Dev gzf exp (#1670)
* resume from step

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch
2024-04-28 15:14:57 +08:00
zhifu gao
861147c730
Dev gzf exp (#1654)
* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* sensevoice finetune

* bugfix

* update with main (#1631)

* update seaco finetune

* v1.0.24

---------

Co-authored-by: 维石 <shixian.shi@alibaba-inc.com>

* sensevoice

* sensevoice

* sensevoice

* update with main (#1638)

* update seaco finetune

* v1.0.24

* update rwkv template

---------

Co-authored-by: 维石 <shixian.shi@alibaba-inc.com>

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* sense voice

* whisper

* whisper

* update style

* update style

---------

Co-authored-by: 维石 <shixian.shi@alibaba-inc.com>
2024-04-24 16:03:38 +08:00
游雁
22d71ff774 wechat 2024-04-23 09:56:06 +08:00
zhifu gao
320c7ff2c2
Dev gzf new (#1562)
* train

* train

* train

* train

* train

* train

* train

* train

* train

* train

* train

* train

* train

* train

* train

* train

* train

* train

* train
2024-03-29 12:30:35 +08:00
zhifu gao
2297d7515a
Dev gzf new (#1553)
* train

* train

* train

* train

* train

* train

* train

* train
2024-03-27 23:20:53 +08:00
游雁
08392f28ec train 2024-03-27 17:06:26 +08:00
游雁
9b4e9cc8a0 train update 2024-03-27 16:05:29 +08:00
游雁
6e86c5044d docs 2024-03-26 01:11:52 +08:00
游雁
77cfefcba0 install requirements automatically 2024-03-25 14:13:17 +08:00
游雁
817ff41fbc install requirements automatically 2024-03-25 12:55:20 +08:00
游雁
3cdb83537b finetune 2024-03-25 00:25:18 +08:00
游雁
81fb78286f update 2024-03-22 20:13:05 +08:00
游雁
9c0735b7df update 2024-03-22 19:09:49 +08:00
游雁
3b580e4a74 tutorial 2024-03-21 18:31:49 +08:00
游雁
497198ebf9 tutorial 2024-03-21 17:41:27 +08:00
游雁
86fb406bb7 tutorial 2024-03-21 17:04:03 +08:00
游雁
bd2b6f6a11 tutorial 2024-03-21 16:38:24 +08:00
游雁
5ebac59f9e tutorial 2024-03-21 16:26:49 +08:00
游雁
944a053a66 tutorial 2024-03-21 14:20:09 +08:00
zhifu gao
f9d894322a
Dev gzf (#1461)
* qwenaudio qwenaudiochat

* qwenaudio qwenaudiochat

* whisper

* whisper

* llm

* llm

* llm

* llm

* llm

* llm

* llm

* llm

* export onnx

* export onnx

* export onnx

* dingding

* dingding
2024-03-11 15:44:53 +08:00
游雁
8912e0696a Resolve merge conflict 2024-01-14 23:42:11 +08:00
jaluik
27e8ba254a
docs: update docker tag (#1227) 2024-01-09 10:57:03 +08:00
游雁
ccb9488954 funasr1.0 2023-12-27 23:03:49 +08:00
游雁
298ddd13fb funasr2 2023-12-15 23:46:41 +08:00
游雁
cc9d2decd0 docs alibaba 2023-11-20 11:52:06 +08:00
游雁
eeb43ced05 docs 2023-11-09 19:37:41 +08:00
游雁
c857b7dd67 docs 2023-11-08 10:38:32 +08:00
北念
91630e7331 update modelscope model zoo 2023-10-16 16:23:32 +08:00
shixian.shi
9a0bc00e5f update docs and readme 2023-10-13 15:14:00 +08:00
haoneng.lhn
68808cb5f6 update github io 2023-10-11 16:16:46 +08:00
yhliang
90aa5f1410
Update index.rst 2023-09-27 10:22:46 +08:00
yhliang
67e730838d
Update index.rst 2023-09-27 10:22:12 +08:00
yhliang
945dae5f13
Update index.rst 2023-09-27 10:19:54 +08:00
yhliang
8482141d20
Update Dataset.md 2023-09-27 10:17:49 +08:00
yhliang
3b8cff497f
Update Dataset.md 2023-09-27 10:17:26 +08:00
游雁
451a9ab976 wechat 2023-09-19 12:35:43 +08:00
游雁
0b5ab0709e wechat 2023-09-19 12:33:53 +08:00
游雁
71b38b1c2c wechat 2023-09-19 12:32:02 +08:00
Yabin Li
61ed60695a
coauthor:duj12, add itn;add timestamp、hotword to 2pass; (#966)
* Add ITN,include openfst/gflags in onnxruntime/third_party.

* 2pass server support Hotword and Timestamp. The start_time of each segment need to be fix.

* add global time start and end of each frame(both online and offline), support two-pass timestamp(both segment and token level).

* update websocket cmake.

* 2pass server support itn, hw and tp.

* Add local build and run. Add timestamp in 2pass server, update cmakelist.

* fix filemode bug in h5, avoid 2pass wss server close before final.

* offline server add itn.

* offline server add ITN.

* update hotword model dir.

* Add Acknowledgement to WeTextProcessing(https://github.com/wenet-e2e/WeTextProcessing)

* adapted to original FunASR.

* adapted to itn timestamp hotword

* merge from main (#949)

* fix empty timestamp list inference

* punc large

* fix decoding_ind none bug

* fix decoding_ind none bug

* docs

* setup

* change eng punc in offline model

* update contextual export

* update proc for oov in hotword onnx inference

* add python http code (#940)

* funasr-onnx 0.2.2

* funasr-onnx 0.2.3

* bug fix in timestamp inference

* fix bug in timestamp inference

* Update preprocessor.py

---------

Co-authored-by: shixian.shi <shixian.shi@alibaba-inc.com>
Co-authored-by: 游雁 <zhifu.gzf@alibaba-inc.com>
Co-authored-by: haoneng.lhn <haoneng.lhn@alibaba-inc.com>
Co-authored-by: mengzhe.cmz <mengzhe.cmz@alibaba-inc.com>
Co-authored-by: Xian Shi <40013335+R1ckShi@users.noreply.github.com>
Co-authored-by: chenmengzheAAA <123789350+chenmengzheAAA@users.noreply.github.com>
Co-authored-by: 夜雨飘零 <yeyupiaoling@foxmail.com>

* update docs

* update deploy_tools

---------

Co-authored-by: dujing <dujing@xmov.ai>
Co-authored-by: Jean Du <37294470+duj12@users.noreply.github.com>
Co-authored-by: shixian.shi <shixian.shi@alibaba-inc.com>
Co-authored-by: 游雁 <zhifu.gzf@alibaba-inc.com>
Co-authored-by: haoneng.lhn <haoneng.lhn@alibaba-inc.com>
Co-authored-by: mengzhe.cmz <mengzhe.cmz@alibaba-inc.com>
Co-authored-by: Xian Shi <40013335+R1ckShi@users.noreply.github.com>
Co-authored-by: chenmengzheAAA <123789350+chenmengzheAAA@users.noreply.github.com>
Co-authored-by: 夜雨飘零 <yeyupiaoling@foxmail.com>
2023-09-19 10:09:58 +08:00
游雁
4fa9bdb832 wechat 2023-09-18 11:24:27 +08:00
chenmengzheAAA
d75e9c6de2
Update modelscope_models.md 2023-09-14 19:05:16 +08:00
chenmengzheAAA
dad87ec9c1
Update modelscope_models_zh.md 2023-09-14 19:04:08 +08:00
chenmengzheAAA
542360546a
Update modelscope_models_zh.md 2023-09-14 19:01:49 +08:00
chenmengzheAAA
3c0ef48c6e
Update modelscope_models.md 2023-09-14 19:00:04 +08:00
chenmengzheAAA
2eb244f635
Update modelscope_models_zh.md 2023-09-14 18:54:59 +08:00