mirror of
https://github.com/espressif/esp-sr.git
synced 2025-09-15 15:28:44 +08:00
34 lines
2.4 KiB
Markdown
34 lines
2.4 KiB
Markdown
# esp_sr [[中文]](./README_cn.md)
|
|
|
|
Espressif esp_sr provides basic algorithms for **Speech Recognition** applications. Now, this framework has three modules:
|
|
|
|
* The wake word detection model [WakeNet](wake_word_engine/README.md)
|
|
* The speech command recognition model [MultiNet](speech_command_recognition/README.md)
|
|
* Acoustic algorithm: MASE(Mic Array Speech Enhancement), AEC(Acoustic Echo Cancellation), VAD(Voice Activity Detection), AGC(Automatic Gain Control), NS(Noise Suppression)
|
|
|
|
These algorithms are provided in the form of a component, so they can be integrated into your projects with minimum efforts.
|
|
|
|
## Wake Word Engine
|
|
|
|
Espressif wake word engine [WakeNet](wake_word_engine/README.md) is specially designed to provide a high performance and low memory footprint wake word detection algorithm for users, which enables devices always listen wake words, such as “Alexa”, “天猫精灵” (Tian Mao Jing Ling) and “小爱同学” (Xiao Ai Tong Xue).
|
|
|
|
Currently, Espressif has not only provided an official wake word "Hi, Lexin" to public for free, but also allows customized wake words. For details on how to customize your own wake words, please see [Espressif Speech Wake Words Customization Process](wake_word_engine/ESP_Wake_Words_Customization.md).
|
|
|
|
## Speech Command Recognition
|
|
|
|
Espressif's speech command recognition model [MultiNet](speech_command_recognition/README.md) is specially designed to provide a flexible off-line speech command recognition model. With this model, you can easily add your own speech commands, eliminating the need to train model again.
|
|
|
|
Currently, Espressif **MultiNet** supports up to 100 Chinese or English speech commands, such as “打开空调” (Turn on the air conditioner) and “打开卧室灯” (Turn on the bedroom light).
|
|
|
|
|
|
## Acoustic algorithm
|
|
|
|
Espressif acoustic algorithm module is specially designed to improve speech recognition performance in far-field or noisy environments.
|
|
|
|
Currently, MASE algorithm supports 2-mic linear array and 3-mic circular array.
|
|
|
|
|
|
**In order to achieve optimal performance:**
|
|
|
|
* Please refer to hardware design [ESP32_Korvo](https://github.com/espressif/esp-skainet/tree/master/docs/zh_CN/hw-reference/esp32/user-guide-esp32-korvo-v1.1.md) or [ESP32-LyraT-Mini](https://docs.espressif.com/projects/esp-adf/en/latest/get-started/get-started-esp32-lyrat-mini.html).
|
|
* Please refer to software design [esp-skainet](https://github.com/espressif/esp-skainet). |