ESP-SR 语音识别框架
Go to file
2021-11-05 19:23:35 +08:00
docs Merge branch 'update_doc' into model_compress 2021-11-05 19:21:10 +08:00
esp-tts bugfix(TTS): ensure that if the input text is same, the output audio is same. update from v1.0 to v1.1 2021-05-07 19:51:24 +08:00
include Merge branch 'model_compress' 2021-11-05 19:23:35 +08:00
lib feat(system): Support ESP32 2021-11-04 15:10:48 +08:00
model feat(system): Refactor esp-sr; Accelerate model reading 2021-11-03 17:18:37 +08:00
src feat(system): Support ESP32 2021-11-04 15:10:48 +08:00
tool feat(tool): Add some tools 2021-11-04 15:32:38 +08:00
.gitignore feat(model): Support models in spiffs partitions 2021-10-15 16:31:16 +08:00
CHANGELOG.md feature/add AFE component & update wakenet 2021-02-25 11:01:29 +08:00
CMakeLists.txt feat(system): Support ESP32 2021-11-04 15:10:48 +08:00
component.mk fix component.mk issue in legacy GNU make 2020-11-09 19:03:29 +08:00
Kconfig.projbuild feat(system): Support ESP32 2021-11-04 15:10:48 +08:00
libversion feat(system): Support ESP32 2021-11-04 15:10:48 +08:00
LICENSE add README 2019-08-06 12:01:02 +08:00
README.md bugfix(doc): modify some incorrent link 2021-11-05 19:20:44 +08:00

esp_sr

Espressif esp_sr provides basic algorithms for Speech Recognition applications. Now, this framework has four modules:

  • The wake word detection model WakeNet
  • The speech command recognition model MultiNet
  • Audio Front-End AFE
  • The txt to speech model esp-tts

These algorithms are provided in the form of a component, so they can be integrated into your projects with minimum efforts.

Wake Word Engine

Espressif wake word engine WakeNet is specially designed to provide a high performance and low memory footprint wake word detection algorithm for users, which enables devices always listen wake words, such as “Alexa”, “天猫精灵” (Tian Mao Jing Ling) and “小爱同学” (Xiao Ai Tong Xue).

Currently, Espressif has not only provided an official wake word "Hi,Lexin","Hi,ESP" to public for free, but also allows customized wake words. For details on how to customize your own wake words, please see Espressif Speech Wake Words Customization Process.

Speech Command Recognition

Espressif's speech command recognition model MultiNet is specially designed to provide a flexible off-line speech command recognition model. With this model, you can easily add your own speech commands, eliminating the need to train model again.

Currently, Espressif MultiNet supports up to 200 Chinese or English speech commands, such as “打开空调” (Turn on the air conditioner) and “打开卧室灯” (Turn on the bedroom light).

Audio Front End

Espressif Audio Front-End AFE integrates AEC (Acoustic Echo Cancellation), VAD (Voice Activity Detection),MASE(Mic Array Speech Enhancement) and NS (Noise Suppression).

Our two-mic Audio Front-End (AFE) have been qualified as a “Software Audio Front-End Solution” for Amazon Alexa Built-in devices.

In order to achieve optimal performance: