A Mel-Scale STFT-Domain TinyUNet for Speech Enhancement on an ESP32-S3 Microcontroller
编号:83 访问权限:仅限参会人 更新:2026-10-04 23:34:43 浏览:20次 Online

报告开始:2026年10月13日 11:15(Asia/Ho_Chi_Minh)

报告时间:15min

所在会场:[S2] Track 2: IoT and applications [S2-3] Track 2: IoT and applications

演示文件

提示:该报告下的文件权限为仅限参会人,您尚未登录,暂时无法查看。

摘要
Deploying speech enhancement directly on microcontroller units provides an energy-efficient, privacy-preserving front-end for voice-enabled edge computing. However, conventional deep neural architectures impose computational loads and memory footprints that exceed the strict resource boundaries of commodity microcontrollers. This paper introduces a Mel-scale STFT-domain TinyUNet comprising 13,651 parameters, optimized for on-device speech enhancement on an ESP32-S3 microcontroller operating at 240 MHz. Rather than processing full-resolution linear spectrograms, the architecture utilizes a 64-channel Mel filterbank representation, effectively halving the acoustic feature dimensionality while retaining the primary spectral envelope for causal mask estimation. Under full 8-bit integer (INT8) post-training quantization, the model occupies 45.57 KB of Flash memory and 18.06 KB of internal SRAM. Experimental evaluation on the DEMAND dataset across signal-to-noise ratios from -5 dB to +10 dB confirms that the quantized model achieves robust noise suppression, providing consistent improvements in objective quality and signal clarity over traditional statistical baselines with negligible performance loss relative to floating-point precision. Measured on-device execution of the complete pipeline, encompassing hardware-accelerated Fourier transforms, neural mask inference, and overlap-add synthesis, processes a 72 ms audio context window in 22.97 ms entirely within on-chip SRAM, establishing a practical baseline for deep neural speech enhancement on low-cost edge devices.
关键词
Speech enhancement,short-time Fourier transform (STFT),Microcontroller,Unet
报告人
Kien Trong Nguyen
Lecturer Posts and Telecommunications Institute of Technology;Ho Chi Minh City

稿件作者
Thuan Quang Tran Posts and Telecommunications Institute of Technology;Ho Chi Minh City
Xuan Viet Le Posts and Telecommunications Institute of Technology (PTIT);Ho Chi Minh City
Kien Trong Nguyen Posts and Telecommunications Institute of Technology;Ho Chi Minh City
发表评论
验证码 看不清楚,更换一张
全部评论
重要日期
  • 会议日期

    10月11日

    2026

    至

    10月14日

    2026

  • 12月30日 2025

    报告提交截止日期

  • 09月28日 2026

    提前注册日期

  • 10月10日 2026

    初稿截稿日期

  • 10月14日 2026

    注册截止日期

主办单位
United Societies of Science
承办单位
Posts and Telecommunications Institute of Technology
协办单位
IEEE Section
IEEE Vietnam Section
移动端
在手机上打开
小程序
打开微信小程序
客服
扫码或点此咨询