Preservation Of Interaural Level Difference Cue In A Deep Learning-Based Speech Separation System For Bilateral And Bimodal Cochlear Implants Users

Feng，Zicheng1; Tsao，Yu2; Chen，Fei1

10.1109/IWAENC53105.2022.9914788

2022

978-1-6654-6868-8

International Workshop on Acoustic Signal Enhancement, IWAENC 2022 - Proceedings

1-5

5-8 Sept. 2022

Bamberg, Germany

Due to the success of deep neural networks (DNNs) in speech separation, the DNN-based speech separation method has become a potentially feasible front end of cochlear implants (CIs) to reduce noises. However, most DNN-based methods neglect the demand of accurately preserved spatial cues, which are necessary for bilateral and bimodal CI users to localize sounds and benefit from spatial release from masking. In our previous study, a speech separation framework with spatial cues preservation has been designed, by restoring the distorted relative transfer function of the pre-separated speech. In this work, the framework was extended for evaluation in simulated CI hearing scenarios with bilateral and bimodal CI setups. Experiment results showed that the framework significantly reduced the interaural level difference (ILD) errors of the speech separated by the existing DNN-based method, indicating that the proposed DNN-based speech separation framework can effectively preserve the ILD cue in the CI application scenarios.

Cochlear implants deep learning spatial cues preservation speech separation

First

English

2-s2.0-85141360347

Scopus

1.Southern University of Science and Technology,Department of Electrical and Electronic Engineering,Shenzhen,China
2.Academia Sinica,Research Center for Information Technology Innovation,Taipei,Taiwan

Feng，Zicheng,Tsao，Yu,Chen，Fei. Preservation Of Interaural Level Difference Cue In A Deep Learning-Based Speech Separation System For Bilateral And Bimodal Cochlear Implants Users[C],2022:1-5.