Even for humans, it is somewhat difficult to single out a voice in a crowed place, and for computers, it is almost next to impossible. But, not now. A new Google AI tech can pick out specific voices based on people’s faces when they’re speaking. This is an important development as computers as not as good as humans at focusing their attention on a particular person in a noisy environment. Known as the cocktail party effect, the capability to mentally “mute” all other voices and sounds comes natural to us humans.
However, automatic speech separation - separating an audio signal into its individual speech sources - remains a significant challenge for computers, Inbar Mosseri and Oran Lang, software engineers at Google Research, wrote in a blog post this week.
In a new paper, the researchers presented a deep learning audio-visual model for isolating a single speech signal from a mixture of sounds such as other voices and background noise.
Read More...