Title |
Selective cortical representation of attended speaker in multi-talker speech perception
|
---|---|
Published in |
Nature, April 2012
|
DOI | 10.1038/nature11020 |
Pubmed ID | |
Authors |
Nima Mesgarani, Edward F. Chang |
Abstract |
Humans possess a remarkable ability to attend to a single speaker's voice in a multi-talker background. How the auditory system manages to extract intelligible speech under such acoustically complex and adverse listening conditions is not known, and, indeed, it is not clear how attended speech is internally represented. Here, using multi-electrode surface recordings from the cortex of subjects engaged in a listening task with two simultaneous speakers, we demonstrate that population responses in non-primary human auditory cortex encode critical features of attended speech: speech spectrograms reconstructed based on cortical responses to the mixture of speakers reveal the salient spectral and temporal features of the attended speaker, as if subjects were listening to that speaker alone. A simple classifier trained solely on examples of single speakers can decode both attended words and speaker identity. We find that task performance is well predicted by a rapid increase in attention-modulated neural selectivity across both single-electrode and population-level cortical responses. These findings demonstrate that the cortical representation of speech does not merely reflect the external acoustic environment, but instead gives rise to the perceptual aspects relevant for the listener's intended goal. |
X Demographics
Geographical breakdown
Country | Count | As % |
---|---|---|
United States | 11 | 24% |
United Kingdom | 6 | 13% |
Japan | 3 | 7% |
Canada | 1 | 2% |
Sweden | 1 | 2% |
Spain | 1 | 2% |
Cameroon | 1 | 2% |
Italy | 1 | 2% |
Côte d'Ivoire | 1 | 2% |
Other | 0 | 0% |
Unknown | 19 | 42% |
Demographic breakdown
Type | Count | As % |
---|---|---|
Members of the public | 27 | 60% |
Scientists | 13 | 29% |
Science communicators (journalists, bloggers, editors) | 4 | 9% |
Practitioners (doctors, other healthcare professionals) | 1 | 2% |
Mendeley readers
Geographical breakdown
Country | Count | As % |
---|---|---|
United States | 45 | 4% |
Germany | 11 | <1% |
United Kingdom | 11 | <1% |
Netherlands | 6 | <1% |
France | 6 | <1% |
Canada | 5 | <1% |
Belgium | 4 | <1% |
Switzerland | 3 | <1% |
Japan | 3 | <1% |
Other | 19 | 2% |
Unknown | 1075 | 90% |
Demographic breakdown
Readers by professional status | Count | As % |
---|---|---|
Student > Ph. D. Student | 322 | 27% |
Researcher | 238 | 20% |
Student > Master | 100 | 8% |
Student > Bachelor | 85 | 7% |
Professor > Associate Professor | 64 | 5% |
Other | 224 | 19% |
Unknown | 155 | 13% |
Readers by discipline | Count | As % |
---|---|---|
Neuroscience | 197 | 17% |
Psychology | 197 | 17% |
Agricultural and Biological Sciences | 184 | 15% |
Engineering | 137 | 12% |
Medicine and Dentistry | 72 | 6% |
Other | 178 | 15% |
Unknown | 223 | 19% |