The Neural Coding of Speech Across Human Languages

Study Purpose

The overall goal of this study is to reveal the fundamental neural mechanisms that underlie comprehension across human spoken languages. An understanding of how speech is coded in the brain has significant implications for the development of new diagnostic and rehabilitative strategies for language disorders (e.g. aphasia, dyslexia, autism, et alia). The basic mechanisms underlying comprehension of spoken language are unknown. Researchers are only beginning to understand how the human brain extracts the most fundamental linguistic elements (consonants and vowels) from a complex and highly variable acoustic signal. Traditional theories have posited a 'universal' phonetic inventory shared by all humans, but this has been challenged by other newer theories that each language has its own unique and specialized code. An investigation of the cortical representation of speech sounds across languages can likely shed light on this fundamental question. Previous research has implicated the superior temporal cortex in the processing of speech sounds. Most of this work has been entirely carried out in English. The recording of neural activity directly from the cortical surface from individuals with different language experience is a promising approach since it can provide both high spatial and temporal resolution. This study will examine the mechanisms of phonetic encoding, by utilizing neurophysiological recordings obtained during neurosurgical procedures. High-density electrode arrays, advanced signal processing, and direct electrocortical stimulation will be utilized to unravel both local and population encoding of speech sounds in the lateral temporal cortex. This study will also examine the neural encoding of speech in patients who are monolingual and bilingual in Mandarin, Spanish, and English, the most common spoken languages worldwide, and feature important contrastive differences of pitch, formant, and temporal envelope. A cross-linguistic approach is critical for a true understanding of language, while also striving to achieve a broader approach of diversity and inclusion in neuroscience of language.

Recruitment Criteria

Accepts Healthy Volunteers

Healthy volunteers are participants who do not have a disease or condition, or related conditions or symptoms

Study Type

An interventional clinical study is where participants are assigned to receive one or more interventions (or no intervention) so that researchers can evaluate the effects of the interventions on biomedical or health-related outcomes.

An observational clinical study is where participants identified as belonging to study groups are assessed for biomedical or health outcomes.

Searching Both is inclusive of interventional and observational studies.

Eligible Ages 18 Years - 70 Years
Gender All
More Inclusion & Exclusion Criteria

Inclusion Criteria:

  • - Participants with epilepsy or brain tumors at UCSF undergoing surgical electrode implantation for seizure localization or for speech and language mapping and.
  • - Participants with electrodes implanted in at least two regions of interest who are willing and able to cooperate with study tasks.

Exclusion Criteria:

  • - Participants who lack capacity or decline to provide informed consent, - Participants who have significant cerebral lesions or.
  • - Participants with cognitive deficits that preclude reliable completion of study tasks.

Trial Details

Trial ID:

This trial id was obtained from, a service of the U.S. National Institutes of Health, providing information on publicly and privately supported clinical studies of human participants with locations in all 50 States and in 196 countries.


Phase 1: Studies that emphasize safety and how the drug is metabolized and excreted in humans.

Phase 2: Studies that gather preliminary data on effectiveness (whether the drug works in people who have a certain disease or condition) and additional safety data.

Phase 3: Studies that gather more information about safety and effectiveness by studying different populations and different dosages and by using the drug in combination with other drugs.

Phase 4: Studies occurring after FDA has approved a drug for marketing, efficacy, or optimal use.

Lead Sponsor

The sponsor is the organization or person who oversees the clinical study and is responsible for analyzing the study data.

University of California, San Francisco
Principal Investigator

The person who is responsible for the scientific and technical direction of the entire clinical study.

Edward F Chang, MD
Principal Investigator Affiliation University of California, San Francisco
Agency Class

Category of organization(s) involved as sponsor (and collaborator) supporting the trial.

Other, NIH
Overall Status Enrolling by invitation
Countries United States

The disease, disorder, syndrome, illness, or injury that is being studied.

Epilepsy, Brain Tumor, Speech, Bilingualism
Additional Details

Experimental approaches with significantly greater spatial and temporal resolution are necessary to directly resolve, both local- and population- level, the contrastive encoding of speech sounds. This study proposes an innovative methodological approach using customized intracranial high-density electrode arrays to record neural activity directly from nonprimary auditory cortex in patients undergoing clinical neurosurgical procedures (acute intraoperative and chronic extraoperative). This approach overcomes obstacles in traditional neuroimaging by offering high signal-to-noise recordings, unprecedented detailed spatiotemporal resolution, and a large number of simultaneously recorded cortical sites in awake, behaving subjects. The research study team will leverage the diversity of languages spoken by patients that are treated at the large volume epilepsy and tumor brain mapping programs at the University of California, San Francisco. They will examine cortical responses to speech stimuli (natural speech corpora and control tokens) in Spanish, Mandarin, and English speakers (monolingual and bilingual). They will also focus on encoding models in three fundamental domains of acoustic-phonetic cues that are present in all languages: pitch, formants, and amplitude envelope. The aims of this study seeks to determine how pitch cues encode lexical tone processing in Mandarin (Aim 1), the cortical representation of vowels in Spanish and English (Aim 2), and the encoding of the speech amplitude envelope in Spanish and English (Aim 3). Together, these aims will elucidate mechanistic principles of speech encoding in the human auditory cortex to understand what is shared and different across human spoken languages. Abnormalities in these fundamental processes have been implicated in a host of communication disorders such as dyslexia, developmental language disorder, central hearing loss, and aphasia. These results should heavily impact current theories of speech processing and, therefore, will have significant implications for understanding and remediating human disorders across different languages.

Arms & Interventions


Experimental: Electrocorticography (ECoG) recording during Speech Tasks

Participants listened to 20-minute Speech Tasks while ECoG signals for neural activity was recorded during their intraoperative procedure or inpatient hospitalization at the University of California, San Francisco (UCSF).


Behavioral: - Speech Tasks

Listen to 20-minutes of speech sounds in English, Spanish, and/or Mandarin.

Contact a Trial Team

If you are interested in learning more about this trial, find the trial site nearest to your location and contact the site coordinator via email or phone. We also strongly recommend that you consult with your healthcare provider about the trials that may interest you and refer to our terms of service below.

University of California, San Francisco, San Francisco, California



University of California, San Francisco

San Francisco, California, 94143

Stay Informed & Connected