Human discrimination and modeling of high-frequency complex tones shed light on the neural codes for pitch

Accurate pitch perception of harmonic complex tones is widely believed to rely on temporal fine structure information conveyed by the precise phase-locked responses of auditory-nerve fibers. However, accurate pitch perception remains possible even when spectrally resolved harmonics are presented at frequencies beyond the putative limits of neural phase locking, and it is unclear whether residual temporal information, or a coarser rate-place code, underlies this ability. We addressed this question by measuring human pitch discrimination at low and high frequencies for harmonic complex tones, presented either in isolation or in the presence of concurrent complex-tone maskers. We found that concurrent complex-tone maskers impaired performance at both low and high frequencies, although the impairment introduced by adding maskers at high frequencies relative to low frequencies differed between the tested masker types. We then combined simulated auditory-nerve responses to our stimuli with ideal-observer analysis to quantify the extent to which performance was limited by peripheral factors. We found that the worsening of both frequency discrimination and F0 discrimination at high frequencies could be well accounted for (in relative terms) by optimal decoding of all available information at the level of the auditory nerve. A Python package is provided to reproduce these results, and to simulate responses to acoustic stimuli from the three previously published models of the human auditory nerve used in our analyses.     

Encoding properties of auditory neurons in the brain of a soniferous damselfish: response to simple tones and complex conspecific signals

The fish auditory system encodes important acoustic stimuli used in social communication, but few studies have examined response properties of central auditory neurons to natural signals. We determined the features and responses of single hindbrain and midbrain auditory neurons to tone bursts and playbacks of conspecific sounds in the soniferous damselfish, Abudefduf abdominalis. Most auditory neurons were either silent or had slow irregular resting discharge rates <20 spikes s⁻¹. Average best frequency for neurons to tone stimuli was ~130 Hz but ranged from 80 to 400 Hz with strong phase-locking. This low-frequency sensitivity matches the frequency band of natural sounds. Auditory neurons were also modulated by playbacks of conspecific sounds with thresholds similar to 100 Hz tones, but these thresholds were lower than that of tones at other test frequencies. Thresholds of neurons to natural sounds were lower in the midbrain than the hindbrain. This is the first study to compare response properties of auditory neurons to both simple tones and complex stimuli in the brain of a recently derived soniferous perciform that lacks accessory auditory structures. These data demonstrate that the auditory fish brain is most sensitive to the frequency and temporal components of natural pulsed sounds that provide important signals for conspecific communication.     

Rats’ (Rattus norvegicus) temporal discrimination of brief auditory stimuli: How does it compare with that of humans (Homo sapiens) and zebra finches (Taeniopygia guttata)?

The present study with rats replicated an experiment on the ability of zebra finches and humans to discriminate among brief auditory stimuli (see Weisman et al., 1999, Experiment 2). We trained rats with 27 3-kHz tones that varied in duration from 10 ms to 1420 ms. Reinforcement was contingent on responding (approaching the food well) to the nine medium-durations range tones (56-255 ms) but not to the nine short-durations range (10-46 ms) or long-durations range tones (309-1420 ms). Rats also received post-discrimination transfer tests with 2 kHz and 4 kHz tones that varied over the same durations as the 3 kHz tones. Rats acquired the temporal discrimination to a slightly lower level of accuracy than seen in finches or humans by Weisman et al. (1999). We tested for transfer of the temporal discrimination to find that rats, similar to humans (data from Weisman et al., 1999), transferred to untrained 2-kHz and 4-kHz tones at levels approaching accuracy to that achieved to the trained 3-kHz tone. By contrast, zebra finches (data from Weisman et al., 1999) failed to transfer their discrimination to the trained tone. We conclude that (a) rats discriminate among tone durations at least as well as they do among auditory frequencies and (b) rats like humans, but unlike finches, are insensitive to absolute pitch in their temporal discrimination.     

The role of superior temporal cortex in auditory timing

Recently, there has been upsurge of interest in the neural mechanisms of time perception. A central question is whether the representation of time is distributed over brain regions as a function of stimulus modality, task and length of the duration used or whether it is centralized in a single specific and supramodal network. The answers seem to be converging on the former, and many areas not primarily considered as temporal processing areas remain to be investigated in the temporal domain. Here we asked whether the superior temporal gyrus, an auditory modality specific area, is involved in processing of auditory timing. Repetitive transcranial magnetic stimulation was applied over left and right superior temporal gyri while participants performed either a temporal or a frequency discrimination task of single tones. A significant decrease in performance accuracy was observed after stimulation of the right superior temporal gyrus, in addition to an increase in response uncertainty as measured by the Just Noticeable Difference. The results are specific to auditory temporal processing and performance on the frequency task was not affected. Our results further support the idea of distributed temporal processing and speak in favor of the existence of modality specific temporal regions in the human brain.     

Two measures of temporal resolution in brown-headed cowbirds (<Emphasis Type="Italic">Molothrus ater</Emphasis>)

Studies of auditory temporal resolution in birds have traditionally examined processing capabilities by assessing behavioral discrimination of sounds varying in temporal structure. Here, temporal resolution of the brown-headed cowbird (Molothrus ater) was measured using two auditory evoked potential (AEP)-based methods: auditory brainstem responses (ABRs) to paired clicks and envelope following responses (EFRs) to amplitude-modulated tones. The basic patterns observed in cowbirds were similar to those found in other songbird species, suggesting similar temporal processing capabilities. The amplitude of the ABR to the second click was less than that of the first click at inter-click intervals less than 10 ms, and decreased to 30% at an interval of 1 ms. EFR amplitude was generally greatest at modulation frequencies from 335 to 635 Hz and decreased at higher and lower modulation frequencies. Compared to data from terrestrial mammals these results support recent behavioral findings of enhanced temporal resolution in birds. General agreement between these AEP results and behaviorally based studies suggests that AEPs can provide a useful assessment of temporal resolution in wild bird species.     

Peripheral encoding of behaviorally relevant acoustic signals in a vocal fish: harmonic and beat stimuli

Nesting male midshipman fish, Porichthys notatus, emit simple, long-duration sounds known as hums, which are attractive to gravid females. While hums share the multi-harmonic structure typical of many vertebrate communication sounds, their lack of amplitude modulation gives individual hums unusually simple temporal envelopes. However, hums often overlap, producing beats in the summed acoustic waveform. This study presents responses of individual saccular afferent fibers to two-tone harmonic and beat stimuli presented via an underwater loudspeaker. Spike activity was quantified as vector strength of synchronization and average spike rate. Responses to harmonic stimuli depended on harmonic phase; these effects apparently resulted primarily from variation in waveform fine temporal structure rather than auditory non-linearities. At most phases, addition of the harmonic enhanced afferent synchronization compared to the fundamental alone. Two-tone beat stimuli evoked stronger synchronization to the component frequencies than to the beat modulation rate. Vector strength tended to be higher to the lower frequency component, and this pattern appeared to derive from afferent tuning. Midshipman saccular afferents encoded both the temporal envelope and waveform fine structure of these naturalistic signals, information that may be important in conspecific communication.     

Encoding of phase spectra by the peripheral auditory system of the bullfrog

In this study we have examined the sensitivity of auditory nerve fibers in the bullfrog (Rana catesbeiana) to changes in the phase spectrum of an equal-amplitude multi-harmonic stimulus which spanned the bullfrog's range of hearing. To assess peripheral auditory phase sensitivity, changes in the response properties of VIIIth nerve fibers were measured when the relative phase angle of a single harmonic component nearest a unit's best excitatory frequency was systematically varied. The results revealed that shifts in the phase spectrum are encoded in at least J different ways by the peripheral auditory system of the bullfrog: 1) by changes in the degree of spike synchronization of fibers from both inner ear organs (the amphibian papilla and the basilar papilla) to the fundamental waveform period; 2) by changes in the shapes of period histograms of fibers from both organs; and 3) by changes in the spike rates of amphibian papilla fibers. The presence of phase sensitivity in the peripheral auditory system of the bullfrog indicates that information regarding the fine-temporal waveshape and the underlying phase spectrum of an acoustic signal is contained within the spike trains of VIIIth nerve fibers. Similar sensitivities to changes in the phase spectra and temporal waveshapes of acoustic signals may also be present in the peripheral auditory system of other vertebrates. Such studies could provide valuable insight into the role that phase spectra and temporal waveshape may play in bioacoustic communication.Abbreviations BEF best excitatory frequency - BEC best excitatory component - CS_{f 1} synchronization to the fundamental period Portions of this study have been summarized in abstract form (Bodnar and Capranica 1991)     

Activation of duration-sensitive auditory cortical fields in humans

The influence of stimulus duration on auditory evoked potentials (AEPs) was examined for tones varying randomly in duration, location, and frequency in an auditory selective attention task. Stimulus duration effects were isolated as duration difference waves by subtracting AEPs to short duration tones from AEPs to longer duration tones of identical location, frequency and rise time. This analysis revealed that AEP components generally increased in amplitude and decreased in latency with increments in signal duration, with evidence of longer temporal integration times for lower frequency tones. Different temporal integration functions were seen for different N1 subcomponents. The results suggest that different auditory cortical areas have different temporal integration times, and that these functions vary as a function of tone frequency.     

Involuntary monitoring of sound signals in noise is reflected in the human auditory evoked N1m response

Constant sound sequencing as operationalized by repeated stimulation with tones of the same frequency has multiple effects. On the one hand, it activates mechanisms of habituation and refractoriness, which are reflected in the decrease of response amplitude of evoked responses. On the other hand, the constant sequencing acts as spectral cueing, resulting in tones being detected faster and more accurately. With the present study, by means of magnetoencephalography, we investigated the impact of repeated tone stimulation on the N1m auditory evoked fields, while listeners were distracted from the test sounds. We stimulated subjects with trains of either four tones of the same frequency, or with trains of randomly assigned frequencies. The trains were presented either in a silent or in a noisy background. In silence, the patterns of source strength decline originating from repeated stimulation suggested both, refractoriness as well as habituation as underlying mechanisms. In noise, in contrast, there was no indication of source strength decline. Furthermore, we found facilitating effects of constant sequencing regarding the detection of the single tones as indexed by a shortening of N1m latency. We interpret our findings as a correlate of a bottom-up mechanism that is constantly monitoring the incoming auditory information, even when voluntary attention is directed to a different modality.     

Response of parietal association cortex neurons to acoustic stimulation before and after auditory cortex blockage in the cat

The effect of auditory cortex blockade on response patterns of parietal association cortex neurons responding to different frequency tones was investigated in the cat. Blockade was produced by two methods: bilateral isolation and application of a 6% Nembutal solution to the auditory cortex surface. Frequency threshold curves were plotted for all test neurons. The majority of test neurons (84%) displayed one or two characteristic frequencies before blockade, as against only 63% of all neurons responding following blockade. Changes also affect the range of frequencies at which the cells could respond. Virtually all test neurons responded to application of a broad spectrum of frequencies under normal conditions. After blockade of the auditory cortex 69% of neurons no longer responded to tones above 8–10 kHz. This would suggest that mainly information on high frequency tones is transmitted via the auditory cortex. The question of where acoustic information for parietal association cortex neurons mostly originates is also discussed; association thalamic nuclei are thought to be the main source.A. A. Bogomolets Institute of Physiology, Academy of Sciences of the Ukrainian SSR, Kiev. Translated from Neirofiziologiya, Vol. 18, No. 3, pp. 354–360, May–June, 1986.     

Learning of auditory equivalence classes for vowels by rats

Four male Long-Evans rats were trained to discriminate between synthetic vowel sounds using a GO/NOGO response choice task. The vowels were characterized by an increase in fundamental frequency correlated with an upward shift in formant frequencies. In an initial phase we trained the subjects to discriminate between two vowel categories using two exemplars from each category. In a subsequent phase the ability of the rats to generalize the discrimination between the two categories was tested. To test whether rats might exploit the fact that attributes of training stimuli covaried, we used non-standard stimuli with a reversed relation between fundamental frequency and formants. The overall results demonstrate that rats are able to generalize the discrimination to new instances of the same vowels. We present evidence that the performance of the subjects depended on the relation between fundamental and formant frequencies that they had previously been exposed to. Simple simulation results with artificial neural networks could reproduce most of the behavioral results and support the hypothesis that equivalence classes for vowels are associated with an experience-driven process based on general properties of peripheral auditory coding mixed with elementary learning mechanisms. These results suggest that rats use spectral and temporal cues similarly to humans despite differences in basic auditory capabilities.     

Stimulus Phase Locking of Cortical Oscillation for Auditory Stream Segregation in Rats

The phase of cortical oscillations contains rich information and is valuable for encoding sound stimuli. Here we hypothesized that oscillatory phase modulation, instead of amplitude modulation, is a neural correlate of auditory streaming. Our behavioral evaluation provided compelling evidences for the first time that rats are able to organize auditory stream. Local field potentials (LFPs) were investigated in the cortical layer IV or deeper in the primary auditory cortex of anesthetized rats. In response to ABA- sequences with different inter-tone intervals and frequency differences, neurometric functions were characterized with phase locking as well as the band-specific amplitude evoked by test tones. Our results demonstrated that under large frequency differences and short inter-tone intervals, the neurometric function based on stimulus phase locking in higher frequency bands, particularly the gamma band, could better describe van Noorden’s perceptual boundary than the LFP amplitude. Furthermore, the gamma-band neurometric function showed a build-up-like effect within around 3 seconds from sequence onset. These findings suggest that phase locking and amplitude have different roles in neural computation, and support our hypothesis that temporal modulation of cortical oscillations should be considered to be neurophysiological mechanisms of auditory streaming, in addition to forward suppression, tonotopic separation, and multi-second adaptation.     

Learning Pitch with STDP: A Computational Model of Place and Temporal Pitch Perception Using Spiking Neural Networks

Pitch perception is important for understanding speech prosody, music perception, recognizing tones in tonal languages, and perceiving speech in noisy environments. The two principal pitch perception theories consider the place of maximum neural excitation along the auditory nerve and the temporal pattern of the auditory neurons’ action potentials (spikes) as pitch cues. This paper describes a biophysical mechanism by which fine-structure temporal information can be extracted from the spikes generated at the auditory periphery. Deriving meaningful pitch-related information from spike times requires neural structures specialized in capturing synchronous or correlated activity from amongst neural events. The emergence of such pitch-processing neural mechanisms is described through a computational model of auditory processing. Simulation results show that a correlation-based, unsupervised, spike-based form of Hebbian learning can explain the development of neural structures required for recognizing the pitch of simple and complex tones, with or without the fundamental frequency. The temporal code is robust to variations in the spectral shape of the signal and thus can explain the phenomenon of pitch constancy.     

Learning-induced dynamic receptive field changes in primary auditory cortex of the unanaesthetized Mongolian gerbil

Learning-induced changes of the spectro-temporal characteristics of primary auditory cortex (AI) units were studied by response plane analysis of recordings from the AI in unanaesthetized Mongolian gerbils. Using response planes obtained prior to and after auditory discrimination training bins of significant change were identified and their spectro-temporal distribution was studied. Bins of significant changes were generally found to be distributed over the entire spectro-temporal receptive field but occurred most frequently within the first 100 ms of response in the spectral neighbourhood (1.5 octaves) of the frequency of the reinforced conditioned stimulus. Training-induced response decreases occurred early after 10 ms for reinforced conditioned tones and tones in the frequency neighbourhood. Response increases occurred so early only for non-reinforced tones in the neighbourhood of the reinforced frequency and occurred later (after 40 ms) for the reinforced tones. The results are discussed in the light of dynamic disinhibition. Accepted: 13 August 1997     

Modulation rate transfer functions in bottlenose dolphins (<Emphasis Type="Italic">Tursiops truncatus</Emphasis>) with normal hearing and high-frequency hearing loss

Envelope following responses were measured in two bottlenose dolphins in response to sinusoidal amplitude modulated tones with carrier frequencies from 20 to 60 kHz and modulation rates from 100 to 5,000 Hz. One subject had elevated hearing thresholds at higher frequencies, with threshold differences between subjects varying from ±4 dB at 20 and 30 kHz to +40 dB at 50 and 60 kHz. At each carrier frequency, evoked response amplitudes and phase angles were plotted with respect to modulation frequency to construct modulation rate transfer functions. Results showed that both subjects could follow the stimulus envelope components up to at least 2,000 Hz, regardless of carrier frequency. There were no substantial differences in modulation rate transfer functions for the two subjects suggesting that reductions in hearing sensitivity did not result in reduced temporal processing ability. In contrast to earlier studies, phase data showed group delays of approximately 3.5 ms across the tested frequency range, implying generation site(s) within the brainstem rather than the periphery at modulation rates from 100 to 1,600 Hz. This discrepancy is believed to be the result of undersampling of the modulation rate during previous phase measurements.     

Flying in tune: sexual recognition in mosquitoes

Mosquitoes hear with their antennae, which in most species are sexually dimorphic. Johnston, who discovered the mosquito auditory organ at the base of the antenna 150 years ago, speculated that audition was involved with mating behaviour. Indeed, male mosquitoes are attracted to female flight tones. The male auditory organ has been proposed to act as an acoustic filter for female flight tones, but female auditory behavior is unknown. We show, for the first time, interactive auditory behavior between males and females that leads to sexual recognition. Individual males and females both respond to pure tones by altering wing-beat frequency. Behavioral auditory tuning curves, based on minimum threshold sound levels that elicit a change in wing-beat frequency to pure tones, are sharper than the mechanical tuning of the antennae, with males being more sensitive than females. We flew opposite-sex pairs of tethered Toxorhynchites brevipalpis and found that each mosquito alters its wing-beat frequency in response to the flight tone of the other, so that within seconds their flight-tone frequencies are closely matched, if not completely synchronized. The flight tones of same-sex pairs may converge in frequency but eventually diverge dramatically.     

Maximum decoding abilities of temporal patterns and synchronized firings: application to auditory neurons responding to click trains and amplitude modulated white noise

Simultaneous recordings of an increasing number of neurons have recently become available, but few methods have been proposed to handle this activity. Here, we extract and investigate all the possible temporal neural activity patterns based on synchronized firings of neurons recorded on multiple electrodes, or based on bursts of single-electrode activity in cat primary auditory cortex. We apply this to responses to periodic click trains or sinusoïdal amplitude modulated noise by obtaining for each pattern its temporal modulation transfer function. An algorithm that maximizes the mutual information between all patterns and stimuli subsequently leads to the identification of patterns that optimally decode modulation frequency (MF). We show that stimulus information contained in multi-electrode synchronized firing is not redundant with single-electrode firings and leads to improved efficiency of MF decoding. We also show that the combined use of firing rate and temporal codes leads to a better discrimination of the MF.     

Electrical Brain Responses to an Auditory Illusion and the Impact of Musical Expertise

The presentation of two sinusoidal tones, one to each ear, with a slight frequency mismatch yields an auditory illusion of a beating frequency equal to the frequency difference between the two tones; this is known as binaural beat (BB). The effect of brief BB stimulation on scalp EEG is not conclusively demonstrated. Further, no studies have examined the impact of musical training associated with BB stimulation, yet musicians'' brains are often associated with enhanced auditory processing. In this study, we analysed EEG brain responses from two groups, musicians and non-musicians, when stimulated by short presentation (1 min) of binaural beats with beat frequency varying from 1 Hz to 48 Hz. We focused our analysis on alpha and gamma band EEG signals, and they were analysed in terms of spectral power, and functional connectivity as measured by two phase synchrony based measures, phase locking value and phase lag index. Finally, these measures were used to characterize the degree of centrality, segregation and integration of the functional brain network. We found that beat frequencies belonging to alpha band produced the most significant steady-state responses across groups. Further, processing of low frequency (delta, theta, alpha) binaural beats had significant impact on cortical network patterns in the alpha band oscillations. Altogether these results provide a neurophysiological account of cortical responses to BB stimulation at varying frequencies, and demonstrate a modulation of cortico-cortical connectivity in musicians'' brains, and further suggest a kind of neuronal entrainment of a linear and nonlinear relationship to the beating frequencies.     

Interactions Between Swarming Chironomus annularius (Diptera: Chironomidae) Males: Role of Acoustic Behavior

Males of swarming species of chironomids use their auditory system (Johnston's organs) to recognize a female within swarm and do not respond to male flight tones. However, in some cases the male–male interactions were observed at a high frequency. The role of acoustic behavior in this phenomenon in C. annularius was studied. The results showed that male Johnston's organs were sensitive to male flight tones from a distance of about 1–1.5 cm. The carrier frequencies of these sounds negatively correlated with male body size. Thus we would expect that male–male interactions will occur mainly between large males. Nonetheless, the analysis of caught pairs revealed that in both male–male and female–male interactions small males had an advantage. The ability of males to perceive the male flight tones is discussed with respect to swarming behavior and mating success.