Coding of concurrent vocal signals by the auditory midbrain: effects of duration

Neural selectivity to signal duration within the auditory midbrain has been observed in several species and is thought to play a role in signal recognition. Here we examine the effects of signal duration on the coding of individual and concurrent vocal signals in a teleost fish with exceptionally long duration vocalizations, the plainfin midshipman, Porichthys notatus. Nesting males produce long-duration, multi-harmonic signals known as hums to attract females to their nests; overlapping hums produce acoustic beats at the difference frequency of their spectral components. Our data show that all midbrain neurons have sustained responses to long-duration hum-like tones and beats. Overall spike counts increase linearly with signal duration, although spike rates decrease dramatically. Neurons show varying degrees of spike rate decline and hence, differential changes in spike rate across the neuron population may code signal duration. Spike synchronization to beat difference frequency progressively increases throughout long-duration beats such that significant difference frequency coding is maintained in most neurons. The significance level of difference frequency synchronization coding increases by an order of magnitude when integrated over the entirety of long-duration signals. Thus, spike synchronization remains a reliable difference frequency code and improves with integration over longer time spans.     

Beat Processing Is Pre-Attentive for Metrically Simple Rhythms with Clear Accents: An ERP Study

The perception of a regular beat is fundamental to music processing. Here we examine whether the detection of a regular beat is pre-attentive for metrically simple, acoustically varying stimuli using the mismatch negativity (MMN), an ERP response elicited by violations of acoustic regularity irrespective of whether subjects are attending to the stimuli. Both musicians and non-musicians were presented with a varying rhythm with a clear accent structure in which occasionally a sound was omitted. We compared the MMN response to the omission of identical sounds in different metrical positions. Most importantly, we found that omissions in strong metrical positions, on the beat, elicited higher amplitude MMN responses than omissions in weak metrical positions, not on the beat. This suggests that the detection of a beat is pre-attentive when highly beat inducing stimuli are used. No effects of musical expertise were found. Our results suggest that for metrically simple rhythms with clear accents beat processing does not require attention or musical expertise. In addition, we discuss how the use of acoustically varying stimuli may influence ERP results when studying beat processing.     

Spectral Characteristics of Phase Sensitivity and Discharge Rate of Neurons in the Ascending Tectofugal Visual System

Drifting gratings can modulate the activity of visual neurons at the temporal frequency of the stimulus. In order to characterize the temporal frequency modulation in the cat’s ascending tectofugal visual system, we recorded the activity of single neurons in the superior colliculus, the suprageniculate nucleus, and the anterior ectosylvian cortex during visual stimulation with drifting sine-wave gratings. In response to such stimuli, neurons in each structure showed an increase in firing rate and/or oscillatory modulated firing at the temporal frequency of the stimulus (phase sensitivity). To obtain a more complete characterization of the neural responses in spatiotemporal frequency domain, we analyzed the mean firing rate and the strength of the oscillatory modulations measured by the standardized Fourier component of the response at the temporal frequency of the stimulus. We show that the spatiotemporal stimulus parameters that elicit maximal oscillations often differ from those that elicit a maximal discharge rate. Furthermore, the temporal modulation and discharge-rate spectral receptive fields often do not overlap, suggesting that the detection range for visual stimuli provided jointly by modulated and unmodulated response components is larger than the range provided by a one response component.     

Recognition of Non-Harmonic Natural Sounds by Small Mammals Using Competitive Training

Animals recognize biologically relevant sounds, such as the non-harmonic sounds made by some predators, and respond with adaptive behaviors, such as escaping. To clarify which acoustic parameters are used for identifying non-harmonic, noise-like, broadband sounds, guinea pigs were conditioned to a natural target sound by introducing a novel training procedure in which 2 or 3 guinea pigs in a group competed for food. A set of distinct behavioral reactions was reliably induced almost exclusively to the target sound in a 2-week operant training. When fully conditioned, individual animals were separately tested for recognition of a set of target-like sounds that had been modified from the target sound, with spectral ranges eliminated or with fine or coarse temporal structures altered. The results show that guinea pigs are able to identify the noise-like non-harmonic natural sounds by relying on gross spectral compositions and/or fine temporal structures, just as birds are thought to do in the recognition of harmonic birdsongs. These findings are discussed with regard to similarities and dissimilarities to harmonic sound recognition. The results suggest that similar but not identical processing that requires different time scales might be used to recognize harmonic and non-harmonic sounds, at least in small mammals.     

A computational model of cellular mechanisms of temporal coding in the medial geniculate body (MGB)

Acoustic stimuli are often represented in the early auditory pathway as patterns of neural activity synchronized to time-varying features. This phase-locking predominates until the level of the medial geniculate body (MGB), where previous studies have identified two main, largely segregated response types: Stimulus-synchronized responses faithfully preserve the temporal coding from its afferent inputs, and Non-synchronized responses, which are not phase locked to the inputs, represent changes in temporal modulation by a rate code. The cellular mechanisms underlying this transformation from phase-locked to rate code are not well understood. We use a computational model of a MGB thalamocortical neuron to test the hypothesis that these response classes arise from inferior colliculus (IC) excitatory afferents with divergent properties similar to those observed in brain slice studies. Large-conductance inputs exhibiting synaptic depression preserved input synchrony as short as 12.5 ms interclick intervals, while maintaining low firing rates and low-pass filtering responses. By contrast, small-conductance inputs with Mixed plasticity (depression of AMPA-receptor component and facilitation of NMDA-receptor component) desynchronized afferent inputs, generated a click-rate dependent increase in firing rate, and high-pass filtered the inputs. Synaptic inputs with facilitation often permitted band-pass synchrony along with band-pass rate tuning. These responses could be tuned by changes in membrane potential, strength of the NMDA component, and characteristics of synaptic plasticity. These results demonstrate how the same synchronized input spike trains from the inferior colliculus can be transformed into different representations of temporal modulation by divergent synaptic properties.     

Peripheral encoding of behaviorally relevant acoustic signals in a vocal fish: single tones

The midshipman fish, Porichthys notatus, generates acoustic signals for intraspecific communication. Nesting males produce long-duration “hums” which attract gravid females and can be effectively mimicked by pure tones. In this study we examine the encoding of tonal signals by the midshipman peripheral auditory system. Single-unit recordings were made from afferents innervating the sacculus while presenting sounds via an underwater loudspeaker. Units were characterized by iso-intensity spike rate and vector strength of synchronization curves, as well as by peri-stimulus time histograms. Additionally, response-intensity curves and responses to long-duration (up to 10 s) stimuli were obtained. As has been seen in other teleosts, afferents had highly variable activity profiles. Excitatory frequencies ranged from 60 to over 300 Hz with most units responding best around 70 or 140 Hz. Thresholds at 90 Hz ranged from 95 to 145 dB re 1 μPa. Strong synchronization provided a robust temporal code of frequency, comparable to that described for goldfish. Spike rate showed varying degrees of adaptation but high rates were generally maintained even for 10-s stimuli. The midshipman peripheral auditory system is well suited to encoding conspecific communication signals, but nonetheless shares many response patterns with the auditory system of other teleosts. Accepted: 10 February 1999     

Stimulus variability affects the amplitude of the auditory steady-state response

In this study we investigate whether stimulus variability affects the auditory steady-state response (ASSR). We present cosinusoidal AM pulses as stimuli where we are able to manipulate waveform shape independently of the fixed repetition rate of 4 Hz. We either present sounds in which the waveform shape, the pulse-width, is fixed throughout the presentation or where it varies pseudo-randomly. Importantly, the average spectra of all the fixed-width AM stimuli are equal to the spectra of the mixed-width AM. Our null hypothesis is that the average ASSR to the fixed-width AM will not be significantly different from the ASSR to the mixed-width AM. In a region of interest beamformer analysis of MEG data, we compare the 4 Hz component of the ASSR to the mixed-width AM with the 4 Hz component of the ASSR to the pooled fixed-width AM. We find that at the group level, there is a significantly greater response to the variable mixed-width AM at the medial boundary of the Middle and Superior Temporal Gyri. Hence, we find that adding variability into AM stimuli increases the amplitude of the ASSR. This observation is important, as it provides evidence that analysis of the modulation waveform shape is an integral part of AM processing. Therefore, standard steady-state studies in audition, using sinusoidal AM, may not be sensitive to a key feature of acoustic processing.     

Seismic and auditory tuning curves from bullfrog saccular and amphibian papular axons

We present seismic and auditory frequency tuning curves of individual bullfrog, Rana catesbeiana, saccular and amphibian papilla axons that responded to both seismic and auditory stimuli. In this study we found: 1) most saccular axons respond well to auditory stimuli with moderate signal strength (50-70 dB SPL) as well as to seismic stimuli; 2) most amphibian papilla axons respond well to seismic stimuli as well as to auditory stimuli, and their seismic sensitivities are comparable to those of saccular axons (responding to sinusoidal stimuli with peak accelerations in the range 0.001 to 0.1 cm/S2); 3) the responses to both seismic and auditory stimuli from both saccule and amphibian papilla are tuned, i.e. the strength of the response varies with the frequency of the stimulus; and this tuning is clearly not the result of second order resonance; 4) in individual axons the tuning properties for seismic stimuli often are not the same as those for auditory stimuli, a fact that may provide clues about how the stimulus signal energy is transferred to the hair cells in each case.     

Multi-Variate EEG Analysis as a Novel Tool to Examine Brain Responses to Naturalistic Music Stimuli

Note onsets in music are acoustic landmarks providing auditory cues that underlie the perception of more complex phenomena such as beat, rhythm, and meter. For naturalistic ongoing sounds a detailed view on the neural representation of onset structure is hard to obtain, since, typically, stimulus-related EEG signatures are derived by averaging a high number of identical stimulus presentations. Here, we propose a novel multivariate regression-based method extracting onset-related brain responses from the ongoing EEG. We analyse EEG recordings of nine subjects who passively listened to stimuli from various sound categories encompassing simple tone sequences, full-length romantic piano pieces and natural (non-music) soundscapes. The regression approach reduces the 61-channel EEG to one time course optimally reflecting note onsets. The neural signatures derived by this procedure indeed resemble canonical onset-related ERPs, such as the N1-P2 complex. This EEG projection was then utilized to determine the Cortico-Acoustic Correlation (CACor), a measure of synchronization between EEG signal and stimulus. We demonstrate that a significant CACor (i) can be detected in an individual listener''s EEG of a single presentation of a full-length complex naturalistic music stimulus, and (ii) it co-varies with the stimuli’s average magnitudes of sharpness, spectral centroid, and rhythmic complexity. In particular, the subset of stimuli eliciting a strong CACor also produces strongly coordinated tension ratings obtained from an independent listener group in a separate behavioral experiment. Thus musical features that lead to a marked physiological reflection of tone onsets also contribute to perceived tension in music.     

Encoding properties of auditory neurons in the brain of a soniferous damselfish: response to simple tones and complex conspecific signals

The fish auditory system encodes important acoustic stimuli used in social communication, but few studies have examined response properties of central auditory neurons to natural signals. We determined the features and responses of single hindbrain and midbrain auditory neurons to tone bursts and playbacks of conspecific sounds in the soniferous damselfish, Abudefduf abdominalis. Most auditory neurons were either silent or had slow irregular resting discharge rates <20 spikes s⁻¹. Average best frequency for neurons to tone stimuli was ~130 Hz but ranged from 80 to 400 Hz with strong phase-locking. This low-frequency sensitivity matches the frequency band of natural sounds. Auditory neurons were also modulated by playbacks of conspecific sounds with thresholds similar to 100 Hz tones, but these thresholds were lower than that of tones at other test frequencies. Thresholds of neurons to natural sounds were lower in the midbrain than the hindbrain. This is the first study to compare response properties of auditory neurons to both simple tones and complex stimuli in the brain of a recently derived soniferous perciform that lacks accessory auditory structures. These data demonstrate that the auditory fish brain is most sensitive to the frequency and temporal components of natural pulsed sounds that provide important signals for conspecific communication.     

Broadband Onset Inhibition Can Suppress Spectral Splatter in the Auditory Brainstem

In vivo intracellular responses to auditory stimuli revealed that, in a particular population of cells of the ventral nucleus of the lateral lemniscus (VNLL) of rats, fast inhibition occurred before the first action potential. These experimental data were used to constrain a leaky integrate-and-fire (LIF) model of the neurons in this circuit. The post-synaptic potentials of the VNLL cell population were characterized using a method of triggered averaging. Analysis suggested that these inhibited VNLL cells produce action potentials in response to a particular magnitude of the rate of change of their membrane potential. The LIF model was modified to incorporate the VNLL cells’ distinctive action potential production mechanism. The model was used to explore the response of the population of VNLL cells to simple speech-like sounds. These sounds consisted of a simple tone modulated by a saw tooth with exponential decays, similar to glottal pulses that are the repeated impulses seen in vocalizations. It was found that the harmonic component of the sound was enhanced in the VNLL cell population when compared to a population of auditory nerve fibers. This was because the broadband onset noise, also termed spectral splatter, was suppressed by the fast onset inhibition. This mechanism has the potential to greatly improve the clarity of the representation of the harmonic content of certain kinds of natural sounds.     

Losing the beat: deficits in temporal coordination

Tapping or clapping to an auditory beat, an easy task for most individuals, reveals precise temporal synchronization with auditory patterns such as music, even in the presence of temporal fluctuations. Most models of beat-tracking rely on the theoretical concept of pulse: a perceived regular beat generated by an internal oscillation that forms the foundation of entrainment abilities. Although tapping to the beat is a natural sensorimotor activity for most individuals, not everyone can track an auditory beat. Recently, the case of Mathieu was documented (Phillips-Silver et al. 2011 Neuropsychologia 49, 961–969. (doi:10.1016/j.neuropsychologia.2011.02.002)). Mathieu presented himself as having difficulty following a beat and exhibited synchronization failures. We examined beat-tracking in normal control participants, Mathieu, and a second beat-deaf individual, who tapped with an auditory metronome in which unpredictable perturbations were introduced to disrupt entrainment. Both beat-deaf cases exhibited failures in error correction in response to the perturbation task while exhibiting normal spontaneous motor tempi (in the absence of an auditory stimulus), supporting a deficit specific to perception–action coupling. A damped harmonic oscillator model was applied to the temporal adaptation responses; the model''s parameters of relaxation time and endogenous frequency accounted for differences between the beat-deaf cases as well as the control group individuals.     

Encoding of phase spectra by the peripheral auditory system of the bullfrog

In this study we have examined the sensitivity of auditory nerve fibers in the bullfrog (Rana catesbeiana) to changes in the phase spectrum of an equal-amplitude multi-harmonic stimulus which spanned the bullfrog's range of hearing. To assess peripheral auditory phase sensitivity, changes in the response properties of VIIIth nerve fibers were measured when the relative phase angle of a single harmonic component nearest a unit's best excitatory frequency was systematically varied. The results revealed that shifts in the phase spectrum are encoded in at least J different ways by the peripheral auditory system of the bullfrog: 1) by changes in the degree of spike synchronization of fibers from both inner ear organs (the amphibian papilla and the basilar papilla) to the fundamental waveform period; 2) by changes in the shapes of period histograms of fibers from both organs; and 3) by changes in the spike rates of amphibian papilla fibers. The presence of phase sensitivity in the peripheral auditory system of the bullfrog indicates that information regarding the fine-temporal waveshape and the underlying phase spectrum of an acoustic signal is contained within the spike trains of VIIIth nerve fibers. Similar sensitivities to changes in the phase spectra and temporal waveshapes of acoustic signals may also be present in the peripheral auditory system of other vertebrates. Such studies could provide valuable insight into the role that phase spectra and temporal waveshape may play in bioacoustic communication.Abbreviations BEF best excitatory frequency - BEC best excitatory component - CS_{f 1} synchronization to the fundamental period Portions of this study have been summarized in abstract form (Bodnar and Capranica 1991)     

Auditory Processing of Temporal Information in a Neotropical Frog is Independent of Signal Intensity

Animals often encounter the problem of identifying the temporal structure of their species-specific communication sounds amidst heterospecific signals that are more intense. Little information is available, however, concerning the effects of intensity on these discriminative capacities. Here we report that male frogs, Physalaemus pustulosus, are able to discriminate between sounds that differ only in their direction of frequency modulation and that this discrimination remains intact over their entire response range; more than a 10,000-fold range in sound intensity in some cases.     

Dissociable Neural Response Signatures for Slow Amplitude and Frequency Modulation in Human Auditory Cortex

Natural auditory stimuli are characterized by slow fluctuations in amplitude and frequency. However, the degree to which the neural responses to slow amplitude modulation (AM) and frequency modulation (FM) are capable of conveying independent time-varying information, particularly with respect to speech communication, is unclear. In the current electroencephalography (EEG) study, participants listened to amplitude- and frequency-modulated narrow-band noises with a 3-Hz modulation rate, and the resulting neural responses were compared. Spectral analyses revealed similar spectral amplitude peaks for AM and FM at the stimulation frequency (3 Hz), but amplitude at the second harmonic frequency (6 Hz) was much higher for FM than for AM. Moreover, the phase delay of neural responses with respect to the full-band stimulus envelope was shorter for FM than for AM. Finally, the critical analysis involved classification of single trials as being in response to either AM or FM based on either phase or amplitude information. Time-varying phase, but not amplitude, was sufficient to accurately classify AM and FM stimuli based on single-trial neural responses. Taken together, the current results support the dissociable nature of cortical signatures of slow AM and FM. These cortical signatures potentially provide an efficient means to dissect simultaneously communicated slow temporal and spectral information in acoustic communication signals.     

Bats and frogs and animals in between: evidence for a common central timing mechanism to extract periodicity pitch

Widely divergent vertebrates share a common central temporal mechanism for representing periodicities of acoustic waveform events. In the auditory nerve, periodicities corresponding to frequencies or rates from about 10 Hz to over 1,000 Hz are extracted from pure tones, from low-frequency complex sounds (e.g., 1st harmonic in bullfrog calls), from mid-frequency sounds with low-frequency modulations (e.g., amplitude modulation rates in cat vocalizations), and from time intervals between high-frequency transients (e.g., pulse-echo delay in bat sonar). Time locking of neuronal responses to periodicities from about 50 ms down to 4 ms or less (about 20–300 Hz) is preserved in the auditory midbrain, where responses are dispersed across many neurons with different onset latencies from 4–5 to 20–50 ms. Midbrain latency distributions are wide enough to encompass two or more repetitions of successive acoustic events, so that responses to multiple, successive periods are ongoing simultaneously in different midbrain neurons. These latencies have a previously unnoticed periodic temporal pattern that determines the specific times for the dispersed on-responses.     

The Dynamics of Attention during Free Looking

Simple methods to study attention dynamics in challenging research and practical applications are limited. We explored the utility of examining attention dynamics during free looking with steady-state visual evoked potentials (SSVEPs), which reflect the effects of attention on early sensory processing. This method can be used with participants who cannot follow verbal instructions and patients without voluntary motor control. In our healthy participants, there were robust fluctuations in the strength of SSVEPs driven by the fixated and non-fixated stimuli (rapidly changing pictures of faces) in the seconds leading up to the moment they chose to shift their gaze to the next stimulus sequence. Furthermore, the amplitude of SSVEPs driven by the fixated stimuli predicted subsequent recognition of individual stimuli. The results illustrate how information about the temporal course of attention during free looking can be obtained with simple methods based on the attentional modulation of SSVEPs.     

Representation of complex vocalizations in the Lusitanian toadfish auditory system: evidence of fine temporal,frequency and amplitude discrimination

Many fishes rely on their auditory skills to interpret crucial information about predators and prey, and to communicate intraspecifically. Few studies, however, have examined how complex natural sounds are perceived in fishes. We investigated the representation of conspecific mating and agonistic calls in the auditory system of the Lusitanian toadfish Halobatrachus didactylus, and analysed auditory responses to heterospecific signals from ecologically relevant species: a sympatric vocal fish (meagre Argyrosomus regius) and a potential predator (dolphin Tursiops truncatus). Using auditory evoked potential (AEP) recordings, we showed that both sexes can resolve fine features of conspecific calls. The toadfish auditory system was most sensitive to frequencies well represented in the conspecific vocalizations (namely the mating boatwhistle), and revealed a fine representation of duration and pulsed structure of agonistic and mating calls. Stimuli and corresponding AEP amplitudes were highly correlated, indicating an accurate encoding of amplitude modulation. Moreover, Lusitanian toadfish were able to detect T. truncatus foraging sounds and A. regius calls, although at higher amplitudes. We provide strong evidence that the auditory system of a vocal fish, lacking accessory hearing structures, is capable of resolving fine features of complex vocalizations that are probably important for intraspecific communication and other relevant stimuli from the auditory scene.     

Modulation of human muscle spindle discharge by arterial pulsations--functional effects and consequences

Arterial pulsations are known to modulate muscle spindle firing; however, the physiological significance of such synchronised modulation has not been investigated. Unitary recordings were made from 75 human muscle spindle afferents innervating the pretibial muscles. The modulation of muscle spindle discharge by arterial pulsations was evaluated by R-wave triggered averaging and power spectral analysis. We describe various effects arterial pulsations may have on muscle spindle afferent discharge. Afferents could be "driven" by arterial pulsations, e.g., showing no other spontaneous activity than spikes generated with cardiac rhythmicity. Among afferents showing ongoing discharge that was not primarily related to cardiac rhythmicity we illustrate several mechanisms by which individual spikes may become phase-locked. However, in the majority of afferents the discharge rate was modulated by the pulse wave without spikes being phase locked. Then we assessed whether these influences changed in two physiological conditions in which a sustained increase in muscle sympathetic nerve activity was observed without activation of fusimotor neurones: a maximal inspiratory breath-hold, which causes a fall in systolic pressure, and acute muscle pain, which causes an increase in systolic pressure. The majority of primary muscle spindle afferents displayed pulse-wave modulation, but neither apnoea nor pain had any significant effect on the strength of this modulation, suggesting that the physiological noise injected by the arterial pulsations is robust and relatively insensitive to fluctuations in blood pressure. Within the afferent population there was a similar number of muscle spindles that were inhibited and that were excited by the arterial pulse wave, indicating that after signal integration at the population level, arterial pulsations of opposite polarity would cancel each other out. We speculate that with close-to-threshold stimuli the arterial pulsations may serve as an endogenous noise source that may synchronise the sporadic discharge within the afferent population and thus facilitate the detection of weak stimuli.     

Correlation between auditory evoked responses in the thalamus and species-specific call characteristics

This evoked potential study of the bullfrog's auditory thalamic area (an auditory responsive region in the posterior dorsal thalamus) shows that complex processing, distinct from that reported in lower auditory regions, occurs in this center. An acoustic stimulus consisting of two tones, one which stimulates either the low-frequency or the mid-frequency sensitive population of auditory nerve fibers from the amphibian papilla and the other the high-frequency sensitive population of fibers from the basilar papilla, evoked a maximal response. The amplitude of the response to the simultaneous stimulation of the two auditory organs was, in some locations, much larger than the linear sum of the responses to the individual tones presented separately. Bimodal spectral stimuli that had relatively long rise-times (greater than or equal to 100 ms) evoked much larger responses than similar sounds with short rise-times. The optimal rise-times were close to those occurring in the bullfrog's mating call. The response was dependent on the waveform periodicity and harmonic content, with a fundamental frequency of 200 Hz producing a larger response than those with fundamentals of 50, 100 or 300 Hz. Six of the natural calls in the bullfrog's vocal repertoire were tested and the mating call and warning call were found to evoke the best responses. Each of these calls stimulate the two auditory organs simultaneously. The evoked response had a long refractory period which could not be altered by lesioning the efferent telencephalic pathways. The type of spectral and temporal information extracted by the auditory thalamic area suggests that this center is involved in processing complex sounds and likely plays an important role in the bullfrog's detection of some of its vocal signals.