A neurocomputational model of stimulus-specific adaptation to oddball and Markov sequences

Stimulus-specific adaptation (SSA) occurs when the spike rate of a neuron decreases with repetitions of the same stimulus, but recovers when a different stimulus is presented. It has been suggested that SSA in single auditory neurons may provide information to change detection mechanisms evident at other scales (e.g., mismatch negativity in the event related potential), and participate in the control of attention and the formation of auditory streams. This article presents a spiking-neuron model that accounts for SSA in terms of the convergence of depressing synapses that convey feature-specific inputs. The model is anatomically plausible, comprising just a few homogeneously connected populations, and does not require organised feature maps. The model is calibrated to match the SSA measured in the cortex of the awake rat, as reported in one study. The effect of frequency separation, deviant probability, repetition rate and duration upon SSA are investigated. With the same parameter set, the model generates responses consistent with a wide range of published data obtained in other auditory regions using other stimulus configurations, such as block, sequential and random stimuli. A new stimulus paradigm is introduced, which generalises the oddball concept to Markov chains, allowing the experimenter to vary the tone probabilities and the rate of switching independently. The model predicts greater SSA for higher rates of switching. Finally, the issue of whether rarity or novelty elicits SSA is addressed by comparing the responses of the model to deviants in the context of a sequence of a single standard or many standards. The results support the view that synaptic adaptation alone can explain almost all aspects of SSA reported to date, including its purported novelty component, and that non-trivial networks of depressing synapses can intensify this novelty response.     

Stimulus-specific adaptation in the auditory thalamus of the anesthetized rat

The specific adaptation of neuronal responses to a repeated stimulus (Stimulus-specific adaptation, SSA), which does not fully generalize to other stimuli, provides a mechanism for emphasizing rare and potentially interesting sensory events. Previous studies have demonstrated that neurons in the auditory cortex and inferior colliculus show SSA. However, the contribution of the medial geniculate body (MGB) and its main subdivisions to SSA and detection of rare sounds remains poorly characterized. We recorded from single neurons in the MGB of anaesthetized rats while presenting a sequence composed of a rare tone presented in the context of a common tone (oddball sequences). We demonstrate that a significant percentage of neurons in MGB adapt in a stimulus-specific manner. Neurons in the medial and dorsal subdivisions showed the strongest SSA, linking this property to the non-lemniscal pathway. Some neurons in the non-lemniscal regions showed strong SSA even under extreme testing conditions (e.g., a frequency interval of 0.14 octaves combined with a stimulus onset asynchrony of 2000 ms). Some of these neurons were able to discriminate between two very close frequencies (frequency interval of 0.057 octaves), revealing evidence of hyperacuity in neurons at a subcortical level. Thus, SSA is expressed strongly in the rat auditory thalamus and contribute significantly to auditory change detection.     

Stimulus-specific adaptation and deviance detection in the auditory system: experiments and models

Stimulus-specific adaptation (SSA) is the reduction in the response to a common stimulus that does not generalize, or only partially generalizes, to other, rare stimuli. SSA has been proposed to be a correlate of ‘deviance detection’, an important computational task of sensory systems. SSA is ubiquitous in the auditory system: It is found both in cortex and in subcortical stations, and it has been demonstrated in many mammalian species as well as in birds. A number of models have been suggested in the literature to account for SSA in the auditory domain. In this review, the experimental literature is critically examined in relationship to these models. While current models can all account for auditory SSA to some degree, none is fully compatible with the available findings.     

Auditory change detection by a single neuron in an insect

The detection of novel signals in the auditory scene is an elementary task of any hearing system. In Neoconocephalus katydids, a primary auditory interneuron (TN-1) with broad spectral sensitivity, responded preferentially to rare deviant pulses (7 pulses/s repetition rate) embedded among common standard pulses (140 pulses/s repetition rate). Eliminating inhibitory input did not affect the detection of the deviant pulses. Detection thresholds for deviant pulses increased significantly with increasing amplitude of standard pulses. Responses to deviant pulses occurred when the carrier frequencies of deviant and standard were sufficiently different, both when the deviant had a higher or lower carrier frequency than the standard. Recordings from receptor neurons revealed that TN-1 responses to the deviant pulses did not depend on the population response strength of the receptors, but on the distribution of the receptor cell activity. TN-1 responses to the deviant pulse occurred only when the standard and deviant pulses were transmitted by different groups of receptor cells. TN-1 responses parallel stimulus specific adaptation (SSA) described in mammalian auditory system. The results support the hypothesis that the mechanisms underlying SSA and change-detection are located in the TN-1 dendrite, rather than the receptor cells.     

Detection of simple and pattern regularity violations occurs at different levels of the auditory hierarchy

Auditory deviance detection in humans is indexed by the mismatch negativity (MMN), a component of the auditory evoked potential (AEP) of the electroencephalogram (EEG) occurring at a latency of 100-250 ms after stimulus onset. However, by using classic oddball paradigms, differential responses to regularity violations of simple auditory features have been found at the level of the middle latency response (MLR) of the AEP occurring within the first 50 ms after stimulus (deviation) onset. These findings suggest the existence of fast deviance detection mechanisms for simple feature changes, but it is not clear whether deviance detection among more complex acoustic regularities could be observed at such early latencies. To test this, we examined the pre-attentive processing of rare stimulus repetitions in a sequence of tones alternating in frequency in both long and middle latency ranges. Additionally, we introduced occasional changes in the interaural time difference (ITD), so that a simple-feature regularity could be examined in the same paradigm. MMN was obtained for both repetition and ITD deviants, occurring at 150 ms and 100 ms after stimulus onset respectively. At the level of the MLR, a difference was observed between standards and ITD deviants at the Na component (20-30 ms after stimulus onset), for 800 Hz tones, but not for repetition deviants. These findings suggest that detection mechanisms for deviants to simple regularities, but not to more complex regularities, are already activated in the MLR range, supporting the view that the auditory deviance detection system is organized in a hierarchical manner.     

The Effect of Adaptation on the Tuning Curves of Rat Auditory Cortex

Repeated stimulus causes a specific suppression of neuronal responses, which is so-called as Stimulus-Specific Adaptation (SSA). This effect can be recovered when the stimulus changes. In the auditory system SSA is a well-known phenomenon that appears at different levels of the mammalian auditory pathway. In this study, we explored the effects of adaptation to a particular stimulus on the auditory tuning curves of anesthetized rats. We used two sequences and compared the responses of each tone combination in these two conditions. First sequence consists of different pure tone combinations that were presented randomly. In the second one, the same stimuli of the first sequence were presented in the context of an adapted stimulus (adapter) that occupied 80% of sequence probability. The population results demonstrated that the adaptation factor decreased the frequency response area and made a change in the tuning curve to shift it unevenly toward the higher thresholds of tones. The local field potentials and multi-unit activity responses have indicated that the neural activities strength of the adapted frequency has been suppressed as well as with lower suppression in neighboring frequencies. This aforementioned reduction changed the characteristic frequency of the tuning curve.     

Cerebellum,temporal predictability and the updating of a mental model

We live in a dynamic and changing environment, which necessitates that we adapt to and efficiently respond to changes of stimulus form (‘what’) and stimulus occurrence (‘when’). Consequently, behaviour is optimal when we can anticipate both the ‘what’ and ‘when’ dimensions of a stimulus. For example, to perceive a temporally expected stimulus, a listener needs to establish a fairly precise internal representation of its external temporal structure, a function ascribed to classical sensorimotor areas such as the cerebellum. Here we investigated how patients with cerebellar lesions and healthy matched controls exploit temporal regularity during auditory deviance processing. We expected modulations of the N2b and P3b components of the event-related potential in response to deviant tones, and also a stronger P3b response when deviant tones are embedded in temporally regular compared to irregular tone sequences. We further tested to what degree structural damage to the cerebellar temporal processing system affects the N2b and P3b responses associated with voluntary attention to change detection and the predictive adaptation of a mental model of the environment, respectively. Results revealed that healthy controls and cerebellar patients display an increased N2b response to deviant tones independent of temporal context. However, while healthy controls showed the expected enhanced P3b response to deviant tones in temporally regular sequences, the P3b response in cerebellar patients was significantly smaller in these sequences. The current data provide evidence that structural damage to the cerebellum affects the predictive adaptation to the temporal structure of events and the updating of a mental model of the environment under voluntary attention.     

Auditory event-related potentials to deviant stimuli during drowsiness and stage 2 sleep

Twelve subjects were tested using a 3-tone auditory oddball paradigm consisting of a standard 1000 Hz tone (P = 80%) and two deviants, namely, a 1200 Hz tone and a 2000 Hz tone (both P = 10%). Testing took place in 3 conditions: (1) attend, in which the subject had to count one of the deviant tones; (2) ignore, in which the subject read a book; and (3) sleep, in which the subject was encouraged to go to sleep during presentation of the tones.In the awake conditions stimulus deviance elicited mismatch negativity (MMN) and P3. During drowsiness, no separate mismatch negativity (MMN) could be detected, but the 2000 Hz tone evoked a broad fronto-central early negative deflection, suggesting an overlap of N₁ and MMN. In the same condition, P210, N330 and P430 appeared, all being sensitive to magnitude of deviance. During stage 2, the P210, N330 and P430 amplitudes increased, most notably to the large deviant.These data indicate that differential processing of auditory inputs is maintained during drowsiness and stage 2 sleep, but do not support the notion that MMN or P3 activity comparable to the waking state occurs to oddball stimuli during this stage. It is hypothesised that during light sleep, scanning of the environment is performed by a different system than in the awake state and that during drowsiness a gradual switch between these two systems takes place.     

Memory-based mismatch response to frequency changes in rats

Any occasional changes in the acoustic environment are of potential importance for survival. In humans, the preattentive detection of such changes generates the mismatch negativity (MMN) component of event-related brain potentials. MMN is elicited to rare changes ('deviants') in a series of otherwise regularly repeating stimuli ('standards'). Deviant stimuli are detected on the basis of a neural comparison process between the input from the current stimulus and the sensory memory trace of the standard stimuli. It is, however, unclear to what extent animals show a similar comparison process in response to auditory changes. To resolve this issue, epidural potentials were recorded above the primary auditory cortex of urethane-anesthetized rats. In an oddball condition, tone frequency was used to differentiate deviants interspersed randomly among a standard tone. Mismatch responses were observed at 60-100 ms after stimulus onset for frequency increases of 5% and 12.5% but not for similarly descending deviants. The response diminished when the silent inter-stimulus interval was increased from 375 ms to 600 ms for +5% deviants and from 600 ms to 1000 ms for +12.5% deviants. In comparison to the oddball condition the response also diminished in a control condition in which no repetitive standards were presented (equiprobable condition). These findings suggest that the rat mismatch response is similar to the human MMN and indicate that anesthetized rats provide a valuable model for studies of central auditory processing.     

Fast detection of unexpected sound intensity decrements as revealed by human evoked potentials

The detection of deviant sounds is a crucial function of the auditory system and is reflected by the automatically elicited mismatch negativity (MMN), an auditory evoked potential at 100 to 250 ms from stimulus onset. It has recently been shown that rarely occurring frequency and location deviants in an oddball paradigm trigger a more negative response than standard sounds at very early latencies in the middle latency response of the human auditory evoked potential. This fast and early ability of the auditory system is corroborated by the finding of neurons in the animal auditory cortex and subcortical structures, which restore their adapted responsiveness to standard sounds, when a rare change in a sound feature occurs. In this study, we investigated whether the detection of intensity deviants is also reflected at shorter latencies than those of the MMN. Auditory evoked potentials in response to click sounds were analyzed regarding the auditory brain stem response, the middle latency response (MLR) and the MMN. Rare stimuli with a lower intensity level than standard stimuli elicited (in addition to an MMN) a more negative potential in the MLR at the transition from the Na to the Pa component at circa 24 ms from stimulus onset. This finding, together with the studies about frequency and location changes, suggests that the early automatic detection of deviant sounds in an oddball paradigm is a general property of the auditory system.     

Frequency Change Detection in Human Auditory Cortex

We offer a model of how human cortex detects changes in the auditory environment. Auditory change detection has recently been the object of intense investigation via the mismatch negativity (MMN). MMN is a preattentive response to sudden changes in stimulation, measured noninvasively in the electroencephalogram (EEG) and the magnetoencephalogram (MEG). It is elicited in the oddball paradigm, where infrequent deviant tones intersperse a series of repetitive standard tones. However, little apart from the participation of tonotopically organized auditory cortex is known about the neural mechanisms underlying change detection and the MMN. In the present study, we investigate how poststimulus inhibition might account for MMN and compare the effects of adaptation with those of lateral inhibition in a model describing tonotopically organized cortex. To test the predictions of our model, we performed MEG and EEG measurements on human subjects and used both small- (<1/3 octave) and large- (>5 octaves) frequency differences between the standard and deviant tones. The experimental results bear out the prediction that MMN is due to both adaptation and lateral inhibition. Finally, we suggest that MMN might serve as a probe of what stimulus features are mapped by human auditory cortex.     

The mismatch negativity for duration decrement of auditory stimuli in healthy subjects

The amplitude and latency of the mismatch negativity (MMN) elicited by occasional shorter-duration tones (25 and 50 ms) in a sequence of 75 ms standard tones were studied in 40 healthy subjects (9–84 years). The replicability and age dependence of the MMN-responses were determined. The 25 ms deviant tone evoked a clear response in 39 of the subjects, while the 50 ms deviant tone evoked an observable MMN only in 32 of the subjects. The MMN peak amplitude for the 25 ms deviants was significantly larger than for the 50 ms deviants. There was no significant difference in the peak latencies (measured from stimulus offset). For the 25 ms deviant, the amplitude diminished with increasing age. The MMN curves for the 25 ms deviant, measured on separate days in 14 subjects, looked very replicable. As a result of noise and filtering effect, the product-moment correlations were poor. The results indicate that the signal-to-noise ratio for the MMN to 25 ms deviants, obtained even in a 25 min recording session, is large enough for clinical use and individual diagnostics when undetectable (or very low amplitude) MMN is used as a sign of pathology. However, judged from the low correlation coefficients, despite the good replicability in visual evaluation, better methods for MMN quantification have to be used for clinical follow-up.     

Neural adaptation to tone sequences in the songbird forebrain: patterns, determinants, and relation to the build-up of auditory streaming

Neural responses to tones in the mammalian primary auditory cortex (A1) exhibit adaptation over the course of several seconds. Important questions remain about the taxonomic distribution of multi-second adaptation and its possible roles in hearing. It has been hypothesized that neural adaptation could explain the gradual “build-up” of auditory stream segregation. We investigated the influence of several stimulus-related factors on neural adaptation in the avian homologue of mammalian A1 (field L2) in starlings (Sturnus vulgaris). We presented awake birds with sequences of repeated triplets of two interleaved tones (ABA–ABA–…) in which we varied the frequency separation between the A and B tones (ΔF), the stimulus onset asynchrony (time from tone onset to onset within a triplet), and tone duration. We found that stimulus onset asynchrony generally had larger effects on adaptation compared with ΔF and tone duration over the parameter range tested. Using a simple model, we show how time-dependent changes in neural responses can be transformed into neurometric functions that make testable predictions about the dependence of the build-up of stream segregation on various spectral and temporal stimulus properties.     

Processing of complex auditory patterns in musicians and nonmusicians

In the present study we investigated the capacity of the memory store underlying the mismatch negativity (MMN) response in musicians and nonmusicians for complex tone patterns. While previous studies have focused either on the kind of information that can be encoded or on the decay of the memory trace over time, we studied capacity in terms of the length of tone sequences, i.e., the number of individual tones that can be fully encoded and maintained. By means of magnetoencephalography (MEG) we recorded MMN responses to deviant tones that could occur at any position of standard tone patterns composed of four, six or eight tones during passive, distracted listening. Whereas there was a reliable MMN response to deviant tones in the four-tone pattern in both musicians and nonmusicians, only some individuals showed MMN responses to the longer patterns. This finding of a reliable capacity of the short-term auditory store underlying the MMN response is in line with estimates of a three to five item capacity of the short-term memory trace from behavioural studies, although pitch and contour complexity covaried with sequence length, which might have led to an understatement of the reported capacity. Whereas there was a tendency for an enhancement of the pattern MMN in musicians compared to nonmusicians, a strong advantage for musicians could be shown in an accompanying behavioural task of detecting the deviants while attending to the stimuli for all pattern lengths, indicating that long-term musical training differentially affects the memory capacity of auditory short-term memory for complex tone patterns with and without attention. Also, a left-hemispheric lateralization of MMN responses in the six-tone pattern suggests that additional networks that help structuring the patterns in the temporal domain might be recruited for demanding auditory processing in the pitch domain.     

Mismatch Responses in the Awake Rat: Evidence from Epidural Recordings of Auditory Cortical Fields

Detecting sudden environmental changes is crucial for the survival of humans and animals. In the human auditory system the mismatch negativity (MMN), a component of auditory evoked potentials (AEPs), reflects the violation of predictable stimulus regularities, established by the previous auditory sequence. Given the considerable potentiality of the MMN for clinical applications, establishing valid animal models that allow for detailed investigation of its neurophysiological mechanisms is important. Rodent studies, so far almost exclusively under anesthesia, have not provided decisive evidence whether an MMN analogue exists in rats. This may be due to several factors, including the effect of anesthesia. We therefore used epidural recordings in awake black hooded rats, from two auditory cortical areas in both hemispheres, and with bandpass filtered noise stimuli that were optimized in frequency and duration for eliciting MMN in rats. Using a classical oddball paradigm with frequency deviants, we detected mismatch responses at all four electrodes in primary and secondary auditory cortex, with morphological and functional properties similar to those known in humans, i.e., large amplitude biphasic differences that increased in amplitude with decreasing deviant probability. These mismatch responses significantly diminished in a control condition that removed the predictive context while controlling for presentation rate of the deviants. While our present study does not allow for disambiguating precisely the relative contribution of adaptation and prediction error processing to the observed mismatch responses, it demonstrates that MMN-like potentials can be obtained in awake and unrestrained rats.     

What We Expect Is Not Always What We Get: Evidence for Both the Direction-of-Change and the Specific-Stimulus Hypotheses of Auditory Attentional Capture

Participants were requested to respond to a sequence of visual targets while listening to a well-known lullaby. One of the notes in the lullaby was occasionally exchanged with a pattern deviant. Experiment 1 found that deviants capture attention as a function of the pitch difference between the deviant and the replaced/expected tone. However, when the pitch difference between the expected tone and the deviant tone is held constant, a violation to the direction-of-pitch change across tones can also capture attention (Experiment 2). Moreover, in more complex auditory environments, wherein it is difficult to build a coherent neural model of the sound environment from which expectations are formed, deviations can capture attention but it appears to matter less whether this is a violation from a specific stimulus or a violation of the current direction-of-change (Experiment 3). The results support the expectation violation account of auditory distraction and suggest that there are at least two different expectations that can be violated: One appears to be bound to a specific stimulus and the other would seem to be bound to a more global cross-stimulus rule such as the direction-of-change based on a sequence of preceding sound events. Factors like base-rate probability of tones within the sound environment might become the driving mechanism of attentional capture—rather than violated expectations—in complex sound environments.     

Topographic Distribution of Stimulus-Specific Adaptation across Auditory Cortical Fields in the Anesthetized Rat

Stimulus-specific adaptation (SSA) in single neurons of the auditory cortex was suggested to be a potential neural correlate of the mismatch negativity (MMN), a widely studied component of the auditory event-related potentials (ERP) that is elicited by changes in the auditory environment. However, several aspects on this SSA/MMN relation remain unresolved. SSA occurs in the primary auditory cortex (A1), but detailed studies on SSA beyond A1 are lacking. To study the topographic organization of SSA, we mapped the whole rat auditory cortex with multiunit activity recordings, using an oddball paradigm. We demonstrate that SSA occurs outside A1 and differs between primary and nonprimary cortical fields. In particular, SSA is much stronger and develops faster in the nonprimary than in the primary fields, paralleling the organization of subcortical SSA. Importantly, strong SSA is present in the nonprimary auditory cortex within the latency range of the MMN in the rat and correlates with an MMN-like difference wave in the simultaneously recorded local field potentials (LFP). We present new and strong evidence linking SSA at the cellular level to the MMN, a central tool in cognitive and clinical neuroscience.     

Mismatch field to tone pairs: neuromagnetic evidence for temporal integration at the sensory level

The mismatch field (MMF) to minor pitch changes in two experimental conditions was studied. Standard tones of 1000 Hz and deviant tones of 1050 Hz both of 50 ms duration were delivered in single tone condition. Paired tones of the same duration were used in the paired tone condition. The standard tone pair consisted of two 1000 Hz tones, whereas the deviant tone pair was composed of a 1000 Hz tone in the first position and a 1050 Hz tone in the second position with a silent interval of 15 ms between the two. Standards of 90% and deviants of 10% probability were presented in random order and with a randomized interstimulus interval between 600 and 900 ms. The source analysis showed a more lateral location for the MMF obtained in the paired tone condition (MMF.P) compared to the MMF elicited by the single deviants (MMF.S). The source location of both the MMF.P and MMF.S turned out to be significantly anterior relative to the sources of the M100. The increased stimulus repetition in the paired tone condition (two times more stimuli than in the single tone condition) lead to a strong suppression of the field amplitude and of the dipole moment of the M100, while this effect could not be seen for the MMF. The data demonstrate a fundamental difference between the processes reflected by the M100 and the MMF: while the M100 represents the processing of every individual tone, the MMF reflects the change detection of the paired stimuli as unitary events, forming a perceptual group. The different sources of the MMF.P and MMF.S also support an integrated processing of the paired stimuli.     

Investigating the Neural Correlates of a Streaming Percept in an Informational-Masking Paradigm

Humans routinely segregate a complex acoustic scene into different auditory streams, through the extraction of bottom-up perceptual cues and the use of top-down selective attention. To determine the neural mechanisms underlying this process, neural responses obtained through magnetoencephalography (MEG) were correlated with behavioral performance in the context of an informational masking paradigm. In half the trials, subjects were asked to detect frequency deviants in a target stream, consisting of a rhythmic tone sequence, embedded in a separate masker stream composed of a random cloud of tones. In the other half of the trials, subjects were exposed to identical stimuli but asked to perform a different task—to detect tone-length changes in the random cloud of tones. In order to verify that the normalized neural response to the target sequence served as an indicator of streaming, we correlated neural responses with behavioral performance under a variety of stimulus parameters (target tone rate, target tone frequency, and the “protection zone”, that is, the spectral area with no tones around the target frequency) and attentional states (changing task objective while maintaining the same stimuli). In all conditions that facilitated target/masker streaming behaviorally, MEG normalized neural responses also changed in a manner consistent with the behavior. Thus, attending to the target stream caused a significant increase in power and phase coherence of the responses in recording channels correlated with an increase in the behavioral performance of the listeners. Normalized neural target responses also increased as the protection zone widened and as the frequency of the target tones increased. Finally, when the target sequence rate increased, the buildup of the normalized neural responses was significantly faster, mirroring the accelerated buildup of the streaming percepts. Our data thus support close links between the perceptual and neural consequences of the auditory stream segregation.     

Mismatch Negativity Latency and Cognitive Function in Schizophrenia

Background

The Mismatch Negativity (MMN) is an event-related potential (ERP) sensitive to early auditory deviance detection and has been shown to be reduced in schizophrenia patients. Moreover, MMN amplitude reduction to duration deviant tones was found to be related to functional outcomes particularly, to neuropsychological (working memory and verbal domains) and psychosocial measures. While MMN amplitude is thought to be correlated with deficits of early sensory processing, the functional significance of MMN latency remains unclear so far. The present study focused on the investigation of MMN in relation to neuropsychological function in schizophrenia.

Method

Forty schizophrenia patients and 16 healthy controls underwent a passive oddball paradigm (2400 binaural tones; 88% standards [1 kHz, 80 db, 80 ms], 11% frequency deviants [1.2 kHz], 11% duration deviants [40 ms]) and a neuropsychological test-battery. Patients were assessed with regard to clinical symptoms.

Results

Compared to healthy controls schizophrenia patients showed diminished MMN amplitude and shorter MMN latency to both deviants as well as an impaired neuropsychological test performance. Severity of positive symptoms was related to decreased MMN amplitude to duration deviants. Furthermore, enhanced verbal memory performance was associated with prolonged MMN latency to frequency deviants in patients.

Conclusion

The present study corroborates previous results of a diminished MMN amplitude and its association with positive symptoms in schizophrenia patients. Both, the findings of a shorter latency to duration and frequency deviants and the relationship of the latter with verbal memory in patients, emphasize the relevance of the temporal aspect of early auditory discrimination processing in schizophrenia.