Context effects on the neural correlates of recognition memory: an electrophysiological study

Event-related potentials (ERPs) were recorded during a recognition memory test for previously studied visual objects. Some studied objects were paired with the same context (landscape scenes) as at study, some were superimposed on a different studied context, and some were paired with new contexts. Unstudied objects were paired with either a studied or a new context. Three ERP memory effects were observed: an early effect elicited by all stimuli containing at least one studied component; a second effect elicited only by stimuli in which both object and context had been studied; and a third effect elicited by stimuli containing a studied object. Thus, test stimuli engaged three distinct kinds of memory-related neural activity which differed in their specificity for task-relevant features.     

Correlations of Electrophysiological Measurements with Identification Levels of Ancient Chinese Characters

Studies of event-related potential (ERP) in the human brain have shown that the N170 component can reliably distinguish among different object categories. However, it is unclear whether this is true for different identifiable levels within a single category. In the present study, we used ERP recording to examine the neural response to different identification levels and orientations (upright vs. inverted) of Chinese characters. The results showed that P1, N170, and P250 were modulated by different identification levels of Chinese characters. Moreover, time frequency analysis showed similar results, indicating that identification levels were associated with object recognition, particularly during processing of a single categorical stimulus.     

Implicit Binding of Facial Features During Change Blindness

Change blindness refers to the inability to detect visual changes if introduced together with an eye-movement, blink, flash of light, or with distracting stimuli. Evidence of implicit detection of changed visual features during change blindness has been reported in a number of studies using both behavioral and neurophysiological measurements. However, it is not known whether implicit detection occurs only at the level of single features or whether complex organizations of features can be implicitly detected as well. We tested this in adult humans using intact and scrambled versions of schematic faces as stimuli in a change blindness paradigm while recording event-related potentials (ERPs). An enlargement of the face-sensitive N170 ERP component was observed at the right temporal electrode site to changes from scrambled to intact faces, even if the participants were not consciously able to report such changes (change blindness). Similarly, the disintegration of an intact face to scrambled features resulted in attenuated N170 responses during change blindness. Other ERP deflections were modulated by changes, but unlike the N170 component, they were indifferent to the direction of the change. The bidirectional modulation of the N170 component during change blindness suggests that implicit change detection can also occur at the level of complex features in the case of facial stimuli.     

Visual exploration and object recognition by lattice deformation

Mechanisms of explicit object recognition are often difficult to investigate and require stimuli with controlled features whose expression can be manipulated in a precise quantitative fashion. Here, we developed a novel method (called "Dots"), for generating visual stimuli, which is based on the progressive deformation of a regular lattice of dots, driven by local contour information from images of objects. By applying progressively larger deformation to the lattice, the latter conveys progressively more information about the target object. Stimuli generated with the presented method enable a precise control of object-related information content while preserving low-level image statistics, globally, and affecting them only little, locally. We show that such stimuli are useful for investigating object recognition under a naturalistic setting--free visual exploration--enabling a clear dissociation between object detection and explicit recognition. Using the introduced stimuli, we show that top-down modulation induced by previous exposure to target objects can greatly influence perceptual decisions, lowering perceptual thresholds not only for object recognition but also for object detection (visual hysteresis). Visual hysteresis is target-specific, its expression and magnitude depending on the identity of individual objects. Relying on the particular features of dot stimuli and on eye-tracking measurements, we further demonstrate that top-down processes guide visual exploration, controlling how visual information is integrated by successive fixations. Prior knowledge about objects can guide saccades/fixations to sample locations that are supposed to be highly informative, even when the actual information is missing from those locations in the stimulus. The duration of individual fixations is modulated by the novelty and difficulty of the stimulus, likely reflecting cognitive demand.     

Functional brain organization of global and local visual perception: an ERP study

Adult subjects were asked to recognize a hierarchical visual stimulus (a letter) while their attention was drawn to either the global or local level of the stimulus. Event-related potentials (ERP) and psychophysical indices (reaction time and percentage of correct responses) were measured. An analysis of psychophysical indices showed the global level precedence effect, i.e., the increase in a small letter recognition time when this letter is a part of incongruent stimulus. An analysis of ERP components showed level-related (global vs. local) differences in the timing and topography of the brain organization of perceptual processing and regulatory mechanisms of attention. Visual recognition at the local level was accompanied by (1) stronger activation of the visual associative areas (Pz and T6) at the stage of sensory features analysis (P1 ERP component), (2) involvement mainly of inferior temporal cortices of the right hemisphere (T6) at the stage of sensory categorization (P2 ERP component), and (3) involvement of prefrontal cortex of the right hemisphere at the stage of the selection of the relevant features of the target (N2 ERP component). Visual recognition at the global level was accompanied by (1) pronounced involvement of mechanisms of early sensory selection (N1 ERP component), (2) prevailing activation of parietal cortex of the right hemisphere (P4) at the stage of sensory categorization (P2 ERP component) as well as at the stage of the target stimulus identification (P3 ERP component). It is suggested that perception at the global level of the hierarchical stimulus is related primarily to the analysis of the spatial features of the stimulus in the dorsal visual system whereas the perception at the local level primarily involves an analysis of the object-related features in the ventral visual system.     

The N170 component is sensitive to face-like stimuli: a study of Chinese Peking opera makeup

The N170 component is considered a neural marker of face-sensitive processing. In the present study, the face-sensitive N170 component of event-related potentials (ERPs) was investigated with a modified oddball paradigm using a natural face (the standard stimulus), human- and animal-like makeup stimuli, scrambled control images that mixed human- and animal-like makeup pieces, and a grey control image. Nineteen participants were instructed to respond within 1000 ms by pressing the ‘F’ or ‘J’ key in response to the standard or deviant stimuli, respectively. We simultaneously recorded ERPs, response accuracy, and reaction times. The behavioral results showed that the main effect of stimulus type was significant for reaction time, whereas there were no significant differences in response accuracies among stimulus types. In relation to the ERPs, N170 amplitudes elicited by human-like makeup stimuli, animal-like makeup stimuli, scrambled control images, and a grey control image progressively decreased. A right hemisphere advantage was observed in the N170 amplitudes for human-like makeup stimuli, animal-like makeup stimuli, and scrambled control images but not for grey control image. These results indicate that the N170 component is sensitive to face-like stimuli and reflect configural processing in face recognition.     

Interstimulus interval and auditory event-related potentials in children: evidence for multiple generators

In the present study, the component structure of auditory event-related potentials (ERP) was studied in children of 7–9 years old by presenting stimuli with different interstimulus intervals (ISI). A short-term auditory sensory memory, as reflected by ISI effects on ERPs, was also studied. Auditory ERPs were recorded to brief unattended 1000 Hz frequent, `standard' and 1100 Hz rare, `deviant' (probability 0.1) tone stimuli with ISIs of 350, 700 and 1400 ms (in separate blocks). With the 350 ms-ISI, the ERP waveform to the standard stimulus consisted of P100-N250 peaks. With the two longer ISIs, in addition, the frontocentral N160 and N460 peaks were observed. Results suggested that N160, found with the longer ISIs, is a correlate of the adult auditory N1. In difference waves, obtained by subtracting ERP to standard stimuli from ERP to deviant stimuli, two negativities were revealed. The first was the mismatch negativity (MMN), which is elicited by any discriminable change in repetitive auditory input. The MMN data suggested that neural traces of auditory sensory memory lasted for at least 1400 ms, probably considerably longer, as no MMN attenuation was found across the ISIs used. The second, later negativity was similar to MMN in all aspects, except for the scalp distribution, which was posterior to that of the MMN.     

视觉空间注意事件相关电位的协同学分析

在用事件相关电位(event-related potentials,ERP)研究视觉空间注意问题时,直接观察ERP数据就可得出,空间注意的主要作用是对视觉信息处理的调制,它出现在刺激开始后大约80～250ms,主要表现为枕叶的P1、N1和P2波有明显的增强但它们的潜伏期没有变化。采用基于协同学的时空模式分解方法,把视觉空间注意ERP分解为3个模式成分。结果表明,注意不仅使模式1的第一个正波成分(P11)、第一个负波成分(N11)以及第二个正波成分(P12)增强,还使模式3的第一个正波成分(P31)的潜伏期缩短。用探照灯模型对这些现象作了初步解释,说明该方法是研究注意ERP的一种有潜力的新方法。     

Event-related potentials to conjunctions of spatial frequency and orientation as a function of stimulus parameters and response requirements

ERPs were recorded from subjects who were required to push a button in response to a given conjunction of spatial frequency and orientation (target), and to ignore conjunctions sharing with the target only frequency (frequency-relevant), only orientation (orientation-relevant), or neither (irrelevant). Differences between ERPs to irrelevant and frequency-relevant stimuli were identified as frontal selection positivity (Fz, 150–200 msec post-stimulus), selection negativity (Oz, just after 200 msec), and vertex N2b (200–250 msec). For relevant orientations, the selection negativity and the N2b were also found, but the frontal selection positivity was elicited only when the spatial frequency was relevant as well. Neither of these 3 waves was sensitive to spatial frequency or orientation per se. Other waves (N80, N180) did show such sensitivity, but this was independent of stimulus relevance. Hence, direct evidence for the neural-specificity theory, stating that task-related selective ERP responses reflect differential enhancement of activity in stimulus-specific pathways, was not obtained. It is further concluded that ERPs associated with selection of frequency and orientation are highly comparable to those associated with other visual dimensions (e.g., color), and that selection of multiple visual dimensions may be hierarchical at one level of processing and independent at another.     

Brain mechanism of selective listening reflected by event-related potentials

Stimulus selection during selective listening on the basis of simple physical stimulus features is reflected by an event-related potential (ERP) component called the processing negativity (PN). PN has been proposed to indicate a matching or comparison process between the physical features of the stimulus and an ‘attentional trace’, an actively formed and maintained temporary neuronal representation of the features defining the relevant stimuli. According to this theory, the smaller is the difference between the eliciting stimulus and that represented by the attentional trace, the longer time is the stimulus processed, and thus the larger in amplitude and longer in duration is the PN elicited. The relevant stimuli, perfectly matching with the attentional trace, and therefore eliciting the largest and longest-duration PN, are selected for further processing. In the present study, the relevant and irrelevant stimuli differed in pitch, and the magnitude of this pitch separation was varied between different stimulus blocks. The results support the afore-mentioned matching or comparison hypothesis of selective attention by showing that PN is not elicited only by the relevant stimuli but even by irrelevant stimuli, and further that the latter PN is larger in amplitude and longer in duration the more similar the irrelevant stimuli are to the relevant stimuli. This PN, however, was smaller than that to the relevant stimuli even for very small separations, reflecting high accuracy of the discrimination function of the attentional trace mechanism proposed to underly selective listening. The termination of the PN to the irrelevant stimuli was followed by a positivity which thus partly explained the difference (Nd) between the ERPs to the relevant and irrelevant stimuli.     

Functionally independent components of early event-related potentials in a visual spatial attention task.

Spatial visual attention modulates the first negative-going deflection in the human averaged event-related potential (ERP) in response to visual target and non-target stimuli (the N1 complex). Here we demonstrate a decomposition of N1 into functionally independent subcomponents with functionally distinct relations to task and stimulus conditions. ERPs were collected from 20 subjects in response to visual target and non-target stimuli presented at five attended and non-attended screen locations. Independent component analysis, a new method for blind source separation, was trained simultaneously on 500 ms grand average responses from all 25 stimulus-attention conditions and decomposed the non-target N1 complexes into five spatially fixed, temporally independent and physiologically plausible components. Activity of an early, laterally symmetrical component pair (N1aR and N1aL) was evoked by the left and right visual field stimuli, respectively. Component N1aR peaked ca. 9 ms earlier than N1aL. Central stimuli evoked both components with the same peak latency difference, producing a bilateral scalp distribution. The amplitudes of these components were no reliably augmented by spatial attention. Stimuli in the right visual field evoked activity in a spatio-temporally overlapping bilateral component (N1b) that peaked at ca. 180 ms and was strongly enhanced by attention. Stimuli presented at unattended locations evoked a fourth component (P2a) peaking near 240 ms. A fifth component (P3f) was evoked only by targets presented in either visual field. The distinct response patterns of these components across the array of stimulus and attention conditions suggest that they reflect activity in functionally independent brain systems involved in processing attended and unattended visuospatial events.     

How the Visual Cortex Handles Stimulus Noise: Insights from Amblyopia

Adding noise to a visual image makes object recognition more effortful and has a widespread effect on human electrophysiological responses. However, visual cortical processes directly involved in handling the stimulus noise have yet to be identified and dissociated from the modulation of the neural responses due to the deteriorated structural information and increased stimulus uncertainty in the case of noisy images. Here we show that the impairment of face gender categorization performance in the case of noisy images in amblyopic patients correlates with amblyopic deficits measured in the noise-induced modulation of the P1/P2 components of single-trial event-related potentials (ERP). On the other hand, the N170 ERP component is similarly affected by the presence of noise in the two eyes and its modulation does not predict the behavioral deficit. These results have revealed that the efficient processing of noisy images depends on the engagement of additional processing resources both at the early, feature-specific as well as later, object-level stages of visual cortical processing reflected in the P1 and P2 ERP components, respectively. Our findings also suggest that noise-induced modulation of the N170 component might reflect diminished face-selective neuronal responses to face images with deteriorated structural information.     

Erratum to: Functional Brain Organization of Global and Local Visual Perception: An Event-Related Potentials Study

Adult subjects were asked to recognize a hierarchical visual stimulus (a letter) while their attention was drawn to either the global or local level of the stimulus. Event-related potentials (ERP) and behavioral indices (reaction time and percentage of correct responses) were measured. An analysis of behavioral indices showed the global level precedence effect, i.e. the increase in a small letter recognition time when this letter is a part of incongruent stimulus. An analysis of ERP components showed level-related (global vs. local) differences in the timing and topography of the brain organization of perceptual processing and regulatory mechanisms of attention. Visual recognition at the local level was accompanied by (1) stronger activation of the visual associative areas (P _z and T ₆) at the stage of sensory features analysis (P1 ERP component), (2) involvement mainly of inferior temporal cortices of the right hemisphere (T ₆) at the stage of sensory categorization (P2 ERP component), and (3) involvement of prefrontal cortex of the right hemisphere at the stage of selection of the relevant features of the target (N2 ERP component). Visual recognition at the global level was accompanied by (1) pronounced involvement of mechanisms of early sensory selection (N1 ERP component), (2) prevailing activation of parietal cortex of the right hemisphere (P ₄) at the stage of sensory categorization (P2 ERP component) as well as at the stage of the target stimulus identification (P3 ERP component). We suggested that perception of the hierarchical stimulus at the global level is related primarily to the analysis of its spatial features in the dorsal visual system whereas the perception at the local level primarily involves an analysis of the object-related features in the ventral visual system.     

Classifying four-category visual objects using multiple ERP components in single-trial ERP

Object categorization using single-trial electroencephalography (EEG) data measured while participants view images has been studied intensively. In previous studies, multiple event-related potential (ERP) components (e.g., P1, N1, P2, and P3) were used to improve the performance of object categorization of visual stimuli. In this study, we introduce a novel method that uses multiple-kernel support vector machine to fuse multiple ERP component features. We investigate whether fusing the potential complementary information of different ERP components (e.g., P1, N1, P2a, and P2b) can improve the performance of four-category visual object classification in single-trial EEGs. We also compare the classification accuracy of different ERP component fusion methods. Our experimental results indicate that the classification accuracy increases through multiple ERP fusion. Additional comparative analyses indicate that the multiple-kernel fusion method can achieve a mean classification accuracy higher than 72 %, which is substantially better than that achieved with any single ERP component feature (55.07 % for the best single ERP component, N1). We compare the classification results with those of other fusion methods and determine that the accuracy of the multiple-kernel fusion method is 5.47, 4.06, and 16.90 % higher than those of feature concatenation, feature extraction, and decision fusion, respectively. Our study shows that our multiple-kernel fusion method outperforms other fusion methods and thus provides a means to improve the classification performance of single-trial ERPs in brain–computer interface research.     

Modulation of semantic processing by spatial selective attention

The effects of spatial selective attention upon ERPs associated with the processing of word stimuli were investigated. While subjects maintained central eye fixation, ERPs were recorded to words presented to the left and right visual fields. In each of 6 runs, subjects focussed attention to alternate fields to perform a category-detection task. Pairs of semantically related and repeated words were embedded in the word lists presented to the attended and unattended visual fields. Consistent with prior studies, the P1-N1 visual ERP was larger when elicited by words in attended spatial locations. A large negative slow wave identified as N400 was elicited by attended, but not unattended, words. For attended words, N400 was smaller for semantically primed or repeated words. We concluded that spatial selective attention can modulate the degree to which words are processed, and that the cognitive processes associated with N400 are not automatic.     

Unconscious context control of visual perception of simple stimuli: A study using evoked potentials

The effect of nonsemantic context on the perception of simple nonverbal visual stimuli has been studied in ten healthy volunteers by the event-related potential (ERP) method. The nonsemantic context was specified by the formation of a memory trace of a test visual stimulus via its repeated presentation without any instruction except gaze fixation. Then, this stimulus randomly alternated with control stimuli that did not form memory traces before their presentation. It has been found that an ERP in the interval 260–340 ms after presentation of a simple nonverbal stimulus significantly differs from the control ERPs. The results suggest that some stages of the processing of visual stimuli may be modified by nonsemantic context.     

Effects of Sound Frequency on Audiovisual Integration: An Event-Related Potential Study

A combination of signals across modalities can facilitate sensory perception. The audiovisual facilitative effect strongly depends on the features of the stimulus. Here, we investigated how sound frequency, which is one of basic features of an auditory signal, modulates audiovisual integration. In this study, the task of the participant was to respond to a visual target stimulus by pressing a key while ignoring auditory stimuli, comprising of tones of different frequencies (0.5, 1, 2.5 and 5 kHz). A significant facilitation of reaction times was obtained following audiovisual stimulation, irrespective of whether the task-irrelevant sounds were low or high frequency. Using event-related potential (ERP), audiovisual integration was found over the occipital area for 0.5 kHz auditory stimuli from 190–210 ms, for 1 kHz stimuli from 170–200 ms, for 2.5 kHz stimuli from 140–200 ms, 5 kHz stimuli from 100–200 ms. These findings suggest that a higher frequency sound signal paired with visual stimuli might be early processed or integrated despite the auditory stimuli being task-irrelevant information. Furthermore, audiovisual integration in late latency (300–340 ms) ERPs with fronto-central topography was found for auditory stimuli of lower frequencies (0.5, 1 and 2.5 kHz). Our results confirmed that audiovisual integration is affected by the frequency of an auditory stimulus. Taken together, the neurophysiological results provide unique insight into how the brain processes a multisensory visual signal and auditory stimuli of different frequencies.     

Mismatch negativity (MMN) for sequences of auditory and visual stimuli: evidence for a mechanism specific to the auditory modality

ERPs to sequences of standard and deviant sinusoidal 100 msec tone pips, high-contrast sinusoidal gratings and to their simultaneously presented combinations were recorded. Mismatch negativity (MMN), an ERP component elicited by deviant stimuli, was estimated for the different stimulus sequences in order to find out whether it reflects modality-specific processes or non-specific attentive phenomena. In addition to the auditory modality, we studied whether the mismatch response could be evoked by a deviant visual stimulus in a visual sequence or by a deviant stimulus in either modality. The results show that only auditory stimuli produced the mismatch response, suggesting that MMN is not a manifestation of a general attentional mechanism but is probably specific to the auditory modality.     

Visual cognitive dysfunction in depression: an event-related potential study

The P3(00) event-related potentials (ERPs) elicited by visual stimuli in two visual tasks were assessed in depressed patients (12 patients with major depression and 11 patients with bipolar disorder) and compared with those of 20 age-matched normal controls. At remission, the ERPs from 18 of the depressed patients were again recorded. The visual oddball (VO) paradigm presented both target and standard visual stimuli and the simple visual (SV) paradigm presented a target but no standard visual stimulus. Subjects performed the VO task significantly less accurately than the SV task, as reflected by the behavioral measures (reaction-time and task accuracy). Depressed patients of the bipolar group showed longer P3 peak latency for the VO task and no change in P3 amplitude. No significant differences were found in any other ERP component between the groups. During remission, slowing RTs and reduced P3 peak latencies were observed for both major depression and bipolar disorder groups. Thus, the P3 ERP may be an index of the contribution of the slowed central processing to psychomotor retardation in clinically homogenous samples of depressive patients performing an appropriately demanding task.