Robust Single Trial Identification of Conscious Percepts Triggered by Sensory Events of Variable Saliency

The neural correlates of visual awareness are elusive because of its fleeting nature. Here we have addressed this issue by using single trial statistical “brain reading” of neurophysiological event related (ERP) signatures of conscious perception of visual attributes with different levels of saliency. Behavioral reports were taken at every trial in 4 experiments addressing conscious access to color, luminance, and local phase offset cues. We found that single trial neurophysiological signatures of target presence can be observed around 300 ms at central parietal sites. Such signatures are significantly related with conscious perception, and their probability is related to sensory saliency levels. These findings identify a general neural correlate of conscious perception at the single trial level, since conscious perception can be decoded as such independently of stimulus salience and fluctuations of threshold levels. This approach can be generalized to successfully detect target presence in other individuals.     

Reentrant Processing in Intuitive Perception

The process of perception requires not only the brain''s receipt of sensory data but also the meaningful organization of that data in relation to the perceptual experience held in memory. Although it typically results in a conscious percept, the process of perception is not fully conscious. Research on the neural substrates of human visual perception has suggested that regions of limbic cortex, including the medial orbital frontal cortex (mOFC), may contribute to intuitive judgments about perceptual events, such as guessing whether an object might be present in a briefly presented fragmented drawing. Examining dense array measures of cortical electrical activity during a modified Waterloo Gestalt Closure Task, results show, as expected, that activity in medial orbital frontal electrical responses (about 250 ms) was associated with intuitive judgments. Activity in the right temporal-parietal-occipital (TPO) region was found to predict mOFC (∼150 ms) activity and, in turn, was subsequently influenced by the mOFC at a later time (∼300 ms). The initial perception of gist or meaning of a visual stimulus in limbic networks may thus yield reentrant input to the visual areas to influence continued development of the percept. Before perception is completed, the initial representation of gist may support intuitive judgments about the ongoing perceptual process.     

The timing of the cognitive cycle

We propose that human cognition consists of cascading cycles of recurring brain events. Each cognitive cycle senses the current situation, interprets it with reference to ongoing goals, and then selects an internal or external action in response. While most aspects of the cognitive cycle are unconscious, each cycle also yields a momentary "ignition" of conscious broadcasting. Neuroscientists have independently proposed ideas similar to the cognitive cycle, the fundamental hypothesis of the LIDA model of cognition. High-level cognition, such as deliberation, planning, etc., is typically enabled by multiple cognitive cycles. In this paper we describe a timing model LIDA's cognitive cycle. Based on empirical and simulation data we propose that an initial phase of perception (stimulus recognition) occurs 80-100 ms from stimulus onset under optimal conditions. It is followed by a conscious episode (broadcast) 200-280 ms after stimulus onset, and an action selection phase 60-110 ms from the start of the conscious phase. One cognitive cycle would therefore take 260-390 ms. The LIDA timing model is consistent with brain evidence indicating a fundamental role for a theta-gamma wave, spreading forward from sensory cortices to rostral corticothalamic regions. This posteriofrontal theta-gamma wave may be experienced as a conscious perceptual event starting at 200-280 ms post stimulus. The action selection component of the cycle is proposed to involve frontal, striatal and cerebellar regions. Thus the cycle is inherently recurrent, as the anatomy of the thalamocortical system suggests. The LIDA model fits a large body of cognitive and neuroscientific evidence. Finally, we describe two LIDA-based software agents: the LIDA Reaction Time agent that simulates human performance in a simple reaction time task, and the LIDA Allport agent which models phenomenal simultaneity within timeframes comparable to human subjects. While there are many models of reaction time performance, these results fall naturally out of a biologically and computationally plausible cognitive architecture.     

Spatio-temporal brain mapping of motion-onset VEPs combined with fMRI and retinotopic maps

Neuroimaging studies have identified several motion-sensitive visual areas in the human brain, but the time course of their activation cannot be measured with these techniques. In the present study, we combined electrophysiological and neuroimaging methods (including retinotopic brain mapping) to determine the spatio-temporal profile of motion-onset visual evoked potentials for slow and fast motion stimuli and to localize its neural generators. We found that cortical activity initiates in the primary visual area (V1) for slow stimuli, peaking 100 ms after the onset of motion. Subsequently, activity in the mid-temporal motion-sensitive areas, MT+, peaked at 120 ms, followed by peaks in activity in the more dorsal area, V3A, at 160 ms and the lateral occipital complex at 180 ms. Approximately 250 ms after stimulus onset, activity fast motion stimuli was predominant in area V6 along the parieto-occipital sulcus. Finally, at 350 ms (100 ms after the motion offset) brain activity was visible again in area V1. For fast motion stimuli, the spatio-temporal brain pattern was similar, except that the first activity was detected at 70 ms in area MT+. Comparing functional magnetic resonance data for slow vs. fast motion, we found signs of slow-fast motion stimulus topography along the posterior brain in at least three cortical regions (MT+, V3A and LOR).     

Conscious awareness of flicker in humans involves frontal and parietal cortex

Even when confined to the same spatial location, flickering and steady light evoke very different conscious experiences because of their distinct temporal patterns. The neural basis of such differences in subjective experience remains uncertain . Here, we used functional MRI in humans to examine the neural structures involved in awareness of flicker. Participants viewed a single point source of light that flickered at the critical flicker fusion (CFF) threshold, where the same stimulus is sometimes perceived as flickering and sometimes as steady (fused) . We were thus able to compare brain activity for conscious percepts that differed qualitatively (flickering or fused) but were evoked by identical physical stimuli. Greater brain activation was observed on flicker (versus fused) trials in regions of frontal and parietal cortex previously associated with visual awareness in tasks that did not require detection of temporal patterns . In contrast, greater activation was observed on fused (versus flicker) trials in occipital extrastriate cortex. Our findings indicate that activity of higher-level cortical areas is important for awareness of temporally distinct visual events in the context of a nonspatial task, and they thus suggest that frontal and parietal regions may play a general role in visual awareness.     

Fronto-Central Theta Oscillations Are Related to Oscillations in Saccadic Response Times (SRT): An EEG and Behavioral Data Analysis

The phase reset hypothesis states that the phase of an ongoing neural oscillation, reflecting periodic fluctuations in neural activity between states of high and low excitability, can be shifted by the occurrence of a sensory stimulus so that the phase value become highly constant across trials (Schroeder et al., 2008). From EEG/MEG studies it has been hypothesized that coupled oscillatory activity in primary sensory cortices regulates multi sensory processing (Senkowski et al. 2008). We follow up on a study in which evidence of phase reset was found using a purely behavioral paradigm by including also EEG measures. In this paradigm, presentation of an auditory accessory stimulus was followed by a visual target with a stimulus-onset asynchrony (SOA) across a range from 0 to 404 ms in steps of 4 ms. This fine-grained stimulus presentation allowed us to do a spectral analysis on the mean SRT as a function of the SOA, which revealed distinct peak spectral components within a frequency range of 6 to 11 Hz with a modus of 7 Hz. The EEG analysis showed that the auditory stimulus caused a phase reset in 7-Hz brain oscillations in a widespread set of channels. Moreover, there was a significant difference in the average phase at which the visual target stimulus appeared between slow and fast SRT trials. This effect was evident in three different analyses, and occurred primarily in frontal and central electrodes.     

Rapid Amygdala Responses during Trace Fear Conditioning without Awareness

The role of consciousness in learning has been debated for nearly 50 years. Recent studies suggest that conscious awareness is needed to bridge the gap when learning about two events that are separated in time, as is true for trace fear conditioning. This has been repeatedly shown and seems to apply to other forms of classical conditioning as well. In contrast to these findings, we show that individuals can learn to associate a face with the later occurrence of a shock, even if they are unable to perceive the face. We used a novel application of magnetoencephalography (MEG) to non-invasively record neural activity from the amygdala, which is known to be important for fear learning. We demonstrate rapid (∼170–200 ms) amygdala responses during the stimulus free period between the face and the shock. These results suggest that unperceived faces can serve as signals for impending threat, and that rapid, automatic activation of the amygdala contributes to this process. In addition, we describe a methodology that can be applied in the future to study neural activity with MEG in other subcortical structures.     

Converging Intracranial Markers of Conscious Access

We compared conscious and nonconscious processing of briefly flashed words using a visual masking procedure while recording intracranial electroencephalogram (iEEG) in ten patients. Nonconscious processing of masked words was observed in multiple cortical areas, mostly within an early time window (<300 ms), accompanied by induced gamma-band activity, but without coherent long-distance neural activity, suggesting a quickly dissipating feedforward wave. In contrast, conscious processing of unmasked words was characterized by the convergence of four distinct neurophysiological markers: sustained voltage changes, particularly in prefrontal cortex, large increases in spectral power in the gamma band, increases in long-distance phase synchrony in the beta range, and increases in long-range Granger causality. We argue that all of those measures provide distinct windows into the same distributed state of conscious processing. These results have a direct impact on current theoretical discussions concerning the neural correlates of conscious access.     

Impact of emotion on consciousness: positive stimuli enhance conscious reportability

Emotion and reward have been proposed to be closely linked to conscious experience, but empirical data are lacking. The anterior cingulate cortex (ACC) plays a central role in the hedonic dimension of conscious experience; thus potentially a key region in interactions between emotion and consciousness. Here we tested the impact of emotion on conscious experience, and directly investigated the role of the ACC. We used a masked paradigm that measures conscious reportability in terms of subjective confidence and objective accuracy in identifying the briefly presented stimulus in a forced-choice test. By manipulating the emotional valence (positive, neutral, negative) and the presentation time (16 ms, 32 ms, 80 ms) we measured the impact of these variables on conscious and subliminal (i.e. below threshold) processing. First, we tested normal participants using face and word stimuli. Results showed that participants were more confident and accurate when consciously seeing happy versus sad/neutral faces and words. When stimuli were presented subliminally, we found no effect of emotion. To investigate the neural basis of this impact of emotion, we recorded local field potentials (LFPs) directly in the ACC in a chronic pain patient. Behavioural findings were replicated: the patient was more confident and accurate when (consciously) seeing happy versus sad faces, while no effect was seen in subliminal trials. Mirroring behavioural findings, we found significant differences in the LFPs after around 500 ms (lasting 30 ms) in conscious trials between happy and sad faces, while no effect was found in subliminal trials. We thus demonstrate a striking impact of emotion on conscious experience, with positive emotional stimuli enhancing conscious reportability. In line with previous studies, the data indicate a key role of the ACC, but goes beyond earlier work by providing the first direct evidence of interaction between emotion and conscious experience in the human ACC.     

Sensory information in local field potentials and spikes from visual and auditory cortices: time scales and frequency bands

Studies analyzing sensory cortical processing or trying to decode brain activity often rely on a combination of different electrophysiological signals, such as local field potentials (LFPs) and spiking activity. Understanding the relation between these signals and sensory stimuli and between different components of these signals is hence of great interest. We here provide an analysis of LFPs and spiking activity recorded from visual and auditory cortex during stimulation with natural stimuli. In particular, we focus on the time scales on which different components of these signals are informative about the stimulus, and on the dependencies between different components of these signals. Addressing the first question, we find that stimulus information in low frequency bands (<12 Hz) is high, regardless of whether their energy is computed at the scale of milliseconds or seconds. Stimulus information in higher bands (>50 Hz), in contrast, is scale dependent, and is larger when the energy is averaged over several hundreds of milliseconds. Indeed, combined analysis of signal reliability and information revealed that the energy of slow LFP fluctuations is well related to the stimulus even when considering individual or few cycles, while the energy of fast LFP oscillations carries information only when averaged over many cycles. Addressing the second question, we find that stimulus information in different LFP bands, and in different LFP bands and spiking activity, is largely independent regardless of time scale or sensory system. Taken together, these findings suggest that different LFP bands represent dynamic natural stimuli on distinct time scales and together provide a potentially rich source of information for sensory processing or decoding brain activity.     

Covariation between Spike and LFP Modulations Revealed with Focal and Asynchronous Stimulation of Receptive Field Surround in Monkey Primary Visual Cortex

A focal visual stimulus outside the classical receptive field (RF) of a V1 neuron does not evoke a spike response by itself, and yet evokes robust changes in the local field potential (LFP). This subthreshold LFP provides a unique opportunity to investigate how changes induced by surround stimulation leads to modulation of spike activity. In the current study, two identical Gabor stimuli were sequentially presented with a variable stimulus onset asynchrony (SOA) ranging from 0 to 100 ms: the first (S1) outside the RF and the second (S2) over the RF of primary visual cortex neurons, while trained monkeys performed a fixation task. This focal and asynchronous stimulation of the RF surround enabled us to analyze the modulation of S2-evoked spike activity and covariation between spike and LFP modulation across SOA. In this condition, the modulation of S2-evoked spike response was dominantly facilitative and was correlated with the change in LFP amplitude, which was pronounced for the cells recorded in the upper cortical layers. The time course of covariation between the SOA-dependent spike modulation and LFP amplitude suggested that the subthreshold LFP evoked by the S1 can predict the magnitude of upcoming spike modulation.     

Energy model for contrast detection: spatiotemporal characteristics of threshold vision

A model for contrast detection of spatiotemporal stimuli is proposed which consists of a spatiotemporal linear filter, an energy device and a threshold device. Assuming the existence of independent intrinsic noise, the probability of stimulus detection was approximated by a Weibull function of the response energy. With this assumption, the stimulus energy is a constant at fixed detection probability. This energy model for contrast detection satisfactorily accounted for the elliptical threshold contours of line pairs at stimulus separations within the range 2–30 min and at stimulus onset asynchronies within the range 20–140 ms. The threshold contour at a large stimulus onset asynchrony (300 ms) was in the form of a rounded square. This finding was explained by assuming that the probability of seeing the line pair was determined by the joint probability that at least one stimulus had been detected. With the energy model, the temporal and spatial autocorrelation functions of the response to a flashed line were evaluated. The autocorrelation functions thus determined were used to predict the temporal contrast sensitivity function to a flickering line stimulus and the spatial contrast sensitivity function to flashed gratings, which were in agreement with the experimental data. The data obtained were fitted adequately by an impulse response approximated by a spatiotemporal Gabor-like function. Received: 08 December 1997 / Accepted in revised form: 26 January 1999     

Investigating Thought Disorder in Schizophrenia: Evidence for Pathological Activation

Background

Previous research has yielded evidence for enhanced semantic priming in formal thought-disordered schizophrenia patients, a result that fits well with the hypothesis of disinhibited processes of spreading activation in this population.

Objective

The current study examined whether hyper priming among schizophrenia patients is an outcome of further spreading of activation of a node or a result of farther activation of nodes in the semantic network. We also try to shed light on the fate of this activation.

Methods

The present study tested this hypothesis by using semantic and identical priming in two different experiments. SOA (stimulus onset asynchrony) was manipulated (240 ms vs. 740 ms) within block. It is assumed that among healthy individuals, performance relies on a balance between activation and inhibition processes, contrary to in schizophrenic individuals. In order to examine this hypothesis, we compared formal thought-disordered schizophrenia patients, non thought-disordered schizophrenia patients, and healthy controls.

Results

For thought-disordered schizophrenia patients, we found a large positive semantic effect and identical priming effect (129 ms and 154 ms, respectively) only with short SOA. SOA and type of priming did not modulate priming effects in the control groups.

Conclusions

This result supports the claim that there is a lack of inhibitory processes among thought-disordered patients. Hyper priming in the thought-disorder group may be an outcome of hyper activation followed by rapid decay below baseline threshold.     

Perceiving what is reachable depends on motor representations: evidence from a transcranial magnetic stimulation study

Background

Visually determining what is reachable in peripersonal space requires information about the egocentric location of objects but also information about the possibilities of action with the body, which are context dependent. The aim of the present study was to test the role of motor representations in the visual perception of peripersonal space.

Methodology

Seven healthy participants underwent a TMS study while performing a right-left decision (control) task or perceptually judging whether a visual target was reachable or not with their right hand. An actual grasping movement task was also included. Single pulse TMS was delivered 80% of the trials on the left motor and premotor cortex and on a control site (the temporo-occipital area), at 90% of the resting motor threshold and at different SOA conditions (50ms, 100ms, 200ms or 300ms).

Principal Findings

Results showed a facilitation effect of the TMS on reaction times in all tasks, whatever the site stimulated and until 200ms after stimulus presentation. However, the facilitation effect was on average 34ms lower when stimulating the motor cortex in the perceptual judgement task, especially for stimuli located at the boundary of peripersonal space.

Conclusion

This study provides the first evidence that brain motor area participate in the visual determination of what is reachable. We discuss how motor representations may feed the perceptual system with information about possible interactions with nearby objects and thus may contribute to the perception of the boundary of peripersonal space.     

How Does the Extraction of Local and Global Auditory Regularities Vary with Context?

How does the human brain extract regularities from its environment? There is evidence that short range or ‘local’ regularities (within seconds) are automatically detected by the brain while long range or ‘global’ regularities (over tens of seconds or more) require conscious awareness. In the present experiment, we asked whether participants'' attention was needed to acquire such auditory regularities, to detect their violation or both. We designed a paradigm in which participants listened to predictable sounds. Subjects could be distracted by a visual task at two moments: when they were first exposed to a regularity or when they detected violations of this regularity. MEG recordings revealed that early brain responses (100–130 ms) to violations of short range regularities were unaffected by visual distraction and driven essentially by local transitional probabilities. Based on global workspace theory and prior results, we expected that visual distraction would eliminate the long range global effect, but unexpectedly, we found the contrary, i.e. late brain responses (300–600 ms) to violations of long range regularities on audio-visual trials but not on auditory only trials. Further analyses showed that, in fact, visual distraction was incomplete and that auditory and visual stimuli interfered in both directions. Our results show that conscious, attentive subjects can learn the long range dependencies present in auditory stimuli even while performing a visual task on synchronous visual stimuli. Furthermore, they acquire a complex regularity and end up making different predictions for the very same stimulus depending on the context (i.e. absence or presence of visual stimuli). These results suggest that while short-range regularity detection is driven by local transitional probabilities between stimuli, the human brain detects and stores long-range regularities in a highly flexible, context dependent manner.     

White Noise Masks Some Temporal Parameters of the Auditory Localization of Radially Moving Targets

The temporal parameters of the perception of radially moving sound sources partly masked with broadband internalized noise at an intensity of 40, 46, or 52 dB above the hearing threshold have been studied. The threshold of sound duration necessary for identifying the direction of movement of the sound source (75% correct answers) increases from 135 ms in silence to 285 ms at all intensities of continuous noise studied. The minimum duration of the stimulus beginning with which a subsequent increase in duration does not increase the number of correct responses is the same (385 ms) under all conditions of stimulus presentation. Broadband noise of any intensity increases the time of response to stimuli in the range of durations studied. At a noise of 52 dB, which is close to the threshold of full masking, the reaction time is not increased significantly compared to its estimation at a noise of 46 dB. The minimum duration of the stimulus has proved to be the stablest temporal parameter of the perception of movement of a sound source. Changes in the temporal parameters of sound perception at noise levels close to the threshold of full masking are discussed.     

Selection of stimulus parameters for enhancing slow wave sleep events with a neural-field theory thalamocortical model

Slow-wave sleep cortical brain activity, conformed by slow-oscillations and sleep spindles, plays a key role in memory consolidation. The increase of the power of the slow-wave events, obtained by auditory sensory stimulation, positively correlates with memory consolidation performance. However, little is known about the experimental protocol maximizing this effect, which could be induced by the power of slow-oscillation, the number of sleep spindles, or the timing of both events’ co-occurrence. Using a mean-field model of thalamocortical activity, we studied the effect of several stimulation protocols, varying the pulse shape, duration, amplitude, and frequency, as well as a target-phase using a closed-loop approach. We evaluated the effect of these parameters on slow-oscillations (SO) and sleep-spindles (SP), considering: (i) the power at the frequency bands of interest, (ii) the number of SO and SP, (iii) co-occurrences between SO and SP, and (iv) synchronization of SP with the up-peak of the SO. The first three targets are maximized using a decreasing ramp pulse with a pulse duration of 50 ms. Also, we observed a reduction in the number of SO when increasing the stimulus energy by rising its amplitude. To assess the target-phase parameter, we applied closed-loop stimulation at 0°, 45°, and 90° of the phase of the narrow-band filtered ongoing activity, at 0.85 Hz as central frequency. The 0° stimulation produces better results in the power and number of SO and SP than the rhythmic or random stimulation. On the other hand, stimulating at 45° or 90° change the timing distribution of spindles centers but with fewer co-occurrences than rhythmic and 0° phase. Finally, we propose the application of closed-loop stimulation at the rising zero-cross point using pulses with a decreasing ramp shape and 50 ms of duration for future experimental work.     

Masking efficiency as a function of stimulus onset asynchrony for spatial-frequency detection and identification

Detection and identification thresholds for grating targets were measured in the presence of a compound mask grating as a function of the stimulus onset asynchrony (SOA). The detection and identification SOA functions are both reversed U-shaped but they are not parallel. The detection-to-identification ratio is itself a reversed U-shaped function of SOA, even for stimuli two octaves apart, with a peak between +20 and +60 ms SOA (backward masking). It is argued that these results support the hypothesis according to which detection and identification are serial processes.     

Effects of ISI and flash duration on the identification of briefly flashed stimuli

The identification accuracy of briefly flashed stimuli followed by an interstimulus interval (ISI) of variable length was compared to that obtained with longer flashes that prolonged the exposure of the stimulus throughout the ISI. The interval between the onset of the stimulus and the onset of the mask (stimulus onset asynchrony (SOA)) was the same in the two conditions. Consistent with a dependence of visual identification on SOA, the percentages of correct identification in the two conditions were approximately similar at all SOAs irrespective of the level of noise, stimulus familiarity, and stimulus complexity. However, departures from the onset-onset rule were also present. While the two conditions yielded virtually identical identification accuracy with an SOA of 80 ms, small but significant differences were found for shorter and longer intervals. Possible theoretical explanations of the results are presented.     

Dynamic construction of stimulus values in the ventromedial prefrontal cortex

Signals representing the value assigned to stimuli at the time of choice have been repeatedly observed in ventromedial prefrontal cortex (vmPFC). Yet it remains unknown how these value representations are computed from sensory and memory representations in more posterior brain regions. We used electroencephalography (EEG) while subjects evaluated appetitive and aversive food items to study how event-related responses modulated by stimulus value evolve over time. We found that value-related activity shifted from posterior to anterior, and from parietal to central to frontal sensors, across three major time windows after stimulus onset: 150-250 ms, 400-550 ms, and 700-800 ms. Exploratory localization of the EEG signal revealed a shifting network of activity moving from sensory and memory structures to areas associated with value coding, with stimulus value activity localized to vmPFC only from 400 ms onwards. Consistent with these results, functional connectivity analyses also showed a causal flow of information from temporal cortex to vmPFC. Thus, although value signals are present as early as 150 ms after stimulus onset, the value signals in vmPFC appear relatively late in the choice process, and seem to reflect the integration of incoming information from sensory and memory related regions.