Precisely timed oculomotor and parietal EEG activity in perceptual switching

Blinks and saccades cause transient interruptions of visual input. To investigate how such effects influence our perceptual state, we analyzed the time courses of blink and saccade rates in relation to perceptual switching in the Necker cube. Both time courses of blink and saccade rates showed peaks at different moments along the switching process. A peak in blinking rate appeared 1,000 ms prior to the switching responses. Blinks occurring around this peak were associated with subsequent switching to the preferred interpretation of the Necker cube. Saccade rates showed a peak 150 ms prior to the switching response. The direction of saccades around this peak was predictive of the perceived orientation of the Necker cube afterwards. Peak blinks were followed and peak saccades were preceded by transient parietal theta band activity indicating the changing of the perceptual interpretation. Precisely-timed blinks, therefore, can initiate perceptual switching, and precisely-timed saccades can facilitate an ongoing change of interpretation.     

A songbird inhibits blinking behaviour in flight

Visual attention plays a fundamental role in avian flight but attention is likely limited whenever birds blink. Because blinks are necessary to maintaining proper vision, this study tested the hypothesis that birds strategically inhibit their blinks in flight. The blinks of captive great-tailed grackles (Quiscalus mexicanus) were recorded before, during and after they flew a short distance in an open environment. The grackles spent the least amount of time blinking in flight (take-off, during flight and landing) and the most amount of time blinking at impact. Their blinking behaviour was similar before and after flight. These results suggest that grackles strategically inhibit their blinking behaviour in flight, potentially because blinks impose costs to avian flight.     

Concurrent TMS-fMRI and psychophysics reveal frontal influences on human retinotopic visual cortex

BACKGROUND: Regions in human frontal cortex may have modulatory top-down influences on retinotopic visual cortex, but to date neuroimaging methods have only been able to provide indirect evidence for such functional interactions between remote but interconnected brain regions. Here we combined transcranial magnetic stimulation (TMS) with concurrent functional magnetic resonance imaging (fMRI), plus psychophysics, to show that stimulation of the right human frontal eye-field (FEF) produced a characteristic topographic pattern of activity changes in retinotopic visual areas V1-V4, with functional consequences for visual perception. RESULTS: FEF TMS led to activity increases for retinotopic representations of the peripheral visual field, but to activity decreases for the central field, in areas V1-V4. These frontal influences on visual cortex occurred in a top-down manner, independently of visual input. TMS of a control site (vertex) did not elicit such visual modulations, and saccades, blinks, or pupil dilation could not account for our results. Finally, the effects of FEF TMS on activity in retinotopic visual cortex led to a behavioral prediction that we confirmed psychophysically by showing that TMS of the frontal site (again compared with vertex) enhanced perceived contrast for peripheral relative to central visual stimuli. CONCLUSIONS: Our results provide causal evidence that circuits originating in the human FEF can modulate activity in retinotopic visual cortex, in a manner that differentiates the central and peripheral visual field, with functional consequences for perception. More generally, our study illustrates how the new approach of concurrent TMS-fMRI can now reveal causal interactions between remote but interconnected areas of the human brain.     

Navigation-synchronized multimodal control wheelchair from brain to alternative assistive technologies for persons with severe disabilities

Currently, electric wheelchairs are commonly used to improve mobility in disabled people. In severe cases, the user is unable to control the wheelchair by themselves because his/her motor functions are disabled. To restore mobility function, a brain-controlled wheelchair (BCW) would be a promising system that would allow the patient to control the wheelchair by their thoughts. P300 is a reliable brain electrical signal, a component of visual event-related potentials (ERPs), that could be used for interpreting user commands. This research aimed to propose a prototype BCW to allowed severe motor disabled patients to practically control a wheelchair for use in their home environment. The users were able to select from 9 possible destination commands in the automatic mode and from 4 directional commands (forward, backward, turn left and right) in the shared-control mode. These commands were selected via the designed P300 processing system. The wheelchair was steered to the desired location by the implemented navigation system. Safety of the user was ensured during wheelchair navigation due to the included obstacle detection and avoidance features. A combination of P300 and EOG was used as a hybrid BCW system. The user could fully operate the system such as enabling P300 detection system, mode shifting and stop/cancelation command by performing a different consecutive blinks to generate eye blinking patterns. The results revealed that the prototype BCW could be operated in either of the proposed modes. With the new design of the LED-based P300 stimulator, the average accuracies of the P300 detection algorithm in the shared-control and automatic modes were 95.31 and 83.42% with 3.09 and 3.79 bits/min, respectively. The P300 classification error was acceptable, as the user could cancel an incorrect command by blinking 2 times. Moreover, the proposed navigation system had a flexible design that could be interfaced with other assistive technologies. This research developed 3 alternative input modules: an eye tracker module and chin and hand controller modules. The user could select the most suitable assistive technology based on his/her level of disability. Other existing assistive technologies could also be connected to the proposed system in the future using the same protocol.     

Synchronization of spontaneous eyeblinks while viewing video stories

Blinks are generally suppressed during a task that requires visual attention and tend to occur immediately before or after the task when the timing of its onset and offset are explicitly given. During the viewing of video stories, blinks are expected to occur at explicit breaks such as scene changes. However, given that the scene length is unpredictable, there should also be appropriate timing for blinking within a scene to prevent temporal loss of critical visual information. Here, we show that spontaneous blinks were highly synchronized between and within subjects when they viewed the same short video stories, but were not explicitly tied to the scene breaks. Synchronized blinks occurred during scenes that required less attention such as at the conclusion of an action, during the absence of the main character, during a long shot and during repeated presentations of a similar scene. In contrast, blink synchronization was not observed when subjects viewed a background video or when they listened to a story read aloud. The results suggest that humans share a mechanism for controlling the timing of blinks that searches for an implicit timing that is appropriate to minimize the chance of losing critical information while viewing a stream of visual events.     

Electrical Neuroimaging Reveals Timing of Attentional Control Activity in Human Brain

Voluntarily shifting attention to a location of the visual field improves the perception of events that occur there. Regions of frontal cortex are thought to provide the top-down control signal that initiates a shift of attention, but because of the temporal limitations of functional brain imaging, the timing and sequence of attentional-control operations remain unknown. We used a new analytical technique (beamformer spatial filtering) to reconstruct the anatomical sources of low-frequency brain waves in humans associated with attentional control across time. Following a signal to shift attention, control activity was seen in parietal cortex 100–200 ms before activity was seen in frontal cortex. Parietal cortex was then reactivated prior to anticipatory biasing of activity in occipital cortex. The magnitudes of early parietal activations were strongly predictive of the degree of attentional improvement in perceptual performance. These results show that parietal cortex, not frontal cortex, provides the initial signals to shift attention and indicate that top-down attentional control is not purely top down.     

Preparatory effects of distractor suppression: evidence from visual cortex

Spatial selective attention is the mechanism that facilitates the selection of relevant information over irrelevant information in the visual field. The current study investigated whether foreknowledge of the presence or absence of distractors surrounding an impending target stimulus results in preparatory changes in visual cortex. We cued the location of the target and the presence or absence of distractors surrounding the target while changes in blood oxygen level dependent (BOLD) signals were measured. In line with prior work, we found that top-down spatial attention resulted in an increased contralateral BOLD response, evoked by the cue throughout early visual cortex (areas V1, V2 and V3). In addition, cues indicating distractor presence evoked a substantial increase in the magnitude of the BOLD signal in visual area V3, but not in V2 or V1. This study shows that prior knowledge concerning the presence of a distractor results in enhanced attentional modulation of visual cortex, in visual areas where neuronal receptive fields are large enough to encompass both targets and distractors. We interpret these findings as evidence that top-down attentional control processes include active preparatory suppression mechanisms for irrelevant, distracting information in the visual scene.     

Increased activity in human visual cortex during directed attention in the absence of visual stimulation

When subjects direct attention to a particular location in a visual scene, responses in the visual cortex to stimuli presented at that location are enhanced, and the suppressive influences of nearby distractors are reduced. What is the top-down signal that modulates the response to an attended versus an unattended stimulus? Here, we demonstrate increased activity related to attention in the absence of visual stimulation in extrastriate cortex when subjects covertly directed attention to a peripheral location expecting the onset of visual stimuli. Frontal and parietal areas showed a stronger signal increase during this expectation than did visual areas. The increased activity in visual cortex in the absence of visual stimulation may reflect a top-down bias of neural signals in favor of the attended location, which derives from a fronto-parietal network.     

Acquisition of conditioned facial reflexes in the cat: cortical control of different facial movements

The motor cortex plays a role in determining which of three different facial movements is acquired in Pavlovian conditioning experiments. Three separate facial reflexes can be distinguished by recording electromyographic activity from the orbicularis oculi (eye blink) and levator orii (nose twitch) muscles. One in a pure eye blink; a second is a nose twitch; the third is a compound eye blink and nose twitch. Which of these movements is elicited by a click (conditioned stimulus) following associative conditioning is reflected by the pattern of unit activity elicited by the click at the motor cortex. Activity is enhanced, after conditioning, in those units that project polysynaptically to the specific muscles performing the learned movement. This enhancement of activity is, in turn, relatable to an enhanced electrical excitability of the involved neurons. Analogous changes in the excitability of neurons of the motor cortex to applied currents can be produced by local application of cholinergic agents. Iontophoresis of acetylcholine, aceclidine (a cholinomimetic drug), or intracellularly applied cyclic GMP produces changes in single neuron membrane resistance that increase neuronal excitability. The units of the motor cortex that respond preferentially to these agents and to the click conditioned stimuli with short latencies have been identified as pyramidal cells of layer V. The axons of these neurons form the pyramidal tract, a pathway characterized as serving voluntary movement. It appears that this system supports rapid transmission and processing of auditory-motor information used to perform learned movements adaptively, selectively, and discriminatively.     

Ganzfeld Stimulation or Sleep Enhance Long Term Motor Memory Consolidation Compared to Normal Viewing in Saccadic Adaptation Paradigm

Adaptation of saccade amplitude in response to intra-saccadic target displacement is a type of implicit motor learning which is required to compensate for physiological changes in saccade performance. Once established trials without intra-saccadic target displacement lead to de-adaptation or extinction, which has been attributed either to extra-retinal mechanisms of spatial constancy or to the influence of the stable visual surroundings. Therefore we investigated whether visual deprivation (“Ganzfeld”-stimulation or sleep) can partially maintain this motor learning compared to free viewing of the natural surroundings. Thirty-five healthy volunteers performed two adaptation blocks of 100 inward adaptation trials – interspersed by an extinction block – which were followed by a two-hour break with or without visual deprivation (VD). Using additional adaptation and extinction blocks short and long (4 weeks) term memory of this implicit motor learning were tested. In the short term, motor memory tested immediately after free viewing was superior to adaptation performance after VD. In the long run, however, effects were opposite: motor memory and relearning of adaptation was superior in the VD conditions. This could imply independent mechanisms that underlie the short-term ability of retrieving learned saccadic gain and its long term consolidation. We suggest that subjects mainly rely on visual cues (i.e., retinal error) in the free viewing condition which makes them prone to changes of the visual stimulus in the extinction block. This indicates the role of a stable visual array for resetting adapted saccade amplitudes. In contrast, visual deprivation (GS and sleep), might train subjects to rely on extra-retinal cues, e.g., efference copy or prediction to remap their internal representations of saccade targets, thus leading to better consolidation of saccadic adaptation.     

Correlation between Inter-Blink Interval and Episodic Encoding during Movie Watching

Human eye blinking is cognitively suppressed to minimize loss of visual information for important real-world events. Despite the relationship between eye blinking and cognitive state, the effect of eye blinks on cognition in real-world environments has received limited research attention. In this study, we focused on the temporal pattern of inter-eye blink interval (IEBI) during movie watching and investigated its relationship with episodic memory. As a control condition, 24 healthy subjects watched a nature documentary that lacked a specific story line while electroencephalography was performed. Immediately after viewing the movie, the subjects were asked to report its most memorable scene. Four weeks later, subjects were asked to score 32 randomly selected scenes from the movie, based on how much they were able to remember and describe. The results showed that the average IEBI was significantly longer during the movie than in the control condition. In addition, the significant increase in IEBI when watching a movie coincided with the most memorable scenes of the movie. The results suggested that the interesting episodic narrative of the movie attracted the subjects’ visual attention relative to the documentary clip that did not have a story line. In the episodic memory test executed four weeks later, memory performance was significantly positively correlated with IEBI (p<0.001). In summary, IEBI may be a reliable bio-marker of the degree of concentration on naturalistic content that requires visual attention, such as a movie.     

Top-down control of motor cortex ensembles by dorsomedial prefrontal cortex

Dorsomedial prefrontal cortex is critical for the temporal control of behavior. Dorsomedial prefrontal cortex might alter neuronal activity in areas such as motor cortex to inhibit temporally inappropriate responses. We tested this hypothesis by recording from neuronal ensembles in rodent dorsomedial prefrontal cortex during a delayed-response task. One-third of dorsomedial prefrontal neurons were significantly modulated during the delay period. The activity of many of these neurons was predictive of premature responding. We then reversibly inactivated dorsomedial prefrontal cortex while recording ensemble activity in motor cortex. Inactivation of dorsomedial prefrontal cortex reduced delay-related firing, but not response-related firing, in motor cortex. Finally, we made simultaneous recordings in dorsomedial prefrontal cortex and motor cortex and found strong delay-related temporal correlations between neurons in the two cortical areas. These data suggest that functional interactions between dorsomedial prefrontal cortex and motor cortex might serve as a top-down control signal that inhibits inappropriate responding.     

The thalamus in the motor system.

The ventrolateral (VL) and anterior (VA) are the main thalamic relay for cerebellar and pallidal efferents going to the motor cortex. Four aspects of the function of these nuclei are briefly considered. (1) It is well known that these thalamic structures are not a simple relay on the way to the motor cortex, but that they have a gating function for the cerebellar afferents. The gating mechanism is active during slow-wave sleep, with deafferentation and with the use of various anesthetics. Possibly, it might play a role in the central organization of movement. (2) The organization at the unitary level of the projections between VL and motor cortex is examined and their role in the command of motor synergies through the motor cortex is strongly suggested. (3). It appears that unitary activity of VL neurons is not only related to movement but also to postural changes associated with movement. (4) The sensory input to VL nucleus is briefly analyzed. The inefficacy of exteroceptive stimulation in awake animals, in contrast with the effect of the same stimulation in anesthetized preparations, is discussed.     

Spike suppression in a local cortical circuit induced by transcranial magnetic stimulation

Transcranial magnetic stimulation (TMS) noninvasively interferes with human cortical function, and is widely used as an effective technique for probing causal links between neural activity and cognitive function. However, the physiological mechanisms underlying TMS-induced effects on neural activity remain unclear. We examined the mechanism by which TMS disrupts neural activity in a local circuit in early visual cortex using a computational model consisting of conductance-based spiking neurons with excitatory and inhibitory synaptic connections. We found that single-pulse TMS suppressed spiking activity in a local circuit model, disrupting the population response. Spike suppression was observed when TMS was applied to the local circuit within a limited time window after the local circuit received sensory afferent input, as observed in experiments investigating suppression of visual perception with TMS targeting early visual cortex. Quantitative analyses revealed that the magnitude of suppression was significantly larger for synaptically-connected neurons than for isolated individual neurons, suggesting that intracortical inhibitory synaptic coupling also plays an important role in TMS-induced suppression. A conventional local circuit model of early visual cortex explained only the early period of visual suppression observed in experiments. However, models either involving strong recurrent excitatory synaptic connections or sustained excitatory input were able to reproduce the late period of visual suppression. These results suggest that TMS targeting early visual cortex disrupts functionally distinct neural signals, possibly corresponding to feedforward and recurrent information processing, by imposing inhibitory effects through intracortical inhibitory synaptic connections.     

Vision: in the brain of the beholder

It is commonly thought that neural activity in the visual cortex reflects retinal input. Recent studies, however, suggest that patterns of cortical activity are mostly intrinsically generated, and that visual input exerts but a modulatory influence.     

Predicting the stream of consciousness from activity in human visual cortex

Can the rapid stream of conscious experience be predicted from brain activity alone? Recently, spatial patterns of activity in visual cortex have been successfully used to predict feature-specific stimulus representations for both visible and invisible stimuli. However, because these studies examined only the prediction of static and unchanging perceptual states during extended periods of stimulation, it remains unclear whether activity in early visual cortex can also predict the rapidly and spontaneously changing stream of consciousness. Here, we used binocular rivalry to induce frequent spontaneous and stochastic changes in conscious experience without any corresponding changes in sensory stimulation, while measuring brain activity with fMRI. Using information that was present in the multivariate pattern of responses to stimulus features, we could accurately predict, and therefore track, participants' conscious experience from the fMRI signal alone while it underwent many spontaneous changes. Prediction in primary visual cortex primarily reflected eye-based signals, whereas prediction in higher areas reflected the color of the percept. Furthermore, accurate prediction during binocular rivalry could be established with signals recorded during stable monocular viewing, showing that prediction generalized across viewing conditions and did not require or rely on motor responses. It is therefore possible to predict the dynamically changing time course of subjective experience with only brain activity.     

Optogenetic Stimulation of the Corticothalamic Pathway Affects Relay Cells and GABAergic Neurons Differently in the Mouse Visual Thalamus

The dorsal lateral geniculate nucleus (dLGN) serves as the primary conduit of retinal information to visual cortex. In addition to retinal input, dLGN receives a large feedback projection from layer VI of visual cortex. Such input modulates thalamic signal transmission in different ways that range from gain control to synchronizing network activity in a stimulus-specific manner. However, the mechanisms underlying such modulation have been difficult to study, in part because of the complex circuitry and diverse cell types this pathway innervates. To address this and overcome some of the technical limitations inherent in studying the corticothalamic (CT) pathway, we adopted a slice preparation in which we were able to stimulate CT terminal arbors in the visual thalamus of the mouse with blue light by using an adeno-associated virus to express the light-gated ion channel, ChIEF, in layer VI neurons. To examine the postsynaptic responses evoked by repetitive CT stimulation, we recorded from identified relay cells in dLGN, as well as GFP expressing GABAergic neurons in the thalamic reticular nucleus (TRN) and intrinsic interneurons of dLGN. Relay neurons exhibited large glutamatergic responses that continued to increase in amplitude with each successive stimulus pulse. While excitatory responses were apparent at postnatal day 10, the strong facilitation noted in adult was not observed until postnatal day 21. GABAergic neurons in TRN exhibited large initial excitatory responses that quickly plateaued during repetitive stimulation, indicating that the degree of facilitation was much larger for relay cells than for TRN neurons. The responses of intrinsic interneurons were smaller and took the form of a slow depolarization. These differences in the pattern of excitation for different thalamic cell types should help provide a framework for understanding how CT feedback alters the activity of visual thalamic circuitry during sensory processing as well as different behavioral or pathophysiological states.     

Dynamics of parietal neural activity during spatial cognitive processing

Dynamic neural processing unrelated to changes in sensory input or motor output is likely to be a hallmark of cognitive operations. Here we show that neural representations of space in parietal cortex are dynamic while monkeys perform a spatial cognitive operation on a static visual stimulus. We recorded neural activity in area 7a during a visual maze task in which monkeys mentally followed a path without moving their eyes. We found that the direction of the followed path could be recovered from neuronal population activity. When the monkeys covertly processed a path that turned, the population representation of path direction shifted in the direction of the turn. This neural population dynamic took place during a period of unchanging visual input and showed characteristics of both serial and parallel processing. The data suggest that the dynamic evolution of parietal neuronal activity is associated with the progression of spatial cognitive operations.     

Prefrontal cortex and neural mechanisms of executive function

Executive function is a product of the coordinated operation of multiple neural systems and an essential prerequisite for a variety of cognitive functions. The prefrontal cortex is known to be a key structure for the performance of executive functions. To accomplish the coordinated operations of multiple neural systems, the prefrontal cortex must monitor the activities in other cortical and subcortical structures and control and supervise their operations by sending command signals, which is called top-down signaling. Although neurophysiological and neuroimaging studies have provided evidence that the prefrontal cortex sends top-down signals to the posterior cortices to control information processing, the neural correlate of these top-down signals is not yet known. Through use of the paired association task, it has been demonstrated that top-down signals are used to retrieve specific information stored in long-term memory. Therefore, we used a paired association task to examine the neural correlates of top-down signals in the prefrontal cortex. The preliminary results indicate that 32% of visual neurons exhibit pair-selectivity, which is similar to the characteristics of pair-coding activities in temporal neurons. The latency of visual responses in prefrontal neurons was longer than bottom-up signals but faster than top-down signals in inferior temporal neurons. These results suggest that pair-selective visual responses may be top-down signals that the prefrontal cortex provides to the temporal cortex, although further studies are needed to elucidate the neural correlates of top-down signals and their characteristics to understand the neural mechanism of executive control by the prefrontal cortex.     

Mechanisms of neural integration in the parietal lobe for visual attention.

The impulse discharges of neurons in the inferior parietal association cortex (area 7) were studied in the alert, behaving rhesus monkey, trained to fixate and follow visual targets. Four classes of cells related to visual or visuomotor function were found. Cells of one of these are sensitive to visual stimuli and have large, contralateral receptive fields with maximal sensitivity in the far temporal quadrants. Cells of the other three classes are related to visuomotor functions: visual fixation, tracking, and saccades. They are neither sensory nor motor in the usual sense for they are activated only by interested fixation of gaze or tracking, or before visually evoked saccadic eye movements. They are not activated during the spontaneous saccades and fixations that the monkey makes while casually exploring his environment. It is hypothesized that the light-sensitive neurons provide the visual input to the visuomotor cells that, in turn, produce a command signal for the direction of visual attention and for shifting the focus of attention from one target to another.