Priority-based transformations of stimulus representation in visual working memory

How does the brain prioritize among the contents of working memory (WM) to appropriately guide behavior? Previous work, employing inverted encoding modeling (IEM) of electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) datasets, has shown that unprioritized memory items (UMI) are actively represented in the brain, but in a “flipped”, or opposite, format compared to prioritized memory items (PMI). To acquire independent evidence for such a priority-based representational transformation, and to explore underlying mechanisms, we trained recurrent neural networks (RNNs) with a long short-term memory (LSTM) architecture to perform a 2-back WM task. Visualization of LSTM hidden layer activity using Principal Component Analysis (PCA) confirmed that stimulus representations undergo a representational transformation–consistent with a flip—while transitioning from the functional status of UMI to PMI. Demixed (d)PCA of the same data identified two representational trajectories, one each within a UMI subspace and a PMI subspace, both undergoing a reversal of stimulus coding axes. dPCA of data from an EEG dataset also provided evidence for priority-based transformations of the representational code, albeit with some differences. This type of transformation could allow for retention of unprioritized information in WM while preventing it from interfering with concurrent behavior. The results from this initial exploration suggest that the algorithmic details of how this transformation is carried out by RNNs, versus by the human brain, may differ.     

Viewing Complex,Dynamic Scenes “Through the Eyes” of Another Person: The Gaze-Replay Paradigm

We present a novel “Gaze-Replay” paradigm that allows the experimenter to directly test how particular patterns of visual input—generated from people’s actual gaze patterns—influence the interpretation of the visual scene. Although this paradigm can potentially be applied across domains, here we applied it specifically to social comprehension. Participants viewed complex, dynamic scenes through a small window displaying only the foveal gaze pattern of a gaze “donor.” This was intended to simulate the donor’s visual selection, such that a participant could effectively view scenes “through the eyes” of another person. Throughout the presentation of scenes presented in this manner, participants completed a social comprehension task, assessing their abilities to recognize complex emotions. The primary aim of the study was to assess the viability of this novel approach by examining whether these Gaze-Replay windowed stimuli contain sufficient and meaningful social information for the viewer to complete this social perceptual and cognitive task. The results of the study suggested this to be the case; participants performed better in the Gaze-Replay condition compared to a temporally disrupted control condition, and compared to when they were provided with no visual input. This approach has great future potential for the exploration of experimental questions aiming to unpack the relationship between visual selection, perception, and cognition.     

The Default Mode Network and the Working Memory Network Are Not Anti-Correlated during All Phases of a Working Memory Task

Introduction

The default mode network and the working memory network are known to be anti-correlated during sustained cognitive processing, in a load-dependent manner. We hypothesized that functional connectivity among nodes of the two networks could be dynamically modulated by task phases across time.

Methods

To address the dynamic links between default mode network and the working memory network, we used a delayed visuo-spatial working memory paradigm, which allowed us to separate three different phases of working memory (encoding, maintenance, and retrieval), and analyzed the functional connectivity during each phase within and between the default mode network and the working memory network networks.

Results

We found that the two networks are anti-correlated only during the maintenance phase of working memory, i.e. when attention is focused on a memorized stimulus in the absence of external input. Conversely, during the encoding and retrieval phases, when the external stimulation is present, the default mode network is positively coupled with the working memory network, suggesting the existence of a dynamically switching of functional connectivity between “task-positive” and “task-negative” brain networks.

Conclusions

Our results demonstrate that the well-established dichotomy of the human brain (anti-correlated networks during rest and balanced activation-deactivation during cognition) has a more nuanced organization than previously thought and engages in different patterns of correlation and anti-correlation during specific sub-phases of a cognitive task. This nuanced organization reinforces the hypothesis of a direct involvement of the default mode network in cognitive functions, as represented by a dynamic rather than static interaction with specific task-positive networks, such as the working memory network.     

A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants

Understanding typical and atypical development remains one of the fundamental questions in developmental human neuroscience. Traditionally, experimental paradigms and analysis tools have been limited to constrained laboratory tasks and contexts due to technical limitations imposed by the available set of measuring and analysis techniques and the age of the subjects. These limitations severely limit the study of developmental neural dynamics and associated neural networks engaged in cognition, perception and action in infants performing “in action and in context”. This protocol presents a novel approach to study infants and young children as they freely organize their own behavior, and its consequences in a complex, partly unpredictable and highly dynamic environment. The proposed methodology integrates synchronized high-density active scalp electroencephalography (EEG), inertial measurement units (IMUs), video recording and behavioral analysis to capture brain activity and movement non-invasively in freely-behaving infants. This setup allows for the study of neural network dynamics in the developing brain, in action and context, as these networks are recruited during goal-oriented, exploration and social interaction tasks.     

A Direct Brain-to-Brain Interface in Humans

We describe the first direct brain-to-brain interface in humans and present results from experiments involving six different subjects. Our non-invasive interface, demonstrated originally in August 2013, combines electroencephalography (EEG) for recording brain signals with transcranial magnetic stimulation (TMS) for delivering information to the brain. We illustrate our method using a visuomotor task in which two humans must cooperate through direct brain-to-brain communication to achieve a desired goal in a computer game. The brain-to-brain interface detects motor imagery in EEG signals recorded from one subject (the “sender”) and transmits this information over the internet to the motor cortex region of a second subject (the “receiver”). This allows the sender to cause a desired motor response in the receiver (a press on a touchpad) via TMS. We quantify the performance of the brain-to-brain interface in terms of the amount of information transmitted as well as the accuracies attained in (1) decoding the sender’s signals, (2) generating a motor response from the receiver upon stimulation, and (3) achieving the overall goal in the cooperative visuomotor task. Our results provide evidence for a rudimentary form of direct information transmission from one human brain to another using non-invasive means.     

The research of constructing dynamic cognition model based on brain network

Estimating the functional interactions and connections between brain regions to corresponding process in cognitive, behavioral and psychiatric domains is a central pursuit for understanding the human connectome. Few studies have examined the effects of dynamic evolution on cognitive processing and brain activation using brain network model in scalp electroencephalography (EEG) data. Aim of this study was to investigate the brain functional connectivity and construct dynamic programing model from EEG data and to evaluate a possible correlation between topological characteristics of the brain connectivity and cognitive evolution processing. Here, functional connectivity between brain regions is defined as the statistical dependence between EEG signals in different brain areas and is typically determined by calculating the relationship between regional time series using wavelet coherence. We present an accelerated dynamic programing algorithm to construct dynamic cognitive model that we found that spatially distributed regions coherence connection difference, the topologic characteristics with which they can transfer information, producing temporary network states. Our findings suggest that brain dynamics give rise to variations in complex network properties over time after variation audio stimulation, dynamic programing model gives the dynamic evolution processing at different time and frequency. In this paper, by applying a new construct approach to understand whole brain network dynamics, firstly, brain network is constructed by wavelet coherence, secondly, different time active brain regions are selected by network topological characteristics and minimum spanning tree. Finally, dynamic evolution model is constructed to understand cognitive process by dynamic programing algorithm, this model is applied to the auditory experiment, results showed that, quantitatively, more correlation was observed after variation audio stimulation, the EEG function connection dynamic evolution model on cognitive processing is feasible with wavelet coherence EEG recording.     

How Skill Expertise Shapes the Brain Functional Architecture: An fMRI Study of Visuo-Spatial and Motor Processing in Professional Racing-Car and Na?ve Drivers

The present study was designed to investigate the brain functional architecture that subserves visuo-spatial and motor processing in highly skilled individuals. By using functional magnetic resonance imaging (fMRI), we measured brain activity while eleven Formula racing-car drivers and eleven ‘naïve’ volunteers performed a motor reaction and a visuo-spatial task. Tasks were set at a relatively low level of difficulty such to ensure a similar performance in the two groups and thus avoid any potential confounding effects on brain activity due to discrepancies in task execution. The brain functional organization was analyzed in terms of regional brain response, inter-regional interactions and blood oxygen level dependent (BOLD) signal variability. While performance levels were equal in the two groups, as compared to naïve drivers, professional drivers showed a smaller volume recruitment of task-related regions, stronger connections among task-related areas, and an increased information integration as reflected by a higher signal temporal variability. In conclusion, our results demonstrate that, as compared to naïve subjects, the brain functional architecture sustaining visuo-motor processing in professional racing-car drivers, trained to perform at the highest levels under extremely demanding conditions, undergoes both ‘quantitative’ and ‘qualitative’ modifications that are evident even when the brain is engaged in relatively simple, non-demanding tasks. These results provide novel evidence in favor of an increased ‘neural efficiency’ in the brain of highly skilled individuals.     

Extracting Multiscale Pattern Information of fMRI Based Functional Brain Connectivity with Application on Classification of Autism Spectrum Disorders

We employed a multi-scale clustering methodology known as “data cloud geometry” to extract functional connectivity patterns derived from functional magnetic resonance imaging (fMRI) protocol. The method was applied to correlation matrices of 106 regions of interest (ROIs) in 29 individuals with autism spectrum disorders (ASD), and 29 individuals with typical development (TD) while they completed a cognitive control task. Connectivity clustering geometry was examined at both “fine” and “coarse” scales. At the coarse scale, the connectivity clustering geometry produced 10 valid clusters with a coherent relationship to neural anatomy. A supervised learning algorithm employed fine scale information about clustering motif configurations and prevalence, and coarse scale information about intra- and inter-regional connectivity; the algorithm correctly classified ASD and TD participants with sensitivity of and specificity of . Most of the predictive power of the logistic regression model resided at the level of the fine-scale clustering geometry, suggesting that cellular versus systems level disturbances are more prominent in individuals with ASD. This article provides validation for this multi-scale geometric approach to extracting brain functional connectivity pattern information and for its use in classification of ASD.     

FMRI Effective Connectivity and TMS Chronometry: Complementary Accounts of Causality in the Visuospatial Judgment Network

Background

While traditionally quite distinct, functional neuroimaging (e.g. functional magnetic resonance imaging: fMRI) and functional interference techniques (e.g. transcranial magnetic stimulation: TMS) increasingly address similar questions of functional brain organization, including connectivity, interactions, and causality in the brain. Time-resolved TMS over multiple brain network nodes can elucidate the relative timings of functional relevance for behavior (“TMS chronometry”), while fMRI functional or effective connectivity (fMRI EC) can map task-specific interactions between brain regions based on the interrelation of measured signals. The current study empirically assessed the relation between these different methods.

Methodology/Principal Findings

One group of 15 participants took part in two experiments: one fMRI EC study, and one TMS chronometry study, both of which used an established cognitive paradigm involving one visuospatial judgment task and one color judgment control task. Granger causality mapping (GCM), a data-driven variant of fMRI EC analysis, revealed a frontal-to-parietal flow of information, from inferior/middle frontal gyrus (MFG) to posterior parietal cortex (PPC). FMRI EC-guided Neuronavigated TMS had behavioral effects when applied to both PPC and to MFG, but the temporal pattern of these effects was similar for both stimulation sites. At first glance, this would seem in contradiction to the fMRI EC results. However, we discuss how TMS chronometry and fMRI EC are conceptually different and show how they can be complementary and mutually constraining, rather than contradictory, on the basis of our data.

Conclusions/Significance

The findings that fMRI EC could successfully localize functionally relevant TMS target regions on the single subject level, and conversely, that TMS confirmed an fMRI EC identified functional network to be behaviorally relevant, have important methodological and theoretical implications. Our results, in combination with data from earlier studies by our group (Sack et al., 2007, Cerebral Cortex), lead to informed speculations on complex brain mechanisms, and TMS disruption thereof, underlying visuospatial judgment. This first in-depth empirical and conceptual comparison of fMRI EC and TMS chronometry thereby shows the complementary insights offered by the two methods.     

Dynamically Allocated Hub in Task-Evoked Network Predicts the Vulnerable Prefrontal Locus for Contextual Memory Retrieval in Macaques

Neuroimaging and neurophysiology have revealed that multiple areas in the prefrontal cortex (PFC) are activated in a specific memory task, but severity of impairment after PFC lesions is largely different depending on which activated area is damaged. The critical relationship between lesion sites and impairments has not yet been given a clear mechanistic explanation. Although recent works proposed that a whole-brain network contains hubs that play integrative roles in cortical information processing, this framework relying on an anatomy-based structural network cannot account for the vulnerable locus for a specific task, lesioning of which would bring impairment. Here, we hypothesized that (i) activated PFC areas dynamically form an ordered network centered at a task-specific “functional hub” and (ii) the lesion-effective site corresponds to the “functional hub,” but not to a task-invariant “structural hub.” To test these hypotheses, we conducted functional magnetic resonance imaging experiments in macaques performing a temporal contextual memory task. We found that the activated areas formed a hierarchical hub-centric network based on task-evoked directed connectivity, differently from the anatomical network reflecting axonal projection patterns. Using a novel simulated-lesion method based on support vector machine, we estimated severity of impairment after lesioning of each area, which accorded well with a known dissociation in contextual memory impairment in macaques (impairment after lesioning in area 9/46d, but not in area 8Ad). The predicted severity of impairment was proportional to the network “hubness” of the virtually lesioned area in the task-evoked directed connectivity network, rather than in the anatomical network known from tracer studies. Our results suggest that PFC areas dynamically and cooperatively shape a functional hub-centric network to reallocate the lesion-effective site depending on the cognitive processes, apart from static anatomical hubs. These findings will be a foundation for precise prediction of behavioral impacts of damage or surgical intervention in human brains.     

Modeling the Impact of Lesions in the Human Brain

Lesions of anatomical brain networks result in functional disturbances of brain systems and behavior which depend sensitively, often unpredictably, on the lesion site. The availability of whole-brain maps of structural connections within the human cerebrum and our increased understanding of the physiology and large-scale dynamics of cortical networks allow us to investigate the functional consequences of focal brain lesions in a computational model. We simulate the dynamic effects of lesions placed in different regions of the cerebral cortex by recording changes in the pattern of endogenous (“resting-state”) neural activity. We find that lesions produce specific patterns of altered functional connectivity among distant regions of cortex, often affecting both cortical hemispheres. The magnitude of these dynamic effects depends on the lesion location and is partly predicted by structural network properties of the lesion site. In the model, lesions along the cortical midline and in the vicinity of the temporo-parietal junction result in large and widely distributed changes in functional connectivity, while lesions of primary sensory or motor regions remain more localized. The model suggests that dynamic lesion effects can be predicted on the basis of specific network measures of structural brain networks and that these effects may be related to known behavioral and cognitive consequences of brain lesions.     

Cell groups reveal structure of stimulus space

An important task of the brain is to represent the outside world. It is unclear how the brain may do this, however, as it can only rely on neural responses and has no independent access to external stimuli in order to “decode” what those responses mean. We investigate what can be learned about a space of stimuli using only the action potentials (spikes) of cells with stereotyped—but unknown—receptive fields. Using hippocampal place cells as a model system, we show that one can (1) extract global features of the environment and (2) construct an accurate representation of space, up to an overall scale factor, that can be used to track the animal's position. Unlike previous approaches to reconstructing position from place cell activity, this information is derived without knowing place fields or any other functions relating neural responses to position. We find that simply knowing which groups of cells fire together reveals a surprising amount of structure in the underlying stimulus space; this may enable the brain to construct its own internal representations.     

Discrimination of Complex Human Behavior by Pigeons (Columba livia) and Humans

The cognitive and neural mechanisms for recognizing and categorizing behavior are not well understood in non-human animals. In the current experiments, pigeons and humans learned to categorize two non-repeating, complex human behaviors (“martial arts” vs. “Indian dance”). Using multiple video exemplars of a digital human model, pigeons discriminated these behaviors in a go/no-go task and humans in a choice task. Experiment 1 found that pigeons already experienced with discriminating the locomotive actions of digital animals acquired the discrimination more rapidly when action information was available than when only pose information was available. Experiments 2 and 3 found this same dynamic superiority effect with naïve pigeons and human participants. Both species used the same combination of immediately available static pose information and more slowly perceived dynamic action cues to discriminate the behavioral categories. Theories based on generalized visual mechanisms, as opposed to embodied, species-specific action networks, offer a parsimonious account of how these different animals recognize behavior across and within species.     

The Brain Ages Optimally to Model Its Environment: Evidence from Sensory Learning over the Adult Lifespan

The aging brain shows a progressive loss of neuropil, which is accompanied by subtle changes in neuronal plasticity, sensory learning and memory. Neurophysiologically, aging attenuates evoked responses—including the mismatch negativity (MMN). This is accompanied by a shift in cortical responsivity from sensory (posterior) regions to executive (anterior) regions, which has been interpreted as a compensatory response for cognitive decline. Theoretical neurobiology offers a simpler explanation for all of these effects—from a Bayesian perspective, as the brain is progressively optimized to model its world, its complexity will decrease. A corollary of this complexity reduction is an attenuation of Bayesian updating or sensory learning. Here we confirmed this hypothesis using magnetoencephalographic recordings of the mismatch negativity elicited in a large cohort of human subjects, in their third to ninth decade. Employing dynamic causal modeling to assay the synaptic mechanisms underlying these non-invasive recordings, we found a selective age-related attenuation of synaptic connectivity changes that underpin rapid sensory learning. In contrast, baseline synaptic connectivity strengths were consistently strong over the decades. Our findings suggest that the lifetime accrual of sensory experience optimizes functional brain architectures to enable efficient and generalizable predictions of the world.     

Development of Large-Scale Functional Brain Networks in Children

The ontogeny of large-scale functional organization of the human brain is not well understood. Here we use network analysis of intrinsic functional connectivity to characterize the organization of brain networks in 23 children (ages 7–9 y) and 22 young-adults (ages 19–22 y). Comparison of network properties, including path-length, clustering-coefficient, hierarchy, and regional connectivity, revealed that although children and young-adults' brains have similar “small-world” organization at the global level, they differ significantly in hierarchical organization and interregional connectivity. We found that subcortical areas were more strongly connected with primary sensory, association, and paralimbic areas in children, whereas young-adults showed stronger cortico-cortical connectivity between paralimbic, limbic, and association areas. Further, combined analysis of functional connectivity with wiring distance measures derived from white-matter fiber tracking revealed that the development of large-scale brain networks is characterized by weakening of short-range functional connectivity and strengthening of long-range functional connectivity. Importantly, our findings show that the dynamic process of over-connectivity followed by pruning, which rewires connectivity at the neuronal level, also operates at the systems level, helping to reconfigure and rebalance subcortical and paralimbic connectivity in the developing brain. Our study demonstrates the usefulness of network analysis of brain connectivity to elucidate key principles underlying functional brain maturation, paving the way for novel studies of disrupted brain connectivity in neurodevelopmental disorders such as autism.     

Examination of Cognitive Fatigue in Multiple Sclerosis using Functional Magnetic Resonance Imaging and Diffusion Tensor Imaging

The present study investigated the neural correlates of cognitive fatigue in Multiple Sclerosis (MS), looking specifically at the relationship between self-reported fatigue and objective measures of cognitive fatigue. In Experiment 1, functional magnetic resonance imaging (fMRI) was used to examine where in the brain BOLD activity covaried with “state” fatigue, assessed during performance of a task designed to induce cognitive fatigue while in the scanner. In Experiment 2, diffusion tensor imaging (DTI) was used to examine where in the brain white matter damage correlated with increased “trait” fatigue in individuals with MS, assessed by the Fatigue Severity Scale (FSS) completed outside the scanning session. During the cognitively fatiguing task, the MS group had increased brain activity associated with fatigue in the caudate as compared with HCs. DTI findings revealed that reduced fractional anisotropy in the anterior internal capsule was associated with increased self-reported fatigue on the FSS. Results are discussed in terms of identifying a “fatigue-network” in MS.     

Playing 20 Questions with the Mind: Collaborative Problem Solving by Humans Using a Brain-to-Brain Interface

We present, to our knowledge, the first demonstration that a non-invasive brain-to-brain interface (BBI) can be used to allow one human to guess what is on the mind of another human through an interactive question-and-answering paradigm similar to the “20 Questions” game. As in previous non-invasive BBI studies in humans, our interface uses electroencephalography (EEG) to detect specific patterns of brain activity from one participant (the “respondent”), and transcranial magnetic stimulation (TMS) to deliver functionally-relevant information to the brain of a second participant (the “inquirer”). Our results extend previous BBI research by (1) using stimulation of the visual cortex to convey visual stimuli that are privately experienced and consciously perceived by the inquirer; (2) exploiting real-time rather than off-line communication of information from one brain to another; and (3) employing an interactive task, in which the inquirer and respondent must exchange information bi-directionally to collaboratively solve the task. The results demonstrate that using the BBI, ten participants (five inquirer-respondent pairs) can successfully identify a “mystery item” using a true/false question-answering protocol similar to the “20 Questions” game, with high levels of accuracy that are significantly greater than a control condition in which participants were connected through a sham BBI.     

Ketamine Decreases Resting State Functional Network Connectivity in Healthy Subjects: Implications for Antidepressant Drug Action

Increasing preclinical and clinical evidence underscores the strong and rapid antidepressant properties of the glutamate-modulating NMDA receptor antagonist ketamine. Targeting the glutamatergic system might thus provide a novel molecular strategy for antidepressant treatment. Since glutamate is the most abundant and major excitatory neurotransmitter in the brain, pathophysiological changes in glutamatergic signaling are likely to affect neurobehavioral plasticity, information processing and large-scale changes in functional brain connectivity underlying certain symptoms of major depressive disorder. Using resting state functional magnetic resonance imaging (rsfMRI), the „dorsal nexus “(DN) was recently identified as a bilateral dorsal medial prefrontal cortex region showing dramatically increased depression-associated functional connectivity with large portions of a cognitive control network (CCN), the default mode network (DMN), and a rostral affective network (AN). Hence, Sheline and colleagues (2010) proposed that reducing increased connectivity of the DN might play a critical role in reducing depression symptomatology and thus represent a potential therapy target for affective disorders. Here, using a randomized, placebo-controlled, double-blind, crossover rsfMRI challenge in healthy subjects we demonstrate that ketamine decreases functional connectivity of the DMN to the DN and to the pregenual anterior cingulate (PACC) and medioprefrontal cortex (MPFC) via its representative hub, the posterior cingulate cortex (PCC). These findings in healthy subjects may serve as a model to elucidate potential biomechanisms that are addressed by successful treatment of major depression. This notion is further supported by the temporal overlap of our observation of subacute functional network modulation after 24 hours with the peak of efficacy following an intravenous ketamine administration in treatment-resistant depression.     

The Impact of Symbolic and Non-Symbolic Quantity on Spatial Learning

An implicit mapping of number to space via a “mental number line” occurs automatically in adulthood. Here, we systematically explore the influence of differing representations of quantity (no quantity, non-symbolic magnitudes, and symbolic numbers) and directional flow of stimuli (random flow, left-to-right, or right-to-left) on learning and attention via a match-to-sample working memory task. When recalling a cognitively demanding string of spatial locations, subjects performed best when information was presented right-to-left. When non-symbolic or symbolic numerical arrays were embedded in these spatial locations, and mental number line congruency prompted, this effect was attenuated and in some cases reversed. In particular, low-performing female participants who viewed increasing non-symbolic number arrays paired with the spatial locations exhibited better recall for left-to-right directional flow information relative to right-to-left, and better processing for the left side of space relative to the right side of space. The presence of symbolic number during spatial learning enhanced recall to a greater degree than non-symbolic number—especially for female participants, and especially when cognitive load is high—and this difference was independent of directional flow of information. We conclude that quantity representations have the potential to scaffold spatial memory, but this potential is subtle, and mediated by the nature of the quantity and the gender and performance level of the learner.