When encoding yields remembering: insights from event-related neuroimaging.

To understand human memory, it is important to determine why some experiences are remembered whereas others are forgotten. Until recently, insights into the neural bases of human memory encoding, the processes by which information is transformed into an enduring memory trace, have primarily been derived from neuropsychological studies of humans with select brain lesions. The advent of functional neuroimaging methods, such as positron emission tomography (PET) and functional magnetic resonance imaging (fMRI), has provided a new opportunity to gain additional understanding of how the brain supports memory formation. Importantly, the recent development of event-related fMRI methods now allows for examination of trial-by-trial differences in neural activity during encoding and of the consequences of these differences for later remembering. In this review, we consider the contributions of PET and fMRI studies to the understanding of memory encoding, placing a particular emphasis on recent event-related fMRI studies of the Dm effect: that is, differences in neural activity during encoding that are related to differences in subsequent memory. We then turn our attention to the rich literature on the Dm effect that has emerged from studies using event-related potentials (ERPs). It is hoped that the integration of findings from ERP studies, which offer higher temporal resolution, with those from event-related fMRI studies, which offer higher spatial resolution, will shed new light on when and why encoding yields subsequent remembering.     

Delayed striate cortical activation during spatial attention

Recordings of event-related potentials (ERPs) and event-related magnetic fields (ERMFs) were combined with functional magnetic resonance imaging (fMRI) to study visual cortical activity in humans during spatial attention. While subjects attended selectively to stimulus arrays in one visual field, fMRI revealed stimulus-related activations in the contralateral primary visual cortex and in multiple extrastriate areas. ERP and ERMF recordings showed that attention did not affect the initial evoked response at 60-90 ms poststimulus that was localized to primary cortex, but a similarly localized late response at 140-250 ms was enhanced to attended stimuli. These findings provide evidence that the primary visual cortex participates in the selective processing of attended stimuli by means of delayed feedback from higher visual-cortical areas.     

Functional neuroimaging

Functional neuroimaging represents an area of brain imaging that has undergone tremendous advancements in the last decade. It is now possible to design experiments that elucidate the functional interplay between brain regions that give rise to specific human cognitive processes. Positron emission tomography (PET) and functional magnetic resonance imaging (fMRI) form the core technologies that have allowed such studies. This article reviews the basis of these techniques, their strengths and limitations, the underlying neurophysiology, and the future of functional neuroimaging.     

形状识别的功能定位和时间过程:功能磁共振与脑电结合的研究

通过结合具有高空间分辨率的功能磁共振成像（fMRI）和具有高时间分辨率的128导脑电事件相关电位（ERP）两项技术,测量了视皮层腹侧区域对图形形状识别任务反应的空间定位和时间过程。fMRI的实验结果表明,图形的形状和觉引起了腹测GTi／GF皮层区域的兴奋。进一步,基于fMRI兴奋区域的种子偶极子模型拟合的的ERP动态定位分析的结果和自由运动的偶极子模型拟合的ERP定位分析结果表明：GTi／GF区域活动的时间发生在刺激呈现之后132－176ms时间段,峰值150ms左右,相应于ERP的N1成分。这些结果在人类大脑皮层上同时确定了视觉通路中涉及图形形状识别的兴奋区域和兴奋的时间过程。     

统计学习的认知机制及其神经基础

本文主要探讨了人类统计学习研究的起源和发展、影响统计学习的因素及统计学习的脑神经基础.人类统计学习的研究起源于20世纪90年代关于婴儿听觉语音流切分的实验,之后,大量研究又考察了对听觉非语言信息及视觉图形的统计学习.这些研究表明,统计学习是一种具有一般性的、涉及发现和提取规则的学习类型,但是不同范畴的统计学习又受到与特定范畴有关因素的制约.例如,语言统计学习受到语言因素的制约,而非语言统计学习与呈现刺激的特征以及呈现的通道有关.近些年,研究者开始采用事件相关电位(event-related potentials,ERPs)技术考察统计学习的时间进程,以及采用功能核磁共振成像(functional magnetic resonance imaging,fMRI)技术考察统计学习的脑激活模式.ERPs研究较一致地发现400 ms左右产生的负波与统计信息的提取有关,而脑成像研究结果表明,与统计学习相关的脑区有大脑左侧颞上回(superiortemporal gyrus)、右侧纹状体(right striatum)和右侧颞叶内侧记忆系统(right medial temporal memory system).     

Hilbert phase entropy imaging of fMRI time series

Functional magnetic resonance imaging (fMRI) data-processing methods in the time domain include correlation analysis and the general linear model, among others. Virtually, many fMRI processing strategies utilise temporal information and ignore or pay little attention to phase information, resulting in an unnecessary loss of efficiency. We proposed a novel method named Hilbert phase entropy imaging (HPEI) that used the discrete Hilbert transform of the magnitude time series to detect brain functional activation. The data from two simulation studies and two in vivo fMRI studies that both contained block-design and event-related experiments revealed that the HPEI method enabled the effective detection of brain functional activation and the distinction of different response patterns. Our results demonstrate that this method is useful as a complementary analysis, but hypothesis-constrained, in revealing additional information regarding the complex nature of fMRI time series.     

Functional imaging of numerical processing in adults and 4-y-old children

Adult humans, infants, pre-school children, and non-human animals appear to share a system of approximate numerical processing for non-symbolic stimuli such as arrays of dots or sequences of tones. Behavioral studies of adult humans implicate a link between these non-symbolic numerical abilities and symbolic numerical processing (e.g., similar distance effects in accuracy and reaction-time for arrays of dots and Arabic numerals). However, neuroimaging studies have remained inconclusive on the neural basis of this link. The intraparietal sulcus (IPS) is known to respond selectively to symbolic numerical stimuli such as Arabic numerals. Recent studies, however, have arrived at conflicting conclusions regarding the role of the IPS in processing non-symbolic, numerosity arrays in adulthood, and very little is known about the brain basis of numerical processing early in development. Addressing the question of whether there is an early-developing neural basis for abstract numerical processing is essential for understanding the cognitive origins of our uniquely human capacity for math and science. Using functional magnetic resonance imaging (fMRI) at 4-Tesla and an event-related fMRI adaptation paradigm, we found that adults showed a greater IPS response to visual arrays that deviated from standard stimuli in their number of elements, than to stimuli that deviated in local element shape. These results support previous claims that there is a neurophysiological link between non-symbolic and symbolic numerical processing in adulthood. In parallel, we tested 4-y-old children with the same fMRI adaptation paradigm as adults to determine whether the neural locus of non-symbolic numerical activity in adults shows continuity in function over development. We found that the IPS responded to numerical deviants similarly in 4-y-old children and adults. To our knowledge, this is the first evidence that the neural locus of adult numerical cognition takes form early in development, prior to sophisticated symbolic numerical experience. More broadly, this is also, to our knowledge, the first cognitive fMRI study to test healthy children as young as 4 y, providing new insights into the neurophysiology of human cognitive development.     

Functional imaging of memory processes in humans: positron emission tomography and functional magnetic resonance imaging

Human memory is not a unitary function; it consists of multiple memory systems, with different characteristics and specialisations that are implemented in the brain. The cognitive neuroscience of human memory tries to comprehend how we encode, store, and retrieve memory items within and across those systems. The emergence of functional neuroimaging techniques offered the unprecedented opportunity to directly observe the brain regions engaged in memory functions. Brain imaging techniques can roughly be divided into those measuring the electric or magnetic fields generated by neuronal activity (EEG, magnetencephalography [MEG]) and those measuring the haemodynamic or metabolic sequelae of neuronal activity (positron emission tomography [PET], functional magnetic resonance imaging [fMRI]). Out of these techniques, the following two will be discussed in detail: fMRI and PET. Although functional neuroimaging is able to acquire images of the brain engaged in consolidating or retrieving memories, these processes are not clearly visible in the data. Statistical techniques are needed to reduce the complexity of the data and to extract the processes of interest. This article outlines the experimental and analytical procedures of neuroimaging studies with PET and fMRI. We will use a PET-study on episodic memory in human volunteers to illustrate design, analysis, and interpretation of functional imaging studies on memory.     

Temporal difference models and reward-related learning in the human brain

Temporal difference learning has been proposed as a model for Pavlovian conditioning, in which an animal learns to predict delivery of reward following presentation of a conditioned stimulus (CS). A key component of this model is a prediction error signal, which, before learning, responds at the time of presentation of reward but, after learning, shifts its response to the time of onset of the CS. In order to test for regions manifesting this signal profile, subjects were scanned using event-related fMRI while undergoing appetitive conditioning with a pleasant taste reward. Regression analyses revealed that responses in ventral striatum and orbitofrontal cortex were significantly correlated with this error signal, suggesting that, during appetitive conditioning, computations described by temporal difference learning are expressed in the human brain.     

Motor Training Increases the Stability of Activation Patterns in the Primary Motor Cortex

Learning to be skillful is an endowed talent of humans, but neural mechanisms underlying behavioral improvement remain largely unknown. Some studies have reported that the mean magnitude of neural activation is increased after learning, whereas others have instead shown decreased activation. In this study, we used functional magnetic resonance imaging (fMRI) to investigate learning-induced changes in the neural activation in the human brain with a classic motor training task. Specifically, instead of comparing the mean magnitudes of activation before and after training, we analyzed the learning-induced changes in multi-voxel spatial patterns of neural activation. We observed that the stability of the activation patterns, or the similarity of the activation patterns between the even and odd runs of the fMRI scans, was significantly increased in the primary motor cortex (M1) after training. By contrast, the mean magnitude of neural activation remained unchanged. Therefore, our study suggests that learning shapes the brain by increasing the stability of the activation patterns, therefore providing a new perspective in understanding the neural mechanisms underlying learning.     

Timing and sequence of brain activity in top-down control of visual-spatial attention

Recent brain imaging studies using functional magnetic resonance imaging (fMRI) have implicated a frontal-parietal network in the top-down control of attention. However, little is known about the timing and sequence of activations within this network. To investigate these timing questions, we used event-related electrical brain potentials (ERPs) and a specially designed visual-spatial attentional-cueing paradigm, which were applied as part of a multi-methodological approach that included a closely corresponding event-related fMRI study using an identical paradigm. In the first 400 ms post cue, attention-directing and control cues elicited similar general cue-processing activity, corresponding to the more lateral subregions of the frontal-parietal network identified with the fMRI. Following this, the attention-directing cues elicited a sustained negative-polarity brain wave that was absent for control cues. This activity could be linked to the more medial frontal–parietal subregions similarly identified in the fMRI as specifically involved in attentional orienting. Critically, both the scalp ERPs and the fMRI-seeded source modeling for this orienting-related activity indicated an earlier onset of frontal versus parietal contribution (∼400 versus ∼700 ms). This was then followed (∼800–900 ms) by pretarget biasing activity in the region-specific visual-sensory occipital cortex. These results indicate an activation sequence of key components of the attentional-control brain network, providing insight into their functional roles. More specifically, these results suggest that voluntary attentional orienting is initiated by medial portions of frontal cortex, which then recruit medial parietal areas. Together, these areas then implement biasing of region-specific visual-sensory cortex to facilitate the processing of upcoming visual stimuli.     

Simultaneous PET-MRI: a new approach for functional and morphological imaging

Noninvasive imaging at the molecular level is an emerging field in biomedical research. This paper introduces a new technology synergizing two leading imaging methodologies: positron emission tomography (PET) and magnetic resonance imaging (MRI). Although the value of PET lies in its high-sensitivity tracking of biomarkers in vivo, it lacks resolving morphology. MRI has lower sensitivity, but produces high soft-tissue contrast and provides spectroscopic information and functional MRI (fMRI). We have developed a three-dimensional animal PET scanner that is built into a 7-T MRI. Our evaluations show that both modalities preserve their functionality, even when operated isochronously. With this combined imaging system, we simultaneously acquired functional and morphological PET-MRI data from living mice. PET-MRI provides a powerful tool for studying biology and pathology in preclinical research and has great potential for clinical applications. Combining fMRI and spectroscopy with PET paves the way for a new perspective in molecular imaging.     

Cholinergic modulation of experience-dependent plasticity in human auditory cortex

The factors that influence experience-dependent plasticity in the human brain are unknown. We used event-related functional magnetic resonance imaging (fMRI) and a pharmacological manipulation to measure cholinergic modulation of experience-dependent plasticity in human auditory cortex. In a differential aversive conditioning paradigm, subjects were presented with high (1600 Hz) and low tones (400 Hz), one of which was conditioned by pairing with an electrical shock. Prior to presentation, subjects were given either a placebo or an anticholinergic drug (0.4 mg iv scopolamine). Experience-dependent plasticity, expressed as a conditioning-specific enhanced BOLD response, was evident in auditory cortex in the placebo group, but not with scopolamine. This study provides in vivo evidence that experience-dependent plasticity, evident in hemodynamic changes in human auditory cortex, is modulated by acetylcholine.     

Insect olfactory memory in time and space

Recent studies using functional optical imaging have revealed that cellular memory traces form in different areas of the insect brain after olfactory classical conditioning. These traces are revealed as increased calcium signals or synaptic release from defined neurons, and include a short-lived trace that forms immediately after conditioning in antennal lobe projection neurons, an early trace in dopaminergic neurons, and a medium-term trace in dorsal paired medial neurons. New molecular genetic tools have revealed that for normal behavioral memory performance, synaptic transmission from the mushroom body neurons is required only during retrieval, whereas synaptic transmission from dopaminergic neurons is required at the time of acquisition and synaptic transmission from dorsal paired medial neurons is required during the consolidation period. Such experimental results are helping to identify the types of neurons that participate in olfactory learning and when their participation is required. Olfactory learning often occurs alongside crossmodal interactions of sensory information from other modalities. Recent studies have revealed complex interactions between the olfactory and the visual senses that can occur during olfactory learning, including the facilitation of learning about subthreshold olfactory stimuli due to training with concurrent visual stimuli.     

Investigating the Neural Mechanisms of Aware and Unaware Fear Memory with fMRI

Pavlovian fear conditioning is often used in combination with functional magnetic resonance imaging (fMRI) in humans to investigate the neural substrates of associative learning ^1-5. In these studies, it is important to provide behavioral evidence of conditioning to verify that differences in brain activity are learning-related and correlated with human behavior. Fear conditioning studies often monitor autonomic responses (e.g. skin conductance response; SCR) as an index of learning and memory ^6-8. In addition, other behavioral measures can provide valuable information about the learning process and/or other cognitive functions that influence conditioning. For example, the impact unconditioned stimulus (UCS) expectancies have on the expression of the conditioned response (CR) and unconditioned response (UCR) has been a topic of interest in several recent studies ^9-14. SCR and UCS expectancy measures have recently been used in conjunction with fMRI to investigate the neural substrates of aware and unaware fear learning and memory processes ¹⁵. Although these cognitive processes can be evaluated to some degree following the conditioning session, post-conditioning assessments cannot measure expectations on a trial-to-trial basis and are susceptible to interference and forgetting, as well as other factors that may distort results ^16,17 .Monitoring autonomic and behavioral responses simultaneously with fMRI provides a mechanism by which the neural substrates that mediate complex relationships between cognitive processes and behavioral/autonomic responses can be assessed. However, monitoring autonomic and behavioral responses in the MRI environment poses a number of practical problems. Specifically, 1) standard behavioral and physiological monitoring equipment is constructed of ferrous material that cannot be safely used near the MRI scanner, 2) when this equipment is placed outside of the MRI scanning chamber, the cables projecting to the subject can carry RF noise that produces artifacts in brain images, 3) artifacts can be produced within the skin conductance signal by switching gradients during scanning, 4) the fMRI signal produced by the motor demands of behavioral responses may need to be distinguished from activity related to the cognitive processes of interest. Each of these issues can be resolved with modifications to the setup of physiological monitoring equipment and additional data analysis procedures. Here we present a methodology to simultaneously monitor autonomic and behavioral responses during fMRI, and demonstrate the use of these methods to investigate aware and unaware memory processes during fear conditioning. Download video file.^{(83M, mov)}     

Conserved fMRI and LFP signals during new associative learning in the human and macaque monkey medial temporal lobe

We measured local field potential (LFP) and blood-oxygen-level-dependent (BOLD) functional magnetic resonance imaging (fMRI) in the medial temporal lobes of monkeys and humans, respectively, as they performed the same conditional motor associative learning task. Parallel analyses were used to examine both data sets. Despite significantly faster learning in humans relative to monkeys, we found equivalent neural signals differentiating new versus highly familiar stimuli, first stimulus presentation, trial outcome, and learning strength in the entorhinal cortex and hippocampus of both species. Thus, the use of parallel behavioral tasks and analyses in monkeys and humans revealed conserved patterns of neural activity across the medial temporal lobe during an associative learning task.     

Neural substrates of intermanual transfer of a newly acquired motor skill

In healthy humans, the two cerebral hemispheres show functional specialization to a degree unmatched in other animals, and such strong hemispheric specialization contributes to unimanual skill acquisition [1, 2]. When most humans learn a new motor skill with one hand, this process results in performance improvements in the opposite hand as well [3-6]. Despite the obvious adaptive advantage of such intermanual transfer, there is no direct evidence identifying the neural substrates of this form of skill acquisition [7-9]. Here, we used functional magnetic resonance imaging (fMRI) to study brain regions activated during intermanual transfer of a learned sequence of finger movements. First, we found that the supplementary motor area (SMA) has more activity when a skill has transferred well than when it has transferred poorly. Second, we found that fMRI activity in the ventrolateral posterior thalamic nucleus correlated with successful future intermanual transfer, whereas activity in the ventrolateral anterior thalamic nucleus correlated with past intermanual transfer. Third, we found that repetitive transcranial magnetic stimulation applied over the SMA blocked intermanual transfer without affecting skill acquisition. These findings provide direct evidence for an SMA-based mechanism that supports intermanual transfer of motor-skill learning.     

The influence of serotonin on fear learning

Learning of associations between aversive stimuli and predictive cues is the basis of Pavlovian fear conditioning and is driven by a mismatch between expectation and outcome. To investigate whether serotonin modulates the formation of such aversive cue-outcome associations, we used functional magnetic resonance imaging (fMRI) and dietary tryptophan depletion to reduce brain serotonin (5-HT) levels in healthy human subjects. In a Pavlovian fear conditioning paradigm, 5-HT depleted subjects compared to a non-depleted control group exhibited attenuated autonomic responses to cues indicating the upcoming of an aversive event. These results were closely paralleled by reduced aversive learning signals in the amygdala and the orbitofrontal cortex, two prominent structures of the neural fear circuit. In agreement with current theories of serotonin as a motivational opponent system to dopamine in fear learning, our data provide first empirical evidence for a role of serotonin in representing formally derived learning signals for aversive events.     

Absolute coding of stimulus novelty in the human substantia nigra/VTA

Novelty exploration can enhance hippocampal plasticity in animals through dopaminergic neuromodulation arising in the substantia nigra/ventral tegmental area (SN/VTA). This enhancement can outlast the exploration phase by several minutes. Currently, little is known about dopaminergic novelty processing and its relationship to hippocampal function in humans. In two functional magnetic resonance imaging (fMRI) studies, SN/VTA activations in humans were indeed driven by stimulus novelty rather than other forms of stimulus salience such as rareness, negative emotional valence, or targetness of familiar stimuli, whereas hippocampal responses were less selective. SN/VTA novelty responses were scaled according to absolute rather than relative novelty in a given context, unlike adaptive SN/VTA responses recently reported for reward outcome in animal studies. Finally, novelty enhanced learning and perirhinal/parahippocampal processing of familiar items presented in the same context. Thus, the human SN/VTA can code absolute stimulus novelty and might contribute to enhancing learning in the context of novelty.     

Self-regulation of local brain activity using real-time functional magnetic resonance imaging (fMRI)

Functional magnetic resonance imaging (fMRI) measures the blood oxygen level-dependent (BOLD) signal related to neuronal activity. So far, this technique has been limited by time-consuming data analysis impeding on-line analysis. In particular, no brain-computer interface (BCI) was available which provided on-line feedback to learn physiological self-regulation of the BOLD signal. Recently, studies have shown that fMRI feedback is feasible and facilitates voluntary control of brain activity. Here we review these studies to make the fMRI feedback methodology accessible to a broader scientific community such as researchers concerned with functional brain imaging and the neurobiology of learning. Methodological and conceptual limitations were substantially reduced by artefact control, sensitivity improvements, real-time algorithms, and adapted experimental designs. Physiological self-regulation of the local BOLD response is a new paradigm for cognitive neuroscience to study brain plasticity and the functional relevance of regulated brain areas by modification of behaviour. Voluntary control of abnormal activity in circumscribed brain areas may even be applied as psychophysiological treatment.