Effective visual working memory capacity: an emergent effect from the neural dynamics in an attractor network

The study of working memory capacity is of outmost importance in cognitive psychology as working memory is at the basis of general cognitive function. Although the working memory capacity limit has been thoroughly studied, its origin still remains a matter of strong debate. Only recently has the role of visual saliency in modulating working memory storage capacity been assessed experimentally and proved to provide valuable insights into working memory function. In the computational arena, attractor networks have successfully accounted for psychophysical and neurophysiological data in numerous working memory tasks given their ability to produce a sustained elevated firing rate during a delay period. Here we investigate the mechanisms underlying working memory capacity by means of a biophysically-realistic attractor network with spiking neurons while accounting for two recent experimental observations: 1) the presence of a visually salient item reduces the number of items that can be held in working memory, and 2) visually salient items are commonly kept in memory at the cost of not keeping as many non-salient items.OUR MODEL SUGGESTS THAT WORKING MEMORY CAPACITY IS DETERMINED BY TWO FUNDAMENTAL PROCESSES: encoding of visual items into working memory and maintenance of the encoded items upon their removal from the visual display. While maintenance critically depends on the constraints that lateral inhibition imposes to the mnemonic activity, encoding is limited by the ability of the stimulated neural assemblies to reach a sufficiently high level of excitation, a process governed by the dynamics of competition and cooperation among neuronal pools. Encoding is therefore contingent upon the visual working memory task and has led us to introduce the concept of effective working memory capacity (eWMC) in contrast to the maximal upper capacity limit only reached under ideal conditions.     

When more means less: neural activity related to unsuccessful memory encoding

The neural correlates of memory encoding have been studied by contrasting neural activity elicited by items at the time of learning according to whether they were later remembered or forgotten [1]. Previous studies have focused on regions where neural activity is greater for subsequently remembered items [2-8]. Here, we describe regions where activity is greater for subsequently forgotten items. In two experiments that employed the same incidental learning task, activity in an overlapping set of cortical regions (posterior cingulate, inferior and medial parietal, and dorsolateral prefrontal) was associated with failure on a subsequent memory test.     

Parallel processing of appetitive short- and long-term memories in Drosophila

It is broadly accepted that long-term memory (LTM) is formed sequentially after learning and short-term memory (STM) formation, but the nature of the relationship between early and late memory traces remains heavily debated [1-5]. To shed light on this issue, we used an olfactory appetitive conditioning in Drosophila, wherein starved flies learned to associate an odor with the presence of sugar [6]. We took advantage of the fact that both STM and LTM are generated after a unique conditioning cycle [7, 8] to demonstrate that appetitive LTM is able to form independently of STM. More specifically, we show that (1) STM retrieval involves output from γ neurons of the mushroom body (MB), i.e., the olfactory memory center [9, 10], whereas LTM retrieval involves output from αβ MB neurons; (2) STM information is not transferred from γ neurons to αβ neurons for LTM formation; and (3) the adenylyl cyclase RUT, which is thought to operate as a coincidence detector between the olfactory stimulus and the sugar stimulus [11-14], is required independently in γ neurons to form appetitive STM and in αβ neurons to form LTM. Taken together, these results demonstrate that appetitive short- and long-term memories are formed and processed in parallel.     

Preservation of musical memory in an amnesic professional cellist

Learning and memory of music involves a multitude of perceptual, motor, affective, and autobiographical memory processes [1]. Patient and imaging studies suggest that musical memory may involve distinct neural substrates [2,3]. However, the degree of independence of such a system from other memory domains is controversial [4]. We have investigated a 68-year-old professional cellist, patient PM, who developed severe amnesia following encephalitis. This case provided a unique opportunity to study musical memory in a patient with a precisely defined premorbid musical knowledge and well-demarcated focal lesions of the brain. Despite severe memory impairments, he performed like healthy musicians in various tests of recognition memory for music. These findings suggest that learning and retention of musical information depends on brain networks distinct from those involved in other types of episodic and semantic memory.     

Refixation frequency and memory mechanisms in visual search

Visual search-looking for a target object in the presence of a number of distractor items-is an everyday activity for humans (for example, finding the car in a busy car park) and animals (for example, foraging for food). Our understanding of visual search has been enriched by an interdisciplinary effort using a wide range of research techniques including behavioural studies in humans [1], single-cell electrophysiology [2], transcranial magnetic stimulation [3], event-related potentials [4] and studies of patients with focal brain injury [5]. A central question is what kind of information controls the search process. Visual search is typically accompanied by a series of eye movements, and investigating the nature and location of fixations helps to identify the kind of information that might control the search process. It has already been demonstrated that objects are fixated if they are visually similar to the target [6]. Also, if an item has been fixated, it is less likely to be returned to on the subsequent saccade. This automatic process is referred to as inhibition of return (IOR [7,8]). Here, we investigated the role of memory for which items had been fixated previously. We found that, during search, subjects often refixated items that had been previously fixated. Although there were fewer return saccades than would be expected by chance, the number of refixations indicated limited functional memory, indeed the memory effects that were present may primarily be a result of IOR.     

Neural repetition effects in the medial temporal lobe complex are modulated by previous encoding experience

It remains an intriguing question why the medial temporal lobe (MTL) can display either attenuation or enhancement of neural activity following repetition of previously studied items. To isolate the role of encoding experience itself, we assessed neural repetition effects in the absence of any ongoing task demand or intentional orientation to retrieve. Experiment 1 showed that the hippocampus and surrounding MTL regions displayed neural repetition suppression (RS) upon repetition of past items that were merely attended during an earlier study phase but this was not the case following re-occurrence of items that had been encoded into working memory (WM). In this latter case a trend toward neural repetition enhancement (RE) was observed, though this was highly variable across individuals. Interestingly, participants with a higher degree of neural RE in the MTL complex displayed higher memory sensitivity in a later, surprise recognition test. Experiment 2 showed that massive exposure at encoding effected a change in the neural architecture supporting incidental repetition effects, with regions of the posterior parietal and ventral-frontal cortex in addition to the hippocampus displaying neural RE, while no neural RS was observed. The nature of encoding experience therefore modulates the expression of neural repetition effects in the MTL and the neocortex in the absence of memory goals.     

Exact neural mass model for synaptic-based working memory

A synaptic theory of Working Memory (WM) has been developed in the last decade as a possible alternative to the persistent spiking paradigm. In this context, we have developed a neural mass model able to reproduce exactly the dynamics of heterogeneous spiking neural networks encompassing realistic cellular mechanisms for short-term synaptic plasticity. This population model reproduces the macroscopic dynamics of the network in terms of the firing rate and the mean membrane potential. The latter quantity allows us to gain insight of the Local Field Potential and electroencephalographic signals measured during WM tasks to characterize the brain activity. More specifically synaptic facilitation and depression integrate each other to efficiently mimic WM operations via either synaptic reactivation or persistent activity. Memory access and loading are related to stimulus-locked transient oscillations followed by a steady-state activity in the β-γ band, thus resembling what is observed in the cortex during vibrotactile stimuli in humans and object recognition in monkeys. Memory juggling and competition emerge already by loading only two items. However more items can be stored in WM by considering neural architectures composed of multiple excitatory populations and a common inhibitory pool. Memory capacity depends strongly on the presentation rate of the items and it maximizes for an optimal frequency range. In particular we provide an analytic expression for the maximal memory capacity. Furthermore, the mean membrane potential turns out to be a suitable proxy to measure the memory load, analogously to event driven potentials in experiments on humans. Finally we show that the γ power increases with the number of loaded items, as reported in many experiments, while θ and β power reveal non monotonic behaviours. In particular, β and γ rhythms are crucially sustained by the inhibitory activity, while the θ rhythm is controlled by excitatory synapses.     

Recognition memory and the human hippocampus

The capacity for declarative memory depends on the hippocampal region and adjacent cortex within the medial temporal lobe. One of the most widely studied examples of declarative memory is the capacity to recognize recently encountered material as familiar, but uncertainty remains about whether intact recognition memory depends on the hippocampal region itself and, if so, what the nature of the hippocampal contribution might be. Seven patients with bilateral damage thought to be limited primarily to the hippocampal region were impaired on three standard tests of recognition memory. In addition, the patients were impaired to a similar extent at Remembering and Knowing, measures of the two processes thought to support recognition performance: the ability to remember the learning episode (episodic recollection) and the capacity for judging items as familiar (familiarity).     

具有竞争指针的短时记忆神经网络模型

在我们以前提出的短时记忆神经网络模型基础上［３］,我们在新模型中引入突触竞争机制,提出了一个新的短时记忆神经网络模型。模型仍由两个神经网络所组成;其一为与长时记忆共有的信息内容表达网络,另一个为指针神经元环路。由于表达区神经元与指针神经元间的突触权重的竞争,使得模型可以表现出由干扰引起的短时记忆的遗忘。相应于自由回忆序列位置效应和汉字组块两个心理学实验,对模型做了计算机仿真。仿真结果显示模型的行为与两个心理实验定量地符合得很好。由此表明现在的模型更合适于作为短时记忆的模型。     

短时记忆的神经网络模型

提出一个带有指针环路的短时记忆神经网络模型,模型包含两个神经网络,其中一个是与长时记忆共有的存贮内容表达网络,另一个为短时指针神经元环路,由于指针环路仅作为记忆内容的临时指针,因此,仅用很少的存贮单元即可完成各种短时记忆任务,计算机仿真证明,本模型确能表现出短时记忆的存贮容量有限和组块编码两个基本特征。     

Social Facilitation of Long-Lasting Memory Retrieval in Drosophila

Recent studies demonstrate that social interactions can have a profound influence on Drosophila melanogaster behavior [1], [2], [3], [4], [5], [6], [7] and [8] and cuticular pheromone patterns [8], [9] and [10]. Olfactory memory performance has mostly been investigated in groups, and previous studies have reported that grouped flies do not interact with each other and behave in the same way as individual flies during short-term memory retrieval [11], [12] and [13]. However, the influence of social effects on the two known forms of Drosophila long-lasting associative memory, anesthesia-resistant memory (ARM) and long-term memory (LTM), has never been reported. We show here that ARM is displayed by individual flies but is socially facilitated; flies trained for ARM interact within a group to improve their conditioned performance. In contrast, testing shows LTM improvement in individual flies rather than in a group. We show that the social facilitation of ARM during group testing is independent of the social context of training and does not involve nonspecific aggregation. Furthermore, we demonstrate that social interactions facilitate ARM retrieval. We also show that social interactions necessary for this facilitation are specifically generated by trained flies: when single flies trained for ARM are mixed with groups of naive flies, they display poor retrieval, whereas mixing with groups trained either for ARM or LTM enhances performance.     

Spontaneous behavior of a rhesus monkey (Macaca mulatta) during memory tests suggests memory awareness

Humans can predict with some accuracy whether or not they know the correct answer to a question before responding. In some cases the capacity to make such predictions depends on memory awareness, the ability to introspectively discriminate between knowing and not knowing. In this unplanned retrospective analysis of video taped behavior we asked whether a rhesus monkey's apparent frustration predicted his accuracy in a matching-to-sample task on a trial-by-trial basis. The monkey was likely to aggressively strike the computer touchscreen when committing errors, whereas he generally touched the screen more gently when selecting the correct stimulus. This difference in behavior, which occurred before the monkey received feedback on the accuracy of his choice, suggests that he knew whether or not he remembered the correct response.     

The evolutionary origins of human patience: temporal preferences in chimpanzees, bonobos, and human adults

To make adaptive choices, individuals must sometimes exhibit patience, forgoing immediate benefits to acquire more valuable future rewards [1-3]. Although humans account for future consequences when making temporal decisions [4], many animal species wait only a few seconds for delayed benefits [5-10]. Current research thus suggests a phylogenetic gap between patient humans and impulsive, present-oriented animals [9, 11], a distinction with implications for our understanding of economic decision making [12] and the origins of human cooperation [13]. On the basis of a series of experimental results, we reject this conclusion. First, bonobos (Pan paniscus) and chimpanzees (Pan troglodytes) exhibit a degree of patience not seen in other animals tested thus far. Second, humans are less willing to wait for food rewards than are chimpanzees. Third, humans are more willing to wait for monetary rewards than for food, and show the highest degree of patience only in response to decisions about money involving low opportunity costs. These findings suggest that core components of the capacity for future-oriented decisions evolved before the human lineage diverged from apes. Moreover, the different levels of patience that humans exhibit might be driven by fundamental differences in the mechanisms representing biological versus abstract rewards.     

Recruitment of unique neural systems to support visual memory in normal aging.

The performance of many cognitive tasks changes in normal aging [1] [2] [3]. Recent behavioral work has identified some tasks that seem to be performed in an age-invariant manner [4]. To understand the brain mechanisms responsible for this, we combined psychophysical measurements of visual short-term memory with positron emission tomography (PET) in young and old individuals. Participants judged the differences between two visual stimuli, and the memory load was manipulated by interposing a delay between the two stimuli. Both age groups performed the task equally well, but the neural systems supporting performance differed between young and old individuals. Although there was some overlap in the brain regions supporting performance (for example, occipital, temporal and inferior prefrontal cortices, and caudate), the functional interconnections between these common regions were much weaker in old participants. This suggests that the regions were not operating effectively as a network in old individuals. Old participants recruited unique areas, however, including medial temporal and dorsolateral prefrontal cortices. These unique areas were strongly interactive and their activity was related to performance only in old participants. Therefore, these areas may have acted to compensate for reduced interactions between the other brain areas.     

Practicing coarse orientation discrimination improves orientation signals in macaque cortical area v4

Practice improves the performance in visual tasks, but mechanisms underlying this adult brain plasticity are unclear. Single-cell studies reported no [1], weak [2], or moderate [3, 4] perceptual learning-related changes in macaque visual areas V1 and V4, whereas none were found in middle temporal (MT) [5]. These conflicting results and modeling of human (e.g., [6, 7]) and monkey data [8] suggested that changes in the readout of visual cortical signals underlie perceptual learning, rather than changes in these signals. In the V4 learning studies, monkeys discriminated small differences in orientation, whereas in the MT study, the animals discriminated opponent motion directions. Analogous to the latter study, we trained monkeys to discriminate static orthogonal orientations masked by noise. V4 neurons showed robust increases in their capacity to discriminate the trained orientations during the course of the training. This effect was observed during discrimination and passive fixation but specifically for the trained orientations. The improvement in neural discrimination was due to decreased response variability and an increase of the difference between the mean responses for the two trained orientations. These findings demonstrate that perceptual learning in a coarse discrimination task indeed can change the response properties of a cortical sensory area.     

A visual sense of number

Evidence exists for a nonverbal capacity for the apprehension of number, in humans [1] (including infants [2, 3]) and in other primates [4-6]. Here, we show that perceived numerosity is susceptible to adaptation, like primary visual properties of a scene, such as color, contrast, size, and speed. Apparent numerosity was decreased by adaptation to large numbers of dots and increased by adaptation to small numbers, the effect depending entirely on the numerosity of the adaptor, not on contrast, size, orientation, or pixel density, and occurring with very low adaptor contrasts. We suggest that the visual system has the capacity to estimate numerosity and that it is an independent primary visual property, not reducible to others like spatial frequency or density of texture [7].     

Hippocampal-prefrontal connectivity predicts midfrontal oscillations and long-term memory performance

The hippocampus and prefrontal cortex interact to support working memory (WM) and long-term memory [1-3]. Neurophysiologically, WM is thought to be subserved by reverberatory activity of distributed networks within the prefrontal cortex (PFC) [2, 4-8], which become synchronized with reverberatory activity in the hippocampus [1, 4]. This electrophysiological synchronization is difficult to study in humans because noninvasive electroencephalography (EEG) cannot measure hippocampus activity. Here, using a novel integration of EEG and diffusion-weighted imaging, it is shown that individuals with relatively stronger anatomical connectivity linking the hippocampus to the right ventrolateral PFC (ventral Brodmann area 46) exhibited slower frequency neuronal oscillations during a WM task. Furthermore, subjects with stronger hippocampus-PFC connectivity were better able to encode the complex pictures used in the WM task into long-term memory. These findings are consistent with models suggesting that electrophysiological oscillations provide a mechanism of long-range interactions [9] and link hippocampus-PFC structural connectivity to PFC rhythmic electrical dynamics and memory performance. More generally, these results highlight the importance of incorporating individual differences when linking structure and function to cognition.     

Early Activation of Extracellular Signal-Regulated Kinase Signaling Pathway in the Hippocampus is Required for Short-Term Memory Formation of a Fear-Motivated Learning

1. According to its duration there are, at least, two major forms of memory in mammals: short term memory (STM) which develops in a few seconds and lasts several hours and long-term memory (LTM) lasting days, weeks and even a lifetime. In contrast to LTM, very little is known about the neural, cellular and molecular requirements for mammalian STM formation.2. Here we show that early activation of extracellular signal-regulated kinases 1/2 (ERK1/2) in the hippocampus is required for the establishment of STM for a one-trial inhibitory avoidance task in the rat. Immediate posttraining infusion of U0126 (a selective inhibitor of ERK kinase) into the CA1 region of the dorsal hippocampus blocked STM formation.3. Reversible inactivation of the entorhinal cortex through muscimol infusion produced deficits in STM and a selective and rapid decrease in hippocampal ERK2 activation.4. Together with our previous findings showing a rapid decrease in ERK2 activation and impaired STM after blocking BDNF function, the present results strongly suggest that ERK2 signaling in the hippocampus is a critical step in STM processing.Lionel Muller Igaz and Milena Winograd contributed equally to this work     

fMRI adaptation reveals mirror neurons in human inferior parietal cortex

Mirror neurons, as originally described in the macaque, have two defining properties [1, 2]: They respond specifically to a particular action (e.g., bringing an object to the mouth), and they produce their action-specific responses independent of whether the monkey executes the action or passively observes a conspecific performing the same action. In humans, action observation and action execution engage a network of frontal, parietal, and temporal areas. However, it is unclear whether these responses reflect the activity of a single population that represents both observed and executed actions in a common neural code or the activity of distinct but overlapping populations of exclusively perceptual and motor neurons [3]. Here, we used fMRI adaptation to show that the right inferior parietal lobe (IPL) responds independently to specific actions regardless of whether they are observed or executed. Specifically, responses in the right IPL were attenuated when participants observed a recently executed action relative to one that had not previously been performed. This adaptation across action and perception demonstrates that the right IPL responds selectively to the motoric and perceptual representations of actions and is the first evidence for a neural response in humans that shows both defining properties of mirror neurons.     

Monkeys recall and reproduce simple shapes from memory

If you draw from memory a picture of the front of your childhood home, you will have demonstrated recall. You could also recognize this house upon seeing it. Unlike recognition, recall demonstrates memory for things that are not present. Recall is necessary for planning and imagining, and it can increase the flexibility of navigation, social behavior, and other cognitive skills. Without recall, memory is more limited to recognition of the immediate environment. Amnesic patients are impaired on recall tests [1, 2], and recall performance often declines with aging [3]. Despite its importance, we know relatively little about nonhuman animals' ability to recall information; we lack suitable recall tests for them and depend instead on recognition tests to measure nonhuman memory. Here we report that rhesus monkeys can recall simple shapes from memory and reproduce them on a touchscreen. As in humans [4, 5], monkeys remembered less in recall than recognition tests, and their recall performance deteriorated more slowly. Transfer tests showed that monkeys used a flexible memory mechanism rather than memorizing specific actions for each shape. Observation of recall in Old World monkeys suggests that it has been adaptive for over 30 million years [6] and does not depend on language.