Visual working memory capacity does not modulate the feature-based information filtering in visual working memory

Background

The limited capacity of visual working memory (VWM) requires us to select the task relevant information and filter out the irrelevant information efficiently. Previous studies showed that the individual differences in VWM capacity dramatically influenced the way we filtered out the distracters displayed in distinct spatial-locations: low-capacity individuals were poorer at filtering them out than the high-capacity ones. However, when the target and distracting information pertain to the same object (i.e., multiple-featured object), whether the VWM capacity modulates the feature-based filtering remains unknown.

Methodology/Principal Findings

We explored this issue mainly based on one of our recent studies, in which we asked the participants to remember three colors of colored-shapes or colored-landolt-Cs while using two types of task irrelevant information. We found that the irrelevant high-discriminable information could not be filtered out during the extraction of VWM but the irrelevant fine-grained information could be. We added 8 extra participants to the original 16 participants and then split the overall 24 participants into low- and high-VWM capacity groups. We found that regardless of the VWM capacity, the irrelevant high-discriminable information was selected into VWM, whereas the irrelevant fine-grained information was filtered out. The latter finding was further corroborated in a second experiment in which the participants were required to remember one colored-landolt-C and a more strict control was exerted over the VWM capacity.

Conclusions/Significance

We conclude that VWM capacity did not modulate the feature-based filtering in VWM.     

Mental imagery and visual working memory

Visual working memory provides an essential link between past and future events. Despite recent efforts, capacity limits, their genesis and the underlying neural structures of visual working memory remain unclear. Here we show that performance in visual working memory--but not iconic visual memory--can be predicted by the strength of mental imagery as assessed with binocular rivalry in a given individual. In addition, for individuals with strong imagery, modulating the background luminance diminished performance on visual working memory and imagery tasks, but not working memory for number strings. This suggests that luminance signals were disrupting sensory-based imagery mechanisms and not a general working memory system. Individuals with poor imagery still performed above chance in the visual working memory task, but their performance was not affected by the background luminance, suggesting a dichotomy in strategies for visual working memory: individuals with strong mental imagery rely on sensory-based imagery to support mnemonic performance, while those with poor imagery rely on different strategies. These findings could help reconcile current controversy regarding the mechanism and location of visual mnemonic storage.     

Neurodevelopmental changes in working memory and cognitive control

One of the most salient ways in which our behavior changes during childhood and adolescence is that we get better at working towards long-term goals, at ignoring irrelevant information that could distract us from our goals, and at controlling our impulses - in other words, we exhibit improvements in cognitive control. Several recent magnetic resonance imaging studies have examined the developmental changes in brain structure and function that underlie improvements in working memory and cognitive control. Increased recruitment of task-relevant regions in the prefrontal cortex, parietal cortex and striatum over the course of development is associated with better performance in a range of cognitive tasks. Further work is needed to assess the role of experience in shaping the neural circuitry that underlies cognitive control.     

Priority-based transformations of stimulus representation in visual working memory

How does the brain prioritize among the contents of working memory (WM) to appropriately guide behavior? Previous work, employing inverted encoding modeling (IEM) of electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) datasets, has shown that unprioritized memory items (UMI) are actively represented in the brain, but in a “flipped”, or opposite, format compared to prioritized memory items (PMI). To acquire independent evidence for such a priority-based representational transformation, and to explore underlying mechanisms, we trained recurrent neural networks (RNNs) with a long short-term memory (LSTM) architecture to perform a 2-back WM task. Visualization of LSTM hidden layer activity using Principal Component Analysis (PCA) confirmed that stimulus representations undergo a representational transformation–consistent with a flip—while transitioning from the functional status of UMI to PMI. Demixed (d)PCA of the same data identified two representational trajectories, one each within a UMI subspace and a PMI subspace, both undergoing a reversal of stimulus coding axes. dPCA of data from an EEG dataset also provided evidence for priority-based transformations of the representational code, albeit with some differences. This type of transformation could allow for retention of unprioritized information in WM while preventing it from interfering with concurrent behavior. The results from this initial exploration suggest that the algorithmic details of how this transformation is carried out by RNNs, versus by the human brain, may differ.     

Dependence of stability of the visual cognitive set on motivation

In order to reveal the character of motivation influence on the stability of the unconscious visual set, young adult healthy subjects were promised to be rewarded for correct solution of the cognitive task. A substantial increase in set stability was observed under conditions of augmented motivation of a subject to the result of his performance. Positive and negative aspects of the impact of the increased motivation of a subject on his cognitive activity at the stages of set formation and actualization are discussed.     

From cognitive to neural models of working memory

Working memory refers to the temporary retention of information that was just experienced or just retrieved from long-term memory but no longer exists in the external environment. These internal representations are short-lived, but can be stored for longer periods of time through active maintenance or rehearsal strategies, and can be subjected to various operations that manipulate the information in such a way that makes it useful for goal-directed behaviour. Empirical studies of working memory using neuroscientific techniques, such as neuronal recordings in monkeys or functional neuroimaging in humans, have advanced our knowledge of the underlying neural mechanisms of working memory. This rich dataset can be reconciled with behavioural findings derived from investigating the cognitive mechanisms underlying working memory. In this paper, I review the progress that has been made towards this effort by illustrating how investigations of the neural mechanisms underlying working memory can be influenced by cognitive models and, in turn, how cognitive models can be shaped and modified by neuroscientific data. One conclusion that arises from this research is that working memory can be viewed as neither a unitary nor a dedicated system. A network of brain regions, including the prefrontal cortex (PFC), is critical for the active maintenance of internal representations that are necessary for goal-directed behaviour. Thus, working memory is not localized to a single brain region but probably is an emergent property of the functional interactions between the PFC and the rest of the brain.     

High visual working memory capacity in trait social anxiety

Working memory capacity is one of the most important cognitive functions influencing individual traits, such as attentional control, fluid intelligence, and also psychopathological traits. Previous research suggests that anxiety is associated with impaired cognitive function, and studies have shown low verbal working memory capacity in individuals with high trait anxiety. However, the relationship between trait anxiety and visual working memory capacity is still unclear. Considering that people allocate visual attention more widely to detect danger under threat, visual working memory capacity might be higher in anxious people. In the present study, we show that visual working memory capacity increases as trait social anxiety increases by using a change detection task. When the demand to inhibit distractors increased, however, high visual working memory capacity diminished in individuals with social anxiety, and instead, impaired filtering of distractors was predicted by trait social anxiety. State anxiety was not correlated with visual working memory capacity. These results indicate that socially anxious people could potentially hold a large amount of information in working memory. However, because of an impaired cognitive function, they could not inhibit goal-irrelevant distractors and their performance decreased under highly demanding conditions.     

A cognitive set and top-down processes in the functional organization of visual recognition

A top-down processing model and the role of frontal and prefrontal cortex in the neural mechanisms of recognition of verbal and non-verbal visual stimuli, are discussed. Stimulus recognition is considered to be a result of integration of the bottom-up and top-down streams. The cognitive set phenomenon can be used for studying the downward control in the neurocognitive visual system and in functional organisation of stimuli recognition.     

Age-related specificity of the processing of visual information in the system of working memory

In adults and seven- to eight-year-old children, event-related potentials (ERPs) were analyzed during quiet observation and detailed paired comparison of visual stimuli. In both age groups, we showed the differences in the initial stages (component N1) of sensory analysis in these situations. In adults, an increase in the negativity during the initial stages of analysis was observed in the caudal and central areas of the cortex during presentation of standard and test stimuli. In the frontal areas of the cortex, an increase in the negative potential was observed only in ERPs induced by the test stimulus. In children, an increase in the negativity at the initial phases of analysis of stimuli in the situation of working memory, as compared to quiet observation, was confined to the caudal areas of the cortex. Differential curves that characterize analysis of standard and test stimuli showed age-related differences in the initial and late phases of information processing under the conditions of working memory. In adults, the differential curves that characterize analysis of the standard stimulus were represented by negative phases, and the curves related to the test stimulus, by positive phases. In children, late phases of analysis of the standard and test stimuli had smaller differences as compared to adults: the late positive wave was predominant in the responses to both standard and test stimulus in the caudal areas of the cortex. In the frontal areas, there was no considerable increase in the amplitude of the late positive wave in response to the test stimulus. This fact, together with the absence of enhancement of initial negativity in the frontal areas, which reflects analysis of the test stimulus, indicates that the prefrontal cortex plays a smaller role in the comparison of the memory trace with the current information in seven- to eight-year-old children. The data obtained suggest that the central executive of working memory is not sufficiently mature in children aged seven to eight years.     

Event-related potentials at different stages of the operation of visual working memory

Trace fixation and comparison with incoming information was studied using event-related potentials (ERPs) recorded from various cortical areas during passive viewing and matching of two consecutive pictures. Visual stimuli differing in the spatial location of elements (4 × 4 square patterns with random positions of 4 black and 12 white squares) and phonological stimuli (differently written letters) were used. Trace fixation was studied by comparing the ERPs generated in response to the first (reference) stimulus in the pair with those generated during passive viewing. Sensory analysis of the reference stimuli was observed in the time interval 128–196 ms. For the patterns presented, it was reflected by an increased amplitude of the N1 component in the caudal areas as compared with passive viewing. The phonological stimuli produced a higher amplitude of a positive wave in the frontotemporal area in the same time interval. Processing of subsequent information to be stored in memory was observed in the interval 232–452 ms. Processing of patterns was reflected by a decreased positivity, most pronounced in the left temporo-parieto-occipital area. Comparison of a trace with incoming information was studied by comparing the ERPs generated in response to the first (reference) and second (test) stimuli. The number of cortical areas involved in the sensory analysis of the test stimuli was larger than the number involved in the analysis of the reference stimuli. Comparison of the new information with the trace was reflected by an increased amplitude of the late positive wave (components P3, Pc, and Pc-Nc) in the frontocentral and caudal cortical areas. The topographic changes in the late positive components depended on the type of stimulus.     

Dissociated mechanisms of extracting perceptual information into visual working memory

Background

The processing mechanisms of visual working memory (VWM) have been extensively explored in the recent decade. However, how the perceptual information is extracted into VWM remains largely unclear. The current study investigated this issue by testing whether the perceptual information was extracted into VWM via an integrated-object manner so that all the irrelevant information would be extracted (object hypothesis), or via a feature-based manner so that only the target-relevant information would be extracted (feature hypothesis), or via an analogous processing manner as that in visual perception (analogy hypothesis).

Methodology/Principal Findings

High-discriminable information which is processed at the parallel stage of visual perception and fine-grained information which is processed via focal attention were selected as the representatives of perceptual information. The analogy hypothesis predicted that whereas high-discriminable information is extracted into VWM automatically, fine-grained information will be extracted only if it is task-relevant. By manipulating the information type of the irrelevant dimension in a change-detection task, we found that the performance was affected and the ERP component N270 was enhanced if a change between the probe and the memorized stimulus consisted of irrelevant high-discriminable information, but not if it consisted of irrelevant fine-grained information.

Conclusions/Significance

We conclude that dissociated extraction mechanisms exist in VWM for information resolved via dissociated processes in visual perception (at least for the information tested in the current study), supporting the analogy hypothesis.     

Differential roles for parietal and occipital cortices in visual working memory

Visual working memory (VWM) is known as a highly capacity-limited cognitive system that can hold 3-4 items. Recent studies have demonstrated that activity in the intraparietal sulcus (IPS) and occipital cortices correlates with the number of representations held in VWM. However, differences among those regions are poorly understood, particularly when task-irrelevant items are to be ignored. The present fMRI-based study investigated whether memory load-sensitive regions such as the IPS and occipital cortices respond differently to task-relevant information. Using a change detection task in which participants are required to remember pre-specified targets, here we show that while the IPS exhibited comparable responses to both targets and distractors, the dorsal occipital cortex manifested significantly weaker responses to an array containing distractors than to an array containing only targets, despite that the number of objects presented was the same for the two arrays. These results suggest that parietal and occipital cortices engage differently in distractor processing and that the dorsal occipital, rather than parietal, activity appears to reflect output of stimulus filtering and selection based on behavioral relevance.     

Neural correlate of filtering of irrelevant information from visual working memory

In a dynamic environment stimulus task relevancy could be altered through time and it is not always possible to dissociate relevant and irrelevant objects from the very first moment they come to our sight. In such conditions, subjects need to retain maximum possible information in their WM until it is clear which items should be eliminated from WM to free attention and memory resources. Here, we examined the neural basis of irrelevant information filtering from WM by recording human ERP during a visual change detection task in which the stimulus irrelevancy was revealed in a later stage of the task forcing the subjects to keep all of the information in WM until test object set was presented. Assessing subjects' behaviour we found that subjects' RT was highly correlated with the number of irrelevant objects and not the relevant one, pointing to the notion that filtering, and not selection, process was used to handle the distracting effect of irrelevant objects. In addition we found that frontal N150 and parietal N200 peak latencies increased systematically as the amount of irrelevancy load increased. Interestingly, the peak latency of parietal N200, and not frontal N150, better correlated with subjects' RT. The difference between frontal N150 and parietal N200 peak latencies varied with the amount of irrelevancy load suggesting that functional connectivity between modules underlying fronto-parietal potentials vary concomitant with the irrelevancy load. These findings suggest the existence of two neural modules, responsible for irrelevant objects elimination, whose activity latency and functional connectivity depend on the number of irrelevant object.     

Aging-related changes of EEG synchronization during a visual working memory task

Differences of EEG synchronization between normal old and young people during a working memory (WM) task were investigated. The synchronization likelihood (SL) is a novel method to assessed synchronization in multivariate time series for non-stationary systems. To evaluate this method to study the mechanisms of WM, we calculated the SL values in brain electrical activity for both resting state and task state. EEG signals were recorded from 14 young adults and 12 old adults during two different states, respectively. SL was used to measure EEG synchronization between 19 electrodes in delta, theta, alpha1, alpha2 and beta frequency bands. Bad task performance and significantly decreased EEG synchronization were found in old group compared to young group in alpha1, alpha2 and beta frequency bands during the WM task. Moreover, significantly decreased EEG synchronization in beta band in the elder was also detected during the resting state. The findings suggested that reduced EEG synchronization may be one of causes for WM capacity decline along with healthy aging.     

Khat use is associated with impaired working memory and cognitive flexibility

Rationale

Khat consumption has increased during the last decades in Eastern Africa and has become a global phenomenon spreading to ethnic communities in the rest of the world, such as The Netherlands, United Kingdom, Canada, and the United States. Very little is known, however, about the relation between khat use and cognitive control functions in khat users.

Objective

We studied whether khat use is associated with changes in working memory (WM) and cognitive flexibility, two central cognitive control functions.

Methods

Khat users and khat-free controls were matched in terms of sex, ethnicity, age, alcohol and cannabis consumption, and IQ (Raven''s progressive matrices). Groups were tested on cognitive flexibility, as measured by a Global-Local task, and on WM using an N-back task.

Result

Khat users performed significantly worse than controls on tasks tapping into cognitive flexibility as well as monitoring of information in WM.

Conclusions

The present findings suggest that khat use impairs both cognitive flexibility and the updating of information in WM. The inability to monitor information in WM and to adjust behavior rapidly and flexibly may have repercussions for daily life activities.     

Dependence of plasticity of set to emotional facial expression on working memory load

The effect of increasing working memory load (by introduction of an additional cognitive task into the experimental context) on the recognition of emotional facial expression in a visual set paradigm was studied in healthy adult subjects. The link between plasticity of the cognitive set to emotional facial expression and the working memory was revealed. It was found that an increase in the working memory load was associated with a delay of set shifting in a modified situation. The set became more rigid which appeared as increasing number of trials with erroneous assessments of facial expression in the form of contrast or assimilative illusions. The significance of inner states and priming for the insight into psychophysiological mechanisms of erroneous assessments under conditions of the working memory loading is discussed in terms of the concept of the integration of bottom-up and top-down streams.     

Selective visual processing across competition episodes: a theory of task-driven visual attention and working memory

The goal of this review is to introduce a theory of task-driven visual attention and working memory (TRAM). Based on a specific biased competition model, the ‘theory of visual attention’ (TVA) and its neural interpretation (NTVA), TRAM introduces the following assumption. First, selective visual processing over time is structured in competition episodes. Within an episode, that is, during its first two phases, a limited number of proto-objects are competitively encoded—modulated by the current task—in activation-based visual working memory (VWM). In processing phase 3, relevant VWM objects are transferred via a short-term consolidation into passive VWM. Second, each time attentional priorities change (e.g. after an eye movement), a new competition episode is initiated. Third, if a phase 3 VWM process (e.g. short-term consolidation) is not finished, whereas a new episode is called, a protective maintenance process allows its completion. After a VWM object change, its protective maintenance process is followed by an encapsulation of the VWM object causing attentional resource costs in trailing competition episodes. Viewed from this perspective, a new explanation of key findings of the attentional blink will be offered. Finally, a new suggestion will be made as to how VWM items might interact with visual search processes.