Visual working memory capacity does not modulate the feature-based information filtering in visual working memory

Background

The limited capacity of visual working memory (VWM) requires us to select the task relevant information and filter out the irrelevant information efficiently. Previous studies showed that the individual differences in VWM capacity dramatically influenced the way we filtered out the distracters displayed in distinct spatial-locations: low-capacity individuals were poorer at filtering them out than the high-capacity ones. However, when the target and distracting information pertain to the same object (i.e., multiple-featured object), whether the VWM capacity modulates the feature-based filtering remains unknown.

Methodology/Principal Findings

We explored this issue mainly based on one of our recent studies, in which we asked the participants to remember three colors of colored-shapes or colored-landolt-Cs while using two types of task irrelevant information. We found that the irrelevant high-discriminable information could not be filtered out during the extraction of VWM but the irrelevant fine-grained information could be. We added 8 extra participants to the original 16 participants and then split the overall 24 participants into low- and high-VWM capacity groups. We found that regardless of the VWM capacity, the irrelevant high-discriminable information was selected into VWM, whereas the irrelevant fine-grained information was filtered out. The latter finding was further corroborated in a second experiment in which the participants were required to remember one colored-landolt-C and a more strict control was exerted over the VWM capacity.

Conclusions/Significance

We conclude that VWM capacity did not modulate the feature-based filtering in VWM.     

Dissociated mechanisms of extracting perceptual information into visual working memory

Background

The processing mechanisms of visual working memory (VWM) have been extensively explored in the recent decade. However, how the perceptual information is extracted into VWM remains largely unclear. The current study investigated this issue by testing whether the perceptual information was extracted into VWM via an integrated-object manner so that all the irrelevant information would be extracted (object hypothesis), or via a feature-based manner so that only the target-relevant information would be extracted (feature hypothesis), or via an analogous processing manner as that in visual perception (analogy hypothesis).

Methodology/Principal Findings

High-discriminable information which is processed at the parallel stage of visual perception and fine-grained information which is processed via focal attention were selected as the representatives of perceptual information. The analogy hypothesis predicted that whereas high-discriminable information is extracted into VWM automatically, fine-grained information will be extracted only if it is task-relevant. By manipulating the information type of the irrelevant dimension in a change-detection task, we found that the performance was affected and the ERP component N270 was enhanced if a change between the probe and the memorized stimulus consisted of irrelevant high-discriminable information, but not if it consisted of irrelevant fine-grained information.

Conclusions/Significance

We conclude that dissociated extraction mechanisms exist in VWM for information resolved via dissociated processes in visual perception (at least for the information tested in the current study), supporting the analogy hypothesis.     

Neural correlate of filtering of irrelevant information from visual working memory

In a dynamic environment stimulus task relevancy could be altered through time and it is not always possible to dissociate relevant and irrelevant objects from the very first moment they come to our sight. In such conditions, subjects need to retain maximum possible information in their WM until it is clear which items should be eliminated from WM to free attention and memory resources. Here, we examined the neural basis of irrelevant information filtering from WM by recording human ERP during a visual change detection task in which the stimulus irrelevancy was revealed in a later stage of the task forcing the subjects to keep all of the information in WM until test object set was presented. Assessing subjects' behaviour we found that subjects' RT was highly correlated with the number of irrelevant objects and not the relevant one, pointing to the notion that filtering, and not selection, process was used to handle the distracting effect of irrelevant objects. In addition we found that frontal N150 and parietal N200 peak latencies increased systematically as the amount of irrelevancy load increased. Interestingly, the peak latency of parietal N200, and not frontal N150, better correlated with subjects' RT. The difference between frontal N150 and parietal N200 peak latencies varied with the amount of irrelevancy load suggesting that functional connectivity between modules underlying fronto-parietal potentials vary concomitant with the irrelevancy load. These findings suggest the existence of two neural modules, responsible for irrelevant objects elimination, whose activity latency and functional connectivity depend on the number of irrelevant object.     

Selective visual processing across competition episodes: a theory of task-driven visual attention and working memory

The goal of this review is to introduce a theory of task-driven visual attention and working memory (TRAM). Based on a specific biased competition model, the ‘theory of visual attention’ (TVA) and its neural interpretation (NTVA), TRAM introduces the following assumption. First, selective visual processing over time is structured in competition episodes. Within an episode, that is, during its first two phases, a limited number of proto-objects are competitively encoded—modulated by the current task—in activation-based visual working memory (VWM). In processing phase 3, relevant VWM objects are transferred via a short-term consolidation into passive VWM. Second, each time attentional priorities change (e.g. after an eye movement), a new competition episode is initiated. Third, if a phase 3 VWM process (e.g. short-term consolidation) is not finished, whereas a new episode is called, a protective maintenance process allows its completion. After a VWM object change, its protective maintenance process is followed by an encapsulation of the VWM object causing attentional resource costs in trailing competition episodes. Viewed from this perspective, a new explanation of key findings of the attentional blink will be offered. Finally, a new suggestion will be made as to how VWM items might interact with visual search processes.     

Mental imagery and visual working memory

Visual working memory provides an essential link between past and future events. Despite recent efforts, capacity limits, their genesis and the underlying neural structures of visual working memory remain unclear. Here we show that performance in visual working memory--but not iconic visual memory--can be predicted by the strength of mental imagery as assessed with binocular rivalry in a given individual. In addition, for individuals with strong imagery, modulating the background luminance diminished performance on visual working memory and imagery tasks, but not working memory for number strings. This suggests that luminance signals were disrupting sensory-based imagery mechanisms and not a general working memory system. Individuals with poor imagery still performed above chance in the visual working memory task, but their performance was not affected by the background luminance, suggesting a dichotomy in strategies for visual working memory: individuals with strong mental imagery rely on sensory-based imagery to support mnemonic performance, while those with poor imagery rely on different strategies. These findings could help reconcile current controversy regarding the mechanism and location of visual mnemonic storage.     

The human visual system is optimised for processing the spatial information in natural visual images

A fundamental tenet of visual science is that the detailed properties of visual systems are not capricious accidents, but are closely matched by evolution and neonatal experience to the environments and lifestyles in which those visual systems must work. This has been shown most convincingly for fish and insects. For mammalian vision, however, this tenet is based more upon theoretical arguments than upon direct observations. Here, we describe experiments that require human observers to discriminate between pictures of slightly different faces or objects. These are produced by a morphing technique that allows small, quantifiable changes to be made in the stimulus images. The independent variable is designed to give increasing deviation from natural visual scenes, and is a measure of the Fourier composition of the image (its second-order statistics). Performance in these tests was best when the pictures had natural second-order spatial statistics, and degraded when the images were made less natural. Furthermore, performance can be explained with a simple model of contrast coding, based upon the properties of simple cells in the mammalian visual cortex. The findings thus provide direct empirical support for the notion that human spatial vision is optimised to the second-order statistics of the optical environment.     

Role of working memory in forming the cognitive visual set

It was found in healthy adult subjects (n = 90) that under conditions of complication of cognitive tasks (increasing number of relevant stimuli), the stability (rigidity) of the unconscious cognitive sets markedly rises. These changes in both verbal and nonverbal sets depend on the working memory loading. The revealed dependence of the motor reaction time to the probe stimulus on the sequence of the set stimuli in a context and on the set stage suggests that unconscious cognitive sets can regulate selective attention.     

Priority-based transformations of stimulus representation in visual working memory

How does the brain prioritize among the contents of working memory (WM) to appropriately guide behavior? Previous work, employing inverted encoding modeling (IEM) of electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) datasets, has shown that unprioritized memory items (UMI) are actively represented in the brain, but in a “flipped”, or opposite, format compared to prioritized memory items (PMI). To acquire independent evidence for such a priority-based representational transformation, and to explore underlying mechanisms, we trained recurrent neural networks (RNNs) with a long short-term memory (LSTM) architecture to perform a 2-back WM task. Visualization of LSTM hidden layer activity using Principal Component Analysis (PCA) confirmed that stimulus representations undergo a representational transformation–consistent with a flip—while transitioning from the functional status of UMI to PMI. Demixed (d)PCA of the same data identified two representational trajectories, one each within a UMI subspace and a PMI subspace, both undergoing a reversal of stimulus coding axes. dPCA of data from an EEG dataset also provided evidence for priority-based transformations of the representational code, albeit with some differences. This type of transformation could allow for retention of unprioritized information in WM while preventing it from interfering with concurrent behavior. The results from this initial exploration suggest that the algorithmic details of how this transformation is carried out by RNNs, versus by the human brain, may differ.     

Age-related changes in the relationship between learning progress and auditory working memory characteristics

In order to explore the relationship between learning progress and working memory characteristics, the psychoacoustic testing of 42 persons (20-65 years old) of medical staff taught a novel science (informatics) was carried out. The subjects were divided into three age groups: 20-35, 36-50, and 51-65-year-olds. Acoustical test consisted of a set of 12 target words (professional informatics terms) presented through headphones and subsequent presentation of a random succession of 12 target and 12 masking words (all of them being professional informatics terms). Listeners had to recognize the target words. The stepwise linear regression analysis revealed a link between the progress in acquisition of the new material and characteristics of acoustical working memory, whose role in learning progress increased with age. Because the memory efficiency reduction was found in subjects older than 35 years, it was supposed that age-related changes in characteristics of the acoustical working memory were responsible for the decline in ability to learn novel material.     

High visual working memory capacity in trait social anxiety

Working memory capacity is one of the most important cognitive functions influencing individual traits, such as attentional control, fluid intelligence, and also psychopathological traits. Previous research suggests that anxiety is associated with impaired cognitive function, and studies have shown low verbal working memory capacity in individuals with high trait anxiety. However, the relationship between trait anxiety and visual working memory capacity is still unclear. Considering that people allocate visual attention more widely to detect danger under threat, visual working memory capacity might be higher in anxious people. In the present study, we show that visual working memory capacity increases as trait social anxiety increases by using a change detection task. When the demand to inhibit distractors increased, however, high visual working memory capacity diminished in individuals with social anxiety, and instead, impaired filtering of distractors was predicted by trait social anxiety. State anxiety was not correlated with visual working memory capacity. These results indicate that socially anxious people could potentially hold a large amount of information in working memory. However, because of an impaired cognitive function, they could not inhibit goal-irrelevant distractors and their performance decreased under highly demanding conditions.     

Effect of noise in processing of visual information

Background

Information transmission and processing in the nervous system has stochastic nature. Multiple factors contribute to neuronal trial-to-trial variability. Noise and variations are introduced by the processes at the molecular and cellular level (thermal noise, channel current noise, membrane potential variations, biochemical and diffusion noise at synapses etc). The stochastic processes are affected by different physical (temperature, electromagnetic field) and chemical (drugs) factors. The aim of this study was experimental investigation of hypotheses that increase in the noise level in the brain affects processing of visual information. Change in the noise level was introduced by an external factor producing excess noise in the brain.

Methods

An exposure to 450 MHz low-frequency modulated microwave radiation was applied to generate excess noise. Such exposure has been shown to increase diffusion, alter membrane resting potential, gating variables and intracellular Calcium efflux. Nine healthy volunteers passed the experimental protocol at the lower (without microwave) and the higher (with microwave) noise level. Two photos (visual stimuli) of unfamiliar, young male faces were presented to the subjects, one picture after another. The task was to identify later the photos from a group of six photos and to decide in which order they were presented. Each subject had a total of eight sessions at the lower and eight at the higher noise level. Each session consisted of 50 trials; altogether a subject made 800 trials, 400 at the lower and 400 at the higher noise level. Student t-test was applied for statistical evaluation of the results.

Results

Correct recognition of both stimuli in the right order was better at the lower noise level. All the subjects under investigation showed higher numbers of right answers in trials at the lower noise level. Average number of correct answers from n=400 trials with microwave exposure was 50.3, without exposure 54.4, difference 7.5%, p<0.002. No difference between results at the lower and the higher noise level was revealed in the case of only partly correct or incorrect answers.

Conclusions

Our experimental results showed that introduced excess noise reduced significantly ability of the nervous system in correct processing of visual information.

     

N-cadherin regulates target specificity in the Drosophila visual system

Using visual behavioral screens in Drosophila, we identified multiple alleles of N-cadherin. Removal of N-cadherin selectively from photoreceptor neurons (R cells) causes deficits in specific visual behaviors that correlate with disruptions in R cell connectivity. These defects include disruptions in the pattern of neuronal connections made by all three classes of R cells (R1-R6, R7, and R8). N-cadherin is expressed in both R cell axons and their targets. By inducing mitotic recombination in a subclass of eye progenitors, we generated mutant R7 axons surrounded by largely wild-type R cell axons and a wild-type target. R7 axons lacking N-cadherin mistarget to the R8 recipient layer. We consider the implications of these findings in the context of the proposed role for cadherins in target specificity.     

Event-related potentials at different stages of the operation of visual working memory

Trace fixation and comparison with incoming information was studied using event-related potentials (ERPs) recorded from various cortical areas during passive viewing and matching of two consecutive pictures. Visual stimuli differing in the spatial location of elements (4 × 4 square patterns with random positions of 4 black and 12 white squares) and phonological stimuli (differently written letters) were used. Trace fixation was studied by comparing the ERPs generated in response to the first (reference) stimulus in the pair with those generated during passive viewing. Sensory analysis of the reference stimuli was observed in the time interval 128–196 ms. For the patterns presented, it was reflected by an increased amplitude of the N1 component in the caudal areas as compared with passive viewing. The phonological stimuli produced a higher amplitude of a positive wave in the frontotemporal area in the same time interval. Processing of subsequent information to be stored in memory was observed in the interval 232–452 ms. Processing of patterns was reflected by a decreased positivity, most pronounced in the left temporo-parieto-occipital area. Comparison of a trace with incoming information was studied by comparing the ERPs generated in response to the first (reference) and second (test) stimuli. The number of cortical areas involved in the sensory analysis of the test stimuli was larger than the number involved in the analysis of the reference stimuli. Comparison of the new information with the trace was reflected by an increased amplitude of the late positive wave (components P3, Pc, and Pc-Nc) in the frontocentral and caudal cortical areas. The topographic changes in the late positive components depended on the type of stimulus.