Imagery-induced interference on a visual detection task.

The literature on the interaction between visual imagery and visual perception provides conflicting outcomes. Some studies show imagery interferes with perception whereas others show facilitation on perceptual tasks. The effects of visual imagery on a detection task were examined in six experiments. When either a bar image (Experiment 1) or an image of the letter 'l' (Experiment 3) overlapped with the targets, interference was discovered; however, images not overlapping the target did not effect detection (Experiments 2 and 4). Increasing the number of target locations caused the interfering effects of the image to disappear; however, there was no evidence of facilitation (Experiment 5). Physical stimuli interfered with detection whether there was overlap or not (Experiment 6). The results indicate that imagery induced interference may be lessened with more complex visual displays.     

Search efficiency but not response interference affects visual selection in frontal eye field

Two manipulations of a visual search task were used to test the hypothesis that the discrimination of a target from distractors by visually responsive neurons in the frontal eye field (FEF) marks the outcome and conclusion of visual processing instead of saccade preparation. First, search efficiency was reduced by increasing the similarity of the distractors to the target. Second, response interference was introduced by infrequently changing the location of the target in the array. Both manipulations increased reaction time, but only the change in search efficiency affected the time needed to select the target by visually responsive neurons. This result indicates that visually responsive neurons in FEF form an explicit representation of the location of the target in the image.     

Active maintenance of associative mnemonic signal in monkey inferior temporal cortex

We investigated the contribution of the inferior temporal (IT) cortical neurons to the active maintenance of internal representations. The activity of single neurons in the IT cortex was recorded while the monkeys performed a sequential-type associative memory task in which distractor stimuli interrupted the delay epoch between the cue and target (paired-associate) stimuli. For each neuron, information about each stimulus conveyed by the delay activity was estimated as a coefficient of multiple regression analysis. We found that target information derived from long-term memory (LTM) persisted despite the distractors. By contrast, cue information derived from the visual system was attenuated and frequently replaced by distractor information. These results suggest that LTM-derived information required for upcoming behavior is actively maintained in the IT neurons, whereas visually derived information tends to be updated irrespective of behavioral relevance.     

Negative priming under rapid serial visual presentation

Negative priming (NP) was examined under a new paradigm wherein a target and distractors were temporally separated using rapid serial visual presentation (RSVP). The results from the two experiments revealed that (a) NP was robust under RSVP, such that the responses to a target were slower when the target served as a distractor in a previous trial than when it did not; (b) NP was found regardless of whether the distractors appeared before or after the targets; and (c) NP was stronger when the distractor was more distinctive. These findings are generally similar to those on NP in the spatial search task. The implications for the processes causing NP under RSVP are discussed in the current paper.     

The role of the cognitive context in the conservatism of unconscious visual sets

Rigidity of a verbal set was compared in three series of experiments: (1) pseudowords were presented at the set-forming stage and were changed for common words at the testing stage; (2) in the same conditions as in 1, an additional task of target localization in the matrix by two distinctive features was introduced; (3) in the additional target localization task, the spatial component was strengthened whereas image recognition component was reduced. The results confirmed our hypothesis about the context-dependence of the rigidity of the visual set. This characteristic substantially depends on a working memory loading and cognitive tasks performed by a subject, in particular, the relationship between the degrees of involvement of the ventral and dorsal visual systems into the cortical processing of sequential verbal and nonverbal visual stimuli. The experimental paradigm can serve as a model for the investigation of the roles of the ventral and dorsal visual systems in the recognition function.     

The Effects of Feature-Based Priming and Visual Working Memory on Oculomotor Capture

Recently, it has been demonstrated that objects held in working memory can influence rapid oculomotor selection. This has been taken as evidence that perceptual salience can be modified by active working memory representations. The goal of the present study was to examine whether these results could also be caused by feature-based priming. In two experiments, participants were asked to saccade to a target line segment of a certain orientation that was presented together with a to-be-ignored distractor. Both objects were given a task-irrelevant color that varied per trial. In a secondary task, a color had to be memorized, and that color could either match the color of the target, match the color of the distractor, or it did not match the color of any of the objects in the search task. The memory task was completed either after the search task (Experiment 1), or before it (Experiment 2). The results showed that in both experiments the memorized color biased oculomotor selection. Eye movements were more frequently drawn towards objects that matched the memorized color, irrespective of whether the memory task was completed after (Experiment 1) or before (Experiment 2) the search task. This bias was particularly prevalent in short-latency saccades. The results show that early oculomotor selection performance is not only affected by properties that are actively maintained in working memory but also by those previously memorized. Both working memory and feature priming can cause early biases in oculomotor selection.     

How Visuo-Spatial Mental Imagery Develops: Image Generation and Maintenance

Two experiments examined the nature of visuo-spatial mental imagery generation and maintenance in 4-, 6-, 8-, 10-year old children and adults (N = 211). The key questions were how image generation and maintenance develop (Experiment 1) and how accurately children and adults coordinate mental and visually perceived images (Experiment 2). Experiment 1 indicated that basic image generation and maintenance abilities are present at 4 years of age but the precision with which images are generated and maintained improves particularly between 4 and 8 years. In addition to increased precision, Experiment 2 demonstrated that generated and maintained mental images become increasingly similar to visually perceived objects. Altogether, findings suggest that for simple tasks demanding image generation and maintenance, children attain adult-like precision younger than previously reported. This research also sheds new light on the ability to coordinate mental images with visual images in children and adults.     

Postdictive modulation of visual orientation

The present study investigated how visual orientation is modulated by subsequent orientation inputs. Observers were presented a near-vertical Gabor patch as a target, followed by a left- or right-tilted second Gabor patch as a distracter in the spatial vicinity of the target. The task of the observers was to judge whether the target was right- or left-tilted (Experiment 1) or whether the target was vertical or not (Supplementary experiment). The judgment was biased toward the orientation of the distracter (the postdictive modulation of visual orientation). The judgment bias peaked when the target and distracter were temporally separated by 100 ms, indicating a specific temporal mechanism for this phenomenon. However, when the visibility of the distracter was reduced via backward masking, the judgment bias disappeared. On the other hand, the low-visibility distracter could still cause a simultaneous orientation contrast, indicating that the distracter orientation is still processed in the visual system (Experiment 2). Our results suggest that the postdictive modulation of visual orientation stems from spatiotemporal integration of visual orientation on the basis of a slow feature matching process.     

A neural-network approach for visual cryptography and authorization

In this paper, we propose a neural-network approach for visual authorization, which is an application of visual cryptography (VC). The scheme contains a key-share and a set of user-shares. The administrator owns the key-share, and each user owns a user-share issued by the administrator from the user-share set. The shares in the user-share set are visually indistinguishable, i.e. they have the same pictorial meaning. However, the stacking of the key-share with different user-shares will reveal significantly different images. Therefore, the administrator (in fact, only the administrator) can visually recognize the authority assigned to a particular user by viewing the information appearing in the superposed image of key-share and user-share. This approach is completely different from traditional VC approaches. The salient features include: (i) the access schemes are described using a set of graytone images, and (ii) the codebooks to fulfil them are not required; and (iii) the size of share images is the same as the size of target image.     

Social Groups Prioritize Selective Attention to Faces: How Social Identity Shapes Distractor Interference

Human faces automatically attract visual attention and this process appears to be guided by social group memberships. In two experiments, we examined how social groups guide selective attention toward in-group and out-group faces. Black and White participants detected a target letter among letter strings superimposed on faces (Experiment 1). White participants were less accurate on trials with racial out-group (Black) compared to in-group (White) distractor faces. Likewise, Black participants were less accurate on trials with racial out-group (White) compared to in-group (Black) distractor faces. However, this pattern of out-group bias was only evident under high perceptual load—when the task was visually difficult. To examine the malleability of this pattern of racial bias, a separate sample of participants were assigned to mixed-race minimal groups (Experiment 2). Participants assigned to groups were less accurate on trials with their minimal in-group members compared to minimal out-group distractor faces, regardless of race. Again, this pattern of out-group bias was only evident under high perceptual load. Taken together, these results suggest that social identity guides selective attention toward motivationally relevant social groups—shifting from out-group bias in the domain of race to in-group bias in the domain of minimal groups—when perceptual resources are scarce.     

Auditory short-term memory behaves like visual short-term memory

Are the information processing steps that support short-term sensory memory common to all the senses? Systematic, psychophysical comparison requires identical experimental paradigms and comparable stimuli, which can be challenging to obtain across modalities. Participants performed a recognition memory task with auditory and visual stimuli that were comparable in complexity and in their neural representations at early stages of cortical processing. The visual stimuli were static and moving Gaussian-windowed, oriented, sinusoidal gratings (Gabor patches); the auditory stimuli were broadband sounds whose frequency content varied sinusoidally over time (moving ripples). Parallel effects on recognition memory were seen for number of items to be remembered, retention interval, and serial position. Further, regardless of modality, predicting an item's recognizability requires taking account of (1) the probe's similarity to the remembered list items (summed similarity), and (2) the similarity between the items in memory (inter-item homogeneity). A model incorporating both these factors gives a good fit to recognition memory data for auditory as well as visual stimuli. In addition, we present the first demonstration of the orthogonality of summed similarity and inter-item homogeneity effects. These data imply that auditory and visual representations undergo very similar transformations while they are encoded and retrieved from memory.     

Refixation frequency and memory mechanisms in visual search

Visual search-looking for a target object in the presence of a number of distractor items-is an everyday activity for humans (for example, finding the car in a busy car park) and animals (for example, foraging for food). Our understanding of visual search has been enriched by an interdisciplinary effort using a wide range of research techniques including behavioural studies in humans [1], single-cell electrophysiology [2], transcranial magnetic stimulation [3], event-related potentials [4] and studies of patients with focal brain injury [5]. A central question is what kind of information controls the search process. Visual search is typically accompanied by a series of eye movements, and investigating the nature and location of fixations helps to identify the kind of information that might control the search process. It has already been demonstrated that objects are fixated if they are visually similar to the target [6]. Also, if an item has been fixated, it is less likely to be returned to on the subsequent saccade. This automatic process is referred to as inhibition of return (IOR [7,8]). Here, we investigated the role of memory for which items had been fixated previously. We found that, during search, subjects often refixated items that had been previously fixated. Although there were fewer return saccades than would be expected by chance, the number of refixations indicated limited functional memory, indeed the memory effects that were present may primarily be a result of IOR.     

Temporal brain dynamics of multiple object processing: the flexibility of individuation

The ability to process concurrently multiple visual objects is fundamental for a coherent perception of the world. A core component of this ability is the simultaneous individuation of multiple objects. Many studies have addressed the mechanism of object individuation but it remains unknown whether the visual system mandatorily individuates all relevant elements in the visual field, or whether object indexing depends on task demands. We used a neural measure of visual selection, the N2pc component, to evaluate the flexibility of multiple object individuation. In three ERP experiments, participants saw a variable number of target elements among homogenous distracters and performed either an enumeration task (Experiment 1) or a detection task, reporting whether at least one (Experiment 2) or a specified number of target elements (Experiment 3) was present. While in the enumeration task the N2pc response increased as a function of the number of targets, no such modulation was found in Experiment 2, indicating that individuation of multiple targets is not mandatory. However, a modulation of the N2pc similar to the enumeration task was visible in Experiment 3, further highlighting that object individuation is a flexible mechanism that binds indexes to object properties and locations as needed for further object processing.     

Priming the Semantic Neighbourhood during the Attentional Blink

Background

When two targets are presented in close temporal proximity amongst a rapid serial visual stream of distractors, a period of disrupted attention and attenuated awareness lasting 200–500 ms follows identification of the first target (T1). This phenomenon is known as the “attentional blink” (AB) and is generally attributed to a failure to consolidate information in visual short-term memory due to depleted or disrupted attentional resources. Previous research has shown that items presented during the AB that fail to reach conscious awareness are still processed to relatively high levels, including the level of meaning. For example, missed word stimuli have been shown to prime later targets that are closely associated words. Although these findings have been interpreted as evidence for semantic processing during the AB, closely associated words (e.g., day-night) may also rely on specific, well-worn, lexical associative links which enhance attention to the relevant target.

Methodology/Principal Findings

We used a measure of semantic distance to create prime-target pairs that are conceptually close, but have low word associations (e.g., wagon and van) and investigated priming from a distractor stimulus presented during the AB to a subsequent target (T2). The stimuli were words (concrete nouns) in Experiment 1 and the corresponding pictures of objects in Experiment 2. In both experiments, report of T2 was facilitated when this item was preceded by a semantically-related distractor.

Conclusions/Significance

This study is the first to show conclusively that conceptual information is extracted from distractor stimuli presented during a period of attenuated awareness and that this information spreads to neighbouring concepts within a semantic network.     

Saccadic target selection as a function of time

Recent evidence indicates that stimulus-driven and goal-directed control of visual selection operate independently and in different time windows (van Zoest et al., 2004). The present study further investigates how eye movements are affected by stimulus-driven and goal-directed control. Observers were presented with search displays consisting of one target, multiple non-targets and one distractor element. The task of observers was to make a fast eye movement to a target immediately following the offset of a central fixation point, an event that either co-occurred with or soon followed the presentation of the search display. Distractor saliency and target-distractor similarity were independently manipulated. The results demonstrated that the effect of distractor saliency was transient and only present for the fastest eye movements, whereas the effect of target-distractor similarity was sustained and present in all but the fastest eye movements. The results support an independent timing account of visual selection.     

Implied Spatial Meaning and Visuospatial Bias: Conceptual Processing Influences Processing of Visual Targets and Distractors

Concepts with implicit spatial meaning (e.g., "hat", "boots") can bias visual attention in space. This result is typically found in experiments with a single visual target per trial, which can appear at one of two locations (e.g., above vs. below). Furthermore, the interaction is typically found in the form of speeded responses to targets appearing at the compatible location (e.g., faster responses to a target above fixation, after reading "hat"). It has been argued that these concept-space interactions could also result from experimentally-induced associations between the binary set of locations and the conceptual categories with upward and downward meaning. Thus, rather than reflecting a conceptually driven spatial bias, the effect could reflect a benefit for compatible cue-target sequences that occurs only after target onset. We addressed these concerns by going beyond a binary set of locations and employing a search display consisting of four items (above, below, left, and right). Within each search trial, before performing a visual search task, participants performed a conceptual task involving concepts with implicit upward or downward meaning. The search display, in addition to including a target, could also include a salient distractor. Assuming a conceptually driven visual bias, we expected to observe, first, a benefit for target processing at the compatible location and, second, an increase in the cost of the salient distractor. The findings confirmed both predictions, suggesting that concepts do indeed generate a spatial bias. Finally, results from a control experiment, without the conceptual task, suggest the presence of an axis-specific effect, in addition to the location-specific effect, suggesting that concepts might cause both location-specific and axis-specific spatial bias. Taken together, our findings provide additional support for the involvement of spatial processing in conceptual understanding.     

Distractor effects upon habituation of complex stimuli

In two experiments, rats were given serial forward (the target followed by the distractor) or backward (the distractor followed by the target) exposure to two compound flavor stimuli that could be either similar (Salt-X/AX) or dissimilar (Salt-X/AY, Experiment 1; Salt/AX, Experiment 2). Following pre-exposure, the Salt element was presented in a compound with a novel flavor, N. The salience or effectiveness of the Salt element was then assessed by presenting the new flavor, N, under a state of salt appetite. Experiments 1 and 2 revealed that the order of presentation modulated the habituation of the Salt element only when the distractor was similar to the target: the Salt element was more salient after forward than backward pre-exposure. In the groups Dissimilar the order of pre-exposure was irrelevant; however, when the Salt element was presented in compound with a second element (Salt-X, Experiment 1), its salience was preserved, whereas when it was presented alone (Salt, Experiment 2) its salience was significantly reduced. These results, which are discussed in terms of Wagner (1981) theory of habituation, inform about the way in which stimuli presented closely in time are processed.     

What Determines Auditory Distraction? On the Roles of Local Auditory Changes and Expectation Violations

Both the acoustic variability of a distractor sequence and the degree to which it violates expectations are important determinants of auditory distraction. In four experiments we examined the relative contribution of local auditory changes on the one hand and expectation violations on the other hand in the disruption of serial recall by irrelevant sound. We present evidence for a greater disruption by auditory sequences ending in unexpected steady state distractor repetitions compared to auditory sequences with expected changing state endings even though the former contained fewer local changes. This effect was demonstrated with piano melodies (Experiment 1) and speech distractors (Experiment 2). Furthermore, it was replicated when the expectation violation occurred after the encoding of the target items (Experiment 3), indicating that the items'' maintenance in short-term memory was disrupted by attentional capture and not their encoding. This seems to be primarily due to the violation of a model of the specific auditory distractor sequences because the effect vanishes and even reverses when the experiment provides no opportunity to build up a specific neural model about the distractor sequence (Experiment 4). Nevertheless, the violation of abstract long-term knowledge about auditory regularities seems to cause a small and transient capture effect: Disruption decreased markedly over the course of the experiments indicating that participants habituated to the unexpected distractor repetitions across trials. The overall pattern of results adds to the growing literature that the degree to which auditory distractors violate situation-specific expectations is a more important determinant of auditory distraction than the degree to which a distractor sequence contains local auditory changes.     

Adaptation supports short-term memory in a visual change detection task

The maintenance of short-term memories is critical for survival in a dynamically changing world. Previous studies suggest that this memory can be stored in the form of persistent neural activity or using a synaptic mechanism, such as with short-term plasticity. Here, we compare the predictions of these two mechanisms to neural and behavioral measurements in a visual change detection task. Mice were trained to respond to changes in a repeated sequence of natural images while neural activity was recorded using two-photon calcium imaging. We also trained two types of artificial neural networks on the same change detection task as the mice. Following fixed pre-processing using a pretrained convolutional neural network, either a recurrent neural network (RNN) or a feedforward neural network with short-term synaptic depression (STPNet) was trained to the same level of performance as the mice. While both networks are able to learn the task, the STPNet model contains units whose activity are more similar to the in vivo data and produces errors which are more similar to the mice. When images are omitted, an unexpected perturbation which was absent during training, mice often do not respond to the omission but are more likely to respond to the subsequent image. Unlike the RNN model, STPNet produces a similar pattern of behavior. These results suggest that simple neural adaptation mechanisms may serve as an important bottom-up memory signal in this task, which can be used by downstream areas in the decision-making process.     

Distractor Evoked Deviations of Saccade Trajectory Are Modulated by Fixation Activity in the Superior Colliculus: Computational and Behavioral Evidence

Previous studies have shown that saccades may deviate towards or away from task irrelevant visual distractors. This observation has been attributed to active suppression (inhibition) of the distractor location unfolding over time: early in time inhibition at the distractor location is incomplete causing deviation towards the distractor, while later in time when inhibition is complete the eyes deviate away from the distractor. In a recent computational study, Wang, Kruijne and Theeuwes proposed an alternative theory that the lateral interactions in the superior colliculus (SC), which are characterized by short-distance excitation and long-distance inhibition, are sufficient for generating both deviations towards and away from distractors. In the present study, we performed a meta-analysis of the literature, ran model simulations and conducted two behavioral experiments to further explore this unconventional theory. Confirming predictions generated by the model simulations, the behavioral experiments show that a) saccades deviate towards close distractors and away from remote distractors, and b) the amount of deviation depends on the strength of fixation activity in the SC, which can be manipulated by turning off the fixation stimulus before or after target onset (Experiment 1), or by varying the eccentricity of the target and distractor (Experiment 2).