Spatial context and top-down strategies in visual search

Marvin M. Chun and Yuhong Jiang (1998) investigated the role of spatial context on visual search. They used two display conditions. In the Old Display condition, the spatial arrangement of items in the search display was kept constant throughout the experiment. In the New Display condition, the spatial arrangement of items was always novel from trial to trial. The results showed better performance with Old Displays than with New Displays. The authors proposed that repeated spatial context help guiding attention to the target location, thus they termed this effect Contextual Cueing. We present three attempts to reproduce this effect. Experiments 1 and 2 were near exact replications of experiments in Chun and Jiang's report, where we failed to obtain Contextual Cueing. Post-experimental interviews revealed that participants used different search strategies when performing the task: an 'active' strategy (an active effort to find the target), or a 'passive' strategy (intuitive search). In Experiment 3, we manipulated task instructions to bias participants into using active or passive strategies. A robust Contextual Cueing Effect was obtained only in the passive instruction condition.     

Spatial and temporal dynamics of attentional guidance during inefficient visual search

Spotting a prey or a predator is crucial in the natural environment and relies on the ability to extract quickly pertinent visual information. The experimental counterpart of this behavior is visual search (VS) where subjects have to identify a target amongst several distractors. In difficult VS tasks, it has been found that the reaction time (RT) is influenced by salience factors, such as the target-distractor similarity, and this finding is usually regarded as evidence for a guidance of attention by preattentive mechanisms. However, the use of RT measurements, a parameter which depends on multiple factors, allows only very indirect inferences about the underlying attentional mechanisms. The purpose of the present study was to determine the influence of salience factors on attentional guidance during VS, by measuring directly attentional allocation. We studied attention allocation by using a dual covert VS task in subjects who had 1) to detect a target amongst different items and 2) to report letters briefly flashed inside those items at different delays. As predicted, we showed that parallel processes guide attention towards the most relevant item by virtue of both goal-directed and stimulus-driven factors, and we demonstrated that this attentional selection is a prerequisite for target detection. In addition, we show that when the target is characterized by two features (conjunction VS), the goal-directed effects of both features are initially combined into a unique salience value, but at a later stage, grouping phenomena interact with the salience computation, and lead to the selection of a whole group of items. These results, in line with Guided Search Theory, show that efficient and rapid preattentive processes guide attention towards the most salient item, allowing to reduce the number of attentional shifts needed to find the target.     

Attention and visual search

Selective Tuning (ST) presents a framework for modeling attention and in this work we show how it performs in covert visual search tasks by comparing its performance to human performance. Two implementations of ST have been developed. The Object Recognition Model recognizes and attends to simple objects formed by the conjunction of various features and the Motion Model recognizes and attends to motion patterns. The validity of the Object Recognition Model was first tested by successfully duplicating the results of Nagy and Sanchez. A second experiment was aimed at an evaluation of the model's performance against the observed continuum of search slopes for feature-conjunction searches of varying difficulty. The Motion Model was tested against two experiments dealing with searches in the visual motion domain. A simple odd-man-out search for counter-clockwise rotating octagons among identical clockwise rotating octagons produced linear increase in search time with the increase of set size. The second experiment was similar to one described by Thorton and Gilden. The results from both implementations agreed with the psychophysical data from the simulated experiments. We conclude that ST provides a valid explanatory mechanism for human covert visual search performance, an explanation going far beyond the conventional saliency map based explanations.     

Knowledge-based vision and simple visual machines.

The vast majority of work in machine vision emphasizes the representation of perceived objects and events: it is these internal representations that incorporate the ''knowledge'' in knowledge-based vision or form the ''models'' in model-based vision. In this paper, we discuss simple machine vision systems developed by artificial evolution rather than traditional engineering design techniques, and note that the task of identifying internal representations within such systems is made difficult by the lack of an operational definition of representation at the causal mechanistic level. Consequently, we question the nature and indeed the existence of representations posited to be used within natural vision systems (i.e. animals). We conclude that representations argued for on a priori grounds by external observers of a particular vision system may well be illusory, and are at best place-holders for yet-to-be-identified causal mechanistic interactions. That is, applying the knowledge-based vision approach in the understanding of evolved systems (machines or animals) may well lead to theories and models that are internally consistent, computationally plausible, and entirely wrong.     

Structure and interactions in simple solutions

Neutron scattering with hydrogen/deuterium isotopic substitution techniques has been used to investigate the full range of structural interactions in a dilute 0.02 mol fraction solution of tertiary butanol in water, both in the absence and in the presence of a small amount of sodium chloride. Emphasis is given to the detailed pictures of the intermolecular interactions that have been derived using the empirical potential structure refinement technique. Analysis has been performed to the level of the spatial density distribution functions that illustrate the orientational dependence of the intermolecular interactions between all combinations of molecular and ionic components. The results show the key structural motifs involved in the interactions between the various components in a complex aqueous system. They underline the structural versatility of the water molecule in accommodating a range of different kinds of interactions while retaining its characteristic first-neighbour interaction geometry. Within this framework, the results highlight the complex interplay between the polar, non-polar and charged molecular interactions that exist in the system.     

Refixation frequency and memory mechanisms in visual search

Visual search-looking for a target object in the presence of a number of distractor items-is an everyday activity for humans (for example, finding the car in a busy car park) and animals (for example, foraging for food). Our understanding of visual search has been enriched by an interdisciplinary effort using a wide range of research techniques including behavioural studies in humans [1], single-cell electrophysiology [2], transcranial magnetic stimulation [3], event-related potentials [4] and studies of patients with focal brain injury [5]. A central question is what kind of information controls the search process. Visual search is typically accompanied by a series of eye movements, and investigating the nature and location of fixations helps to identify the kind of information that might control the search process. It has already been demonstrated that objects are fixated if they are visually similar to the target [6]. Also, if an item has been fixated, it is less likely to be returned to on the subsequent saccade. This automatic process is referred to as inhibition of return (IOR [7,8]). Here, we investigated the role of memory for which items had been fixated previously. We found that, during search, subjects often refixated items that had been previously fixated. Although there were fewer return saccades than would be expected by chance, the number of refixations indicated limited functional memory, indeed the memory effects that were present may primarily be a result of IOR.     

The search operating characteristic as a tool for analyzing performance in dynamic visual search tasks.

A standard data plot for the analysis of eye movement behavior in visual search and related tasks, a Search Operating Characteristic (SOC), is proposed. The SOC plots mean fixation duration (in ms) vs. search span (in items/fixation) for different difficulty levels. It is well specified by a reciprocal power function and this function can be explained with the help of Piéron's law.     

Effective protein folding in simple random search

Here I show the following facts using a simple random search model without including any sophisticated energy term. As the size of elements exponentially affects the efficiency of folding, it can be remarkably enhanced by dividing the elements into small blocks. As the folding of the blocks is completely independent, the total folding time can be reduced to the folding time of the single hardest block. This result gives the simplest and most straightforward answer to the Levinthal paradox.     

Influence of inter-item symmetry in visual search

Does visual search involve a serial inspection of individual items (Feature Integration Theory) or are items grouped and segregated prior to their consideration as a possible target (Attentional Engagement Theory)? For search items defined by motion and shape there is strong support for prior grouping (Kingstone and Bischof, 1999). The present study tested for grouping based on inter-item shape symmetry. Results showed that target-distractor symmetry strongly influenced search whereas distractor-distractor symmetry influenced search more weakly. This indicates that static shapes are evaluated for similarity to one another prior to their explicit identification as 'target' or 'distractor'. Possible reasons for the unequal contributions of target-distractor and distractor-distractor relations are discussed.     

Are direction and speed coded independently by the visual system? Evidence from visual search.

Three visual search experiments examined whether motion is coded as two separate features, speed and direction. Increasing the heterogeneity of the directions in which stimuli moved disrupted detection of a target defined by speed (fast among medium and slow nontargets), suggesting that speed is coded integrally with direction. However, heterogeneity in speed did not disrupt detection of a target moving in a particular direction among nontargets with different directions. This suggests that direction is coded independently of speed. The apparent paradox raised by these contrasting conclusions is consistent with neurophysiological and computational models of motion-detection, which suggest that low-levels of the visual system contain direction-detectors insensitive to speed, while speed is coded at higher levels by detectors which are also sensitive to direction. Evidence consistent with the existence of the latter conjunction detectors was obtained in a final experiment which found search for a conjunction of speed and direction to be parallel.     

Effects of set-size and lateral masking in visual search

In the present research, the roles of lateral masking and central processing limitations in visual search were studied. Two search conditions were used: (1) target differed from distractors by presence/absence of a simple feature; (2) target differed by relative position of the same components only. The number of displayed stimuli (set-size) and the distance between neighbouring stimuli were varied as independently as possible in order to measure the effect of both. The effect of distance between stimuli (lateral masking) was found to be similar in both conditions. The effect of set-size was much larger for relative position stimuli. The results support the view that perception of relative position of stimulus components is limited mainly by the capacity of central processing.     

Spatial interactions and resilience in arid ecosystems

We present a mathematical analysis of the consequences of spatial interactions between vegetation patches by means of water flow for the functioning of arid systems. Our model results suggest that spatial exchange of water improved the resilience to disturbances and increased the resistance to human-induced loss of cover. Furthermore, spatial exchange of water allowed vegetation to persist at lower rainfall levels compared to systems that lack spatial interactions. Our analysis stresses the general importance of spatial interactions for the functioning of ecological systems.     

Complex backgrounds delay low-load visual search

Past research has shown, separately, that endogenous location cues and high perceptual load search tasks increase the specificity of attentional deployment to task-relevant regions of the visual field, while complex task-irrelevant backgrounds greatly resembling task-relevant stimuli reduce it. Here, we investigated in the same study whether the perceptual load created by an endogenously cued set of task-relevant stimuli determines whether a surrounding complex background of similar task-irrelevant stimuli would interfere with search. Our results show that high perceptual load protects against interference from a complex background of similar but task-irrelevant stimuli, situated just beyond the boundaries of the task-relevant set. Furthermore, our findings demonstrate that search characteristics do not change when the relevant set is restricted attentionally to a smaller delineated area, even in the presence of a background. Finally, we found that the efficacy of endogenous location cueing is not dependent on the type of search task that occurs in the cued area. Our findings also reveal that alternative attention-directing strategies, such as guided search and signal detection, may be employed in such tasks in the absence of endogenous location cueing.     

On the manifestations of memory in visual search

Evidence is presented supporting the thesis that performance in visual search tasks is affected by the contribution of memory processes. Three levels of analysis, corresponding to the various time scales present in a typical search experiment, are discussed. Perceptual learning involves the task and stimulus specific improvement seen across blocks of training. Trial-to-trial priming has an influence which extends over 5-8 trials and lasts on the order of 30 s. Within-trial tagging prevents the re-inspection of already attended (or fixated) items. Also at the within-trial level of analysis, parallel accumulation of evidence for target presence/absence or target location inherently involves memory mechanisms. Organizing the various phenomena in this way makes it apparent that the various mechanisms may interact in a causal way. Within-trial tagging may contribute to priming which may contribute to perceptual learning. Recent proposals that visual search is memoryless (amnesic) are discussed and dismissed.     

Spatial interactions in rapid pattern discrimination

We measured reaction times (RTs) for identification of a target among distracters under stabilized image conditions in which the positions of the target and the distracters were constant within a single experimental session. Under these conditions, the observer need not search for the target because its position is known. We nevertheless found that the presence of even a single distracter could elevate RTs. The magnitude of this effect depended on the distance of the distracter from the target and, for some observers, the distance of the distracter from the fovea. When we added not one but six background elements in a ring around the target, RT increased even more. If, apart from these neighboring distracters, the target was surrounded by more distracters located beyond the nearest neighbors, RT was, in general, not increased further. These findings suggest that adding background elements in a search task can elevate RTs in ways that are not dependent on the positional uncertainty of the target.     

Spatial frequency analysis in early visual processing

The existence of multiple channels, or multiple receptive field sizes, in the visual system does not commit us to any particular theory of spatial encoding in vision. However, distortions of apparent spatial frequency and width in a wide variety of conditions favour the idea that each channel carries a width- or frequency-related code or 'label' rather than a 'local sign' or positional label. When distortions of spatial frequency occur without prior adaptation (e.g. at low contrast or low luminance) they are associated with lowered sensitivity, and may be due to a mismatch between the perceptual labels and the actual tuning of the channels. A low-level representation of retinal space could be constructed from the spatial information encoded by the channels, rather than being projected intact from the retina.     

Spatial remapping in the primate visual system

Summary The lateral geniculate body performs a spatial remapping operation. This remapping may help to preserve the apparent distance of objects under symmetrical eye movements, thereby stabilizing the appearance of visual space. In addition, a related, and perhaps more basic function of the geniculate remapping may be to increase the efficiency of the neural matrix which encodes depth information. For distant fixation, the majority of cells in this cortical matrix would be responsive to crossed disparities, but for near fixation, many of these same cells might be converted into uncrossed disparity detectors. Two types of models for the geniculate are presented, together with supporting evidence: (1) a quantitative psychophysical model describing its steady-state properties, and (2) a qualitative neurophysiological model describing the function of the geniculate laminae.This work was supported by the U.S. Air Force under contract No. AFORSR-F 44620-67-C0085. Supplementary funding was received from NASA and NIMH under grants Ns G 496 and MH 05673 awarded to Prof. H.-L. Teuber, Chairman, Dept. of Psychology, M. I. T., Cambridge, Mass.     

Spatial variation in mink and muskrat interactions in Canada

We investigated the spatial attributes of mink ( Mustela vison ) and muskrat ( Ondatra zibethicus ) interactions in Canada using 160 geographically paired historic time series of mink ( n =80) and muskrat ( n =80) harvest data obtained from Hudson's Bay Co. Archives. All series were 25 years in length (1925–1949) and were distributed primarily throughout five ecozones. We used autoregressive models and cross-correlation analysis to characterize the interactions between mink and muskrat. Model selection results did not differ among ecozones, and indicated that a predator-prey autoregressive model incorporating a delayed density-dependent term best described both the mink and muskrat harvest time series. Subsequent analysis of autoregressive coefficients and estimated lags indicated that mink and muskrat interactions vary throughout Canada. In western Canada, the trophic interactions appear to be strong, and mink population cycles lag behind muskrats 2–3 years. In central Canada, mink harvests lagged behind muskrats 1 year, and mink and muskrat interactions in central Canada, with the exception of the Hudson Plains ecozone, were intermediate. In eastern Canada, the trophic interactions appeared weakest, and there were no distinct time lags between mink and muskrat. Stronger interactions in western Canada may be a result of decreased prey diversity, forcing mink to specialize more on muskrats, whereas comparatively stronger perturbations stemming from other trophic interactions may alter the estimated interaction between mink and muskrat in eastern Canada.