Culture Modulates Eye-Movements to Visual Novelty

Background

When viewing complex scenes, East Asians attend more to contexts whereas Westerners attend more to objects, reflecting cultural differences in holistic and analytic visual processing styles respectively. This eye-tracking study investigated more specific mechanisms and the robustness of these cultural biases in visual processing when salient changes in the objects and backgrounds occur in complex pictures.

Methodology/Principal Findings

Chinese Singaporean (East Asian) and Caucasian US (Western) participants passively viewed pictures containing selectively changing objects and background scenes that strongly captured participants'' attention in a data-driven manner. We found that although participants from both groups responded to object changes in the pictures, there was still evidence for cultural divergence in eye-movements. The number of object fixations in the US participants was more affected by object change than in the Singapore participants. Additionally, despite the picture manipulations, US participants consistently maintained longer durations for both object and background fixations, with eye-movements that generally remained within the focal objects. In contrast, Singapore participants had shorter fixation durations with eye-movements that alternated more between objects and backgrounds.

Conclusions/Significance

The results demonstrate a robust cultural bias in visual processing even when external stimuli draw attention in an opposite manner to the cultural bias. These findings also extend previous studies by revealing more specific, but consistent, effects of culture on the different aspects of visual attention as measured by fixation duration, number of fixations, and saccades between objects and backgrounds.     

Cultural Adaptation of Visual Attention: Calibration of the Oculomotor Control System in Accordance with Cultural Scenes

Previous studies have found that Westerners are more likely than East Asians to attend to central objects (i.e., analytic attention), whereas East Asians are more likely than Westerners to focus on background objects or context (i.e., holistic attention). Recently, it has been proposed that the physical environment of a given culture influences the cultural form of scene cognition, although the underlying mechanism is yet unclear. This study examined whether the physical environment influences oculomotor control. Participants saw culturally neutral stimuli (e.g., a dog in a park) as a baseline, followed by Japanese or United States scenes, and finally culturally neutral stimuli again. The results showed that participants primed with Japanese scenes were more likely to move their eyes within a broader area and they were less likely to fixate on central objects compared with the baseline, whereas there were no significant differences in the eye movements of participants primed with American scenes. These results suggest that culturally specific patterns in eye movements are partly caused by the physical environment.     

A Role of Eye Vergence in Covert Attention

Covert spatial attention produces biases in perceptual and neural responses in the absence of overt orienting movements. The neural mechanism that gives rise to these effects is poorly understood. Here we report the relation between fixational eye movements, namely eye vergence, and covert attention. Visual stimuli modulate the angle of eye vergence as a function of their ability to capture attention. This illustrates the relation between eye vergence and bottom-up attention. In visual and auditory cue/no-cue paradigms, the angle of vergence is greater in the cue condition than in the no-cue condition. This shows a top-down attention component. In conclusion, observations reveal a close link between covert attention and modulation in eye vergence during eye fixation. Our study suggests a basis for the use of eye vergence as a tool for measuring attention and may provide new insights into attention and perceptual disorders.     

Combining Computer Game-Based Behavioural Experiments With High-Density EEG and Infrared Gaze Tracking

Experimental paradigms are valuable insofar as the timing and other parameters of their stimuli are well specified and controlled, and insofar as they yield data relevant to the cognitive processing that occurs under ecologically valid conditions. These two goals often are at odds, since well controlled stimuli often are too repetitive to sustain subjects'' motivation. Studies employing electroencephalography (EEG) are often especially sensitive to this dilemma between ecological validity and experimental control: attaining sufficient signal-to-noise in physiological averages demands large numbers of repeated trials within lengthy recording sessions, limiting the subject pool to individuals with the ability and patience to perform a set task over and over again. This constraint severely limits researchers'' ability to investigate younger populations as well as clinical populations associated with heightened anxiety or attentional abnormalities. Even adult, non-clinical subjects may not be able to achieve their typical levels of performance or cognitive engagement: an unmotivated subject for whom an experimental task is little more than a chore is not the same, behaviourally, cognitively, or neurally, as a subject who is intrinsically motivated and engaged with the task. A growing body of literature demonstrates that embedding experiments within video games may provide a way between the horns of this dilemma between experimental control and ecological validity. The narrative of a game provides a more realistic context in which tasks occur, enhancing their ecological validity (Chaytor & Schmitter-Edgecombe, 2003). Moreover, this context provides motivation to complete tasks. In our game, subjects perform various missions to collect resources, fend off pirates, intercept communications or facilitate diplomatic relations. In so doing, they also perform an array of cognitive tasks, including a Posner attention-shifting paradigm (Posner, 1980), a go/no-go test of motor inhibition, a psychophysical motion coherence threshold task, the Embedded Figures Test (Witkin, 1950, 1954) and a theory-of-mind (Wimmer & Perner, 1983) task. The game software automatically registers game stimuli and subjects'' actions and responses in a log file, and sends event codes to synchronise with physiological data recorders. Thus the game can be combined with physiological measures such as EEG or fMRI, and with moment-to-moment tracking of gaze. Gaze tracking can verify subjects'' compliance with behavioural tasks (e.g. fixation) and overt attention to experimental stimuli, and also physiological arousal as reflected in pupil dilation (Bradley et al., 2008). At great enough sampling frequencies, gaze tracking may also help assess covert attention as reflected in microsaccades - eye movements that are too small to foveate a new object, but are as rapid in onset and have the same relationship between angular distance and peak velocity as do saccades that traverse greater distances. The distribution of directions of microsaccades correlates with the (otherwise) covert direction of attention (Hafed & Clark, 2002).Download video file.^{(79M, mov)}     

Visuomotor origins of covert spatial attention

Covert spatial attention produces biases in perceptual performance and neural processing of behaviorally relevant stimuli in the absence of overt orienting movements. The neural mechanism that gives rise to these effects is poorly understood. This paper surveys past evidence of a relationship between oculomotor control and visual spatial attention and more recent evidence of a causal link between the control of saccadic eye movements by frontal cortex and covert visual selection. Both suggest that the mechanism of covert spatial attention emerges as a consequence of the reciprocal interactions between neural circuits primarily involved in specifying the visual properties of potential targets and those involved in specifying the movements needed to fixate them.     

Paradoxical relationship between speed and accuracy in olfactory figure-background segregation

In natural settings, many stimuli impinge on our sensory organs simultaneously. Parsing these sensory stimuli into perceptual objects is a fundamental task faced by all sensory systems. Similar to other sensory modalities, increased odor backgrounds decrease the detectability of target odors by the olfactory system. The mechanisms by which background odors interfere with the detection and identification of target odors are unknown. Here we utilized the framework of the Drift Diffusion Model (DDM) to consider possible interference mechanisms in an odor detection task. We first considered pure effects of background odors on either signal or noise in the decision-making dynamics and showed that these produce different predictions about decision accuracy and speed. To test these predictions, we trained mice to detect target odors that are embedded in random background mixtures in a two-alternative choice task. In this task, the inter-trial interval was independent of behavioral reaction times to avoid motivating rapid responses. We found that increased backgrounds reduce mouse performance but paradoxically also decrease reaction times, suggesting that noise in the decision making process is increased by backgrounds. We further assessed the contributions of background effects on both noise and signal by fitting the DDM to the behavioral data. The models showed that background odors affect both the signal and the noise, but that the paradoxical relationship between trial difficulty and reaction time is caused by the added noise.     

Background gamma activity in the rabbit electroencephalogram as an index of the level of sustained (tonic) attention in the active oddball paradigm in rabbits

Tonic brain activity substantially affects the character of subjects' responsiveness to sensory stimuli. The dynamics of background gamma-band activity in rabbit electroencephalogram was investigated in the active oddball paradigm modified for animal studies. It was shown that increase in the power and coherence of gamma activity reflects the target stimulus expectancy. Correct responses to stimuli occur at a particular level of background gamma activity, which is likely to correspond to the optimal level of sustained (tonic) attention. Decrease in the level of background gamma activity leads to omissions of responses to target stimuli, while it's excessive level results in erroneous responses to nontarget stimuli (false alarms). The observed dynamics of tonic gamma activity can be interpreted as the result of variations in the level of tonic cholinergic activation of the brain cortex.     

Possible recoding of visual space in covert orienting tasks.

Reaction time to lateralized light targets is longer if targets are preceded by light stimuli in the same visual hemifield compared to when they are preceded by light stimuli in the opposite visual hemifield. The effect is probably caused by interactions between implicit oculomotor tendencies and covert shifts of attention. We show here that a similar, but much smaller, ipsilateral RT inhibition can be observed when all stimuli are presented in a display completely lateralized to one hemifield, where ipsilateral and contralateral are defined with respect to the midpoint of the display. The persistence of ipsilateral inhibition with unilateral stimulus displays can be accounted for by a recoding of visual space predicated on the centering of covert attention on the display midpoint rather than on the fixation point. The recoding seems to affect the control of covert attention and perhaps oculomotor control as well.     

The Effects of Incidentally Learned Temporal and Spatial Predictability on Response Times and Visual Fixations during Target Detection and Discrimination

Responses are quicker to predictable stimuli than if the time and place of appearance is uncertain. Studies that manipulate target predictability often involve overt cues to speed up response times. However, less is known about whether individuals will exhibit faster response times when target predictability is embedded within the inter-trial relationships. The current research examined the combined effects of spatial and temporal target predictability on reaction time (RT) and allocation of overt attention in a sustained attention task. Participants responded as quickly as possible to stimuli while their RT and eye movements were measured. Target temporal and spatial predictability were manipulated by altering the number of: 1) different time intervals between a response and the next target; and 2) possible spatial locations of the target. The effects of target predictability on target detection (Experiment 1) and target discrimination (Experiment 2) were tested. For both experiments, shorter RTs as target predictability increased across both space and time were found. In addition, the influences of spatial and temporal target predictability on RT and the overt allocation of attention were task dependent; suggesting that effective orienting of attention relies on both spatial and temporal predictability. These results indicate that stimulus predictability can be increased without overt cues and detected purely through inter-trial relationships over the course of repeated stimulus presentations.     

Covert shift of attention modulates the ongoing neural activity in a reaching area of the macaque dorsomedial visual stream

Background

Attention is used to enhance neural processing of selected parts of a visual scene. It increases neural responses to stimuli near target locations and is usually coupled to eye movements. Covert attention shifts, however, decouple the attentional focus from gaze, allowing to direct the attention to a peripheral location without moving the eyes. We tested whether covert attention shifts modulate ongoing neuronal activity in cortical area V6A, an area that provides a bridge between visual signals and arm-motor control.

Methodology/Principal Findings

We performed single cell recordings from 3 Macaca Fascicularis trained to fixate straight-head, while shifting attention outward to a peripheral cue and inward again to the fixation point. We found that neurons in V6A are influenced by spatial attention. The attentional modulation occurs without gaze shifts and cannot be explained by visual stimulations. Visual, motor, and attentional responses can occur in combination in single neurons.

Conclusions/Significance

This modulation in an area primarily involved in visuo-motor transformation for reaching may form a neural basis for coupling attention to the preparation of reaching movements. Our results show that cortical processes of attention are related not only to eye-movements, as many studies have shown, but also to arm movements, a finding that has been suggested by some previous behavioral findings. Therefore, the widely-held view that spatial attention is tightly intertwined with—and perhaps directly derived from—motor preparatory processes should be extended to a broader spectrum of motor processes than just eye movements.     

The role of observers' gaze behaviour when watching object manipulation tasks: predicting and evaluating the consequences of action

When watching an actor manipulate objects, observers, like the actor, naturally direct their gaze to each object as the hand approaches and typically maintain gaze on the object until the hand departs. Here, we probed the function of observers'' eye movements, focusing on two possibilities: (i) that observers'' gaze behaviour arises from processes involved in the prediction of the target object of the actor''s reaching movement and (ii) that this gaze behaviour supports the evaluation of mechanical events that arise from interactions between the actor''s hand and objects. Observers watched an actor reach for and lift one of two presented objects. The observers'' task was either to predict the target object or judge its weight. Proactive gaze behaviour, similar to that seen in self-guided action–observation, was seen in the weight judgement task, which requires evaluating mechanical events associated with lifting, but not in the target prediction task. We submit that an important function of gaze behaviour in self-guided action observation is the evaluation of mechanical events associated with interactions between the hand and object. By comparing predicted and actual mechanical events, observers, like actors, can gain knowledge about the world, including information about objects they may subsequently act upon.     

Microsaccades counteract visual fading during fixation

Our eyes move continually, even while we fixate our gaze on an object. If fixational eye movements are counteracted, our perception of stationary objects fades completely, due to neural adaptation. Some studies have suggested that fixational microsaccades refresh retinal images, thereby preventing adaptation and fading. However, other studies disagree, and so the role of microsaccades remains unclear. Here, we correlate visibility during fixation to the occurrence of microsaccades. We asked subjects to indicate when Troxler fading of a peripheral target occurs, while simultaneously recording their eye movements with high precision. We found that before a fading period, the probability, rate, and magnitude of microsaccades decreased. Before transitions toward visibility, the probability, rate, and magnitude of microsaccades increased. These results reveal a direct link between suppression of microsaccades and fading and suggest a causal relationship between microsaccade production and target visibility during fixation.     

Location constancy and its effect on visual selection.

The present study investigated how location constancy influences selective attention to a cued location. The relative effectiveness of target/distractor distance and target/distractor compatibility were studied under covert and overt attention conditions. Experiment 1 measured reaction time and error rates to a scaled target letter that appeared at varied locations from 0.62 to 20 deg. Experiments 2 and 3 looked at covert/overt attention when the target location was fixed rather than varied within a block of trials. To provide a comprehensive assessment of the two primary variables across location constancy conditions, effect sizes for these results as well as for related past research (Goolkasian, 1999; Goolkasian and Tarantino, 1999) are presented. The findings suggest that the location of the target (foveal vs peripheral) does not influence attentional patterns as much as the consistency of its location. When a target appears at varied locations from trial to trial, distractor compatibility effects are in general stronger than the effect of target/distractor distance. However, the relative importance of these two variables reverses when the presentation location of the target is fixed at a constant location.     

Are Stripes Beneficial? Dazzle Camouflage Influences Perceived Speed and Hit Rates

In the animal kingdom, camouflage refers to patterns that help potential prey avoid detection. Mostly camouflage is thought of as helping prey blend in with their background. In contrast, disruptive or dazzle patterns protect moving targets and have been suggested as an evolutionary force in shaping the dorsal patterns of animals. Dazzle patterns, such as stripes and zigzags, are thought to reduce the probability with which moving prey will be captured by impairing predators'' perception of speed. We investigated how different patterns of stripes (longitudinal—i.e., parallel to movement direction–and vertical–i.e., perpendicular to movement direction) affect the probability with which humans can hit moving objects and if differences in hitting probability are caused by a misperception of speed. A first experiment showed that longitudinally striped objects were hit more often than unicolored objects. However, vertically striped objects did not differ from unicolored objects. A second study examining the link between perceived speed and hitting probability showed that longitudinally and vertically striped objects were both perceived as moving faster and were hit more often than unicolored objects. In sum, our results provide evidence that striped patterns disrupt the perception of speed, which in turn influences how often objects are hit. However, the magnitude and the direction of the effects depend on additional factors such as speed and the task setup.     

Searching for asymmetries in the detection of gaze contact versus averted gaze under different head views: a behavioural study

Eye contact is a crucial social cue constituting a frequent preliminary to interaction. Thus, the perception of others' gaze may be associated with specific processes beginning with asymmetries in the detection of direct versus averted gaze. We tested this hypothesis in two behavioural experiments using realistic eye stimuli in a visual search task. We manipulated the head orientation (frontal or deviated) and the visual field (right or left) in which the target appeared at display onset. We found that direct gaze targets presented among averted gaze distractors were detected faster and better than averted gaze targets among direct gaze distractors, but only when the head was deviated. Moreover, direct gaze targets were detected very quickly and efficiently regardless of head orientation and visual field, whereas the detection of averted gaze was strongly modulated by these factors. These results suggest that gaze contact has precedence over contextual information such as head orientation and visual field.     

Size as a parameter for tuning visual attention]

The ability of visual attention to tune to the stimulus size (when this size could not be described by spatial frequencies) was studies. Sinusoidal gratings with frequencies of 1.5, 3, and 6 cycle/degree were used as test stimuli. All these stimuli consisted of 3 periods, consequently, they had different sizes: 2 x 2, 1 x 1, and 0.5 x 0.5 degrees. Three reference stimuli had the same sizes but were constructed as a superposition of all the test frequencies. The reference stimulus of suprathreshold contrast was displayed for 400 ms to the left or to the right of a fixation point at a distance of 3 degrees. After that, the test stimulus of threshold contrast was for 100 ms displayed symmetrically to the fixation point on the other side. Subjects were instructed that the sizes of the reference and test stimuli were the same. It was found that the probability of test detection decreased with increase in the difference between the sizes of the reference and test stimuli. Since in our experiments the spatial frequency could not be used for tuning visual attention, the obtained results suggest that there are specialized mechanisms in the visual system for estimation of the general image size.     

Racial group membership is associated to gaze-mediated orienting in Italy

Viewing a face with averted gaze results in a spatial shift of attention in the corresponding direction, a phenomenon defined as gaze-mediated orienting. In the present paper, we investigated whether this effect is influenced by social factors. Across three experiments, White and Black participants were presented with faces of White and Black individuals. A modified spatial cueing paradigm was used in which a peripheral target stimulus requiring a discrimination response was preceded by a noninformative gaze cue. Results showed that Black participants shifted attention to the averted gaze of both ingroup and outgroup faces, whereas White participants selectively shifted attention only in response to individuals of their same group. Interestingly, the modulatory effect of social factors was context-dependent and emerged only when group membership was situationally salient to participants. It was hypothesized that differences in the relative social status of the two groups might account for the observed asymmetry between White and Black participants. A final experiment ruled out an alternative explanation based on differences in perceptual familiarity with the face stimuli. Overall, these findings strengthen the idea that gaze-mediated orienting is a socially-connoted phenomenon.     

Covert tracking: a combined ERP and fixational eye movement study

Attention can be directed to particular spatial locations, or to objects that appear at anticipated points in time. While most work has focused on spatial or temporal attention in isolation, we investigated covert tracking of smoothly moving objects, which requires continuous coordination of both. We tested two propositions about the neural and cognitive basis of this operation: first that covert tracking is a right hemisphere function, and second that pre-motor components of the oculomotor system are responsible for driving covert spatial attention during tracking. We simultaneously recorded event related potentials (ERPs) and eye position while participants covertly tracked dots that moved leftward or rightward at 12 or 20°/s. ERPs were sensitive to the direction of target motion. Topographic development in the leftward motion was a mirror image of the rightward motion, suggesting that both hemispheres contribute equally to covert tracking. Small shifts in eye position were also lateralized according to the direction of target motion, implying covert activation of the oculomotor system. The data addresses two outstanding questions about the nature of visuospatial tracking. First, covert tracking is reliant upon a symmetrical frontoparietal attentional system, rather than being right lateralized. Second, this same system controls both pursuit eye movements and covert tracking.     

Joint Attention without Gaze Following: Human Infants and Their Parents Coordinate Visual Attention to Objects through Eye-Hand Coordination

The coordination of visual attention among social partners is central to many components of human behavior and human development. Previous research has focused on one pathway to the coordination of looking behavior by social partners, gaze following. The extant evidence shows that even very young infants follow the direction of another''s gaze but they do so only in highly constrained spatial contexts because gaze direction is not a spatially precise cue as to the visual target and not easily used in spatially complex social interactions. Our findings, derived from the moment-to-moment tracking of eye gaze of one-year-olds and their parents as they actively played with toys, provide evidence for an alternative pathway, through the coordination of hands and eyes in goal-directed action. In goal-directed actions, the hands and eyes of the actor are tightly coordinated both temporally and spatially, and thus, in contexts including manual engagement with objects, hand movements and eye movements provide redundant information about where the eyes are looking. Our findings show that one-year-olds rarely look to the parent''s face and eyes in these contexts but rather infants and parents coordinate looking behavior without gaze following by attending to objects held by the self or the social partner. This pathway, through eye-hand coupling, leads to coordinated joint switches in visual attention and to an overall high rate of looking at the same object at the same time, and may be the dominant pathway through which physically active toddlers align their looking behavior with a social partner.     

Exogenous orienting of attention depends upon the ability to execute eye movements

Shifts of attention can be made overtly by moving the eyes or covertly with attention being allocated to a region of space that does not correspond to the current direction of gaze. However, the precise relationship between eye movements and the covert orienting of attention remains controversial. The influential premotor theory proposes that the covert orienting of attention is produced by the programming of (unexecuted) eye movements and thus predicts a strong relationship between the ability to execute eye movements and the operation of spatial attention. Here, we demonstrate for the first time that impaired spatial attention is observed in an individual (AI) who is neurologically healthy but who cannot execute eye movements as a result of a congenital impairment in the elasticity of her eye muscles. This finding provides direct support for the role of the eye-movement system in the covert orienting of attention and suggests that whereas intact cortical structures may be necessary for normal attentional reflexes, they are not sufficient. The ability to move our eyes is essential for the development of normal patterns of spatial attention.