Joint Attention without Gaze Following: Human Infants and Their Parents Coordinate Visual Attention to Objects through Eye-Hand Coordination

The coordination of visual attention among social partners is central to many components of human behavior and human development. Previous research has focused on one pathway to the coordination of looking behavior by social partners, gaze following. The extant evidence shows that even very young infants follow the direction of another''s gaze but they do so only in highly constrained spatial contexts because gaze direction is not a spatially precise cue as to the visual target and not easily used in spatially complex social interactions. Our findings, derived from the moment-to-moment tracking of eye gaze of one-year-olds and their parents as they actively played with toys, provide evidence for an alternative pathway, through the coordination of hands and eyes in goal-directed action. In goal-directed actions, the hands and eyes of the actor are tightly coordinated both temporally and spatially, and thus, in contexts including manual engagement with objects, hand movements and eye movements provide redundant information about where the eyes are looking. Our findings show that one-year-olds rarely look to the parent''s face and eyes in these contexts but rather infants and parents coordinate looking behavior without gaze following by attending to objects held by the self or the social partner. This pathway, through eye-hand coupling, leads to coordinated joint switches in visual attention and to an overall high rate of looking at the same object at the same time, and may be the dominant pathway through which physically active toddlers align their looking behavior with a social partner.     

Mirror-induced social facilitation in stumptailed macaques (Macaca arctoides)

Seven adult female stumptailed macaques (Macaca arctoides) were confronted alternately with their reflection in a mirror and with the mirror covered. The reflection elicited significantly more visual attention and social responding than the control stimulus, replicating previous findings. Mirror-image stimulation did not significantly affect the subjects' manipulation of unfamiliar objects, but it did increase bout-lengths of episodes of drinking from a bottle containing orange juice. Possible explanations for the ability of the mirror to induce social facilitation of drinking but not of object manipulation are discussed, along with possible underlying mechanisms. Mirror-induced social facilitation is further evidence that monkeys interpret their reflection as a conspecific.     

Clinical evaluation of VEPs to interleaved checkerboard reversal stimulation of central,hemi- and peripheral fields

The VEPs of 195 patients referred for supportive evidence of multiple sclerosis or optic neuritis were studied by a new method of interleaved checkerboard reversal stimulation of different areas of the visual field. In the first group of 95 patients checks of 40′ subtense reversed in the whole field (28° × 20°), alternately in the left and right hemifields and alternately in the central (5° radius) and peripheral fields. In the second group of 100 patients checks reversed in the whole field and in interleaved mode in 3 visual field areas, comprising the central (4° radius) and left and right hemisurround fields.In the first group abnormal responses were recorded from 52 eyes and there was partial disagreement among the stimulus conditions in 10 of the 52. Abnormalities were seen uniquely to central field stimulation in 3 eyes but never to whole field stimulation alone. In the second group abnormal responses were recorded in 58 eyes, again never uniquely to whole field stimulation, while abnormalities confined to one or two areas of the visual field were seen in 24, providing evidence of peripheral field involvement alone in 8 eyes.In the first group, waveforms created from the sum of the left and right hemifield and central and peripheral field responses showed quite close conformity to the whole field VEP, although amplitudes were significantly lower and latencies significantly shorter. In 7 eyes responses would have been differently classified (normal or abnormal) using the sum as compared with the whole fields. The sum of the 3 interleaved stimuli was less reliable, its morphology often not closely approximating whole field responses.It is suggested that interleaved stimulation of two or more areas of the visual field is a sensitive and reliable method which reduces the time necessary to perform the test and helps control the patients' concentration, fixation and alertness. Whole field stimulation is probably necessary only in patients with severely degraded responses.     

Bodily Illusions in Young Children: Developmental Change in Visual and Proprioceptive Contributions to Perceived Hand Position

We examined the visual capture of perceived hand position in forty-five 5- to 7-year-olds and in fifteen young adults, using a mirror illusion task. In this task, participants see their left hand on both the left and right (by virtue of a mirror placed at the midline facing the left arm, and obscuring the right). The accuracy of participants’ reaching was measured when proprioceptive and visual cues to the location of the right arm were put into conflict (by placing the arms at different distances from the mirror), and also when only proprioceptive information was available (i.e., when the mirror was covered). Children in all age-groups (and adults) made reaching errors in the mirror condition in accordance with the visually-specified illusory starting position of their hand indicating a visual capture of perceived hand position. Data analysis indicated that visual capture increased substantially up until 6 years of age. These findings are interpreted with respect to the development of the visual guidance of action in early childhood.     

Looking for Myself: Current Multisensory Input Alters Self-Face Recognition

How do I know the person I see in the mirror is really me? Is it because I know the person simply looks like me, or is it because the mirror reflection moves when I move, and I see it being touched when I feel touch myself? Studies of face-recognition suggest that visual recognition of stored visual features inform self-face recognition. In contrast, body-recognition studies conclude that multisensory integration is the main cue to selfhood. The present study investigates for the first time the specific contribution of current multisensory input for self-face recognition. Participants were stroked on their face while they were looking at a morphed face being touched in synchrony or asynchrony. Before and after the visuo-tactile stimulation participants performed a self-recognition task. The results show that multisensory signals have a significant effect on self-face recognition. Synchronous tactile stimulation while watching another person''s face being similarly touched produced a bias in recognizing one''s own face, in the direction of the other person included in the representation of one''s own face. Multisensory integration can update cognitive representations of one''s body, such as the sense of ownership. The present study extends this converging evidence by showing that the correlation of synchronous multisensory signals also updates the representation of one''s face. The face is a key feature of our identity, but at the same time is a source of rich multisensory experiences used to maintain or update self-representations.     

Hemifield effects in multiple identity tracking

In everyday life, we often need to attentively track moving objects. A previous study has claimed that this tracking occurs independently in the left and right visual hemifields (Alvarez & Cavanagh, 2005, Psychological Science,16, 637–647). Specifically, it was shown that observers were much more accurate at tracking objects that were spread over both visual hemifields as opposed to when all were confined to a single visual hemifield. In that study, observers were not required to remember the identities of the objects. Conversely, in real life, there is seldom any benefit to tracking an object unless you can also recall its identity. It has been predicted that when observers are required to remember the identities of the tracked objects a bilateral advantage should no longer be observed (Oksama & Hyönä, 2008, Cognitive Psychology, 56, 237–283). We tested this prediction and found that a bilateral advantage still occurred, though it was not as strong as when observers were not required to remember the identities of the targets. Even in the later case we found that tracking was not completely independent in the two visual hemifields. We present a combined model of multiple object tracking and multiple identity tracking that can explain our data.     

A preference for contralateral stimuli in human object- and face-selective cortex

Visual input from the left and right visual fields is processed predominantly in the contralateral hemisphere. Here we investigated whether this preference for contralateral over ipsilateral stimuli is also found in high-level visual areas that are important for the recognition of objects and faces. Human subjects were scanned with functional magnetic resonance imaging (fMRI) while they viewed and attended faces, objects, scenes, and scrambled images in the left or right visual field. With our stimulation protocol, primary visual cortex responded only to contralateral stimuli. The contralateral preference was smaller in object- and face-selective regions, and it was smallest in the fusiform gyrus. Nevertheless, each region showed a significant preference for contralateral stimuli. These results indicate that sensitivity to stimulus position is present even in high-level ventral visual cortex.     

Perceived object stability depends on multisensory estimates of gravity

Background

How does the brain estimate object stability? Objects fall over when the gravity-projected centre-of-mass lies outside the point or area of support. To estimate an object''s stability visually, the brain must integrate information across the shape and compare its orientation to gravity. When observers lie on their sides, gravity is perceived as tilted toward body orientation, consistent with a representation of gravity derived from multisensory information. We exploited this to test whether vestibular and kinesthetic information affect this visual task or whether the brain estimates object stability solely from visual information.

Methodology/Principal Findings

In three body orientations, participants viewed images of objects close to a table edge. We measured the critical angle at which each object appeared equally likely to fall over or right itself. Perceived gravity was measured using the subjective visual vertical. The results show that the perceived critical angle was significantly biased in the same direction as the subjective visual vertical (i.e., towards the multisensory estimate of gravity).

Conclusions/Significance

Our results rule out a general explanation that the brain depends solely on visual heuristics and assumptions about object stability. Instead, they suggest that multisensory estimates of gravity govern the perceived stability of objects, resulting in objects appearing more stable than they are when the head is tilted in the same direction in which they fall.     

What are birds looking at? Head movements and eye use in chickens

Using video recordings of hens, Gallus gallus domesticus, as they approached different kinds of objects, I examined how change in object distance is associated with a change from lateral to binocular viewing. The birds tended to view distant objects laterally while they preferentially viewed objects less than 20-30 cm away frontally; this was true whether they were looking at another bird or at an inanimate object. However, as well as switching between lateral and frontal viewing, the hens also swung their heads from side to side with movements so large that the same object appeared to be viewed with completely different parts of the retina, and even with different eyes, in rapid succession. When confronted with a novel object, the hens walked more slowly but continued to show large head movements. This suggests that, unlike mammals, which gaze fixedly at novel objects, hens investigate them by moving the head and looking at them with different, specialized, parts of their eyes. Many aspects of bird behaviour, such as search image formation, vigilance and visual discriminations, may be affected by the way they move the head and eyes. Copyright 2002 The Association for the Study of Animal Behaviour. Published by Elsevier Science Ltd. All rights reserved.     

The case of the disappearing bone: Dogs’ understanding of the physical properties of objects

To assess dogs’ memory for an occluded object, a gaze duration procedure was used similar to one often used with nonverbal infants. A bone shaped dog biscuit was placed behind a solid screen that then rotated in the depth plane through an arc front to back. Dogs were shown either of the two test events. In one event (the possible event), the screen rotated until it reached the point at which it would have reached the bone and then stopped (about 120°); in the other event (the impossible event), the screen rotated through a full 180° arc, as though it had passed through the bone. The dogs looked significantly longer at the impossible event. To control for the differential time it took for the screen to move, for a control group, a bone was placed behind the screen and the screen was rotated either 60° or 120° (both possible events). No difference in looking time was found. To control for the movement of the screen through 120° or 180° when both were possible, for a second control group, the bone was placed to the side of the screen rather than behind the screen and the screen was moved 120° or 180°. Again, no significant difference in looking time was found. Results suggest that much like young children, dogs understand the physical properties of an occluded object. That is they appear to understand that an object (such as a screen) should not be able to pass through another object (such as dog bone).     

Use of a mirror to direct their responses in Japanese monkeys (Macaca fuscata fuscata)

Two male Japanese monkeys used a mirror to inspect an object attached to their bodies but not directly visible. These monkeys had been trained previously to use a mirror to guide their hand to a target. In Experiment 1 their behavior in the presence of a mirror was observed. In Experiment 2 the monkeys used the mirror to locate a picture projected on a screen to the left or right rear side of the cage. In Experiment 3 the monkeys used a mirror to observe and finally grasp an object attached behind their heads. Two monkeys who were not trained to use a mirror to obtain an otherwise hidden object did not show such behavior.     

Northern bald ibises follow others’ gaze into distant space but not behind barriers

Gaze following is the ability to use the visual orientation of others as a trigger to look in the same direction. Thereby, animals may either align their head and eye orientation with others (gaze following into distant space) or may even reposition themselves to look behind barriers impairing their perception (geometrical gaze following). It has been proposed that these two different modes are functionally and cognitively distinct, but experimental evidence for this claim is lacking. We here, to our knowledge, demonstrate for the first time, that adult animals may be capable of following gaze into distant space, but not geometrically around barriers. We tested Northern bald ibises (Geronticus eremita) for their ability to follow a conspecific''s gaze in two standard tasks. The birds readily looked up after seeing a model bird looking up; however, when seeing a model looking behind a barrier, they responded by looking at the barrier instead of walking around. These findings are in stark contrast to results obtained with great apes and corvids and provide the first experimental evidence, to our knowledge, for cognitive differences in gaze following tasks.     

Tactile Gap Detection Deteriorates during Bimanual Symmetrical Movements under Mirror Visual Feedback

It has been suggested that incongruence between signals for motor intention and sensory input can cause pain and other sensory abnormalities. This claim is supported by reports that moving in an environment of induced sensorimotor conflict leads to elevated pain and sensory symptoms in those with certain painful conditions. Similar procedures can lead to reports of anomalous sensations in healthy volunteers too. In the present study, we used mirror visual feedback to investigate the effects of sensorimotor incongruence on responses to stimuli that arise from sources external to the body, in particular, touch. Incongruence between the sensory and motor signals for the right arm was manipulated by having the participants make symmetrical or asymmetrical movements while watching a reflection of their left arm in a parasagittal mirror, or the left hand surface of a similarly positioned opaque board. In contrast to our prediction, sensitivity to the presence of gaps in tactile stimulation of the right forearm was not reduced when participants made asymmetrical movements during mirror visual feedback, as compared to when they made symmetrical or asymmetrical movements with no visual feedback. Instead, sensitivity was reduced when participants made symmetrical movements during mirror visual feedback relative to the other three conditions. We suggest that small discrepancies between sensory and motor information, as they occur during mirror visual feedback with symmetrical movements, can impair tactile processing. In contrast, asymmetrical movements with mirror visual feedback may not impact tactile processing because the larger discrepancies between sensory and motor information may prevent the integration of these sources of information. These results contrast with previous reports of anomalous sensations during exposure to both low and high sensorimotor conflict, but are nevertheless in agreement with a forward model interpretation of perceptual modulations during goal directed movement.     

Spatial frames of reference and somatosensory processing: a neuropsychological perspective.

In patients with lesions in the right hemisphere, frequently involving the posterior parietal regions, left-sided somatosensory (and visual and motor) deficits not only reflect a disorder of primary sensory processes, but also have a higher-order component related to a defective spatial representation of the body. This additional factor, related to right brain damage, is clinically relevant: contralesional hemianaesthesia (and hemianopia and hemiplegia) is more frequent in right brain-damaged patients than in patients with damage to the left side of the brain. Three main lines of investigation suggest the existence of this higher-order pathological factor. (i) Right brain-damaged patients with left hemineglect may show physiological evidence of preserved processing of somatosensory stimuli, of which they are not aware. Similar results have been obtained in the visual domain. (ii) Direction-specific vestibular, visual optokinetic and somatosensory or proprioceptive stimulations may displace spatial frames of reference in right brain-damaged patients with left hemineglect, reducing or increasing the extent of the patients'' ipsilesional rightward directional error, and bring about similar directional effects in normal subjects. These stimulations, which may improve or worsen a number of manifestations of the neglect syndrome (such as extrapersonal and personal hemineglect), have similar effects on the severity of left somatosensory deficits (defective detection of tactile stimuli, position sense disorders). However, visuospatial hemineglect and the somatosensory deficits improved by these stimulations are independent, albeit related, disorders. (iii) The severity of left somatosensory deficits is affected by the spatial position of body segments, with reference to the midsagittal plane of the trunk. A general implication of these observations is that spatial (non-somatotopic) levels of representation contribute to corporeal awareness. The neural basis of these spatial frames includes the posterior parietal and the premotor frontal regions. These spatial representations could provide perceptual-premotor interfaces for the organization of movements (e.g. pointing, locomotion) directed towards targets in personal and extrapersonal space. In line with this view, there is evidence that the sensory stimulations that modulate left somatosensory deficits affect left motor disorders in a similar, direction-specific, fashion.     

Domestic dogs and puppies can use human voice direction referentially

Domestic dogs are particularly skilled at using human visual signals to locate hidden food. This is, to our knowledge, the first series of studies that investigates the ability of dogs to use only auditory communicative acts to locate hidden food. In a first study, from behind a barrier, a human expressed excitement towards a baited box on either the right or left side, while sitting closer to the unbaited box. Dogs were successful in following the human''s voice direction and locating the food. In the two following control studies, we excluded the possibility that dogs could locate the box containing food just by relying on smell, and we showed that they would interpret a human''s voice direction in a referential manner only when they could locate a possible referent (i.e. one of the boxes) in the environment. Finally, in a fourth study, we tested 8–14-week-old puppies in the main experimental test and found that those with a reasonable amount of human experience performed overall even better than the adult dogs. These results suggest that domestic dogs’ skills in comprehending human communication are not based on visual cues alone, but are instead multi-modal and highly flexible. Moreover, the similarity between young and adult dogs’ performances has important implications for the domestication hypothesis.     

Responses of capuchin monkeys (Cebus apella) to different conditions of mirror-image stimulation

Group-living brown capuchins were given mirror-image stimulation as follows: (1) mirror 1 m away; (2) mirror attached to the cage-mesh; (3) angled mirrors creating a deflected image; (4) small mirror in the cage; and (5) small, transportable mirrors. The subjects were initially interested in the mirrors in each condition, but they generally habituated to them over the course of repeated presentations. Control (non-reflective) objects were attended to less than mirrors. Facial expressions occurred mostly in Condition 2, lateral and vertical head movements in Condition 3, reaching behind the mirror in Condition 2, looking obliquely into the mirror in Conditions 4 and 5. Despite these diverse conditions of exposure to mirrors, lasting for a total of over three months, no behaviours suggesting self-recognition were seen in the monkeys.     

Associatieve visuele agnosie. De minder zichtbare gevolgen van een herseninfarct

After a cerebral infarction, some patients acutely demonstrate contralateral hemiplegia, or aphasia. Those are the obvious symptoms of a cerebral infarction. However, less visible but burdensome consequences may go unnoticed without closer investigation. The importance of a thorough clinical examination is exemplified by a single case study of a 72-year-old, right-handed male. Two years before he had suffered from an ischemic stroke in the territory of the left posterior cerebral artery, with right homonymous hemianopia and global alexia (i.e., impairment in letter recognition and profound impairment of reading) without agraphia. Naming was impaired on visual presentation (20%-39% correct), but improved significantly after tactile presentation (87% correct) or verbal definition (89%). Pre-semantic visual processing was normal (correct matching of different views of the same object), as was his access to structural knowledge from vision (he reliably distinguished real objects from non-objects). On a colour decision task he reliably indicated which of two items was coloured correctly. Though he was unable to mime how visually presented objects were used, he more reliably matched pictures of objects with pictures of a mime artist gesturing the use of the object. He obtained normal scores on word definition (WAIS-III), synonym judgment and word-picture matching tasks with perceptual and semantic distractors. He however failed when he had to match physically dissimilar specimens of the same object or when he had to decide which two of five objects were related associatively (Pyramids and Palm Trees Test). The patient thus showed a striking contrast in his intact ability to access knowledge of object shape or colour from vision and impaired functional and associative knowledge. As a result, he could not access a complete semantic representation, required for activating phonological representations to name visually presented objects. The pattern of impairments and preserved abilities is considered to be a specific difficulty to access a full semantic representation from an intact structural representation of visually presented objects, i.e., a form of visual object agnosia.     

Crowding by invisible flankers

Background

Human object recognition degrades sharply as the target object moves from central vision into peripheral vision. In particular, one''s ability to recognize a peripheral target is severely impaired by the presence of flanking objects, a phenomenon known as visual crowding. Recent studies on how visual awareness of flanker existence influences crowding had shown mixed results. More importantly, it is not known whether conscious awareness of the existence of both the target and flankers are necessary for crowding to occur.

Methodology/Principal Findings

Here we show that crowding persists even when people are completely unaware of the flankers, which are rendered invisible through the continuous flash suppression technique. Contrast threshold for identifying the orientation of a grating pattern was elevated in the flanked condition, even when the subjects reported that they were unaware of the perceptually suppressed flankers. Moreover, we find that orientation-specific adaptation is attenuated by flankers even when both the target and flankers are invisible.

Conclusions

These findings complement the suggested correlation between crowding and visual awareness. What''s more, our results demonstrate that conscious awareness and attention are not prerequisite for crowding.