Our Faces in the Dog's Brain: Functional Imaging Reveals Temporal Cortex Activation during Perception of Human Faces

Dogs have a rich social relationship with humans. One fundamental aspect of it is how dogs pay close attention to human faces in order to guide their behavior, for example, by recognizing their owner and his/her emotional state using visual cues. It is well known that humans have specific brain regions for the processing of other human faces, yet it is unclear how dogs’ brains process human faces. For this reason, our study focuses on describing the brain correlates of perception of human faces in dogs using functional magnetic resonance imaging (fMRI). We trained seven domestic dogs to remain awake, still and unrestrained inside an MRI scanner. We used a visual stimulation paradigm with block design to compare activity elicited by human faces against everyday objects. Brain activity related to the perception of faces changed significantly in several brain regions, but mainly in the bilateral temporal cortex. The opposite contrast (i.e., everyday objects against human faces) showed no significant brain activity change. The temporal cortex is part of the ventral visual pathway, and our results are consistent with reports in other species like primates and sheep, that suggest a high degree of evolutionary conservation of this pathway for face processing. This study introduces the temporal cortex as candidate to process human faces, a pillar of social cognition in dogs.     

The development of face expertise

Recent neuroimaging studies in adults indicate that visual areas selective for recognition of faces can be recruited through expertise for nonface objects. This reflects a new emphasis on experience in theories of visual specialization. In addition, novel work infers differences between categories of nonface objects, allowing a re-interpretation of differences seen between recognition of faces and objects. Whether there are experience-independent precursors of face expertise remains unclear; indeed, parallels between literature for infants and adults suggest that methodological issues need to be addressed before strong conclusions can be drawn regarding the origins of face recognition.     

Face pictures reduce behavioural, autonomic, endocrine and neural indices of stress and fear in sheep

Faces are highly emotive stimuli and we find smiling or familiar faces both attractive and comforting, even as young babies. Do other species with sophisticated face recognition skills, such as sheep, also respond to the emotional significance of familiar faces? We report that when sheep experience social isolation, the sight of familiar sheep face pictures compared with those of goats or inverted triangles significantly reduces behavioural (activity and protest vocalizations), autonomic (heart rate) and endocrine (cortisol and adrenaline) indices of stress. They also increase mRNA expression of activity-dependent genes (c-fos and zif/268) in brain regions specialized for processing faces (temporal and medial frontal cortices and basolateral amygdala) and for emotional control (orbitofrontal and cingulate cortex), and reduce their expression in regions associated with stress responses (hypothalamic paraventricular nucleus) and fear (central and lateral amygdala). Effects on face recognition, emotional control and fear centres are restricted to the right brain hemisphere. Results provide evidence that face pictures may be useful for relieving stress caused by unavoidable social isolation in sheep, and possibly other animal species, including humans. The finding that sheep, like humans, appear to have a right brain hemisphere involvement in the control of negative emotional experiences also suggests that functional lateralization of brain emotion systems may be a general feature in mammals.     

Asymmetry of the cerebral hemispheres during comparison of paired visual stimuli

In conditions of tachistoscopic presentation of visual stimuli, healthy (male and female) right-handed subjects carried out a paired comparison of the stimuli presented unilaterally and in the center of the visual field. In case of recognition of images of words and objects, the number of correct answers and motor reaction time usually did not significantly differ at two interstimuli intervals (1 and 10 s). In comparing images of faces, there also were no differences by the number of reactions, and the reaction time was less at the intervals of 1 s. The left hemisphere dominated at the identification of words and female faces, the right one--at the recognition of male faces. When the right visual field was stimulated images of various classes were recognized more differentially than at the stimulation of the left visual field. The male subjects had more prominent interhemispheric differences than the females. The increase of the interstimuli interval from 1 to 10 s brought to a weakening of the functional interhemispheric asymmetry and decreasing of the differences between the male and female subjects. The obtained data show that in the processes connected with short-time memory, functional interhemispheric asymmetry is basically formed at the initial stages of the information processing.     

Second-order relational manipulations affect both humans and monkeys

Recognition and individuation of conspecifics by their face is essential for primate social cognition. This ability is driven by a mechanism that integrates the appearance of facial features with subtle variations in their configuration (i.e., second-order relational properties) into a holistic representation. So far, there is little evidence of whether our evolutionary ancestors show sensitivity to featural spatial relations and hence holistic processing of faces as shown in humans. Here, we directly compared macaques with humans in their sensitivity to configurally altered faces in upright and inverted orientations using a habituation paradigm and eye tracking technologies. In addition, we tested for differences in processing of conspecific faces (human faces for humans, macaque faces for macaques) and non-conspecific faces, addressing aspects of perceptual expertise. In both species, we found sensitivity to second-order relational properties for conspecific (expert) faces, when presented in upright, not in inverted, orientation. This shows that macaques possess the requirements for holistic processing, and thus show similar face processing to that of humans.     

Reading faces: differential lateral gaze bias in processing canine and human facial expressions in dogs and 4-year-old children

Sensitivity to the emotions of others provides clear biological advantages. However, in the case of heterospecific relationships, such as that existing between dogs and humans, there are additional challenges since some elements of the expression of emotions are species-specific. Given that faces provide important visual cues for communicating emotional state in both humans and dogs, and that processing of emotions is subject to brain lateralisation, we investigated lateral gaze bias in adult dogs when presented with pictures of expressive human and dog faces. Our analysis revealed clear differences in laterality of eye movements in dogs towards conspecific faces according to the emotional valence of the expressions. Differences were also found towards human faces, but to a lesser extent. For comparative purpose, a similar experiment was also run with 4-year-old children and it was observed that they showed differential processing of facial expressions compared to dogs, suggesting a species-dependent engagement of the right or left hemisphere in processing emotions.     

Visual search for orientation of faces by a chimpanzee (<Emphasis Type="Italic">Pan troglodytes</Emphasis>): face-specific upright superiority and the role of facial configural properties

A previous experiment showed that a chimpanzee performed better in searching for a target human face that differed in orientation from distractors when the target had an upright orientation than when targets had inverted or horizontal orientation [Tomonaga (1999a) Primate Res 15:215–229]. This upright superiority effect was also seen when using chimpanzee faces as targets but not when using photographs of a house. The present study sought to extend these results and explore factors affecting the face-specific upright superiority effect. Upright superiority was shown in a visual search for orientation when caricaturized human faces and dog faces were used as stimuli for the chimpanzee but not when shapes of a hand and chairs were presented. Thus, the configural properties of facial features, which cause an inversion effect in face recognition in humans and chimpanzees, were thought to be a source of the upright superiority effect in the visual search process. To examine this possibility, various stimuli manipulations were introduced in subsequent experiments. The results clearly show that the configuration of facial features plays a critical role in the upright superiority effect, and strongly suggest similarity in face processing in humans and chimpanzees.     

Inversion effect in perception of human faces in a chimpanzee (Pan troglodytes)

Three experiments investigated the inversion effect in face perception by a chimpanzee (Pantroglodytes) under the matching-to-sample paradigm. The first two experiments addressed the inversion effect in the perception of human faces. In Experiment 1, the subject received identity matching using 104 photographs of faces and houses presented in four different orientations. The chimpanzee showed better accuracy when the faces were presented upright than when they were inverted. The inversion effect was not found for photographs of houses. In Experiment 2, the subject received rotational matching in which the sample and comparisons differed in orientation. The subject showed a clear inversion effect for faces but not for houses. Experiment 3 explored the hemispheric specialization of the face inversion effect with chimeric (artificially composed) faces. The subject showed no visual-field preference when the chimeric faces were presented as samples under nonreinforced probe testing, while the inversion effect was evident when the discrimination was based on the left part of the chimeric sample. The results suggested that the face-inversion was specific to the left visual field (i.e. right hemispheric processing). In general, these results were consistent with those found in humans in similar testing situations.     

A preference for contralateral stimuli in human object- and face-selective cortex

Visual input from the left and right visual fields is processed predominantly in the contralateral hemisphere. Here we investigated whether this preference for contralateral over ipsilateral stimuli is also found in high-level visual areas that are important for the recognition of objects and faces. Human subjects were scanned with functional magnetic resonance imaging (fMRI) while they viewed and attended faces, objects, scenes, and scrambled images in the left or right visual field. With our stimulation protocol, primary visual cortex responded only to contralateral stimuli. The contralateral preference was smaller in object- and face-selective regions, and it was smallest in the fusiform gyrus. Nevertheless, each region showed a significant preference for contralateral stimuli. These results indicate that sensitivity to stimulus position is present even in high-level ventral visual cortex.     

Are All Types of Expertise Created Equal? Car Experts Use Different Spatial Frequency Scales for Subordinate Categorization of Cars and Faces

A much-debated question in object recognition is whether expertise for faces and expertise for non-face objects utilize common perceptual information. We investigated this issue by assessing the diagnostic information required for different types of expertise. Specifically, we asked whether face categorization and expert car categorization at the subordinate level relies on the same spatial frequency (SF) scales. Fifteen car experts and fifteen novices performed a category verification task with spatially filtered images of faces, cars, and airplanes. Images were categorized based on their basic (e.g. “car”) and subordinate level (e.g. “Japanese car”) identity. The effect of expertise was not evident when objects were categorized at the basic level. However, when the car experts categorized faces and cars at the subordinate level, the two types of expertise required different kinds of SF information. Subordinate categorization of faces relied on low SFs more than on high SFs, whereas subordinate expert car categorization relied on high SFs more than on low SFs. These findings suggest that expertise in the recognition of objects and faces do not utilize the same type of information. Rather, different types of expertise require different types of diagnostic visual information.     

Direct intracranial, FMRI, and lesion evidence for the causal role of left inferotemporal cortex in reading

Models of the "visual word form system" postulate that a left occipitotemporal region implements the automatic visual word recognition required for efficient reading. This theory was assessed in a patient in whom reading was explored with behavioral measures, fMRI, and intracranial local field potentials. Prior to surgery, when reading was normal, fMRI revealed a normal mosaic of ventral visual selectivity for words, faces, houses, and tools. Intracranial recordings demonstrated that the left occipitotemporal cortex responded with a short latency to conscious but also to subliminal words. Surgery removed a small portion of word-responsive occipitotemporal cortex overlapping with the word-specific fMRI activation. The patient developed a marked reading deficit, while recognition of other visual categories remained intact. Furthermore, in the post-surgery fMRI map of visual cortex, only word-specific activations disappeared. Altogether, these results provide direct evidence for the causal role of the left occipitotemporal cortex in the recognition of visual words.     

Selectivity of Face Perception to Horizontal Information over Lifespan (from 6 to 74 Year Old)

Face recognition in young human adults preferentially relies on the processing of horizontally-oriented visual information. We addressed whether the horizontal tuning of face perception is modulated by the extensive experience humans acquire with faces over the lifespan, or whether it reflects an invariable processing bias for this visual category. We tested 296 subjects aged from 6 to 74 years in a face matching task. Stimuli were upright and inverted faces filtered to preserve information in the horizontal or vertical orientation, or both (HV) ranges. The reliance on face-specific processing was inferred based on the face inversion effect (FIE). FIE size increased linearly until young adulthood in the horizontal but not the vertical orientation range of face information. These findings indicate that the protracted specialization of the face processing system relies on the extensive experience humans acquire at encoding the horizontal information conveyed by upright faces.     

Asymmetrical activation in the human brain during processing of fearful faces

Traditional split-field studies and patient research indicate a privileged role for the right hemisphere in emotional processing [1-7], but there has been little direct fMRI evidence for this, despite many studies on emotional-face processing [8-10](see Supplemental Background). With fMRI, we addressed differential hemispheric processing of fearful versus neutral faces by presenting subjects with faces bilaterally [11-13]and orthogonally manipulating whether each hemifield showed a fearful or neutral expression prior to presentation of a checkerboard target. Target discrimination in the left visual field was more accurate after a fearful face was presented there. Event-related fMRI showed right-lateralized brain activations for fearful minus neutral left-hemifield faces in right visual areas, as well as more activity in the right than in the left amygdala. These activations occurred regardless of the type of right-hemifield face shown concurrently, concordant with the behavioral effect. No analogous behavioral or fMRI effects were observed for fearful faces in the right visual field (left hemisphere). The amygdala showed enhanced functional coupling with right-middle and anterior-fusiform areas in the context of a left-hemifield fearful face. These data provide behavioral and fMRI evidence for right-lateralized emotional processing during bilateral stimulation involving enhanced coupling of the amygdala and right-hemispheric extrastriate cortex.     

On the Other Side of the Fence: Effects of Social Categorization and Spatial Grouping on Memory and Attention for Own-Race and Other-Race Faces

The term “own-race bias” refers to the phenomenon that humans are typically better at recognizing faces from their own than a different race. The perceptual expertise account assumes that our face perception system has adapted to the faces we are typically exposed to, equipping it poorly for the processing of other-race faces. Sociocognitive theories assume that other-race faces are initially categorized as out-group, decreasing motivation to individuate them. Supporting sociocognitive accounts, a recent study has reported improved recognition for other-race faces when these were categorized as belonging to the participants'' in-group on a second social dimension, i.e., their university affiliation. Faces were studied in groups, containing both own-race and other-race faces, half of each labeled as in-group and out-group, respectively. When study faces were spatially grouped by race, participants showed a clear own-race bias. When faces were grouped by university affiliation, recognition of other-race faces from the social in-group was indistinguishable from own-race face recognition. The present study aimed at extending this singular finding to other races of faces and participants. Forty Asian and 40 European Australian participants studied Asian and European faces for a recognition test. Faces were presented in groups, containing an equal number of own-university and other-university Asian and European faces. Between participants, faces were grouped either according to race or university affiliation. Eye tracking was used to study the distribution of spatial attention to individual faces in the display. The race of the study faces significantly affected participants'' memory, with better recognition of own-race than other-race faces. However, memory was unaffected by the university affiliation of the faces and by the criterion for their spatial grouping on the display. Eye tracking revealed strong looking biases towards both own-race and own-university faces. Results are discussed in light of the theoretical accounts of the own-race bias.     

Face processing limitation to own species in primates: a comparative study in brown capuchins, Tonkean macaques and humans

Most primates live in social groups which survival and stability depend on individuals' abilities to create strong social relationships with other group members. The existence of those groups requires to identify individuals and to assign to each of them a social status. Individual recognition can be achieved through vocalizations but also through faces. In humans, an efficient system for the processing of own species faces exists. This specialization is achieved through experience with faces of conspecifics during development and leads to the loss of ability to process faces from other primate species. We hypothesize that a similar mechanism exists in social primates. We investigated face processing in one Old World species (genus Macaca) and in one New World species (genus Cebus). Our results show the same advantage for own species face recognition for all tested subjects. This work suggests in all species tested the existence of a common trait inherited from the primate ancestor: an efficient system to identify individual faces of own species only.     

Behavioural and neurophysiological evidence for face identity and face emotion processing in animals

Visual cues from faces provide important social information relating to individual identity, sexual attraction and emotional state. Behavioural and neurophysiological studies on both monkeys and sheep have shown that specialized skills and neural systems for processing these complex cues to guide behaviour have evolved in a number of mammals and are not present exclusively in humans. Indeed, there are remarkable similarities in the ways that faces are processed by the brain in humans and other mammalian species. While human studies with brain imaging and gross neurophysiological recording approaches have revealed global aspects of the face-processing network, they cannot investigate how information is encoded by specific neural networks. Single neuron electrophysiological recording approaches in both monkeys and sheep have, however, provided some insights into the neural encoding principles involved and, particularly, the presence of a remarkable degree of high-level encoding even at the level of a specific face. Recent developments that allow simultaneous recordings to be made from many hundreds of individual neurons are also beginning to reveal evidence for global aspects of a population-based code. This review will summarize what we have learned so far from these animal-based studies about the way the mammalian brain processes the faces and the emotions they can communicate, as well as associated capacities such as how identity and emotion cues are dissociated and how face imagery might be generated. It will also try to highlight what questions and advances in knowledge still challenge us in order to provide a complete understanding of just how brain networks perform this complex and important social recognition task.     

Gender in facial representations: a contrast-based study of adaptation within and between the sexes

Face aftereffects are proving to be an effective means of examining the properties of face-specific processes in the human visual system. We examined the role of gender in the neural representation of faces using a contrast-based adaptation method. If faces of different genders share the same representational face space, then adaptation to a face of one gender should affect both same- and different-gender faces. Further, if these aftereffects differ in magnitude, this may indicate distinct gender-related factors in the organization of this face space. To control for a potential confound between physical similarity and gender, we used a Bayesian ideal observer and human discrimination data to construct a stimulus set in which pairs of different-gender faces were equally dissimilar as same-gender pairs. We found that the recognition of both same-gender and different-gender faces was suppressed following a brief exposure of 100 ms. Moreover, recognition was more suppressed for test faces of a different-gender than those of the same-gender as the adaptor, despite the equivalence in physical and psychophysical similarity. Our results suggest that male and female faces likely occupy the same face space, allowing transfer of aftereffects between the genders, but that there are special properties that emerge along gender-defining dimensions of this space.     

Study of effects of low level microwave field by method of face masking

The aim of this study was to examine experimentally effects of low level, modulated microwaves on human central nervous system function utilizing the phenomenon of visual masking. Ten healthy volunteers, four males and six females, were exposed to electromagnetic field (450 MHz, 0.16 mW/cm2) with 7 Hz modulation frequency. Two photo series (visual stimuli) of unfamiliar, young male faces were presented to the subjects, one picture after another. All the photos were frontal views of unfamiliar faces, which could be recognized only by their unique combinations of features. The task was to identify the pictures from a group of six photos and to decide which order they were presented in. The phenomenon of visual masking is revealed as anamorphosis in subject's perception of two instantaneous visual stimuli presented within a short time interval. When both stimuli were to be recognized correctly and put in the right order, there was a statistically significant difference (P < 0.05) between the identification of the stimulus with microwave electromagnetic field and sham exposure. Recognition of both stimuli in a pair was better under the sham exposure conditions but the actual difference was only 5%. It was concluded that early stages of visual information processing are overwhelmingly robust and routine (and adaptively significant) activities, so that the low level 7 Hz modulated electromagnetic field effects exerted upon it are extremely weak.     

Representation of Faces in Longtailed Macaques (Macaca fascicularis)

The experiments described in this study were intended to increase our knowledge about social cognition in primates. Longtailed macaques (Macaca fascicularis) had to discriminate facial drawings of different emotional expressions. A new experimental approach was used. During the experimental sessions social interactions within the group were permitted, but the learning behaviour of individual monkeys was analysed. The procedure consisted of a simultaneous discrimination between four visual patterns under continuous reinforcement. It has implications not only for simple tasks of stimulus discrimination but also for complex problems of internal representations and visual communication. The monkeys learned quickly to discriminate faces of different emotional expressions. This discrimination ability was completely invariant with variations of colour, brightness, size, and rotation. Rotated and inverted faces were recognized perfectly. A preference test for particular features resulted in a graded estimation of particular facial components. Most important for face recognition was the outline, followed by the eye region and the mouth. An asymmetry in recognition of the left and right halves of the face was found. Further tests involving jumbled faces indicated that not only the presence of distinct facial cues but the specific relation of facial features is essential in recognizing faces. The experiment generally confirms that causal mechanisms of social cognition in non-human primates can be studied experimentally. The behavioural results are highly consistent with findings from neurophysiology and research with human subjects.     

Predicting risk of decompression sickness in humans from outcomes in sheep.

In animals, the response to decompression scales as a power of species body mass. Consequently, decompression sickness (DCS) risk in humans should be well predicted from an animal model with a body mass comparable to humans. No-stop decompression outcomes in compressed air and nitrogen-oxygen dives with sheep (n = 394 dives, 14.5% DCS) and humans (n = 463 dives, 4.5% DCS) were used with linear-exponential, probabilistic modeling to test this hypothesis. Scaling the response parameters of this model between species (without accounting for body mass), while estimating tissue-compartment kinetic parameters from combined human and sheep data, predicts combined risk better, based on log likelihood, than do separate sheep and human models, a combined model without scaling, and a kinetic-scaled model. These findings provide a practical tool for estimating DCS risk in humans from outcomes in sheep, especially in decompression profiles too risky to test with humans. This model supports the hypothesis that species of similar body mass have similar DCS risk.