Reduced Face Aftereffects in Autism Are Not Due to Poor Attention

This study aimed to determine why face identity aftereffects are diminished in children with autism, relative to typical children. To address the possibility that reduced face aftereffects might reflect reduced attention to adapting stimuli, we investigated the consequence of controlling attention to adapting faces during a face identity aftereffect task in children with autism and typical children. We also included a size-change between adaptation and test stimuli to determine whether the reduced aftereffects reflect atypical adaptation to low- or higher-level stimulus properties. Results indicated that when attention was controlled and directed towards adapting stimuli, face identity aftereffects in children with autism were significantly reduced relative to typical children. This finding challenges the notion that atypicalities in the quality and/or quantity of children’s attention during adaptation might account for group differences previously observed in this paradigm. Additionally, evidence of diminished face identity aftereffects despite a stimulus size change supports an adaptive processing atypicality in autism that extends beyond low-level, retinotopically coded stimulus properties. These findings support the notion that diminished face aftereffects in autism reflect atypicalities in adaptive norm-based coding, which could also contribute to face processing difficulties in this group.     

Viewer-centered object representation in the human visual system revealed by viewpoint aftereffects

Are there neurons representing specific views of objects in the human visual system? A visual selective adaptation method was used to address this question. After visual adaptation to an object viewed either 15 or 30 degrees from one side, when the same object was subsequently presented near the frontal view, the perceived viewing directions were biased in a direction opposite to that of the adapted viewpoint. This aftereffect can be obtained with spatially nonoverlapping adapting and test stimuli, and it depends on the global representation of the adapting stimuli. Viewpoint aftereffects were found within, but not across, categories of objects tested (faces, cars, wire-like objects). The magnitude of this aftereffect depends on the angular difference between the adapting and test viewing angles and grows with increasing duration of adaptation. These results support the existence of object-selective neurons tuned to specific viewing angles in the human visual system.     

Facial Expression Aftereffect Revealed by Adaption to Emotion-Invisible Dynamic Bubbled Faces

Visual adaptation is a powerful tool to probe the short-term plasticity of the visual system. Adapting to local features such as the oriented lines can distort our judgment of subsequently presented lines, the tilt aftereffect. The tilt aftereffect is believed to be processed at the low-level of the visual cortex, such as V1. Adaptation to faces, on the other hand, can produce significant aftereffects in high-level traits such as identity, expression, and ethnicity. However, whether face adaptation necessitate awareness of face features is debatable. In the current study, we investigated whether facial expression aftereffects (FEAE) can be generated by partially visible faces. We first generated partially visible faces using the bubbles technique, in which the face was seen through randomly positioned circular apertures, and selected the bubbled faces for which the subjects were unable to identify happy or sad expressions. When the subjects adapted to static displays of these partial faces, no significant FEAE was found. However, when the subjects adapted to a dynamic video display of a series of different partial faces, a significant FEAE was observed. In both conditions, subjects could not identify facial expression in the individual adapting faces. These results suggest that our visual system is able to integrate unrecognizable partial faces over a short period of time and that the integrated percept affects our judgment on subsequently presented faces. We conclude that FEAE can be generated by partial face with little facial expression cues, implying that our cognitive system fills-in the missing parts during adaptation, or the subcortical structures are activated by the bubbled faces without conscious recognition of emotion during adaptation.     

Imagine Jane and identify John: face identity aftereffects induced by imagined faces

It is not known whether prolonged exposure to perceived and imagined complex visual images produces similar shifts in subsequent perception through selective adaptation. This question is important because a positive finding would suggest that perception and imagery of visual stimuli are mediated by shared neural networks. In this study, we used a selective adaptation procedure designed to induce high-level face-identity aftereffects--a phenomenon in which extended exposure to a particular face facilitates recognition of subsequent faces with opposite features while impairing recognition of all other faces. We report here that adaptation to either real or imagined faces produces a similar shift in perception and that identity boundaries represented in real and imagined faces are equivalent. Together, our results show that identity information contained in imagined and real faces produce similar behavioral outcomes. Our findings of high-level visual aftereffects induced by imagined stimuli can be taken as evidence for the involvement of shared neural networks that mediate perception and imagery of complex visual stimuli.     

Dissociable Perceptual Effects of Visual Adaptation

Neurons in the visual cortex are responsive to the presentation of oriented and curved line segments, which are thought to act as primitives for the visual processing of shapes and objects. Prolonged adaptation to such stimuli gives rise to two related perceptual effects: a slow change in the appearance of the adapting stimulus (perceptual drift), and the distortion of subsequently presented test stimuli (adaptational aftereffects). Here we used a psychophysical nulling technique to dissociate and quantify these two classical observations in order to examine their underlying mechanisms and their relationship to one another. In agreement with previous work, we found that during adaptation horizontal and vertical straight lines serve as attractors for perceived orientation and curvature. However, the rate of perceptual drift for different stimuli was not predictive of the corresponding aftereffect magnitudes, indicating that the two perceptual effects are governed by distinct neural processes. Finally, the rate of perceptual drift for curved line segments did not depend on the spatial scale of the stimulus, suggesting that its mechanisms lie outside strictly retinotopic processing stages. These findings provide new evidence that the visual system relies on statistically salient intrinsic reference stimuli for the processing of visual patterns, and point to perceptual drift as an experimental window for studying the mechanisms of visual perception.     

Auditory aftereffects of approaching and withdrawing sound sources: Dependence on the trajectory and location of adapting stimuli

Perception of approaching and withdrawing sound sources and their action on auditory aftereffects were studied in the free field. Motion of adapting stimuli was mimicked in two ways: (1) simultaneous opposite changes of amplitude of broadband noise impulses at two loudspeakers placed at 1.1 and 4.5 m from the listener; (2) an increase or a decrease of amplitude of broadband noise impulses in only one loudspeaker, the nearer or the remote one. Motion of test stimuli was mimicked in the former way. Listeners determined direction of the test stimuli motion without any adaptation (control) or after adaptation to stationary, slowly moving (with an amplitude change of 2 dB) and rapidly moving (amplitude change of 12 dB) stimuli. Percentages of “withdrawal” reports were used for construction of psychometric curves. Three phenomena of auditory perception were observed. In the absence of adaptation, a growing-louder effect was revealed, i.e., listeners reported more frequently the test sounds as the approaching ones. Once adapted to stationary or slowly moving stimuli, listeners showed a location-dependent aftereffect. Test stimuli were reported as withdrawing more often as compared with control. The effect was associated with the previous one and was weaker when the distance to the loudspeaker producing adapting stimuli was greater. After adaptation to rapidly moving stimuli, a motion aftereffect was revealed. In this case, listeners reported a direction of test stimuli motion as being opposite to that of adapting stimuli. The motion aftereffect was more pronounced when the adapting stimuli motion was mimicked in the former way, as this method allows estimation of their trajectory. There was no relationship between the motion aftereffect and the growing-louder effect, whichever way the adapting stimuli were produced. There was observed a tendency for reduction of aftereffects of approaching and for intensification of aftereffects of withdrawal with growing distance from source of adapting stimuli.     

Auditory adaptation in voice perception

Perceptual aftereffects following adaptation to simple stimulus attributes (e.g., motion, color) have been studied for hundreds of years. A striking recent discovery was that adaptation also elicits contrastive aftereffects in visual perception of complex stimuli and faces [1-6]. Here, we show for the first time that adaptation to nonlinguistic information in voices elicits systematic auditory aftereffects. Prior adaptation to male voices causes a voice to be perceived as more female (and vice versa), and these auditory aftereffects were measurable even minutes after adaptation. By contrast, crossmodal adaptation effects were absent, both when male or female first names and when silently articulating male or female faces were used as adaptors. When sinusoidal tones (with frequencies matched to male and female voice fundamental frequencies) were used as adaptors, no aftereffects on voice perception were observed. This excludes explanations for the voice aftereffect in terms of both pitch adaptation and postperceptual adaptation to gender concepts and suggests that contrastive voice-coding mechanisms may routinely influence voice perception. The role of adaptation in calibrating properties of high-level voice representations indicates that adaptation is not confined to vision but is a ubiquitous mechanism in the perception of nonlinguistic social information from both faces and voices.     

Cross-Category Adaptation: Objects Produce Gender Adaptation in the Perception of Faces

Adaptation aftereffects have been found for low-level visual features such as colour, motion and shape perception, as well as higher-level features such as gender, race and identity in domains such as faces and biological motion. It is not yet clear if adaptation effects in humans extend beyond this set of higher order features. The aim of this study was to investigate whether objects highly associated with one gender, e.g. high heels for females or electric shavers for males can modulate gender perception of a face. In two separate experiments, we adapted subjects to a series of objects highly associated with one gender and subsequently asked participants to judge the gender of an ambiguous face. Results showed that participants are more likely to perceive an ambiguous face as male after being exposed to objects highly associated to females and vice versa. A gender adaptation aftereffect was obtained despite the adaptor and test stimuli being from different global categories (objects and faces respectively). These findings show that our perception of gender from faces is highly affected by our environment and recent experience. This suggests two possible mechanisms: (a) that perception of the gender associated with an object shares at least some brain areas with those responsible for gender perception of faces and (b) adaptation to gender, which is a high-level concept, can modulate brain areas that are involved in facial gender perception through top-down processes.     

Face adaptation depends on seeing the face

Retinal input that is suppressed from visual awareness can nevertheless produce measurable aftereffects, revealing neural processes that do not directly result in a conscious percept. We here report that the face identity-specific aftereffect requires a visible face; it is effectively cancelled by binocular suppression or by inattentional blindness of the inducing face. Conversely, the same suppression does not interfere with the orientation-specific aftereffect. Thus, the competition between incompatible or interfering visual inputs to reach awareness is resolved before those aspects of information that are exploited in face identification are processed. We also found that the face aftereffect remained intact when the visual distracters in the inattention experiment were replaced with auditory distracters. Thus, cross-modal or cognitive interference that does not affect the visibility of the face does not interfere with the face aftereffect. We conclude that adaptation to face identity depends on seeing the face.     

Ignored Faces Produce Figural Face Aftereffects

Following adaptation to faces with contracted (or expanded) internal features, faces previously perceived as normal appear distorted in the opposite direction. This figural face aftereffect suggests face-coding mechanisms adapt to changes in the spatial relations of features and/or the global structure of faces. Here, we investigated whether the figural aftereffect requires spatial attention. Participants ignored a distorted adapting face and performed a highly demanding letter-count task. Before and after adaptation, participants rated the normality of morphed distorted faces ranging from 50% contracted through undistorted to 50% expanded. A robust aftereffect was observed. These results suggest that the figural face aftereffect can occur in the absence of spatial attention, even when the attentional demands of the relevant task are high.     

Stabilized structure from motion without disparity induces disparity adaptation

3D structures can be perceived based on the patterns of 2D motion signals. With orthographic projection of a 3D stimulus onto a 2D plane, the kinetic information can give a vivid impression of depth, but the depth order is intrinsically ambiguous, resulting in bistable or even multistable interpretations. For example, an orthographic projection of dots on the surface of a rotating cylinder is perceived as a rotating cylinder with ambiguous direction of rotation. We show that the bistable rotation can be stabilized by adding information, not to the dots themselves, but to their spatial context. More interestingly, the stabilized bistable motion can generate consistent rotation aftereffects. The rotation aftereffect can only be observed when the adapting and test stimuli are presented at the same stereo depth and the same retinal location, and it is not due to attentional tracking. The observed rotation aftereffect is likely due to direction-contingent disparity adaptation, implying that stimuli with kinetic depth may have activated neurons sensitive to different disparities, even though the stimuli have zero relative disparity. Stereo depth and kinetic depth may be supported by a common neural mechanism at an early stage in the visual system.     

Adaptation improves discrimination of face identity

Whether face adaptation confers any advantages to perceptual processing remains an open question. We investigated whether face adaptation can enhance the ability to make fine discriminations in the vicinity of the adapted face. We compared face discrimination thresholds in three adapting conditions: (i) same-face: where adapting and test faces were the same, (ii) different-face: where adapting and test faces differed, and (iii) baseline: where the adapting stimulus was a blank. Discrimination thresholds for morphed identity changes involving the adapted face (same-face) improved compared with those from both the baseline (no-adaptation) and different-face conditions. Since adapting to a face did not alter discrimination performance for other faces, this effect is selective for the facial identity that is adapted. These results indicate a form of gain control to heighten perceptual sensitivity in the vicinity of a currently viewed face, analogous to forms of adaptive gain control at lower levels of the visual system.     

Adaptation Aftereffects in Vocal Emotion Perception Elicited by Expressive Faces and Voices

The perception of emotions is often suggested to be multimodal in nature, and bimodal as compared to unimodal (auditory or visual) presentation of emotional stimuli can lead to superior emotion recognition. In previous studies, contrastive aftereffects in emotion perception caused by perceptual adaptation have been shown for faces and for auditory affective vocalization, when adaptors were of the same modality. By contrast, crossmodal aftereffects in the perception of emotional vocalizations have not been demonstrated yet. In three experiments we investigated the influence of emotional voice as well as dynamic facial video adaptors on the perception of emotion-ambiguous voices morphed on an angry-to-happy continuum. Contrastive aftereffects were found for unimodal (voice) adaptation conditions, in that test voices were perceived as happier after adaptation to angry voices, and vice versa. Bimodal (voice + dynamic face) adaptors tended to elicit larger contrastive aftereffects. Importantly, crossmodal (dynamic face) adaptors also elicited substantial aftereffects in male, but not in female participants. Our results (1) support the idea of contrastive processing of emotions (2), show for the first time crossmodal adaptation effects under certain conditions, consistent with the idea that emotion processing is multimodal in nature, and (3) suggest gender differences in the sensory integration of facial and vocal emotional stimuli.     

Motion adaptation distorts perceived visual position

After an observer adapts to a moving stimulus, texture within a stationary stimulus is perceived to drift in the opposite direction-the traditional motion aftereffect (MAE). It has recently been shown that the perceived position of objects can be markedly influenced by motion adaptation. In the present study, we examine the selectivity of positional shifts resulting from motion adaptation to stimulus attributes such as velocity, relative contrast, and relative spatial frequency. In addition, we ask whether spatial position can be modified in the absence of perceived motion. Results show that when adapting and test stimuli have collinear carrier gratings, the global position of the object shows a substantial shift in the direction of the illusory motion. When the carrier gratings of the adapting and test stimuli are orthogonal (a configuration in which no MAE is experienced), a global positional shift of similar magnitude is found. The illusory positional shift was found to be immune to changes in spatial frequency and to contrast between adapting and test stimuli-manipulations that dramatically reduce the magnitude of the traditional MAE. The lack of sensitivity for stimulus characteristics other than direction of motion suggests that a specialized population of cortical neurones, which are insensitive to changes in a number of rudimentary visual attributes, may modulate positional representation in lower cortical areas.     

Gender in facial representations: a contrast-based study of adaptation within and between the sexes

Face aftereffects are proving to be an effective means of examining the properties of face-specific processes in the human visual system. We examined the role of gender in the neural representation of faces using a contrast-based adaptation method. If faces of different genders share the same representational face space, then adaptation to a face of one gender should affect both same- and different-gender faces. Further, if these aftereffects differ in magnitude, this may indicate distinct gender-related factors in the organization of this face space. To control for a potential confound between physical similarity and gender, we used a Bayesian ideal observer and human discrimination data to construct a stimulus set in which pairs of different-gender faces were equally dissimilar as same-gender pairs. We found that the recognition of both same-gender and different-gender faces was suppressed following a brief exposure of 100 ms. Moreover, recognition was more suppressed for test faces of a different-gender than those of the same-gender as the adaptor, despite the equivalence in physical and psychophysical similarity. Our results suggest that male and female faces likely occupy the same face space, allowing transfer of aftereffects between the genders, but that there are special properties that emerge along gender-defining dimensions of this space.     

Orientation-contingent face aftereffects and implications for face-coding mechanisms

Humans have an impressive ability to discriminate between faces despite their similarity as visual patterns. This expertise relies on configural coding of spatial relations between face features and/or holistic coding of overall facial structure. These expert face-coding mechanisms appear to be engaged most effectively by upright faces, with inverted faces engaging primarily feature-coding mechanisms. We show that opposite figural aftereffects can be induced simultaneously for upright and inverted faces, demonstrating that distinct neural populations code upright and inverted faces. This result also suggests that expert (upright) face-coding mechanisms can be selectively adapted. These aftereffects occur for judgments of face normality and face gender and are robust to changes in face size, ruling out adaptation of low-level, retinotopically organized coding mechanisms. Our results suggest a resolution of a paradox in the face recognition literature. Neuroimaging studies have found surprisingly little orientation selectivity in the fusiform face area (FFA) despite evidence that this region plays a role in expert face coding and that expert face-coding mechanisms are selectively engaged by upright faces. Our results, demonstrating orientation-contingent adaptation of face-coding mechanisms, suggest that the FFA's apparent lack of orientation selectivity may be an artifact of averaging across distinct populations within the FFA that respond to upright and inverted faces.     

Adding Years to Your Life (or at Least Looking Like It): A Simple Normalization Underlies Adaptation to Facial Age

Adaptation has been widely used to probe how experience shapes the visual encoding of faces, but the pattern of perceptual changes produced by adaptation and the neural mechanisms these imply remain poorly characterized. We explored how adaptation alters the perceived age of faces, a fundamental facial attribute which can uniquely and reliably be scaled by observers. This allowed us to measure how adaptation to one age level affected the full continuum of perceived ages. Participants guessed the ages of faces ranging from 18–89, before or after adapting to a different set of faces composed of younger, older, or middle-aged adults. Adapting to young or old faces induced opposite linear shifts in perceived age that were independent of the model''s age. Specifically, after adapting to younger or older faces, faces of all ages appeared 2 to 3 years older or younger, respectively. In contrast, middle-aged adaptors induced no aftereffects. This pattern suggests that adaptation leads to a simple and uniform renormalization of age perception, and is consistent with a norm-based neural code for the mechanisms mediating the perception of facial age.     

Perception of approaching and withdrawing sound sources after exposure to broadband noise: The importance of spatial domain

The existence of space-specific differences in auditory aftereffects has been tested under short-term (5 s) exposure to broadband noise (20–20000 Hz). Adapting stimuli were emitted as constant-amplitude noise sequences. Test stimuli could be of constant and changing amplitude: increasing amplitude of noise pulses in a sequence mimicked an approaching sound source, whereas a decrease in amplitude was perceived as withdrawal. The experiments were done in an anechoic chamber. Auditory aftereffects were assessed under the following conditions: (a) adapting and test stimuli were emitted through a loudspeaker mounted at a distance of 1.1 m from the listener (i.e., subjectively near); (b) both stimuli were emitted from a distance of 4.5 m (subjectively far); (c) adapting and test stimuli were emitted from different distances. The results showed that the characteristics of perception of the imitated sound source motion were similar in proximity and remoteness, which was observed both in the control (without adaptation) and after adaptation to noise. In the absence of adaptation, the psychophysical curves were asymmetrical: the listeners reported approaching of test stimuli more often for both spatial domains. However, the overestimation of test stimuli as drawing closer was more pronounced when they were emitted from the distance of 1.1 m, i.e., from near the listener. After the adaptation to noise, the aftereffects showed spatial specificity and were observed only when adapting and test stimuli belonged to the same spatial domain. These aftereffects were similar in their pattern and strength both in proximity and remoteness: the listeners reported withdrawal of test stimuli more frequently as compared with the control. As a result of these aftereffects, the symmetry of psychometric curves was restored, and the estimation of the direction of sound source motion in the experiment became equiprobable.     

Adaptation Aftereffects in the Perception of Radiological Images

Radiologists must classify and interpret medical images on the basis of visual inspection. We examined how the perception of radiological scans might be affected by common processes of adaptation in the visual system. Adaptation selectively adjusts sensitivity to the properties of the stimulus in current view, inducing an aftereffect in the appearance of stimuli viewed subsequently. These perceptual changes have been found to affect many visual attributes, but whether they are relevant to medical image perception is not well understood. To examine this we tested whether aftereffects could be generated by the characteristic spatial structure of radiological scans, and whether this could bias their appearance along dimensions that are routinely used to classify them. Measurements were focused on the effects of adaptation to images of normal mammograms, and were tested in observers who were not radiologists. Tissue density in mammograms is evaluated visually and ranges from "dense" to "fatty." Arrays of images varying in intermediate levels between these categories were created by blending dense and fatty images with different weights. Observers first adapted by viewing image samples of dense or fatty tissue, and then judged the appearance of the intermediate images by using a texture matching task. This revealed pronounced perceptual aftereffects – prior exposure to dense images caused an intermediate image to appear more fatty and vice versa. Moreover, the appearance of the adapting images themselves changed with prolonged viewing, so that they became less distinctive as textures. These aftereffects could not be accounted for by the contrast differences or power spectra of the images, and instead tended to follow from the phase spectrum. Our results suggest that observers can selectively adapt to the properties of radiological images, and that this selectivity could strongly impact the perceived textural characteristics of the images.     

Auditory motion aftereffects of approaching and withdrawing sound sources

Auditory motion aftereffects of approaching and withdrawing sound sources were investigated in the free field. The approaching and withdrawing of a sound source were simulated by means of differently directed changes in the amplitude of impulses of broadband noise (from 20 Hz to 20 kHz) through two loudspeakers placed 1.1 and 4.5 m away from the listener. Presentation of the adapting approaching and withdrawing stimuli changed the perception of test signals following them: a stationary test signal was perceived by listeners as moving in the direction opposite to one of the movement of the adapting stimulus, whereas a test stimulus slowly moving in same direction as the adapting signal was perceived as stationary. The specific features of the auditory aftereffect of signals moving in a radial direction were similar to those of sound sources moving in a horizontal plane.