Adding Years to Your Life (or at Least Looking Like It): A Simple Normalization Underlies Adaptation to Facial Age

Adaptation has been widely used to probe how experience shapes the visual encoding of faces, but the pattern of perceptual changes produced by adaptation and the neural mechanisms these imply remain poorly characterized. We explored how adaptation alters the perceived age of faces, a fundamental facial attribute which can uniquely and reliably be scaled by observers. This allowed us to measure how adaptation to one age level affected the full continuum of perceived ages. Participants guessed the ages of faces ranging from 18–89, before or after adapting to a different set of faces composed of younger, older, or middle-aged adults. Adapting to young or old faces induced opposite linear shifts in perceived age that were independent of the model''s age. Specifically, after adapting to younger or older faces, faces of all ages appeared 2 to 3 years older or younger, respectively. In contrast, middle-aged adaptors induced no aftereffects. This pattern suggests that adaptation leads to a simple and uniform renormalization of age perception, and is consistent with a norm-based neural code for the mechanisms mediating the perception of facial age.     

Short-Term Memory Affects Color Perception in Context

Color-based object selection — for instance, looking for ripe tomatoes in the market — places demands on both perceptual and memory processes: it is necessary to form a stable perceptual estimate of surface color from a variable visual signal, as well as to retain multiple perceptual estimates in memory while comparing objects. Nevertheless, perceptual and memory processes in the color domain are generally studied in separate research programs with the assumption that they are independent. Here, we demonstrate a strong failure of independence between color perception and memory: the effect of context on color appearance is substantially weakened by a short retention interval between a reference and test stimulus. This somewhat counterintuitive result is consistent with Bayesian estimation: as the precision of the representation of the reference surface and its context decays in memory, prior information gains more weight, causing the retained percepts to be drawn toward prior information about surface and context color. This interaction implies that to fully understand information processing in real-world color tasks, perception and memory need to be considered jointly.     

The beak of the other finch: coevolution of genetic covariance structure and developmental modularity during adaptive evolution

The link between adaptation and evolutionary change remains the most central and least understood evolutionary problem. Rapid evolution and diversification of avian beaks is a textbook example of such a link, yet the mechanisms that enable beak''s precise adaptation and extensive adaptability are poorly understood. Often observed rapid evolutionary change in beaks is particularly puzzling in light of the neo-Darwinian model that necessitates coordinated changes in developmentally distinct precursors and correspondence between functional and genetic modularity, which should preclude evolutionary diversification. I show that during first 19 generations after colonization of a novel environment, house finches (Carpodacus mexicanus) express an array of distinct, but adaptively equivalent beak morphologies—a result of compensatory developmental interactions between beak length and width in accommodating microevolutionary change in beak depth. Directional selection was largely confined to the elimination of extremes formed by these developmental interactions, while long-term stabilizing selection along a single axis—beak depth—was mirrored in the structure of beak''s additive genetic covariance. These results emphasize three principal points. First, additive genetic covariance structure may represent a historical record of the most recurrent developmental and functional interactions. Second, adaptive equivalence of beak configurations shields genetic and developmental variation in individual components from depletion by natural selection. Third, compensatory developmental interactions among beak components can generate rapid reorganization of beak morphology under novel conditions and thus greatly facilitate both the evolution of precise adaptation and extensive diversification, thereby linking adaptation and adaptability in this classic example of Darwinian evolution.     

Ganzfeld Stimulation or Sleep Enhance Long Term Motor Memory Consolidation Compared to Normal Viewing in Saccadic Adaptation Paradigm

Adaptation of saccade amplitude in response to intra-saccadic target displacement is a type of implicit motor learning which is required to compensate for physiological changes in saccade performance. Once established trials without intra-saccadic target displacement lead to de-adaptation or extinction, which has been attributed either to extra-retinal mechanisms of spatial constancy or to the influence of the stable visual surroundings. Therefore we investigated whether visual deprivation (“Ganzfeld”-stimulation or sleep) can partially maintain this motor learning compared to free viewing of the natural surroundings. Thirty-five healthy volunteers performed two adaptation blocks of 100 inward adaptation trials – interspersed by an extinction block – which were followed by a two-hour break with or without visual deprivation (VD). Using additional adaptation and extinction blocks short and long (4 weeks) term memory of this implicit motor learning were tested. In the short term, motor memory tested immediately after free viewing was superior to adaptation performance after VD. In the long run, however, effects were opposite: motor memory and relearning of adaptation was superior in the VD conditions. This could imply independent mechanisms that underlie the short-term ability of retrieving learned saccadic gain and its long term consolidation. We suggest that subjects mainly rely on visual cues (i.e., retinal error) in the free viewing condition which makes them prone to changes of the visual stimulus in the extinction block. This indicates the role of a stable visual array for resetting adapted saccade amplitudes. In contrast, visual deprivation (GS and sleep), might train subjects to rely on extra-retinal cues, e.g., efference copy or prediction to remap their internal representations of saccade targets, thus leading to better consolidation of saccadic adaptation.     

Motor-related signals support localization invariance for stable visual perception

Our ability to perceive a stable visual world in the presence of continuous movements of the body, head, and eyes has puzzled researchers in the neuroscience field for a long time. We reformulated this problem in the context of hierarchical convolutional neural networks (CNNs)—whose architectures have been inspired by the hierarchical signal processing of the mammalian visual system—and examined perceptual stability as an optimization process that identifies image-defining features for accurate image classification in the presence of movements. Movement signals, multiplexed with visual inputs along overlapping convolutional layers, aided classification invariance of shifted images by making the classification faster to learn and more robust relative to input noise. Classification invariance was reflected in activity manifolds associated with image categories emerging in late CNN layers and with network units acquiring movement-associated activity modulations as observed experimentally during saccadic eye movements. Our findings provide a computational framework that unifies a multitude of biological observations on perceptual stability under optimality principles for image classification in artificial neural networks.     

A Unified Account of Perceptual Layering and Surface Appearance in Terms of Gamut Relativity

When we look at the world—or a graphical depiction of the world—we perceive surface materials (e.g. a ceramic black and white checkerboard) independently of variations in illumination (e.g. shading or shadow) and atmospheric media (e.g. clouds or smoke). Such percepts are partly based on the way physical surfaces and media reflect and transmit light and partly on the way the human visual system processes the complex patterns of light reaching the eye. One way to understand how these percepts arise is to assume that the visual system parses patterns of light into layered perceptual representations of surfaces, illumination and atmospheric media, one seen through another. Despite a great deal of previous experimental and modelling work on layered representation, however, a unified computational model of key perceptual demonstrations is still lacking. Here we present the first general computational model of perceptual layering and surface appearance—based on a boarder theoretical framework called gamut relativity—that is consistent with these demonstrations. The model (a) qualitatively explains striking effects of perceptual transparency, figure-ground separation and lightness, (b) quantitatively accounts for the role of stimulus- and task-driven constraints on perceptual matching performance, and (c) unifies two prominent theoretical frameworks for understanding surface appearance. The model thereby provides novel insights into the remarkable capacity of the human visual system to represent and identify surface materials, illumination and atmospheric media, which can be exploited in computer graphics applications.     

Nucleolar Integrity Is Required for the Maintenance of Long-Term Synaptic Plasticity

Long-term memory (LTM) formation requires new protein synthesis and new gene expression. Based on our work in Aplysia, we hypothesized that the rRNA genes, stimulation-dependent targets of the enzyme Poly(ADP-ribose) polymerase-1 (PARP-1), are primary effectors of the activity-dependent changes in synaptic function that maintain synaptic plasticity and memory. Using electrophysiology, immunohistochemistry, pharmacology and molecular biology techniques, we show here, for the first time, that the maintenance of forskolin-induced late-phase long-term potentiation (L-LTP) in mouse hippocampal slices requires nucleolar integrity and the expression of new rRNAs. The activity-dependent upregulation of rRNA, as well as L-LTP expression, are poly(ADP-ribosyl)ation (PAR) dependent and accompanied by an increase in nuclear PARP-1 and Poly(ADP) ribose molecules (pADPr) after forskolin stimulation. The upregulation of PARP-1 and pADPr is regulated by Protein kinase A (PKA) and extracellular signal-regulated kinase (ERK)—two kinases strongly associated with long-term plasticity and learning and memory. Selective inhibition of RNA Polymerase I (Pol I), responsible for the synthesis of precursor rRNA, results in the segmentation of nucleoli, the exclusion of PARP-1 from functional nucleolar compartments and disrupted L-LTP maintenance. Taken as a whole, these results suggest that new rRNAs (28S, 18S, and 5.8S ribosomal components)—hence, new ribosomes and nucleoli integrity—are required for the maintenance of long-term synaptic plasticity. This provides a mechanistic link between stimulation-dependent gene expression and the new protein synthesis known to be required for memory consolidation.     

Associative Processing Is Inherent in Scene Perception

How are complex visual entities such as scenes represented in the human brain? More concretely, along what visual and semantic dimensions are scenes encoded in memory? One hypothesis is that global spatial properties provide a basis for categorizing the neural response patterns arising from scenes. In contrast, non-spatial properties, such as single objects, also account for variance in neural responses. The list of critical scene dimensions has continued to grow—sometimes in a contradictory manner—coming to encompass properties such as geometric layout, big/small, crowded/sparse, and three-dimensionality. We demonstrate that these dimensions may be better understood within the more general framework of associative properties. That is, across both the perceptual and semantic domains, features of scene representations are related to one another through learned associations. Critically, the components of such associations are consistent with the dimensions that are typically invoked to account for scene understanding and its neural bases. Using fMRI, we show that non-scene stimuli displaying novel associations across identities or locations recruit putatively scene-selective regions of the human brain (the parahippocampal/lingual region, the retrosplenial complex, and the transverse occipital sulcus/occipital place area). Moreover, we find that the voxel-wise neural patterns arising from these associations are significantly correlated with the neural patterns arising from everyday scenes providing critical evidence whether the same encoding principals underlie both types of processing. These neuroimaging results provide evidence for the hypothesis that the neural representation of scenes is better understood within the broader theoretical framework of associative processing. In addition, the results demonstrate a division of labor that arises across scene-selective regions when processing associations and scenes providing better understanding of the functional roles of each region within the cortical network that mediates scene processing.     

The neural subjective frame: from bodily signals to perceptual consciousness

The report ‘I saw the stimulus’ operationally defines visual consciousness, but where does the ‘I’ come from? To account for the subjective dimension of perceptual experience, we introduce the concept of the neural subjective frame. The neural subjective frame would be based on the constantly updated neural maps of the internal state of the body and constitute a neural referential from which first person experience can be created. We propose to root the neural subjective frame in the neural representation of visceral information which is transmitted through multiple anatomical pathways to a number of target sites, including posterior insula, ventral anterior cingulate cortex, amygdala and somatosensory cortex. We review existing experimental evidence showing that the processing of external stimuli can interact with visceral function. The neural subjective frame is a low-level building block of subjective experience which is not explicitly experienced by itself which is necessary but not sufficient for perceptual experience. It could also underlie other types of subjective experiences such as self-consciousness and emotional feelings. Because the neural subjective frame is tightly linked to homeostatic regulations involved in vigilance, it could also make a link between state and content consciousness.     

Attention driven phantom vision: measuring the sensory strength of attentional templates and their relation to visual mental imagery and aphantasia

When we search for an object in an array or anticipate attending to a future object, we create an ‘attentional template'' of the object. The definitions of attentional templates and visual imagery share many similarities as well as many of the same neural characteristics. However, the phenomenology of these attentional templates and their neural similarities to visual imagery and perception are rarely, if ever discussed. Here, we investigate the relationship between these two forms of non-retinal phantom vision through the use of the binocular rivalry technique, which allows us to measure the sensory strength of attentional templates in the absence of concurrent perceptual stimuli. We find that attentional templates correlate with both feature-based attention and visual imagery. Attentional templates, like imagery, were significantly disrupted by the presence of irrelevant visual stimuli, while feature-based attention was not. We also found that a special population who lack the ability to visualize (aphantasia), showed evidence of feature-based attention when measured using the binocular rivalry paradigm, but not attentional templates. Taken together, these data suggest functional similarities between attentional templates and visual imagery, advancing the theory of visual imagery as a general simulation tool used across cognition.This article is part of the theme issue ‘Offline perception: voluntary and spontaneous perceptual experiences without matching external stimulation’.     

Improving the performance of the amblyopic visual system

Experience-dependent plasticity is closely linked with the development of sensory function; however, there is also growing evidence for plasticity in the adult visual system. This review re-examines the notion of a sensitive period for the treatment of amblyopia in the light of recent experimental and clinical evidence for neural plasticity. One recently proposed method for improving the effectiveness and efficiency of treatment that has received considerable attention is ‘perceptual learning’. Specifically, both children and adults with amblyopia can improve their perceptual performance through extensive practice on a challenging visual task. The results suggest that perceptual learning may be effective in improving a range of visual performance and, importantly, the improvements may transfer to visual acuity. Recent studies have sought to explore the limits and time course of perceptual learning as an adjunct to occlusion and to investigate the neural mechanisms underlying the visual improvement. These findings, along with the results of new clinical trials, suggest that it might be time to reconsider our notions about neural plasticity in amblyopia.     

A helping hand: How vinculin contributes to cell-matrix and cell-cell force transfer

Vinculin helps cells regulate and respond to mechanical forces. It is a scaffolding protein that tightly regulates its interactions with potential binding partners within adhesive structures—including focal adhesions that link the cell to the extracellular matrix and adherens junctions that link cells to each other—that physically connect the force-generating actin cytoskeleton (CSK) with the extracellular environment. This tight control of binding partner interaction—mediated by vinculin''s autoinhibitory head–tail interaction—allows vinculin to rapidly interact and detach in response to changes in the dynamic forces applied through the cell. In doing so, vinculin modulates the structural composition of focal adhesions and the cell''s ability to generate traction forces and adhesion strength. Recent evidence suggests that vinculin plays a similar role in regulating the fate and function of cell–cell junctions, further underscoring the importance of this protein. Using our lab''s recent work as a starting point, this commentary explores several outstanding questions regarding the nature of vinculin activation and its function within focal adhesions and adherens junctions.     

Monetary Reward Modulates Task-Irrelevant Perceptual Learning for Invisible Stimuli

Task Irrelevant Perceptual Learning (TIPL) shows that the brain’s discriminative capacity can improve also for invisible and unattended visual stimuli. It has been hypothesized that this form of “unconscious” neural plasticity is mediated by an endogenous reward mechanism triggered by the correct task performance. Although this result has challenged the mandatory role of attention in perceptual learning, no direct evidence exists of the hypothesized link between target recognition, reward and TIPL. Here, we manipulated the reward value associated with a target to demonstrate the involvement of reinforcement mechanisms in sensory plasticity for invisible inputs. Participants were trained in a central task associated with either high or low monetary incentives, provided only at the end of the experiment, while subliminal stimuli were presented peripherally. Our results showed that high incentive-value targets induced a greater degree of perceptual improvement for the subliminal stimuli, supporting the role of reinforcement mechanisms in TIPL.     

Circadian Adaptation to Night Shift Work Influences Sleep,Performance, Mood and the Autonomic Modulation of the Heart

Our aim was to investigate how circadian adaptation to night shift work affects psychomotor performance, sleep, subjective alertness and mood, melatonin levels, and heart rate variability (HRV). Fifteen healthy police officers on patrol working rotating shifts participated to a bright light intervention study with 2 participants studied under two conditions. The participants entered the laboratory for 48 h before and after a series of 7 consecutive night shifts in the field. The nighttime and daytime sleep periods were scheduled during the first and second laboratory visit, respectively. The subjects were considered “adapted” to night shifts if their peak salivary melatonin occurred during their daytime sleep period during the second visit. The sleep duration and quality were comparable between laboratory visits in the adapted group, whereas they were reduced during visit 2 in the non-adapted group. Reaction speed was higher at the end of the waking period during the second laboratory visit in the adapted compared to the non-adapted group. Sleep onset latency (SOL) and subjective mood levels were significantly reduced and the LF∶HF ratio during daytime sleep was significantly increased in the non-adapted group compared to the adapted group. Circadian adaptation to night shift work led to better performance, alertness and mood levels, longer daytime sleep, and lower sympathetic dominance during daytime sleep. These results suggest that the degree of circadian adaptation to night shift work is associated to different health indices. Longitudinal studies are required to investigate long-term clinical implications of circadian misalignment to atypical work schedules.     

Distinct neural circuits underlie assessment of a diversity of natural dangers by American crows

Social animals encountering natural dangers face decisions such as whether to freeze, flee or harass the threat. The American crow, Corvus brachyrhynchos, conspicuously mobs dangers. We used positron emission tomography to test the hypothesis that distinct neuronal substrates underlie the crow''s consistent behavioural response to different dangers. We found that crows activated brain regions associated with attention and arousal (nucleus isthmo-opticus/locus coeruleus), and with motor response (arcopallium), as they fixed their gaze on a threat. However, despite this consistent behavioural and neural response, the sight of a person who previously captured the crow, a person holding a dead crow and a taxidermy-mounted hawk activated distinct forebrain regions (amygdala, hippocampus and portion of the caudal nidopallium, respectively). We suggest that aspects of mobbing behaviour are guided by unique neural circuits that respond to differences in mental processing—learning, memory formation and multisensory discrimination—required to appropriately nuance a risky behaviour to specific dangers.     

Reentrant Processing in Intuitive Perception

The process of perception requires not only the brain''s receipt of sensory data but also the meaningful organization of that data in relation to the perceptual experience held in memory. Although it typically results in a conscious percept, the process of perception is not fully conscious. Research on the neural substrates of human visual perception has suggested that regions of limbic cortex, including the medial orbital frontal cortex (mOFC), may contribute to intuitive judgments about perceptual events, such as guessing whether an object might be present in a briefly presented fragmented drawing. Examining dense array measures of cortical electrical activity during a modified Waterloo Gestalt Closure Task, results show, as expected, that activity in medial orbital frontal electrical responses (about 250 ms) was associated with intuitive judgments. Activity in the right temporal-parietal-occipital (TPO) region was found to predict mOFC (∼150 ms) activity and, in turn, was subsequently influenced by the mOFC at a later time (∼300 ms). The initial perception of gist or meaning of a visual stimulus in limbic networks may thus yield reentrant input to the visual areas to influence continued development of the percept. Before perception is completed, the initial representation of gist may support intuitive judgments about the ongoing perceptual process.     

Reconciling competing mechanisms posited to underlie auditory verbal hallucinations

Perception is not the passive registration of incoming sensory data. Rather, it involves some analysis by synthesis, based on past experiences and context. One adaptive consequence of this arrangement is imagination—the ability to richly simulate sensory experiences, interrogate and manipulate those simulations, in service of action and decision making. In this paper, we will discuss one possible cost of this adaptation, namely hallucinations—perceptions without sensory stimulation, which characterize serious mental illnesses like schizophrenia, but which also occur in neurological illnesses, and—crucially for the present piece—are common also in the non-treatment-seeking population. We will draw upon a framework for imagination that distinguishes voluntary from non-voluntary experiences and explore the extent to which the varieties and features of hallucinations map onto this distinction, with a focus on auditory-verbal hallucinations (AVHs)—colloquially, hearing voices. We will propose that sense of agency for the act of imagining is key to meaningfully dissecting different forms and features of AVHs, and we will outline the neural, cognitive and phenomenological sequelae of this sense. We will conclude that a compelling unifying framework for action, perception and belief—predictive processing—can incorporate observations regarding sense of agency, imagination and hallucination.This article is part of the theme issue ‘Offline perception: voluntary and spontaneous perceptual experiences without matching external stimulation’.     

Cultural Differences in Perceptual Reorganization in US and Pirah? Adults

Visual illusions and other perceptual phenomena can be used as tools to uncover the otherwise hidden constructive processes that give rise to perception. Although many perceptual processes are assumed to be universal, variable susceptibility to certain illusions and perceptual effects across populations suggests a role for factors that vary culturally. One striking phenomenon is seen with two-tone images—photos reduced to two tones: black and white. Deficient recognition is observed in young children under conditions that trigger automatic recognition in adults. Here we show a similar lack of cue-triggered perceptual reorganization in the Pirahã, a hunter-gatherer tribe with limited exposure to modern visual media, suggesting such recognition is experience- and culture-specific.     

Sleep-Effects on Implicit and Explicit Memory in Repeated Visual Search

In repeated visual search tasks, facilitation of reaction times (RTs) due to repetition of the spatial arrangement of items occurs independently of RT facilitation due to improvements in general task performance. Whereas the latter represents typical procedural learning, the former is a kind of implicit memory that depends on the medial temporal lobe (MTL) memory system and is impaired in patients with amnesia. A third type of memory that develops during visual search is the observers’ explicit knowledge of repeated displays. Here, we used a visual search task to investigate whether procedural memory, implicit contextual cueing, and explicit knowledge of repeated configurations, which all arise independently from the same set of stimuli, are influenced by sleep. Observers participated in two experimental sessions, separated by either a nap or a controlled rest period. In each of the two sessions, they performed a visual search task in combination with an explicit recognition task. We found that (1) across sessions, MTL-independent procedural learning was more pronounced for the nap than rest group. This confirms earlier findings, albeit from different motor and perceptual tasks, showing that procedural memory can benefit from sleep. (2) Likewise, the sleep group compared with the rest group showed enhanced context-dependent configural learning in the second session. This is a novel finding, indicating that the MTL-dependent, implicit memory underlying contextual cueing is also sleep-dependent. (3) By contrast, sleep and wake groups displayed equivalent improvements in explicit recognition memory in the second session. Overall, the current study shows that sleep affects MTL-dependent as well as MTL-independent memory, but it affects different, albeit simultaneously acquired, forms of MTL-dependent memory differentially.     

Dissociable Perceptual Effects of Visual Adaptation

Neurons in the visual cortex are responsive to the presentation of oriented and curved line segments, which are thought to act as primitives for the visual processing of shapes and objects. Prolonged adaptation to such stimuli gives rise to two related perceptual effects: a slow change in the appearance of the adapting stimulus (perceptual drift), and the distortion of subsequently presented test stimuli (adaptational aftereffects). Here we used a psychophysical nulling technique to dissociate and quantify these two classical observations in order to examine their underlying mechanisms and their relationship to one another. In agreement with previous work, we found that during adaptation horizontal and vertical straight lines serve as attractors for perceived orientation and curvature. However, the rate of perceptual drift for different stimuli was not predictive of the corresponding aftereffect magnitudes, indicating that the two perceptual effects are governed by distinct neural processes. Finally, the rate of perceptual drift for curved line segments did not depend on the spatial scale of the stimulus, suggesting that its mechanisms lie outside strictly retinotopic processing stages. These findings provide new evidence that the visual system relies on statistically salient intrinsic reference stimuli for the processing of visual patterns, and point to perceptual drift as an experimental window for studying the mechanisms of visual perception.