Patterns of fMRI activity dissociate overlapping functional brain areas that respond to biological motion

Accurate perception of the actions and intentions of other people is essential for successful interactions in a social environment. Several cortical areas that support this process respond selectively in fMRI to static and dynamic displays of human bodies and faces. Here we apply pattern-analysis techniques to arrive at a new understanding of the neural response to biological motion. Functionally defined body-, face-, and motion-selective visual areas all responded significantly to "point-light" human motion. Strikingly, however, only body selectivity was correlated, on a voxel-by-voxel basis, with biological motion selectivity. We conclude that (1) biological motion, through the process of structure-from-motion, engages areas involved in the analysis of the static human form; (2) body-selective regions in posterior fusiform gyrus and posterior inferior temporal sulcus overlap with, but are distinct from, face- and motion-selective regions; (3) the interpretation of region-of-interest findings may be substantially altered when multiple patterns of selectivity are considered.     

Human visual system integrates color signals along a motion trajectory

Whether fundamental visual attributes, such as color, motion, and shape, are analyzed separately in specialized pathways has been one of the central questions of visual neuroscience. Although recent studies have revealed various forms of cross-attribute interactions, including significant contributions of color signals to motion processing, it is still widely believed that color perception is relatively independent of motion processing. Here, we report a new color illusion, motion-induced color mixing, in which moving bars, the color of each of which alternates between two colors (e.g., red and green), are perceived as the mixed color (e.g., yellow) even though the two colors are never superimposed on the retina. The magnitude of color mixture is significantly stronger than that expected from direction-insensitive spatial integration of color signals. This illusion cannot be ascribed to optical image blurs, including those induced by chromatic aberration, or to involuntary eye movements of the observer. Our findings indicate that color signals are integrated not only at the same retinal location, but also along a motion trajectory. It is possible that this neural mechanism helps us to see veridical colors for moving objects by reducing motion blur, as in the case of luminance-based pattern perception.     

Perception of biological motion in schizophrenia and healthy individuals: a behavioral and FMRI study

Background

Anomalous visual perception is a common feature of schizophrenia plausibly associated with impaired social cognition that, in turn, could affect social behavior. Past research suggests impairment in biological motion perception in schizophrenia. Behavioral and functional magnetic resonance imaging (fMRI) experiments were conducted to verify the existence of this impairment, to clarify its perceptual basis, and to identify accompanying neural concomitants of those deficits.

Methodology/Findings

In Experiment 1, we measured ability to detect biological motion portrayed by point-light animations embedded within masking noise. Experiment 2 measured discrimination accuracy for pairs of point-light biological motion sequences differing in the degree of perturbation of the kinematics portrayed in those sequences. Experiment 3 measured BOLD signals using event-related fMRI during a biological motion categorization task.Compared to healthy individuals, schizophrenia patients performed significantly worse on both the detection (Experiment 1) and discrimination (Experiment 2) tasks. Consistent with the behavioral results, the fMRI study revealed that healthy individuals exhibited strong activation to biological motion, but not to scrambled motion in the posterior portion of the superior temporal sulcus (STSp). Interestingly, strong STSp activation was also observed for scrambled or partially scrambled motion when the healthy participants perceived it as normal biological motion. On the other hand, STSp activation in schizophrenia patients was not selective to biological or scrambled motion.

Conclusion

Schizophrenia is accompanied by difficulties discriminating biological from non-biological motion, and associated with those difficulties are altered patterns of neural responses within brain area STSp. The perceptual deficits exhibited by schizophrenia patients may be an exaggerated manifestation of neural events within STSp associated with perceptual errors made by healthy observers on these same tasks. The present findings fit within the context of theories of delusion involving perceptual and cognitive processes.     

Atypical Integration of Motion Signals in Autism Spectrum Conditions

Vision in Autism Spectrum Conditions (ASC) is characterized by enhanced perception of local elements, but impaired perception of global percepts. Deficits in coherent motion perception seem to support this characterization, but the roots and robustness of such deficits remain unclear. We aimed to investigate the dynamics of the perceptual decision-making network known to support coherent motion perception. In a series of forced-choice coherent motion perception tests, we parametrically varied a single stimulus dimension, viewing duration, to test whether the rate at which evidence is accumulated towards a global decision is atypical in ASC. 40 adult participants (20 ASC) performed a classic motion discrimination task, manually indicating the global direction of motion in a random-dot kinematogram across a range of coherence levels (2–75%) and stimulus-viewing durations (200–1500 ms). We report a deficit in global motion perception at short viewing durations in ASC. Critically, however, we found that increasing the amount of time over which motion signals could be integrated reduced the magnitude of the deficit, such that at the longest duration there was no difference between the ASC and control groups. Further, the deficit in motion integration at the shortest duration was significantly associated with the severity of autistic symptoms in our clinical population, and was independent from measures of intelligence. These results point to atypical integration of motion signals during the construction of a global percept in ASC. Based on the neural correlates of decision-making in global motion perception our findings suggest the global motion deficit observed in ASC could reflect a slower or more variable response from the primary motion area of the brain or longer accumulation of evidence towards a decision-bound in parietal areas.     

Implications on visual apperception: Energy, duration, structure and synchronization

Although primary visual cortex (V1 or striate) activity per se is not sufficient for visual apperception (normal conscious visual experiences and conscious functions such as detection, discrimination, and recognition), the same is also true for extrastriate visual areas (such as V2, V3, V4/V8/VO, V5/M5/MST, IT, and GF). In the lack of V1 area, visual signals can still reach several extrastriate parts but appear incapable of generating normal conscious visual experiences. It is scarcely emphasized in the scientific literature that conscious perceptions and representations must have also essential energetic conditions. These energetic conditions are achieved by spatiotemporal networks of dynamic mitochondrial distributions inside neurons. However, the highest density of neurons in neocortex (number of neurons per degree of visual angle) devoted to representing the visual field is found in retinotopic V1. It means that the highest mitochondrial (energetic) activity can be achieved in mitochondrial cytochrome oxidase-rich V1 areas. Thus, V1 bear the highest energy allocation for visual representation.In addition, the conscious perceptions also demand structural conditions, presence of adequate duration of information representation, and synchronized neural processes and/or ‘interactive hierarchical structuralism.’ For visual apperception, various visual areas are involved depending on context such as stimulus characteristics such as color, form/shape, motion, and other features. Here, we focus primarily on V1 where specific mitochondrial-rich retinotopic structures are found; we will concisely discuss V2 where smaller riches of these structures are found. We also point out that residual brain states are not fully reflected in active neural patterns after visual perception. Namely, after visual perception, subliminal residual states are not being reflected in passive neural recording techniques, but require active stimulation to be revealed.     

Human brain activity during illusory visual jitter as revealed by functional magnetic resonance imaging

One central problem in vision is how to compensate for retinal slip. A novel illusion (visual jitter) suggests the compensation mechanism is based solely on retinal motion. Adaptation to visual noise attenuates the motion signals used by the compensation stage, producing illusory jitter due to the undercompensation of retinal slip. Here, we investigated the neural substrate of retinal slip compensation during this illusion using high-field fMRI and retinotopic mapping in flattened cortical format. When jitter perception occurred, MR signal decreased in lower stages of the visual system but increased prominently in area MT+. In conclusion, visual areas as early as V1 are responsible for the adaptation stage, and MT+ is involved in the compensation stage. The present finding suggests the pathway from V1 to MT+ has an important role in stabilizing the visual world.     

Central neural mechanisms that interrelate sensory and affective dimensions of pain

The perception of pain is highly complex, and requires neural integration from a variety of routes. Spinal pathways to the amygdala, hypothalamus, reticular formation, medial thalamic nuclei, and limbic cortical structures transmit information involved arousal, bodily regulation, and emotional responses. Other, albeit indirect, pathways can carry signals to these same structures, for example, from spinal pathways to somatosensory thalamic and cortical areas, and from these to cortical limbic structures. Indirect cortico-limbic pathways integrate nociception with information about the status of the body and indirect routes must culminate in the prioritization of emotions and responses to pain.     

BOLD Response Selective to Flow-Motion in Very Young Infants

In adults, motion perception is mediated by an extensive network of occipital, parietal, temporal, and insular cortical areas. Little is known about the neural substrate of visual motion in infants, although behavioural studies suggest that motion perception is rudimentary at birth and matures steadily over the first few years. Here, by measuring Blood Oxygenated Level Dependent (BOLD) responses to flow versus random-motion stimuli, we demonstrate that the major cortical areas serving motion processing in adults are operative by 7 wk of age. Resting-state correlations demonstrate adult-like functional connectivity between the motion-selective associative areas, but not between primary cortex and temporo-occipital and posterior-insular cortices. Taken together, the results suggest that the development of motion perception may be limited by slow maturation of the subcortical input and of the cortico-cortical connections. In addition they support the existence of independent input to primary (V1) and temporo-occipital (V5/MT+) cortices very early in life.     

Directional anisotropies reveal a functional segregation of visual motion processing for perception and action

Human exhibits an anisotropy in direction perception: discrimination is superior when motion is around horizontal or vertical rather than diagonal axes. In contrast to the consistent directional anisotropy in perception, we found only small idiosyncratic anisotropies in smooth pursuit eye movements, a motor action requiring accurate discrimination of visual motion direction. Both pursuit and perceptual direction discrimination rely on signals from the middle temporal visual area (MT), yet analysis of multiple measures of MT neuronal responses in the macaque failed to provide evidence of a directional anisotropy. We conclude that MT represents different motion directions uniformly, and subsequent processing creates a directional anisotropy in pathways unique to perception. Our data support the hypothesis that, at least for visual motion, perception and action are guided by inputs from separate sensory streams. The directional anisotropy of perception appears to originate after the two streams have segregated and downstream from area MT.     

Pathway Analysis of Smoking Quantity in Multiple GWAS Identifies Cholinergic and Sensory Pathways

Cigarette smoking is a common addiction that increases the risk for many diseases, including lung cancer and chronic obstructive pulmonary disease. Genome-wide association studies (GWAS) have successfully identified and validated several susceptibility loci for nicotine consumption and dependence. However, the trait variance explained by these genes is only a small fraction of the estimated genetic risk. Pathway analysis complements single marker methods by including biological knowledge into the evaluation of GWAS, under the assumption that causal variants lie in functionally related genes, enabling the evaluation of a broad range of signals. Our approach to the identification of pathways enriched for multiple genes associated with smoking quantity includes the analysis of two studies and the replication of common findings in a third dataset. This study identified pathways for the cholinergic receptors, which included SNPs known to be genome-wide significant; as well as novel pathways, such as genes involved in the sensory perception of smell, that do not contain any single SNP that achieves that stringent threshold.     

Visual motion interferes with lexical decision on motion words

Embodied theories of cognition propose that neural substrates used in experiencing the referent of a word, for example perceiving upward motion, should be engaged in weaker form when that word, for example 'rise', is comprehended [1-3]. This claim has been broadly supported in the motor domain (for example [4,5]), whilst evidence is supportive, but less clear cut, for perception (for example [6-8]). Motivated by the finding that the perception of irrelevant background motion at near-threshold, but not supra-threshold, levels interferes with task execution [9], we assessed whether interference from near-threshold background motion was modulated by its congruence with the meaning of words (semantic content) when participants completed a lexical decision task (deciding if a string of letters is a real word or not). Reaction times for motion words, such as 'rise' or 'fall', were slower when the direction of visual motion and the 'motion' of the word were incongruent - but only when the visual motion was at near-threshold levels (supporting [9]). When motion was supra-threshold, the distribution of error rates, not reaction times, implicated low-level motion processing in the semantic processing of motion words. As the perception of near-threshold signals is not likely to be influenced by strategies [9], our results support a close contact between semantic information and perceptual systems.     

Neurogenetics and the "fly-stampede": dissecting neural circuits involved in visual behaviors

A central goal of systems neuroscience is to understand how neural circuits represent quantitative aspects of the outside world and transform these signals into the motor code for behavior. By contrast to olfactory perception in which odors are encoded by a population of ligand-binding receptors at the input stage, the visual system extracts complex information about color, form and movement from just a few types of photoreceptor inputs. The algorithms for many of these transformations are poorly understood. We designed a high throughput real-time quantitative testing system, the "fly-stampede", to evaluate behavioral responses to light and motion cues in Drosophila. With this system, we identified a neural circuit that does not participate in sensing light but is crucial for computing visual motion. When neurons of this circuit are genetically inactivated, the flies show normal walking phototaxis, but are completely motion blind. Using neurogenetics to study the circuits mediating sophisticated animal behaviors is currently a field of intense study. This extra view attempts to summarize our work within historical background of fly biocybernetics and other recent advances.     

Cross-Category Adaptation: Objects Produce Gender Adaptation in the Perception of Faces

Adaptation aftereffects have been found for low-level visual features such as colour, motion and shape perception, as well as higher-level features such as gender, race and identity in domains such as faces and biological motion. It is not yet clear if adaptation effects in humans extend beyond this set of higher order features. The aim of this study was to investigate whether objects highly associated with one gender, e.g. high heels for females or electric shavers for males can modulate gender perception of a face. In two separate experiments, we adapted subjects to a series of objects highly associated with one gender and subsequently asked participants to judge the gender of an ambiguous face. Results showed that participants are more likely to perceive an ambiguous face as male after being exposed to objects highly associated to females and vice versa. A gender adaptation aftereffect was obtained despite the adaptor and test stimuli being from different global categories (objects and faces respectively). These findings show that our perception of gender from faces is highly affected by our environment and recent experience. This suggests two possible mechanisms: (a) that perception of the gender associated with an object shares at least some brain areas with those responsible for gender perception of faces and (b) adaptation to gender, which is a high-level concept, can modulate brain areas that are involved in facial gender perception through top-down processes.     

Human areas V3A and V6 compensate for self-induced planar visual motion

Little is known about mechanisms mediating a stable perception of the world during pursuit eye movements. Here, we used fMRI to determine to what extent human motion-responsive areas integrate planar retinal motion with nonretinal eye movement signals in order to discard self-induced planar retinal motion and to respond to objective ("real") motion. In?contrast to other areas, V3A lacked responses to?self-induced planar retinal motion but responded strongly to head-centered motion, even when retinally canceled by pursuit. This indicates a near-complete multimodal integration of visual with nonvisual planar motion signals in V3A. V3A could be mapped selectively and robustly in every single subject on this basis. V6 also reported head-centered planar motion, even when 3D flow was added to it, but was suppressed by retinal planar motion. These findings suggest a dominant contribution of human areas V3A and V6 to head-centered motion perception and to perceptual stability during eye movements.     

Auditory motion information drives visual motion perception

Background

Vision provides the most salient information with regard to the stimulus motion. However, it has recently been demonstrated that static visual stimuli are perceived as moving laterally by alternating left-right sound sources. The underlying mechanism of this phenomenon remains unclear; it has not yet been determined whether auditory motion signals, rather than auditory positional signals, can directly contribute to visual motion perception.

Methodology/Principal Findings

Static visual flashes were presented at retinal locations outside the fovea together with a lateral auditory motion provided by a virtual stereo noise source smoothly shifting in the horizontal plane. The flash appeared to move by means of the auditory motion when the spatiotemporal position of the flashes was in the middle of the auditory motion trajectory. Furthermore, the lateral auditory motion altered visual motion perception in a global motion display where different localized motion signals of multiple visual stimuli were combined to produce a coherent visual motion perception.

Conclusions/Significance

These findings suggest there exist direct interactions between auditory and visual motion signals, and that there might be common neural substrates for auditory and visual motion processing.     

Spatially localized distortions of event time

A fundamental question about the perception of time is whether the neural mechanisms underlying temporal judgements are universal and centralized in the brain or modality specific and distributed. Time perception has traditionally been thought to be entirely dissociated from spatial vision. Here we show that the apparent duration of a dynamic stimulus can be manipulated in a local region of visual space by adapting to oscillatory motion or flicker. This implicates spatially localized temporal mechanisms in duration perception. We do not see concomitant changes in the time of onset or offset of the test patterns, demonstrating a direct local effect on duration perception rather than an indirect effect on the time course of neural processing. The effects of adaptation on duration perception can also be dissociated from motion or flicker perception per se. Although 20 Hz adaptation reduces both the apparent temporal frequency and duration of a 10 Hz test stimulus, 5 Hz adaptation increases apparent temporal frequency but has little effect on duration perception. We conclude that there is a peripheral, spatially localized, essentially visual component involved in sensing the duration of visual events.     

Shape Invariant Coding of Motion Direction in Somatosensory Cortex

Invariant representations of stimulus features are thought to play an important role in producing stable percepts of objects. In the present study, we assess the invariance of neural representations of tactile motion direction with respect to other stimulus properties. To this end, we record the responses evoked in individual neurons in somatosensory cortex of primates, including areas 3b, 1, and 2, by three types of motion stimuli, namely scanned bars and dot patterns, and random dot displays, presented to the fingertips of macaque monkeys. We identify a population of neurons in area 1 that is highly sensitive to the direction of stimulus motion and whose motion signals are invariant across stimulus types and conditions. The motion signals conveyed by individual neurons in area 1 can account for the ability of human observers to discriminate the direction of motion of these stimuli, as measured in paired psychophysical experiments. We conclude that area 1 contains a robust representation of motion and discuss similarities in the neural mechanisms of visual and tactile motion processing.     

Cortical Hierarchies Perform Bayesian Causal Inference in Multisensory Perception

To form a veridical percept of the environment, the brain needs to integrate sensory signals from a common source but segregate those from independent sources. Thus, perception inherently relies on solving the “causal inference problem.” Behaviorally, humans solve this problem optimally as predicted by Bayesian Causal Inference; yet, the underlying neural mechanisms are unexplored. Combining psychophysics, Bayesian modeling, functional magnetic resonance imaging (fMRI), and multivariate decoding in an audiovisual spatial localization task, we demonstrate that Bayesian Causal Inference is performed by a hierarchy of multisensory processes in the human brain. At the bottom of the hierarchy, in auditory and visual areas, location is represented on the basis that the two signals are generated by independent sources (= segregation). At the next stage, in posterior intraparietal sulcus, location is estimated under the assumption that the two signals are from a common source (= forced fusion). Only at the top of the hierarchy, in anterior intraparietal sulcus, the uncertainty about the causal structure of the world is taken into account and sensory signals are combined as predicted by Bayesian Causal Inference. Characterizing the computational operations of signal interactions reveals the hierarchical nature of multisensory perception in human neocortex. It unravels how the brain accomplishes Bayesian Causal Inference, a statistical computation fundamental for perception and cognition. Our results demonstrate how the brain combines information in the face of uncertainty about the underlying causal structure of the world.     

Emergence and transmission of visual awareness through optical coding in the brain: A redox molecular hypothesis on visual mental imagery

Does the primary visual cortex mediate consciousness for higher-level stages of information processing by providing an outlet for mental imagery? Evidence based on neural electrical activity is inconclusive as reflected in the “imagery debate” in cognitive science. Neural information and activity, however, also depend on regulated biophoton (optical) signaling. During encoding and retrieval of visual information, regulated electrical (redox) signals of neurons are converted into synchronized biophoton signals by bioluminescent radical processes. That is, visual information may be represented by regulated biophotons of mitochondrial networks in retinotopically organized cytochrome oxidase-rich neural networks within early visual areas. Therefore, we hypothesize that regulated biophotons can generate intrinsic optical representations in the primary visual cortex and then propagate variably degraded versions along cytochrome oxidase pathways during both perception and imagery. Testing this hypothesis requires to establish a methodology for measurement of in vivo and/or in vitro increases of biophoton emission in humans' brain during phosphene inductions by transcranial magnetic stimulation and to compare the decrease in phosphene thresholds during transcranial magnetic stimulation and imagery. Our hypothesis provides a molecular mechanism for the visual buffer and for imagery as the prevalent communication mode (through optical signaling) within the brain. If confirmed empirically, this hypothesis could resolve the imagery debate and the underlying issue of continuity between perception and abstract thought.