Low-level correlations between object properties and viewpoint can cause viewpoint-dependent object recognition

Viewpoint-dependent recognition performance of 3-D objects has often been taken as an indication of a viewpoint-dependent object representation. This viewpoint dependence is most often found using metrically manipulated objects. We aim to investigate whether instead these results can be explained by viewpoint and object property (e.g. curvature) information not being processed independently at a lower level, prior to object recognition itself. Multidimensional signal detection theory offers a useful framework, allowing us to model this as a low-level correlation between the internal noise distributions of viewpoint and object property dimensions. In Experiment 1, we measured these correlations using both Yes/No and adjustment tasks. We found a good correspondence across tasks, but large individual differences. In Experiment 2, we compared these results to the viewpoint dependence of object recognition through a Yes/No categorization task. We found that viewpoint-independent object recognition could not be fully reached using our stimuli, and that the pattern of viewpoint dependence was strongly correlated with the low-level correlations we measured earlier. In part, however, the viewpoint was abstracted despite these correlations. We conclude that low-level correlations do exist prior to object recognition, and can offer an explanation for some viewpoint effects on the discrimination of metrically manipulated 3-D objects.     

Two Speed Factors of Visual Recognition Independently Correlated with Fluid Intelligence

Growing evidence indicates a moderate but significant relationship between processing speed in visuo-cognitive tasks and general intelligence. On the other hand, findings from neuroscience proposed that the primate visual system consists of two major pathways, the ventral pathway for objects recognition and the dorsal pathway for spatial processing and attentive analysis. Previous studies seeking for visuo-cognitive factors of human intelligence indicated a significant correlation between fluid intelligence and the inspection time (IT), an index for a speed of object recognition performed in the ventral pathway. We thus presently examined a possibility that neural processing speed in the dorsal pathway also represented a factor of intelligence. Specifically, we used the mental rotation (MR) task, a popular psychometric measure for mental speed of spatial processing in the dorsal pathway. We found that the speed of MR was significantly correlated with intelligence scores, while it had no correlation with one’s IT (recognition speed of visual objects). Our results support the new possibility that intelligence could be explained by two types of mental speed, one related to object recognition (IT) and another for manipulation of mental images (MR).     

It takes two-skilled recognition of objects engages lateral areas in both hemispheres

Our object recognition abilities, a direct product of our experience with objects, are fine-tuned to perfection. Left temporal and lateral areas along the dorsal, action related stream, as well as left infero-temporal areas along the ventral, object related stream are engaged in object recognition. Here we show that expertise modulates the activity of dorsal areas in the recognition of man-made objects with clearly specified functions. Expert chess players were faster than chess novices in identifying chess objects and their functional relations. Experts' advantage was domain-specific as there were no differences between groups in a control task featuring geometrical shapes. The pattern of eye movements supported the notion that experts' extensive knowledge about domain objects and their functions enabled superior recognition even when experts were not directly fixating the objects of interest. Functional magnetic resonance imaging (fMRI) related exclusively the areas along the dorsal stream to chess specific object recognition. Besides the commonly involved left temporal and parietal lateral brain areas, we found that only in experts homologous areas on the right hemisphere were also engaged in chess specific object recognition. Based on these results, we discuss whether skilled object recognition does not only involve a more efficient version of the processes found in non-skilled recognition, but also qualitatively different cognitive processes which engage additional brain areas.     

The time course of action and action-word comprehension in the human brain as revealed by neurophysiology.

Numerous previous neuroimaging studies suggest an involvement of cortical motor areas not only in action execution but also in action recognition and understanding. Motor areas of the human brain have also been found to activate during the processing of written and spoken action-related words and sentences. Even more strikingly, stimuli referring to different bodily effectors produced specific somatotopic activation patterns in the motor areas. However, metabolic neuroimaging results can be ambiguous with respect to the processing stage they reflect. This is a serious limitation when hypotheses concerning linguistic processes are tested, since in this case it is usually crucial to distinguish early lexico-semantic processing from strategic effects or mental imagery that may follow lexico-semantic information access. Timing information is therefore pivotal to determine the functional significance of motor areas in action recognition and action-word comprehension. Here, we review attempts to reveal the time course of these processes using neurophysiological methods (EEG, MEG and TMS), in visual and auditory domains. We will highlight the importance of the choice of appropriate paradigms in combination with the corresponding method for the extraction of timing information. The findings will be discussed in the general context of putative brain mechanisms of word and object recognition.     

Motor Imagery Cognitive Network after Left Ischemic Stroke: Study of the Patients during Mental Rotation Task

Although motor imagery could improve motor rehabilitation, the detailed neural mechanisms of motor imagery cognitive process of stroke patients, particularly from functional network perspective, remain unclear. This study investigated functional brain network properties in each cognitive sub-stage of motor imagery of stroke patients with ischemic lesion in left hemisphere to reveal the impact of stroke on the cognition of motor imagery. Both stroke patients and control subjects participated in mental rotation task, which includes three cognitive sub-stages: visual stimulus perception, mental rotation and response cognitive process. Event-related electroencephalograph was recorded and interdependence between two different cortical areas was assessed by phase synchronization. Both global and nodal properties of functional networks in three sub-stages were statistically analyzed. Phase synchronization of stroke patients significantly reduced in mental rotation sub-stage. Longer characteristic path length and smaller global clustering coefficient of functional network were observed in patients in mental rotation sub-stage which implied the impaired segregation and integration. Larger nodal clustering coefficient and betweenness in contralesional occipitoparietal and frontal area respectively were observed in patients in all sub-stages. In addition, patients also showed smaller betweenness in ipsilesional central-parietal area in response sub-stage. The compensatory effects on local connectedness and centrality indicated the neuroplasticity in contralesional hemisphere. The functional brain networks of stroke patients demonstrated significant alterations and compensatory effects during motor imagery.     

Body context and posture affect mental imagery of hands

Different visual stimuli have been shown to recruit different mental imagery strategies. However the role of specific visual stimuli properties related to body context and posture in mental imagery is still under debate. Aiming to dissociate the behavioural correlates of mental processing of visual stimuli characterized by different body context, in the present study we investigated whether the mental rotation of stimuli showing either hands as attached to a body (hands-on-body) or not (hands-only), would be based on different mechanisms. We further examined the effects of postural changes on the mental rotation of both stimuli. Thirty healthy volunteers verbally judged the laterality of rotated hands-only and hands-on-body stimuli presented from the dorsum- or the palm-view, while positioning their hands on their knees (front postural condition) or behind their back (back postural condition). Mental rotation of hands-only, but not of hands-on-body, was modulated by the stimulus view and orientation. Additionally, only the hands-only stimuli were mentally rotated at different speeds according to the postural conditions. This indicates that different stimulus-related mechanisms are recruited in mental rotation by changing the bodily context in which a particular body part is presented. The present data suggest that, with respect to hands-only, mental rotation of hands-on-body is less dependent on biomechanical constraints and proprioceptive input. We interpret our results as evidence for preferential processing of visual- rather than kinesthetic-based mechanisms during mental transformation of hands-on-body and hands-only, respectively.     

Visual, haptic and cross-modal recognition of objects and scenes.

In this article we review current literature on cross-modal recognition and present new findings from our studies on object and scene recognition. Specifically, we address the questions of what is the nature of the representation underlying each sensory system that facilitates convergence across the senses and how perception is modified by the interaction of the senses. In the first set of our experiments, the recognition of unfamiliar objects within and across the visual and haptic modalities was investigated under conditions of changes in orientation (0 degrees or 180 degrees ). An orientation change increased recognition errors within each modality but this effect was reduced across modalities. Our results suggest that cross-modal object representations of objects are mediated by surface-dependent representations. In a second series of experiments, we investigated how spatial information is integrated across modalities and viewpoint using scenes of familiar, 3D objects as stimuli. We found that scene recognition performance was less efficient when there was either a change in modality, or in orientation, between learning and test. Furthermore, haptic learning was selectively disrupted by a verbal interpolation task. Our findings are discussed with reference to separate spatial encoding of visual and haptic scenes. We conclude by discussing a number of constraints under which cross-modal integration is optimal for object recognition. These constraints include the nature of the task, and the amount of spatial and temporal congruency of information across the modalities.     

Dissociation between ventral and dorsal fMRI activation during object and action recognition

Neuropsychological case studies suggest the existence of two functionally separate visual streams: the ventral pathway, central for object recognition; and the dorsal pathway, engaged in visually guided actions. However, a clear dissociation between the functions of the two streams has not been decisively shown in intact humans. In this study, we demonstrate dissociation between dorsal and ventral fMRI activation patterns during observation of object manipulation video clips. Parietal areas, such as anterior intraparietal sulcus (aIPS) display grasp viewing-dependent adaptation (i.e., fMR adaptation during repeated viewing of the same object-grasping movement) as well as a contralateral preference for the viewed manipulating hand. Ventral regions, such as the fusiform gyrus, show similar characteristics (i.e., adaptation, contralateral preference), but these depend on object identity. Our results support the hypothesized functional specialization in the visual system and suggest that parietal areas (such as aIPS) are engaged in action recognition, as well as in action planning.     

Androgens and eye movements in women and men during a test of mental rotation ability

Eye movements were monitored in 16 women and 20 men during completion of a standard diagram-based test of mental rotation ability to provide measures of cognitive function not requiring conscious, decisional processes. Overall, women and men allocated visual attention during task performance in very similar, systematic ways. However, consistent with previous suggestions that sex differences in attentional processes during completion of the mental rotation task may exist, eye movements in men compared to women indicated greater discrimination and longer processing of correct alternatives during task performance. Other findings suggested that androgens may enhance cognitive processes that are recruited differentially by women and men as a function of the task. Specifically, smaller (i.e., more masculine) digit ratios were associated with men's shorter fixations on distracters, suggesting that perinatal androgen action may influence brain systems that facilitate the identification of relevant task stimuli. In women, higher circulating testosterone levels appeared to contribute to more general processes engaged during task performance, for example higher levels of visual persistence. It is possible that variability in the relative contribution of such hormone sensitive cognitive processes to accuracy scores as a function of different sample characteristics or assessment methods may partially account for the inconsistent findings of previous research on hormonal factors in mental rotation ability.     

Measuring Sensitivity to Viewpoint Change with and without Stereoscopic Cues

The speed and accuracy of object recognition is compromised by a change in viewpoint; demonstrating that human observers are sensitive to this transformation. Here we discuss a novel method for simulating the appearance of an object that has undergone a rotation-in-depth, and include an exposition of the differences between perspective and orthographic projections. Next we describe a method by which human sensitivity to rotation-in-depth can be measured. Finally we discuss an apparatus for creating a vivid percept of a 3-dimensional rotation-in-depth; the Wheatstone Eight Mirror Stereoscope. By doing so, we reveal a means by which to evaluate the role of stereoscopic cues in the discrimination of viewpoint rotated shapes and objects.     

Macaques (Macaca nemestrina) recognize when they are being imitated

This study investigated whether monkeys recognize when a human experimenter imitates their actions towards an object. Two experimenters faced 10 pigtailed macaques, who were given access to an interesting object. One experimenter imitated the monkeys' object-directed actions, the other performed temporally contingent but structurally different object-directed actions. Results show a significant visual preference for the imitator during manual object manipulations, but not mouthing actions. We argue that the ability to match actions could be based on both visual-visual and kinaesthetic-visual matching skills, and that mirror neurons, which have both visual and motor properties, could serve as a neural basis for recognizing imitation. However, imitation recognition as assessed by visual preference does not necessarily imply the capacity to attribute imitative intentionality to the imitator. The monkeys might implicitly recognize when they are being imitated without deeper insight into the mental processes of others.     

Mental Rotation of Faces in Healthy Aging and Alzheimer's Disease

Background

Previous research has shown that individuals with Alzheimer''s disease (AD) develop visuospatial difficulties that affect their ability to mentally rotate objects. Surprisingly, the existing literature has generally ignored the impact of this mental rotation deficit on the ability of AD patients to recognize faces from different angles. Instead, the devastating loss of the ability to recognize friends and family members in AD has primarily been attributed to memory loss and agnosia in later stages of the disorder. The impact of AD on areas of the brain important for mental rotation should not be overlooked by face processing investigations – even in early stages of the disorder.

Methodology/Principal Findings

This study investigated the sensitivity of face processing in AD, young controls and older non-neurological controls to two changes of the stimuli – a rotation in depth and an inversion. The control groups showed a systematic effect of depth rotation, with errors increasing with the angle of rotation, and with inversion. The majority of the AD group was not impaired when faces were presented upright and no transformation in depth was required, and were most accurate when all faces were presented in frontal views, but accuracy was severely impaired with any rotation or inversion.

Conclusions/Significance

These results suggest that with the onset of AD, mental rotation difficulties arise that affect the ability to recognize faces presented at different angles. The finding that a frontal view is “preferred” by these patients provides a valuable communication strategy for health care workers.     

Caffeine improves adult mice performance in the object recognition task and increases BDNF and TrkB independent on phospho-CREB immunocontent in the hippocampus

Caffeine is one of the most psychostimulants consumed all over the world that usually presents positive effects on cognition. In this study, effects of caffeine on mice performance in the object recognition task were tested in different intertrial intervals. In addition, it was analyzed the effects of caffeine on brain derived neurotrophic factor (BDNF) and its receptor, TrkB, immunocontent to try to establish a connection between the behavioral finding and BDNF, one of the neurotrophins strictly involved in memory and learning process. CF1 mice were treated during 4 consecutive days with saline (0.9g%, i.p.) or caffeine (10mg/kg, i.p., equivalent dose corresponding to 2-3 cups of coffee). Caffeine treatment was interrupted 24h before the object recognition task analysis. In the test session performed 15min after training session, caffeine-treated mice recognized more efficiently both the familiar and the novel object. In the test session performed 90min and 24h after training session, caffeine did not change the time spent in the familiar object but increased the object recognition index, when compared to control group. Western blotting analysis of hippocampus from caffeine-treated mice revealed an increase in BDNF and TrkB immunocontent, compared to their saline-matched controls. Phospho-CREB immunocontent did not change with caffeine treatment. Our results suggest that acute treatment with caffeine improves recognition memory, and this effect may be related to an increase of the BDNF and TrkB immunocontent in the hippocampus.     

Organization of Regional Interactions of the Brain Cortical Activity during the Common-root Word Derivation Task

This study analyzed specificities in the activity of the neurophysiological mechanisms underlying the organization of active word-derivation processes. The regularities in the reorganization of the spatial structure for the systemic interaction of bioelectrical activity between different cortical areas of the cerebral hemispheres were studied in adult subjects during the test for mental derivation of common root words (i.е., using the modern methods of the so-called “functional connectome” investigations). Сross-correlation and coherent analysis of EEG has shown that the ipsilateral statistical EEG interactions in the left hemisphere, including Broca’s and Wernicke’s areas, were significantly increased in adults during mental derivation of common root words and, simultaneously, the interhemispheric connectivity and the EEG interactions in the right hemisphere were reduced. Comparison of our results with the previous data of verbal activity associated with speech perception and production has revealed significant differences in the degree of involvement of the left and right hemisphere cortical activity in verbal processing. For example, unlike the data of current study, an equal involvement of both hemispheres cortical activity was recorded during the phoneme recognition in auditory perceived words, grammatical and semantic errors in sentences, as well as during mental formation of words from a set of phonemes and sentences from a set of words, which was particularly manifested in the increased of hemispheric interactions, predominantly, in the inferior frontal and temporal areas and the overlapped areas of the temporal, parietal, and occipital cortical zones (TPO) of both hemispheres. Thus, the data obtained in this study indicate the presence of expressed specificities in the lateralization of activity in the neurophysiological mechanisms underlying the processes of active word derivation and inflexion.     

Relationships between salivary estradiol and components of mental rotation in young men

Testosterone and estradiol levels were measured by saliva assays in 15 young men, and their relationships with different processes in a mental rotation task were elucidated. The estradiol level was positively correlated with reaction time; this effect was yielded by the slope of functions relating performance to angular disparity. These findings suggest that estrogen may inhibit the performance of a mental rotation task by affecting perception of the rotation process.     

Recognition of spatially transformed objects in men and women: Analysis of behavior and evoked potentials

The accuracy, reaction time, and evoked potentials have been analyzed in 16 men and 15 women during recognition of familiar objects at different levels of spatial transformation. Three levels of transformation have been used: in a fixed position relative to each other, all details were shifted in the radial direction (level 1) followed by analogous displacement in combination with the rotation of all details of the figure by ±0?C45 and ±45?C90 degrees (levels 3 and 4). The task performance did not depend on gender: the image transformation resulted in identification impairment, which was the worst in the case of the maximum rotation of the details. The changes in evoked potentials (ERP) are different for men and women. The amplitude of component P1 in the parietal cortex of men is associated with the level of figure transformation: a greater rotation angle leads to a higher response. In women, figure transformation evokes ERP changes in the time window of negativity N150, and they are associated with ungrouping of the figure, but not with rotation of details, and are located in other visual areas: occipital and temporal. The data obtained are discussed in terms of the theory of gender specificity of the visual representation of space.     

Cognitive alterations in motor imagery process after left hemispheric ischemic stroke

Background

Motor imagery training is a promising rehabilitation strategy for stroke patients. However, few studies had focused on the neural mechanisms in time course of its cognitive process. This study investigated the cognitive alterations after left hemispheric ischemic stroke during motor imagery task.

Methodology/Principal Findings

Eleven patients with ischemic stroke in left hemisphere and eleven age-matched control subjects participated in mental rotation task (MRT) of hand pictures. Behavior performance, event-related potential (ERP) and event-related (de)synchronization (ERD/ERS) in beta band were analyzed to investigate the cortical activation. We found that: (1) The response time increased with orientation angles in both groups, called “angle effect”, however, stoke patients’ responses were impaired with significantly longer response time and lower accuracy rate; (2) In early visual perceptual cognitive process, stroke patients showed hypo-activations in frontal and central brain areas in aspects of both P200 and ERD; (3) During mental rotation process, P300 amplitude in control subjects decreased while angle increased, called “amplitude modulation effect”, which was not observed in stroke patients. Spatially, patients showed significant lateralization of P300 with activation only in contralesional (right) parietal cortex while control subjects showed P300 in both parietal lobes. Stroke patients also showed an overall cortical hypo-activation of ERD during this sub-stage; (4) In the response sub-stage, control subjects showed higher ERD values with more activated cortical areas particularly in the right hemisphere while angle increased, named “angle effect”, which was not observed in stroke patients. In addition, stroke patients showed significant lower ERD for affected hand (right) response than that for unaffected hand.

Conclusions/Significance

Cortical activation was altered differently in each cognitive sub-stage of motor imagery after left hemispheric ischemic stroke. These results will help to understand the underlying neural mechanisms of mental rotation following stroke and may shed light on rehabilitation based on motor imagery training.     

Directed cortical information flow during human object recognition: analyzing induced EEG gamma-band responses in brain's source space

The increase of induced gamma-band responses (iGBRs; oscillations >30 Hz) elicited by familiar (meaningful) objects is well established in electroencephalogram (EEG) research. This frequency-specific change at distinct locations is thought to indicate the dynamic formation of local neuronal assemblies during the activation of cortical object representations. As analytically power increase is just a property of a single location, phase-synchrony was introduced to investigate the formation of large-scale networks between spatially distant brain sites. However, classical phase-synchrony reveals symmetric, pair-wise correlations and is not suited to uncover the directionality of interactions. Here, we investigated the neural mechanism of visual object processing by means of directional coupling analysis going beyond recording sites, but rather assessing the directionality of oscillatory interactions between brain areas directly. This study is the first to identify the directionality of oscillatory brain interactions in source space during human object recognition and suggests that familiar, but not unfamiliar, objects engage widespread reciprocal information flow. Directionality of cortical information-flow was calculated based upon an established Granger-Causality coupling-measure (partial-directed coherence; PDC) using autoregressive modeling. To enable comparison with previous coupling studies lacking directional information, phase-locking analysis was applied, using wavelet-based signal decompositions. Both, autoregressive modeling and wavelet analysis, revealed an augmentation of iGBRs during the presentation of familiar objects relative to unfamiliar controls, which was localized to inferior-temporal, superior-parietal and frontal brain areas by means of distributed source reconstruction. The multivariate analysis of PDC evaluated each possible direction of brain interaction and revealed widespread reciprocal information-transfer during familiar object processing. In contrast, unfamiliar objects entailed a sparse number of only unidirectional connections converging to parietal areas. Considering the directionality of brain interactions, the current results might indicate that successful activation of object representations is realized through reciprocal (feed-forward and feed-backward) information-transfer of oscillatory connections between distant, functionally specific brain areas.     

Approach to human adaptability to stresses of city life

Interest of human adaptability to city life is one of the most principal topics of physiological anthropology. Especially, cultural adaptation and flowing stresses by itself is the most important viewpoint of human adaptability in the recent modern life. In this paper, the authors reviewed the keywords of physiological anthropology, especially with the focus on techno-adaptability, and presented our experimental trials to study physiological polymorphism of cardio-vascular reactivity to mental stresses. We scoped the psychological stresses by means of mental tasks as an experimental model of techno-stress. Techno-stress was defined as not only from inadequate interface of man-machine system, but also from increased social complexity owing to highly advanced technological social system. In the experimental trial, we observed different types of cardio-vascular responses to several mental tasks. Blood pressure rose significantly during the tasks. However, contribution of change in cardiac output and total peripheral resistance on it was not the same between subgroups of the subjects.     

Use of temporary and semipermanent enrichment objects by five chimpanzees

At the Chimpanzee and Human Communication Institute, caregivers provide the 5 chimpanzees who reside there with many different forms of social, food, habitat, and object enrichment. In this study, we examined the chimpanzees' use of both semipermanent and temporary objects. Semipermanent objects included cargo nets, climbing structures, a treat mound, and other objects that were present at the chimpanzees' enclosure throughout the duration of this study. Each day, 50 temporary objects were placed in the chimpanzees' outdoor enclosure or indoor exercise rooms. Frequency of use was examined in 2 conditions: rotated and same. In the rotated condition, temporary objects were replaced with different temporary objects after 3 hr. In the same condition, temporary objects were presented for the entire day. Focal and scan sampling were used to record the chimpanzees' use of enrichment objects. Observers collected focal sample data to record the chimpanzees' initial reaction to objects when entering the indoor exercise rooms, outdoor enclosures, or both at 9:00 a.m. and 1.00 p.m. A total of 35 hr of focal data and 156 hr of scan data were collected over an 8-week period. Temporary object rotation in- creased the overall frequency of temporary object use both in the initial 15 min of focal sample data and during the following 6 hr of scan sample data for 4 of the chimpanzees. All of these chimpanzees used both semipermanent and temporary objects throughout the day. Each chimpanzee's pattern of use was unique. The results of this study emphasize the importance of temporary object rotation and presentation of both temporary and semipermanent objects to captive chimpanzee environments.