Multiple Strategies for Spatial Integration of 2D Layouts within Working Memory

Prior results on the spatial integration of layouts within a room differed regarding the reference frame that participants used for integration. We asked whether these differences also occur when integrating 2D screen views and, if so, what the reasons for this might be. In four experiments we showed that integrating reference frames varied as a function of task familiarity combined with processing time, cues for spatial transformation, and information about action requirements paralleling results in the 3D case. Participants saw part of an object layout in screen 1, another part in screen 2, and reacted on the integrated layout in screen 3. Layout presentations between two screens coincided or differed in orientation. Aligning misaligned screens for integration is known to increase errors/latencies. The error/latency pattern was thus indicative of the reference frame used for integration. We showed that task familiarity combined with self-paced learning, visual updating, and knowing from where to act prioritized the integration within the reference frame of the initial presentation, which was updated later, and from where participants acted respectively. Participants also heavily relied on layout intrinsic frames. The results show how humans flexibly adjust their integration strategy to a wide variety of conditions.     

Neural correlates of hate

In this work, we address an important but unexplored topic, namely the neural correlates of hate. In a block-design fMRI study, we scanned 17 normal human subjects while they viewed the face of a person they hated and also faces of acquaintances for whom they had neutral feelings. A hate score was obtained for the object of hate for each subject and this was used as a covariate in a between-subject random effects analysis. Viewing a hated face resulted in increased activity in the medial frontal gyrus, right putamen, bilaterally in premotor cortex, in the frontal pole and bilaterally in the medial insula. We also found three areas where activation correlated linearly with the declared level of hatred, the right insula, right premotor cortex and the right fronto-medial gyrus. One area of deactivation was found in the right superior frontal gyrus. The study thus shows that there is a unique pattern of activity in the brain in the context of hate. Though distinct from the pattern of activity that correlates with romantic love, this pattern nevertheless shares two areas with the latter, namely the putamen and the insula.     

Visual Experience Determines the Use of External Reference Frames in Joint Action Control

Vision plays a crucial role in human interaction by facilitating the coordination of one''s own actions with those of others in space and time. While previous findings have demonstrated that vision determines the default use of reference frames, little is known about the role of visual experience in coding action-space during joint action. Here, we tested if and how visual experience influences the use of reference frames in joint action control. Dyads of congenitally-blind, blindfolded-sighted, and seeing individuals took part in an auditory version of the social Simon task, which required each participant to respond to one of two sounds presented to the left or right of both participants. To disentangle the contribution of external—agent-based and response-based—reference frames during joint action, participants performed the task with their respective response (right) hands uncrossed or crossed over one another. Although the location of the auditory stimulus was completely task-irrelevant, participants responded overall faster when the stimulus location spatially corresponded to the required response side than when they were spatially non-corresponding: a phenomenon known as the social Simon effect (SSE). In sighted participants, the SSE occurred irrespective of whether hands were crossed or uncrossed, suggesting the use of external, response-based reference frames. Congenitally-blind participants also showed an SSE, but only with uncrossed hands. We argue that congenitally-blind people use both agent-based and response-based reference frames resulting in conflicting spatial information when hands are crossed and, thus, canceling out the SSE. These results imply that joint action control functions on the basis of external reference frames independent of the presence or (transient/permanent) absence of vision. However, the type of external reference frames used for organizing motor control in joint action seems to be determined by visual experience.     

Frames of reference for eye-head gaze commands in primate supplementary eye fields

The supplementary eye field (SEF) is a region within medial frontal cortex that integrates complex visuospatial information and controls eye-head gaze shifts. Here, we test if the SEF encodes desired gaze directions in a simple retinal (eye-centered) frame, such as the superior colliculus, or in some other, more complex frame. We electrically stimulated 55 SEF sites in two head-unrestrained monkeys to evoke 3D eye-head gaze shifts and then mathematically rotated these trajectories into various reference frames. Each stimulation site specified a specific spatial goal when plotted in its intrinsic frame. These intrinsic frames varied site by site, in a continuum from eye-, to head-, to space/body-centered coding schemes. This variety of coding schemes provides the SEF with a unique potential for implementing arbitrary reference frame transformations.     

Dynamic Grouping of Hippocampal Neural Activity During Cognitive Control of Two Spatial Frames

Cognitive control is the ability to coordinate multiple streams of information to prevent confusion and select appropriate behavioral responses, especially when presented with competing alternatives. Despite its theoretical and clinical significance, the neural mechanisms of cognitive control are poorly understood. Using a two-frame place avoidance task and partial hippocampal inactivation, we confirmed that intact hippocampal function is necessary for coordinating two streams of spatial information. Rats were placed on a continuously rotating arena and trained to organize their behavior according to two concurrently relevant spatial frames: one stationary, the other rotating. We then studied how information about locations in these two spatial frames is organized in the action potential discharge of ensembles of hippocampal cells. Both streams of information were represented in neuronal discharge—place cell activity was organized according to both spatial frames, but almost all cells preferentially represented locations in one of the two spatial frames. At any given time, most coactive cells tended to represent locations in the same spatial frame, reducing the risk of interference between the two information streams. An ensemble''s preference to represent locations in one or the other spatial frame alternated within a session, but at each moment, location in the more behaviorally relevant spatial frame was more likely to be represented. This discharge organized into transient groups of coactive neurons that fired together within 25 ms to represent locations in the same spatial frame. These findings show that dynamic grouping, the transient coactivation of neural subpopulations that represent the same stream of information, can coordinate representations of concurrent information streams and avoid confusion, demonstrating neural-ensemble correlates of cognitive control in hippocampus.     

Testing neural network models of memory with behavioral experiments

In recent years, a number of computational neural networks have been proposed aimed at describing memory functions associated with different subregions of the hippocampus, namely dentate gyrus, CA3 and CA1. Recent evidence suggests that indeed specific subregions of the hippocampus may subserve different computational functions, such as spatial and temporal pattern separation, short-term or working memory, pattern association, and temporal pattern completion.     

The role of low and high spatial frequencies in exogenous attention to biologically salient stimuli

Exogenous attention can be understood as an adaptive tool that permits the detection and processing of biologically salient events even when the individual is engaged in a resource-consuming task. Indirect data suggest that the spatial frequency of stimulation may be a crucial element in this process. Behavioral and neural data (both functional and structural) were analyzed for 36 participants engaged in a digit categorization task in which distracters were presented. Distracters were biologically salient or anodyne images, and had three spatial frequency formats: intact, low spatial frequencies only, and high spatial frequencies only. Behavior confirmed enhanced exogenous attention to biologically salient distracters. The activity in the right and left intraparietal sulci and the right middle frontal gyrus was associated with this behavioral pattern and was greater in response to salient than to neutral distracters, the three areas presenting strong correlations to each other. Importantly, the enhanced response of this network to biologically salient distracters with respect to neutral distracters relied on low spatial frequencies to a significantly greater extent than on high spatial frequencies. Structural analyses suggested the involvement of internal capsule, superior longitudinal fasciculus and corpus callosum in this network. Results confirm that exogenous attention is preferentially captured by biologically salient information, and suggest that the architecture and function underlying this process are low spatial frequency-biased.     

A simple translation in cortical log-coordinates may account for the pattern of saccadic localization errors

During saccadic eye movements, the visual world shifts rapidly across the retina. Perceptual continuity is thought to be maintained by active neural mechanisms that compensate for this displacement, bringing the presaccadic scene into a postsaccadic reference frame. Because of this active mechanism, objects appearing briefly around the time of the saccade are perceived at erroneous locations, a phenomenon called perisaccadic mislocalization. The position and direction of localization errors can inform us about the different reference frames involved. It has been found, for example, that errors are not simply made in the direction of the saccade but directed toward the saccade target, indicating that the compensatory mechanism involves spatial compression rather than translation. A recent study confirmed that localization errors also occur in the direction orthogonal to saccade direction, but only for eccentricities far from the fovea, beyond the saccade target. This spatially specific pattern of distortion cannot be explained by a simple compression of space around the saccade target. Here I show that a change of reference frames (i.e., translation) in cortical (logarithmic) coordinates, taking into account the cortical magnification factor, can accurately predict these spatial patterns of mislocalization. The flashed object projects onto the cortex in presaccadic (fovea-centered) coordinates but is perceived in postsaccadic (target-centered) coordinates.     

Effects of Multimodal Load on Spatial Monitoring as Revealed by ERPs

While the role of selective attention in filtering out irrelevant information has been extensively studied, its characteristics and neural underpinnings when multiple environmental stimuli have to be processed in parallel are much less known. Building upon a dual-task paradigm that induced spatial awareness deficits for contralesional hemispace in right hemisphere-damaged patients, we investigated the electrophysiological correlates of multimodal load during spatial monitoring in healthy participants. The position of appearance of briefly presented, lateralized targets had to be reported either in isolation (single task) or together with a concurrent task, visual or auditory, which recruited additional attentional resources (dual-task). This top-down manipulation of attentional load, without any change of the sensory stimulation, modulated the amplitude of the first positive ERP response (P1) and shifted its neural generators, with a suppression of the signal in the early visual areas during both visual and auditory dual tasks. Furthermore, later N2 contralateral components elicited by left targets were particularly influenced by the concurrent visual task and were related to increased activation of the supramarginal gyrus. These results suggest that the right hemisphere is particularly affected by load manipulations, and confirm its crucial role in subtending automatic orienting of spatial attention and in monitoring both hemispaces.     

A neural mechanism for coordinate transformation predicts pre-saccadic remapping

Whenever we shift our gaze, any location information encoded in the retinocentric reference frame that is predominant in the visual system is obliterated. How is spatial memory retained across gaze changes? Two different explanations have been proposed: Retinocentric information may be transformed into a gaze-invariant representation through a mechanism consistent with gain fields observed in parietal cortex, or retinocentric information may be updated in anticipation of the shift expected with every gaze change, a proposal consistent with neural observations in LIP. The explanations were considered incompatible with each other, because retinocentric update is observed before the gaze shift has terminated. Here, we show that a neural dynamic mechanism for coordinate transformation can also account for retinocentric updating. Our model postulates an extended mechanism of reference frame transformation that is based on bidirectional mapping between a retinocentric and a body-centered representation and that enables transforming multiple object locations in parallel. The dynamic coupling between the two reference frames generates a shift of the retinocentric representation for every gaze change. We account for the predictive nature of the observed remapping activity by using the same kind of neural mechanism to generate an internal representation of gaze direction that is predictively updated based on corollary discharge signals. We provide evidence for the model by accounting for a series of behavioral and neural experimental observations.     

Form and content: dissociating syntax and semantics in sentence comprehension

The distinction between syntax (sentence form) and semantics (sentence meaning) is fundamental to our thinking about language. Whether and where this distinction is represented at the neural level is still a matter of considerable debate. In the present fMRI study, we examined the neural correlates of syntactic and semantic functions using an innovative activation paradigm specifically designed to unequivocally disentangle syntactic from lexicosemantic aspects of sentence processing. Our findings strongly indicate that a part of Broca's area (BA 44, pars opercularis) is critically implicated in processing syntactic information, whereas the lower portion of the left inferior frontal gyrus (BA 47, pars orbitalis) is selectively involved in processing the semantic aspects of a sentence.     

Gender Differences in Perception of Romance in Chinese College Students

Women often complain that their partners are not romantic enough. This raises the question: how romance is recognized and evaluated in a love relationship? However, there has been essentially no empirical research bearing on this issue. The present set of studies examined possible gender differences in perceptions of romance and the associated neural mechanisms in Chinese college students. In Study 1, 303 participants (198 women, 105 men) were administrated a questionnaire consisting of 60 sentences and required to rate the romance level of each sentence. Results showed higher rating scores in males than females for low romance items, but not for high or medium romance items. In Study 2, 69 participants (37 women, 32 men) were recruited to judge the degree of romance in sentences presented on a computer screen one by one. Compared with females, males again showed higher scores and responded more slowly only to low romance items. In Study 3, 36 participants (18 women, 18 men) currently in love with someone were scanned with functional MRI while they did the romance judgment task from Study 2. Compared with females, greater brain activation was found for males in the frontal lobe, precentral gyrus, precuneus and parahippocampal gyrus for low romance items. The results provide the first piece of evidence for gender differences in romance perception, suggesting enhanced cognitive processing in males when evaluating the degree of romance in romantic scenes.     

An fMRI Study of Grammatical Morpheme Processing Associated with Nouns and Verbs in Chinese

This study examined whether the degree of complexity of a grammatical component in a language would impact on its representation in the brain through identifying the neural correlates of grammatical morpheme processing associated with nouns and verbs in Chinese. In particular, the processing of Chinese nominal classifiers and verbal aspect markers were investigated in a sentence completion task and a grammaticality judgment task to look for converging evidence. The Chinese language constitutes a special case because it has no inflectional morphology per se and a larger classifier than aspect marker inventory, contrary to the pattern of greater verbal than nominal paradigmatic complexity in most European languages. The functional imaging results showed BA47 and left supplementary motor area and superior medial frontal gyrus more strongly activated for classifier processing, and the left posterior middle temporal gyrus more responsive to aspect marker processing. We attributed the activation in the left prefrontal cortex to greater processing complexity during classifier selection, analogous to the accounts put forth for European languages, and the left posterior middle temporal gyrus to more demanding verb semantic processing. The overall findings significantly contribute to cross-linguistic observations of neural substrates underlying processing of grammatical morphemes from an analytic and a classifier language, and thereby deepen our understanding of neurobiology of human language.     

Differential Recruitment of Brain Networks following Route and Cartographic Map Learning of Spatial Environments

An extensive neuroimaging literature has helped characterize the brain regions involved in navigating a spatial environment. Far less is known, however, about the brain networks involved when learning a spatial layout from a cartographic map. To compare the two means of acquiring a spatial representation, participants learned spatial environments either by directly navigating them or learning them from an aerial-view map. While undergoing functional magnetic resonance imaging (fMRI), participants then performed two different tasks to assess knowledge of the spatial environment: a scene and orientation dependent perceptual (SOP) pointing task and a judgment of relative direction (JRD) of landmarks pointing task. We found three brain regions showing significant effects of route vs. map learning during the two tasks. Parahippocampal and retrosplenial cortex showed greater activation following route compared to map learning during the JRD but not SOP task while inferior frontal gyrus showed greater activation following map compared to route learning during the SOP but not JRD task. We interpret our results to suggest that parahippocampal and retrosplenial cortex were involved in translating scene and orientation dependent coordinate information acquired during route learning to a landmark-referenced representation while inferior frontal gyrus played a role in converting primarily landmark-referenced coordinates acquired during map learning to a scene and orientation dependent coordinate system. Together, our results provide novel insight into the different brain networks underlying spatial representations formed during navigation vs. cartographic map learning and provide additional constraints on theoretical models of the neural basis of human spatial representation.     

Effect of Laterally Wedged Insoles on the External Knee Adduction Moment across Different Reference Frames

Objective

Biomechanical effects of laterally wedged insoles are assessed by reduction in the knee adduction moment. However, the degree of reduction may vary depending on the reference frame with which it is calculated. The purpose of this study was to clarify the effect of reference frame on the reduction in the knee adduction moment by laterally wedged insoles.

Methods

Twenty-nine healthy participants performed gait trials with a laterally wedged insole and with a flat insole as a control. The knee adduction moment, including the first and second peaks and the angular impulse, were calculated using four different reference frames: the femoral frame, tibial frame, laboratory frame and the Joint Coordinate System.

Results

There were significant effects of reference frame on the knee adduction moment first and second peaks (P < 0.001 for both variables), while the effect was not significant for the angular impulse (P = 0.84). No significant interaction between the gait condition and reference frame was found in either of the knee adduction moment variables (P = 0.99 for all variables), indicating that the effects of laterally wedged insole on the knee adduction moments were similar across the four reference frames. On the other hand, the average percent changes ranged from 9% to 16% for the first peak, from 16% to 18% for the second peak and from 17% to 21% for the angular impulse when using the different reference frames.

Conclusion

The effects of laterally wedged insole on the reduction in the knee adduction moment were similar across the reference frames. On the other hand, Researchers need to recognize that when the percent change was used as the parameter of the efficacy of laterally wedged insole, the choice of reference frame may influence the interpretation of how laterally wedged insoles affect the knee adduction moment.     

Cortical Dynamics of Semantic Processing during Sentence Comprehension: Evidence from Event-Related Optical Signals

Using the event-related optical signal (EROS) technique, this study investigated the dynamics of semantic brain activation during sentence comprehension. Participants read sentences constituent-by-constituent and made a semantic judgment at the end of each sentence. The EROSs were recorded simultaneously with ERPs and time-locked to expected or unexpected sentence-final target words. The unexpected words evoked a larger N400 and a late positivity than the expected ones. Critically, the EROS results revealed activations first in the left posterior middle temporal gyrus (LpMTG) between 128 and 192 ms, then in the left anterior inferior frontal gyrus (LaIFG), the left middle frontal gyrus (LMFG), and the LpMTG in the N400 time window, and finally in the left posterior inferior frontal gyrus (LpIFG) between 832 and 864 ms. Also, expected words elicited greater activation than unexpected words in the left anterior temporal lobe (LATL) between 192 and 256 ms. These results suggest that the early lexical-semantic retrieval reflected by the LpMTG activation is followed by two different semantic integration processes: a relatively rapid and transient integration in the LATL and a relatively slow but enduring integration in the LaIFG/LMFG and the LpMTG. The late activation in the LpIFG, however, may reflect cognitive control.     

大脑前额叶是怎样处理空间信息的

我们的大脑可能使用多个参考系来处理空间信息,比如使用"自我为中心的参考系"和"以大环境为参考系"来处理空间信息。灵长类大脑前额叶位于大脑皮层额叶的前端,尽管对前额叶在脑高级功能中的作用谁都不会怀疑,但很多具体的细节还是不甚清楚,比如背侧大脑前额叶在处理工作记忆信息时,是否处理所有的空间工作记忆信息?该文首先回顾对前额叶的研究情况,然后讨论背侧前额叶在处理自我为中心的空间信息中的作用,最后指出背侧前额叶仅对自我为中心的空间信息处理负责,而与大环境为中心的空间信息处理无关。