Body Space in Social Interactions: A Comparison of Reaching and Comfort Distance in Immersive Virtual Reality

Background

Do peripersonal space for acting on objects and interpersonal space for interacting with con-specifics share common mechanisms and reflect the social valence of stimuli? To answer this question, we investigated whether these spaces refer to a similar or different physical distance.

Methodology

Participants provided reachability-distance (for potential action) and comfort-distance (for social processing) judgments towards human and non-human virtual stimuli while standing still (passive) or walking toward stimuli (active).

Principal Findings

Comfort-distance was larger than other conditions when participants were passive, but reachability and comfort distances were similar when participants were active. Both spaces were modulated by the social valence of stimuli (reduction with virtual females vs males, expansion with cylinder vs robot) and the gender of participants.

Conclusions

These findings reveal that peripersonal reaching and interpersonal comfort spaces share a common motor nature and are sensitive, at different degrees, to social modulation. Therefore, social processing seems embodied and grounded in the body acting in space.     

Proprioceptive Body Illusions Modulate the Visual Perception of Reaching Distance

The neurobiology of reaching has been extensively studied in human and non-human primates. However, the mechanisms that allow a subject to decide—without engaging in explicit action—whether an object is reachable are not fully understood. Some studies conclude that decisions near the reach limit depend on motor simulations of the reaching movement. Others have shown that the body schema plays a role in explicit and implicit distance estimation, especially after motor practice with a tool. In this study we evaluate the causal role of multisensory body representations in the perception of reachable space. We reasoned that if body schema is used to estimate reach, an illusion of the finger size induced by proprioceptive stimulation should propagate to the perception of reaching distances. To test this hypothesis we induced a proprioceptive illusion of extension or shrinkage of the right index finger while participants judged a series of LEDs as reachable or non-reachable without actual movement. Our results show that reach distance estimation depends on the illusory perceived size of the finger: illusory elongation produced a shift of reaching distance away from the body whereas illusory shrinkage produced the opposite effect. Combining these results with previous findings, we suggest that deciding if a target is reachable requires an integration of body inputs in high order multisensory parietal areas that engage in movement simulations through connections with frontal premotor areas.     

Mark My Words: Tone of Voice Changes Affective Word Representations in Memory

The present study explored the effect of speaker prosody on the representation of words in memory. To this end, participants were presented with a series of words and asked to remember the words for a subsequent recognition test. During study, words were presented auditorily with an emotional or neutral prosody, whereas during test, words were presented visually. Recognition performance was comparable for words studied with emotional and neutral prosody. However, subsequent valence ratings indicated that study prosody changed the affective representation of words in memory. Compared to words with neutral prosody, words with sad prosody were later rated as more negative and words with happy prosody were later rated as more positive. Interestingly, the participants'' ability to remember study prosody failed to predict this effect, suggesting that changes in word valence were implicit and associated with initial word processing rather than word retrieval. Taken together these results identify a mechanism by which speakers can have sustained effects on listener attitudes towards word referents.     

Reflection of the emotion manifestation in effects of evoked EEG synchronization and desynchronization

Event-related desynchronization (ERD) and synchronization (ERS) in response to neutral, positive and negative emotional IAPS stimuli were measured in narrow theta, alpha-1, alpha-2 and alpha-3 frequency bands in 22 healthy Ss. A high resolution 62-channel EEG was recorded while subjects viewed a sequence of pictures. The effects of valence discrimination related to hemispheric asymmetries are associated with increased theta and alpha-3 synchronization. Theta ERS revealed a significant valence by hemisphere interaction for anterior temporal leads in the time window of 100-700 ms after stimulus onset indicating a relatively greater right hemisphere ERS for negative and a left hemisphere ERS for positive stimuli in comparison to neutral those. In the alpha-3 band, negative stimuli induced a left hemisphere ERS increase (F7 site) in the time window of 800-1200 ms not observed for neutral and positive stimuli. The results obtained along with the earlier observations on EEG correlates of affective processing challenge the notion that effective anterior hemispheric asymmetries are reflected mainly in the wide alpha frequency band.     

Recognition of Intensive Valence and Arousal Affective States via Facial Electromyographic Activity in Young and Senior Adults

Background

Research suggests that interaction between humans and digital environments characterizes a form of companionship in addition to technical convenience. To this effect, humans have attempted to design computer systems able to demonstrably empathize with the human affective experience. Facial electromyography (EMG) is one such technique enabling machines to access to human affective states. Numerous studies have investigated the effects of valence emotions on facial EMG activity captured over the corrugator supercilii (frowning muscle) and zygomaticus major (smiling muscle). The arousal emotion, specifically, has not received much research attention, however. In the present study, we sought to identify intensive valence and arousal affective states via facial EMG activity.

Methods

Ten blocks of affective pictures were separated into five categories: neutral valence/low arousal (0VLA), positive valence/high arousal (PVHA), negative valence/high arousal (NVHA), positive valence/low arousal (PVLA), and negative valence/low arousal (NVLA), and the ability of each to elicit corresponding valence and arousal affective states was investigated at length. One hundred and thirteen participants were subjected to these stimuli and provided facial EMG. A set of 16 features based on the amplitude, frequency, predictability, and variability of signals was defined and classified using a support vector machine (SVM).

Results

We observed highly accurate classification rates based on the combined corrugator and zygomaticus EMG, ranging from 75.69% to 100.00% for the baseline and five affective states (0VLA, PVHA, PVLA, NVHA, and NVLA) in all individuals. There were significant differences in classification rate accuracy between senior and young adults, but there was no significant difference between female and male participants.

Conclusion

Our research provides robust evidences for recognition of intensive valence and arousal affective states in young and senior adults. These findings contribute to the successful future application of facial EMG for identifying user affective states in human machine interaction (HMI) or companion robotic systems (CRS).     

Fix your eyes in the space you could reach: neurons in the macaque medial parietal cortex prefer gaze positions in peripersonal space

Interacting in the peripersonal space requires coordinated arm and eye movements to visual targets in depth. In primates, the medial posterior parietal cortex (PPC) represents a crucial node in the process of visual-to-motor signal transformations. The medial PPC area V6A is a key region engaged in the control of these processes because it jointly processes visual information, eye position and arm movement related signals. However, to date, there is no evidence in the medial PPC of spatial encoding in three dimensions. Here, using single neuron recordings in behaving macaques, we studied the neural signals related to binocular eye position in a task that required the monkeys to perform saccades and fixate targets at different locations in peripersonal and extrapersonal space. A significant proportion of neurons were modulated by both gaze direction and depth, i.e., by the location of the foveated target in 3D space. The population activity of these neurons displayed a strong preference for peripersonal space in a time interval around the saccade that preceded fixation and during fixation as well. This preference for targets within reaching distance during both target capturing and fixation suggests that binocular eye position signals are implemented functionally in V6A to support its role in reaching and grasping.     

The Valence of Self-Generated (Status Updates) and Other-Generated (Wall-Posts) Information Determines Impression Formation on Facebook

We examined whether self-generated (status updates) or other-generated (wall-posts) information on Facebook influenced the impression formed of the target individual. Along with examining reliance on particular types of information, we explored the valence (positive/ neutral/ negative) of the information, as reliance on self-generated or other-generated information may depend on whether self-presentation is perceived (i.e., presenting oneself positively / not negatively). Self-presentation may be perceived if the targets have positive/ neutral statuses, while negative statuses would indicate a lack of self-presentation. In line with previous research, participants should rely on other-generated information (wall-posts) to form an impression when participants are viewed to have self-presented (positive / neutral status updates), as this information could be viewed as unreliable. Forty participants rated nine Facebook profiles where statuses and wall-posts portrayed personality traits varying in valence. Each profile consisted of a neutral profile photo, three status updates (all positive, negative, or neutral) and three wall-posts (all positive, negative, or neutral). Materials were established in two pilots. Impression formation was measured as perceived social, task, and physical attractiveness of the target individual. Participants also ranked the profiles for likeability. Supporting our expectations, other-generated information (wall-posts) dominated impression formation for social attractiveness when self-generated information (status updates) was positive/ neutral. Task attractiveness was affected by information valence, regardless of source (self or other). Despite the inclusion of neutral photos, physical attractiveness was affected by self-generated information, with negative statuses lowering physical attractiveness. We suggest that these findings have implications for impression formation beyond the Facebook setting. The 557 traits analyzed in Pilot 1 are available as supporting information (S1 Dataset) and may be useful for other impression formation researchers.     

Ready both to your and to my hands: mapping the action space of others

To date, mutual interaction between action and perception has been investigated mainly by focusing on single individuals. However, we perceive affording objects and acts upon them in a surrounding world inhabited by other perceiving and acting bodies. Thus, the issue arises as to whether our action-oriented object perception might be modulated by the presence of another potential actor. To tackle this issue we used the spatial alignment effect paradigm and systematically examined this effect when a visually presented handled object was located close either to the perceiver or to another individual (a virtual avatar). We found that the spatial alignment effect occurred whenever the object was presented within the reaching space of a potential actor, regardless of whether it was the participant's own or the other's reaching space. These findings show that objects may afford a suitable motor act when they are ready not only to our own hand but also, and most importantly, to the other's hand. Our proposal is that this effect is likely to be due to a mapping of our own and the other's reaching space and we posit that such mapping could play a critical role in joining our own and the other's action.     

Direct evidence from parietal extinction of enhancement of visual attention near a visible hand

Brain areas exist that appear to be specialized for the coding of visual space surrounding the body (peripersonal space). In marked contrast to neurons in earlier visual areas, cells have been reported in parietal and frontal lobes that effectively respond only when visual stimuli are located in spatial proximity to a particular body part (for example, face, arm or hand) [1-4]. Despite several single-cell studies, the representation of near visual space has scarcely been investigated in humans. Here we focus on the neuropsychological phenomenon of visual extinction following unilateral brain damage. Patients with this disorder may respond well to a single stimulus in either visual field; however, when two stimuli are presented concurrently, the contralesional stimulus is disregarded or poorly identified. Extinction is commonly thought to reflect a pathological bias in selective vision favoring the ipsilesional side under competitive conditions, as a result of the unilateral brain lesion [5-7]. We examined a parietally damaged patient (D.P.) to determine whether visual extinction is modulated by the position of the hands in peripersonal space. We measured the severity of visual extinction in a task which held constant visual and spatial information about stimuli, while varying the distance between hands and stimuli. We found that selection in the affected visual field was remarkably more efficient when visual events were presented in the space near the contralesional finger than far from it. However, the amelioration of extinction dissolved when hands were covered from view, implying that the effect of hand position was not mediated purely through proprioception. These findings illustrate the importance of the spatial relationship between hand position and object location for the internal construction of visual peripersonal space in humans.     

Housing induced mood modulates reactions to emotional stimuli in sheep

The assessment of positive and negative short-term affective states (emotions) in animals and their modulation by long-term affective states (mood) is an on-going challenge. This study investigated the use of behavioural and physiological measures to assess emotions and their modulation by mood in sheep. To induce a more Positive and more Negative mood, two groups of sheep (n = 10 and 9) were kept under different housing conditions for 3 weeks. The Positive mood group was placed in a predictable environment rich in stimuli and with a calm human–animal interaction whereas sheep in the Negative mood group experienced a relatively barren and unpredictable environment with a harsher human–animal interaction. In the subsequent test week, 15 (8 and 7) experimental animals were exposed to four situations intended to elicit emotional reactions: separation from group members (negative valence), sham-grooming (low intensity negative), non-grooming (neutral), and grooming (positive valence). Data were tested for interactions between mood group and valence of the test situation using linear mixed models. More frequent ear-posture changes, a higher proportion of asymmetric ears, shorter inter-heartbeat intervals and higher respiration rates were observed during separation than during the other situations. Interactions between mood group and test situation showed that sheep in the Negative mood group reacted more negatively to the negative and more positively to the positive situation (proportion of asymmetric ears, inter-heartbeat interval, respiration rate). In conclusion, our findings suggest that sheep in a Positive mood reacted more weakly to an emotional situation independent of its valence, thus buffering negative events but also degrading positive events. In addition, this investigation showed the potential of using observations of ear postures and cardio-respiratory measures in sheep to assess the valence of short-term emotional states and their modulation by mood states.     

Spatial orientation and the representation of space with parietal lobe lesions.

Damage to the human parietal cortex leads to disturbances of spatial perception and of motor behaviour. Within the parietal lobe, lesions of the superior and of the inferior lobule induce quite different, characteristic deficits. Patients with inferior (predominantly right) parietal lobe lesions fail to explore the contralesional part of space by eye or limb movements (spatial neglect). In contrast, superior parietal lobe lesions lead to specific impairments of goal-directed movements (optic ataxia). The observations reported in this paper support the view of dissociated functions represented in the inferior and the superior lobule of the human parietal cortex. They suggest that a spatial reference frame for exploratory behaviour is disturbed in patients with neglect. Data from these patients'' visual search argue that their failure to explore the contralesional side is due to a disturbed input transformation leading to a deviation of egocentric space representation to the ipsilesional side. Data further show that this deviation follows a rotation around the earth-vertical body axis to the ipsilesional side rather than a translation towards that side. The results are in clear contrast to explanations that assume a lateral gradient ranging from a minimum of exploration in the extreme contralesional to a maximum in the extreme ipsilesional hemispace. Moreover, the failure to orient towards and to explore the contralesional part of space appears to be distinct from those deficits observed once an object of interest has been located and releases reaching. Although patients with neglect exhibit a severe bias of exploratory movements, their hand trajectories to targets in peripersonal space may follow a straight path. This result suggests that (i) exploratory and (ii) goal-directed behaviour in space do not share the same neural control mechanisms. Neural representation of space in the inferior parietal lobule seems to serve as a matrix for spatial exploration and for orienting in space but not for visuomotor processes involved in reaching for objects. Disturbances of such processes rather appear to be prominent in patients with more superior parietal lobe lesions and optic ataxia.     

Manipulable objects facilitate cross-modal integration in peripersonal space

Previous studies have shown that tool use often modifies one's peripersonal space--i.e. the space directly surrounding our body. Given our profound experience with manipulable objects (e.g. a toothbrush, a comb or a teapot) in the present study we hypothesized that the observation of pictures representing manipulable objects would result in a remapping of peripersonal space as well. Subjects were required to report the location of vibrotactile stimuli delivered to the right hand, while ignoring visual distractors superimposed on pictures representing everyday objects. Pictures could represent objects that were of high manipulability (e.g. a cell phone), medium manipulability (e.g. a soap dispenser) and low manipulability (e.g. a computer screen). In the first experiment, when subjects attended to the action associated with the objects, a strong cross-modal congruency effect (CCE) was observed for pictures representing medium and high manipulability objects, reflected in faster reaction times if the vibrotactile stimulus and the visual distractor were in the same location, whereas no CCE was observed for low manipulability objects. This finding was replicated in a second experiment in which subjects attended to the visual properties of the objects. These findings suggest that the observation of manipulable objects facilitates cross-modal integration in peripersonal space.     

Being Barbie: the size of one's own body determines the perceived size of the world

A classical question in philosophy and psychology is if the sense of one's body influences how one visually perceives the world. Several theoreticians have suggested that our own body serves as a fundamental reference in visual perception of sizes and distances, although compelling experimental evidence for this hypothesis is lacking. In contrast, modern textbooks typically explain the perception of object size and distance by the combination of information from different visual cues. Here, we describe full body illusions in which subjects experience the ownership of a doll's body (80 cm or 30 cm) and a giant's body (400 cm) and use these as tools to demonstrate that the size of one's sensed own body directly influences the perception of object size and distance. These effects were quantified in ten separate experiments with complementary verbal, questionnaire, manual, walking, and physiological measures. When participants experienced the tiny body as their own, they perceived objects to be larger and farther away, and when they experienced the large-body illusion, they perceived objects to be smaller and nearer. Importantly, despite identical retinal input, this "body size effect" was greater when the participants experienced a sense of ownership of the artificial bodies compared to a control condition in which ownership was disrupted. These findings are fundamentally important as they suggest a causal relationship between the representations of body space and external space. Thus, our own body size affects how we perceive the world.     

Bodily illusions modulate tactile perception

Touch differs from other exteroceptive senses in that the body itself forms part of the tactile percept. Interactions between proprioception and touch provide a powerful way to investigate the implicit body representation underlying touch. Here, we demonstrate that an intrinsic primary quality of a tactile object, for example its size, is directly affected by the perceived size of the body part touching it. We elicited proprioceptive illusions that the left index finger was either elongating or shrinking by vibrating the biceps or triceps tendon of the right arm while subjects grasped the tip of their left index finger. Subjects estimated the distance between two simultaneous tactile contacts on the left finger during tendon vibration. We found that tactile distances feel bigger when the touched body part feels elongated. Control tests showed that the modulation of touch was linked to the perceived index-finger size induced by tendon vibration. Vibrations that did not produce proprioceptive illusion had no effect on touch. Our results show that the perception of tactile objects is referenced to an implicit body representation and that proprioception contributes to this body representation. We also provide, for the first time, a quantitative, implicit measure of distortions of body size.     

Auditory affective norms for German: testing the influence of depression and anxiety on valence and arousal ratings

Background

The study of emotional speech perception and emotional prosody necessitates stimuli with reliable affective norms. However, ratings may be affected by the participants'' current emotional state as increased anxiety and depression have been shown to yield altered neural responding to emotional stimuli. Therefore, the present study had two aims, first to provide a database of emotional speech stimuli and second to probe the influence of depression and anxiety on the affective ratings.

Methodology/Principal Findings

We selected 120 words from the Leipzig Affective Norms for German database (LANG), which includes visual ratings of positive, negative, and neutral word stimuli. These words were spoken by a male and a female native speaker of German with the respective emotional prosody, creating a total set of 240 auditory emotional stimuli. The recordings were rated again by an independent sample of subjects for valence and arousal, yielding groups of highly arousing negative or positive stimuli and neutral stimuli low in arousal. These ratings were correlated with participants'' emotional state measured with the Depression Anxiety Stress Scales (DASS). Higher depression scores were related to more negative valence of negative and positive, but not neutral words. Anxiety scores correlated with increased arousal and more negative valence of negative words.

Conclusions/Significance

These results underscore the importance of representatively distributed depression and anxiety scores in participants of affective rating studies. The LANG-audition database, which provides well-controlled, short-duration auditory word stimuli for the experimental investigation of emotional speech is available in Supporting Information S1.     

年龄相关的情绪偏向效应的时间进程

来自记忆、注意和决策等领域的大量研究发现,在加工情绪刺激时老年人具有正性情绪偏向或负性情绪规避的特点.本研究采用oddball变式,将情绪面孔图片作为分心刺激呈现.实验过程中记录被试脑电,考察不同情绪效价对脑电波的影响,同时考察老年人在非任务相关条件下情绪加工和情绪调节的时间进程.研究发现,在相对早期时间窗口(270~460 ms),年轻组脑电不受情绪效价影响,而老年组中悲伤情绪面孔较之快乐和中性情绪面孔引发了一个更大的正成分(P3a).在晚期时间窗口(500~850 ms),年轻组中悲伤情绪面孔吸引了被试更多注意并引发了一个更大的正性慢波.相反,老年组在晚期加工阶段,情绪效价效应消失.研究揭示了老年人和年轻人在加工非任务相关的情绪刺激时存在的时间进程差异,年龄相关的正性情绪效应发生在晚期时间窗口,表现为年轻组的负性情绪偏向和老年组的无情绪偏向.研究结果为社会情绪选择理论提供了来自脑电数据的支持.     

Emerging Object Representations in the Visual System Predict Reaction Times for Categorization

Recognizing an object takes just a fraction of a second, less than the blink of an eye. Applying multivariate pattern analysis, or “brain decoding”, methods to magnetoencephalography (MEG) data has allowed researchers to characterize, in high temporal resolution, the emerging representation of object categories that underlie our capacity for rapid recognition. Shortly after stimulus onset, object exemplars cluster by category in a high-dimensional activation space in the brain. In this emerging activation space, the decodability of exemplar category varies over time, reflecting the brain’s transformation of visual inputs into coherent category representations. How do these emerging representations relate to categorization behavior? Recently it has been proposed that the distance of an exemplar representation from a categorical boundary in an activation space is critical for perceptual decision-making, and that reaction times should therefore correlate with distance from the boundary. The predictions of this distance hypothesis have been born out in human inferior temporal cortex (IT), an area of the brain crucial for the representation of object categories. When viewed in the context of a time varying neural signal, the optimal time to “read out” category information is when category representations in the brain are most decodable. Here, we show that the distance from a decision boundary through activation space, as measured using MEG decoding methods, correlates with reaction times for visual categorization during the period of peak decodability. Our results suggest that the brain begins to read out information about exemplar category at the optimal time for use in choice behaviour, and support the hypothesis that the structure of the representation for objects in the visual system is partially constitutive of the decision process in recognition.     

Visuo-tactile representation of near-the-body space.

Here we report findings from neuropsychological investigations showing the existence, in humans, of intersensory integrative systems representing space through the multisensory coding of visual and tactile events. In addition, these findings show that visuo-tactile integration may take place in a privileged manner within a limited sector of space closely surrounding the body surface, i.e., the near-peripersonal space. They also demonstrate that the representation of near-peripersonal space is not static, as objects in the out-of-reach space can be processed as nearer, depending upon the (illusory) visual information about hand position in space, and the use of tools as physical extensions of the reachable space. Finally, new evidence is provided suggesting the multisensory coding of peripersonal space can be achieved through bottom-up processing that, at least in some instances, is not necessarily modulated by more "cognitive" top-down processing, such as the expectation regarding the possibility of being touched. These findings are entirely consistent with the functional properties of multisensory neuronal structures coding near-peripersonal space in monkeys, as well as with behavioral, and neuroimaging evidence for the cross-modal coding of space in normal subjects. This high level of convergence ultimately favors the idea that multisensory space coding is achieved through similar multimodal structures in both humans and non-human primates.     

Macaque Cardiac Physiology Is Sensitive to the Valence of Passively Viewed Sensory Stimuli

Autonomic nervous system activity is an important component of affective experience. We demonstrate in the rhesus monkey that both the sympathetic and parasympathetic branches of the autonomic nervous system respond differentially to the affective valence of passively viewed video stimuli. We recorded cardiac impedance and an electrocardiogram while adult macaques watched a series of 300 30-second videos that varied in their affective content. We found that sympathetic activity (as measured by cardiac pre-ejection period) increased and parasympathetic activity (as measured by respiratory sinus arrhythmia) decreased as video content changes from positive to negative. These findings parallel the relationship between autonomic nervous system responsivity and valence of stimuli in humans. Given the relationship between human cardiac physiology and affective processing, these findings suggest that macaque cardiac physiology may be an index of affect in nonverbal animals.     

Online learning of objects in a biologically motivated visual architecture

We present a biologically motivated architecture for object recognition that is capable of online learning of several objects based on interaction with a human teacher. The system combines biological principles such as appearance-based representation in topographical feature detection hierarchies and context-driven transfer between different levels of object memory. Training can be performed in an unconstrained environment by presenting objects in front of a stereo camera system and labeling them by speech input. The learning is fully online and thus avoids an artificial separation of the interaction into training and test phases. We demonstrate the performance on a challenging ensemble of 50 objects.