Music and emotions in the brain: familiarity matters

The importance of music in our daily life has given rise to an increased number of studies addressing the brain regions involved in its appreciation. Some of these studies controlled only for the familiarity of the stimuli, while others relied on pleasantness ratings, and others still on musical preferences. With a listening test and a functional magnetic resonance imaging (fMRI) experiment, we wished to clarify the role of familiarity in the brain correlates of music appreciation by controlling, in the same study, for both familiarity and musical preferences. First, we conducted a listening test, in which participants rated the familiarity and liking of song excerpts from the pop/rock repertoire, allowing us to select a personalized set of stimuli per subject. Then, we used a passive listening paradigm in fMRI to study music appreciation in a naturalistic condition with increased ecological value. Brain activation data revealed that broad emotion-related limbic and paralimbic regions as well as the reward circuitry were significantly more active for familiar relative to unfamiliar music. Smaller regions in the cingulate cortex and frontal lobe, including the motor cortex and Broca's area, were found to be more active in response to liked music when compared to disliked one. Hence, familiarity seems to be a crucial factor in making the listeners emotionally engaged with music, as revealed by fMRI data.     

Dynamic emotional and neural responses to music depend on performance expression and listener experience

Apart from its natural relevance to cognition, music provides a window into the intimate relationships between production, perception, experience, and emotion. Here, emotional responses and neural activity were observed as they evolved together with stimulus parameters over several minutes. Participants listened to a skilled music performance that included the natural fluctuations in timing and sound intensity that musicians use to evoke emotional responses. A mechanical performance of the same piece served as a control. Before and after fMRI scanning, participants reported real-time emotional responses on a 2-dimensional rating scale (arousal and valence) as they listened to each performance. During fMRI scanning, participants listened without reporting emotional responses. Limbic and paralimbic brain areas responded to the expressive dynamics of human music performance, and both emotion and reward related activations during music listening were dependent upon musical training. Moreover, dynamic changes in timing predicted ratings of emotional arousal, as well as real-time changes in neural activity. BOLD signal changes correlated with expressive timing fluctuations in cortical and subcortical motor areas consistent with pulse perception, and in a network consistent with the human mirror neuron system. These findings show that expressive music performance evokes emotion and reward related neural activations, and that music's affective impact on the brains of listeners is altered by musical training. Our observations are consistent with the idea that music performance evokes an emotional response through a form of empathy that is based, at least in part, on the perception of movement and on violations of pulse-based temporal expectancies.     

The Rewarding Aspects of Music Listening Are Related to Degree of Emotional Arousal

Background

Listening to music is amongst the most rewarding experiences for humans. Music has no functional resemblance to other rewarding stimuli, and has no demonstrated biological value, yet individuals continue listening to music for pleasure. It has been suggested that the pleasurable aspects of music listening are related to a change in emotional arousal, although this link has not been directly investigated. In this study, using methods of high temporal sensitivity we investigated whether there is a systematic relationship between dynamic increases in pleasure states and physiological indicators of emotional arousal, including changes in heart rate, respiration, electrodermal activity, body temperature, and blood volume pulse.

Methodology

Twenty-six participants listened to self-selected intensely pleasurable music and “neutral” music that was individually selected for them based on low pleasure ratings they provided on other participants'' music. The “chills” phenomenon was used to index intensely pleasurable responses to music. During music listening, continuous real-time recordings of subjective pleasure states and simultaneous recordings of sympathetic nervous system activity, an objective measure of emotional arousal, were obtained.

Principal Findings

Results revealed a strong positive correlation between ratings of pleasure and emotional arousal. Importantly, a dissociation was revealed as individuals who did not experience pleasure also showed no significant increases in emotional arousal.

Conclusions/Significance

These results have broader implications by demonstrating that strongly felt emotions could be rewarding in themselves in the absence of a physically tangible reward or a specific functional goal.     

Relief as a reward: hedonic and neural responses to safety from pain

Relief fits the definition of a reward. Unlike other reward types the pleasantness of relief depends on the violation of a negative expectation, yet this has not been investigated using neuroimaging approaches. We hypothesized that the degree of negative expectation depends on state (dread) and trait (pessimism) sensitivity. Of the brain regions that are involved in mediating pleasure, the nucleus accumbens also signals unexpected reward and positive prediction error. We hypothesized that accumbens activity reflects the level of negative expectation and subsequent pleasant relief. Using fMRI and two purpose-made tasks, we compared hedonic and BOLD responses to relief with responses during an appetitive reward task in 18 healthy volunteers. We expected some similarities in task responses, reflecting common neural substrates implicated across reward types. However, we also hypothesized that relief responses would differ from appetitive rewards in the nucleus accumbens, since only relief pleasantness depends on negative expectations. The results confirmed these hypotheses. Relief and appetitive reward task activity converged in the ventromedial prefrontal cortex, which also correlated with appetitive reward pleasantness ratings. In contrast, dread and pessimism scores correlated with relief but not with appetitive reward hedonics. Moreover, only relief pleasantness covaried with accumbens activation. Importantly, the accumbens signal appeared to specifically reflect individual differences in anticipation of the adverse event (dread, pessimism) but was uncorrelated to appetitive reward hedonics. In conclusion, relief differs from appetitive rewards due to its reliance on negative expectations, the violation of which is reflected in relief-related accumbens activation.     

Direct activation of the ventral striatum in anticipation of aversive stimuli

The brain "reward" system, centered on the limbic ventral striatum, plays a critical role in the response to pleasure and pain. The ventral striatum is activated in animal and human studies during anticipation of appetitive/pleasurable events, but its role in aversive/painful events is less clear. Here we present data from three human fMRI studies based on aversive conditioning using unpleasant cutaneous electrical stimulation and show that the ventral striatum is reliably activated. This activation is observed during anticipation and is not a consequence of relief after the aversive event. Further, the ventral striatum is activated in anticipation regardless of whether there is an opportunity to avoid the aversive stimulus or not. Our data suggest that the ventral striatum, a crucial element of the brain "reward" system, is directly activated in anticipation of aversive stimuli.     

Abnormal neural responses to social exclusion in schizophrenia

Social exclusion is an influential concept in politics, mental health and social psychology. Studies on healthy subjects have implicated the medial prefrontal cortex (mPFC), a region involved in emotional and social information processing, in neural responses to social exclusion. Impairments in social interactions are common in schizophrenia and are associated with reduced quality of life. Core symptoms such as delusions usually have a social content. However little is known about the neural underpinnings of social abnormalities. The aim of this study was to investigate the neural substrates of social exclusion in schizophrenia. Patients with schizophrenia and healthy controls underwent fMRI while participating in a popular social exclusion paradigm. This task involves passing a 'ball' between the participant and two cartoon representations of other subjects. The extent of social exclusion (ball not being passed to the participant) was parametrically varied throughout the task. Replicating previous findings, increasing social exclusion activated the mPFC in controls. In contrast, patients with schizophrenia failed to modulate mPFC responses with increasing exclusion. Furthermore, the blunted response to exclusion correlated with increased severity of positive symptoms. These data support the hypothesis that the neural response to social exclusion differs in schizophrenia, highlighting the mPFC as a potential substrate of impaired social interactions.     

Syncopation,Body-Movement and Pleasure in Groove Music

Moving to music is an essential human pleasure particularly related to musical groove. Structurally, music associated with groove is often characterised by rhythmic complexity in the form of syncopation, frequently observed in musical styles such as funk, hip-hop and electronic dance music. Structural complexity has been related to positive affect in music more broadly, but the function of syncopation in eliciting pleasure and body-movement in groove is unknown. Here we report results from a web-based survey which investigated the relationship between syncopation and ratings of wanting to move and experienced pleasure. Participants heard funk drum-breaks with varying degrees of syncopation and audio entropy, and rated the extent to which the drum-breaks made them want to move and how much pleasure they experienced. While entropy was found to be a poor predictor of wanting to move and pleasure, the results showed that medium degrees of syncopation elicited the most desire to move and the most pleasure, particularly for participants who enjoy dancing to music. Hence, there is an inverted U-shaped relationship between syncopation, body-movement and pleasure, and syncopation seems to be an important structural factor in embodied and affective responses to groove.     

Eyes Wide Shut: Amygdala Mediates Eyes-Closed Effect on Emotional Experience with Music

The perceived emotional value of stimuli and, as a consequence the subjective emotional experience with them, can be affected by context-dependent styles of processing. Therefore, the investigation of the neural correlates of emotional experience requires accounting for such a variable, a matter of an experimental challenge. Closing the eyes affects the style of attending to auditory stimuli by modifying the perceptual relationship with the environment without changing the stimulus itself. In the current study, we used fMRI to characterize the neural mediators of such modification on the experience of emotionality in music. We assumed that closed eyes position will reveal interplay between different levels of neural processing of emotions. More specifically, we focused on the amygdala as a central node of the limbic system and on its co-activation with the Locus Ceruleus (LC) and Ventral Prefrontal Cortex (VPFC); regions involved in processing of, respectively, ‘low’, visceral-, and ‘high’, cognitive-related, values of emotional stimuli. Fifteen healthy subjects listened to negative and neutral music excerpts with eyes closed or open. As expected, behavioral results showed that closing the eyes while listening to emotional music resulted in enhanced rating of emotionality, specifically of negative music. In correspondence, fMRI results showed greater activation in the amygdala when subjects listened to the emotional music with eyes closed relative to eyes open. More so, by using voxel-based correlation and a dynamic causal model analyses we demonstrated that increased amygdala activation to negative music with eyes closed led to increased activations in the LC and VPFC. This finding supports a system-based model of perceived emotionality in which the amygdala has a central role in mediating the effect of context-based processing style by recruiting neural operations involved in both visceral (i.e. ‘low’) and cognitive (i.e. ‘high’) related processes of emotions.     

Impact of Early Life Adversity on Reward Processing in Young Adults: EEG-fMRI Results from a Prospective Study over 25 Years

Several lines of evidence have implicated the mesolimbic dopamine reward pathway in altered brain function resulting from exposure to early adversity. The present study examined the impact of early life adversity on different stages of neuronal reward processing later in life and their association with a related behavioral phenotype, i.e. attention deficit/hyperactivity disorder (ADHD). 162 healthy young adults (mean age = 24.4 years; 58% female) from an epidemiological cohort study followed since birth participated in a simultaneous EEG-fMRI study using a monetary incentive delay task. Early life adversity according to an early family adversity index (EFA) and lifetime ADHD symptoms were assessed using standardized parent interviews conducted at the offspring''s age of 3 months and between 2 and 15 years, respectively. fMRI region-of-interest analysis revealed a significant effect of EFA during reward anticipation in reward-related areas (i.e. ventral striatum, putamen, thalamus), indicating decreased activation when EFA increased. EEG analysis demonstrated a similar effect for the contingent negative variation (CNV), with the CNV decreasing with the level of EFA. In contrast, during reward delivery, activation of the bilateral insula, right pallidum and bilateral putamen increased with EFA. There was a significant association of lifetime ADHD symptoms with lower activation in the left ventral striatum during reward anticipation and higher activation in the right insula during reward delivery. The present findings indicate a differential long-term impact of early life adversity on reward processing, implicating hyporesponsiveness during reward anticipation and hyperresponsiveness when receiving a reward. Moreover, a similar activation pattern related to lifetime ADHD suggests that the impact of early life stress on ADHD may possibly be mediated by a dysfunctional reward pathway.     

The medial prefrontal cortex as a part of the brain reward system

Summary. This review will briefly summarize experimental evidence for an involvement of the medial prefrontal cortex (mPFC) in reward-related mechanisms in the rat brain. The mPFC is part of the mesocorticolimbic dopaminergic system. It receives prominent dopaminergic input from the ventral tegmental area (VTA) and, via the mediodorsal thalamus, inputs from other subcortical basal ganglia structures. In turn it projects back to the VTA and the nucleus accumbens septi (NAS), which are generally considered as main components of the brain reward system. Evidence for the involvement of the mPFC in reward-related mechanisms comes mainly from three types of studies, conditioned place preference (CPP), intracranial self-stimulation (ICSS), and self-administration. Work will be summarized that has shown that certain drugs injected into the mPFC can produce CPP or that lesions of the mPFC can disrupt the development of CPP, that ICSS is obtained with the stimulating electrode placed in the mPFC, and that certain drugs are self-administered into the mPFC or that lesions of the mPFC disrupt the peripheral self-administration of certain drugs. However, it has also been shown that the role of the mPFC in reward is not uniform. For example, the mPFC appears to be particularly important for the rewarding actions of cocaine, while it appears not to be important for the rewarding actions of amphetamine. Also, different subareas of the mPFC appear to be differentially involved in the rewarding actions of different drugs. Taken together, the available evidence shows that some drugs can produce reward directly within the mPFC, and that some drugs, even though not having direct rewarding effects within the mPFC, depend on the function of the mPFC for the mediation of their rewarding effects. Received August 31, 1999 Accepted September 20, 1999     

Is the Medial Prefrontal Cortex Necessary for Theory of Mind?

Background

Successful social interaction relies on the ability to attribute mental states to other people. Previous functional neuroimaging studies have shown that this process, described as Theory of Mind (ToM) or mentalization, is reliably associated with activation of the medial prefrontal cortex (mPFC). However, this study presents a novel and surprising finding that provides new insight into the role of the mPFC in mentalization tasks.

Methodology/Principal Findings

Twenty healthy individuals were recruited from a wide range of ages and social backgrounds. Participants underwent functional magnetic resonance imaging (fMRI) while viewing a well-established ToM visual paradigm involving moving triangles. Functional MRI data were analyzed using a classical general linear model. No activation was detected in the medial prefrontal cortex (mPFC) during movement patterns that typically elicit ToM. However, increased activity was observed in the right middle occipital gyrus, right temporoparietal junction (TPJ), left middle occipital gyrus and right inferior frontal gyrus. No correlation was found between participants’ age and BOLD response.

Conclusions/Significance

In contrast with previous neuroimaging research, our findings support the notion that mPFC function is not critical for reasoning about the mental states of others; furthermore, our data indicate that the right TPJ and right inferior frontal gyrus are able to perform mentalization without any contributions from the mPFC.     

Comparing the processing of music and language meaning using EEG and FMRI provides evidence for similar and distinct neural representations

Recent demonstrations that music is capable of conveying semantically meaningful information has raised several questions as to what the underlying mechanisms of establishing meaning in music are, and if the meaning of music is represented in comparable fashion to language meaning. This paper presents evidence showing that expressed affect is a primary pathway to music meaning and that meaning in music is represented in a very similar fashion to language meaning. In two experiments using EEG and fMRI, it was shown that single chords varying in harmonic roughness (consonance/dissonance) and thus perceived affect could prime the processing of subsequently presented affective target words, as indicated by an increased N400 and activation of the right middle temporal gyrus (MTG). Most importantly, however, when primed by affective words, single chords incongruous to the preceding affect also elicited an N400 and activated the right posterior STS, an area implicated in processing meaning of a variety of signals (e.g. prosody, voices, motion). This provides an important piece of evidence in support of music meaning being represented in a very similar but also distinct fashion to language meaning: Both elicit an N400, but activate different portions of the right temporal lobe.     

Examining Complexity across Domains: Relating Subjective and Objective Measures of Affective Environmental Scenes,Paintings and Music

Subjective complexity has been found to be related to hedonic measures of preference, pleasantness and beauty, but there is no consensus about the nature of this relationship in the visual and musical domains. Moreover, the affective content of stimuli has been largely neglected so far in the study of complexity but is crucial in many everyday contexts and in aesthetic experiences. We thus propose a cross-domain approach that acknowledges the multidimensional nature of complexity and that uses a wide range of objective complexity measures combined with subjective ratings. In four experiments, we employed pictures of affective environmental scenes, representational paintings, and Romantic solo and chamber music excerpts. Stimuli were pre-selected to vary in emotional content (pleasantness and arousal) and complexity (low versus high number of elements). For each set of stimuli, in a between-subjects design, ratings of familiarity, complexity, pleasantness and arousal were obtained for a presentation time of 25 s from 152 participants. In line with Berlyne’s collative-motivation model, statistical analyses controlling for familiarity revealed a positive relationship between subjective complexity and arousal, and the highest correlations were observed for musical stimuli. Evidence for a mediating role of arousal in the complexity-pleasantness relationship was demonstrated in all experiments, but was only significant for females with regard to music. The direction and strength of the linear relationship between complexity and pleasantness depended on the stimulus type and gender. For environmental scenes, the root mean square contrast measures and measures of compressed file size correlated best with subjective complexity, whereas only edge detection based on phase congruency yielded equivalent results for representational paintings. Measures of compressed file size and event density also showed positive correlations with complexity and arousal in music, which is relevant for the discussion on which aspects of complexity are domain-specific and which are domain-general.     

The Neural Basis of Object-Context Relationships on Aesthetic Judgment

The relationship between contextual information and object perception has received considerable attention in neuroimaging studies. In the work reported here, we used functional magnetic resonance imaging (fMRI) to investigate the relationship between aesthetic judgment and images of objects in their normal contextual setting versus images of objects in abnormal contextual settings and the underlying brain activity. When object-context relationships are violated changes in visual perception and aesthetic judgment emerges that exposes the contribution of vision to interpretations shaped by previous experience. We found that effects of context on aesthetic judgment modulates different memory sub-systems, while aesthetic judgment regardless of context recruit medial and lateral aspects of the orbitofrontal cortex, consistent with previous findings. Visual cortical areas traditionally associated with the processing of visual features are recruited in normal contexts, irrespective of aesthetic ratings, while prefrontal areas are significantly more engaged when objects are viewed in unaccustomed settings.     

Differential neural responses to food images in women with bulimia versus anorexia nervosa

Background

Previous fMRI studies show that women with eating disorders (ED) have differential neural activation to viewing food images. However, despite clinical differences in their responses to food, differential neural activation to thinking about eating food, between women with anorexia nervosa (AN) and bulimia nervosa (BN) is not known.

Methods

We compare 50 women (8 with BN, 18 with AN and 24 age-matched healthy controls [HC]) while they view food images during functional Magnetic Resonance Imaging (fMRI).

Results

In response to food (vs non-food) images, women with BN showed greater neural activation in the visual cortex, right dorsolateral prefrontal cortex, right insular cortex and precentral gyrus, women with AN showed greater activation in the right dorsolateral prefrontal cortex, cerebellum and right precuneus. HC women activated the cerebellum, right insular cortex, right medial temporal lobe and left caudate. Direct comparisons revealed that compared to HC, the BN group showed relative deactivation in the bilateral superior temporal gyrus/insula, and visual cortex, and compared to AN had relative deactivation in the parietal lobe and dorsal posterior cingulate cortex, but greater activation in the caudate, superior temporal gyrus, right insula and supplementary motor area.

Conclusions

Women with AN and BN activate top-down cognitive control in response to food images, yet women with BN have increased activation in reward and somatosensory regions, which might impinge on cognitive control over food consumption and binge eating.     

Human striatal responses to monetary reward depend on saliency

While the striatum has been implicated in reward processing, an alternative view contends that the striatum processes salient events in general. Using fMRI, we investigated human striatal responses to monetary reward while modulating the saliency surrounding its receipt. Money was maximally salient when its receipt depended on a correct response (active) and minimally salient when its receipt was completely independent of the task (passive). The saliency manipulation was confirmed by skin conductance responses and subjective ratings of the stimuli. Significant caudate and nucleus accumbens activations occurred following the active compared to passive money. Such activations were attributed to saliency rather than the motor requirement associated with the active money because striatal activations were not observed when the money was replaced by inconsequential, nonrewarding stimuli. The present study provides evidence that the striatum's role in reward processing is dependent on the saliency associated with reward, rather than value or hedonic feelings.     

Diurnal rhythms in psychological reward functioning in healthy young men: ‘Wanting’, liking,and learning

A range of evidence suggests that human reward functioning is partly driven by the endogenous circadian system, generating 24-hour rhythms in behavioural measures of reward activation. Reward functioning is multifaceted but literature to date is largely limited to measures of self-reported positive mood states. The aim of this study was to advance the field by testing for hypothesised diurnal variation in previously unexplored components of psychological reward: ‘wanting’, liking, and learning using subjective and behavioural measures. Risky decision making (automatic Balloon Analogue Risk Task), affective responsivity to positive images (International Affective Pictures System), uncued self-reported discrete emotions, and learning-contingent reward (Iowa Gambling Task) were measured at 10.00 hours, 14.00 hours, and 19.00 hours in a counterbalanced repeated measures design with 50 healthy male participants (aged 18–30). As hypothesised, risky decision making (unconscious ‘wanting’) and ratings of arousal towards positive images (conscious wanting) exhibited a diurnal waveform with indices highest at 14.00 hours. No diurnal rhythm was observed for liking (pleasure ratings to positive images, discrete uncued positive emotions) or in a learning-contingent reward task. Findings reaffirm that diurnal variation in human reward functioning is most pronounced in the motivational ‘wanting’ components of reward.     

Affective Responses to Increasing Levels of Exercise Intensity in Normal‐weight,Overweight, and Obese Middle‐aged Women

At least 60 min of daily physical activity (PA) are recommended for weight control, a target achieved by only 3% of obese (OB) women. The purposes of this study were to examine (i) the affective responses of normal‐weight (NW), overweight (OW), and OB middle‐aged sedentary women to exercise of increasing intensity and (ii) the relationship of affective responses to self‐efficacy and social physique anxiety. The women participated in a graded treadmill protocol to volitional exhaustion while providing ratings of pleasure–displeasure and perceived activation each minute. The Activation Deactivation Adjective Check List (AD ACL) was also completed before and after exercise. The affective responses of NW and OW women did not differ. However OB women gave lower pleasure ratings during the incremental protocol and reported lower Energy scores immediately after the protocol. Social physique anxiety, but not self‐efficacy, was inversely related to pleasure and energy. The lower levels of pleasure and energy experienced by OB than nonobese women could account in part for their dramatically low levels of PA participation. Modifying the cognitive antecedents of social physique anxiety might be a useful intervention strategy.     

Are Autobiographical Memories Inherently Social? Evidence from an fMRI Study

The story of our lifetime – our narrative self – is constructed from our autobiographical memories. A central claim of social psychology is that this narrative self is inherently social: When we construct our lives, we do so in a real or imagined interaction. This predicts that self-referential processes which are involved in recall of autobiographical memories overlap with processes involved in social interactions. Indeed, previous functional MRI studies indicate that regions in the medial prefrontal cortex (mPFC) are activated during autobiographical memory recall and virtual communication. However, no fMRI study has investigated recall of autobiographical memories in a real-life interaction. We developed a novel paradigm in which participants overtly reported self-related and other-related memories to an experimenter, whose non-verbal reactions were being filmed and online displayed to the participants in the scanner. We found that recall of autobiographical vs. non-autobiographical memories was associated with activation of the mPFC, as was recall in the social as compared to a non-social control condition; however, both contrasts involved different non-overlapping regions within the mPFC. These results indicate that self-referential processes involved in autobiographical memory recall are different from processes supporting social interactions, and argue against the hypothesis that autobiographical memories are inherently social.     

Cerebral Activations Related to Audition-Driven Performance Imagery in Professional Musicians

Functional Magnetic Resonance Imaging (fMRI) was used to study the activation of cerebral motor networks during auditory perception of music in professional keyboard musicians (n = 12). The activation paradigm implied that subjects listened to two-part polyphonic music, while either critically appraising the performance or imagining they were performing themselves. Two-part polyphonic audition and bimanual motor imagery circumvented a hemisphere bias associated with the convention of playing the melody with the right hand. Both tasks activated ventral premotor and auditory cortices, bilaterally, and the right anterior parietal cortex, when contrasted to 12 musically unskilled controls. Although left ventral premotor activation was increased during imagery (compared to judgment), bilateral dorsal premotor and right posterior-superior parietal activations were quite unique to motor imagery. The latter suggests that musicians not only recruited their manual motor repertoire but also performed a spatial transformation from the vertically perceived pitch axis (high and low sound) to the horizontal axis of the keyboard. Imagery-specific activations in controls were seen in left dorsal parietal-premotor and supplementary motor cortices. Although these activations were less strong compared to musicians, this overlapping distribution indicated the recruitment of a general ‘mirror-neuron’ circuitry. These two levels of sensori-motor transformations point towards common principles by which the brain organizes audition-driven music performance and visually guided task performance.