Experience Drives Synchronization: The phase and Amplitude Dynamics of Neural Oscillations to Musical Chords Are Differentially Modulated by Musical Expertise

Musical expertise is associated with structural and functional changes in the brain that underlie facilitated auditory perception. We investigated whether the phase locking (PL) and amplitude modulations (AM) of neuronal oscillations in response to musical chords are correlated with musical expertise and whether they reflect the prototypicality of chords in Western tonal music. To this aim, we recorded magnetoencephalography (MEG) while musicians and non-musicians were presented with common prototypical major and minor chords, and with uncommon, non-prototypical dissonant and mistuned chords, while watching a silenced movie. We then analyzed the PL and AM of ongoing oscillations in the theta (4–8 Hz) alpha (8–14 Hz), beta- (14–30 Hz) and gamma- (30–80 Hz) bands to these chords. We found that musical expertise was associated with strengthened PL of ongoing oscillations to chords over a wide frequency range during the first 300 ms from stimulus onset, as opposed to increased alpha-band AM to chords over temporal MEG channels. In musicians, the gamma-band PL was strongest to non-prototypical compared to other chords, while in non-musicians PL was strongest to minor chords. In both musicians and non-musicians the long-latency (> 200 ms) gamma-band PL was also sensitive to chord identity, and particularly to the amplitude modulations (beats) of the dissonant chord. These findings suggest that musical expertise modulates oscillation PL to musical chords and that the strength of these modulations is dependent on chord prototypicality.     

Musical Expertise and the Ability to Imagine Loudness

Most perceived parameters of sound (e.g. pitch, duration, timbre) can also be imagined in the absence of sound. These parameters are imagined more veridically by expert musicians than non-experts. Evidence for whether loudness is imagined, however, is conflicting. In music, the question of whether loudness is imagined is particularly relevant due to its role as a principal parameter of performance expression. This study addressed the hypothesis that the veridicality of imagined loudness improves with increasing musical expertise. Experts, novices and non-musicians imagined short passages of well-known classical music under two counterbalanced conditions: 1) while adjusting a slider to indicate imagined loudness of the music and 2) while tapping out the rhythm to indicate imagined timing. Subtests assessed music listening abilities and working memory span to determine whether these factors, also hypothesised to improve with increasing musical expertise, could account for imagery task performance. Similarity between each participant’s imagined and listening loudness profiles and reference recording intensity profiles was assessed using time series analysis and dynamic time warping. The results suggest a widespread ability to imagine the loudness of familiar music. The veridicality of imagined loudness tended to be greatest for the expert musicians, supporting the predicted relationship between musical expertise and musical imagery ability.     

Audio-Tactile Integration and the Influence of Musical Training

Perception of our environment is a multisensory experience; information from different sensory systems like the auditory, visual and tactile is constantly integrated. Complex tasks that require high temporal and spatial precision of multisensory integration put strong demands on the underlying networks but it is largely unknown how task experience shapes multisensory processing. Long-term musical training is an excellent model for brain plasticity because it shapes the human brain at functional and structural levels, affecting a network of brain areas. In the present study we used magnetoencephalography (MEG) to investigate how audio-tactile perception is integrated in the human brain and if musicians show enhancement of the corresponding activation compared to non-musicians. Using a paradigm that allowed the investigation of combined and separate auditory and tactile processing, we found a multisensory incongruency response, generated in frontal, cingulate and cerebellar regions, an auditory mismatch response generated mainly in the auditory cortex and a tactile mismatch response generated in frontal and cerebellar regions. The influence of musical training was seen in the audio-tactile as well as in the auditory condition, indicating enhanced higher-order processing in musicians, while the sources of the tactile MMN were not influenced by long-term musical training. Consistent with the predictive coding model, more basic, bottom-up sensory processing was relatively stable and less affected by expertise, whereas areas for top-down models of multisensory expectancies were modulated by training.     

Preservation of musical memory in an amnesic professional cellist

Learning and memory of music involves a multitude of perceptual, motor, affective, and autobiographical memory processes [1]. Patient and imaging studies suggest that musical memory may involve distinct neural substrates [2,3]. However, the degree of independence of such a system from other memory domains is controversial [4]. We have investigated a 68-year-old professional cellist, patient PM, who developed severe amnesia following encephalitis. This case provided a unique opportunity to study musical memory in a patient with a precisely defined premorbid musical knowledge and well-demarcated focal lesions of the brain. Despite severe memory impairments, he performed like healthy musicians in various tests of recognition memory for music. These findings suggest that learning and retention of musical information depends on brain networks distinct from those involved in other types of episodic and semantic memory.     

Cognitive Control in Auditory Working Memory Is Enhanced in Musicians

Musical competence may confer cognitive advantages that extend beyond processing of familiar musical sounds. Behavioural evidence indicates a general enhancement of both working memory and attention in musicians. It is possible that musicians, due to their training, are better able to maintain focus on task-relevant stimuli, a skill which is crucial to working memory. We measured the blood oxygenation-level dependent (BOLD) activation signal in musicians and non-musicians during working memory of musical sounds to determine the relation among performance, musical competence and generally enhanced cognition. All participants easily distinguished the stimuli. We tested the hypothesis that musicians nonetheless would perform better, and that differential brain activity would mainly be present in cortical areas involved in cognitive control such as the lateral prefrontal cortex. The musicians performed better as reflected in reaction times and error rates. Musicians also had larger BOLD responses than non-musicians in neuronal networks that sustain attention and cognitive control, including regions of the lateral prefrontal cortex, lateral parietal cortex, insula, and putamen in the right hemisphere, and bilaterally in the posterior dorsal prefrontal cortex and anterior cingulate gyrus. The relationship between the task performance and the magnitude of the BOLD response was more positive in musicians than in non-musicians, particularly during the most difficult working memory task. The results confirm previous findings that neural activity increases during enhanced working memory performance. The results also suggest that superior working memory task performance in musicians rely on an enhanced ability to exert sustained cognitive control. This cognitive benefit in musicians may be a consequence of focused musical training.     

Action in Perception: Prominent Visuo-Motor Functional Symmetry in Musicians during Music Listening

Musical training leads to sensory and motor neuroplastic changes in the human brain. Motivated by findings on enlarged corpus callosum in musicians and asymmetric somatomotor representation in string players, we investigated the relationship between musical training, callosal anatomy, and interhemispheric functional symmetry during music listening. Functional symmetry was increased in musicians compared to nonmusicians, and in keyboardists compared to string players. This increased functional symmetry was prominent in visual and motor brain networks. Callosal size did not significantly differ between groups except for the posterior callosum in musicians compared to nonmusicians. We conclude that the distinctive postural and kinematic symmetry in instrument playing cross-modally shapes information processing in sensory-motor cortical areas during music listening. This cross-modal plasticity suggests that motor training affects music perception.     

Musical training induces functional plasticity in perceptual and motor networks: insights from resting-state FMRI

A number of previous studies have examined music-related plasticity in terms of multi-sensory and motor integration but little is known about the functional and effective connectivity patterns of spontaneous intrinsic activity in these systems during the resting state in musicians. Using functional connectivity and Granger causal analysis, functional and effective connectivity among the motor and multi-sensory (visual, auditory and somatosensory) cortices were evaluated using resting-state functional magnetic resonance imaging (fMRI) in musicians and non-musicians. The results revealed that functional connectivity was significantly increased in the motor and multi-sensory cortices of musicians. Moreover, the Granger causality results demonstrated a significant increase outflow-inflow degree in the auditory cortex with the strongest causal outflow pattern of effective connectivity being found in musicians. These resting state fMRI findings indicate enhanced functional integration among the lower-level perceptual and motor networks in musicians, and may reflect functional consolidation (plasticity) resulting from long-term musical training, involving both multi-sensory and motor functional integration.     

The Role of Emotion in Musical Improvisation: An Analysis of Structural Features

One of the primary functions of music is to convey emotion, yet how music accomplishes this task remains unclear. For example, simple correlations between mode (major vs. minor) and emotion (happy vs. sad) do not adequately explain the enormous range, subtlety or complexity of musically induced emotions. In this study, we examined the structural features of unconstrained musical improvisations generated by jazz pianists in response to emotional cues. We hypothesized that musicians would not utilize any universal rules to convey emotions, but would instead combine heterogeneous musical elements together in order to depict positive and negative emotions. Our findings demonstrate a lack of simple correspondence between emotions and musical features of spontaneous musical improvisation. While improvisations in response to positive emotional cues were more likely to be in major keys, have faster tempos, faster key press velocities and more staccato notes when compared to negative improvisations, there was a wide distribution for each emotion with components that directly violated these primary associations. The finding that musicians often combine disparate features together in order to convey emotion during improvisation suggests that structural diversity may be an essential feature of the ability of music to express a wide range of emotion.     

Dynamic emotional and neural responses to music depend on performance expression and listener experience

Apart from its natural relevance to cognition, music provides a window into the intimate relationships between production, perception, experience, and emotion. Here, emotional responses and neural activity were observed as they evolved together with stimulus parameters over several minutes. Participants listened to a skilled music performance that included the natural fluctuations in timing and sound intensity that musicians use to evoke emotional responses. A mechanical performance of the same piece served as a control. Before and after fMRI scanning, participants reported real-time emotional responses on a 2-dimensional rating scale (arousal and valence) as they listened to each performance. During fMRI scanning, participants listened without reporting emotional responses. Limbic and paralimbic brain areas responded to the expressive dynamics of human music performance, and both emotion and reward related activations during music listening were dependent upon musical training. Moreover, dynamic changes in timing predicted ratings of emotional arousal, as well as real-time changes in neural activity. BOLD signal changes correlated with expressive timing fluctuations in cortical and subcortical motor areas consistent with pulse perception, and in a network consistent with the human mirror neuron system. These findings show that expressive music performance evokes emotion and reward related neural activations, and that music's affective impact on the brains of listeners is altered by musical training. Our observations are consistent with the idea that music performance evokes an emotional response through a form of empathy that is based, at least in part, on the perception of movement and on violations of pulse-based temporal expectancies.     

The Neural Correlates of Shoulder Apprehension: A Functional MRI Study

Although shoulder apprehension is an established clinical finding and is important for the prevention of shoulder dislocation, how this subjective perception is evoked remains unclear. We elucidated the functional neuroplasticity associated with apprehension in patients with recurrent anterior shoulder instability (RSI) using functional magnetic resonance imaging (fMRI). Twelve healthy volunteers and 14 patients with right-sided RSI performed a motor imagery task and a passive shoulder motion task. Brain activity was compared between healthy participants and those with RSI and was correlated with the apprehension intensity reported by participants after each task. Compared to healthy volunteers, participants with RSI exhibited decreased brain activity in the motor network, but increased activity in the hippocampus and amygdala. During the passive motion task, participants with RSI exhibited decreased activity in the left premotor and primary motor/somatosensory areas. Furthermore, brain activity was correlated with apprehension intensity in the left amygdala and left thalamus during the motor imagery task (memory-induced), while a correlation between apprehension intensity and brain activity was found in the left prefrontal cortex during the passive motion task (instability-induced). Our findings provide insight into the pathophysiology of RSI by identifying its associated neural alterations. We elucidated that shoulder apprehension was induced by two different factors, namely instability and memory.     

正常人长时数字记忆信息提取的神经基础的功能磁共振研究

本文旨在通过功能磁共振成像(functional magnetic resonance imaging,fMRI)技术研究正常人进行长时数字记忆信息提取的神经基础。选取22名右利手志愿者进行长时数字记忆任务实验,采用组块设计,记忆任务与对照任务交替进行,同时利用Siemens 1.5T超导型磁共振仪进行fMRI成像,采用SPM99软件进行数据分析,脑功能区定位在Talairach坐标中显示。结果显示被试者在进行长时数字记忆提取任务时,激活最显著的皮层是左侧额中回(Brodmann分区9区,BA9区),另外左额叶内侧回、左额下回、右额下回、扣带回、左顶下小叶、左顶上小叶、右顶上小叶、右颞中回、左枕舌回、左枕中回、右中脑、小脑、右尾状核尾部等结构也有激活,各大脑皮层的激活均呈现明显的左侧半球优势。根据上述结果推论,长时数字记忆由以左侧大脑半球为优势的各脑区共同参与完成,其中左侧额叶外侧面可能是信息提取的重要结构,而其它脑叶及其之间的广泛联系可能在数字信息的加工、处理和存储中起重要作用。     

Auditory Short-Term Memory Activation during Score Reading

Performing music on the basis of reading a score requires reading ahead of what is being played in order to anticipate the necessary actions to produce the notes. Score reading thus not only involves the decoding of a visual score and the comparison to the auditory feedback, but also short-term storage of the musical information due to the delay of the auditory feedback during reading ahead. This study investigates the mechanisms of encoding of musical information in short-term memory during such a complicated procedure. There were three parts in this study. First, professional musicians participated in an electroencephalographic (EEG) experiment to study the slow wave potentials during a time interval of short-term memory storage in a situation that requires cross-modal translation and short-term storage of visual material to be compared with delayed auditory material, as it is the case in music score reading. This delayed visual-to-auditory matching task was compared with delayed visual-visual and auditory-auditory matching tasks in terms of EEG topography and voltage amplitudes. Second, an additional behavioural experiment was performed to determine which type of distractor would be the most interfering with the score reading-like task. Third, the self-reported strategies of the participants were also analyzed. All three parts of this study point towards the same conclusion according to which during music score reading, the musician most likely first translates the visual score into an auditory cue, probably starting around 700 or 1300 ms, ready for storage and delayed comparison with the auditory feedback.     

Behavioral and Neural Correlates of Executive Functioning in Musicians and Non-Musicians

Executive functions (EF) are cognitive capacities that allow for planned, controlled behavior and strongly correlate with academic abilities. Several extracurricular activities have been shown to improve EF, however, the relationship between musical training and EF remains unclear due to methodological limitations in previous studies. To explore this further, two experiments were performed; one with 30 adults with and without musical training and one with 27 musically trained and untrained children (matched for general cognitive abilities and socioeconomic variables) with a standardized EF battery. Furthermore, the neural correlates of EF skills in musically trained and untrained children were investigated using fMRI. Adult musicians compared to non-musicians showed enhanced performance on measures of cognitive flexibility, working memory, and verbal fluency. Musically trained children showed enhanced performance on measures of verbal fluency and processing speed, and significantly greater activation in pre-SMA/SMA and right VLPFC during rule representation and task-switching compared to musically untrained children. Overall, musicians show enhanced performance on several constructs of EF, and musically trained children further show heightened brain activation in traditional EF regions during task-switching. These results support the working hypothesis that musical training may promote the development and maintenance of certain EF skills, which could mediate the previously reported links between musical training and enhanced cognitive skills and academic achievement.     

Assessment of lexical semantic judgment abilities in alcohol-dependent subjects: An fMRI study

Neuropsychological studies have shown that alcohol dependence is associated with neurocognitive deficits in tasks requiring memory, perceptual motor skills, abstraction and problem solving, whereas language skills are relatively spared in alcoholics despite structural abnormalities in the language-related brain regions. To investigate the preserved mechanisms of language processing in alcohol-dependents, functional brain imaging was undertaken in healthy controls (n=18) and alcohol-dependents (n=16) while completing a lexical semantic judgment task in a 3 T MR scanner. Behavioural data indicated that alcohol-dependents took more time than controls for performing the task but there was no significant difference in their response accuracy. fMRI data analysis revealed that while performing the task, the alcoholics showed enhanced activations in left supramarginal gyrus, precuneus bilaterally, left angular gyrus, and left middle temporal gyrus as compared to control subjects. The extensive activations observed in alcoholics as compared to controls suggest that alcoholics recruit additional brain areas to meet the behavioural demands for equivalent task performance. The results are consistent with previous fMRI studies suggesting compensatory mechanisms for the execution of task for showing an equivalent performance or decreased neural efficiency of relevant brain networks. However, on direct comparison of the two groups, the results did not survive correction for multiple comparisons; therefore, the present findings need further exploration.     

Cerebral Activations Related to Audition-Driven Performance Imagery in Professional Musicians

Functional Magnetic Resonance Imaging (fMRI) was used to study the activation of cerebral motor networks during auditory perception of music in professional keyboard musicians (n = 12). The activation paradigm implied that subjects listened to two-part polyphonic music, while either critically appraising the performance or imagining they were performing themselves. Two-part polyphonic audition and bimanual motor imagery circumvented a hemisphere bias associated with the convention of playing the melody with the right hand. Both tasks activated ventral premotor and auditory cortices, bilaterally, and the right anterior parietal cortex, when contrasted to 12 musically unskilled controls. Although left ventral premotor activation was increased during imagery (compared to judgment), bilateral dorsal premotor and right posterior-superior parietal activations were quite unique to motor imagery. The latter suggests that musicians not only recruited their manual motor repertoire but also performed a spatial transformation from the vertically perceived pitch axis (high and low sound) to the horizontal axis of the keyboard. Imagery-specific activations in controls were seen in left dorsal parietal-premotor and supplementary motor cortices. Although these activations were less strong compared to musicians, this overlapping distribution indicated the recruitment of a general ‘mirror-neuron’ circuitry. These two levels of sensori-motor transformations point towards common principles by which the brain organizes audition-driven music performance and visually guided task performance.     

Enhanced Syllable Discrimination Thresholds in Musicians

Speech processing inherently relies on the perception of specific, rapidly changing spectral and temporal acoustic features. Advanced acoustic perception is also integral to musical expertise, and accordingly several studies have demonstrated a significant relationship between musical training and superior processing of various aspects of speech. Speech and music appear to overlap in spectral and temporal features; however, it remains unclear which of these acoustic features, crucial for speech processing, are most closely associated with musical training. The present study examined the perceptual acuity of musicians to the acoustic components of speech necessary for intra-phonemic discrimination of synthetic syllables. We compared musicians and non-musicians on discrimination thresholds of three synthetic speech syllable continua that varied in their spectral and temporal discrimination demands, specifically voice onset time (VOT) and amplitude envelope cues in the temporal domain. Musicians demonstrated superior discrimination only for syllables that required resolution of temporal cues. Furthermore, performance on the temporal syllable continua positively correlated with the length and intensity of musical training. These findings support one potential mechanism by which musical training may selectively enhance speech perception, namely by reinforcing temporal acuity and/or perception of amplitude rise time, and implications for the translation of musical training to long-term linguistic abilities.     

The nose smells what the eye sees: crossmodal visual facilitation of human olfactory perception

Human olfactory perception is notoriously unreliable, but shows substantial benefits from visual cues, suggesting important crossmodal integration between these primary sensory modalities. We used event-related fMRI to determine the underlying neural mechanisms of olfactory-visual integration in the human brain. Subjects participated in an olfactory detection task, whereby odors and pictures were delivered separately or together. By manipulating the degree of semantic correspondence between odor-picture pairs, we show a perceptual olfactory facilitation for semantically congruent (versus incongruent) trials. This behavioral advantage was associated with enhanced neural activity in anterior hippocampus and rostromedial orbitofrontal cortex. We suggest these findings can be interpreted as indicating that human hippocampus mediates reactivation of crossmodal semantic associations, even in the absence of explicit memory processing.     

Both the hippocampus and striatum are involved in consolidation of motor sequence memory

Functional magnetic resonance imaging (fMRI) was used to investigate the cerebral correlates of motor sequence memory consolidation. Participants were scanned while training on an implicit oculomotor sequence learning task and during a single testing session taking place 30 min, 5 hr, or 24 hr later. During training, responses observed in hippocampus and striatum were linearly related to the gain in performance observed overnight, but not over the day. Responses in both structures were significantly larger at 24 hr than at 30 min or 5 hr. Additionally, the competitive interaction observed between these structures during training became cooperative overnight. These results stress the importance of both hippocampus and striatum in procedural memory consolidation. Responses in these areas during training seem to condition the overnight memory processing that is associated with a change in their functional interactions. These results show that both structures interact during motor sequence consolidation to optimize subsequent behavior.     

Right Inferior Frontal Gyrus Activation Is Associated with Memory Improvement in Patients with Left Frontal Low-Grade Glioma Resection

Patients with low-grade glioma (LGG) have been studied as a model of functional brain reorganization due to their slow-growing nature. However, there is no information regarding which brain areas are involved during verbal memory encoding after extensive left frontal LGG resection. In addition, it remains unknown whether these patients can improve their memory performance after instructions to apply efficient strategies. The neural correlates of verbal memory encoding were investigated in patients who had undergone extensive left frontal lobe (LFL) LGG resections and healthy controls using fMRI both before and after directed instructions were given for semantic organizational strategies. Participants were scanned during the encoding of word lists under three different conditions before and after a brief period of practice. The conditions included semantically unrelated (UR), related-non-structured (RNS), and related-structured words (RS), allowing for different levels of semantic organization. All participants improved on memory recall and semantic strategy application after the instructions for the RNS condition. Healthy subjects showed increased activation in the left inferior frontal gyrus (IFG) and middle frontal gyrus (MFG) during encoding for the RNS condition after the instructions. Patients with LFL excisions demonstrated increased activation in the right IFG for the RNS condition after instructions were given for the semantic strategies. Despite extensive damage in relevant areas that support verbal memory encoding and semantic strategy applications, patients that had undergone resections for LFL tumor could recruit the right-sided contralateral homologous areas after instructions were given and semantic strategies were practiced. These results provide insights into changes in brain activation areas typically implicated in verbal memory encoding and semantic processing.     

Movement-related theta rhythm in humans: coordinating self-directed hippocampal learning

The hippocampus is crucial for episodic or declarative memory and the theta rhythm has been implicated in mnemonic processing, but the functional contribution of theta to memory remains the subject of intense speculation. Recent evidence suggests that the hippocampus might function as a network hub for volitional learning. In contrast to human experiments, electrophysiological recordings in the hippocampus of behaving rodents are dominated by theta oscillations reflecting volitional movement, which has been linked to spatial exploration and encoding. This literature makes the surprising cross-species prediction that the human hippocampal theta rhythm supports memory by coordinating exploratory movements in the service of self-directed learning. We examined the links between theta, spatial exploration, and memory encoding by designing an interactive human spatial navigation paradigm combined with multimodal neuroimaging. We used both non-invasive whole-head Magnetoencephalography (MEG) to look at theta oscillations and Functional Magnetic Resonance Imaging (fMRI) to look at brain regions associated with volitional movement and learning. We found that theta power increases during the self-initiation of virtual movement, additionally correlating with subsequent memory performance and environmental familiarity. Performance-related hippocampal theta increases were observed during a static pre-navigation retrieval phase, where planning for subsequent navigation occurred. Furthermore, periods of the task showing movement-related theta increases showed decreased fMRI activity in the parahippocampus and increased activity in the hippocampus and other brain regions that strikingly overlap with the previously observed volitional learning network (the reverse pattern was seen for stationary periods). These fMRI changes also correlated with participant's performance. Our findings suggest that the human hippocampal theta rhythm supports memory by coordinating exploratory movements in the service of self-directed learning. These findings directly extend the role of the hippocampus in spatial exploration in rodents to human memory and self-directed learning.