Motivation and Intelligence Drive Auditory Perceptual Learning

Background

Although feedback on performance is generally thought to promote perceptual learning, the role and necessity of feedback remain unclear. We investigated the effect of providing varying amounts of positive feedback while listeners attempted to discriminate between three identical tones on learning frequency discrimination.

Methodology/Principal Findings

Using this novel procedure, the feedback was meaningless and random in relation to the listeners'' responses, but the amount of feedback provided (or lack thereof) affected learning. We found that a group of listeners who received positive feedback on 10% of the trials improved their performance on the task (learned), while other groups provided either with excess (90%) or with no feedback did not learn. Superimposed on these group data, however, individual listeners showed other systematic changes of performance. In particular, those with lower non-verbal IQ who trained in the no feedback condition performed more poorly after training.

Conclusions/Significance

This pattern of results cannot be accounted for by learning models that ascribe an external teacher role to feedback. We suggest, instead, that feedback is used to monitor performance on the task in relation to its perceived difficulty, and that listeners who learn without the benefit of feedback are adept at self-monitoring of performance, a trait that also supports better performance on non-verbal IQ tests. These results show that ‘perceptual’ learning is strongly influenced by top-down processes of motivation and intelligence.     

The Influence of Stress and Energy Level on Learning Muscle Relaxation During Gross-Motor Task Performance Using Electromyographic Feedback

The aim was to investigate the influence of mood on learning muscle relaxation. Self-reported mood (assessed by the Stress-Energy Checklist) at baseline was related to learning muscle relaxation induced by electromyographic feedback training during performance of a gross-motor task. Feedback training was provided either intermittently (Intermittent Feedback Task, IF, n=12) or continuously (Continuous Feedback Task, CF, n=9). Results reveal a negative correlation between the learning effect at short-term and energy dimension for the IF Task. It can be concluded that mood experienced prior to a learning task is relevant for the learning effect and this effect may be dependent on the schedule of feedback used.     

Dissociation between Active and Observational Learning from Positive and Negative Feedback in Parkinsonism

Feedback to both actively performed and observed behaviour allows adaptation of future actions. Positive feedback leads to increased activity of dopamine neurons in the substantia nigra, whereas dopamine neuron activity is decreased following negative feedback. Dopamine level reduction in unmedicated Parkinson’s Disease patients has been shown to lead to a negative learning bias, i.e. enhanced learning from negative feedback. Recent findings suggest that the neural mechanisms of active and observational learning from feedback might differ, with the striatum playing a less prominent role in observational learning. Therefore, it was hypothesized that unmedicated Parkinson’s Disease patients would show a negative learning bias only in active but not in observational learning. In a between-group design, 19 Parkinson’s Disease patients and 40 healthy controls engaged in either an active or an observational probabilistic feedback-learning task. For both tasks, transfer phases aimed to assess the bias to learn better from positive or negative feedback. As expected, actively learning patients showed a negative learning bias, whereas controls learned better from positive feedback. In contrast, no difference between patients and controls emerged for observational learning, with both groups showing better learning from positive feedback. These findings add to neural models of reinforcement-learning by suggesting that dopamine-modulated input to the striatum plays a minor role in observational learning from feedback. Future research will have to elucidate the specific neural underpinnings of observational learning.     

Transfer of Heart Rate Feedback Training to Reduce Heart Rate Response to Laboratory Tasks

To examine whether transfer of heart rate (HR) feedback training to tasks not used during training could be improved by using multiple tasks during training, a modified multiple baseline across tasks, single subject design study was conducted using six high HR-reactive young adults. Participants received HR feedback training during the presentation of a videogame, and transfer of training was assessed to a mental arithmetic challenge and handgrip task. Transfer of training was next assessed following training with the mental arithmetic challenge and handgrip task. HR responses to each training task with no HR feedback were assessed during a pre-treatment session, an immediate post-training period following training on each task, a short delay (1–2 days) post-training session, and a long delay (1–2 weeks) post-training session. HR response to a novel speech task was assessed at pre-treatment and during short delay and long delay post-training sessions. Results revealed that participants reduced HR during training and generally maintained this reduction in HR during the immediate post-training assessment when HR feedback was not present. Participants were not able to reduce HR responses to tasks during short delay and long delay post-training sessions, and they were unable to transfer HR reduction skills to the speech task. Transfer of HR feedback training to new tasks was limited in nature and efforts to train across multiple stressors did not appear to improve transfer of training.     

Effect of Feedback during Virtual Training of Grip Force Control with a Myoelectric Prosthesis

The aim of this study was to determine whether virtual training improves grip force control in prosthesis use, and to examine which type of augmented feedback facilitates its learning most. Thirty-two able-bodied participants trained grip force with a virtual ball-throwing game for five sessions in a two-week period, using a myoelectric simulator. They received either feedback on movement outcome or on movement execution. Sixteen controls received training that did not focus on force control. Variability over learning was examined with the Tolerance-Noise-Covariation approach, and the transfer of grip force control was assessed in five test-tasks that assessed different aspects of force control in a pretest, a posttest and a retention test. During training performance increased while the variability in performance was decreased, mainly by reduction in noise. Grip force control only improved in the test-tasks that provided information on performance. Starting the training with a task that required low force production showed no transfer of the learned grip force. Feedback on movement execution was detrimental to grip force control, whereas feedback on movement outcome enhanced transfer of grip force control to tasks other than trained. Clinical implications of these results regarding virtual training of grip force control are discussed.     

Feedback delays and relaxation expectancies in EMG biofeedback

The use of noncontingent feedback controls in studies of the efficacy and process of electromyographic (EMG) biofeedback may yield results confounded by differential expectancies for relaxation. Furthermore, the role of expectancies in producing psychological and physical relaxation as well as reducing muscle activity is unclear. This study investigated the effects of feedback delays and induced relaxation expectancies on EMG activity and experienced relaxation. One hundred four non-clinical subjects participated in one auditory frontal EMG biofeedback training session. Subjects were assigned to one of four computerized feedback delay conditions (0.0037, 0.7493, 2.2481, 6.7444 s) and to one of two relaxation expectancy conditions (positive or negative). During 20 minutes of biofeedback training, all groups decreased frontal activity. Feedback delays interacted with training epochs in affecting EMG; the longest delay group reduced frontal activity more slowly than the shortest delay group during training. Positive relaxation expectancies produced greater experienced relaxation than did negative relaxation expectancies. Instrumental and expectancy factors in EMG biofeedback appear to operate independently of each other by reducing physiological activity and producing psychological relaxation respectively.     

Factors Limiting Performance in a Multitone Intensity-Discrimination Task: Disentangling Non-Optimal Decision Weights and Increased Internal Noise

To identify factors limiting performance in multitone intensity discrimination, we presented sequences of five pure tones alternating in level between loud (85 dB SPL) and soft (30, 55, or 80 dB SPL). In the “overall-intensity task”, listeners detected a level increment on all of the five tones. In the “masking task”, the level increment was imposed only on the soft tones, rendering the soft tones targets and loud tones task-irrelevant maskers. Decision weights quantifying the importance of the five tone levels for the decision were estimated using methods of molecular psychophysics. Compatible with previous studies, listeners placed higher weights on the loud tones than on the soft tones in the overall-intensity condition. In the masking task, the decisions were systematically influenced by the to-be-ignored loud tones (maskers). Using a maximum-likelihood technique, we estimated the internal noise variance and tested whether the internal noise was higher in the alternating-level five-tone sequences than in sequences presenting only the soft or only the loud tones. For the overall-intensity task, we found no evidence for increased internal noise, but listeners applied suboptimal decision weights. These results are compatible with the hypothesis that the presence of the loud tones does not impair the precision of the representation of the intensity of the soft tones available at the decision stage, but that this information is not used in an optimal fashion due to a difficulty in attending to the soft tones. For the masking task, in some cases our data indicated an increase in internal noise. Additionally, listeners applied suboptimal decision weights. The maximum-likelihood analyses we developed should also be useful for other tasks or other sensory modalities.     

Feedback delays and relaxation expectancies in EMG biofeedback

The use of noncontingent feedback controls in studies of the efficacy and process of electromyographic (EMG) biofeedback may yield results confounded by differential expectancies for relaxation. Furthermore, the role of expectancies in producing psychological and physical relaxation as well as reducing muscle activity is unclear. This study investigated the effects of feedback delays and induced relaxation expectancies on EMG activity and experienced relaxation. One hundred four non-clinical subjects participated in one auditory frontal EMG biofeedback training session. Subjects were assigned to one of four computerized feedback delay conditions (0.0037, 0.7493, 2.2481, 6.7444 s) and to one of two relaxation expectancy conditions (positive or negative). During 20 minutes of biofeedback training, all groups decreased frontal activity. Feedback delays interacted with training epochs in affecting EMG; the longest delay group reduced frontal activity more slowly than the shortest delay group during training. Positive relaxation expectancies produced greater experienced relaxation than did negative relaxation expectancies. Instrumental and expectancy factors in EMG biofeedback appear to operate independently of each other by reducing physiological activity and producing psychological relaxation respectively.This study was completed by the first author under the direction of the second author in partial fulfillment of the requirements for the Master of Arts degree. We gratefully acknowledge the computerization advice and assistance provided by Larry Wheeler, and the assistance in data collection provided by Dawn Dexter and Michael Winstanley.     

Feedback theory and Darwinian evolution.

Feedback loops can have a significant impact on biological systems that are evolving under Darwinian natural selection. Many of the striking and sometimes bizarre patterns that characterize the evolution of such systems have simple, natural explanations that involve the effects of feedback loops. The two fundamental types of feedback loops, positive and negative, have effects that are radically different: negative feedback tends to produce stability and resistance to change; positive feedback produces instability and even catastrophe. Both types of feedback loops are important in biological systems, and both can produce chaos, whose mathematical complexity often produces strange, beautiful and totally unexpected patterns that have only begun to be explored using the computational capabilities of modern electronic computers. An understanding of the patterns that can result from the effects of feedback loops can produce important new insights into the patterns that mark the evolutionary development of biological systems.     

Decoding of Baby Calls: Can Adult Humans Identify the Eliciting Situation from Emotional Vocalizations of Preverbal Infants?

Preverbal infants often vocalize in emotionally loaded situations, yet the communicative potential of these vocalizations is not well understood. The aim of our study was to assess how accurately adult listeners extract information about the eliciting situation from infant preverbal vocalizations. Vocalizations of 19 infants aged 5-10 months were recorded in 3 negative (Pain, Isolation, Demand for Food) and 3 positive (Play, Reunion, After Feeding) situations. The recordings were later rated by 333 adult listeners on the scales of emotional valence and intensity. Subsequently, the listeners assigned the eliciting situations in a forced choice task. Listeners were almost perfectly able to discriminate whether a recording came from a negative or a positive situation. Their discrimination may have been based on perceived valence as they consistently assigned higher valence when listening to positive, and lower valence when listening to negative, recordings. Ability to identify the particular situation within the negative or positive realm was substantially weaker, with only three of the six situations being discriminated above chance. The best discriminated situation, Play, was associated with high perceived intensity. The weak qualitative discrimination of negative situations seemed to be based on graded perception of negative recordings, from the most intense and unpleasant (assigned to Pain) to the least intense and least unpleasant (assigned to Demand for Food). Parenthood and younger age, but not gender of listeners, had weak positive effects on the accuracy of judgments. Our results indicate that adults almost flawlessly distinguish positive and negative infant sounds, but are rather inaccurate regarding identification of the specific needs of the infant and may normally employ other sensory channels to gain this information.     

Effects of Achievement Goals on Challenge Seeking and Feedback Processing: Behavioral and fMRI Evidence

We conducted behavioral and functional magnetic resonance imaging (fMRI) research to investigate the effects of two types of achievement goals—mastery goals and performance-approach goals— on challenge seeking and feedback processing. The results of the behavioral experiment indicated that mastery goals were associated with a tendency to seek challenge, both before and after experiencing difficulty during task performance, whereas performance-approach goals were related to a tendency to avoid challenge after encountering difficulty during task performance. The fMRI experiment uncovered a significant decrease in ventral striatal activity when participants received negative feedback for any task type and both forms of achievement goals. During the processing of negative feedback for the rule-finding task, performance-approach-oriented participants showed a substantial reduction in activity in the dorsolateral prefrontal cortex (DLPFC) and the frontopolar cortex, whereas mastery-oriented participants showed little change. These results suggest that performance-approach-oriented participants are less likely to either recruit control processes in response to negative feedback or focus on task-relevant information provided alongside the negative feedback. In contrast, mastery-oriented participants are more likely to modulate aversive valuations to negative feedback and focus on the constructive elements of feedback in order to attain their task goals. We conclude that performance-approach goals lead to a reluctant stance towards difficulty, while mastery goals encourage a proactive stance.     

Learning new gait patterns is enhanced by specificity of training rather than progression of task difficulty

The use of motor learning strategies may enhance rehabilitation outcomes of individuals with neurological injuries (e.g., stroke or cerebral palsy). A common strategy to facilitate learning of challenging tasks is to use sequential progression – i.e., initially reduce task difficulty and slowly increase task difficulty until the desired difficulty level is reached. However, the evidence related to the use of such sequential progressions to improve learning is mixed for functional skill learning tasks, especially considering situations where practice duration is limited. Here, we studied the benefits of sequential progression using a functional motor learning task that has been previously used in gait rehabilitation. Three groups of participants (N = 43) learned a novel motor task during treadmill walking using different learning strategies. Participants in the specific group (n = 21) practiced only the criterion task (i.e., matching a target template that was scaled-up by 30%) throughout the training. Participants in the sequential group (n = 11) gradually progressed to the criterion task (from 3% to 30% in increments of 3%), whereas participants in the random group (n = 11) started at 3% and progressed in random increments (involving both increases and decreases in task difficulty) to the criterion task. At the end of training, kinematic tracking performance on the criterion task was evaluated in all participants both with and without visual feedback. Results indicated that the tracking error was significantly lower in the specific group, and no differences were observed between the sequential and the random progression groups. The findings indicate that the amount of practice in the criterion task is more critical than the difficulty and variations of task practice when learning new gait patterns during treadmill walking.     

Bimanual Coordination Learning with Different Augmented Feedback Modalities and Information Types

Previous studies have shown that bimanual coordination learning is more resistant to the removal of augmented feedback when acquired with auditory than with visual channel. However, it is unclear whether this differential “guidance effect” between feedback modalities is due to enhanced sensorimotor integration via the non-dominant auditory channel or strengthened linkage to kinesthetic information under rhythmic input. The current study aimed to examine how modalities (visual vs. auditory) and information types (continuous visuospatial vs. discrete rhythmic) of concurrent augmented feedback influence bimanual coordination learning. Participants either learned a 90°-out-of-phase pattern for three consecutive days with Lissajous feedback indicating the integrated position of both arms, or with visual or auditory rhythmic feedback reflecting the relative timing of the movement. The results showed diverse performance change after practice when the feedback was removed between Lissajous and the other two rhythmic groups, indicating that the guidance effect may be modulated by the type of information provided during practice. Moreover, significant performance improvement in the dual-task condition where the irregular rhythm counting task was applied as a secondary task also suggested that lower involvement of conscious control may result in better performance in bimanual coordination.     

Incentives to enhance the effects of electromyographic Feedback Training in stroke patients

The use of monetary incentives to enhance the effects of electromyographic(EMG) feedback training was studied in five stabilized stroke patients with hemiplegia. The study was divided into Baseline, EMG Feedback Training, Feedback Training Plus Incentives, and Follow-Up treatment conditions. Integrated EMG activity was recorded simultaneously from the anterior tibialis and medial gastrocnemius muscles during relaxation and dorsiflexion of the affected foot. Patients were instructed to try to increase anterior tibialis EMG activity while decreasing EMG activity in the medial gastrocnemius. Range of motion was measured both prior to and immediately following the Baseline and Feedback Training conditions. Results suggested that(a) EMG feedback training produced greater EMG control and range of motion than did unassisted practice, and(b) the addition of monetary incentives may enhance the effects of feedback training, possibly through its effect on patient motivation.     

Positive Feedback Promotes Oscillations in Negative Feedback Loops

A simple three-component negative feedback loop is a recurring motif in biochemical oscillators. This motif oscillates as it has the three necessary ingredients for oscillations: a three-step delay, negative feedback, and nonlinearity in the loop. However, to oscillate, this motif under the common Goodwin formulation requires a high degree of cooperativity (a measure of nonlinearity) in the feedback that is biologically “unlikely.” Moreover, this recurring negative feedback motif is commonly observed augmented by positive feedback interactions. Here we show that these positive feedback interactions promote oscillation at lower degrees of cooperativity, and we can thus unify several common kinetic mechanisms that facilitate oscillations, such as self-activation and Michaelis-Menten degradation. The positive feedback loops are most beneficial when acting on the shortest lived component, where they function by balancing the lifetimes of the different components. The benefits of multiple positive feedback interactions are cumulative for a majority of situations considered, when benefits are measured by the reduction in the cooperativity required to oscillate. These positive feedback motifs also allow oscillations with longer periods than that determined by the lifetimes of the components alone. We can therefore conjecture that these positive feedback loops have evolved to facilitate oscillations at lower, kinetically achievable, degrees of cooperativity. Finally, we discuss the implications of our conclusions on the mammalian molecular clock, a system modeled extensively based on the three-component negative feedback loop.     

Performance Feedback Processing Is Positively Biased As Predicted by Attribution Theory

A considerable literature on attribution theory has shown that healthy individuals exhibit a positivity bias when inferring the causes of evaluative feedback on their performance. They tend to attribute positive feedback internally (e.g., to their own abilities) but negative feedback externally (e.g., to environmental factors). However, all empirical demonstrations of this bias suffer from at least one of the three following drawbacks: First, participants directly judge explicit causes for their performance. Second, participants have to imagine events instead of experiencing them. Third, participants assess their performance only after receiving feedback and thus differences in baseline assessments cannot be excluded. It is therefore unclear whether the classically reported positivity bias generalizes to setups without these drawbacks. Here, we aimed at establishing the relevance of attributions for decision-making by showing an attribution-related positivity bias in a decision-making task. We developed a novel task, which allowed us to test how participants changed their evaluations in response to positive and negative feedback about performance. Specifically, we used videos of actors expressing different facial emotional expressions. Participants were first asked to evaluate the actors’ credibility in expressing a particular emotion. After this initial rating, participants performed an emotion recognition task and did—or did not—receive feedback on their veridical performance. Finally, participants re-rated the actors’ credibility, which provided a measure of how they changed their evaluations after feedback. Attribution theory predicts that participants change their evaluations of the actors’ credibility toward the positive after receiving positive performance feedback and toward the negative after negative performance feedback. Our results were in line with this prediction. A control condition without feedback showed that correct or incorrect performance alone could not explain the observed positivity bias. Furthermore, participants’ behavior in our task was linked to the most widely used measure of attribution style. In sum, our findings suggest that positive and negative performance feedback influences the evaluation of task-related stimuli, as predicted by attribution theory. Therefore, our study points to the relevance of attribution theory for feedback processing in decision-making and provides a novel outlook for decision-making biases.     

The Effect of Positive and Negative Feedback on Risk-Taking across Different Contexts

Preferences for risky choices have often been shown to be unstable and context-dependent. Though people generally avoid gambles with mixed outcomes, a phenomenon often attributed to loss aversion, contextual factors can impact this dramatically. For example, people typically prefer risky options after a financial loss, while generally choosing safer options after a monetary gain. However, it is unclear what exactly contributes to these preference shifts as a function of prior outcomes, as these gain/loss outcomes are usually confounded with participant performance, and therefore it is unclear whether these effects are driven purely by the monetary gains or losses, or rather by success or failure at the actual task. Here, we experimentally separated the effects of monetary gains/losses from performance success/failure prior to a standard risky choice. Participants performed a task in which they experienced contextual effects: 1) monetary gain or loss based directly on performance, 2) monetary gain or loss that was randomly awarded and was, crucially, independent from performance, and 3) success or failure feedback based on performance, but without any monetary incentive. Immediately following these positive/negative contexts, participants were presented with a gain-loss gamble that they had to decide to either play or pass. We found that risk preferences for identical sets of gambles were biased by positive and negative contexts containing monetary gains and losses, but not by contexts containing performance feedback. This data suggests that the observed framing effects are driven by aversion for monetary losses and not simply by the positive or negative valence of the context, or by potential moods resulting from positive or negative contexts. These results highlight the specific context dependence of risk preferences.     

Voluntary Modulation of Anterior Cingulate Response to Negative Feedback

Anterior cingulate and medial frontal cortex (dACC/mFC) response to negative feedback represents the actions of a generalized error-monitoring system critical for the management of goal-directed behavior. Magnitude of dACC/mFC response to negative feedback correlates with levels of post-feedback behavioral change, and with proficiency of operant learning processes. With this in mind, it follows that an ability to alter dACC/mFC response to negative feedback may lead to representative changes in operant learning proficiency. To this end, the present study investigated the extent to which healthy individuals would show modulation of their dACC/mFC response when instructed to try to either maximize or minimize their neural response to the presentation of contingent negative feedback. Participants performed multiple runs of a standard time-estimation task, during which they received feedback regarding their ability to accurately estimate a one-second duration. On Watch runs, participants were simply instructed to try to estimate as closely as possible the one second duration. On Increase and Decrease runs, participants performed the same task, but were instructed to “try to increase [decrease] their brain''s response every time they received negative feedback”. Results indicated that participants showed changes in dACC/mFC response under these differing instructional conditions: dACC/mFC activity following negative feedback was higher in the Increase condition, and dACC activity trended lower in the Decrease condition, compared to the Watch condition. Moreover, dACC activity correlated with post-feedback performance adjustments, and these adjustments were highest in the Increase condition. Potential implications for neuromodulation and facilitated learning are discussed.     

A Critical Quantity for Noise Attenuation in Feedback Systems

Feedback modules, which appear ubiquitously in biological regulations, are often subject to disturbances from the input, leading to fluctuations in the output. Thus, the question becomes how a feedback system can produce a faithful response with a noisy input. We employed multiple time scale analysis, Fluctuation Dissipation Theorem, linear stability, and numerical simulations to investigate a module with one positive feedback loop driven by an external stimulus, and we obtained a critical quantity in noise attenuation, termed as “signed activation time”. We then studied the signed activation time for a system of two positive feedback loops, a system of one positive feedback loop and one negative feedback loop, and six other existing biological models consisting of multiple components along with positive and negative feedback loops. An inverse relationship is found between the noise amplification rate and the signed activation time, defined as the difference between the deactivation and activation time scales of the noise-free system, normalized by the frequency of noises presented in the input. Thus, the combination of fast activation and slow deactivation provides the best noise attenuation, and it can be attained in a single positive feedback loop system. An additional positive feedback loop often leads to a marked decrease in activation time, decrease or slight increase of deactivation time and allows larger kinetic rate variations for slow deactivation and fast activation. On the other hand, a negative feedback loop may increase the activation and deactivation times. The negative relationship between the noise amplification rate and the signed activation time also holds for the six other biological models with multiple components and feedback loops. This principle may be applicable to other feedback systems.     

EFFECT OF FEEDBACK ON SENSORY TRAINING: A PRELIMINARY STUDY

Feedback in sensory training can facilitate performance in several ways. It can provide information about the type, the extent and the direction of errors so that they may be corrected. This paper shows the effects of immediate feedback over a three session training. Triangle test, familiar odor recognition and scaling test were used in training. The scaling test, specially designed for this study, was performed with solutions of mixtures of basic tastes in different proportions.
Prior sensory ability was taken into account by dividing 54 people into two groups according to their sensory ability. Each group was then split into an experimental group receiving feedback and into a control group.
The results showed that feedback has different effects depending on test: a positive effect for recognition test, no effect for triangle test and a probable negative effect for scaling.