Double dissociation of PKC and AC manipulations on operant and classical learning in Drosophila

Learning about relationships between stimuli (i.e., classical conditioning [1]) and learning about consequences of one's own behavior (i.e., operant conditioning [2]) constitute the major part of our predictive understanding of the world. Since these forms of learning were recognized as two separate types 80 years ago [3], a recurrent concern has been the issue of whether one biological process can account for both of them [4, 5, 6, 7, 8, 9]. Today, we know the anatomical structures required for successful learning in several different paradigms, e.g., operant and classical processes can be localized to different brain regions in rodents [9] and an identified neuron in Aplysia shows opposite biophysical changes after operant and classical training, respectively [5]. We also know to some detail the molecular mechanisms underlying some forms of learning and memory consolidation. However, it is not known whether operant and classical learning can be distinguished at the molecular level. Therefore, we investigated whether genetic manipulations could differentiate between operant and classical learning in Drosophila. We found a double dissociation of protein kinase C and adenylyl cyclase on operant and classical learning. Moreover, the two learning systems interacted hierarchically such that classical predictors were learned preferentially over operant predictors.     

Behavioral modification in choice process of Drosophila

Because of its clear genetic and developmental background, diversity of behavioral paradigms and neuroanatomy of the brain, Drosophila has become an important animal model for studying genetic, molecular and cellular bases of learning and memory[1]. Extensive research has explored the visual operant conditioning of Drosophila and related molecular bases[2—8]; recently, researchers began to address cognition-like functions and involved neural substrates[9—11]. In these studies, behavioral ana…     

Behavioral modification in choice process of<Emphasis Type="Italic">Drosophila</Emphasis>

In visual operant conditioning ofDrosophila at the flight simulator, only motor output of flies—yaw torque—is recorded, which is involved in the conditioning process. The current study used a newly-designed data analysis method to study the torque distribution ofDrosophila. Modification of torque distribution represents the effects of operant conditioning on flies’ behavioral mode. Earlier works^[10] showed that, when facing contradictory visual cues, flies could make choices based upon the relative weightiness of different cues, and it was demonstrated that mushroom bodies might play an important role in such choice behavior. The new “torque-position map” method was used to explore the CS-US associative learning and choice behavior inDrosophila from the aspect of its behavioral mode. Finally, this work also discussed various possible neural bases involved in visual associative learning, choice processing and modification processing of the behavioral mode in the visual operant conditioning ofDrosophila.     

Operant conditioning in Drosophila melanogaster wild-type and learning mutants with defects in the cyclic AMP metabolism

Wild-type Drosophila melanogaster and the learning mutants dunce, amnesiac and rutabaga, were tested using a new operant conditioning paradigm for single flies. All strains are able to learn to different extents, but no evidence of memory was found in the mutants amnesiac and rutabaga, while dunce has a reduced but extended memory. The relationship between this characteristic and cAMP levels are discussed. The three mutants have previously been shown, using classical conditioning paradigms to be deficient in olfactory learning and/or memory, and show reduced visual learning. The variability of the response of the mutants in the different paradigms is discussed in relation to the generality of the Aplysia model of the cellular mechanism underlying learning. In the operant conditioning paradigm described here, 93% of the wild-type flies learned to criterion. The performance of individual flies was consistent.     

Molecular mechanisms underlying a cellular analog of operant reward learning

Operant conditioning is a ubiquitous but mechanistically poorly understood form of associative learning in which an animal learns the consequences of its behavior. Using a single-cell analog of operant conditioning in neuron B51 of Aplysia, we examined second-messenger pathways engaged by activity and reward and how they may provide a biochemical association underlying operant learning. Conditioning was blocked by Rp-cAMP, a peptide inhibitor of PKA, a PKC inhibitor, and by expressing a dominant-negative isoform of Ca2+-dependent PKC (apl-I). Thus, both PKA and PKC were necessary for operant conditioning. Injection of cAMP into B51 mimicked the effects of operant conditioning. Activation of PKC also mimicked conditioning but was dependent on both cAMP and PKA, suggesting that PKC acted at some point upstream of PKA activation. Our results demonstrate how these molecules can interact to mediate operant conditioning in an individual neuron important for the expression of the conditioned behavior.     

Operant control of EEG and event-related and slow brain potentials

Research on operant control of brain potentials is reviewed. From single-unit firing and spontaneous EEG activity to event-related potentials such as sensory and pain evoked potentials, and slow potential shifts, most of the aspects of electrical brain activity have been investigated. Results produced by conditioning of spontaneous EEG oscillations (alpha and theta) dampened the early enthusiasm: e.g., no increase above baseline levels could be achieved and no reliable behavioral effects became manifest. Evidence accumulates, however, that operant conditioning of the sensorimotor rhythm (12–15 Hz) may lead to successful self-regulation and that epileptic patients may profit from the training. First steps in the conditioning of brainstem, as well as pain evoked potentials suggest that self-regulation of EPs can be achieved by adequate biofeedback procedures. If some of the observed behavioral effects prove to be stable, the therapeutic usefulness seems to be within reach. A comparable progress has been achieved for the operant control of slow potentials (DC-shifts across seconds). Biofeedback procedures have been used successfully as a scientific tool to achieve systematic variations on a psychological level and to record psychological covariations. This method may provide insights into the behavioral meaning of electrical brain activity.     

Cdk5: a novel role in learning and memory

Learning and memory are processes by which organisms acquire, retain and retrieve information. They result in modifications of behavior in response to new or previously encountered stimuli thereby enabling adaptation to a permanently changing environment. Protein phosphorylation has long been known to play a key role in triggering synaptic changes underlying learning and memory. Although intracellular phosphorylation and dephosphorylation is orchestrated by a complex network of interactions between a number of protein kinases and phosphatases, significant advances in the understanding of neuronal mechanisms underlying learning and memory have been achieved by investigating the actions of individual molecules under defined experimental conditions, brain areas, neuronal cells and their subcellular compartments. On the basis of these approaches, the cyclic AMP protein kinase (PKA), protein kinase C (PKC) and extracellularly regulated protein kinases 1 and 2 (Erk-1/2) have been identified as the core signaling pathways in memory consolidation. Here we review recent findings demonstrating an important novel role for Cdk5 in learning and memory. We suggest that some of the well-characterized roles of Cdk5 during neurodevelopmental processes, such as interactions with distinct cytoplasmic and synaptic target molecules, may be also involved in synaptic plasticity underlying memory consolidation within the adult central nervous system.     

Conditioning and learning in relation to disease

Of the two generally recognized processes through which learning occurs--imprinting and conditioning--only the latter with its two paradigms, classical and operant, has both practical and heuristic implications for disease. From the classical conditioning experiments of Pavlov's laboratory over 100 years ago to the later work in operant conditioning by Skinner and others in the past four decades has evolved much of the basis of modern learning theory and its applications to disease in the form of behavior therapy. Variants of behavior therapy have been employed in the treatment of wide variety of medical and psychiatric illnesses. Recent developments in the study of brain function and biochemistry have led to renewed interest in the conditioning paradigm and its value as tool in these areas of research.     

Spatial Generalization in Operant Learning: Lessons from Professional Basketball

In operant learning, behaviors are reinforced or inhibited in response to the consequences of similar actions taken in the past. However, because in natural environments the “same” situation never recurs, it is essential for the learner to decide what “similar” is so that he can generalize from experience in one state of the world to future actions in different states of the world. The computational principles underlying this generalization are poorly understood, in particular because natural environments are typically too complex to study quantitatively. In this paper we study the principles underlying generalization in operant learning of professional basketball players. In particular, we utilize detailed information about the spatial organization of shot locations to study how players adapt their attacking strategy in real time according to recent events in the game. To quantify this learning, we study how a make \ miss from one location in the court affects the probabilities of shooting from different locations. We show that generalization is not a spatially-local process, nor is governed by the difficulty of the shot. Rather, to a first approximation, players use a simplified binary representation of the court into 2 pt and 3 pt zones. This result indicates that rather than using low-level features, generalization is determined by high-level cognitive processes that incorporate the abstract rules of the game.     

Morgan's Canon: Is it still a useful rule of thumb?

For over 100 years, Morgan's Canon has served as the criterion for distinguishing what appears to be complex cognitive processes shown by animals from simpler associative learning processes (Pavlovian and instrumental conditioning). Morgan's ( 1894 ) canon states “In no case is an animal activity to be interpreted in terms of higher psychological processes if it can be fairly interpreted in terms of processes which stand lower in the scale of psychological evolution and development.” In the present article, several examples are provided in which complex human‐like processes are proposed to have been demonstrated but the judicious use of Morgan's Canon suggests that simpler mechanisms may be sufficient to account for the behavior. The use of Morgan's Canon is not meant to reduce behavior to its lowest common denominator but rather to challenge investigators to develop procedures that can distinguish between simple behavioral principles and the more complex processes that cannot be explained in terms of genetics or simple conditioning. Whatever the results of these experiments, they should help identify the underlying processes and mechanisms involved.     

Effect of Circadian Phase on Memory Acquisition and Recall: Operant Conditioning vs. Classical Conditioning

There have been several studies on the role of circadian clocks in the regulation of associative learning and memory processes in both vertebrate and invertebrate species. The results have been quite variable and at present it is unclear to what extent the variability observed reflects species differences or differences in methodology. Previous results have shown that following differential classical conditioning in the cockroach, Rhyparobia maderae, in an olfactory discrimination task, formation of the short-term and long-term memory is under strict circadian control. In contrast, there appeared to be no circadian regulation of the ability to recall established memories. In the present study, we show that following operant conditioning of the same species in a very similar olfactory discrimination task, there is no impact of the circadian system on either short-term or long-term memory formation. On the other hand, ability to recall established memories is strongly tied to the circadian phase of training. On the basis of these data and those previously reported for phylogenetically diverse species, it is suggested that there may be fundamental differences in the way the circadian system regulates learning and memory in classical and operant conditioning.     

Insect olfactory memory in time and space

Recent studies using functional optical imaging have revealed that cellular memory traces form in different areas of the insect brain after olfactory classical conditioning. These traces are revealed as increased calcium signals or synaptic release from defined neurons, and include a short-lived trace that forms immediately after conditioning in antennal lobe projection neurons, an early trace in dopaminergic neurons, and a medium-term trace in dorsal paired medial neurons. New molecular genetic tools have revealed that for normal behavioral memory performance, synaptic transmission from the mushroom body neurons is required only during retrieval, whereas synaptic transmission from dopaminergic neurons is required at the time of acquisition and synaptic transmission from dorsal paired medial neurons is required during the consolidation period. Such experimental results are helping to identify the types of neurons that participate in olfactory learning and when their participation is required. Olfactory learning often occurs alongside crossmodal interactions of sensory information from other modalities. Recent studies have revealed complex interactions between the olfactory and the visual senses that can occur during olfactory learning, including the facilitation of learning about subthreshold olfactory stimuli due to training with concurrent visual stimuli.     

Differential effects of dopamine D1 and D2 receptor antagonists on conditioned orienting behavior in the rat

Brain dopamine (DA) systems are known to be important in regulation of behavior conditioned to appetitive stimuli. Nevertheless, despite a large body of evidence showing behavioral deficits in the operant conditioning paradigm produced by DA receptor blockade, there have been relatively few studies directly assessing behavioral changes in classical conditioning paradigm under this drug treatment. By employing an appetitive Pavlovian conditioning task, the present work investigated the effects of selective D1 and D2 receptor antagonists on the expression and acquisition of the conditioned orienting response (COR) and food-cup approach. SCH23390 (0, 0.05, and 0.10 mg/kg) and raclopride (0, 0.1, and 0.2 mg/kg) were administered via an intra-peritoneal route in a between-group design. Data from Experiment 1 showed that both SCH23390 and raclopride suppressed expression of the COR and food-cup approach, but only the impairment produced by raclopride reached a significant level. In Experiment 2, with SCH23390 being administered during the acquisition phase, the suppressed COR was completely restored in a subsequent (24 h later) drug-free session. In contrast, the suppressed COR in raclopride-pretreated groups was only partially restored. These findings support the view that the DA system plays a role in the neural substrates underlying this appetitive conditioning. In addition, D2 receptors are more likely involved in the modulation of learning process of the COR than D1 receptors.     

Neurobiology of secure infant attachment and attachment despite adversity: a mouse model

Attachment to an abusive caregiver has wide phylogenetic representation, suggesting that animal models are useful in understanding the neural basis underlying this phenomenon and subsequent behavioral outcomes. We previously developed a rat model, in which we use classical conditioning to parallel learning processes evoked during secure attachment (odor‐stroke, with stroke mimicking tactile stimulation from the caregiver) or attachment despite adversity (odor‐shock, with shock mimicking maltreatment). Here we extend this model to mice. We conditioned infant mice (postnatal day (PN) 7–9 or 13–14) with presentations of peppermint odor and either stroking or shock. We used ¹⁴C 2‐deoxyglucose (2‐DG) to assess olfactory bulb and amygdala metabolic changes following learning. PN7‐9 mice learned to prefer an odor following either odor‐stroke or shock conditioning, whereas odor‐shock conditioning at PN13‐14 resulted in aversion/fear learning. 2‐DG data indicated enhanced bulbar activity in PN7‐9 preference learning, whereas significant amygdala activity was present following aversion learning at PN13‐14. Overall, the mouse results parallel behavioral and neural results in the rat model of attachment, and provide the foundation for the use of transgenic and knockout models to assess the impact of both genetic (biological vulnerabilities) and environmental factors (abusive) on attachment‐related behaviors and behavioral development .     

高校《普通动物学》教学中实施自主学习的探索

课堂教学是学生获取知识的主渠道,教会学生如何自主学习已经成为世界各国基础教育的根本任务之一。在现代社会自主学习是学习者所必备的重要能力之一,在课堂教学模式下,让学生走自主学习之路是学会学习的有效途径。作者对本校《普通动物学》课堂教学模式下实施自主学习现状进行了分析、对比、改进,目的在于培养学生自主学习的意识,增强自主学习能力,提高学习效率。结果证明学生在自主式教学模式下积极性被充分调动,学习成绩显著提高。     

Beetles, boxes and brain cells: neural mechanisms underlying valuation and learning

Sensory cues in the environment can predict the availability of reward. Through experience, humans and animals learn these predictions and use them to guide their actions. For example, we can learn to discriminate chanterelles from ordinary champignons through experience. Assuming the development of a taste for the complex and lingering flavors of chanterelles, we therefore learn to value the same action--picking mushrooms--differentially depending upon the appearance of a mushroom. One major goal of cognitive neuroscience is to understand the neural mechanisms that underlie this sort of learning. Because the acquisition of rewards motivates much behavior, recent efforts have focused on describing the neural signals related to learning the value of stimuli and actions. Neurons in the basal ganglia, in midbrain dopamine areas, in frontal and parietal cortices and in other brain areas, all modulate their activity in relation to aspects of learning. By training monkeys on various behavioral tasks, recent studies have begun to characterize how neural signals represent distinct processes, such as the timing of events, motivation, absolute (objective) and relative (subjective) valuation, and the formation of associative links between stimuli and potential actions. In addition, a number of studies have either further characterized dopamine signals or sought to determine how such signaling might interact with target structures, such as the striatum and rhinal cortex, to underlie learning.     

A variable-response model for parasitoid foraging behavior

An important factor inducing variability in foraging behavior in parasitic wasps is experience gained by the insect. Together with the insect's genetic constitution and physiological state, experience ultimately defines the behavioral repertoire under specified environmental circumstances. We present a conceptual variable-response model based on several major observations of a foraging parasitoid's responses to stimuli involved in the hostfinding process. These major observations are that (1) different stimuli evoke different responses or levels of response, (2) strong responses are less variable than weak ones, (3) learning can change response levels, (4) learning increases originally low responses more than originally high responses, and (5) hostderived stimuli serve as rewards in associative learning of other stimuli. The model specifies how the intrinsic variability of a response will depend on the magnitude of the response and predicts when and how learning will modify the insect's behavior. Additional hypotheses related to the model concern how experience with a stimulus modifies behavioral responses to other stimuli, how animals respond in multistimulus situations, which stimuli act to reinforce behavioral responses to other stimuli in the learning process, and finally, how generalist and specialist species differ in their behavioral plasticity. We postulate that insight into behavioral variability in the foraging behavior of natural enemies may be a help, if not a prerequisite, for the efficient application of parasitoids in pest management.     

An Investigation into the Cognition Behind Spontaneous String Pulling in New Caledonian Crows

The ability of some bird species to pull up meat hung on a string is a famous example of spontaneous animal problem solving. The “insight” hypothesis claims that this complex behaviour is based on cognitive abilities such as mental scenario building and imagination. An operant conditioning account, in contrast, would claim that this spontaneity is due to each action in string pulling being reinforced by the meat moving closer and remaining closer to the bird on the perch. We presented experienced and naïve New Caledonian crows with a novel, visually restricted string-pulling problem that reduced the quality of visual feedback during string pulling. Experienced crows solved this problem with reduced efficiency and increased errors compared to their performance in standard string pulling. Naïve crows either failed or solved the problem by trial and error learning. However, when visual feedback was available via a mirror mounted next to the apparatus, two naïve crows were able to perform at the same level as the experienced group. Our results raise the possibility that spontaneous string pulling in New Caledonian crows may not be based on insight but on operant conditioning mediated by a perceptual-motor feedback cycle.     

Dissociation of visual associative and motor learning in Drosophila at the flight simulator

Ever since operant conditioning was studied experimentally, the relationship between associative learning and possible motor learning has become controversial. Although motor learning and its underlying neural substrates have been extensively studied in mammals, it is still poorly understood in invertebrates. The visual discriminative avoidance paradigm of Drosophila at the flight simulator has been widely used to study the flies' visual associative learning and related functions, but it has not been used to study the motor learning process. In this study, newly-designed data analysis was employed to examine the flies' solitary behavioural variable that was recorded at the flight simulator-yaw torque. Analysis was conducted to explore torque distributions of both wild-type and mutant flies in conditioning, with the following results: (1) Wild-type Canton-S flies had motor learning performance in conditioning, which was proved by modifications of the animal's behavioural mode in conditioning. (2) Repetition of training improved the motor learning performance of wild-type Canton-S flies. (3) Although mutant dunce(1) flies were defective in visual associative learning, they showed essentially normal motor learning performance in terms of yaw torque distribution in conditioning. Finally, we tentatively proposed that both visual associative learning and motor learning were involved in the visual operant conditioning of Drosophila at the flight simulator, that the two learning forms could be dissociated and they might have different neural bases.