EMG Biofeedback: The Effects of CRF, FR, VR, FI, and VI Schedules of Reinforcement on the Acquisition and Extinction of Increases in Forearm Muscle Tension

Biofeedback was used to increase forearm-muscle tension. Feedback was delivered under continuous reinforcement (CRF), variable interval (VI), fixed interval (FI), variable ratio (VR), and fixed ratio (FR) schedules of reinforcement when college students increased their muscle tension (electromyograph, EMG) above a high threshold. There were three daily sessions of feedback, and Session 3 was immediately followed by a session without feedback (extinction). The CRF schedule resulted in the highest EMG, closely followed by the FR and VR schedules, and the lowest EMG scores were produced by the FI and VI schedules. Similarly, the CRF schedule resulted in the greatest amount of time-above-threshold and the VI and FI schedules produced the lowest time-above-threshold. The highest response rates were generated by the FR schedule, followed by the VR schedule. The CRF schedule produced relatively low response rates, comparable to the rates under the VI and FI schedules. Some of the data are consistent with the partial-reinforcement-extinction effect. The present data suggest that different schedules of feedback should be considered in muscle-strengthening contexts such as during the rehabilitation of muscles following brain damage or peripheral nervous-system injury.     

奖励性操作式条件反射任务在大鼠学习记忆研究中的应用

目的将奖励性操作式条件反射方法应用于学习记忆研究。方法首次采用奖励性操作式条件反射方法,设置单次操作训练、连续多次操作训练、信号辨识与消退四种检测模式,研究Wistar大鼠和SHR大鼠学习记忆能力。结果奖赏训练中,SHR组鼻触次数显著增多（vs.Wistar＆Donepezil,P〈0.05）;单次操作训练中,三组动物对操作反应的获得无显著差异;连续多次操作学习任务中,SHR组错误操作次数增多（vs.Wistar,P〈0.05）,奖赏获得次数减少（vs.Donepezil,P〈0.001）,反应准确率显著降低（vs.Wistar＆Donepezil,P〈0.05）;信号辨识任务中SHR组错误反应次数显著增多（vs.Wistar＆Donepezil,P〈0.05）,而反应准确率降低,组间差异有显著性（vs.Wistar＆Donepezil,P〈0.05）;消退实验中,三组动物差异无显著性。神经递质检测发现,SHR组大鼠谷氨酸[（1.0639±0.07086）mg/g]、乙酰胆碱[（2.7760±0.2609）μg/g]与五羟色胺[（1.2200±0.1137）μg/g]含量均显著低于Wistar组大鼠（P〈0.05）,多奈哌齐组大鼠乙酰胆碱含量显著增加[（3.9344±0.2747）μg/g]（vs.Wistar,P〈0.05;vs.SHR,P〈0.001）。结论奖励性操作式条件反射方法可作为一种正性增强条件反射检测新方法应用于大鼠学习记忆研究。     

The role of context in risky choice

Human choice behavior was assessed in a concurrent-chain schedule, where two equal initial links (IL) each led to a distinct terminal-link (TL). One TL was associated with a fixed ratio schedule of reinforcement, while the other was associated with a bi-valued mixed ratio schedule of reinforcement, whose arithmetic mean equaled the Fixed TL schedule. The fixed component (FR50; FR25; FR5) was arranged to be equal to the alternative mixed component in each condition (FR1/99; FR1/49; FR1/9), and choice behavior was measured by proportion of responses to each IL. In addition, the IL duration varied across conditions (VI 30 s; VI 15 s; FI 1 s). Preference for the mixed option was observed with longer durations (e.g., when IL = VI 30 s and TL = FR1/99). Participants were relatively indifferent in other conditions, though the results suggested a monotonic increase in preference as either durations or programmed efforts increased. It is concluded that both choice and the conditioned reinforcement value of the mixed option is contextually based, so that the value of a stimulus correlated with an immediate reward (i.e., FR 1) is enhanced the greater the temporal context in which the FR1 is embedded.     

Effects of thyrotropin-releasing hormone (TRH) and MK-771 on behavior of squirrel monkeys controlled by noxious stimuli

The effects of TRH (0.1-30 mg/kg) and an enzyme-resistant analogue, MK-771 (0.1-10 mg/kg), were characterized in squirrel monkeys on responding maintained in the presence of different visual stimuli by a multiple 3-min fixed-interval (FI), 30-response fixed-ratio (FR) schedule of stimulus-shock termination or by a multiple 5-min FI schedule of food or shock presentation. Under the termination schedule, the first response at the end of 3 min in the FI component or the completion of the 30-response requirement in the FR component terminated the visual stimulus in the presence of which shocks occurred (escape schedule). Under the schedule of food or shock presentation, the first response at the end of the 5-min FI produced food in the presence of red stimulus lights or shock in the presence of white lights. TRH and MK-771 produced large, dose-related increases in responding maintained under the FR stimulus-shock termination schedule whereas these peptides produced smaller increases or did not affect responding under the FI schedule. TRH and MK-771 also produced marked increases in responding maintained by shock presentation at doses that did not alter or decreased food-maintained responding in the same subject. Thus, performances maintained by noxious stimuli are uniquely sensitive to the rate-increasing effects of TRH and MK-771. These findings suggest that the behavioral effects of the neuropeptides, TRH and MK-771, can depend on the specific consequences of behavior and, as such, the effects of these substances are determined by many of the same variables that determine the effects of other behaviorally-active drugs.     

The proportion of fixed interval trials to probe trials affects acquisition of the peak procedure fixed interval timing task

A common procedure for studying the ability of animals to time is the peak procedure. With the peak procedure, animals are first trained on a fixed interval schedule (i.e., 30s). After the animals have been well trained on the fixed interval schedule, probe trials are introduced. On probe trials, the stimulus is presented longer (i.e., 90s) and the animal does not receive reinforcement for responding. When animals are first presented with probe trials responding remains flat following the point that reinforcement normally occurs on fixed interval trials. The descending slope that eventually emerges is acquired with experience with probe trials. The present experiments manipulated the percentage of probe trials compared to FI trials across groups of rats. It was hypothesized that the descending limb of peak responding would be acquired more quickly when there were many probe trials per session as this might facilitate extinction of responding beyond the interval that reinforcement normally occurs. It was found, however, that acquisition of peak responding occurred best when there were few probe trials per session.     

Effect of soman on schedule-controlled behavior and brain acetylcholinesterase in rats

Rats were trained to press a lever under a multiple fixed-ratio 25 fixed-interval 50-second (FR25 FI50-sec) schedule of food reinforcement. Soman, 70-90 micrograms/kg, s.c., suppressed response rates in both components, with a slightly greater effect in the FI schedule. The pattern of responding under the FI schedule, however, was maintained until lever-pressing was nearly completely suppressed. At the highest doses, soman occasionally caused tremors or mild tonic seizures with hindlimb abduction. The suppression of response rate was correlated with inhibition of acetylcholinesterase (AChE) in all brain regions examined: cortex, striatum, hippocampus, hypothalamus and brainstem. Cortical AChE was inhibited to the highest degree, while striatal AChE was most resistant to inhibition by soman.     

Habituation and the reinforcing effectiveness of visual stimuli

The term "sensory reinforcer" has been used to refer to sensory stimuli (e.g. light onset) that are primary reinforcers in order to differentiate them from other more biologically important primary reinforcers (e.g. food and water). Acquisition of snout poke responding for a visual stimulus (5s light onset) with fixed ratio 1 (FR 1), variable-interval 1min (VI 1min), or variable-interval 6min (VI 6min) schedules of reinforcement was tested in three groups of rats (n=8/group). The VI 6min schedule of reinforcement produced a higher response rate than the FR 1 or VI 1min schedules of visual stimulus reinforcement. One explanation for greater responding on the VI 6min schedule relative to the FR 1 and VI 1min schedules is that the reinforcing effectiveness of light onset habituated more rapidly in the FR 1 and VI 1min groups as compared to the VI 6min group. The inverse relationship between response rate and the rate of visual stimulus reinforcement is opposite to results from studies with biologically important reinforcers which indicate a positive relationship between response and reinforcement rate. Rapid habituation of reinforcing effectiveness may be a fundamental characteristic of sensory reinforcers that differentiates them from biologically important reinforcers, which are required to maintain homeostatic balance.     

Morphine self-administration added to food conditioning: methodological variant in rats]

Rats with permanent intra-jugular cannula are submitted to an alimentary operant reinforcement schedule with fixed ratio type FR 1, FR5, then FR 20. As a result, the animals are self administering (together with the alimentary inducer) a slow (about 5 sec) intravenous infusion of morphine (0.05 mg/kg). 20 per cent only of the experimental population exhibit a psychogenic dependance afterward. On the other hand, the animals for which morphine self-administration has been substituted to the alimentary reinforcement without respecting a transitory period combining both types of reinforcement have never shown any tendancy toward morphine self-administration. The lack of positive results could be related to the marked duration of the self-injection.     

Dishabituation with component transitions may contribute to the interactions observed during multiple schedules

Rates of responding by rats were usually higher during the variable interval (VI) 30-s component of a multiple VI 30-s fixed interval (FI) 30-s schedule than during the same component of a multiple VI 30-s VI 30-s schedule (Experiment 1). Response rates were also usually higher during the FI 30-s component of a multiple VI 30-s FI 30-s schedule than during the same component of a multiple FI 30-s FI 30-s schedule (Experiment 2). The differences in response rates were not observed when the components provided VI or FI 120-s schedules. These results were predicted by the idea that differences in habituation to the reinforcer between multiple schedules contribute to behavioral interactions, such as behavioral contrast. However, differences in habituation were not apparent in the within-session patterns of responding. Finding differences in response rates in both experiments violates widely-held assumptions about behavioral interactions, including that behavioral contrast does not occur for rats and that improving the conditions of reinforcement decreases, rather than increases, response rate in the alternative component.     

Photochemical characterization of flavobacterial rhodopsin: The importance of the helix E region for heat stability

Although many microbial rhodopsins have been discovered many of organisms in a variety of habitats, little is known about the property and diversity of rhodopsin in flavobacteria. Recent studies discovered that many proteorhodopsin (PR)-like proteins exist in genomes of flavobacteria. Following the isolation of a flavobacterial rhodopsins (FR) from the flavobacteria IMCC1997 from the East Sea of Korea, we characterized its photochemical features. We confirmed that the FR expression is induced by light in the IMCC1997 cell. Upon receiving light energy in vitro, the proton acceptor (D83) and donor (E94) of the FR translocate protons from intracellular to extracellular regions. Compared with proteorhodopsin (PR), the FR from IMCC 1997 cells is very unstable, which may be explained by their primary sequence differences. The ratio of all trans/13-cis retinal conformation does not influence this stability. To measure the stability of FR, we tested heat endurance at 70 °C and found that the heat endurance time of some FR mutants increased. Based upon these results, we found the helix E of this protein to be critical for the unstability of FR.     

Impact of pubertal and adult estradiol treatments on cocaine self-administration

Estradiol is thought to play a critical role in the increased vulnerability to psychostimulant abuse in women. Sex differences in the ability of estradiol to influence cocaine self-administration in adult rats have been hypothesized to depend upon pubertal estradiol exposure. The current study investigated whether the presence of gonadal hormones during puberty affected cocaine self-administration behavior and its sensitivity to adult estradiol treatment in male and female Sprague–Dawley rats. Subjects were gonadectomized or SHAM-operated at postnatal day (PD) 22, and received either OIL or estradiol benzoate (EB) during the approximate time of puberty (PD27 to PD37). Adult rats were subsequently treated with either EB or OIL 30 min before cocaine self-administration (0.3 mg/kg/inf) in order to examine the effects of pubertal manipulations on the estradiol sensitivity of acquisition on a fixed ratio (FR) 1 schedule, total intake on a FR5 schedule and motivation on a progressive ratio schedule. Adult EB treatment only affected cocaine self-administration in females, which is consistent with previous research. Adult EB treatment enhanced acquisition in all females irrespective of puberty manipulations. All females, except those treated with EB during puberty, displayed increased cocaine intake following adult EB treatment. Adult EB treatment only enhanced motivation in females that were intact during puberty, whereas those treated with EB during puberty showed reduced motivation. Therefore, the sensitivities of different self-administration behaviors to adult estradiol treatment are organized independently in females, with pubertal estradiol exerting a greater influence over motivational processes, and negligible effects on learning/acquisition.     

Psychological distance to reward: equating the number of stimulus and response segments

Psychological distance to reward, or the segmentation effect, refers to the preference for a terminal link of a concurrent-chains schedule consisting of a simple reinforcement schedule (e.g. fixed interval [FI] 30s) relative to its chained-schedule counterpart (e.g. chained FI 15s FI 15s). This experiment was conducted to examine whether the segmentation effect is due to the number of terminal-link stimulus and response segments per se. Three pigeons pecked under a concurrent-chains schedule in which identical variable-interval (VI) schedules operated in the initial links. In each session, half the terminal-link entries followed one initial-link key and the other half followed the other initial-link key. The initial-link keys correlated with the different terminal links were manipulated across conditions. In the first three conditions, each terminal link contained a chained fixed-time (FT) FT schedule, and in the final three conditions, each terminal link contained a chained FI FI schedule. In each condition, in one terminal link (alternating), the order of two key colors correlated with the different schedule segments alternated across terminal-link entries, whereas in the other terminal link (constant), the order of two other key colors was identical for each entry. With the chained FT FT schedule terminal links, there was indifference between the alternating and constant terminal links within and across pigeons, as indexed by initial-link choice proportions. In addition, terminal-link response rates were relatively low. With the chained FI FI schedule terminal links, for each pigeon, there was relatively more preference for the alternating terminal link and terminal-link response rates increased relative to conditions with the chained FT FT schedule terminal links. These data suggest that the segmentation effect is not due simply to the number of terminal-link stimulus or response segments per se, but rather to a required period of responding during a stimulus segment that never is paired with reinforcement.     

Temporal generalization accounts for response resurgence in the peak procedure

The peak interval (PI) procedure is commonly used to evaluate animals' ability to produce timed intervals. It consists of presenting fixed interval (FI) schedules in which some of the trials are replaced by extended non-reinforced trials. Responding will often resume (resurge) at the end of the non-reinforced trials unless precautions are taken to prevent it. Response resurgence was replicated in rats and pigeons. Variation of the durations of the FI and the non-reinforced probe trials showed it to be dependent on the time when reinforcement is expected. Timing of both the normal time to reinforcement, and the subsequent time to reinforcement during the probe trials followed Weber's law. A quantitative model of resurgence is described, suggesting how animals respond to the signaling properties of reinforcement omission. Model results were simulated using a stochastic binary counter.     

An Assessment of Fixed Interval Timing in Free-Flying Honey Bees (Apis mellifera ligustica): An Analysis of Individual Performance

Interval timing is a key element of foraging theory, models of predator avoidance, and competitive interactions. Although interval timing is well documented in vertebrate species, it is virtually unstudied in invertebrates. In the present experiment, we used free-flying honey bees (Apis mellifera ligustica) as a model for timing behaviors. Subjects were trained to enter a hole in an automated artificial flower to receive a nectar reinforcer (i.e. reward). Responses were continuously reinforced prior to exposure to either a fixed interval (FI) 15-sec, FI 30-sec, FI 60-sec, or FI 120-sec reinforcement schedule. We measured response rate and post-reinforcement pause within each fixed interval trial between reinforcers. Honey bees responded at higher frequencies earlier in the fixed interval suggesting subject responding did not come under traditional forms of temporal control. Response rates were lower during FI conditions compared to performance on continuous reinforcement schedules, and responding was more resistant to extinction when previously reinforced on FI schedules. However, no “scalloped” or “break-and-run” patterns of group or individual responses reinforced on FI schedules were observed; no traditional evidence of temporal control was found. Finally, longer FI schedules eventually caused all subjects to cease returning to the operant chamber indicating subjects did not tolerate the longer FI schedules.     

Choice behavior in spontaneously hypertensive rats: Variable vs. fixed schedules of reinforcement

Spontaneously hypertensive rats (SHR) and Wistar rats were evaluated in the successive-encounters procedure (an operant simulation of natural foraging) with the idea of assessing differences between them in their preference for variable schedules of reinforcement. In this procedure, after satisfying a schedule of reinforcement associated with search time, the subjects could “accept” or “reject” another schedule of reinforcement associated with handling time. Two schedules of reinforcement were available: a fixed interval (FI), and a variable interval (VI) with the same mean value. The results indicated preference for the variable schedule in both strains, as suggested by the observation that the VI was always accepted while the FI was often rejected. The difference in FI acceptability between strains was not statistically significant, a result which is relevant for the current debate of SHR as an adequate animal model of Attention Deficit Hyperactivity Disorder.     

Second-order schedules of drug injection.

Key-press responding of squirrel monkeys produced intravenous injections of cocaine under two simple types of schedule. Under a fixed ratio schedule, every 30th response produced an injection; steady responding at high rates of over one per second were maintained during each fixed-ratio component. Under a fixed-interval schedule, the first response occurring after a fixed time of 5 min produced an injection; there was a pause at the start of each interval and then progressively increasing responding until cocaine was injected at the end of the interval. Both squirrel monkeys and rhesus monkeys also were studied under second-order schedules of drug injection. Under one type of second-order schedule, studies only in squirrel monkeys, completion of each fixed-interval component produced only a 2 sec light; completion of the 10th fixed-interval component produced the brief light and an intravenous injection of cocaine. Under a second type of second-order schedule, each fixed-ratio component completed during a fixed time interval (5 or 60 min) produced only a 2-sec light; the first fixed-ratio component completed after the interval of time elapsed produced the brief light and an intravenous (squirrel monkeys) or intramuscular (rhesus monkeys) injection of cocaine. Under both types of second-order schedules, repeated sequences of responding were maintained during each session and characteristic fixed-interval or fixed-ratio patterns of responding were controlled by the brief visual stimuli.     

Localization of neuron-specific (gamma gamma) enolase in proliferating (supportive and neoplastic) Schwann cells. An immunohisto- and electron-immunocyto-chemical study of ganglioneuroblastoma and schwannomas

Neuron-specific (gamma gamma) enolase, a glycolytic enzyme used as a relatively specific marker for normal neurons and neuroendocrine cells, has recently been found in a variety of neoplastic cells and in reactive astrocytes. Its localization was investigated by immunohisto- and electron-immunocyto-chemistry, in the proliferating supportive Schwann cells of a peripheral ganglioneuroblastoma and in the neoplastic Schwann cells of four acoustic tumours. By light microscopy, the neoplastic Schwann cells showed moderate uneven diffuse immunopositivity for enolase. By electron-immunocytochemistry, both types of Schwann cells demonstrated immunopositivity discretely limited to their cell surface membranes. The neoplastic ganglion cells and axons of the ganglioneuroblastoma and the normal neurons and axons included in the schwannomas were, as expected, intensely immunopositive. The visualization of gamma gamma enolase on the cell surface membranes of both neoplastic and non-neoplastic proliferating Schwann cells suggests that increased glycolytic activity may occur on the surface of these proliferating cells irrespective of the nature of the proliferation.     

Ascorbic acid blockade of muscle contractions by neurotransmitters and 2-aminoethanol.

Rats given intracisternal administration of 5–6 dihydroxytryptamine (5,6 DHT) 5 days after birth were tested at two subsequent periods for alterations in locomotor activity and responsiveness to dl-amphetamine and scopolamine. Later in life they were given amphetamine while performing on an FR-6 operant schedule for food reward. Biochemical analyses revealed that the 5,6 DHT treatment produced reductions in forebrain serotonin content. There was no alteration in the treated animals in locomotor activity or in responsiveness to amphetamine in the open field. However, animals given the highest dose (75 μg) of 5,6 DHT neonatally showed open field activity increases at high doses of scopolamine significantly more frequently than the other groups of animals. Although treatment with 5,6 DHT did not affect response rates on the FR task under no-drug conditions, the rate-suppressive effects of amphetamine on the FR task were greatly enhanced in the treated animals.     

Relationship of food intake to the induction of plasma sex steroid-binding protein and testicular activity in immature male little brown bats (Myotis lucifugus lucifugus)

Immature male little brown bats were aroused prematurely from their first hibernation and fed ad libitum (Group AL) or given a restricted diet (Group FR). All animals were weighed daily and the food intake of Group FR males was restricted to maintain their body weights at or near initial post-arousal values (5.3-6.8 g). The average body weights of Group AL males increased during the first week after arousal and then stabilized at a level which was 20% higher than those of Group FR males. The post-arousal induction of plasma SBP was similar in Groups FR and AL: plasma SBP activity was significantly increased 1 week after arousal and by 3 weeks had reached levels which were more than 10-fold higher than those of immature hibernating males which served as controls. Although food restriction had no effect on plasma SBP levels, it did inhibit reproductive development. Arousal-induced increases in testicular and epididymal (head/body) weights in Group FR males were less than 50% of those in Group AL males. However, histological examination of the testes revealed similar degrees of spermatogenic activation in both groups. Plasma testosterone concentrations were increased markedly in Groups FR and AL; values were generally lower in Group FR but wide individual variations were observed. Despite these elevated peripheral testosterone values, the accessory sex glands in both groups remained unstimulated.