Organization of the Human Frontal Pole Revealed by Large-Scale DTI-Based Connectivity: Implications for Control of Behavior

The goal of the current study was to examine the pattern of anatomical connectivity of the human frontal pole so as to inform theories of function of the frontal pole, perhaps one of the least understood region of the human brain. Rather than simply parcellating the frontal pole into subregions, we focused on examining the brain regions to which the frontal pole is anatomically and functionally connected. While the current findings provided support for previous work suggesting the frontal pole is connected to higher-order sensory association cortex, we found novel evidence suggesting that the frontal pole in humans is connected to posterior visual cortex. Furthermore, we propose a functional framework that incorporates these anatomical connections with existing cognitive theories of the functional organization of the frontal pole. In addition to a previously discussed medial-lateral distinction, we propose a dorsal-ventral gradient based on the information the frontal pole uses to guide behavior. We propose that dorsal regions are connected to other prefrontal regions that process goals and action plans, medial regions are connected to other brain regions that monitor action outcomes and motivate behaviors, and ventral regions connect to regions that process information about stimuli, values, and emotion. By incorporating information across these different levels of information, the frontal pole can effectively guide goal-directed behavior.     

Imbalanced Decision Hierarchy in Addicts Emerging from Drug-Hijacked Dopamine Spiraling Circuit

Despite explicitly wanting to quit, long-term addicts find themselves powerless to resist drugs, despite knowing that drug-taking may be a harmful course of action. Such inconsistency between the explicit knowledge of negative consequences and the compulsive behavioral patterns represents a cognitive/behavioral conflict that is a central characteristic of addiction. Neurobiologically, differential cue-induced activity in distinct striatal subregions, as well as the dopamine connectivity spiraling from ventral striatal regions to the dorsal regions, play critical roles in compulsive drug seeking. However, the functional mechanism that integrates these neuropharmacological observations with the above-mentioned cognitive/behavioral conflict is unknown. Here we provide a formal computational explanation for the drug-induced cognitive inconsistency that is apparent in the addicts'' “self-described mistake”. We show that addictive drugs gradually produce a motivational bias toward drug-seeking at low-level habitual decision processes, despite the low abstract cognitive valuation of this behavior. This pathology emerges within the hierarchical reinforcement learning framework when chronic exposure to the drug pharmacologically produces pathologicaly persistent phasic dopamine signals. Thereby the drug hijacks the dopaminergic spirals that cascade the reinforcement signals down the ventro-dorsal cortico-striatal hierarchy. Neurobiologically, our theory accounts for rapid development of drug cue-elicited dopamine efflux in the ventral striatum and a delayed response in the dorsal striatum. Our theory also shows how this response pattern depends critically on the dopamine spiraling circuitry. Behaviorally, our framework explains gradual insensitivity of drug-seeking to drug-associated punishments, the blocking phenomenon for drug outcomes, and the persistent preference for drugs over natural rewards by addicts. The model suggests testable predictions and beyond that, sets the stage for a view of addiction as a pathology of hierarchical decision-making processes. This view is complementary to the traditional interpretation of addiction as interaction between habitual and goal-directed decision systems.     

Ventral striatum: a critical look at models of learning and evaluation

Extensive evidence implicates the ventral striatum in multiple distinct facets of action selection. Early work established a role in modulating ongoing behavior, as engaged by the energizing and directing influences of motivationally relevant cues and the willingness to expend effort in order to obtain reward. More recently, reinforcement learning models have suggested the notion of ventral striatum primarily as an evaluation step during learning, which serves as a critic to update a separate actor. Recent computational and experimental work may provide a resolution to the differences between these two theories through a careful parsing of behavior and the instrinsic heterogeneity that characterizes this complex structure.     

The mind through chick eyes: memory,cognition and anticipation

To understand the animal mind, we have to reconstruct how animals recognize the external world through their own eyes. For the reconstruction to be realistic, explanations must be made both in their proximate causes (brain mechanisms) as well as ultimate causes (evolutionary backgrounds). Here, we review recent advances in the behavioral, psychological, and system-neuroscience studies accomplished using the domestic chick as subjects. Diverse behavioral paradigms are compared (such as filial imprinting, sexual imprinting, one-trial passive avoidance learning, and reinforcement operant conditioning) in their behavioral characterizations (development, sensory and motor aspects of functions, fitness gains) and relevant brain mechanisms. We will stress that common brain regions are shared by these distinct paradigms, particularly those in the ventral telencephalic structures such as AIv (in the archistriatum) and LPO (in the medial striatum). Neuronal ensembles in these regions could code the chick's anticipation for forthcoming events, particularly the quality/quantity and the temporal proximity of rewards. Without the internal representation of the anticipated proximity in LPO, behavioral tolerance will be lost, and the chick makes impulsive choice for a less optimized option. Functional roles of these regions proved compatible with their anatomical counterparts in the mammalian brain, thus suggesting that the neural systems linking between the memorized past and the anticipated future have remained highly conservative through the evolution of the amniotic vertebrates during the last 300 million years. With the conservative nature in mind, research efforts should be oriented toward a unifying theory, which could explain behavioral deviations from optimized foraging, such as "na?ve curiosity," "contra-freeloading," "Concorde fallacy," and "altruism."     

Drugs of abuse and immediate-early genes in the forebrain

A diverse array of chemical agents have been self administered by humans to alter the psychological state. Such drugs of abuse include both stimulants and depressants of the central nervous system. However, some commonalties must underlie the neurobiological actions of these drugs, since the desire to take the drugs often crosses from one drug to another. Studies have emphasized a role of the ventral striatum, especially the nucleus accumbens, in the actions of all drugs of abuse, although more recent studies have implicated larger regions of the forebrain. Induction of immediate-early genes has been studied extensively as a marker for activation of neurons in the central nervous system. In this review, we survey the literature reporting activation of immediate-early gene expression in the forebrain, in response to administration of drugs of abuse. All drugs of abuse activate immediate-early gene expression in the striatum, although each drug induces a particular neuroanatomical signature of activation. Most drugs of abuse activate immediate-early gene expression in several additional forebrain regions, including portions of the extended amygdala, cerebral cortex, lateral septum, and midline/intralaminar thalamic nuclei, although regional variations are found depending on the particular drug administered. Common neuropharmacological mechanisms responsible for activation of immediate-early gene expression in the forebrain involve dopaminergic and glutamatergic systems. Speculations on the biological significance and clinical relevance of immediate-early gene expression in response to drugs of abuse are presented.     

Stimulus-driven orienting of visuo-spatial attention in complex dynamic environments

In everyday life attention operates within complex and dynamic environments, while laboratory paradigms typically employ simple and stereotyped stimuli. This fMRI study investigated stimulus-driven spatial attention using a virtual-environment video. We explored the influence of bottom-up signals by computing saliency maps of the environment and by introducing attention-grabbing events in the video. We parameterized the efficacy of these signals for the orienting of spatial attention by measuring eye movements and used these parameters to analyze the imaging data. The efficacy of bottom-up signals modulated ongoing activity in dorsal fronto-parietal regions and transient activation of the ventral attention system. Our results demonstrate that the combination of computational, behavioral, and imaging techniques enables studying cognitive functions in ecologically valid contexts. We highlight the central role of the efficacy of stimulus-driven signals in both dorsal and ventral attention systems, with a dissociation of the efficacy of background salience versus distinctive events in the two systems.     

Neural mechanisms underlying motivation of mental versus physical effort

Mental and physical efforts, such as paying attention and lifting weights, have been shown to involve different brain systems. These cognitive and motor systems, respectively, include cortical networks (prefronto-parietal and precentral regions) as well as subregions of the dorsal basal ganglia (caudate and putamen). Both systems appeared sensitive to incentive motivation: their activity increases when we work for higher rewards. Another brain system, including the ventral prefrontal cortex and the ventral basal ganglia, has been implicated in encoding expected rewards. How this motivational system drives the cognitive and motor systems remains poorly understood. More specifically, it is unclear whether cognitive and motor systems can be driven by a common motivational center or if they are driven by distinct, dedicated motivational modules. To address this issue, we used functional MRI to scan healthy participants while performing a task in which incentive motivation, cognitive, and motor demands were varied independently. We reasoned that a common motivational node should (1) represent the reward expected from effort exertion, (2) correlate with the performance attained, and (3) switch effective connectivity between cognitive and motor regions depending on task demand. The ventral striatum fulfilled all three criteria and therefore qualified as a common motivational node capable of driving both cognitive and motor regions of the dorsal striatum. Thus, we suggest that the interaction between a common motivational system and the different task-specific systems underpinning behavioral performance might occur within the basal ganglia.     

Optogenetic mimicry of the transient activation of dopamine neurons by natural reward is sufficient for operant reinforcement

Activation of dopamine receptors in forebrain regions, for minutes or longer, is known to be sufficient for positive reinforcement of stimuli and actions. However, the firing rate of dopamine neurons is increased for only about 200 milliseconds following natural reward events that are better than expected, a response which has been described as a "reward prediction error" (RPE). Although RPE drives reinforcement learning (RL) in computational models, it has not been possible to directly test whether the transient dopamine signal actually drives RL. Here we have performed optical stimulation of genetically targeted ventral tegmental area (VTA) dopamine neurons expressing Channelrhodopsin-2 (ChR2) in mice. We mimicked the transient activation of dopamine neurons that occurs in response to natural reward by applying a light pulse of 200 ms in VTA. When a single light pulse followed each self-initiated nose poke, it was sufficient in itself to cause operant reinforcement. Furthermore, when optical stimulation was delivered in separate sessions according to a predetermined pattern, it increased locomotion and contralateral rotations, behaviors that are known to result from activation of dopamine neurons. All three of the optically induced operant and locomotor behaviors were tightly correlated with the number of VTA dopamine neurons that expressed ChR2, providing additional evidence that the behavioral responses were caused by activation of dopamine neurons. These results provide strong evidence that the transient activation of dopamine neurons provides a functional reward signal that drives learning, in support of RL theories of dopamine function.     

Testing neural network models of memory with behavioral experiments

In recent years, a number of computational neural networks have been proposed aimed at describing memory functions associated with different subregions of the hippocampus, namely dentate gyrus, CA3 and CA1. Recent evidence suggests that indeed specific subregions of the hippocampus may subserve different computational functions, such as spatial and temporal pattern separation, short-term or working memory, pattern association, and temporal pattern completion.     

Brain region-specific studies of the excitatory behavioral effects of morphine-3-glucuronide.

This study was designed to determine in rats whether morphine-3-glucuronide (M3G) produces its neuro-excitatory effects most potently in the ventral hippocampus (as has been reported previously for subanalgesic doses of opioid peptides). Guide cannulae were implanted into one of seven regions of the rat brain: lateral ventricle; ventral, CA1 and CA2-CA3 regions of the hippocampus; amygdala; striatum or cortex. After a 7 day recovery period, rats received intracerebral injections of (i) M3G (1.1 or 11 nmol) (ii) DADLE ([D-Ala2,D-Leu5]enkephalin), (45 nmol, positive controls) or (iii) vehicle (deionised water), and behavioral excitation was quantified over 80 min. High-dose M3G (11 nmol) evoked behavioral excitation in all brain regions but the onset, severity and duration of these effects varied considerably among brain regions. By contrast, low-dose M3G (1.1 nmol) evoked excitatory behaviors only when administered into the ventral hippocampus and the amygdala, with the most potent effects being observed in the ventral hippocampus. Prior administration of the nonselective opioid antagonists, naloxone and beta-funaltrexamine into the ventral hippocampus, markedly attenuated low-dose M3G's excitatory effects but did not significantly alter levels of excitation evoked by high-dose M3G. Naloxone given 10 min after M3G (1.1 or 11 nmol) did not significantly attenuate behavioral excitation. Thus, M3G's excitatory behavioral effects occur most potently in the ventral hippocampus as reported previously for subanalgesic doses of opioid peptides, and appear to be mediated through at least two mechanisms, one possibly involving excitatory opioid receptors and the other, non-opioid receptors.     

A Multivariate Surface-Based Analysis of the Putamen in Premature Newborns: Regional Differences within the Ventral Striatum

Many children born preterm exhibit frontal executive dysfunction, behavioral problems including attentional deficit/hyperactivity disorder and attention related learning disabilities. Anomalies in regional specificity of cortico-striato-thalamo-cortical circuits may underlie deficits in these disorders. Nonspecific volumetric deficits of striatal structures have been documented in these subjects, but little is known about surface deformation in these structures. For the first time, here we found regional surface morphological differences in the preterm neonatal ventral striatum. We performed regional group comparisons of the surface anatomy of the striatum (putamen and globus pallidus) between 17 preterm and 19 term-born neonates at term-equivalent age. We reconstructed striatal surfaces from manually segmented brain magnetic resonance images and analyzed them using our in-house conformal mapping program. All surfaces were registered to a template with a new surface fluid registration method. Vertex-based statistical comparisons between the two groups were performed via four methods: univariate and multivariate tensor-based morphometry, the commonly used medial axis distance, and a combination of the last two statistics. We found statistically significant differences in regional morphology between the two groups that are consistent across statistics, but more extensive for multivariate measures. Differences were localized to the ventral aspect of the striatum. In particular, we found abnormalities in the preterm anterior/inferior putamen, which is interconnected with the medial orbital/prefrontal cortex and the midline thalamic nuclei including the medial dorsal nucleus and pulvinar. These findings support the hypothesis that the ventral striatum is vulnerable, within the cortico-stiato-thalamo-cortical neural circuitry, which may underlie the risk for long-term development of frontal executive dysfunction, attention deficit hyperactivity disorder and attention-related learning disabilities in preterm neonates.     

Increased Functional Connectivity between Prefrontal Cortex and Reward System in Pathological Gambling

Pathological gambling (PG) shares clinical characteristics with substance-use disorders and is thus discussed as a behavioral addiction. Recent neuroimaging studies on PG report functional changes in prefrontal structures and the mesolimbic reward system. While an imbalance between these structures has been related to addictive behavior, whether their dysfunction in PG is reflected in the interaction between them remains unclear. We addressed this question using functional connectivity resting-state fMRI in male subjects with PG and controls. Seed-based functional connectivity was computed using two regions-of-interest, based on the results of a previous voxel-based morphometry study, located in the prefrontal cortex and the mesolimbic reward system (right middle frontal gyrus and right ventral striatum). PG patients demonstrated increased connectivity from the right middle frontal gyrus to the right striatum as compared to controls, which was also positively correlated with nonplanning aspect of impulsiveness, smoking and craving scores in the PG group. Moreover, PG patients demonstrated decreased connectivity from the right middle frontal gyrus to other prefrontal areas as compared to controls. The right ventral striatum demonstrated increased connectivity to the right superior and middle frontal gyrus and left cerebellum in PG patients as compared to controls. The increased connectivity to the cerebellum was positively correlated with smoking in the PG group. Our results provide further evidence for alterations in functional connectivity in PG with increased connectivity between prefrontal regions and the reward system, similar to connectivity changes reported in substance use disorder.     

Reductions in binding and functions of D2 dopamine receptors in the rat ventral striatum during amphetamine sensitization

Rats receiving amphetamine (5 mg/kg, i.p. once daily) for 14 continuous days develop behavioral sensitization to a subsequent amphetamine challenge (1 mg/kg) at withdrawal days 8 to 10. The present study was aimed at investigating whether there are changes in binding or functions of striatal D2 dopamine receptors in amphetamine-sensitized rats. The results indicated that the Bmax value of D2 receptors in the ventral striatum decreased 40% and 52% 7 and 10 days after amphetamine withdrawal, respectively, without changes in their binding affinities (Kd). During this withdrawal period, the D(2/3) receptor agonist-induced (a) locomotor activation (bromocriptine, 5 mg/kg, i.p. or quinpirole, 1 mg/kg, i.p.) and (b) inhibition of forskolin-enhanced adenylyl cyclase activity (bromocriptine, 50 or 150 microM) in the ventral striatum were both suppressed as compared with saline controls. The decreases in D2 receptor function were unrelated to the coupled G-proteins, since none of the G alpha i-3, G alpha o or G alpha q in the ventral striatum exhibited quantitative differences between control and amphetamine sensitized rats. Collectively, these results demonstrate that intermittent amphetamine administration for a period of 14 days leads to diminished D2 receptor expression and functions in the ventral striatum at late withdrawal periods. The decrease of D2 receptors might reflect cellular mechanisms underlying the expression of amphetamine sensitization.     

Modulation of motor behaviour by NMDA- and cholecystokinin-antagonism

Summary Motor behaviour relies on complex neurochemical interactions in the basal ganglia, in particular the striatum. Antagonistic influences in this region are exerted by afferent projections from, on the one hand, the ventral mesencephalon, utilizing dopamine as a transmitter, and, on the other hand, from the cerebral cortex, signalling by the excitatory amino acid glutamate. The activity in both these neuronal populations appears to be regulated by the neuropeptide cholecystokinin. This article concentrates on interactions between cholecystokinin and glutamate, summarizing some recent morphological, biochemical and behavioural findings. It is suggested that cholecystokinin, acting via the cholecystokininB receptor, potentiates the glutamatergic excitatory input to the striatum.     

A link between neuroscience and informatics: large-scale modeling of memory processes

Utilizing advances in functional neuroimaging and computational neural modeling, neuroscientists have increasingly sought to investigate how distributed networks, composed of functionally defined subregions, combine to produce cognition. Large-scale, biologically realistic neural models, which integrate data from cellular, regional, whole brain, and behavioral sources, delineate specific hypotheses about how these interacting neural populations might carry out high-level cognitive tasks. In this review, we discuss neuroimaging, neural modeling, and the utility of large-scale biologically realistic models using modeling of short-term memory as an example. We present a sketch of the data regarding the neural basis of short-term memory from non-human electrophysiological, computational and neuroimaging perspectives, highlighting the multiple interacting brain regions believed to be involved. Through a review of several efforts, including our own, to combine neural modeling and neuroimaging data, we argue that large scale neural models provide specific advantages in understanding the distributed networks underlying cognition and behavior.     

Brain mechanisms of emotion and emotional learning.

The amygdala appears to play an essential role in many aspects of emotional information processing and behavior. Studies over the past year have begun to clarify the anatomical organization of the amygdala and the contribution of its individual subregions to emotional functions, especially emotional learning and memory. Researchers can now point to plausible circuits involved in the transmission of sensory inputs into the amygdala, between amygdaloid subregions, and to efferent targets in cortical and subcortical regions, for specific emotional learning and memory processes.     

Global fit and structure optimization of flexible and rigid macromolecules and nanoparticles from analytical ultracentrifugation and other dilute solution properties

The calculation of hydrodynamic and other solution properties from structural information (size and shape or flexibility) of macromolecules and nanoparticles is feasible thanks to existing theories and computational tools. Here we review our recent advances in the inverse problem of extracting structural information from those properties. The concepts of equivalent radii and ratios of radii are particularly useful in global-fitting structural analysis, when one has to treat simultaneously with various properties, eventually for a series of samples. Based on the equivalent radii or their ratios, we define target functions that measure the adequacy of a given structure to fit a set of experimental properties. Structural determination is carried out by minimization of those target functions. We review a variety of examples. Some of them refer to the simple, yet important models like ellipsoids, cylinders and wormlike chains, whose structure is determined by optimization of the model parameters. In other, more complex cases, properties are calculated with computational tools like programs in the HYDRO suite. We have devised other tools to make the structure optimization from the results of those calculations in a quite direct, simple and systematic manner.     

Striatal input from the ventrobasal complex of the rat thalamus

We have analyzed whether caudal regions of the caudate putamen receive direct projections from thalamic sensory relay nuclei such as the ventrobasal complex. To this aim, the delivery of the retrograde neuroanatomical tracer Fluoro-Gold into the caudal caudate putamen resulted in the appearance of retrogradely labeled neurons in the ventral posteromedial and ventral posterolateral thalamic nuclei. These projections were further confirmed with injections of the anterograde tracers biotinylated dextran amine or Phaseolus vulgaris leucoagglutinin into these thalamic nuclei, by showing the existence of axonal terminal fields located in the caudal striatum. These results support the existence of direct projections linking the thalamic ventrobasal complex and the caudal striatum in the rat, probably via collateralization of thalamocortical axons when passing through the caudate putamen, and therefore supporting the putative involvement of the caudal striatum in sensory-related functions.     

Ocellar interneurones in the blowfly Calliphora erythrocephala: Morphology and central projections

Summary The morphology and central projections of first-order ocellar interneurones were analysed in the blowfly, Calliphora erythrocephala after cobalt and horseradish-peroxidase labelling. Three classes of interneurones can be distinguished on the basis of axon diameters: large, medium and small neurones. In total there are 12 large, 10 medium and an unknown number of small interneurones. These interneurones connect the fused first-order ocellar neuropil (underlying the three ocelli) with various areas of the central nervous system. The large neurones terminate in three subregions of the posterior slope (ocellar foci); the medium neurones arborise in several regions of the lateral protocerebrum, in the posterior slope, the lobula, the ventral medulla, and in the pro- and mesothoracic ganglia. The thin fibers arborise in all the above regions (except in the thoracic ganglia), and in addition in the neuropil dorsal to the oesophagus and antero-ventral to posterior slope (tritocerebrum). The anatomy of the ocellar pathway in C. erythrocephala is compared with those in other studied insects. Possible interactions between ocellar interneurones and other pathways are discussed.