Bursts and Heavy Tails in Temporal and Sequential Dynamics of Foraging Decisions

A fundamental understanding of behavior requires predicting when and what an individual will choose. However, the actual temporal and sequential dynamics of successive choices made among multiple alternatives remain unclear. In the current study, we tested the hypothesis that there is a general bursting property in both the timing and sequential patterns of foraging decisions. We conducted a foraging experiment in which rats chose among four different foods over a continuous two-week time period. Regarding when choices were made, we found bursts of rapidly occurring actions, separated by time-varying inactive periods, partially based on a circadian rhythm. Regarding what was chosen, we found sequential dynamics in affective choices characterized by two key features: (a) a highly biased choice distribution; and (b) preferential attachment, in which the animals were more likely to choose what they had previously chosen. To capture the temporal dynamics, we propose a dual-state model consisting of active and inactive states. We also introduce a satiation-attainment process for bursty activity, and a non-homogeneous Poisson process for longer inactivity between bursts. For the sequential dynamics, we propose a dual-control model consisting of goal-directed and habit systems, based on outcome valuation and choice history, respectively. This study provides insights into how the bursty nature of behavior emerges from the interaction of different underlying systems, leading to heavy tails in the distribution of behavior over time and choices.     

Learned odor discrimination in Drosophila without combinatorial odor maps in the antennal lobe

A unifying feature of mammalian and insect olfactory systems is that olfactory sensory neurons (OSNs) expressing the same unique odorant-receptor gene converge onto the same glomeruli in the brain [1-7]. Most odorants activate a combination of receptors and thus distinct patterns of glomeruli, forming a proposed combinatorial spatial code that could support discrimination between a large number of odorants [8-11]. OSNs also exhibit odor-evoked responses with complex temporal dynamics [11], but the contribution of this activity to behavioral odor discrimination has received little attention [12]. Here, we investigated the importance of spatial encoding in the relatively simple Drosophila antennal lobe. We show that Drosophila can learn to discriminate between two odorants with one functional class of Or83b-expressing OSNs. Furthermore, these flies encode one odorant from a mixture and cross-adapt to odorants that activate the relevant OSN class, demonstrating that they discriminate odorants by using the same OSNs. Lastly, flies with a single class of Or83b-expressing OSNs recognize a specific odorant across a range of concentration, indicating that they encode odorant identity. Therefore, flies can distinguish odorants without discrete spatial codes in the antennal lobe, implying an important role for odorant-evoked temporal dynamics in behavioral odorant discrimination.     

Deconstructing memory in Drosophila

Unlike most organ systems, which have evolved to maintain homeostasis, the brain has been selected to sense and adapt to environmental stimuli by constantly altering interactions in a gene network that functions within a larger neural network. This unique feature of the central nervous system provides a remarkable plasticity of behavior, but also makes experimental investigations challenging. Each experimental intervention ramifies through both gene and neural networks, resulting in unpredicted and sometimes confusing phenotypic adaptations. Experimental dissection of mechanisms underlying behavioral plasticity ultimately must accomplish an integration across many levels of biological organization, including genetic pathways acting within individual neurons, neural network interactions which feed back to gene function, and phenotypic observations at the behavioral level. This dissection will be more easily accomplished for model systems such as Drosophila, which, compared with mammals, have relatively simple and manipulable nervous systems and genomes. The evolutionary conservation of behavioral phenotype and the underlying gene function ensures that much of what we learn in such model systems will be relevant to human cognition. In this essay, we have not attempted to review the entire Drosophila memory field. Instead, we have tried to discuss particular findings that provide some level of intellectual synthesis across three levels of biological organization: behavior, neural circuitry and biochemical pathways. We have attempted to use this integrative approach to evaluate distinct mechanistic hypotheses, and to propose critical experiments that will advance this field.     

Accurate Encoding and Decoding by Single Cells: Amplitude Versus Frequency Modulation

Cells sense external concentrations and, via biochemical signaling, respond by regulating the expression of target proteins. Both in signaling networks and gene regulation there are two main mechanisms by which the concentration can be encoded internally: amplitude modulation (AM), where the absolute concentration of an internal signaling molecule encodes the stimulus, and frequency modulation (FM), where the period between successive bursts represents the stimulus. Although both mechanisms have been observed in biological systems, the question of when it is beneficial for cells to use either AM or FM is largely unanswered. Here, we first consider a simple model for a single receptor (or ion channel), which can either signal continuously whenever a ligand is bound, or produce a burst in signaling molecule upon receptor binding. We find that bursty signaling is more accurate than continuous signaling only for sufficiently fast dynamics. This suggests that modulation based on bursts may be more common in signaling networks than in gene regulation. We then extend our model to multiple receptors, where continuous and bursty signaling are equivalent to AM and FM respectively, finding that AM is always more accurate. This implies that the reason some cells use FM is related to factors other than accuracy, such as the ability to coordinate expression of multiple genes or to implement threshold crossing mechanisms.     

Bursty Communication Patterns Facilitate Spreading in a Threshold-Based Epidemic Dynamics

Records of social interactions provide us with new sources of data for understanding how interaction patterns affect collective dynamics. Such human activity patterns are often bursty, i.e., they consist of short periods of intense activity followed by long periods of silence. This burstiness has been shown to affect spreading phenomena; it accelerates epidemic spreading in some cases and slows it down in other cases. We investigate a model of history-dependent contagion. In our model, repeated interactions between susceptible and infected individuals in a short period of time is needed for a susceptible individual to contract infection. We carry out numerical simulations on real temporal network data to find that bursty activity patterns facilitate epidemic spreading in our model.     

Thalamocortical dynamics of sleep: roles of purinergic neuromodulation

Thalamocortical dynamics, the millisecond to second changes in activity of thalamocortical circuits, are central to perception, action and cognition. Generated by local circuitry and sculpted by neuromodulatory systems, these dynamics reflect the expression of vigilance states. In sleep, thalamocortical dynamics are thought to mediate "offline" functions including memory consolidation and synaptic scaling. Here, I discuss thalamocortical sleep dynamics and their modulation by the ascending arousal system and locally released neurochemicals. I focus on modulation of these dynamics by electrically silent astrocytes, highlighting the role of purinergic signaling in this glial form of communication. Astrocytes modulate cortical slow oscillations, sleep behavior, and sleep-dependent cognitive function. The discovery that astrocytes can modulate sleep dynamics and sleep-related behaviors suggests a new way of thinking about the brain, in which integrated circuits of neurons and glia control information processing and behavioral output.     

On the dynamics of the spontaneous activity in neuronal networks

Most neuronal networks, even in the absence of external stimuli, produce spontaneous bursts of spikes separated by periods of reduced activity. The origin and functional role of these neuronal events are still unclear. The present work shows that the spontaneous activity of two very different networks, intact leech ganglia and dissociated cultures of rat hippocampal neurons, share several features. Indeed, in both networks: i) the inter-spike intervals distribution of the spontaneous firing of single neurons is either regular or periodic or bursting, with the fraction of bursting neurons depending on the network activity; ii) bursts of spontaneous spikes have the same broad distributions of size and duration; iii) the degree of correlated activity increases with the bin width, and the power spectrum of the network firing rate has a 1/f behavior at low frequencies, indicating the existence of long-range temporal correlations; iv) the activity of excitatory synaptic pathways mediated by NMDA receptors is necessary for the onset of the long-range correlations and for the presence of large bursts; v) blockage of inhibitory synaptic pathways mediated by GABA(A) receptors causes instead an increase in the correlation among neurons and leads to a burst distribution composed only of very small and very large bursts. These results suggest that the spontaneous electrical activity in neuronal networks with different architectures and functions can have very similar properties and common dynamics.     

Serotonin modulates locomotory behavior and coordinates egg-laying and movement in Caenorhabditis elegans.

Biogenic amines have been implicated in the modulation of neural circuits involved in diverse behaviors in a wide variety of organisms. In the nematode C. elegans, serotonin has been shown to modulate the temporal pattern of egg-laying behavior. Here we show that serotonergic neurotransmission is also required for modulation of the timing of behavioral events associated with locomotion and for coordinating locomotive behavior with egg-laying. Using an automated tracking system to record locomotory behavior over long time periods, we determined that both the direction and velocity of movement fluctuate in a stochastic pattern in wild-type worms. During periods of active egg-laying, the patterns of reversals and velocity were altered: velocity increased transiently before egg-laying events, while reversals increased in frequency following egg-laying events. The temporal coordination between egg-laying and locomotion was dependent on the serotonergic HSN egg-laying motorneurons as well as the decision-making AVF interneurons, which receive synaptic input from the HSNs. Serotonin-deficient mutants also failed to coordinate egg-laying and locomotion and exhibited an abnormally low overall reversal frequency. Thus, serotonin appears to function specifically to facilitate increased locomotion during periods of active egg-laying, and to function generally to modulate decision-making neurons that promote forward movement.     

The analytical characteristics of the dynamics of interneuronal functional connections during conditioned-reflex activity]

The dynamics of functional relations between neurons was studied in the frontal cortex of dogs performing reversal conditioning task. To reveal the functionally relevant relationships between the temporal patterns of correlated firing and behavioral events, we developed an original processing technique. The technique included the following procedures: a) isolation of the "coupled spikes" (CS) from simultaneously recorded impulse trains: b) search for the temporal patterns of correlated firings and their classification by clustering single trials with similar temporal distribution of CS; c) assessment of behavioral significance of the identified patterns by evaluation of the probabilities of coincidence of behavioral events and different CS patterns. Significant correlations between impulse trains were revealed in 38 neuronal pairs of 456 analyzed. The effects of change in behavioral context on the CS dynamics during the task performance were found in 87% of neuronal pairs with correlated activity. In 17 pairs the behavioral conditions were identified, under which potentially connected neurons fired independently during all the periods of the behavioral task. The potentialities of the advanced processing technique are discussed. We suggest that this analysis can provide useful information about the temporal distribution of correlated firings under conditions of nonstereotyped behavior, when an animal reacts in the dynamically organized experimental context.     

Attention-like processes underlying optomotor performance in a Drosophila choice maze

The authors present a novel paradigm for studying visual responses in Drosophila. An eight-level choice maze was found to reliably segregate fly populations according to their responses to moving stripes displayed on a computer screen. Visual responsiveness was robust in wild-type flies, and performance depended on salience effects such as stimulus color and speed. Analysis of individual fly choices in the maze revealed that stereotypy, or choice persistence, contributed significantly to a strain's performance. On the basis of these observations, the authors bred wild-type flies for divergent visual phenotypes by selecting individual flies displaying extreme stereotypy. Selected flies alternated less often in the sequential choice maze than unselected flies, showing that stereotypy could evolve across generations. The authors found that selection for increased stereotypy impaired flies' responsiveness to competing stimuli in tests for attention-like behavior in the maze. Visual selective attention was further investigated by electrophysiology, and it was found that increased stereotypy also impaired responsiveness to competing stimuli at the level of brain activity. Combined results present a comprehensive approach to studying visual responses in Drosophila, and show that behavioral performance involves attention-like processes that are variable among individuals and thus sensitive to artificial selection.     

Correlated dynamics in egocentric communication networks

We investigate the communication sequences of millions of people through two different channels and analyse the fine grained temporal structure of correlated event trains induced by single individuals. By focusing on correlations between the heterogeneous dynamics and the topology of egocentric networks we find that the bursty trains usually evolve for pairs of individuals rather than for the ego and his/her several neighbours, thus burstiness is a property of the links rather than of the nodes. We compare the directional balance of calls and short messages within bursty trains to the average on the actual link and show that for the trains of voice calls the imbalance is significantly enhanced, while for short messages the balance within the trains increases. These effects can be partly traced back to the technological constraints (for short messages) and partly to the human behavioural features (voice calls). We define a model that is able to reproduce the empirical results and may help us to understand better the mechanisms driving technology mediated human communication dynamics.     

The role of behavioral dynamics in determining the patch distributions of interacting species

The effect of the behavioral dynamics of movement on the population dynamics of interacting species in multipatch systems is studied. The behavioral dynamics of habitat choice used in a range of previous models are reviewed. There is very limited empirical evidence for distinguishing between these different models, but they differ in important ways, and many lack properties that would guarantee stability of an ideal free distribution in a single-species system. The importance of finding out more about movement dynamics in multispecies systems is shown by an analysis of the effect of movement rules on the dynamics of a particular two-species-two-patch model of competition, where the population dynamical equilibrium in the absence of movement is often not a behavioral equilibrium in the presence of adaptive movement. The population dynamics of this system are explored for several different movement rules and different parameter values, producing a variety of outcomes. Other systems of interacting species that may lack a dynamically stable distribution among patches are discussed, and it is argued that such systems are not rare. The sensitivity of community properties to individual movement behavior in this and earlier studies argues that there is a great need for empirical investigation to determine the applicability of different models of the behavioral dynamics of habitat selection.     

Concurrent Bursty Behavior of Social Sensors in Sporting Events

The advent of social media expands our ability to transmit information and connect with others instantly, which enables us to behave as “social sensors.” Here, we studied concurrent bursty behavior of Twitter users during major sporting events to determine their function as social sensors. We show that the degree of concurrent bursts in tweets (posts) and retweets (re-posts) works as a strong indicator of winning or losing a game. More specifically, our simple tweet analysis of Japanese professional baseball games in 2013 revealed that social sensors can immediately react to positive and negative events through bursts of tweets, but that positive events are more likely to induce a subsequent burst of retweets. We confirm that these findings also hold true for tweets related to Major League Baseball games in 2015. Furthermore, we demonstrate active interactions among social sensors by constructing retweet networks during a baseball game. The resulting networks commonly exhibited user clusters depending on the baseball team, with a scale-free connectedness that is indicative of a substantial difference in user popularity as an information source. While previous studies have mainly focused on bursts of tweets as a simple indicator of a real-world event, the temporal correlation between tweets and retweets implies unique aspects of social sensors, offering new insights into human behavior in a highly connected world.     

The neuropeptide SIFamide modulates sexual behavior in Drosophila

The expression of Drosophila neuropeptide AYRKPPFNGSIFamide (SIFamide) was shown by both immunohistology and in situ hybridization to be restricted to only four neurons of the pars intercerebralis. The role of SIFamide in adult courtship behavior in both sexes was studied using two different approaches to perturb the function of SIFamide; targeted cell ablation and RNA interference (RNAi). Elimination of SIFamide by either of these methods results in promiscuous flies; males perform vigorous and indiscriminant courtship directed at either sex, while females appear sexually hyper-receptive. These results demonstrate that SIFamide is responsible for these behavioral effects and that the four SIFamidergic neurons and arborizations play an important function in the neuronal circuitry controlling Drosophila sexual behavior.     

Altered Neurocircuitry in the Dopamine Transporter Knockout Mouse Brain

The plasma membrane transporters for the monoamine neurotransmitters dopamine, serotonin, and norepinephrine modulate the dynamics of these monoamine neurotransmitters. Thus, activity of these transporters has significant consequences for monoamine activity throughout the brain and for a number of neurological and psychiatric disorders. Gene knockout (KO) mice that reduce or eliminate expression of each of these monoamine transporters have provided a wealth of new information about the function of these proteins at molecular, physiological and behavioral levels. In the present work we use the unique properties of magnetic resonance imaging (MRI) to probe the effects of altered dopaminergic dynamics on meso-scale neuronal circuitry and overall brain morphology, since changes at these levels of organization might help to account for some of the extensive pharmacological and behavioral differences observed in dopamine transporter (DAT) KO mice. Despite the smaller size of these animals, voxel-wise statistical comparison of high resolution structural MR images indicated little morphological change as a consequence of DAT KO. Likewise, proton magnetic resonance spectra recorded in the striatum indicated no significant changes in detectable metabolite concentrations between DAT KO and wild-type (WT) mice. In contrast, alterations in the circuitry from the prefrontal cortex to the mesocortical limbic system, an important brain component intimately tied to function of mesolimbic/mesocortical dopamine reward pathways, were revealed by manganese-enhanced MRI (MEMRI). Analysis of co-registered MEMRI images taken over the 26 hours after introduction of Mn²⁺ into the prefrontal cortex indicated that DAT KO mice have a truncated Mn²⁺ distribution within this circuitry with little accumulation beyond the thalamus or contralateral to the injection site. By contrast, WT littermates exhibit Mn²⁺ transport into more posterior midbrain nuclei and contralateral mesolimbic structures at 26 hr post-injection. Thus, DAT KO mice appear, at this level of anatomic resolution, to have preserved cortico-striatal-thalamic connectivity but diminished robustness of reward-modulating circuitry distal to the thalamus. This is in contradistinction to the state of this circuitry in serotonin transporter KO mice where we observed more robust connectivity in more posterior brain regions using methods identical to those employed here.     

Vesicular glutamate transport at a central synapse limits the acuity of visual perception in zebrafish

The neural circuitry that constrains visual acuity in the CNS has not been experimentally identified. We show here that zebrafish blumenkohl (blu) mutants are impaired in resolving rapid movements and fine spatial detail. The blu gene encodes a vesicular glutamate transporter expressed by retinal ganglion cells. Mutant retinotectal synapses release less glutamate, per vesicle and per terminal, and fatigue more quickly than wild-type in response to high-frequency stimulation. In addition, mutant axons arborize more extensively, thus increasing the number of synaptic terminals and effectively normalizing the combined input to postsynaptic cells in the tectum. This presumably homeostatic response results in larger receptive fields of tectal cells and a degradation of the retinotopic map. As predicted, mutants have a selective deficit in the capture of small prey objects, a behavior dependent on the tectum. Our studies successfully link the disruption of a synaptic protein to complex changes in neural circuitry and behavior.     

A succession of anesthetic endpoints in the Drosophila brain

General anesthetics abolish behavioral responsiveness in all animals, and in humans this is accompanied by loss of consciousness. Whether similar target mechanisms and behavioral endpoints exist across species remains controversial, although model organisms have been successfully used to study mechanisms of anesthesia. In Drosophila, a number of key mutants have been characterized as hypersensitive or resistant to general anesthetics by behavioral assays. In order to investigate general anesthesia in the Drosophila brain, local field potential (LFP) recordings were made during incremental exposures to isoflurane in wild-type and mutant flies. As in higher animals, general anesthesia in flies was found to involve a succession of distinct endpoints. At low doses, isoflurane uncoupled brain activity from ongoing movement, followed by a sudden attenuation in neural correlates of perception. Average LFP activity in the brain was more gradually attenuated with higher doses, followed by loss of movement behavior. Among mutants, a strong correspondence was found between behavioral and LFP sensitivities, thereby suggesting that LFP phenotypes are proximal to the anesthetic's mechanism of action. Finally, genetic and pharmacological analysis revealed that anesthetic sensitivities in the fly brain are, like other arousal states, influenced by dopaminergic activity. These results suggest that volatile anesthetics such as isoflurane may target the same processes that sustain wakefulness and attention in the brain. LFP correlates of general anesthesia in Drosophila provide a powerful new approach to uncovering the nature of these processes.     

Intrinsic activity in the fly brain gates visual information during behavioral choices

The small insect brain is often described as an input/output system that executes reflex-like behaviors. It can also initiate neural activity and behaviors intrinsically, seen as spontaneous behaviors, different arousal states and sleep. However, less is known about how intrinsic activity in neural circuits affects sensory information processing in the insect brain and variability in behavior. Here, by simultaneously monitoring Drosophila's behavioral choices and brain activity in a flight simulator system, we identify intrinsic activity that is associated with the act of selecting between visual stimuli. We recorded neural output (multiunit action potentials and local field potentials) in the left and right optic lobes of a tethered flying Drosophila, while its attempts to follow visual motion (yaw torque) were measured by a torque meter. We show that when facing competing motion stimuli on its left and right, Drosophila typically generate large torque responses that flip from side to side. The delayed onset (0.1-1 s) and spontaneous switch-like dynamics of these responses, and the fact that the flies sometimes oppose the stimuli by flying straight, make this behavior different from the classic steering reflexes. Drosophila, thus, seem to choose one stimulus at a time and attempt to rotate toward its direction. With this behavior, the neural output of the optic lobes alternates; being augmented on the side chosen for body rotation and suppressed on the opposite side, even though the visual input to the fly eyes stays the same. Thus, the flow of information from the fly eyes is gated intrinsically. Such modulation can be noise-induced or intentional; with one possibility being that the fly brain highlights chosen information while ignoring the irrelevant, similar to what we know to occur in higher animals.     

Age-dependent behavior loss in adult Drosophila melanogaster

The use of Drosophila as an organism in which to study aging has been limited by the fact that few biomarkers of aging exist in the adult. In this paper we examine behavior loss relative to longevity in wild-type populations maintained at 22°C and 29°C to determine whether behavior loss—that is, loss of ability to perform certain innate behavioral responses within a defined test interval—can be used as biomarkers of aging. We find that under controlled conditions behavior loss can be used as a landmark of aging in populations maintained at either 22°C or 29°C. The ability to perform normal geotactic and phototactic responses is lost during the reproductive phase of the adult populations, whereas motor activity is not lost until well into the death phase. We feel that the use of behavior loss, together with other parameters of longevity in Drosophila, will allow comparisons to be made between different strains or between different environmental conditions to test their effect on aging. In the companion paper we demonstrate the use of behavior loss to identify a mutation which may accelerate the aging process.