Thunderstruck: The ACDC model of flexible sequences and rhythms in recurrent neural circuits

Adaptive sequential behavior is a hallmark of human cognition. In particular, humans can learn to produce precise spatiotemporal sequences given a certain context. For instance, musicians can not only reproduce learned action sequences in a context-dependent manner, they can also quickly and flexibly reapply them in any desired tempo or rhythm without overwriting previous learning. Existing neural network models fail to account for these properties. We argue that this limitation emerges from the fact that sequence information (i.e., the position of the action) and timing (i.e., the moment of response execution) are typically stored in the same neural network weights. Here, we augment a biologically plausible recurrent neural network of cortical dynamics to include a basal ganglia-thalamic module which uses reinforcement learning to dynamically modulate action. This “associative cluster-dependent chain” (ACDC) model modularly stores sequence and timing information in distinct loci of the network. This feature increases computational power and allows ACDC to display a wide range of temporal properties (e.g., multiple sequences, temporal shifting, rescaling, and compositionality), while still accounting for several behavioral and neurophysiological empirical observations. Finally, we apply this ACDC network to show how it can learn the famous “Thunderstruck” song intro and then flexibly play it in a “bossa nova” rhythm without further training.     

Protein Interaction Networks—More Than Mere Modules

It is widely believed that the modular organization of cellular function is reflected in a modular structure of molecular networks. A common view is that a “module” in a network is a cohesively linked group of nodes, densely connected internally and sparsely interacting with the rest of the network. Many algorithms try to identify functional modules in protein-interaction networks (PIN) by searching for such cohesive groups of proteins. Here, we present an alternative approach independent of any prior definition of what actually constitutes a “module”. In a self-consistent manner, proteins are grouped into “functional roles” if they interact in similar ways with other proteins according to their functional roles. Such grouping may well result in cohesive modules again, but only if the network structure actually supports this. We applied our method to the PIN from the Human Protein Reference Database (HPRD) and found that a representation of the network in terms of cohesive modules, at least on a global scale, does not optimally represent the network''s structure because it focuses on finding independent groups of proteins. In contrast, a decomposition into functional roles is able to depict the structure much better as it also takes into account the interdependencies between roles and even allows groupings based on the absence of interactions between proteins in the same functional role. This, for example, is the case for transmembrane proteins, which could never be recognized as a cohesive group of nodes in a PIN. When mapping experimental methods onto the groups, we identified profound differences in the coverage suggesting that our method is able to capture experimental bias in the data, too. For example yeast-two-hybrid data were highly overrepresented in one particular group. Thus, there is more structure in protein-interaction networks than cohesive modules alone and we believe this finding can significantly improve automated function prediction algorithms.     

Tissue-Specific Functional Networks for Prioritizing Phenotype and Disease Genes

Integrated analyses of functional genomics data have enormous potential for identifying phenotype-associated genes. Tissue-specificity is an important aspect of many genetic diseases, reflecting the potentially different roles of proteins and pathways in diverse cell lineages. Accounting for tissue specificity in global integration of functional genomics data is challenging, as “functionality” and “functional relationships” are often not resolved for specific tissue types. We address this challenge by generating tissue-specific functional networks, which can effectively represent the diversity of protein function for more accurate identification of phenotype-associated genes in the laboratory mouse. Specifically, we created 107 tissue-specific functional relationship networks through integration of genomic data utilizing knowledge of tissue-specific gene expression patterns. Cross-network comparison revealed significantly changed genes enriched for functions related to specific tissue development. We then utilized these tissue-specific networks to predict genes associated with different phenotypes. Our results demonstrate that prediction performance is significantly improved through using the tissue-specific networks as compared to the global functional network. We used a testis-specific functional relationship network to predict genes associated with male fertility and spermatogenesis phenotypes, and experimentally confirmed one top prediction, Mbyl1. We then focused on a less-common genetic disease, ataxia, and identified candidates uniquely predicted by the cerebellum network, which are supported by both literature and experimental evidence. Our systems-level, tissue-specific scheme advances over traditional global integration and analyses and establishes a prototype to address the tissue-specific effects of genetic perturbations, diseases and drugs.     

Microbial adaptive evolution

Bacterial species can adapt to significant changes in their environment by mutation followed by selection, a phenomenon known as “adaptive evolution.” With the development of bioinformatics and genetic engineering, research on adaptive evolution has progressed rapidly, as have applications of the process. In this review, we summarize various mechanisms of bacterial adaptive evolution, the technologies used for studying it, and successful applications of the method in research and industry. We particularly highlight the contributions of Dr. L. O. Ingram. Microbial adaptive evolution has significant impact on our society not only from its industrial applications, but also in the evolution, emergence, and control of various pathogens.     

An Empirical Analysis of Primary and Secondary Pharmaceutical Patents in Chile

We analyze the patent filing strategies of foreign pharmaceutical companies in Chile distinguishing between “primary” (active ingredient) and “secondary” patents (patents on modified compounds, formulations, dosages, particular medical uses, etc.). There is prior evidence that secondary patents are used by pharmaceutical originator companies in the U.S. and Europe to extend patent protection on drugs in length and breadth. Using a novel dataset that comprises all drugs registered in Chile between 1991 and 2010 as well as the corresponding patents and trademarks, we find evidence that foreign originator companies pursue similar strategies in Chile. We find a primary to secondary patents ratio of 1:4 at the drug-level, which is comparable to the available evidence for Europe; most secondary patents are filed over several years following the original primary patent and after the protected active ingredient has obtained market approval in Chile. This points toward effective patent term extensions through secondary patents. Secondary patents dominate “older” therapeutic classes like anti-ulcer and anti-depressants. In contrast, newer areas like anti-virals and anti-neoplastics (anti-cancer) have a much larger share of primary patents.     

Source-Sink Colonization as a Possible Strategy of Insects Living in Temporary Habitats

Continuous colonization and re-colonization is critical for survival of insect species living in temporary habitats. When insect populations in temporary habitats are depleted, some species may escape extinction by surviving in permanent, but less suitable habitats, in which long-term population survival can be maintained only by immigration from other populations. Such situation has been repeatedly described in nature, but conditions when and how this occurs and how important this phenomenon is for insect metapopulation survival are still poorly known, mainly because it is difficult to study experimentally. Therefore, we used a simulation model to investigate, how environmental stochasticity, growth rate and the incidence of dispersal affect the positive effect of permanent but poor (“sink”) habitats on the likelihood of metapopulation persistence in a network of high quality but temporary (“source”) habitats. This model revealed that permanent habitats substantially increase the probability of metapopulation persistence of insect species with poor dispersal ability if the availability of temporary habitats is spatio-temporally synchronized. Addition of permanent habitats to a system sometimes enabled metapopulation persistence even in cases in which the metapopulation would otherwise go extinct, especially for species with high growth rates. For insect species with low growth rates the probability of a metapopulation persistence strongly depended on the proportions of “source” to “source” and “sink” to “source” dispersal rates.     

Distributed representations accelerate evolution of adaptive behaviours

Animals with rudimentary innate abilities require substantial learning to transform those abilities into useful skills, where a skill can be considered as a set of sensory–motor associations. Using linear neural network models, it is proved that if skills are stored as distributed representations, then within-lifetime learning of part of a skill can induce automatic learning of the remaining parts of that skill. More importantly, it is shown that this “free-lunch” learning (FLL) is responsible for accelerated evolution of skills, when compared with networks which either 1) cannot benefit from FLL or 2) cannot learn. Specifically, it is shown that FLL accelerates the appearance of adaptive behaviour, both in its innate form and as FLL-induced behaviour, and that FLL can accelerate the rate at which learned behaviours become innate.     

Selecting Essential Information for Biosurveillance—A Multi-Criteria Decision Analysis

The National Strategy for Biosurveillancedefines biosurveillance as “the process of gathering, integrating, interpreting, and communicating essential information related to all-hazards threats or disease activity affecting human, animal, or plant health to achieve early detection and warning, contribute to overall situational awareness of the health aspects of an incident, and to enable better decision-making at all levels.” However, the strategy does not specify how “essential information” is to be identified and integrated into the current biosurveillance enterprise, or what the metrics qualify information as being “essential”. Thequestion of data stream identification and selection requires a structured methodology that can systematically evaluate the tradeoffs between the many criteria that need to be taken in account. Multi-Attribute Utility Theory, a type of multi-criteria decision analysis, can provide a well-defined, structured approach that can offer solutions to this problem. While the use of Multi-Attribute Utility Theoryas a practical method to apply formal scientific decision theoretical approaches to complex, multi-criteria problems has been demonstrated in a variety of fields, this method has never been applied to decision support in biosurveillance.We have developed a formalized decision support analytic framework that can facilitate identification of “essential information” for use in biosurveillance systems or processes and we offer this framework to the global BSV community as a tool for optimizing the BSV enterprise. To demonstrate utility, we applied the framework to the problem of evaluating data streams for use in an integrated global infectious disease surveillance system.     

Global Analysis of the Human Pathophenotypic Similarity Gene Network Merges Disease Module Components

The molecular complexity of genetic diseases requires novel approaches to break it down into coherent biological modules. For this purpose, many disease network models have been created and analyzed. We highlight two of them, “the human diseases networks” (HDN) and “the orphan disease networks” (ODN). However, in these models, each single node represents one disease or an ambiguous group of diseases. In these cases, the notion of diseases as unique entities reduces the usefulness of network-based methods. We hypothesize that using the clinical features (pathophenotypes) to define pathophenotypic connections between disease-causing genes improve our understanding of the molecular events originated by genetic disturbances. For this, we have built a pathophenotypic similarity gene network (PSGN) and compared it with the unipartite projections (based on gene-to-gene edges) similar to those used in previous network models (HDN and ODN). Unlike these disease network models, the PSGN uses semantic similarities. This pathophenotypic similarity has been calculated by comparing pathophenotypic annotations of genes (human abnormalities of HPO terms) in the “Human Phenotype Ontology”. The resulting network contains 1075 genes (nodes) and 26197 significant pathophenotypic similarities (edges). A global analysis of this network reveals: unnoticed pairs of genes showing significant pathophenotypic similarity, a biological meaningful re-arrangement of the pathological relationships between genes, correlations of biochemical interactions with higher similarity scores and functional biases in metabolic and essential genes toward the pathophenotypic specificity and the pleiotropy, respectively. Additionally, pathophenotypic similarities and metabolic interactions of genes associated with maple syrup urine disease (MSUD) have been used to merge into a coherent pathological module.Our results indicate that pathophenotypes contribute to identify underlying co-dependencies among disease-causing genes that are useful to describe disease modularity.     

Network modeling of dynamic brain interactions predicts emergence of neural information that supports human cognitive behavior

How cognitive task behavior is generated by brain network interactions is a central question in neuroscience. Answering this question calls for the development of novel analysis tools that can firstly capture neural signatures of task information with high spatial and temporal precision (the “where and when”) and then allow for empirical testing of alternative network models of brain function that link information to behavior (the “how”). We outline a novel network modeling approach suited to this purpose that is applied to noninvasive functional neuroimaging data in humans. We first dynamically decoded the spatiotemporal signatures of task information in the human brain by combining MRI-individualized source electroencephalography (EEG) with multivariate pattern analysis (MVPA). A newly developed network modeling approach—dynamic activity flow modeling—then simulated the flow of task-evoked activity over more causally interpretable (relative to standard functional connectivity [FC] approaches) resting-state functional connections (dynamic, lagged, direct, and directional). We demonstrate the utility of this modeling approach by applying it to elucidate network processes underlying sensory–motor information flow in the brain, revealing accurate predictions of empirical response information dynamics underlying behavior. Extending the model toward simulating network lesions suggested a role for the cognitive control networks (CCNs) as primary drivers of response information flow, transitioning from early dorsal attention network-dominated sensory-to-response transformation to later collaborative CCN engagement during response selection. These results demonstrate the utility of the dynamic activity flow modeling approach in identifying the generative network processes underlying neurocognitive phenomena.

How is cognitive task behavior generated by brain network interactions? This study describes a novel network modeling approach and applies it to source electroencephalography data. The model accurately predicts future information dynamics underlying behavior and (via simulated lesioning) suggests a role for cognitive control networks as key drivers of response information flow.     

Fish Invasions in the World's River Systems: When Natural Processes Are Blurred by Human Activities

Because species invasions are a principal driver of the human-induced biodiversity crisis, the identification of the major determinants of global invasions is a prerequisite for adopting sound conservation policies. Three major hypotheses, which are not necessarily mutually exclusive, have been proposed to explain the establishment of non-native species: the “human activity” hypothesis, which argues that human activities facilitate the establishment of non-native species by disturbing natural landscapes and by increasing propagule pressure; the “biotic resistance” hypothesis, predicting that species-rich communities will readily impede the establishment of non-native species; and the “biotic acceptance” hypothesis, predicting that environmentally suitable habitats for native species are also suitable for non-native species. We tested these hypotheses and report here a global map of fish invasions (i.e., the number of non-native fish species established per river basin) using an original worldwide dataset of freshwater fish occurrences, environmental variables, and human activity indicators for 1,055 river basins covering more than 80% of Earth's surface. First, we identified six major invasion hotspots where non-native species represent more than a quarter of the total number of species. According to the World Conservation Union, these areas are also characterised by the highest proportion of threatened fish species. Second, we show that the human activity indicators account for most of the global variation in non-native species richness, which is highly consistent with the “human activity” hypothesis. In contrast, our results do not provide support for either the “biotic acceptance” or the “biotic resistance” hypothesis. We show that the biogeography of fish invasions matches the geography of human impact at the global scale, which means that natural processes are blurred by human activities in driving fish invasions in the world's river systems. In view of our findings, we fear massive invasions in developing countries with a growing economy as already experienced in developed countries. Anticipating such potential biodiversity threats should therefore be a priority.     

The "Majority Illusion" in Social Networks

Individual’s decisions, from what product to buy to whether to engage in risky behavior, often depend on the choices, behaviors, or states of other people. People, however, rarely have global knowledge of the states of others, but must estimate them from the local observations of their social contacts. Network structure can significantly distort individual’s local observations. Under some conditions, a state that is globally rare in a network may be dramatically over-represented in the local neighborhoods of many individuals. This effect, which we call the “majority illusion,” leads individuals to systematically overestimate the prevalence of that state, which may accelerate the spread of social contagions. We develop a statistical model that quantifies this effect and validate it with measurements in synthetic and real-world networks. We show that the illusion is exacerbated in networks with a heterogeneous degree distribution and disassortative structure.     

A Novel Bio-Sensor Based on DNA Strand Displacement

DNA strand displacement technology performs well in sensing and programming DNA segments. In this work, we construct DNA molecular systems based on DNA strand displacement performing computation of logic gates. Specifically, a class of so-called “DNA neurons” are achieved, in which a “smart” way inspired by biological neurons encoding information is developed to encode and deliver information using DNA molecules. The “DNA neuron” is bistable, that is, it can sense DNA molecules as input signals, and release “negative” or “positive” signals DNA molecules. We design intelligent DNA molecular systems that are constructed by cascading some particularly organized “DNA neurons”, which could perform logic computation, including AND, OR, XOR logic gates, automatically. Both simulation results using visual DSD (DNA strand displacement) software and experimental results are obtained, which shows that the proposed systems can detect DNA signals with high sensitivity and accretion; moreover, the systems can process input signals automatically with complex nonlinear logic. The method proposed in this work may provide a new way to construct a sensitive molecular signal detection system with neurons spiking behavior in vitro, and can be used to develop intelligent molecular processing systems in vivo.     

The Two Sides of Complement C3d: Evolution of Electrostatics in a Link between Innate and Adaptive Immunity

The interaction between complement fragment C3d and complement receptor 2 (CR2) is a key aspect of complement immune system activation, and is a component in a link between innate and adaptive immunities. The complement immune system is an ancient mechanism for defense, and can be found in species that have been on Earth for the last 600 million years. However, the link between the complement system and adaptive immunity, which is formed through the association of the B-cell co-receptor complex, including the C3d-CR2 interaction, is a much more recent adaptation. Human C3d and CR2 have net charges of −1 and +7 respectively, and are believed to have evolved favoring the role of electrostatics in their functions. To investigate the role of electrostatics in the function and evolution of human C3d and CR2, we have applied electrostatic similarity methods to identify regions of evolutionarily conserved electrostatic potential based on 24 homologues of complement C3d and 4 homologues of CR2. We also examine the effects of structural perturbation, as introduced through molecular dynamics and mutations, on spatial distributions of electrostatic potential to identify perturbation resistant regions, generated by so-called electrostatic “hot-spots”. Distributions of electrostatic similarity based on families of perturbed structures illustrate the presence of electrostatic “hot-spots” at the two functional sites of C3d, while the surface of CR2 lacks electrostatic “hot-spots” despite its excessively positive nature. We propose that the electrostatic “hot-spots” of C3d have evolved to optimize its dual-functionality (covalently attaching to pathogen surfaces and interaction with CR2), which are both necessary for the formation B-cell co-receptor complexes. Comparison of the perturbation resistance of the electrostatic character of the homologues of C3d suggests that there was an emergence of a new role of electrostatics, and a transition in the function of C3d, after the divergence of jawless fish.     

Allosteric Communication Occurs via Networks of Tertiary and Quaternary Motions in Proteins

Allosteric proteins bind an effector molecule at one site resulting in a functional change at a second site. We hypothesize that allosteric communication in proteins relies upon networks of quaternary (collective, rigid-body) and tertiary (residue–residue contact) motions. We argue that cyclic topology of these networks is necessary for allosteric communication. An automated algorithm identifies rigid bodies from the displacement between the inactive and the active structures and constructs “quaternary networks” from these rigid bodies and the substrate and effector ligands. We then integrate quaternary networks with a coarse-grained representation of contact rearrangements to form “global communication networks” (GCNs). The GCN reveals allosteric communication among all substrate and effector sites in 15 of 18 multidomain and multimeric proteins, while tertiary and quaternary networks exhibit such communication in only 4 and 3 of these proteins, respectively. Furthermore, in 7 of the 15 proteins connected by the GCN, 50% or more of the substrate-effector paths via the GCN are “interdependent” paths that do not exist via either the tertiary or the quaternary network. Substrate-effector “pathways” typically are not linear but rather consist of polycyclic networks of rigid bodies and clusters of rearranging residue contacts. These results argue for broad applicability of allosteric communication based on structural changes and demonstrate the utility of the GCN. Global communication networks may inform a variety of experiments on allosteric proteins as well as the design of allostery into non-allosteric proteins.     

Explicating the Face Perception Network with White Matter Connectivity

A network of multiple brain regions is recruited in face perception. Our understanding of the functional properties of this network can be facilitated by explicating the structural white matter connections that exist between its functional nodes. We accomplished this using functional MRI (fMRI) in combination with fiber tractography on high angular resolution diffusion weighted imaging data. We identified the three nodes of the core face network: the “occipital face area” (OFA), the “fusiform face area” (mid-fusiform gyrus or mFus), and the superior temporal sulcus (STS). Additionally, a region of the anterior temporal lobe (aIT), implicated as being important for face perception was identified. Our data suggest that we can further divide the OFA into multiple anatomically distinct clusters – a partitioning consistent with several recent neuroimaging results. More generally, structural white matter connectivity within this network revealed: 1) Connectivity between aIT and mFus, and between aIT and occipital regions, consistent with studies implicating this posterior to anterior pathway as critical to normal face processing; 2) Strong connectivity between mFus and each of the occipital face-selective regions, suggesting that these three areas may subserve different functional roles; 3) Almost no connectivity between STS and mFus, or between STS and the other face-selective regions. Overall, our findings suggest a re-evaluation of the “core” face network with respect to what functional areas are or are not included in this network.     

“Bicycles May Use Full Lane” Signage Communicates U.S. Roadway Rules and Increases Perception of Safety

Many global challenges, including obesity, health care costs, and climate change, could be addressed in part by increasing the use of bicycles for transportation. Concern about the safety of bicycling on roadways is frequently cited as a deterrent to increasing bicycle use in the USA. The use of effective signage along roadways might help alleviate these concerns by increasing knowledge about the rights and duties of bicyclists and motorists, ideally reducing crashes. We administered a web-based survey, using Twitter for recruitment, to examine how well three US traffic control devices communicated the message that bicyclists are permitted in the center of the travel lane and do not have to “get out of the way” to allow motorists to pass without changing lanes: “Bicycles May Use Full Lane” and “Share the Road” signage, and Shared Lane Markings on the pavement. Each was compared to an unsigned roadway. We also asked respondents whether it was safe for a bicyclist to occupy the center of the travel lane. “Bicycles May Use Full Lane” signage was the most consistently comprehended device for communicating the message that bicyclists may occupy the travel lane and also increased perceptions of safety. “Share the Road” signage did not increase comprehension or perceptions of safety. Shared Lane Markings fell somewhere between. “Bicycles May Use Full Lane” signage showed notable increases in comprehension among novice bicyclists and private motor vehicle commuters, critical target audiences for efforts to promote bicycling in the USA. Although limited in scope, our survey results are indicative and suggest that Departments of Transportation consider replacing “Share the Road” with “Bicycles May Use Full Lane” signage, possibly combined with Shared Lane Markings, if the intent is to increase awareness of roadway rights and responsibilities. Further evaluation through virtual reality simulations and on-road experiments is merited.     

Analysis and Prediction of the Metabolic Stability of Proteins Based on Their Sequential Features,Subcellular Locations and Interaction Networks

The metabolic stability is a very important idiosyncracy of proteins that is related to their global flexibility, intramolecular fluctuations, various internal dynamic processes, as well as many marvelous biological functions. Determination of protein''s metabolic stability would provide us with useful information for in-depth understanding of the dynamic action mechanisms of proteins. Although several experimental methods have been developed to measure protein''s metabolic stability, they are time-consuming and more expensive. Reported in this paper is a computational method, which is featured by (1) integrating various properties of proteins, such as biochemical and physicochemical properties, subcellular locations, network properties and protein complex property, (2) using the mRMR (Maximum Relevance & Minimum Redundancy) principle and the IFS (Incremental Feature Selection) procedure to optimize the prediction engine, and (3) being able to identify proteins among the four types: “short”, “medium”, “long”, and “extra-long” half-life spans. It was revealed through our analysis that the following seven characters played major roles in determining the stability of proteins: (1) KEGG enrichment scores of the protein and its neighbors in network, (2) subcellular locations, (3) polarity, (4) amino acids composition, (5) hydrophobicity, (6) secondary structure propensity, and (7) the number of protein complexes the protein involved. It was observed that there was an intriguing correlation between the predicted metabolic stability of some proteins and the real half-life of the drugs designed to target them. These findings might provide useful insights for designing protein-stability-relevant drugs. The computational method can also be used as a large-scale tool for annotating the metabolic stability for the avalanche of protein sequences generated in the post-genomic age.