Integrated information increases with fitness in the evolution of animats

One of the hallmarks of biological organisms is their ability to integrate disparate information sources to optimize their behavior in complex environments. How this capability can be quantified and related to the functional complexity of an organism remains a challenging problem, in particular since organismal functional complexity is not well-defined. We present here several candidate measures that quantify information and integration, and study their dependence on fitness as an artificial agent ("animat") evolves over thousands of generations to solve a navigation task in a simple, simulated environment. We compare the ability of these measures to predict high fitness with more conventional information-theoretic processing measures. As the animat adapts by increasing its "fit" to the world, information integration and processing increase commensurately along the evolutionary line of descent. We suggest that the correlation of fitness with information integration and with processing measures implies that high fitness requires both information processing as well as integration, but that information integration may be a better measure when the task requires memory. A correlation of measures of information integration (but also information processing) and fitness strongly suggests that these measures reflect the functional complexity of the animat, and that such measures can be used to quantify functional complexity even in the absence of fitness data.     

Processing ordinality and quantity: the case of developmental dyscalculia

In contrast to quantity processing, up to date, the nature of ordinality has received little attention from researchers despite the fact that both quantity and ordinality are embodied in numerical information. Here we ask if there are two separate core systems that lie at the foundations of numerical cognition: (1) the traditionally and well accepted numerical magnitude system but also (2) core system for representing ordinal information. We report two novel experiments of ordinal processing that explored the relation between ordinal and numerical information processing in typically developing adults and adults with developmental dyscalculia (DD). Participants made "ordered" or "non-ordered" judgments about 3 groups of dots (non-symbolic numerical stimuli; in Experiment 1) and 3 numbers (symbolic task: Experiment 2). In contrast to previous findings and arguments about quantity deficit in DD participants, when quantity and ordinality are dissociated (as in the current tasks), DD participants exhibited a normal ratio effect in the non-symbolic ordinal task. They did not show, however, the ordinality effect. Ordinality effect in DD appeared only when area and density were randomized, but only in the descending direction. In the symbolic task, the ordinality effect was modulated by ratio and direction in both groups. These findings suggest that there might be two separate cognitive representations of ordinal and quantity information and that linguistic knowledge may facilitate estimation of ordinal information.     

Focus, newness and their combination: processing of information structure in discourse

The relationship between focus and new information has been unclear despite being the subject of several information structure studies. Here, we report an eye-tracking experiment that explored the relationship between them in on-line discourse processing in Chinese reading. Focus was marked by the Chinese focus-particle "shi", which is equivalent to the cleft structure "it was… who…" in English. New information was defined as the target word that was not present in previous contexts. Our results show that, in the target region, focused information was processed more quickly than non-focused information, while new information was processed more slowly than given information. These results reveal differences in processing patterns between focus and newness, and suggest that they are different concepts that relate to different aspects of cognitive processing. In addition, the effect of new/given information occurred in the post-target region for the focus condition, but not for the non-focus condition, suggesting a complex relationship between focus and newness in the discourse integration stage.     

Psychophysiological components of imagery

McGuigan's neuromuscular model of information processing (1978a, 1978b, and 1989) was investigated by electrically recording eye movements (electro-oculograms), covert lip and preferred arm responses (electromyograms), and electroencephalograms. This model predicts that codes are generated as the lips are uniquely activated when processing words beginning with bilabial sounds like "p" or "b," as is the right arm to words like "pencil" that refer to its use. Twelve adult female participants selected for their high imagery ratings were asked to form images to three orally presented linguistic stimuli: the letter "p," the words "pencil" and "pasture," and to a control stimulus, the words "go blank." The following findings were significant beyond the 0.05 level: an increased covert lip response only to the letter "p," increased vertical eye activity to "p" and to the word "pencil," right arm response only to the word "pencil," and a decreased percentage of alpha waves from the right 02 lead only to the word "pasture." Since these covert responses uniquely occurred during specific imagery processes, it is inferred that they are components of neuromuscular circuits that function in accord with the model of information processing tested.     

Exploring supervised and unsupervised methods to detect topics in biomedical text

Background  

Topic detection is a task that automatically identifies topics (e.g., "biochemistry" and "protein structure") in scientific articles based on information content. Topic detection will benefit many other natural language processing tasks including information retrieval, text summarization and question answering; and is a necessary step towards the building of an information system that provides an efficient way for biologists to seek information from an ocean of literature.     

Integration of function in the nervous system — A new theory

A new theory of synaptic function in the nervous system (Dempsher, 1978) is applied to the simplest system for integration of function in the nervous system. This system includes a sensory and motor neuron and three ‘synaptic’ regions associated with those two neurons; a receptor region, an interneuronal spinal synaptic region linking the two neurons, and an effector region. Information is first received and processed at the receptor region. The processing consists of five components:

1. A highly selective mechanism which allows only that information to enter the receptor system which is appropriate.
2. The ‘appropriateness’ of the information is determined by the alphabet (miniature potentials) already in that area.
3. The information entering the system is assembled in a pattern meaningful for the next processing operation.
4. The assembled information is then ‘disassembled’ into its subunits and mapped into the alphabet (miniature potentials).
5. These miniature potentials are assembled into another pattern meaningful to fit the role of the receptor region.
6. This new pattern is repacked for transit to the central synaptic region.

At the central synaptic region, essentially the same process takes place except here an additional operation takes place which determines its role in the processing system. The incoming information is disassembled into its subunits, mapped into the miniature potentials already there; these are collected together in a meaningful pattern, ‘operated’ on, then repacked for transit to the effector site, where again the same kind of processing sequence takes place. In all three regions, despite the difference in their roles, there are similar processing features:

1. In each region, three forms of the nerve impulse are involved: miniature graded potentials, graded potentials, action potentials.
2. In each region, each component of the process is carried out by a precise mathematical operation: four each in the receptor and effector regions; five in the central synaptic region.

It is suggested that integration of function in the nervous system consists of converting information into energy which is in turn converted into a number. Processing of information at each region then involves mathematical operations applied to these numbers. Function appears to be stereotyped in all three regions. The receptor region receives highly selective and restrictive information so that the universe we ‘perceive’ would appear to be a subset of a much larger universe.     

Dissociated mechanisms of extracting perceptual information into visual working memory

Background

The processing mechanisms of visual working memory (VWM) have been extensively explored in the recent decade. However, how the perceptual information is extracted into VWM remains largely unclear. The current study investigated this issue by testing whether the perceptual information was extracted into VWM via an integrated-object manner so that all the irrelevant information would be extracted (object hypothesis), or via a feature-based manner so that only the target-relevant information would be extracted (feature hypothesis), or via an analogous processing manner as that in visual perception (analogy hypothesis).

Methodology/Principal Findings

High-discriminable information which is processed at the parallel stage of visual perception and fine-grained information which is processed via focal attention were selected as the representatives of perceptual information. The analogy hypothesis predicted that whereas high-discriminable information is extracted into VWM automatically, fine-grained information will be extracted only if it is task-relevant. By manipulating the information type of the irrelevant dimension in a change-detection task, we found that the performance was affected and the ERP component N270 was enhanced if a change between the probe and the memorized stimulus consisted of irrelevant high-discriminable information, but not if it consisted of irrelevant fine-grained information.

Conclusions/Significance

We conclude that dissociated extraction mechanisms exist in VWM for information resolved via dissociated processes in visual perception (at least for the information tested in the current study), supporting the analogy hypothesis.     

Benefits of hierarchical generalization and storage of the representations of "object-place" associations in the hippocampal subfields (a hypothesis)

We analyzed the results of experimental research of features of processing sensory information in the hippocampus and neocortex available in literature and results of modelling the perception of information in the neocortex. It is noted that "place" fields of neurons become wider, and overlapping of receptive fields increases during upward moving in trisynaptic hippocampal pathway. These effects specify the generalization of the information processed. The results of our analysis allow us to put forward a hypothesis that a hierarchical complication of"object - place" associations occurs during upward propagation of signals through all hippocampal subfields. Complexity of neural representations of "object - place" associations that are formed and permanently stored in the hippocampal areas increases in process of propagation of signals from the entorhinal cortex to the hierarchically higher dentate gyrus, area CA3 and area CA1. Therefore, with the aim to extract information about "object - place" associations with certain details it is necessary to access that hippocampal area in which associations were processed and stored with the required degree of elaboration. By analogy with the neocortex, it is proposed that such processing of information in the hippocampus makes it possible to avoid the combinatorial explosion and provides storing (memory) the associations accumulated during the life. The proposed mechanism can serve as an addition to the known multiple trace theory, which states that the hippocampus is an integrating part of memory trace and is always involved in recall of long-delayed episodes.     

Brain oscillations,medium spiny neurons,and dopamine

1. The striatum is part of a multisynaptic loop involved in translating higher order cognitive activity into action. The main striatal computational unit is the medium spiny neuron, which integrates inputs arriving from widely distributed cortical neurons and provides the sole striatal output.2. The membrane potential of medium spiny neurons' displays shifts between a very negative resting state (down state) and depolarizing plateaus (up states) which are driven by the excitatory cortical inputs.3. Because striatal spiny neurons fire action potentials only during the up state, these plateau depolarizations are perceived as enabling events that allow information processing through cerebral cortex – basal ganglia circuits. In vivo intracellular recording techniques allow to investigate simultaneously the subthreshold behavior of the medium spiny neuron membrane potential (which is a reading of distributed patterns of cortical activity) and medium spiny neuron firing (which is an index of striatal output).4. Recent studies combining intracellular recordings of striatal neurons with field potential recordings of the cerebral cortex illustrate how the analysis of the input–output transformations performed by medium spiny neurons may help to unveil some aspects of information processing in cerebral cortex – basal ganglia circuits, and to understand the origin of the clinical manifestations of Parkinson's disease and other neurologic and neuropsychiatric disorders that result from alterations in dopamine-dependent information processing in the cerebral cortex – basal ganglia circuits.     

Effects of aerobic exercise and gender on visual and auditory P300, reaction time, and accuracy

Visual and auditory reaction times (RTs) have been reported to decrease during moderate aerobic exercise, and this has been interpreted as reflecting an exercise-induced activation (EIA) of cognitive information processing. In the present study we examined changes in several independent measures of information processing (RT, accuracy, P300 latency and amplitude) during exercise, and their relationship to visual or auditory modalities and to gender. P300 latencies offer independent measures of cognitive speed that are unrelated to motor output, and P300 amplitudes have been used as measures of attentional allocation. Twenty-four healthy college students [mean (SD) age 20 (2) years] performed auditory and visual "oddball" tasks during resting baseline, aerobic exercise, and recovery periods. Consistent with previous studies, both visual and auditory RTs during exercise were significantly shortened compared to control and recovery periods (which did not differ from each other). We now report that, paralleling the RT changes, auditory and visual P300 latencies decreased during exercise, indicating the occurrence of faster cognitive information processing in both sensory modalities. However, both auditory and visual P300 amplitudes decreased during exercise, suggesting diminished attentional resource allocation. In addition, error rates increased during exercise. Taken together, these results suggest that the enhancement of cognitive information processing speed during moderate aerobic exercise, although operating across genders and sensory modalities, is not a global facilitation of cognition, but is accompanied by decreased attention and increased errors.     

Cerebral activation to intranasal chemosensory trigeminal stimulation

Although numerous functional magnetic resonance imaging (FMRI) studies have been performed on the processing of olfactory information, the intranasal trigeminal system so far has not received much attention. In the present study, we sought to delineate the neural correlates of trigeminal stimulation using carbon dioxide (CO(2)) presented to the left or right nostril. Fifteen right-handed men underwent FMRI using single runs of 3 conditions (CO(2) in the right and the left nostrils and an olfactory stimulant-phenyl ethyl alcohol-in the right nostril). As expected, olfactory activations were located in the orbitofrontal cortex (OFC), amygdala, and rostral insula. For trigeminal stimulation, activations were found in "trigeminal" and "olfactory" regions including the pre- and postcentral gyrus, the cerebellum, the ventrolateral thalamus, the insula, the contralateral piriform cortex, and the OFC. Left compared with right side stimulations resulted in stronger cerebellar and brain stem activations; right versus left stimulation resulted in stronger activations of the superior temporal sulcus and OFC. These results suggest a trigeminal processing system that taps into similar cortical regions and yet is separate from that of the olfactory system. The overlapping pattern of cortical activation for trigeminal and olfactory stimuli is assumed to be due to the intimate connections in the processing of information from the 2 major intranasal chemosensory systems.     

A neuron-inspired computational architecture for spatiotemporal visual processing

In this article, we present a neurologically motivated computational architecture for visual information processing. The computational architecture’s focus lies in multiple strategies: hierarchical processing, parallel and concurrent processing, and modularity. The architecture is modular and expandable in both hardware and software, so that it can also cope with multisensory integrations – making it an ideal tool for validating and applying computational neuroscience models in real time under real-world conditions. We apply our architecture in real time to validate a long-standing biologically inspired visual object recognition model, HMAX. In this context, the overall aim is to supply a humanoid robot with the ability to perceive and understand its environment with a focus on the active aspect of real-time spatiotemporal visual processing. We show that our approach is capable of simulating information processing in the visual cortex in real time and that our entropy-adaptive modification of HMAX has a higher efficiency and classification performance than the standard model (up to \(\sim \!+6\,\% \) ).     

The shift from local to global visual processing in 6-year-old children is associated with grey matter loss

Background

A real-world visual scene consists of local elements (e.g. trees) that are arranged coherently into a global configuration (e.g. a forest). Children show psychological evolution from a preference for local visual information to an adult-like preference for global visual information, with the transition in visual preference occurring around 6 years of age. The brain regions involved in this shift in visual preference have not been described.

Methods and Results

We used voxel-based morphometry (VBM) to study children during this developmental window to investigate changes in gray matter that underlie the shift from a bias for local to global visual information. Six-year-old children were assigned to groups according to their judgment on a global/local task. The first group included children who still presented with local visual processing biases, and the second group included children who showed global visual processing biases. VBM results indicated that compared to children with local visual processing biases, children with global visual processing biases had a loss of gray matter in the right occipital and parietal visuospatial areas.

Conclusions

These anatomical findings are in agreement with previous findings in children with neurodevelopmental disorders and represent the first structural identification of brain regions that allow healthy children to develop a global perception of the visual world.     

A biopolymer transistor: electrical amplification by microtubules

Microtubules (MTs) are important cytoskeletal structures engaged in a number of specific cellular activities, including vesicular traffic, cell cyto-architecture and motility, cell division, and information processing within neuronal processes. MTs have also been implicated in higher neuronal functions, including memory and the emergence of "consciousness". How MTs handle and process electrical information, however, is heretofore unknown. Here we show new electrodynamic properties of MTs. Isolated, taxol-stabilized MTs behave as biomolecular transistors capable of amplifying electrical information. Electrical amplification by MTs can lead to the enhancement of dynamic information, and processivity in neurons can be conceptualized as an "ionic-based" transistor, which may affect, among other known functions, neuronal computational capabilities.     

Spatial modulation of primate inferotemporal responses by eye position

Background

A key aspect of representations for object recognition and scene analysis in the ventral visual stream is the spatial frame of reference, be it a viewer-centered, object-centered, or scene-based coordinate system. Coordinate transforms from retinocentric space to other reference frames involve combining neural visual responses with extraretinal postural information.

Methodology/Principal Findings

We examined whether such spatial information is available to anterior inferotemporal (AIT) neurons in the macaque monkey by measuring the effect of eye position on responses to a set of simple 2D shapes. We report, for the first time, a significant eye position effect in over 40% of recorded neurons with small gaze angle shifts from central fixation. Although eye position modulates responses, it does not change shape selectivity.

Conclusions/Significance

These data demonstrate that spatial information is available in AIT for the representation of objects and scenes within a non-retinocentric frame of reference. More generally, the availability of spatial information in AIT calls into questions the classic dichotomy in visual processing that associates object shape processing with ventral structures such as AIT but places spatial processing in a separate anatomical stream projecting to dorsal structures.     

Can diffuse extrasynaptic signaling form a guiding template?

Brain functions such as information processing, learning and memory are commonly associated with changes in synaptic strength, the synaptic plasticity. Extrasynaptic diffusion of transmitters thought to mediate only a modulatory effect. Here I suggest a hypothesis that concentration profile of signaling molecules in the extracellular space can form a "diffuse guiding template" for signal propagation through neuronal network. Such template can be potentially involved in information processing and storage. This hypothesis requires further experimental investigation and, thus, provides a framework for future studies in the field of non-synaptic transmission in the brain.     

Cells as semantic systems

Background

We consider cells as biological systems that process information by means of molecular codes. Many studies analyze cellular information processing exclusively in syntactic terms (e.g., by measuring Shannon entropy of sets of macromolecules), and abstract completely from semantic aspects that are related to the meaning of molecular information.

Methods

This mini-review focusses on semantic aspects of molecular information, particularly on codes that organize the semantic dimension of molecular information. First, a general conceptual framework for describing molecular information is proposed. Second, some examples of molecular codes are presented. Third, a mathematical approach that makes the identification of molecular codes in reaction networks possible, is developed.

Results

By combining a systematic conceptual framework for describing molecular information and a mathematical approach to identify molecular codes, it is possible to give a formally consistent and empirically adequate model of the code-based semantics of molecular information in cells.

General significance

Research on the semantics of molecular information is of great importance particularly to systems biology since molecular codes embedded in systems of interrelated codes govern main traits of cells. Describing cells as semantic systems may thus trigger new experiments and generate new insights into the fundamental processes of cellular information processing. This article is part of a Special Issue entitled Systems Biology of Microorganisms.     

Experimental and theoretical approaches to conscious processing

Recent experimental studies and theoretical models have begun to address the challenge of establishing a causal link between subjective conscious experience and measurable neuronal activity. The present review focuses on the well-delimited issue of how an external or internal piece of information goes beyond nonconscious processing and gains access to conscious processing, a transition characterized by the existence of a reportable subjective experience. Converging neuroimaging and neurophysiological data, acquired during minimal experimental contrasts between conscious and nonconscious processing, point to objective neural measures of conscious access: late amplification of relevant sensory activity, long-distance cortico-cortical synchronization at beta and gamma frequencies, and "ignition" of a large-scale prefronto-parietal network. We compare these findings to current theoretical models of conscious processing, including the Global Neuronal Workspace (GNW) model according to which conscious access occurs when incoming information is made globally available to multiple brain systems through a network of neurons with long-range axons densely distributed in prefrontal, parieto-temporal, and cingulate cortices. The clinical implications of these results for general anesthesia, coma, vegetative state, and schizophrenia are discussed.     

A simple model of human foveal ganglion cell responses to hyperacuity stimuli

We developed a physiologically plausible model of the first steps of spatial visual information processing in the fovea of the human retina. With the predictions of this model we could support the hypothesis that, for moderate contrasts ( 40%), hyperacuity is mediated by the magnocellular (MC-) pathway. Despite the lower sampling density in the MC pathway, as compared to the parvocellular (PC-) pathway, the information that is transferred by the MC ganglion cells is sufficient to achieve thresholds comparable to those of human subjects in psychophysical tasks. This is a result of the much higher signal-to-noise ratio of the MC pathway cell signals. The PC pathway cells do not transfer enough information for hyperacuity thresholds.