Unveiling functions of the visual cortex using task-specific deep neural networks

The human visual cortex enables visual perception through a cascade of hierarchical computations in cortical regions with distinct functionalities. Here, we introduce an AI-driven approach to discover the functional mapping of the visual cortex. We related human brain responses to scene images measured with functional MRI (fMRI) systematically to a diverse set of deep neural networks (DNNs) optimized to perform different scene perception tasks. We found a structured mapping between DNN tasks and brain regions along the ventral and dorsal visual streams. Low-level visual tasks mapped onto early brain regions, 3-dimensional scene perception tasks mapped onto the dorsal stream, and semantic tasks mapped onto the ventral stream. This mapping was of high fidelity, with more than 60% of the explainable variance in nine key regions being explained. Together, our results provide a novel functional mapping of the human visual cortex and demonstrate the power of the computational approach.     

The reflection of compensation processes in the structure of the EEG spatial-temporal relationships in patients with disordered brain regulatory mechanisms]

Studies of intercentral relations of electrical activity in the cerebral cortex of the patients with hypophysis tumours under the conditions of chronic (before operation) and acute (after tumour ablation, early post-operative period) influence of the focus on the regulatory brain systems allowed to reveal definite changes of spectral-coherent EEG characteristics, reflecting the functional state of the cerebral adaptive-compensatory apparatus. It has been shown that reciprocal character of changes of various forms of the brain electrical activity and their intercentral relations is one of manifestations of development of the processes of cerebral compensation. At the same time, global fall of the EEG intercentral relations indicating the disintegration of the cerebral functional connections, reflects a loss of CNS compensatory mechanisms. The revealed EEG-characteristics at the present time are applied in Burdenko Institute of Neurosurgery for diagnostic-prognostic estimation of the brain functional state in patients during pre- and post-operative period.     

The interaction of perception and attention at different stages in individual development

In the study carried out on children aged 10 years (51 persons), subjects aged 16-17 (11) and adults (19) characteristics of the perception and attention interaction were studied by means of electrophysiological parameters analysis (ERP, CNV, EEG) of the process of solution of various visual tasks. It has been shown that adequate brain provision of this process is based in adults both on the functional topographic differentiation and specialization of separate perceptive operations and on the possibility of controlling generalized and local activating influences according to task requirements. In children aged 10, not differing from the adults by the success of the perceptive activity, age peculiarities of its strategy are revealed connected with functional brain organization. Basic distinctive features of children perceptive activity are intensified regional specificity manifested both in responses to relevant and non-relevant stimuli, and excessive generalized activation testifying to incomplete structural-functional maturation of the frontal regions of the cerebral cortex. Increasing functional activity of these structures in ontogenesis provides for the selectivity of perceptive, cognitive and activating processes, adequate to the requirements of the task.     

Psychophysiological and neurophysiological features of the organization of visuo-spatial performance in right-handed and left-handed six- to seven-year-old children

The developmental features of individual components of the visual perception and brain functional organization during visuo-spatial activity of different complexity were studied in right-handed and left-handed 6–7-year-old children. The results of psychophysiological testing of their visual perception testify to the underdevelopment of the mechanisms of integrative brain activity. Some specific features of the brain functional organization were revealed in the left-handed children during visuo-spatial performance. More autonomous functioning of the cerebral hemispheres and the duplication of the activation processes in the right and left hemisphere during visuo-spaital performance of different complexity are characteristic of these children. This is probably associated with the involvement of compensatory mechanisms, which enable the performance reliability.     

The regional cerebral blood flow pattern of the normal human brain and its factor structure

The regional cerebral blood flow (rCBF) pattern of the normal human brain was drawn, and its structure was studied. Relative rCBF estimates for 66 regions of interest (cerebral anatomical-functional areas) were obtained using positron emission tomography in 158 healthy subjects aged 18–49 years. The rCBF rate variation range was 89–121% of the rCBF rate averaged over all regions of interest, taken as 100%. The rCBF rates were the highest (>115%) in the paracentral lobule, precuneus, insular cortex, primary visual cortex, and Broca’s area and the lowest (<95%) in the mediobasal regions of the temporal gyri and caudate nuclei. Analysis of the factor structure of the resultant pattern made it possible to classify cerebral anatomical-functional areas according to a predominant effect of one of the following factors on the interdependence between rCBF rates: (1) cytoarchitectonic characteristics; (2) the functional state of the cortex during quiet wakefulness; or (3) the brain vascular region to which the area belongs. The obtained pattern should be taken into account in both mapping of the functions of a normal brain and clinical diagnosis.     

Age-related specificity of the frontal and temporoparietal cortex activation levels in three-to seven-year-old children

The results of studies on the specificity of formation of the frontal and temporoparietal cortex activation levels in children aged three, four to five, and six to seven years with a normal development of higher mental functions and speech are summarized. The parameters of the stable millivolt-range potential recorded from the head surface were used for this purpose. The results obtained are compared with published data on the specificity of the morphological and functional organization of the brain and the level of development of the slow information control system estimated on the basis of EEG parameters at the same ages. The estimation of the contribution of the brain superslow information control system by one of the basic parameters of state makes it possible to determine, in quantitative terms, (1) the characteristics of the formation of activation levels of cerebral systems involved in the regulation of the resting state, higher mental functions, and speech at different stages of ontogeny; (2) (on the basis of the stable-potential variance) the degrees of freedom of the activation levels of the cerebral systems studied, which determine their regulatory capacity at different ages; and (3) the degree of development of the system-forming mechanisms combining all these systems into an integrated whole at a certain stage of ontogeny (from six to seven years of age).     

Linking visual perception with human brain activity.

The past year has seen great advances in the use of functional magnetic resonance imaging (fMRI) to study the functional organization of the human visual cortex, to measure the neuronal correlates of visual perception, and to test computational theories of vision. Activity in particular visual brain areas, as measured with fMRI, has been found to correlate with psychophysical performance, with visual attention, and with subjective perceptual experience.     

Concurrent TMS-fMRI and psychophysics reveal frontal influences on human retinotopic visual cortex

BACKGROUND: Regions in human frontal cortex may have modulatory top-down influences on retinotopic visual cortex, but to date neuroimaging methods have only been able to provide indirect evidence for such functional interactions between remote but interconnected brain regions. Here we combined transcranial magnetic stimulation (TMS) with concurrent functional magnetic resonance imaging (fMRI), plus psychophysics, to show that stimulation of the right human frontal eye-field (FEF) produced a characteristic topographic pattern of activity changes in retinotopic visual areas V1-V4, with functional consequences for visual perception. RESULTS: FEF TMS led to activity increases for retinotopic representations of the peripheral visual field, but to activity decreases for the central field, in areas V1-V4. These frontal influences on visual cortex occurred in a top-down manner, independently of visual input. TMS of a control site (vertex) did not elicit such visual modulations, and saccades, blinks, or pupil dilation could not account for our results. Finally, the effects of FEF TMS on activity in retinotopic visual cortex led to a behavioral prediction that we confirmed psychophysically by showing that TMS of the frontal site (again compared with vertex) enhanced perceived contrast for peripheral relative to central visual stimuli. CONCLUSIONS: Our results provide causal evidence that circuits originating in the human FEF can modulate activity in retinotopic visual cortex, in a manner that differentiates the central and peripheral visual field, with functional consequences for perception. More generally, our study illustrates how the new approach of concurrent TMS-fMRI can now reveal causal interactions between remote but interconnected areas of the human brain.     

Behavioral detection of electrical microstimulation in different cortical visual areas

The extent to which areas in the visual cerebral cortex differ in their ability to support perceptions has been the subject of considerable speculation. Experiments examining the activity of individual neurons have suggested that activity in later stages of the visual cortex is more closely linked to perception than that in earlier stages [1-9]. In contrast, results from functional imaging, transcranial magnetic stimulation, and lesion studies have been interpreted as showing that earlier stages are more closely coupled to perception [10-15]. We examined whether neuronal activity in early and later stages differs in its ability to support detectable signals by measuring behavioral thresholds for detecting electrical microstimulation in different cortical areas in two monkeys. By training the animals to perform a two-alternative temporal forced-choice task, we obtained criterion-free thresholds from five visual areas--V1, V2, V3A, MT, and the inferotemporal cortex. Every site tested yielded a reliable threshold. Thresholds varied little within and between visual areas, rising gradually from early to later stages. We similarly found no systematic differences in the slopes of the psychometric detection functions from different areas. These results suggest that neuronal signals of similar magnitude evoked in any part of visual cortex can generate percepts.     

Regulation of oxygen transport during brain activation: stimulus-induced hemodynamic responses in human and animal cortices

BACKGROUND: The correlation between regional changes in neuronal activity and changes in hemodynamics is a major issue for noninvasive neuroimaging techniques such as functional magnetic resonance imaging (fMRI) and near-infrared optical imaging (NIOI). A tight coupling of these changes has been assumed to elucidate brain function from data obtained with those techniques. In the present study, we investigated the relationship between neuronal activity and hemodynamic responses in the occipital cortex of humans during visual stimulation and in the somatosensory cortex of rats during peripheral nerve stimulation. METHODS: The temporal frequency dependence of macroscopic hemodynamic responses on visual stimuli was investigated in the occipital cortex of humans by simultaneous measurements made using fMRI and NIOI. The stimulus-intensity dependence of both microscopic hemodynamic changes and changes in neuronal activity in response to peripheral nerve stimulation was investigated in animal models by analyzing membrane potential (fluorescence), hemodynamic parameters (visible spectra and laser-Doppler flowmetry), and vessel diameter (image analyzer). RESULTS: Above a certain level of stimulus-intensity, increases in regional cerebral blood flow (rCBF) were accompanied by a decrease in regional cerebral blood volume (rCBV), i.e., dissociation of rCBF and rCBV responses occurred in both the human and animal experiments. Furthermore, the animal experiments revealed that the distribution of increased rCBF and O2 spread well beyond the area of neuronal activation, and that the increases showed saturation in the activated area. CONCLUSIONS: These results suggest that above a certain level of neuronal activity, a regulatory mechanism between regional cerebral blood flow (rCBF) and rCBV acts to prevent excess O2 inflow into the focally activated area.     

Electrical Neuroimaging Reveals Timing of Attentional Control Activity in Human Brain

Voluntarily shifting attention to a location of the visual field improves the perception of events that occur there. Regions of frontal cortex are thought to provide the top-down control signal that initiates a shift of attention, but because of the temporal limitations of functional brain imaging, the timing and sequence of attentional-control operations remain unknown. We used a new analytical technique (beamformer spatial filtering) to reconstruct the anatomical sources of low-frequency brain waves in humans associated with attentional control across time. Following a signal to shift attention, control activity was seen in parietal cortex 100–200 ms before activity was seen in frontal cortex. Parietal cortex was then reactivated prior to anticipatory biasing of activity in occipital cortex. The magnitudes of early parietal activations were strongly predictive of the degree of attentional improvement in perceptual performance. These results show that parietal cortex, not frontal cortex, provides the initial signals to shift attention and indicate that top-down attentional control is not purely top down.     

A common cortical substrate activated by horizontal and vertical sound movement in the human brain

Perception of movement in acoustic space depends on comparison of the sound waveforms reaching the two ears (binaural cues) as well as spectrotemporal analysis of the waveform at each ear (monaural cues). The relative importance of these two cues is different for perception of vertical or horizontal motion, with spectrotemporal analysis likely to be more important for perceiving vertical shifts. In humans, functional imaging studies have shown that sound movement in the horizontal plane activates brain areas distinct from the primary auditory cortex, in parietal and frontal lobes and in the planum temporale. However, no previous work has examined activations for vertical sound movement. It is therefore difficult to generalize previous imaging studies, based on horizontal movement only, to multidimensional auditory space perception. Using externalized virtual-space sounds in a functional magnetic resonance imaging (fMRI) paradigm to investigate this, we compared vertical and horizontal shifts in sound location. A common bilateral network of brain areas was activated in response to both horizontal and vertical sound movement. This included the planum temporale, superior parietal cortex, and premotor cortex. Sounds perceived laterally in virtual space were associated with contralateral activation of the auditory cortex. These results demonstrate that sound movement in vertical and horizontal dimensions engages a common processing network in the human cerebral cortex and show that multidimensional spatial properties of sounds are processed at this level.     

Choline acetyltransferase activity and total protein content in selected optic areas of the rat after complete light-deprivation during CNS development

Choline acetyltransferase (acetyl-CoA: choline O-acetyltransferase, I.U.B. 2.3.1.6) activity and total protein content in visual and extra-visual areas were compared in normal Long-Evans rats and in rats subjected to complete light-deprivation for 21 days from birth. The enzyme activity and the protein content in the superior colliculi, lateral geniculate bodies and visual cortex, as well as in the sensory-motor cortex, hypothalamus, brain stem and cerebellum, were measured in both mothers and progeny. By means of a radiochemical technique modified in this laboratory, a significant decline of ChAc activity was observed in the lateral geniculate bodies and superior colliculi, with no significant decline in the visual cortex of the experimental progeny. Total protein content, measured colorimetrically, was significantly decreased in the superior colliculi of the progeny. The biochemical data obtained from all other brain areas in the experimental animals (progeny and mothers) and controls demonstrated no marked differences. The enzymic alterations observed in the cholinergic system of progeny after complete light-deprivation during this critical period of CNS development can be specifically correlated with decreased functional maturation of the visual system. If it is accepted that ACh is a neuro-transmitter in some parts of the visual pathway, the data presented here suggest that complete light-deprivation from birth to 21 days of age in the rat has an effect on a biochemical system involved in synaptic transmission.     

Formation of the System of Visual Perception in Ontogeny

Structural, electrophysiological, and behavioral evidence characterizing the specific features of the visual perception at different stages of ontogeny is considered. The main tendency of the formation of the mature type of the brain organization of the visual system is traced from local sensory reactions to active cognitive perception. The formation of the mature type of the organization of the visual perception is largely determined by the involvement of gradually maturing frontal areas. These areas, involved in the processing of sensory-specific information via pathways descending to deep regulatory structures and other cortical areas, provide for a selective dynamic organization of the visual perception system, which functions depending on the specific perceptive task.     

The effects of neck flexion on cerebral potentials evoked by visual,auditory and somatosensory stimuli and focal brain blood flow in related sensory cortices

Background

A flexed neck posture leads to non-specific activation of the brain. Sensory evoked cerebral potentials and focal brain blood flow have been used to evaluate the activation of the sensory cortex. We investigated the effects of a flexed neck posture on the cerebral potentials evoked by visual, auditory and somatosensory stimuli and focal brain blood flow in the related sensory cortices.

Methods

Twelve healthy young adults received right visual hemi-field, binaural auditory and left median nerve stimuli while sitting with the neck in a resting and flexed (20° flexion) position. Sensory evoked potentials were recorded from the right occipital region, Cz in accordance with the international 10–20 system, and 2 cm posterior from C4, during visual, auditory and somatosensory stimulations. The oxidative-hemoglobin concentration was measured in the respective sensory cortex using near-infrared spectroscopy.

Results

Latencies of the late component of all sensory evoked potentials significantly shortened, and the amplitude of auditory evoked potentials increased when the neck was in a flexed position. Oxidative-hemoglobin concentrations in the left and right visual cortices were higher during visual stimulation in the flexed neck position. The left visual cortex is responsible for receiving the visual information. In addition, oxidative-hemoglobin concentrations in the bilateral auditory cortex during auditory stimulation, and in the right somatosensory cortex during somatosensory stimulation, were higher in the flexed neck position.

Conclusions

Visual, auditory and somatosensory pathways were activated by neck flexion. The sensory cortices were selectively activated, reflecting the modalities in sensory projection to the cerebral cortex and inter-hemispheric connections.     

Appearance of parvalbumin-specific immunoreactivity in the cerebral cortex and hippocampus of the developing rat and gerbil brain

Summary Developmental changes in the distribution of parvalbumin-specific immunoreactivity in the brain, in particular in the cerebral cortex and hippocampus, were followed immunohistochemically in two different species, the rat and the Mongolian gerbil (Meriones unguiculatus) using an antibody raised against for rat parvalbumin. The gerbil is known to develop its auditory and visual capacity later than rat. In both the rat and gerbil, parvalbumin-specific immunoreactivity appeared after birth in both the cerebral cortex and hippocampus. The timing of the development of expression of parvalbumin varied among different parts of the cerebral cortex. The parietal cortex showed evidence of the earliest expression of parvalbumin whilst the occipital and temporal cortices expressed parvalbumin at a later stage of a development. This feature was common to both the rat and gerbil but occurred at a relatively later stage in the gerbil. The profile of the distribution of parvalbumin in the brain of the developing and adult gerbil was similar to that of the rat, but there were some differences. The frequency of bead-like structures on the dendrites of the parvalbumin-positive cells in the CA1 region of the hippocampus was markedly lower in the gerbil; instead, straight non-beaded fibers which ran vertically into the pyramidal layer were stained. Parvalbumin-positive fibers were also found in the cerebral cortex of the gerbil.     

Appearance of parvalbumin-specific immunoreactivity in the cerebral cortex and hippocampus of the developing rat and gerbil brain

Developmental changes in the distribution of parvalbumin-specific immunoreactivity in the brain, in particular in the cerebral cortex and hippocampus, were followed immunohistochemically in two different species, the rat and the Mongolian gerbil (Meriones unguiculatus) using an antibody raised against for rat parvalbumin. The gerbil is known to develop its auditory and visual capacity later than rat. In both the rat and gerbil, parvalbumin-specific immunoreactivity appeared after birth in both the cerebral cortex and hippocampus. The timing of the development of expression of parvalbumin varied among different parts of the cerebral cortex. The parietal cortex showed evidence of the earliest expression of parvalbumin whilst the occipital and temporal cortices expressed parvalbumin at a later stage of a development. This feature was common to both the rat and gerbil but occurred at a relatively later stage in the gerbil. The profile of the distribution of parvalbumin in the brain of the developing and adult gerbil was similar to that of the rat, but there were some differences. The frequency of bead-like structures on the dendrites of the parvalbumin-positive cells in the CA1 region of the hippocampus was markedly lower in the gerbil; instead, straight non-beaded fibers which ran vertically into the pyramidal layer were stained. Parvalbumin-positive fibers were also found in the cerebral cortex of the gerbil.     

The role of cerebral regulatory structures in the formation of human EEG

This article generalizes the results of many years’ studies of the EEG of patients with tumorous lesions in the diencephalic, brainstem, and limbic structures, which fulfill the regulatory function in ensuring integral brain activity. The specific features of the inclusion of individual structures under investigation in the organization of the intra- and interhemispheric relations of cortical biopotentials were demonstrated against the background of diffuse changes in the biopotentials that reflect the systemic character of neurodynamic reorganizations when the regulatory brain structures are involved in the pathological process. This study expands the idea of the predominant functional connection of the diencephalic structures with the right hemisphere and brainstem structures with the left one with determination of the regional specific features of changes in the intrahemispheric EEG coherences. The distinguishing features of intercentral relations when the limbic structures are involved in the pathological process show similarity with the neurodynamic reorganizations in patients with lesions in both diencephalic and (even more so) brainstem structures. Universal elements were detected in the formation of integral adaptive reactions of the brain with lesions in its regulatory structures, which reflects their close functional interaction and makes it possible to consider them the individual links of an integral regulatory system. The study revealed reciprocal changes in various forms of electrical activity, which reflects reciprocation of interaction of individual regulatory structures. This is one of the EEG equivalents of the formation of adaptive-compensatory cerebral reactions. The specificity of influence of the studied regulatory structures are clearly seen in situations of their morphofunctional isolation observed during cerebral coma. In these conditions, when the cortex is functionally inactive, the authors demonstrated the dynamic character of changes in interhemispheric asymmetry, which reflects the dominance of individual links of the regulatory system playing the role of supreme regulator of life support of the body in critical states.     

Taurine in the developing cat: Uptake and release in different brain areas

Taurine is an important modulator of neuronal activity in the immature brain. In kittens, taurine deficiency causes serious dysfunction in the cerebellar and cerebral visual cortex. The processes of taurine transport in vitro were now studied for the first time in different brain areas in developing and adult cats. The uptake of taurine consisted initially of two saturable components, high- and low-affinity, in synaptosomal preparations from the developing cerebral cortex and cerebellum, but the high-affinity uptake component completely disappeared during maturation. The release of both endogenous and preloaded labeled taurine from brain slices measured in a superfusion system was severalfold stimulated with a slow onset by depolarizing K⁺ (50 mM) concentrations. K⁺ stimulation released markedly more taurine from the cerebral cortex, cerebellum and brain stem in kittens than in adult cats. The responses were largest in the cerebellum. Both uptake and release of taurine are thus highly efficient in the brain of kittens and may be of significance in view of the vulnerability of cats to taurine deficiency.     

Our Faces in the Dog's Brain: Functional Imaging Reveals Temporal Cortex Activation during Perception of Human Faces

Dogs have a rich social relationship with humans. One fundamental aspect of it is how dogs pay close attention to human faces in order to guide their behavior, for example, by recognizing their owner and his/her emotional state using visual cues. It is well known that humans have specific brain regions for the processing of other human faces, yet it is unclear how dogs’ brains process human faces. For this reason, our study focuses on describing the brain correlates of perception of human faces in dogs using functional magnetic resonance imaging (fMRI). We trained seven domestic dogs to remain awake, still and unrestrained inside an MRI scanner. We used a visual stimulation paradigm with block design to compare activity elicited by human faces against everyday objects. Brain activity related to the perception of faces changed significantly in several brain regions, but mainly in the bilateral temporal cortex. The opposite contrast (i.e., everyday objects against human faces) showed no significant brain activity change. The temporal cortex is part of the ventral visual pathway, and our results are consistent with reports in other species like primates and sheep, that suggest a high degree of evolutionary conservation of this pathway for face processing. This study introduces the temporal cortex as candidate to process human faces, a pillar of social cognition in dogs.