Visual perception and imagery: A new molecular hypothesis

Here, we put forward a redox molecular hypothesis about the natural biophysical substrate of visual perception and visual imagery. This hypothesis is based on the redox and bioluminescent processes of neuronal cells in retinotopically organized cytochrome oxidase-rich visual areas. Our hypothesis is in line with the functional roles of reactive oxygen and nitrogen species in living cells that are not part of haphazard process, but rather a very strict mechanism used in signaling pathways. We point out that there is a direct relationship between neuronal activity and the biophoton emission process in the brain. Electrical and biochemical processes in the brain represent sensory information from the external world. During encoding or retrieval of information, electrical signals of neurons can be converted into synchronized biophoton signals by bioluminescent radical and non-radical processes. Therefore, information in the brain appears not only as an electrical (chemical) signal but also as a regulated biophoton (weak optical) signal inside neurons.     

Phosphene phenomenon: a new concept

This paper proposes a new biopsychophysical concept of phosphene phenomenon. Namely, visual sensation of phosphenes is due to the intrinsic perception of ultraweak bioluminescent photon emission of cells in the visual system. In other words, phosphenes are bioluminescent biophotons in the visual system induced by various stimuli (mechanical, electrical, magnetic, ionizing radiation, etc.) as well as random bioluminescent biophotons firings of cells in the visual pathway. This biophoton emission can become conscious if induced or spontaneous biophoton emission of cells in the visual system exceeds a distinct threshold. Neuronal biophoton communication can occur by means of non-visual neuronal opsins and natural photosensitive biomolecules. Our interpretation is in direct connection with the functional roles of free radicals and excited biomolecules in living cells.     

Picture representation during REM dreams: A redox molecular hypothesis

A novel molecular hypothesis about visual perception and imagery has recently been proposed (Bókkon, 2009; BioSystems). Namely, external electromagnetic visible photons are converted into electrical signals in the retina and are then conveyed to V1. Next, these retinotopic electrical signals (spike-related electrical signals along classical axonal-dendritic pathways) can be converted into synchronized bioluminescent biophoton signals (inside the neurons) by neurocellular radical reactions (redox processes) in retinotopically organized V1 mitochondrial cytochrome oxidase-rich visual areas. The bioluminescent photonic signals (inside the neurons) generated by neurocellular redox/radical reactions in synchronized V1 neurons make it possible to produce computational biophysical pictures during visual perception and imagery. Our hypothesis is in line with the functional roles of reactive oxygen and nitrogen species in living cells and states that this is not a random process, but rather a strict mechanism used in signaling pathways. Here, we suggest that intrinsic biophysical pictures can also emerge during REM dreams.     

Sounds reset rhythms of visual cortex and corresponding human visual perception

An event in one sensory modality can phase reset brain oscillations concerning another modality. In principle, this may result in stimulus-locked periodicity in behavioral performance. Here we considered this possible cross-modal impact of a sound for one of the best-characterized rhythms arising from the visual system, namely occipital alpha-oscillations (8-14 Hz). We presented brief sounds and concurrently recorded electroencephalography (EEG) and/or probed visual cortex excitability (phosphene perception) through occipital transcranial magnetic stimulation (TMS). In a first, TMS-only experiment, phosphene perception rate against time postsound showed a periodic pattern cycling at ~10 Hz phase-aligned to the sound. In a second, combined TMS-EEG experiment, TMS-trials reproduced the cyclical phosphene pattern and revealed a ~10 Hz pattern also for EEG-derived measures of occipital cortex reactivity to the TMS pulses. Crucially, EEG-data from intermingled trials without TMS established cross-modal phase-locking of occipitoparietal alpha oscillations. These independently recorded variables, i.e., occipital cortex excitability and reactivity and EEG phase dynamics, were significantly correlated. This shows that cross-modal phase locking of oscillatory visual cortex activity can arise in the human brain to affect perceptual and EEG measures of visual processing in a cyclical manner, consistent with occipital alpha oscillations underlying a rapid cycling of neural excitability in visual areas.     

Negative BOLD differentiates visual imagery and perception

Recent studies emphasize the overlap between the neural substrates of visual perception and visual imagery. However, the subjective experiences of imagining and seeing are clearly different. Here we demonstrate that deactivation of auditory cortex (and to some extent of somatosensory and subcortical visual structures) as measured by BOLD functional magnetic resonance imaging unequivocally differentiates visual imagery from visual perception. During visual imagery, auditory cortex deactivation negatively correlates with activation in visual cortex and with the score in the subjective vividness of visual imagery questionnaire (VVIQ). Perception of the world requires the merging of multisensory information so that, during seeing, information from other sensory systems modifies visual cortical activity and shapes experience. We suggest that pure visual imagery corresponds to the isolated activation of visual cortical areas with concurrent deactivation of "irrelevant" sensory processing that could disrupt the image created by our "mind's eye."     

Spatial attention changes excitability of human visual cortex to direct stimulation

Conscious perception depends not only on sensory input, but also on attention [1, 2]. Recent studies in monkeys [3-6] and humans [7-12] suggest that influences of spatial attention on visual awareness may reflect top-down influences on excitability of visual cortex. Here we tested this specifically, by providing direct input into human visual cortex via cortical transcranial magnetic stimulation (TMS) to produce illusory visual percepts, called phosphenes. We found that a lower TMS intensity was needed to elicit a conscious phosphene when its apparent spatial location was attended, rather than unattended. Our results indicate that spatial attention can enhance visual-cortex excitability, and visual awareness, even when sensory signals from the eye via the thalamic pathway are bypassed.     

Neural correlates of visual motion prediction

Predicting the trajectories of moving objects in our surroundings is important for many life scenarios, such as driving, walking, reaching, hunting and combat. We determined human subjects' performance and task-related brain activity in a motion trajectory prediction task. The task required spatial and motion working memory as well as the ability to extrapolate motion information in time to predict future object locations. We showed that the neural circuits associated with motion prediction included frontal, parietal and insular cortex, as well as the thalamus and the visual cortex. Interestingly, deactivation of many of these regions seemed to be more closely related to task performance. The differential activity during motion prediction vs. direct observation was also correlated with task performance. The neural networks involved in our visual motion prediction task are significantly different from those that underlie visual motion memory and imagery. Our results set the stage for the examination of the effects of deficiencies in these networks, such as those caused by aging and mental disorders, on visual motion prediction and its consequences on mobility related daily activities.     

Behavioral detection of electrical microstimulation in different cortical visual areas

The extent to which areas in the visual cerebral cortex differ in their ability to support perceptions has been the subject of considerable speculation. Experiments examining the activity of individual neurons have suggested that activity in later stages of the visual cortex is more closely linked to perception than that in earlier stages [1-9]. In contrast, results from functional imaging, transcranial magnetic stimulation, and lesion studies have been interpreted as showing that earlier stages are more closely coupled to perception [10-15]. We examined whether neuronal activity in early and later stages differs in its ability to support detectable signals by measuring behavioral thresholds for detecting electrical microstimulation in different cortical areas in two monkeys. By training the animals to perform a two-alternative temporal forced-choice task, we obtained criterion-free thresholds from five visual areas--V1, V2, V3A, MT, and the inferotemporal cortex. Every site tested yielded a reliable threshold. Thresholds varied little within and between visual areas, rising gradually from early to later stages. We similarly found no systematic differences in the slopes of the psychometric detection functions from different areas. These results suggest that neuronal signals of similar magnitude evoked in any part of visual cortex can generate percepts.     

Implications on visual apperception: Energy, duration, structure and synchronization

Although primary visual cortex (V1 or striate) activity per se is not sufficient for visual apperception (normal conscious visual experiences and conscious functions such as detection, discrimination, and recognition), the same is also true for extrastriate visual areas (such as V2, V3, V4/V8/VO, V5/M5/MST, IT, and GF). In the lack of V1 area, visual signals can still reach several extrastriate parts but appear incapable of generating normal conscious visual experiences. It is scarcely emphasized in the scientific literature that conscious perceptions and representations must have also essential energetic conditions. These energetic conditions are achieved by spatiotemporal networks of dynamic mitochondrial distributions inside neurons. However, the highest density of neurons in neocortex (number of neurons per degree of visual angle) devoted to representing the visual field is found in retinotopic V1. It means that the highest mitochondrial (energetic) activity can be achieved in mitochondrial cytochrome oxidase-rich V1 areas. Thus, V1 bear the highest energy allocation for visual representation.In addition, the conscious perceptions also demand structural conditions, presence of adequate duration of information representation, and synchronized neural processes and/or ‘interactive hierarchical structuralism.’ For visual apperception, various visual areas are involved depending on context such as stimulus characteristics such as color, form/shape, motion, and other features. Here, we focus primarily on V1 where specific mitochondrial-rich retinotopic structures are found; we will concisely discuss V2 where smaller riches of these structures are found. We also point out that residual brain states are not fully reflected in active neural patterns after visual perception. Namely, after visual perception, subliminal residual states are not being reflected in passive neural recording techniques, but require active stimulation to be revealed.     

Distributed neural systems for the generation of visual images

Visual perception of houses, faces, and chairs evoke differential responses in ventral temporal cortex. Using fMRI, we compared activations evoked by perception and imagery of these object categories. We found content-related activation during imagery in extrastriate cortex, but this activity was restricted to small subsets of the regions that showed category-related activation during perception. Within ventral temporal cortex, activation during imagery evoked stronger responses on the left whereas perception evoked stronger responses on the right. Additionally, visual imagery evoked activity in parietal and frontal cortex, but this activity was not content related. These results suggest that content-related activation during imagery in visual extrastriate cortex may be implemented by "top-down" mechanisms in parietal and frontal cortex that mediate the retrieval of face and object representations from long-term memory and their maintenance through visual imagery.     

Properties of biophotons and their theoretical implications

The word "biophotons" is used to denote a permanent spontaneous photon emission from all living systems. It displays a few up to some hundred photons/(s x cm2) within the spectral range from at least 260 to 800 nm. It is closely linked to delayed luminescence (DL) of biological tissues which describes the long term and ultra weak reemission of photons after exposure to light illumination. During relaxation DL turns continuously into the steady state biophoton emission, where both, DL and biophoton emission exhibit mode coupling over the entire spectrum and a Poissonian photo count distribution. DL is representing excited states of the biophoton field. The physical properties indicate that biophotons originate from fully coherent and sometimes even squeezed states. The physical analysis provides thermodynamic and quantum optical interpretation, in order to understand the biological impacts of biophotons. Biological phenomena like intracellular and intercellular communication, cell growth and differentiation, interactions among biological systems (like "Gestaltbildung" or swarming), and microbial infections can be understood in terms of biophotons. "Biophotonics", the corresponding field of applications, provide a new powerful tool for assessing the quality of food (like freshness and shelf life), microbial infections, environmental influences and for substantiating medical diagnosis and therapy.     

Enhanced cortical excitability in grapheme-color synesthesia and its modulation

Synesthesia is an unusual condition characterized by the over-binding of two or more features and the concomitant automatic and conscious experience of atypical, ancillary images or perceptions. Previous research suggests that synesthetes display enhanced modality-specific perceptual processing, but it remains unclear whether enhanced processing contributes to conscious awareness of color photisms. In three experiments, we investigated whether grapheme-color synesthesia is characterized by enhanced cortical excitability in primary visual cortex and the role played by this hyperexcitability in the expression of synesthesia. Using transcranial magnetic stimulation, we show that synesthetes display 3-fold lower phosphene thresholds than controls during stimulation of the primary visual cortex. We next used transcranial direct current stimulation to discriminate between two competing hypotheses of the role of hyperexcitability in the expression of synesthesia. We demonstrate that synesthesia can be selectively augmented with cathodal stimulation and attenuated with anodal stimulation of primary visual cortex. A control task revealed that the effect of the brain stimulation was specific to the experience of synesthesia. These results indicate that hyperexcitability acts as a source of noise in visual cortex that influences the availability of the neuronal signals underlying conscious awareness of synesthetic photisms.     

Why do imagery and perception look and feel so different?

Despite the past few decades of research providing convincing evidence of the similarities in function and neural mechanisms between imagery and perception, for most of us, the experience of the two are undeniably different, why? Here, we review and discuss the differences between imagery and perception and the possible underlying causes of these differences, from function to neural mechanisms. Specifically, we discuss the directional flow of information (top-down versus bottom-up), the differences in targeted cortical layers in primary visual cortex and possible different neural mechanisms of modulation versus excitation. For the first time in history, neuroscience is beginning to shed light on this long-held mystery of why imagery and perception look and feel so different.This article is part of the theme issue ‘Offline perception: voluntary and spontaneous perceptual experiences without matching external stimulation''.     

Imagine Jane and identify John: face identity aftereffects induced by imagined faces

It is not known whether prolonged exposure to perceived and imagined complex visual images produces similar shifts in subsequent perception through selective adaptation. This question is important because a positive finding would suggest that perception and imagery of visual stimuli are mediated by shared neural networks. In this study, we used a selective adaptation procedure designed to induce high-level face-identity aftereffects--a phenomenon in which extended exposure to a particular face facilitates recognition of subsequent faces with opposite features while impairing recognition of all other faces. We report here that adaptation to either real or imagined faces produces a similar shift in perception and that identity boundaries represented in real and imagined faces are equivalent. Together, our results show that identity information contained in imagined and real faces produce similar behavioral outcomes. Our findings of high-level visual aftereffects induced by imagined stimuli can be taken as evidence for the involvement of shared neural networks that mediate perception and imagery of complex visual stimuli.     

Unveiling functions of the visual cortex using task-specific deep neural networks

The human visual cortex enables visual perception through a cascade of hierarchical computations in cortical regions with distinct functionalities. Here, we introduce an AI-driven approach to discover the functional mapping of the visual cortex. We related human brain responses to scene images measured with functional MRI (fMRI) systematically to a diverse set of deep neural networks (DNNs) optimized to perform different scene perception tasks. We found a structured mapping between DNN tasks and brain regions along the ventral and dorsal visual streams. Low-level visual tasks mapped onto early brain regions, 3-dimensional scene perception tasks mapped onto the dorsal stream, and semantic tasks mapped onto the ventral stream. This mapping was of high fidelity, with more than 60% of the explainable variance in nine key regions being explained. Together, our results provide a novel functional mapping of the human visual cortex and demonstrate the power of the computational approach.     

Primary visual cortex and visual awareness

The primary visual cortex (V1) is probably the best characterized area of primate cortex, but whether this region contributes directly to conscious visual experience is controversial. Early neurophysiological and neuroimaging studies found that visual awareness was best correlated with neural activity in extrastriate visual areas, but recent studies have found similarly powerful effects in V1. Lesion and inactivation studies have provided further evidence that V1 might be necessary for conscious perception. Whereas hierarchical models propose that damage to V1 simply disrupts the flow of information to extrastriate areas that are crucial for awareness, interactive models propose that recurrent connections between V1 and higher areas form functional circuits that support awareness. Further investigation into V1 and its interactions with higher areas might uncover fundamental aspects of the neural basis of visual awareness.     

Characterization of visual percepts evoked by noninvasive stimulation of the human posterior parietal cortex

Phosphenes are commonly evoked by transcranial magnetic stimulation (TMS) to study the functional organization, connectivity, and excitability of the human visual brain. For years, phosphenes have been documented only from stimulating early visual areas (V1-V3) and a handful of specialized visual regions (V4, V5/MT+) in occipital cortex. Recently, phosphenes were reported after applying TMS to a region of posterior parietal cortex involved in the top-down modulation of visuo-spatial processing. In the present study, we systematically characterized parietal phosphenes to determine if they are generated directly by local mechanisms or emerge through indirect activation of other visual areas. Using technology developed in-house to record the subjective features of phosphenes, we found no systematic differences in the size, shape, location, or frame-of-reference of parietal phosphenes when compared to their occipital counterparts. In a second experiment, discrete deactivation by 1 Hz repetitive TMS yielded a double dissociation: phosphene thresholds increased at the deactivated site without producing a corresponding change at the non-deactivated location. Overall, the commonalities of parietal and occipital phosphenes, and our ability to independently modulate their excitability thresholds, lead us to conclude that they share a common neural basis that is separate from either of the stimulated regions.     

Cerebral visual motion blindness: transitory akinetopsia induced by transcranial magnetic stimulation of human area V5.

The perception of visual motion can be selectively and reversibly compromised by transcranial magnetic stimulation (TMS) of a small region of cortex, roughly 1 cm in diameter and corresponding in position to human area V5. The reversible inactivation of a small and specialized visual area which receives its predominant input from area V1 and sends a powerful return (re-entrant) input back to it allowed us to study for the first time the backward influence of area V5 on area V1. In contrast to the complete and temporary visual motion blindness which occurs during stimulation of V5, a less-prominent interference with the perception of visual motion occurs at 70-80 ms after the onset of the visual stimulus when TMS is applied to V1. Because V5 is critical for the perception of coherent motion, and because an intact re-entry of signals from V5 to V1 is essential for the conscious perception of visual motion, the results obtained with stimulation of V1 must be caused by a disruption of the re-entrant signals from V5 to V1.     

Neural representation of visual objects: encoding and top-down activation

Knowledge or experiences are voluntarily recalled from memory by reactivation of their neural representations in the association cortex. Mnemonic representations of visual objects, located in the ventral processing stream of visual perception, provide the best indication of how neuronal codes are created, organized and reactivated. Associative codes are created by neurons that have the ability to link the representations of temporally associated stimuli. Recent experiments suggest that not only bottom-up signals from the retina but also top-down signals from the prefrontal cortex can trigger the retrieval of associative codes, which may serve as a neural basis for conscious recall.     

Increase of Universality in Human Brain during Mental Imagery from Visual Perception

Background

Different complex systems behave in a similar way near their critical points of phase transitions which leads to an emergence of a universal scaling behaviour. Universality indirectly implies a long-range correlation between constituent subsystems. As the distributed correlated processing is a hallmark of higher complex cognition, I investigated a measure of universality in human brain during perception and mental imagery of complex real-life visual object like visual art.

Methodology/Principal Findings

A new method was presented to estimate the strength of hidden universal structure in a multivariate data set. In this study, I investigated this method in the electrical activities (electroencephalogram signals) of human brain during complex cognition. Two broad groups - artists and non-artists - were studied during the encoding (perception) and retrieval (mental imagery) phases of actual paintings. Universal structure was found to be stronger in visual imagery than in visual perception, and this difference was stronger in artists than in non-artists. Further, this effect was found to be largest in the theta band oscillations and over the prefrontal regions bilaterally.

Conclusions/Significance

Phase transition like dynamics was observed in the electrical activities of human brain during complex cognitive processing, and closeness to phase transition was higher in mental imagery than in real perception. Further, the effect of long-term training on the universal scaling was also demonstrated.