Neuronal processing delays are compensated in the sensorimotor branch of the visual system

Moving objects change their position until signals from the photoreceptors arrive in the visual cortex. Nonetheless, motor responses to moving objects are accurate and do not lag behind the real-world position. The questions are how and where neural delays are compensated for. It was suggested that compensation is achieved within the visual system by extrapolating the position of moving objects. A visual illusion supports this idea: when a briefly flashed object is presented in the same position as a moving object, it appears to lag behind. However, moving objects do not appear ahead of their final or reversal points. We investigated a situation where participants localized the final position of a moving stimulus. Visual perception and short-term memory of the final target position were accurate, but reaching movements were directed toward future positions of the target beyond the vanishing point. Our results show that neuronal latencies are not compensated for at early stages of visual processing, but at a late stage when retinotopic information is transformed into egocentric space used for motor responses. The sensorimotor system extrapolates the position of moving targets to allow for precise localization of moving targets despite neuronal latencies.     

Simulation of Neuronal Responses Defining Depth Order and Contrast Polarity at Illusory Contours in Monkey Area V2

Neurophysiological, brain imaging, and perceptual studies in animals and humans suggest that illusory (occluding) contours are represented at an early level of visual cortical processing. Comparatively little is known about the mechanisms defining the depth order and the brightness illusion associated with such contours. Baumann et al. (1997) found neurons in area V2 of the alert monkey that signaled not only illusory contours but also the figure-ground direction that human observers perceive at such contours. The majority of these neurons showed this property independent stimulus contrast; a small minority preferred a certain combination of figure-ground direction and contrast polarity at these contours. In this article, we simulate the responses of these neurons by means of a grouping mechanism that uses occlusion cues (line-ends, corners) to define figure-ground direction and contrast polarity at such contours.     

The "Flash-Lag" effect occurs in audition and cross-modally

In 1958 MacKay showed that a rigidly moving object becomes visually fragmented when part of it is continuously visible but the rest is illuminated intermittently. For example, the glowing tip of a lit cigarette moving under stroboscopic illumination appeared to move ahead of the intermittently lit body. Latterly rediscovered as "the flash-lag effect" (FLE), this illusion now is typically demonstrated on a computer monitor showing two spots of light, one translating across the screen and another briefly flashed in vertical alignment with it. Despite being physically aligned, the brief flash is seen to lag behind the moving spot. This effect has recently motivated much fruitful research, prompting a variety of potential explanations, including those based on motion extrapolation, differential latency, attention, postdiction, and temporal integration (for review, see ). With no consensus on which theory is most plausible, we have broadened the scope of enquiry to include audition and have found that the FLE is not confined to vision. Whether the auditory motion stimulus is a frequency sweep or a translating sound source, briefly presented auditory stimuli lag behind auditory movement. In addition, when we used spatial motion, we found that the FLE can occur cross-modally. Together, these findings challenge several FLE theories and point to a discrepancy between internal brain timing and external stimulus timing.     

Analogous mechanisms compensate for neural delays in the sensory and the motor pathways: evidence from motor flash-lag

Motor behaviors require animals to coordinate neural activity across different areas within their motor system. In particular, the significant processing delays within the motor system must somehow be compensated for. Internal models of the motor system, in particular the forward model, have emerged as important potential mechanisms for compensation. For motor responses directed at moving visual objects, there is, additionally, a problem of delays within the sensory pathways carrying crucial position information. The visual phenomenon known as the flash-lag effect has led to a motion-extrapolation model for compensation of sensory delays. In the flash-lag effect, observers see a flashed item colocalized with a moving item as lagging behind the moving item. Here, we explore the possibility that the internal forward model and the motion-extrapolation model are analogous mechanisms compensating for neural delays in the motor and the visual system, respectively. In total darkness, observers moved their right hand gripping a rod while a visual flash was presented at various positions in relation to the rod. When the flash was aligned with the rod, observers perceived it in a position lagging behind the instantaneous felt position of the invisible rod. These results suggest that compensation of neural delays for time-varying motor behavior parallels compensation of delays for time-varying visual stimulation.     

Functional magnetic resonance imaging of awake behaving macaques

In recent years, more and more laboratories have developed functional Magnetic Resonance Imaging (fMRI) for awake non-human primates. This research is essential to provide a link between non-invasive hemodynamic signals recorded in the human brain and the vast body of knowledge gained from invasive electrophysiological studies in monkeys. Given that their brain structure is so closely related to that of humans and that monkeys can be trained to perform complicated behavioral tasks, results obtained with monkey fMRI and electrophysiology can be compared to fMRI results obtained in humans, and provide information crucial to a better understanding of the mechanisms by which different cortical areas perform their functions in the human brain. However, despite that the first publications on fMRI in awake behaving macaques appeared ～10 years ago (Logothetis et al. (1999) [1], Stefanacci et al. (1998) [2], Dubowitz et al. (1998) [3]), relatively few laboratories perform such experiments routinely, a sign of the significant technical difficulties that must be overcome. The higher spatial resolution required because of the animal’s smaller brain results in poorer signal-to-noise ratios than in human fMRI, which is further compounded by problems due to animal motion. Here, we discuss the specific challenges and benefits of fMRI in the awake monkey and review the methodologies and strategies for scanning behaving macaques.     

Audio-Visual Detection Benefits in the Rat

Human psychophysical studies have described multisensory perceptual benefits such as enhanced detection rates and faster reaction times in great detail. However, the neural circuits and mechanism underlying multisensory integration remain difficult to study in the primate brain. While rodents offer the advantage of a range of experimental methodologies to study the neural basis of multisensory processing, rodent studies are still limited due to the small number of available multisensory protocols. We here demonstrate the feasibility of an audio-visual stimulus detection task for rats, in which the animals detect lateralized uni- and multi-sensory stimuli in a two-response forced choice paradigm. We show that animals reliably learn and perform this task. Reaction times were significantly faster and behavioral performance levels higher in multisensory compared to unisensory conditions. This benefit was strongest for dim visual targets, in agreement with classical patterns of multisensory integration, and was specific to task-informative sounds, while uninformative sounds speeded reaction times with little costs for detection performance. Importantly, multisensory benefits for stimulus detection and reaction times appeared at different levels of task proficiency and training experience, suggesting distinct mechanisms inducing these two multisensory benefits. Our results demonstrate behavioral multisensory enhancement in rats in analogy to behavioral patterns known from other species, such as humans. In addition, our paradigm enriches the set of behavioral tasks on which future studies can rely, for example to combine behavioral measurements with imaging or pharmacological studies in the behaving animal or to study changes of integration properties in disease models.     

An Auditory Illusion of Infinite Tempo Change Based on Multiple Temporal Levels

Humans and a few select insect and reptile species synchronise inter-individual behaviour without any time lag by predicting the time of future events rather than reacting to them. This is evident in music performance, dance, and drill. Although repetition of equal time intervals (i.e. isochrony) is the central principle for such prediction, this simple information is used in a flexible and complex way that accommodates both multiples, subdivisions, and gradual changes of intervals. The scope of this flexibility remains largely uncharted, and the underlying mechanisms are a matter for speculation. Here I report an auditory illusion that highlights some aspects of this behaviour and that provides a powerful tool for its future study. A sound pattern is described that affords multiple alternative and concurrent rates of recurrence (temporal levels). An algorithm that systematically controls time intervals and the relative loudness among these levels creates an illusion that the perceived rate speeds up or slows down infinitely. Human participants synchronised hand movements with their perceived rate of events, and exhibited a change in their movement rate that was several times larger than the physical change in the sound pattern. The illusion demonstrates the duality between the external signal and the internal predictive process, such that people''s tendency to follow their own subjective pulse overrides the overall properties of the stimulus pattern. Furthermore, accurate synchronisation with sounds separated by more than 8 s demonstrate that multiple temporal levels are employed for facilitating temporal organisation and integration by the human brain. A number of applications of the illusion and the stimulus pattern are suggested.     

A statistical analyzer for optic nerve messages

A statistical mathematical model of the discharge in a single optic nerve fiber is proposed, based on a discharge with intervals between impulses distributed independently according to a gamma distribution ("gamma discharge"). A light stimulus distorts the time axis of this discharge according to a "frequency function" which is characteristic of the stimulus. A linear filter is described which calculates the likelihood of a certain stimulus when the nerve fiber message is fed into it. This filter forms the basis of theoretical nerve message analyzers for three visual experiments: (a) The detection of the occurrence of a flash of light of known intensity and time of occurrence, (b) the detection of the time of occurrence of a flash of known intensity, and (c) The estimation of the intensity of a flash occurring at a known time. Possible neural mechanisms in the brain for analyzing optic nerve messages, based on the above mathematical models, are suggested. Changes of excitability or discharge frequency correspond to the output of the likelihood filter. Any such mechanism must be sufficiently plastic to have a response matched to each expected stimuus for most efficient vision near threshold.     

Neural Correlates of Illusory Line Motion

Illusory line motion (ILM) refers to a motion illusion in which a flash at one end of a bar prior to the bar''s instantaneous presentation or removal results in the percept of motion. While some theories attribute the origin of ILM to attention or early perceptual mechanisms, others have proposed that ILM results from impletion mechanisms that reinterpret the static bar as one in motion. The current functional magnetic resonance imaging study examined participants while they made decisions about the direction of motion in which a bar appeared to be removed. Preceding the instantaneous removal of the bar with a flash at one end resulted in a motion percept away from the flash. If this flash and the bar''s removal overlapped in time, it appeared that the bar was removed towards the flash (reverse ILM). Independent of the motion type, brain responses indicated activations in areas associated with motion (MT+), endogenous and exogenous attention (intraparietal sulcus, frontal eye fields, and ventral frontal cortex), and response selection (ACC). ILM was associated with lower percept scores and higher activations in ACC relative to real motion, but no differences in shape-selective areas emerged. This pattern of brain activation is consistent with the attentional gradient model or bottom-up accounts of ILM in preference to impletion.     

Seeing more than meets the eye: processing of illusory contours in animals

This review article illustrates that mammals, birds and insects are able to perceive illusory contours. Illusory contours lack a physical counterpart, but monkeys, cats, owls and bees perceive them as if they were real borders. In all of these species, a neural correlate for such perceptual completion phenomena has been described. The robustness of neuronal responses and the abundance of cells argue that such neurons might indeed represent a neural correlate for illusory contour perception. The internal state of an animal subject (i.e., alert and behaving) seems to be an important factor when correlating neural activity with perceptual phenomena. The fact that the neural network necessary for illusory contour perception has been found in relatively early visual brain areas in all tested animals suggests that bottom-up processing is largely sufficient to explain such perceptual abilities. However, recent findings in monkeys indicate that feedback loops within the visual system may provide additional modulation. The detection of illusory contours by independently evolved visual systems argues that processing of edges in the absence of contrast gradients reflects fundamental visual constraints and not just an artifact of visual processing.     

Study of sound localization by owls and its relevance to humans

Human psychoacoustical studies have been the main sources of information from which the brain mechanisms of sound localization are inferred. The value of animal models would be limited, if humans and the animals did not share the same perceptual experience and the neural mechanisms for it. Barn owls and humans use the same method of computing interaural time differences for localization in the horizontal plane. The behavioral performance of owls and its neural bases are consistent with some of the theories developed for human sound localization. Neural theories of sound localization largely owe their origin to the study of sound localization by humans, even though little is known about the physiological properties of the human auditory system. One of these ideas is binaural cross-correlation which assumes that the human brain performs a process similar to mathematical cross-correlation to measure the interaural time difference for localization in the horizontal plane. The most complete set of neural evidence for this theory comes from the study of sound localization and its brain mechanisms in barn owls, although partial support is also available from studies on laboratory mammals. Animal models of human sensory perception make two implicit assumptions; animals and humans experience the same percept and the same neural mechanism underlies the creation of the percept. These assumptions are hard to prove for obvious reason. This article reviews several lines of evidence that similar neural mechanisms must underlie the perception of sound locations in humans and owls.     

A computational model for the modulation of the prepulse inhibition of the acoustic startle reflex

The acoustic startle reflex (ASR), a defensive response, is a contraction of the skeletal and facial muscles in response to an abrupt, intense (> 80 db) auditory stimulus, which has been extensively studied in rats and humans. Prepulse inhibition (PPI) of ASR is the normal suppression of the startle reflex when an intense stimulus is preceded by a weak non-starting pre-stimulus. PPI, a measure of sensory motor gating, is impaired in various neuropsychiatric disorders, including schizophrenia, and is modulated by cognitive and emotional contexts such as fear and attention. We have modeled the fear modulation of PPI of ASR based on its anatomical substrates and taking into account data from behaving rats and humans. The model replicates the principal features of both phenomena and predicts underlying neural mechanisms. In addition, the model yields testable predictions.     

Grey matter volume in early human visual cortex predicts proneness to the sound-induced flash illusion

Visual perception can be modulated by sounds. A drastic example of this is the sound-induced flash illusion: when a single flash is accompanied by two bleeps, it is sometimes perceived in an illusory fashion as two consecutive flashes. However, there are strong individual differences in proneness to this illusion. Some participants experience the illusion on almost every trial, whereas others almost never do. We investigated whether such individual differences in proneness to the sound-induced flash illusion were reflected in structural differences in brain regions whose activity is modulated by the illusion. We found that individual differences in proneness to the illusion were strongly and significantly correlated with local grey matter volume in early retinotopic visual cortex. Participants with smaller early visual cortices were more prone to the illusion. We propose that strength of auditory influences on visual perception is determined by individual differences in recurrent connections, cross-modal attention and/or optimal weighting of sensory channels.     

How Long Depends on How Fast—Perceived Flicker Dilates Subjective Duration

How do humans perceive the passage of time and the duration of events without a dedicated sensory system for timing? Previous studies have demonstrated that when a stimulus changes over time, its duration is subjectively dilated, indicating that duration judgments are based on the number of changes within an interval. In this study, we tested predictions derived from three different accounts describing the relation between a changing stimulus and its subjective duration as either based on (1) the objective rate of changes of the stimulus, (2) the perceived saliency of the changes, or (3) the neural energy expended in processing the stimulus. We used visual stimuli flickering at different frequencies (4–166 Hz) to study how the number of changes affects subjective duration. To this end, we assessed the subjective duration of these stimuli and measured participants'' behavioral flicker fusion threshold (the highest frequency perceived as flicker), as well as their threshold for a frequency-specific neural response to the flicker using EEG. We found that only consciously perceived flicker dilated perceived duration, such that a 2 s long stimulus flickering at 4 Hz was perceived as lasting as long as a 2.7 s steady stimulus. This effect was most pronounced at the slowest flicker frequencies, at which participants reported the most consistent flicker perception. Flicker frequencies higher than the flicker fusion threshold did not affect perceived duration at all, even if they evoked a significant frequency-specific neural response. In sum, our findings indicate that time perception in the peri-second range is driven by the subjective saliency of the stimulus'' temporal features rather than the objective rate of stimulus changes or the neural response to the changes.     

Illusion susceptibility in domestic dogs

Domestic dogs play many vital roles in human lives; however, relatively little is known about how they perceive the world visually. Given dogs’ recent popularity as a subject in cognitive and behavioural studies, it is important to understand how they visually interpret the world around them. One way to evaluate perception is to assess illusion susceptibility; specifically, how visual information is processed, interpreted and modified post-retinally. While illusion susceptibility has been used across a variety of species to comparatively assess the similarities and differences in visual processing and perception, this relatively novel methodological approach has only recently been adapted to evaluate perception in domestic dogs. Here, we present a comprehensive overview of the findings from studies that have evaluated domestic dogs’ illusion susceptibility, highlighting the relevance of these results for those studying illusion susceptibility in animals as well as canine behaviour and cognition. More specifically, the ultimate goal of this review is to answer the questions: (a) Are dogs susceptible to visual illusions? (b) If so, are they susceptible to illusions in a way that parallels humans and/or other animals? (c) Are findings, within dogs, consistent and if not, how might these be interpreted and explained?     

Olfactory perceptual decision-making is biased by motivational state

Growing evidence suggests that internal factors influence how we perceive the world. However, it remains unclear whether and how motivational states, such as hunger and satiety, regulate perceptual decision-making in the olfactory domain. Here, we developed a novel behavioral task involving mixtures of food and nonfood odors (i.e., cinnamon bun and cedar; pizza and pine) to assess olfactory perceptual decision-making in humans. Participants completed the task before and after eating a meal that matched one of the food odors, allowing us to compare perception of meal-matched and non-matched odors across fasted and sated states. We found that participants were less likely to perceive meal-matched, but not non-matched, odors as food dominant in the sated state. Moreover, functional magnetic resonance imaging (fMRI) data revealed neural changes that paralleled these behavioral effects. Namely, odor-evoked fMRI responses in olfactory/limbic brain regions were altered after the meal, such that neural patterns for meal-matched odor pairs were less discriminable and less food-like than their non-matched counterparts. Our findings demonstrate that olfactory perceptual decision-making is biased by motivational state in an odor-specific manner and highlight a potential brain mechanism underlying this adaptive behavior.

Growing evidence suggests that internal factors influence how we perceive the world; this study shows that food intake influences how humans perceive food odors, such as the scent of cinnamon buns. This effect is specific to meal-matched odors, and is paralleled by changes in odor-evoked brain activity.     

Complex functions of the brain

Over the course of the last 50 years it has been possible to solve a number of basic problems in neurobiology. Interest is now turning more and more to problems concerning so-called “higherρ brain functions, including cognition. Examples from the visual system in primates are presented. First relatively elementary problems are illustrated, such as how long it takes to perceive an object or to respond to a stimulus or combinations of stimuli. Top-down modification of perception by expectation is demonstrated in an illusion of misdirected gaze. Interdisciplinary questions straddling the sciences and the humanities are also approached, such as which part of the brain mediates conscious perception. Finally, the problem of causality and freedom of will is addressed, taking into account the knowledge accumulated in the neurosciences during the last 5 decades.     

Fragment-based learning of visual object categories in non-human primates

When we perceive a visual object, we implicitly or explicitly associate it with an object category we know. Recent research has shown that the visual system can use local, informative image fragments of a given object, rather than the whole object, to classify it into a familiar category. We have previously reported, using human psychophysical studies, that when subjects learn new object categories using whole objects, they incidentally learn informative fragments, even when not required to do so. However, the neuronal mechanisms by which we acquire and use informative fragments, as well as category knowledge itself, have remained unclear. Here we describe the methods by which we adapted the relevant human psychophysical methods to awake, behaving monkeys and replicated key previous psychophysical results. This establishes awake, behaving monkeys as a useful system for future neurophysiological studies not only of informative fragments in particular, but also of object categorization and category learning in general.     

Hippocampus: cognitive processes and neural representations that underlie declarative memory

The hippocampus serves a critical role in declarative memory--our capacity to recall everyday facts and events. Recent studies using functional brain imaging in humans and neuropsychological analyses of humans and animals with hippocampal damage have revealed some of the elemental cognitive processes mediated by the hippocampus. In addition, recent characterizations of neuronal firing patterns in behaving animals and humans have suggested how neural representations in the hippocampus underlie those elemental cognitive processes in the service of declarative memory.     

Expression of freezing and fear‐potentiated startle during sustained fear in mice

Fear‐potentiated acoustic startle paradigms have been used to investigate phasic and sustained components of conditioned fear in rats and humans. This study describes a novel training protocol to assess phasic and sustained fear in freely behaving C57BL/6J mice, using freezing and/or fear‐potentiated startle as measures of fear, thereby, if needed, allowing in vivo application of various techniques, such as optogenetics, electrophysiology and pharmacological intervention, in freely behaving animals. An auditory Pavlovian fear conditioning paradigm, with pseudo‐randomized conditioned–unconditioned stimulus presentations at various durations, is combined with repetitive brief auditory white noise burst presentations during fear memory retrieval 24 h after fear conditioning. Major findings are that (1) a motion sensitive platform built on mechano‐electrical transducers enables measurement of startle responses in freely behaving mice, (2) absence or presence of startle stimuli during retrieval as well as unpredictability of a given threat determine phasic and sustained fear response profiles and (3) both freezing and startle responses indicate phasic and sustained components of behavioral fear, with sustained freezing reflecting unpredictability of conditioned stimulus (CS)/unconditioned stimulus (US) pairings. This paradigm and available genetically modified mouse lines will pave the way for investigation of the molecular and neural mechanisms relating to the transition from phasic to sustained fear.