Chasing a dummy target: smooth pursuit and velocity control in male blowflies

Male blowflies chase and catch other flies in fast acrobatic flights. To unravel the underlying control system, we presented a black moving sphere instead of a real fly as a pursuit target. By varying the size and speed of the target, we were able to systematically analyse the decisive visual determinants that guide chasing behaviour. Flies pursue targets of a wide range of sizes and velocities. The percentage of pursuits resulting in target capture decreases with increasing target size and speed. Chasing male flies adjust their forward velocity depending on the retinal size of the target, indicating that retinal size is a relevant input variable of the control system. The chasing fly focuses the target with great accuracy in the frontal part of its visual field by means of a smooth pursuit control system using the retinal position of the target to determine the flight direction. We conclude that for a comprehensive understanding of chasing control different time lags in the control systems of angular and forward velocity together with the impact of inertia on fly movements need to be taken into account.     

Steering a virtual blowfly: simulation of visual pursuit

The behavioural repertoire of male flies includes visually guided chasing after moving targets. The visuomotor control system for these pursuits belongs to the fastest found in the animal kingdom. We simulated a virtual fly, to test whether or not experimentally established hypotheses on the underlying control system are sufficient to explain chasing behaviour. Two operating instructions for steering the chasing virtual fly were derived from behavioural experiments: (i) the retinal size of the target controls the fly's forward speed and, thus, indirectly its distance to the target; and (ii) a smooth pursuit system uses the retinal position of the target to regulate the fly's flight direction. Low-pass filters implement neuronal processing time. Treating the virtual fly as a point mass, its kinematics are modelled in consideration of the effects of translatory inertia and air friction. Despite its simplicity, the model shows behaviour similar to that of real flies. Depending on its starting position and orientation as well as on target size and speed, the virtual fly either catches the target or follows it indefinitely without capture. These two behavioural modes of the virtual fly emerge from the control system for flight steering without implementation of an explicit decision maker.     

Tuning Properties of MT and MSTd and Divisive Interactions for Eye-Movement Compensation

The primate brain intelligently processes visual information from the world as the eyes move constantly. The brain must take into account visual motion induced by eye movements, so that visual information about the outside world can be recovered. Certain neurons in the dorsal part of monkey medial superior temporal area (MSTd) play an important role in integrating information about eye movements and visual motion. When a monkey tracks a moving target with its eyes, these neurons respond to visual motion as well as to smooth pursuit eye movements. Furthermore, the responses of some MSTd neurons to the motion of objects in the world are very similar during pursuit and during fixation, even though the visual information on the retina is altered by the pursuit eye movement. We call these neurons compensatory pursuit neurons. In this study we develop a computational model of MSTd compensatory pursuit neurons based on physiological data from single unit studies. Our model MSTd neurons can simulate the velocity tuning of monkey MSTd neurons. The model MSTd neurons also show the pursuit compensation property. We find that pursuit compensation can be achieved by divisive interaction between signals coding eye movements and signals coding visual motion. The model generates two implications that can be tested in future experiments: (1) compensatory pursuit neurons in MSTd should have the same direction preference for pursuit and retinal visual motion; (2) there should be non-compensatory pursuit neurons that show opposite preferred directions of pursuit and retinal visual motion.     

Visual BOLD Response in Late Blind Subjects with Argus II Retinal Prosthesis

Retinal prosthesis technologies require that the visual system downstream of the retinal circuitry be capable of transmitting and elaborating visual signals. We studied the capability of plastic remodeling in late blind subjects implanted with the Argus II Retinal Prosthesis with psychophysics and functional MRI (fMRI). After surgery, six out of seven retinitis pigmentosa (RP) blind subjects were able to detect high-contrast stimuli using the prosthetic implant. However, direction discrimination to contrast modulated stimuli remained at chance level in all of them. No subject showed any improvement of contrast sensitivity in either eye when not using the Argus II. Before the implant, the Blood Oxygenation Level Dependent (BOLD) activity in V1 and the lateral geniculate nucleus (LGN) was very weak or absent. Surprisingly, after prolonged use of Argus II, BOLD responses to visual input were enhanced. This is, to our knowledge, the first study tracking the neural changes of visual areas in patients after retinal implant, revealing a capacity to respond to restored visual input even after years of deprivation.     

The influence of structured visual backgrounds on smooth-pursuit initiation,steady-state pursuit and smooth-pursuit termination

 Smooth-pursuit eye movements were recorded in two rhesus monkeys in order to compare the influence of structured visual backgrounds on smooth-pursuit initiation, steady-state pursuit and pursuit termination. Different target trajectories were used in order to study smooth-pursuit initiation and termination. The influence of visual backgrounds on pursuit initiation was characterized by recording ocular responses elicited by step-ramp target displacements starting from straight ahead. Pursuit termination was characterized by analysing the transition from steady-state smooth-pursuit to fixation when a centripetally directed target ramp was terminated by a small target step in the direction of the ramp as soon as the target had come close to the straightahead position. The quantification of steady-state pursuit was based on ocular responses elicited by either paradigm. In accordance with previous work, we found that the onset of smooth-pursuit eye movements was delayed and initial eye acceleration reduced in the presence of a structured visual background. Likewise, mean eye velocity during steady-state pursuit was reduced by structured visual backgrounds. However, neither the latency nor the time course of smooth-pursuit termination was altered when the homogeneous background was replaced by a structured visual background. The lack of sensitivity of pursuit termination to the presence of visual structured backgrounds supports a previous contention that pursuit termination is mediated by a process which is different from the ones mediating smooth-pursuit initiation and steady-state pursuit. The absence of any noticeable effect of structured backgrounds on pursuit termination suggests that at least the fast component of the optokinetic reflex is suppressed during pursuit termination. Received: 24 October 1994/Accepted in revised form: 16 December 1994     

Melanopsin contributions to irradiance coding in the thalamo-cortical visual system

Photoreception in the mammalian retina is not restricted to rods and cones but extends to a subset of retinal ganglion cells expressing the photopigment melanopsin (mRGCs). These mRGCs are known to drive such reflex light responses as circadian photoentrainment and pupillomotor movements. By contrast, until now there has been no direct assessment of their contribution to conventional visual pathways. Here, we address this deficit. Using new reporter lines, we show that mRGC projections are much more extensive than previously thought and extend across the dorsal lateral geniculate nucleus (dLGN), origin of thalamo-cortical projection neurons. We continue to show that this input supports extensive physiological light responses in the dLGN and visual cortex in mice lacking rods+cones (a model of advanced retinal degeneration). Moreover, using chromatic stimuli to isolate melanopsin-derived responses in mice with an intact visual system, we reveal strong melanopsin input to the ～40% of neurons in the LGN that show sustained activation to a light step. We demonstrate that this melanopsin input supports irradiance-dependent increases in the firing rate of these neurons. The implication that melanopsin is required to accurately encode stimulus irradiance is confirmed using melanopsin knockout mice. Our data establish melanopsin-based photoreception as a significant source of sensory input to the thalamo-cortical visual system, providing unique irradiance information and allowing visual responses to be retained even in the absence of rods+cones. These findings identify mRGCs as a potential origin for aspects of visual perception and indicate that they may support vision in people suffering retinal degeneration.     

Which retinal and extra-retinal information is crucial for circular vection?

In contradistinction to conventional wisdom, we propose that retinal image slip of a visual scene (optokinetic pattern, OP) does not constitute the only crucial input for visually induced percepts of self-motion (vection). Instead, the hypothesis is investigated that there are three input factors: 1) OP retinal image slip, 2) motion of the ocular orbital shadows across the retinae, and 3) smooth pursuit eye movements (efference copy). To test this hypothesis, we visually induced percepts of sinusoidal rotatory self-motion (circular vection, CV) in the absence of vestibular stimulation. Subjects were presented with three concurrent stimuli: a large visual OP, a fixation point to be pursued with the eyes (both projected in superposition on a semi-circular screen), and a dark window frame placed close to the eyes to create artificial visual field boundaries that simulate ocular orbital rim boundary shadows, but which could be moved across the retinae independent from eye movements. In different combinations these stimuli were independently moved or kept stationary. When moved together (horizontally and sinusoidally around the subject's head), they did so in precise temporal synchrony at 0.05 Hz. The results show that the occurrence of CV requires retinal slip of the OP and/or relative motion between the orbital boundary shadows and the OP. On the other hand, CV does not develop when the two retinal slip signals equal each other (no relative motion) and concur with pursuit eye movements (as it is the case, e.g., when we follow with the eyes the motion of a target on a stationary visual scene). The findings were formalized in terms of a simulation model. In the model two signals coding relative motion between OP and head are fused and fed into the mechanism for CV, a visuo-oculomotor one, derived from OP retinal slip and eye movement efference copy, and a purely visual signal of relative motion between the orbital rims (head) and the OP. The latter signal is also used, together with a version of the oculomotor efference copy, for a mechanism that suppresses CV at a later stage of processing in conditions in which the retinal slip signals are self-generated by smooth pursuit eye movements.     

Perisaccadic Remapping and Rescaling of Visual Responses in Macaque Superior Colliculus

Visual neurons have spatial receptive fields that encode the positions of objects relative to the fovea. Because foveate animals execute frequent saccadic eye movements, this position information is constantly changing, even though the visual world is generally stationary. Interestingly, visual receptive fields in many brain regions have been found to exhibit changes in strength, size, or position around the time of each saccade, and these changes have often been suggested to be involved in the maintenance of perceptual stability. Crucial to the circuitry underlying perisaccadic changes in visual receptive fields is the superior colliculus (SC), a brainstem structure responsible for integrating visual and oculomotor signals. In this work we have studied the time-course of receptive field changes in the SC. We find that the distribution of the latencies of SC responses to stimuli placed outside the fixation receptive field is bimodal: The first mode is comprised of early responses that are temporally locked to the onset of the visual probe stimulus and stronger for probes placed closer to the classical receptive field. We suggest that such responses are therefore consistent with a perisaccadic rescaling, or enhancement, of weak visual responses within a fixed spatial receptive field. The second mode is more similar to the remapping that has been reported in the cortex, as responses are time-locked to saccade onset and stronger for stimuli placed in the postsaccadic receptive field location. We suggest that these two temporal phases of spatial updating may represent different sources of input to the SC.     

Complex predictive eye pursuit in monkey: a model system for cerebellar studies of skilled movement

Smooth pursuit eye movements provide a good model system for cerebellar studies of complex motor control in monkeys. First, the pursuit system exhibits predictive control along complex trajectories and this control improves with training. Second, the flocculus/paraflocculus region of the cerebellum appears to generate this control. Lesions impair pursuit and neural activity patterns are closely related to eye motion during complex pursuit. Importantly, neural responses lead eye motion during predictive pursuit and lag eye motion during non-predictable target motions that require visual control. The idea that flocculus/paraflocculus predictive control is non-visual is also supported by a lack of correlation between neural activity and retinal image motion during pursuit. Third, biologically accurate neural network models of the flocculus/paraflocculus allow the exploration and testing of pursuit mechanisms. Our current model can generate predictive control without visual input in a manner that is compatible with the extensive experimental data available for this cerebellar system. Similar types of non-visual cerebellar control are likely to facilitate the wide range of other skilled movements that are observed.     

Expansion of direction space around the cardinal axes revealed by smooth pursuit eye movements

It is well established that perceptual direction discrimination shows an oblique effect; thresholds are higher for motion along diagonal directions than for motion along cardinal directions. Here, we compare simultaneous direction judgments and pursuit responses for the same motion stimuli and find that both pursuit and perceptual thresholds show similar anisotropies. The pursuit oblique effect is robust under a wide range of experimental manipulations, being largely resistant to changes in trajectory (radial versus tangential motion), speed (10 versus 25 deg/s), directional uncertainty (blocked versus randomly interleaved), and cognitive state (tracking alone versus concurrent tracking and perceptual tasks). Our data show that the pursuit oblique effect is caused by an effective expansion of direction space surrounding the cardinal directions and the requisite compression of space for other directions. This expansion suggests that the directions around the cardinal directions are in some way overrepresented in the visual cortical pathways that drive both smooth pursuit and perception.     

Crizotinib-Induced Abnormal Signal Processing in the Retina

Molecular target therapy for cancer is characterized by unique adverse effects that are not usually observed with cytotoxic chemotherapy. For example, the anaplastic lymphoma kinase (ALK)-tyrosine kinase inhibitor crizotinib causes characteristic visual disturbances, whereas such effects are rare when another ALK-tyrosine kinase inhibitor, alectinib, is used. To elucidate the mechanism responsible for these visual disturbances, the responses to light exhibited by retinal ganglion cells treated with these agents were evaluated using a C57BL6 mouse ex vivo model. Both crizotinib and alectinib changed the firing rate of ON and OFF type retinal ganglion cells. However, the ratio of alectinib-affected cells (15.7%) was significantly lower than that of crizotinib-affected cells (38.6%). Furthermore, these drugs changed the response properties to light stimuli of retinal ganglion cells in some of the affected cells, i.e., OFF cells responded to both ON and OFF stimuli, etc. Finally, the expressions of ALK (a target receptor of both crizotinib and alectinib) and of MET and ROS1 (additional target receptors of crizotinib) were observed at the mRNA level in the retina. Our findings suggest that these drugs might target retinal ganglion cells and that the potency of the drug actions on the light responses of retinal ganglion cells might be responsible for the difference in the frequencies of visual disturbances observed between patients treated with crizotinib and those treated with alectinib. The present experimental system might be useful for screening new molecular target agents prior to their use in clinical trials.     

Blocking Retinal Chloride Co-Transporters KCC2 and NKCC: Impact on Direction Selective ON and OFF Responses in the Rat's Nucleus of the Optic Tract

In the present study we investigated in vivo the effects of pharmacological manipulation of retinal processing on the response properties of direction selective retinal slip cells in the nucleus of the optic tract and dorsal terminal nucleus (NOT-DTN), the key visuomotor interface in the pathway underlying the optokinetic reflex. Employing a moving visual stimulus consisting of either a large dark or light edge we could differentiate direction selective ON and OFF responses in retinal slip cells. To disclose the origin of the retinal slip cells' unexpected OFF response we selectively blocked the retinal ON channels and inactivated the visual cortex by cooling. Cortical cooling had no effect on the direction selectivity of the ON or the OFF response in NOT-DTN retinal slip cells. Blockade of the retinal ON channel with APB led to a loss of the ON and, to a lesser degree, of the OFF response and a reduction in direction selectivity. Subsequent blocking of GABA receptors in the retina with picrotoxin unmasked a vigorous albeit direction unselective OFF response in the NOT-DTN. Disturbing the retinal chloride homeostasis by intraocular injections of bumetanide or furosemide led to a loss of direction selectivity in both the NOT-DTN's ON and the OFF response due to a reduced response in the neuron's preferred direction under bumetanide as well as under furosemide and a slightly increased response in the null direction under bumetanide. Our results indicate that the direction specificity of retinal slip cells in the NOT-DTN of the rat strongly depends on direction selective retinal input which depends on intraretinal chloride homeostasis. On top of the well established input from ON center direction selective ganglion cells we could demonstrate an equally effective input from the retinal OFF system to the NOT-DTN.     

Slow Feature Analysis on Retinal Waves Leads to V1 Complex Cells

The developing visual system of many mammalian species is partially structured and organized even before the onset of vision. Spontaneous neural activity, which spreads in waves across the retina, has been suggested to play a major role in these prenatal structuring processes. Recently, it has been shown that when employing an efficient coding strategy, such as sparse coding, these retinal activity patterns lead to basis functions that resemble optimal stimuli of simple cells in primary visual cortex (V1). Here we present the results of applying a coding strategy that optimizes for temporal slowness, namely Slow Feature Analysis (SFA), to a biologically plausible model of retinal waves. Previously, SFA has been successfully applied to model parts of the visual system, most notably in reproducing a rich set of complex-cell features by training SFA with quasi-natural image sequences. In the present work, we obtain SFA units that share a number of properties with cortical complex-cells by training on simulated retinal waves. The emergence of two distinct properties of the SFA units (phase invariance and orientation tuning) is thoroughly investigated via control experiments and mathematical analysis of the input-output functions found by SFA. The results support the idea that retinal waves share relevant temporal and spatial properties with natural visual input. Hence, retinal waves seem suitable training stimuli to learn invariances and thereby shape the developing early visual system such that it is best prepared for coding input from the natural world.     

Functional specialization of mouse higher visual cortical areas

The mouse is emerging as an important model for understanding how sensory neocortex extracts cues to guide behavior, yet little is known about how these cues are processed beyond primary cortical areas. Here, we used two-photon calcium imaging in awake mice to compare visual responses in primary visual cortex (V1) and in two downstream target areas, AL and PM. Neighboring V1 neurons had diverse stimulus preferences spanning five octaves in spatial and temporal frequency. By contrast, AL and PM neurons responded best to distinct ranges of stimulus parameters. Most strikingly, AL neurons preferred fast-moving stimuli while PM neurons preferred slow-moving stimuli. By contrast, neurons in V1, AL, and PM demonstrated similar selectivity for stimulus orientation but not for stimulus direction. Based on these findings, we predict that area AL helps guide behaviors involving fast-moving stimuli (e.g., optic flow), while area PM?helps guide behaviors involving slow-moving objects.     

Neural mechanisms of tactile motion integration in somatosensory cortex

How are local motion signals integrated to form a global motion percept? We investigate the neural mechanisms of tactile motion integration by presenting tactile gratings and plaids to the fingertips of monkeys, using the tactile analogue of a visual monitor and recording the responses evoked in somatosensory cortical neurons. The perceived directions of the gratings and plaids are measured in parallel psychophysical experiments. We identify a population of somatosensory neurons that exhibit integration properties comparable to those induced by analogous visual stimuli in area MT and find that these neural responses account for the perceived direction of the stimuli across all stimulus conditions tested. The preferred direction of the neurons and the perceived direction of the stimuli can be predicted from the weighted average of the directions of the individual stimulus features, highlighting that the somatosensory system implements a vector average mechanism to compute tactile motion direction that bears striking similarities to its visual counterpart.     

Functional imaging reveals rapid development of visual response properties in the zebrafish tectum

The visual pathway from the retina to the optic tectum in fish and frogs has long been studied as a model for neural circuit formation. Although morphological aspects, such as axonal and dendritic arborization, have been well characterized, less is known about how this translates into functional properties of tectal neurons during development. We developed a system to provide controlled visual stimuli to larval zebrafish, while performing two-photon imaging of tectal neurons loaded with a fluorescent calcium indicator, allowing us to determine visual response properties in intact fish. In relatively mature larvae, we describe receptive field sizes, visual topography, and direction and size selectivity. We also characterize the onset and development of visual responses, beginning when retinal axons first arborize in the tectum. Surprisingly, most of these properties are established soon after dendrite growth and synaptogenesis begin and do not require patterned visual experience or a protracted period of refinement.     

Melanopsin-Derived Visual Responses under Light Adapted Conditions in the Mouse dLGN

A direct projection from melanopsin-expressing intrinsically photosensitive retinal ganglion cells (ipRGCs) reaches the primary visual thalamus (dorsal lateral geniculate nucleus; dLGN). The significance of this melanopsin input to the visual system is only recently being investigated. One unresolved question is the degree to which neurons in the dLGN could use melanopsin to track dynamic changes in light intensity under light adapted conditions. Here we set out to address this question. We were able to present full field steps visible only to melanopsin by switching between rod-isoluminant ‘yellow’ and ‘blue’ lights in a mouse lacking cone function (Cnga3^-/-). In the retina these stimuli elicited melanopsin-like responses from a subset of ganglion cells. When presented to anaesthetised mice, we found that ~25-30% of visually responsive neurones in the contralateral dLGN responded to these melanopsin-isolating steps with small increases in firing rate. Such responses could be elicited even with fairly modest increases in effective irradiance (32% Michelson contrast for melanopsin). These melanopsin-driven responses were apparent at bright backgrounds (corresponding to twilight-daylight conditions), but their threshold irradiance was strongly dependent upon prior light exposure when stimuli were superimposed on a spectrally neutral ramping background light. While both onset and offset latencies were long for melanopsin-derived responses compared to those evoked by rods, there was great variability in these parameters with some cells responding to melanopsin steps in <1 s. These data indicate that a subset of dLGN units can employ melanopsin signals to detect modest changes in irradiance under photopic conditions.     

Spatiotopic coding of BOLD signal in human visual cortex depends on spatial attention

The neural substrate of the phenomenological experience of a stable visual world remains obscure. One possible mechanism would be to construct spatiotopic neural maps where the response is selective to the position of the stimulus in external space, rather than to retinal eccentricities, but evidence for these maps has been inconsistent. Here we show, with fMRI, that when human subjects perform concomitantly a demanding attentive task on stimuli displayed at the fovea, BOLD responses evoked by moving stimuli irrelevant to the task were mostly tuned in retinotopic coordinates. However, under more unconstrained conditions, where subjects could attend easily to the motion stimuli, BOLD responses were tuned not in retinal but in external coordinates (spatiotopic selectivity) in many visual areas, including MT, MST, LO and V6, agreeing with our previous fMRI study. These results indicate that spatial attention may play an important role in mediating spatiotopic selectivity.     

Saccadic adaptation to moving targets

Saccades are so called ballistic movements which are executed without online visual feedback. After each saccade the saccadic motor plan is modified in response to post-saccadic feedback with the mechanism of saccadic adaptation. The post-saccadic feedback is provided by the retinal position of the target after the saccade. If the target moves after the saccade, gaze may follow the moving target. In that case, the eyes are controlled by the pursuit system, a system that controls smooth eye movements. Although these two systems have in the past been considered as mostly independent, recent lines of research point towards many interactions between them. We were interested in the question if saccade amplitude adaptation is induced when the target moves smoothly after the saccade. Prior studies of saccadic adaptation have considered intra-saccadic target steps as learning signals. In the present study, the intra-saccadic target step of the McLaughlin paradigm of saccadic adaptation was replaced by target movement, and a post-saccadic pursuit of the target. We found that saccadic adaptation occurred in this situation, a further indication of an interaction of the saccadic system and the pursuit system with the aim of optimized eye movements.