Spatial facilitation by a high-performance dragonfly target-detecting neuron

Many animals visualize and track small moving targets at long distances-be they prey, approaching predators or conspecifics. Insects are an excellent model system for investigating the neural mechanisms that have evolved for this challenging task. Specialized small target motion detector (STMD) neurons in the optic lobes of the insect brain respond strongly even when the target size is below the resolution limit of the eye. Many STMDs also respond robustly to small targets against complex stationary or moving backgrounds. We hypothesized that this requires a complex mechanism to avoid breakthrough responses by background features, and yet to adequately amplify the weak signal of tiny targets. We compared responses of dragonfly STMD neurons to small targets that begin moving within the receptive field with responses to targets that approach the same location along longer trajectories. We find that responses along longer trajectories are strongly facilitated by a mechanism that builds up slowly over several hundred milliseconds. This allows the neurons to give sustained responses to continuous target motion, thus providing a possible explanation for their extraordinary sensitivity.     

A model for the detection of moving targets in visual clutter inspired by insect physiology

We present a computational model for target discrimination based on intracellular recordings from neurons in the fly visual system. Determining how insects detect and track small moving features, often against cluttered moving backgrounds, is an intriguing challenge, both from a physiological and a computational perspective. Previous research has characterized higher-order neurons within the fly brain, known as 'small target motion detectors' (STMD), that respond robustly to moving features, even when the velocity of the target is matched to the background (i.e. with no relative motion cues). We recorded from intermediate-order neurons in the fly visual system that are well suited as a component along the target detection pathway. This full-wave rectifying, transient cell (RTC) reveals independent adaptation to luminance changes of opposite signs (suggesting separate ON and OFF channels) and fast adaptive temporal mechanisms, similar to other cell types previously described. From this physiological data we have created a numerical model for target discrimination. This model includes nonlinear filtering based on the fly optics, the photoreceptors, the 1(st) order interneurons (Large Monopolar Cells), and the newly derived parameters for the RTC. We show that our RTC-based target detection model is well matched to properties described for the STMDs, such as contrast sensitivity, height tuning and velocity tuning. The model output shows that the spatiotemporal profile of small targets is sufficiently rare within natural scene imagery to allow our highly nonlinear 'matched filter' to successfully detect most targets from the background. Importantly, this model can explain this type of feature discrimination without the need for relative motion cues.     

Retinotopic organization of small-field-target-detecting neurons in the insect visual system

BACKGROUND: Despite having tiny brains and relatively low-resolution compound eyes, many fly species frequently engage in precisely controlled aerobatic pursuits of conspecifics. Recent investigations into high-order processing in the fly visual system have revealed a class of neurons, coined small-target-motion detectors (STMDs), capable of responding robustly to target motion against the motion of background clutter. Despite limited spatial acuity in the insect eye, these neurons display exquisite sensitivity to small targets. RESULTS: We recorded intracellularly from morphologically identified columnar neurons in the lobula complex of the hoverfly Eristalis tenax. We show that these columnar neurons with exquisitely small receptive fields, like their large-field counterparts recently described from both male and female flies, have an extreme selectivity for the motion of small targets. In doing so, we provide the first physiological characterization of small-field neurons in female flies. These retinotopically organized columnar neurons include both direction-selective and nondirection-selective classes covering a large area of visual space. CONCLUSIONS: The retinotopic arrangement of lobula columnar neurons sensitive to the motion of small targets makes a strong case for these neurons as important precursors in the local processing of target motion. Furthermore, the continued response of STMDs with such small receptive fields to the motion of small targets in the presence of moving background clutter places further constraints on the potential mechanisms underlying their small-target tuning.     

Neural specializations for small target detection in insects

Despite being equipped with low-resolution eyes and tiny brains, many insects show exquisite abilities to detect and pursue targets even in highly textured surrounds. Target tracking behavior is subserved by neurons that are sharply tuned to the motion of small high-contrast targets. These neurons respond robustly to target motion, even against self-generated optic flow. A recent model, supported by neurophysiology, generates target selectivity by being sharply tuned to the unique spatiotemporal profile associated with target motion. Target neurons are likely connected in a complex network where some provide more direct output to behavior, whereas others serve an inter-regulatory role. These interactions may regulate attention and aid in the robust detection of targets in clutter observed in behavior.     

Segregation of object and background motion in visual area MT: effects of microstimulation on eye movements

To track a moving object, its motion must first be distinguished from that of the background. The center-surround properties of neurons in the middle temporal visual area (MT) may be important for signaling the relative motion between object and background. To test this, we microstimulated within MT and measured the effects on monkeys' eye movements to moving targets. We found that stimulation at "local motion" sites, where receptive fields possessed antagonistic surrounds, shifted pursuit in the preferred direction of the neurons, whereas stimulation at "wide-field motion" sites shifted pursuit in the opposite, or null, direction. We propose that activating wide-field sites simulated background motion, thus inducing a target motion signal in the opposite direction. Our results support the hypothesis that neuronal center-surround mechanisms contribute to the behavioral segregation of objects from the background.     

Lower visual field advantage for motion segmentation during high competition for selection

A series of visual enumeration tasks were conducted investigating the role of the dorsal visual stream in motion segmentation. Cortical areas representing the lower visual field have greater connections with the parietal cortex and should therefore show an advantage for processes driven by the dorsal stream (Previc, 1990). We looked for differences in processing displays in the upper versus lower visual field when targets required segmentation from distractors in an enumeration task. In a baseline condition, random configurations of moving and static items were presented briefly (200 ms) to the upper or lower visual field. Fast and efficient enumeration took place both for moving targets and for static targets presented alone; there was no effect of visual field. In contrast, for moving targets, a lower visual field advantage was found when the inclusion of static distractors demanded segmentation by motion. This disappeared at the smaller display sizes when the targets were presented in canonical patterns. The results are consistent with segmentation of moving targets from static distractors being mediated by dorsal regions of the visual cortex, particularly under conditions of high load (non-canonical patterns). These regions show greater sensitivity to the lower visual field and to magnocellular-based input.     

Sensory and behavioral properties of neurons in posterior parietal cortex of the awake, trained monkey.

Neurons in posterior parietal cortex of the awake, trained monkey respond to passive visual and/or somatosensory stimuli. In general, the receptive fields of these cells are large and nonspecific. When these neurons are studied during visually guided hand movements and eye movements, most of their activity can be accounted for by passive sensory stimulation. However, for some visual cells, the response to a stimulus is enhanced when it is to be the target for a saccadic eye movement. This enhancement is selective for eye movements into the visual receptive field since it does not occur with eye movements to other parts of the visual field. Cells that discharge in association with a visual fixation task have foveal receptive fields and respond to the spots of light used as fixation targets. Cells discharging selectively in association with different directions of tracking eye movements have directionally selective responses to moving visual stimuli. Every cell in our sample discharging in association with movement could be driven by passive sensory stimuli. We conclude that the activity of neurons in posterior parietal cortex is dependent on and indicative of external stimuli but not predictive of movement.     

Contrast sensitivity and the detection of moving patterns and features

Theories based on optimal sampling by the retina have been widely applied to visual ecology at the level of the optics of the eye, supported by visual behaviour. This leads to speculation about the additional processing that must lie in between—in the brain itself. But fewer studies have adopted a quantitative approach to evaluating the detectability of specific features in these neural pathways. We briefly review this approach with a focus on contrast sensitivity of two parallel pathways for motion processing in insects, one used for analysis of wide-field optic flow, the other for detection of small features. We further use a combination of optical modelling of image blur and physiological recording from both photoreceptors and higher-order small target motion detector neurons sensitive to small targets to show that such neurons operate right at the limits imposed by the optics of the eye and the noise level of single photoreceptors. Despite this, and the limitation of only being able to use information from adjacent receptors to detect target motion, they achieve a contrast sensitivity that rivals that of wide-field motion sensitive pathways in either insects or vertebrates—among the highest in absolute terms seen in any animal.     

The evolution of patterning during movement in a large-scale citizen science game

The motion dazzle hypothesis posits that high contrast geometric patterns can cause difficulties in tracking a moving target and has been argued to explain the patterning of animals such as zebras. Research to date has only tested a small number of patterns, offering equivocal support for the hypothesis. Here, we take a genetic programming approach to allow patterns to evolve based on their fitness (time taken to capture) and thus find the optimal strategy for providing protection when moving. Our ‘Dazzle Bug’ citizen science game tested over 1.5 million targets in a touch screen game at a popular visitor attraction. Surprisingly, we found that targets lost pattern elements during evolution and became closely background matching. Modelling results suggested that targets with lower motion energy were harder to catch. Our results indicate that low contrast, featureless targets offer the greatest protection against capture when in motion, challenging the motion dazzle hypothesis.     

Visual position stabilization in the hummingbird hawk moth, Macroglossum stellatarum L. II. Electrophysiological analysis of neurons sensitive to wide-field image motion

Response properties of neurons in the cervical connectives of the hummingbird hawk moth, Macroglossum stellatarum L., were determined. All neurons described in this account respond directionally selectively to motion in large parts of the visual field of either eye. They respond maximally to bilateral stimulation, preferring either motion as induced on the eyes during translatory movements of the animal or when it turns around one of its body axes. Cells most sensitive to rotational motion either respond best to rotation of the patterns around the vertical axis of the animal or around its longitudinal body axis. Neurons most sensitive to translational pattern motion respond best to either simulated translations of the animal along its vertical or along an oblique axis. Most types of neurons respond tonically and do not habituate. The sensitivity to motion stimuli is not evenly distributed within the receptive field of any investigated neuron. Part of these neurons might play a role in visual position and course stabilization. Accepted: 13 August 1997     

Effect of fast moving stimuli and saccadic eye movements on cell activity in visual areas V1 and V2 of behaving monkeys

Extracellular recordings were carried out in the visual cortex of behaving monkeys trained on a fixation/detection task, during which a target light was displayed stationary or suddenly moving on a tangent translucent screen. The responses of visual cortical cells to fast moving stimuli during steady fixation and those obtained during rapid eye movements (saccades) which moved their receptive field across a stationary stimulus, were studied. Areas V1 and V2 were explored. When tested with rapidly moving stimuli (500 deg/sec) during steady fixation, neurons in each area behaved in almost the same way. About one fourth of them were activated, the remainder showing either no response (little more than a half of them) or a reduction of the spontaneous firing rate. In both areas, some of the neurons activated during steady fixation did not respond or responded very weakly during eye motion at saccadic velocity (500 +/- 50 deg/sec). Neurons of this type, which we refer to as 'real motion' cells, could somehow contribute to the maintenance of visual stability during the execution of large eye movements.     

Responses of tectal neurons to contrasting stimuli: an electrophysiological study in the barn owl

The saliency of visual objects is based on the center to background contrast. Particularly objects differing in one feature from the background may be perceived as more salient. It is not clear to what extent this so called "pop-out" effect observed in humans and primates governs saliency perception in non-primates as well. In this study we searched for neural-correlates of pop-out perception in neurons located in the optic tectum of the barn owl. We measured the responses of tectal neurons to stimuli appearing within the visual receptive field, embedded in a large array of additional stimuli (the background). Responses were compared between contrasting and uniform conditions. In a contrasting condition the center was different from the background while in the uniform condition it was identical to the background. Most tectal neurons responded better to stimuli in the contrsating condition compared to the uniform condition when the contrast between center and background was the direction of motion but not when it was the orientation of a bar. Tectal neurons also preferred contrasting over uniform stimuli when the center was looming and the background receding but not when the center was receding and the background looming. Therefore, our results do not support the hypothesis that tectal neurons are sensitive to pop-out per-se. The specific sensitivity to the motion contrasting stimulus is consistent with the idea that object motion and not large field motion (e.g., self-induced motion) is coded in the neural responses of tectal neurons.     

Representation of motion onset and offset in an augmented Barlow-Levick model of motion detection

Kinetic occlusion produces discontinuities in the optic flow field, whose perception requires the detection of an unexpected onset or offset of otherwise predictably moving or stationary contrast patches. Many cells in primate visual cortex are directionally selective for moving contrasts, and recent reports suggest that this selectivity arises through the inhibition of contrast signals moving in the cells’ null direction, as in the rabbit retina. This nulling inhibition circuit (Barlow-Levick) is here extended to also detect motion onsets and offsets. The selectivity of extended circuit units, measured as a peak evidence accumulation response to motion onset/offset compared to the peak response to constant motion, is analyzed as a function of stimulus speed. Model onset cells are quiet during constant motion, but model offset cells activate during constant motion at slow speeds. Consequently, model offset cell speed tuning is biased towards higher speeds than onset cell tuning, similarly to the speed tuning of cells in the middle temporal area when exposed to speed ramps. Given a population of neurons with different preferred speeds, this asymmetry addresses a behavioral paradox—why human subjects in a simple reaction time task respond more slowly to motion offsets than onsets for low speeds, even though monkey neuron firing rates react more quickly to the offset of a preferred stimulus than to its onset.     

Iterative cooperation between parallel pathways for object and background motion

In a typical visual scene, one or more objects move relative to a larger background, which can itself be in motion as a result of the observer’s eyes moving with respect to the outside world. Here we show that accurate estimation of the background motion from an image velocity field can be accomplished through an iterative cooperation between two modules: one that specializes in calculating a weighted average velocity and another one calculating a velocity contrast map. We build on our analysis to provide a model for the tectum-pretectum loop in the nonmammalian midbrain. Our model accounts for some of the known properties of the tectal neurons (sensitivity to relative motion) and pretectal neurons (sensitivity to whole-field motion). It also agrees with our knowledge of the pretectotectal projection (divergent and inhibitory), and with the results of lesion studies in which the pretectal input to the tectum was removed, leading to hyperactivity of the tectal neurons and the animal. Our model also makes a testable prediction regarding the tectopretectal projection, i.e., that the presence of a larger object and a bigger discrepancy between the directions of motion for the object and the background lead to a larger error by the pretectum in estimating the background motion when the tectal input is abolished.     

Cuttlefish camouflage: context-dependent body pattern use during motion

It is virtually impossible to camouflage a moving target against a non-uniform background, but strategies have been proposed to reduce detection and targeting of movement. Best known is the idea that high contrast markings produce ‘motion dazzle’, which impairs judgement of speed and trajectory. The ability of the cuttlefish Sepia officinalis to change its visual appearance allows us to compare the animal''s choice of patterns during movement to the predictions of models of motion camouflage. We compare cuttlefish body patterns used during movement with those expressed when static on two background types; one of which promotes low-contrast mottle patterns and the other promotes high-contrast disruptive patterns. We find that the body pattern used during motion is context-specific and that high-contrast body pattern components are significantly reduced during movement. Thus, in our experimental conditions, cuttlefish do not use high contrast motion dazzle. It may be that, in addition to being inherently conspicuous during movement, moving high-contrast patterns will attract attention because moving particles in coastal waters tend to be of small size and of low relative contrast.     

Visual motion: homing in on small target detectors

Tracking moving targets is essential for animals that pursue prey or conspecifics. Recent studies in male and female hoverflies have described classes of neurons that detect the movements of small targets against a moving background but the mechanisms generating their responses remain unclear.     

How Moving Backgrounds Influence Interception

Reaching movements towards an object are continuously guided by visual information about the target and the arm. Such guidance increases precision and allows one to adjust the movement if the target unexpectedly moves. On-going arm movements are also influenced by motion in the surrounding. Fast responses to motion in the surrounding could help cope with moving obstacles and with the consequences of changes in one’s eye orientation and vantage point. To further evaluate how motion in the surrounding influences interceptive movements we asked subjects to tap a moving target when it reached a second, static target. We varied the direction and location of motion in the surrounding, as well as details of the stimuli that are known to influence eye movements. Subjects were most sensitive to motion in the background when such motion was near the targets. Whether or not the eyes were moving, and the direction of the background motion in relation to the direction in which the eyes were moving, had very little influence on the response to the background motion. We conclude that the responses to background motion are driven by motion near the target rather than by a global analysis of the optic flow and its relation with other information about self-motion.     

Acoustic facilitation of object movement detection during self-motion

In humans, as well as most animal species, perception of object motion is critical to successful interaction with the surrounding environment. Yet, as the observer also moves, the retinal projections of the various motion components add to each other and extracting accurate object motion becomes computationally challenging. Recent psychophysical studies have demonstrated that observers use a flow-parsing mechanism to estimate and subtract self-motion from the optic flow field. We investigated whether concurrent acoustic cues for motion can facilitate visual flow parsing, thereby enhancing the detection of moving objects during simulated self-motion. Participants identified an object (the target) that moved either forward or backward within a visual scene containing nine identical textured objects simulating forward observer translation. We found that spatially co-localized, directionally congruent, moving auditory stimuli enhanced object motion detection. Interestingly, subjects who performed poorly on the visual-only task benefited more from the addition of moving auditory stimuli. When auditory stimuli were not co-localized to the visual target, improvements in detection rates were weak. Taken together, these results suggest that parsing object motion from self-motion-induced optic flow can operate on multisensory object representations.     

Learning to identify near-acuity letters, either with or without flankers, results in improved letter size and spacing limits in adults with amblyopia

Amblyopia is a developmental abnormality that results in deficits for a wide range of visual tasks, most notably, the reduced ability to see fine details, the loss in contrast sensitivity especially for small objects and the difficulty in seeing objects in clutter (crowding). The primary goal of this study was to evaluate whether crowding can be ameliorated in adults with amblyopia through perceptual learning using a flanked letter identification task that was designed to reduce crowding, and if so, whether the improvements transfer to untrained visual functions: visual acuity, contrast sensitivity and the size of visual span (the amount of information obtained in one fixation). To evaluate whether the improvements following this training task were specific to training with flankers, we also trained another group of adult observers with amblyopia using a single letter identification task that was designed to improve letter contrast sensitivity, not crowding. Following 10,000 trials of training, both groups of observers showed improvements in the respective training task. The improvements generalized to improved visual acuity, letter contrast sensitivity, size of the visual span, and reduced crowding. The magnitude of the improvement for each of these measurements was similar in the two training groups. Perceptual learning regimens aimed at reducing crowding or improving letter contrast sensitivity are both effective in improving visual acuity, contrast sensitivity for near-acuity objects and reducing the crowding effect, and could be useful as a clinical treatment for amblyopia.