Neural action fields for optic flow based navigation: a simulation study of the fly lobula plate network

Optic flow based navigation is a fundamental way of visual course control described in many different species including man. In the fly, an essential part of optic flow analysis is performed in the lobula plate, a retinotopic map of motion in the environment. There, the so-called lobula plate tangential cells possess large receptive fields with different preferred directions in different parts of the visual field. Previous studies demonstrated an extensive connectivity between different tangential cells, providing, in principle, the structural basis for their large and complex receptive fields. We present a network simulation of the tangential cells, comprising most of the neurons studied so far (22 on each hemisphere) with all the known connectivity between them. On their dendrite, model neurons receive input from a retinotopic array of Reichardt-type motion detectors. Model neurons exhibit receptive fields much like their natural counterparts, demonstrating that the connectivity between the lobula plate tangential cells indeed can account for their complex receptive field structure. We describe the tuning of a model neuron to particular types of ego-motion (rotation as well as translation around/along a given body axis) by its 'action field'. As we show for model neurons of the vertical system (VS-cells), each of them displays a different type of action field, i.e., responds maximally when the fly is rotating around a particular body axis. However, the tuning width of the rotational action fields is relatively broad, comparable to the one with dendritic input only. The additional intra-lobula-plate connectivity mainly reduces their translational action field amplitude, i.e., their sensitivity to translational movements along any body axis of the fly.     

Insect detection of small targets moving in visual clutter

Detection of targets that move within visual clutter is a common task for animals searching for prey or conspecifics, a task made even more difficult when a moving pursuer needs to analyze targets against the motion of background texture (clutter). Despite the limited optical acuity of the compound eye of insects, this challenging task seems to have been solved by their tiny visual system. Here we describe neurons found in the male hoverfly,Eristalis tenax, that respond selectively to small moving targets. Although many of these target neurons are inhibited by the motion of a background pattern, others respond to target motion within the receptive field under a surprisingly large range of background motion stimuli. Some neurons respond whether or not there is a speed differential between target and background. Analysis of responses to very small targets (smaller than the size of the visual field of single photoreceptors) or those targets with reduced contrast shows that these neurons have extraordinarily high contrast sensitivity. Our data suggest that rejection of background motion may result from extreme selectivity for small targets contrasting against local patches of the background, combined with this high sensitivity, such that background patterns rarely contain features that satisfactorily drive the neuron.     

Structural organization of male-specific visual neurons in calliphorid optic lobes

Summary The superiority of male flies over female flies in locating and intercepting small rapidly moving targets has been ascribed to differences in their visual systems. In males, this sexual dimorphism is externally expressed by an area of high visual acuity called the acute zone. Selective cobalt uptake reveals 12 types of male-specific visual interneurons in the male lobula, the axons of which terminate in neuropil supplying premotor descending neurons to neck and flight motor circuits. The dendritic fields of the individual male-specific neurons can be extrapolated out into visual space to demonstrate that each is assigned a discrete area of the visual panorama. The dendritic fields of 10 of the 12 male-specific neurons subtend areas of the retina associated with the male acute zone. The functional significance of male-specific neurons is discussed with respect to their putative receptive field and a model circuit for target location by male flies.     

The functional organization of male-specific visual neurons in flies

Summary Intracellular recording and Lucifer yellow dye filling of male fleshflies, Sarcophaga bullata, have revealed male-specific neurons in the lobula, the axons of which project to the origin of premotor channels supplying flight motor neurons. Dendrites of male-specific neurons visit areas of the retinotopic mosaic supplied by the retina's acute zone, which is used by males to keep the image of a conspecific female centered during aerial pursuit. Only males engage in high-speed acrobatic chases, and male-specific neurons are suspected to under-lie this behavior. Physiological determination of receptive fields of male-specific neurons substantiates the fields predicted from anatomical studies and demonstrates that they subtend the acute zone. Male-specific neurons respond in a manner predicted on theoretical grounds from observations of tracking behavior. Such properties include directional selectivity to visual motion and higher sensitivity to motion of small images than to wide-field motion. The present account substantiates and extends neuroanatomical evidence that predicts that male-specific lobula neurons comprise a distinct circuit mediating conspecific tracking.     

Small object detection neurons in female hoverflies

While predators such as dragonflies are dependent on visual detection of moving prey, social interactions make conspecific detection equally important for many non-predatory insects. Specialized 'acute zones' associated with target detection have evolved in several insect groups and are a prominent male-specific feature in many dipteran flies. The physiology of target selective neurons associated with these specialized eye regions has previously been described only from male flies. We show here that female hoverflies (Eristalis tenax) have several classes of neurons within the third optic ganglion (lobula) capable of detecting moving objects smaller than 1 degrees . These neurons have frontal receptive fields covering a large part of the ipsilateral world and are tuned to a broad range of target speeds and sizes. This could make them suitable for detecting targets under a range of natural conditions such as required during predator avoidance or conspecific interactions.     

Descending pathways connecting the male-specific visual system of flies to the neck and flight motor

Summary During sexual pursuit, male flies Sarcophaga bullata, stabilize the image of a pursued target on the dorso-frontal acute zone of their compound eyes. By retinotopic projection, this region is represented in the upper frontal part of the lobula where it is sampled by ensembles of male-specific motion- and flicker-sensitive interneurons. Intracellular recordings of descending neurons, followed by biocytin injection, demonstrate that male-specific neurons are dye-coupled to specific descending neurons and that the response characteristics of these descending neurons closely resemble those of male-specific lobula neurons. Such descending neurons are biocytin-coupled in the thoracic ganglia, revealing their connections with ipsilateral frontal nerve motor neurons supplying muscles that move the head and with contralateral basalar muscle motor neurons that control wing beat amplitude. Recordings from neck muscle motor neurons demonstrate that although they respond to movement of panoramic motion, they also selectively respond to movement of small targets presented to the male-specific acute zone. The present results are discussed with respect to anatomical and physiological studies of sex-specific interneurons and with respect to sex-specific visual behavior. The present study, and those of the two preceding papers, provide a revision of Land and Collett's hypothetical circuit underlying target localization and motor control in males pursuing females.     

Local and global motion preferences in descending neurons of the fly

For a moving animal, optic flow is an important source of information about its ego-motion. In flies, the processing of optic flow is performed by motion sensitive tangential cells in the lobula plate. Amongst them, cells of the vertical system (VS cells) have receptive fields with similarities to optic flows generated during rotations around different body axes. Their output signals are further processed by pre-motor descending neurons. Here, we investigate the local motion preferences of two descending neurons called descending neurons of the ocellar and vertical system (DNOVS1 and DNOVS2). Using an LED arena subtending 240° × 95° of visual space, we mapped the receptive fields of DNOVS1 and DNOVS2 as well as those of their presynaptic elements, i.e. VS cells 1–10 and V2. The receptive field of DNOVS1 can be predicted in detail from the receptive fields of those VS cells that are most strongly coupled to the cell. The receptive field of DNOVS2 is a combination of V2 and VS cells receptive fields. Predicting the global motion preferences from the receptive field revealed a linear spatial integration in DNOVS1 and a superlinear spatial integration in DNOVS2. In addition, the superlinear integration of V2 output is necessary for DNOVS2 to differentiate between a roll rotation and a lift translation of the fly.     

Response properties of visual interneurons to motion stimuli in the praying mantis,Tenodera aridifolia

Intracellular responses of motion-sensitive visual interneurons were recorded from the lobula complex of the mantis, Tenodera aridifolia. The interneurons were divided into four classes according to the response polarity, spatial tuning, and directional selectivity. Neurons of the first class had small, medium, or large receptive fields and showed a strong excitation in response to a small-field motion such as a small square moving in any direction (SF neurons). The second class neurons showed non-directionally selective responses: an excitation to a large-field motion of gratings in any direction (ND neurons). Most ND neurons had small or medium-size receptive fields. Neurons of the third class had large receptive fields and exhibited directionally selective responses: an excitation to a large-field motion of gratings in preferred direction and an inhibition to a motion in opposite, null direction (DS neurons). The last class neurons had small receptive fields and showed inhibitory responses to a moving square and gratings (I neurons). The functional roles of these neurons in prey recognition and optomotor response were discussed.     

A model for the detection of moving targets in visual clutter inspired by insect physiology

We present a computational model for target discrimination based on intracellular recordings from neurons in the fly visual system. Determining how insects detect and track small moving features, often against cluttered moving backgrounds, is an intriguing challenge, both from a physiological and a computational perspective. Previous research has characterized higher-order neurons within the fly brain, known as 'small target motion detectors' (STMD), that respond robustly to moving features, even when the velocity of the target is matched to the background (i.e. with no relative motion cues). We recorded from intermediate-order neurons in the fly visual system that are well suited as a component along the target detection pathway. This full-wave rectifying, transient cell (RTC) reveals independent adaptation to luminance changes of opposite signs (suggesting separate ON and OFF channels) and fast adaptive temporal mechanisms, similar to other cell types previously described. From this physiological data we have created a numerical model for target discrimination. This model includes nonlinear filtering based on the fly optics, the photoreceptors, the 1(st) order interneurons (Large Monopolar Cells), and the newly derived parameters for the RTC. We show that our RTC-based target detection model is well matched to properties described for the STMDs, such as contrast sensitivity, height tuning and velocity tuning. The model output shows that the spatiotemporal profile of small targets is sufficiently rare within natural scene imagery to allow our highly nonlinear 'matched filter' to successfully detect most targets from the background. Importantly, this model can explain this type of feature discrimination without the need for relative motion cues.     

Response properties of motion-sensitive visual interneurons in the lobula plate of Drosophila melanogaster

The crystalline-like structure of the optic lobes of the fruit fly Drosophila melanogaster has made them a model system for the study of neuronal cell-fate determination, axonal path finding, and target selection. For functional studies, however, the small size of the constituting visual interneurons has so far presented a formidable barrier. We have overcome this problem by establishing in vivo whole-cell recordings from genetically targeted visual interneurons of Drosophila. Here, we describe the response properties of six motion-sensitive large-field neurons in the lobula plate that form a network consisting of individually identifiable, directionally selective cells most sensitive to vertical image motion (VS cells). Individual VS cell responses to visual motion stimuli exhibit all the characteristics that are indicative of presynaptic input from elementary motion detectors of the correlation type. Different VS cells possess distinct receptive fields that are arranged sequentially along the eye's azimuth, corresponding to their characteristic cellular morphology and position within the retinotopically organized lobula plate. In addition, lateral connections between individual VS cells cause strongly overlapping receptive fields that are wider than expected from their dendritic input. Our results suggest that motion vision in different dipteran fly species is accomplished in similar circuitries and according to common algorithmic rules. The underlying neural mechanisms of population coding within the VS cell network and of elementary motion detection, respectively, can now be analyzed by the combination of electrophysiology and genetic intervention in Drosophila.     

Spatial facilitation by a high-performance dragonfly target-detecting neuron

Many animals visualize and track small moving targets at long distances-be they prey, approaching predators or conspecifics. Insects are an excellent model system for investigating the neural mechanisms that have evolved for this challenging task. Specialized small target motion detector (STMD) neurons in the optic lobes of the insect brain respond strongly even when the target size is below the resolution limit of the eye. Many STMDs also respond robustly to small targets against complex stationary or moving backgrounds. We hypothesized that this requires a complex mechanism to avoid breakthrough responses by background features, and yet to adequately amplify the weak signal of tiny targets. We compared responses of dragonfly STMD neurons to small targets that begin moving within the receptive field with responses to targets that approach the same location along longer trajectories. We find that responses along longer trajectories are strongly facilitated by a mechanism that builds up slowly over several hundred milliseconds. This allows the neurons to give sustained responses to continuous target motion, thus providing a possible explanation for their extraordinary sensitivity.     

Global versus local adaptation in fly motion-sensitive neurons

Flies, like humans, experience a well-known consequence of adaptation to visual motion, the waterfall illusion. Direction-selective neurons in the fly lobula plate permit a detailed analysis of the mechanisms responsible for motion adaptation and their function. Most of these neurons are spatially non-opponent, they sum responses to motion in the preferred direction across their entire receptive field, and adaptation depresses responses by subtraction and by reducing contrast gain. When we adapted a small area of the receptive field to motion in its anti-preferred direction, we discovered that directional gain at unadapted regions was enhanced. This novel phenomenon shows that neuronal responses to the direction of stimulation in one area of the receptive field are dynamically adjusted to the history of stimulation both within and outside that area.     

Optic flow representation in the optic lobes of Diptera: modeling the role of T5 directional tuning properties

An evolutionarily conserved system of small retinotopic neurons in dipteran insects, called bushy T-cells, provides information about directional motion to large collator neurons in the lobula plate. Physiological and anatomical features of these cells provide the basis for a model that is used to investigate requirements for generating optic flow selectivity in collators while allowing for evolutionary variations. This account focuses on the role of physiological tuning properties of T5 neurons. Various flow fields are defined as inputs to retinotopic arrays of T5 cells, the responses of which are mapped onto collators using innervation matrices that promote selectivity for flow type and position. Properties known or inferred from physiological and anatomical studies of neurons contributing to motion detection are incorporated into the model: broad tuning to local motion direction and the representation of each visual sampling unit by a quartet of small-field T5-like neurons with orthogonal preferred directions. The model predicts hitherto untested response properties of optic flow selective collators, and predicts that selectivity for a given flow field can be highly sensitive to perturbations in physiological properties of the motion detectors.     

Columnar cells necessary for motion responses of wide-field visual interneurons in <Emphasis Type="Italic">Drosophila</Emphasis>

Wide-field motion-sensitive neurons in the lobula plate (lobula plate tangential cells, LPTCs) of the fly have been studied for decades. However, it has never been conclusively shown which cells constitute their major presynaptic elements. LPTCs are supposed to be rendered directionally selective by integrating excitatory as well as inhibitory input from many local motion detectors. Based on their stratification in the different layers of the lobula plate, the columnar cells T4 and T5 are likely candidates to provide some of this input. To study their role in motion detection, we performed whole-cell recordings from LPTCs in Drosophila with T4 and T5 cells blocked using two different genetically encoded tools. In these flies, motion responses were abolished, while flicker responses largely remained. We thus demonstrate that T4 and T5 cells indeed represent those columnar cells that provide directionally selective motion information to LPTCs. Contrary to previous assumptions, flicker responses seem to be largely mediated by a third, independent pathway. This work thus represents a further step towards elucidating the complete motion detection circuitry of the fly.     

Subcellular mapping of dendritic activity in optic flow processing neurons

Dendritic integration is a fundamental element of neuronal information processing. So far, few studies have provided a detailed spatial picture of this process, describing the properties of local dendritic activity and its subcellular organization. Here, we used 2-photon calcium imaging in optic flow processing neurons of the fly Calliphora vicina to determine the preferred location and direction of local motion cues for small branchlets throughout the entire dendrite. We found a pronounced retinotopic mapping on both the subcellular and the cell population level. In addition, dendritic branchlets residing in different layers of the neuropil were tuned to distinct directions of motion. Summing the local receptive fields of all dendritic branchlets reproduced the characteristic properties of these neurons’ axonal output receptive fields. Our results corroborate the notion that the dendritic morphology of vertical system cells allows them to selectively collect local motion inputs with particular directional preferences from a spatially organized input repertoire, thus forming filters that match global patterns of optic flow. Furthermore, we suggest that the facet arrangement across the fly’s eye shapes the subcellular direction tuning to local motion stimuli. These data illustrate a highly structured circuit organization as an efficient way to hard-wire a complex sensory task.     

Quantification of phase synchronization phenomena and their importance for verbal memory processes

The tangential neurons in the lobula plate region of the flies are known to respond to visual motion across broad receptive fields in visual space.When intracellular recordings are made from tangential neurons while the intact animal is stimulated visually with moving natural imagery,we find that neural response depends upon speed of motion but is nearly invariant with respect to variations in natural scenery. We refer to this invariance as velocity constancy. It is remarkable because natural scenes, in spite of similarities in spatial structure, vary considerably in contrast, and contrast dependence is a feature of neurons in the early visual pathway as well as of most models for the elementary operations of visual motion detection. Thus, we expect that operations must be present in the processing pathway that reduce contrast dependence in order to approximate velocity constancy.We consider models for such operations, including spatial filtering, motion adaptation, saturating nonlinearities, and nonlinear spatial integration by the tangential neurons themselves, and evaluate their effects in simulations of a tangential neuron and precursor processing in response to animated natural imagery. We conclude that all such features reduce interscene variance in response, but that the model system does not approach velocity constancy as closely as the biological tangential cell.     

Visuomotor transformation in the fly gaze stabilization system

For sensory signals to control an animal's behavior, they must first be transformed into a format appropriate for use by its motor systems. This fundamental problem is faced by all animals, including humans. Beyond simple reflexes, little is known about how such sensorimotor transformations take place. Here we describe how the outputs of a well-characterized population of fly visual interneurons, lobula plate tangential cells (LPTCs), are used by the animal's gaze-stabilizing neck motor system. The LPTCs respond to visual input arising from both self-rotations and translations of the fly. The neck motor system however is involved in gaze stabilization and thus mainly controls compensatory head rotations. We investigated how the neck motor system is able to selectively extract rotation information from the mixed responses of the LPTCs. We recorded extracellularly from fly neck motor neurons (NMNs) and mapped the directional preferences across their extended visual receptive fields. Our results suggest that-like the tangential cells-NMNs are tuned to panoramic retinal image shifts, or optic flow fields, which occur when the fly rotates about particular body axes. In many cases, tangential cells and motor neurons appear to be tuned to similar axes of rotation, resulting in a correlation between the coordinate systems the two neural populations employ. However, in contrast to the primarily monocular receptive fields of the tangential cells, most NMNs are sensitive to visual motion presented to either eye. This results in the NMNs being more selective for rotation than the LPTCs. Thus, the neck motor system increases its rotation selectivity by a comparatively simple mechanism: the integration of binocular visual motion information.     

Pattern-dependent response modulations in motion-sensitive visual interneurons--a model study

Even if a stimulus pattern moves at a constant velocity across the receptive field of motion-sensitive neurons, such as lobula plate tangential cells (LPTCs) of flies, the response amplitude modulates over time. The amplitude of these response modulations is related to local pattern properties of the moving retinal image. On the one hand, pattern-dependent response modulations have previously been interpreted as 'pattern-noise', because they deteriorate the neuron's ability to provide unambiguous velocity information. On the other hand, these modulations might also provide the system with valuable information about the textural properties of the environment. We analyzed the influence of the size and shape of receptive fields by simulations of four versions of LPTC models consisting of arrays of elementary motion detectors of the correlation type (EMDs). These models have previously been suggested to account for many aspects of LPTC response properties. Pattern-dependent response modulations decrease with an increasing number of EMDs included in the receptive field of the LPTC models, since spatial changes within the visual field are smoothed out by the summation of spatially displaced EMD responses. This effect depends on the shape of the receptive field, being the more pronounced--for a given total size--the more elongated the receptive field is along the direction of motion. Large elongated receptive fields improve the quality of velocity signals. However, if motion signals need to be localized the velocity coding is only poor but the signal provides--potentially useful--local pattern information. These modelling results suggest that motion vision by correlation type movement detectors is subject to uncertainty: you cannot obtain both an unambiguous and a localized velocity signal from the output of a single cell. Hence, the size and shape of receptive fields of motion sensitive neurons should be matched to their potential computational task.     

Orientation tuning of motion-sensitive neurons shaped by vertical-horizontal network interactions

We measured the orientation tuning of two neurons of the fly lobula plate (H1 and H2 cells) sensitive to horizontal image motion. Our results show that H1 and H2 cells are sensitive to vertical motion, too. Their response depended on the position of the vertically moving stimuli within their receptive field. Stimulation within the frontal receptive field produced an asymmetric response: upward motion left the H1/H2 spike frequency nearly unaltered while downward motion increased the spike frequency to about 40% of their maximum responses to horizontal motion. In the lateral parts of their receptive fields, no such asymmetry in the responses to vertical image motion was found. Since downward motion is known to be the preferred direction of neurons of the vertical system in the lobula plate, we analyzed possible interactions between vertical system cells and H1 and H2 cells. Depolarizing current injection into the most frontal vertical system cell (VS1) led to an increased spike frequency, hyperpolarizing current injection to a decreased spike frequency in both H1 and H2 cells. Apart from VS1, no other vertical system cell (VS2-8) had any detectable influence on either H1 or H2 cells. The connectivity of VS1 and H1/H2 is also shown to influence the response properties of both centrifugal horizontal cells in the contralateral lobula plate, which are known to be postsynaptic to the H1 and H2 cells. The vCH cell receives additional input from the contralateral VS2-3 cells via the spiking interneuron V1.     

Visual processing of moving single objects and wide-field patterns in flies: Behavioural analysis after laser-surgical removal of interneurons

A laser micro-beam unit was used to reproducibly and selectively eliminate the large horizontal and vertical motion sensitive neurons (H- and V-cells) of the lobula plate on one side of the brain of house fliesMusca domestica. This was achieved by ablating the precursors of these cells deep in the larval brain without damaging other cells in the brain or other tissues. The individually reared flies were tested for their behaviour. Three tests were performed: (i) visual fixation of a single stripe, (ii) the optomotor turning and thrust response to a stripe moving clockwise and counterclockwise around the fly, (iii) the monocular turning response to a moving grating. The responses to a moving single object were normal on both sides, the control side and the one lacking the H- and V-cells. However, the responses to a moving grating were reduced on the side lacking H- and V-cells for progressive (front to back) and regressive (back to front) motion. From this we conclude that the response to single objects is controlled mainly by cells other than the H- and V-cells. We also suggest two separate pathways for the processing of single object motion and wide field pattern motion respectively (Fig. 8). Furthermore, the H- and V-cells might function as visual stabilizers and background motion processors.