Non-visual environmental imaging and object detection through active electrolocation in weakly electric fish

Weakly electric fish orient at night by employing active electrolocation. South American and African species emit electric signals and perceive the consequences of these emissions with epidermal electroreceptors. Objects are detected by analyzing the electric images which they project onto the animal’s electroreceptive skin surface. Electric images depend on size, distance, shape, and material of objects and on the morphology of the electric organ and the fish’s body. It is proposed that the mormyrid Gnathonemus petersii possesses two electroreceptive “foveae” at its Schnauzenorgan and its nasal region, both of which resemble the visual fovea in the retina of many animals in design, function, and behavioral use. Behavioral experiments have shown that G. petersii can determine the resistive and capacitive components of an object’s complex impedance in order to identify prey items during foraging. In addition, fish can measure the distance and three-dimensional shape of objects. In order to determine object properties during active electrolocation, the fish have to determine at least four parameters of the local signal within an object’s electric image: peak amplitude, maximal slope, image width, and waveform distortions. A crucial parameter is the object distance, which is essential for unambiguous evaluation of object properties.     

Electric images of two low resistance objects in weakly electric fish

Electroreceptive fish detect nearby objects by processing the information contained in the pattern of electric currents through their skin. In weakly electric fish, these currents arise from a self-generated field (the electric organ discharge), depending on the electrical properties of the surrounding medium. The electric image can be defined as the pattern of transepidermal voltage distributed over the receptive surface. To understand electrolocation it is necessary to know how electric image of objects are generated. In pulse mormyrids, the electric organ is localized at the tail, far from the receptors and fires a short biphasic pulse. Consequently, if all the elements in the environment are resistive, the stimulus at every point on the skin has the same waveform. Then, any measure of the amplitude (for example, the peak to peak amplitude) could be the unique parameter of the stimulus at any point of the skin. We have developed a model to calculate the image, corroborating that images are spread over the whole sensory surface and have an opposite center-surround, "Mexican-hat" shape. As a consequence, the images of different objects superimpose. We show theoretically and by simulation that the image of a pair of objects is not the simple addition of the individual images of these objects.     

Distance and shape: perception of the 3-dimensional world by weakly electric fish.

Weakly electric fish orient at night in complete darkness by employing their active electrolocation system. They emit short electric signals and perceive the consequences of these emissions with epidermal electroreceptors. Objects are detected by analyzing the electric images which they project onto the animal's electroreceptive skin surface. This process corresponds to similar processes during vision, where visual images are cast onto the retinas of eyes. Behavioral experiments have shown that electric fish can measure the distance of objects during active electrolocation, thus possessing three-dimensional depth perception of their surroundings. The fundamental mechanism for distance determination differs from stereopsis used during vision by two-eyed animals, but resembles some supplementary mechanisms for distance deduction in humans. Weakly electric fish can also perceive the three-dimensional shape of objects. The fish can learn to identify certain objects and discriminate them from all other objects. In addition, they spontaneously categorize objects according to their shapes and not according to object size or material properties. There is good evidence that some fundamental types of perceptional invariances during visual object recognition in humans are also found in electric fish during active electrolocation. These include size invariance (maybe including size constancy), rotational invariance, and translational invariance. The mechanisms of shape detection during electrolocation are still unknown, and their discoveries require additional experiments.     

Three-dimensional analysis of object properties during active electrolocation in mormyrid weakly electric fishes (Gnathonemus petersii)

Weakly electric fishes are nocturnal and orientate in the absence of vision by using their electrical sense. This enables them not only to navigate but also to perceive and recognize objects in complete darkness. They create an electric field around their bodies by producing electric signals with specialized electric organs. Objects within this field alter the electric current at electroreceptor organs, which are distributed over almost the entire body surface. During active electrolocation, fishes detect, localize and analyse objects by monitoring their self-produced electric signals. We investigated the ability of the mormyrid Gnathonemus petersii to perceive objects three-dimensionally in space. Within a range of about 12 cm, G. petersii can perceive the distance of objects. Depth perception is independent of object size, shape and material. The mechanism for distance determination through electrolocation involves calculating the ratio between two parameters (maximal slope and maximal amplitude) of the electrical image which each object projects onto the fish's skin. During active electrolocation, electric fishes cannot only locate objects in space but in addition can determine the three-dimensional shape of an object. Up to certain limits, objects are spontaneously categorized according to their shapes, but not according to their sizes or the materials of which they are made.     

Fish geometry and electric organ discharge determine functional organization of the electrosensory epithelium

Active electroreception in Gymnotus omarorum is a sensory modality that perceives the changes that nearby objects cause in a self generated electric field. The field is emitted as repetitive stereotyped pulses that stimulate skin electroreceptors. Differently from mormyriformes electric fish, gymnotiformes have an electric organ distributed along a large portion of the body, which fires sequentially. As a consequence shape and amplitude of both, the electric field generated and the image of objects, change during the electric pulse. To study how G. omarorum constructs a perceptual representation, we developed a computational model that allows the determination of the self-generated field and the electric image. We verify and use the model as a tool to explore image formation in diverse experimental circumstances. We show how the electric images of objects change in shape as a function of time and position, relative to the fish's body. We propose a theoretical framework about the organization of the different perceptive tasks made by electroreception: 1) At the head region, where the electrosensory mosaic presents an electric fovea, the field polarizing nearby objects is coherent and collimated. This favors the high resolution sampling of images of small objects and perception of electric color. Besides, the high sensitivity of the fovea allows the detection and tracking of large faraway objects in rostral regions. 2) In the trunk and tail region a multiplicity of sources illuminate different regions of the object, allowing the characterization of the shape and position of a large object. In this region, electroreceptors are of a unique type and capacitive detection should be based in the pattern of the afferents response. 3) Far from the fish, active electroreception is not possible but the collimated field is suitable to be used for electrocommunication and detection of large objects at the sides and caudally.     

Modeling the electric image produced by objects with complex impedance in weakly electric fish

Weakly electric fish generate an electric field around their body by electric organ discharge (EOD). By measuring the modulation of the electric field produced by an object in the field these fish are able to accurately locate an object. Theoretical and experimental studies have focused on the amplitude modulations of EODs produced by resistive objects. However, little is known about the phase modulations produced by objects with complex impedance. The fish must be able to detect changes in object impedance to discriminate between food and nonfood objects. To investigate the features of electric images produced by objects with complex impedance, we developed a model that can be used to map the electric field around the fish body. The present model allows us to calculate the spatial distribution of the amplitude and phase shift in an electric image. This is the first study to investigate the changes in amplitude and phase shift of electric images induced by objects with complex impedance in wave-type fish. Using the model, we show that the amplitude of the electric image exhibits a sigmoidal change as the capacitance and resistance of an object are increased. Similarly, the phase shift exhibits a significant change within the object capacitance range of 0.1–100 nF. We also show that the spatial distribution of the amplitude and phase shifts of the electric image resembles a “Mexican hat” in shape for varying object distances and sizes. The spatial distribution of the phase shift and the amplitude was dependent on the object distance and size. Changes in the skin capacitance were associated with a tradeoff relationship between the magnitude of the amplitude and phase shift of the electric image. The specific range of skin capacitance (1–100 nF) allows the receptor afferents to extract object features that are relevant to electrolocation. These results provide a useful basis for the study of the neural mechanisms by which weakly electric fish recognize object features such as distance, size, and impedance.     

Imaging of objects through active electrolocation in Gnathonemus petersii.

The weakly electric fish Gnathonemus petersii detects, localizes, and analyzes objects during active electrolocation even in complete darkness. This enables these fish to lead a nocturnal life and find and identify their prey (small insect larvae) on the ground of their freshwater habitat. During active electrolocation, fish produce a series of brief electric signals, electric organ discharges (EOD), with an electric organ in their tail. Each EOD builds up a stable electric field around the fish, which is distorted only by nearby objects. Field distortions lead to changes of the transepidermal electric current flow at a region of the fish's electroreceptive skin surface called the 'electric image'. Within the electric image, locally perceived EODs can be either altered in amplitude or waveform by an object. Fish measure both parameters to assess object properties, such as the capacitive and resistive components of the object's complex impedance. the object's size and shape, and its distance from the fish. None of these object properties can be evaluated in isolation, but have to be inferred during parallel processing of electric image spatial and qualitative parameters. Two anterior skin regions of G. petersii appear to possess particular properties for special electrolocation tasks and we therefore refer to them as 'foveal' regions. Because of its high electroreceptor density, the electric field geometry around it, and its behavioral use, the 'nasal region' between the nares and the mouth at the head of the fish is suggested to be a fovea for long-range guidance and object detection. We propose that the 'Schnauzenorgan', a long and flexible chin appendix covered densely with electroreceptor organs, is a second electroreceptive fovea associated with a short-range (food) identification system. Together, these two electric foveae constitute an effective prey detection and identification system.     

The effects of simple objects on the electric field of Apteronotus

How might electric fish determine, from patterns of transdermal voltage changes, the size, shape, location, and impedance of a nearby object? I have investigated this question by measuring and simulating electric images of spheres and ellipsoids near an Apteronotus leptorhynchus. Previous studies have shown that this fish's electric field magnitude, and perturbations of the field due to objects, are complicated nonliner functions of distance from the fish. These functions become much simpler when distance is measured from the axes of symmetry of the fish and the object, instead of their respective edges. My analysis suggests the following characteristics of high frequency electric sense and electric images. 1. The shape of electric images on the fish's body is relatively independent of a spherical object's radius, conductivity, and rostrocaudal location. 2. An image's relative width increases linearly with lateral distance, and might therefore unambiguously encode object distance. 3. Only objects with very large dielectric constants cause appreciable phase shifts, and the degree of shift depends strongly on water conductivity. 4. Several parameters, such as the range of electric sense, may depend on the rostrocaudal location of an object. Large objects may be detectable further from the head than the tail, and conversely, small objects may be detectable further from the tail than head. 5. Asymmetrical objects produce different electric images, correlated with their cross-sections, for different orientations and phases of the electric field. 6. The steep attenuation with distance of the field magnitude causes spatial distortions in electric images, somewhat analogous to the perspective distortion inherent in wide angle optical lenses.     

Biomimetic Sensors: Active Electrolocation of Weakly Electric Fish as a Model for Active Sensing in Technical Systems

Instead of vision, many nocturnal animals use alternative senses for navigation and object detection in their dark environment. For this purpose, weakly electric mormyrid fish employ active electrolocation, during which they discharge a specialized electric organ in their tail which discharges electrical pulses. Each discharge builds up an electrical field around the fish, which is sensed by cutaneous electroreceptor organs that are distributed over most of the body surface of the fish. Nearby objects distort this electrical field and cause a local alteration in current flow in those electroreceptors that are closest to the object. By constantly monitoring responses of its electroreceptor organs, a fish can detect, localize, and identify environmental objects.Inspired by the remarkable capabilities of weakly electric fish in detecting and recognizing objects, we designed technical sensor systems that can solve similar problems of remote object sensing. We applied the principles of active electrolocation to technical systems by building devices that produce electrical current pulses in a conducting medium (water or ionized gases) and simultaneously sense local current density. Depending on the specific task a sensor was designed for devices could (i) detect an object, (ii) localize it in space, (iii) determine its distance, and (iv) measure properties such as material properties, thickness, or material faults. Our systems proved to be relatively insensitive to environmental disturbances such as heat, pressure, or turbidity. They have a wide range of applications including material identification, quality control, non-contact distance measurements, medical applications and many more. Despite their astonishing capacities, our sensors still lag far behind what electric fish are able to achieve during active electrolocation. The understanding of the neural principles governing electric fish sensory physiology and the corresponding optimization of our sensors to solve certain technical tasks therefore remain ongoing goals of our research.     

Biomimetic Sensors： Active Electrolocation of Weakly Electric Fish as a Model for Active Sensing in Technical Systems

Instead of vision, many nocturnal animals use alternative senses for navigation and object detection in their dark environment. For this purpose, weakly electric mormyrid fish employ active electrolocation, during which they discharge a specialized electric organ in their tail which discharges electrical pulses. Each discharge builds up an electrical field around the fish, which is sensed by cutaneous electroreceptor organs that are distributed over most of the body surface of the fish. Nearby objects distort this electrical field and cause a local alteration in current flow in those electroreceptors that are closest to the object. By constantly monitoring responses of its electroreceptor organs, a fish can detect, localize, and identify environmental objects.Inspired by the remarkable capabilities of weakly electric fish in detecting and recognizing objects, we designed technical sensor systems that can solve similar problems of remote object sensing. We applied the principles of active electrolocation to technical systems by building devices that produce electrical current pulses in a conducting medium (water or ionized gases) and simultaneously sense local current density. Depending on the specific task a sensor was designed for devices could (i) detect an object, (ii) localize it in space, (iii) determine its distance, and (iv) measure properties such as material properties, thickness, or material faults. Our systems proved to be relatively insensitive to environmental disturbances such as heat, pressure, or turbidity. They have a wide range of applications including material identification, quality control, non-contact distance measurements, medical applications and many more. Despite their astonishing capacities, our sensors still lag far behind what electric fish are able to achieve during active electrolocation. The understanding of the neural principles governing electric fish sensory physiology and the corresponding optimization of our sensors to solve certain technical tasks therefore remain ongoing goals of our research.     

Fish perform spatial pattern recognition and abstraction by exclusive use of active electrolocation

The field generated by the electric organ of weakly electric fish varies with the electrical properties of nearby objects. Correspondingly, current fluxes in this field differentially stimulate the electroreceptors in the fish's skin. Thus, resistors are to conductors and insulators as gray is to black and white in optics. Additionally, the capacitances of plants and insect larvae contrast with those of water or stones, giving effects comparable to "coloration". Receptors arrayed over a large area of the skin act like a retina upon which the discharge projects "electric images". By further central processing, the fish also discriminate between objects according to their composition, size, or distance, a procedure termed "electrolocation", analogous to echolocation in bats. Here we demonstrate that G. petersii and S. macrurus can also recognize 3D orientations and configurations and extract and generalize spatial features solely with their electrical sense. We presented fish with virtual electrical "objects" formed from electrodes set flush in the inner surface of a Y maze with various patterns of external connectivity. With reward and aversion training, the fish could recognize similar electrode configurations and extract a feature, e.g., a vertical connectivity, present in various novel configurations. Previously, shape recognition has only been shown in electrolocating fish when they are in full mechanical contact with solid objects.     

Active electric imaging: body-object interplay and object's "electric texture"

This article deals with the role of fish's body and object's geometry on determining the image spatial shape in pulse Gymnotiforms. This problem was explored by measuring local electric fields along a line on the skin in the presence and absence of objects. We depicted object's electric images at different regions of the electrosensory mosaic, paying particular attention to the perioral region where a fovea has been described. When sensory surface curvature increases relative to the object's curvature, the image details depending on object's shape are blurred and finally disappear. The remaining effect of the object on the stimulus profile depends on the strength of its global polarization. This depends on the length of the object's axis aligned with the field, in turn depending on fish body geometry. Thus, fish's body and self-generated electric field geometries are embodied in this "global effect" of the object. The presence of edges or local changes in impedance at the nearest surface of closely located objects adds peaks to the image profiles ("local effect" or "object's electric texture"). It is concluded that two cues for object recognition may be used by active electroreceptive animals: global effects (informing on object's dimension along the field lines, conductance, and position) and local effects (informing on object's surface). Since the field has fish's centered coordinates, and electrosensory fovea is used for exploration of surfaces, fish fine movements are essential to perform electric perception. We conclude that fish may explore adjacent objects combining active movements and electrogenesis to represent them using electrosensory information.     

Distance discrimination during active electrolocation in the weakly electric fish Gnathonemus petersii.

Weakly electric fish use active electrolocation for orientation at night. They emit electric signals (electric organ discharges) which generate an electrical field around their body. By sensing field distortions, fish can detect objects and analyze their properties. It is unclear, however, how accurately they can determine the distance of unknown objects. Four Gnathonemus petersii were trained in two-alternative forced-choice procedures to discriminate between two objects differing in their distances to a gate. The fish learned to pass through the gate behind which the corresponding object was farther away. Distance discrimination thresholds for different types of objects were determined. Locomotor and electromotor activity during distance measurement were monitored. Our results revealed that all individuals quickly learned to measure object distance irrespective of size, shape or electrical conductivity of the object material. However, the distances of hollow, water-filled cubes and spheres were consistently misjudged in comparison with solid or more angular objects, being perceived as farther away than they really were. As training continued, fish learned to compensate for these 'electrosensory illusions' and erroneous choices disappeared with time. Distance discrimination thresholds depended on object size and overall object distance. During distance measurement, the fish produced a fast regular rhythm of EOD discharges. A mechanisms for distance determination during active electrolocation is proposed.     

Distance discrimination during active electrolocation in the weakly electric fish Gnathonemus petersii

Weakly electric fish use active electrolocation for orientation at night. They emit electric signals (electric organ discharges) which generate an electrical field around their body. By sensing field distortions, fish can detect objects and analyze their properties. It is unclear, however, how accurately they can determine the distance of unknown objects. Four Gnathonemus petersii were trained in two-alternative forced-choice procedures to discriminate between two objects differing in their distances to a gate. The fish learned to pass through the gate behind which the corresponding object was farther away. Distance discrimination thresholds for different types of objects were determined. Locomotor and electromotor activity during distance measurement were monitored. Our results revealed that all individuals quickly learned to measure object distance irrespective of size, shape or electrical conductivity of the object material. However, the distances of hollow, water-filled cubes and spheres were consistently misjudged in comparison with solid or more angular objects, being perceived as farther away than they really were. As training continued, fish learned to compensate for these 'electrosensory illusions' and erroneous choices disappeared with time. Distance discrimination thresholds depended on object size and overall object distance. During distance measurement, the fish produced a fast regular rhythm of EOD discharges. A mechanisms for distance determination during active electrolocation is proposed.     

Detection of multiple stimulus features forces a trade-off in the pyramidal cell network of a gymnotiform electric fish's electrosensory lateral line lobe

Modification of an existing neural structure to support a second function will produce a trade-off between the two functions if they are in some way incompatible. The trade-off between two such sensory functions is modeled here in pyramidal neurons of the gymnotiform electric fish's medullar electrosensory lateral line lobe (ELL). These neurons detect two electric stimulus features produced when a nearby object interferes with the fish's autogenous electric field: (1) amplitude modulation across a cell's entire receptive field and (2) amplitude variation within a cell's receptive field produced by an object's edge. A model of sensory integration shows that detection of amplitude modulation and enhancement of spatial contrast involve an inherent mechanistic trade-off and that the severity of the trade-off depends on the particular algorithm of sensory integration. Electrophysiology data indicate that of the two algorithms for sensory integration modeled here for the gymnotiform fish Brachyhypopomus pinnicaudatus, the algorithm with the better trade-off function is used. Further, the intrinsic trade-off within single cells has been surmounted by the replication of ELL into multiple electrosensory map segments, each specialized to emphasize different sensory features. Accepted: 14 June 1997     

Mind the gap: the minimal detectable separation distance between two objects during active electrolocation

In a food‐rewarded two‐alternative forced‐choice procedure, it was determined how well the weakly electric elephantnose fish Gnathonemus petersii can sense gaps between two objects, some of which were placed in front of complex backgrounds. The results show that at close distances, G. petersii is able to detect gaps between two small metal cubes (2 cm × 2 cm × 2 cm) down to a width of c. 1·5 mm. When larger objects (3 cm × 3 cm × 3 cm) were used, gaps with a width of 2–3 mm could still be detected. Discrimination performance was better (c. 1 mm gap size) when the objects were placed in front of a moving background consisting of plastic stripes or plant leaves, indicating that movement in the environment plays an important role for object identification. In addition, the smallest gap size that could be detected at increasing distances was determined. A linear relationship between object distance and gap size existed. Minimal detectable gap sizes increased from c. 1·5 mm at a distance of 1 cm, to 20 mm at a distance of 7 cm. Measurements and simulations of the electric stimuli occurring during gap detection revealed that the electric images of two close objects influence each other and superimpose. A large gap of 20 mm between two objects induced two clearly separated peaks in the electric image, while a 2 mm gap caused just a slight indentation in the image. Therefore, the fusion of electric images limits spatial resolution during active electrolocation. Relative movements either between the fish and the objects or between object and background might improve spatial resolution by accentuating the fine details of the electric images.     

Peripheral electrosensory imaging by weakly electric fish

Different species have developed different solutions to the problem of constructing a representation of the environment from sensory images projected onto sensory surfaces. Comprehension of how these images are formed is an essential first step in understanding the representation of external reality by a given sensory system. Modeling of the electrical sensory images of objects began with the discovery of electroreception and continues to provide general insights into the mechanisms of imaging. Progress in electric image research has made it possible to establish the physical basis of electric imaging, as well as methods to accurately predict the electric images of objects alone and as a part of a natural electric scene. In this review, we show the following. (1) The internal low resistance of the fish’s body shapes the image in two different ways: by funneling the current generated by the electric organ to the sensory surface, it increases the fields rostrally, thus enhancing the perturbation produced by nearby objects; and by increasing the projected image. (2) The electric fish’s self-generated currents are modified by capacitive objects in a distinctive manner. These modulations can be detected by different receptor types, yielding the possibility of “electric color.” (3) The effects of different objects in a scene interact with each other, generating an image that is different from the simple addition of the images of individual objects, thus causing strong contextual effects.     

Differential responses of two types of electroreceptive afferents to signal distortions may permit capacitance measurement in a weakly electric fish,Gnathonemus petersii

Summary Gnathonemus petersii discriminates between ohmic and capacitive objects. To investigate the sensory basis of this discrimination we recorded from primary afférents that innervate either A or B mormyromast sensory cells. Modified and natural electric organ discharges were used as stimuli. In both A and B fibres frequencies below the peak-power frequency (3.8 to 4.5 kHz) of the electric organ discharge caused minimal first-spike latencies and a maximum number of spikes. A fibres did not discriminate phase-shifted stimuli, whereas B fibres responded significantly with a decrease in first-spike latency if the phase shift was only — 1°. In both A and B fibres an amplitude increase caused a decrease in spike latency and an increase in spike number; an amplitude decrease had the reverse effect. If stimulated with quasi-natural electric organ discharges distorted by capacitive objects, the responses of A fibres decreased with increasing signal distortion. In contrast, the responses of B fibres increased until amplitude effects began to dominate. Gnathonemus may use the physiological differences between A and B fibres to detect and discriminate between capacitive and purely ohmic objects.Abbreviations ELL electrosensory lateral line lobe - EOD electric organ discharge - LFS local filtered signal - p-p peak-to-peak     

Theoretical analysis of pre-receptor image conditioning in weakly electric fish

Electroreceptive fish detect nearby objects by processing the information contained in the pattern of electric currents through the skin. The distribution of local transepidermal voltage or current density on the sensory surface of the fish's skin is the electric image of the surrounding environment. This article reports a model study of the quantitative effect of the conductance of the internal tissues and the skin on electric image generation in Gnathonemus petersii (Günther 1862). Using realistic modelling, we calculated the electric image of a metal object on a simulated fish having different combinations of internal tissues and skin conductances. An object perturbs an electric field as if it were a distribution of electric sources. The equivalent distribution of electric sources is referred to as an object's imprimence. The high conductivity of the fish body lowers the load resistance of a given object's imprimence, increasing the electric image. It also funnels the current generated by the electric organ in such a way that the field and the imprimence of objects in the vicinity of the rostral electric fovea are enhanced. Regarding skin conductance, our results show that the actual value is in the optimal range for transcutaneous voltage modulation by nearby objects. This result suggests that "voltage" is the answer to the long-standing question as to whether current or voltage is the effective stimulus for electroreceptors. Our analysis shows that the fish body should be conceived as an object that interacts with nearby objects, conditioning the electric image. The concept of imprimence can be extended to other sensory systems, facilitating the identification of features common to different perceptual systems.     

The human visual system is optimised for processing the spatial information in natural visual images

A fundamental tenet of visual science is that the detailed properties of visual systems are not capricious accidents, but are closely matched by evolution and neonatal experience to the environments and lifestyles in which those visual systems must work. This has been shown most convincingly for fish and insects. For mammalian vision, however, this tenet is based more upon theoretical arguments than upon direct observations. Here, we describe experiments that require human observers to discriminate between pictures of slightly different faces or objects. These are produced by a morphing technique that allows small, quantifiable changes to be made in the stimulus images. The independent variable is designed to give increasing deviation from natural visual scenes, and is a measure of the Fourier composition of the image (its second-order statistics). Performance in these tests was best when the pictures had natural second-order spatial statistics, and degraded when the images were made less natural. Furthermore, performance can be explained with a simple model of contrast coding, based upon the properties of simple cells in the mammalian visual cortex. The findings thus provide direct empirical support for the notion that human spatial vision is optimised to the second-order statistics of the optical environment.