An evaluation of video playback using Xiphophorus helleri

Video playback is being increasingly used as a technique for behavioural research. The importance of critically evaluating the effectiveness of video playback is clear, as available video technology is not designed for nonhuman visual systems. We discuss several aspects concerning the perception of video images that could lead to inconclusive or erroneous results. Researchers should verify that behaviour observed in response to video playback is comparable to behaviour observed in response to live animals. We conducted such a verification using live and video playback methods to measure female response to swords of varying lengths in the green swordtail, Xiphophorus helleri. Using both methods, female response appeared to be an increasing function of male sword length. Females did not differ in their response to live and video versions of noncourting, noninteractive males, however, females tended to prefer video playbacks of males with longer swords, a result that has also been found in experiments using live males. These results suggest that females express the same qualitative mating preference, but not necessarily the same quantitative preference, for sword length when viewing video stimuli. Several methodological factors that may contribute to an apparent difference in the strength of the preference are discussed. Despite these differences, both methods produced comparable results; female response to sworded males tended to increase as sword length increased. These experiments demonstrate that video playback is an effective method to measure female preferences accurately in X. helleri and provide an example of how video playback can be evaluated in other species. Copyright 2000 The Association for the Study of Animal Behaviour.     

Response to Video and Computer-animated Images by the Tiger Barb, Puntius tetrazona

Video playback has become an important tool for testing certain questions about animal visual perception. While a few studies have compared the response of test subjects to live and video stimuli, it is generally assumed a priori that the animals will respond to the video image as if it were real. Since video devices are tuned to the spectral sensitivities and flicker fusion frequencies of the human eye and brain, it is important to conduct preliminary tests to compare the response of test subjects between live and video images. Here we compare schooling behavior of tiger barbs, Puntius tetrazona, when presented with a school of live fish, an analog video school of fish and a video of a computer-animated school of fish. Test subjects did not show a significantly different schooling behavior response to any of these stimuli. Additionally, when given the choice of schooling with a conspecific versus a heterospecific, tiger barbs schooled significantly more often with the conspecifics for all three stimulus formats. This study provides evidence that tiger barbs do not choose to discriminate between live and video models of fish and that this technique can be used to test future questions concerning visual perception for this species.     

Digital video playback and visual communication in lizards

Experimental analyses of dynamic visual signals have to overcome the technical obstacle of reproducing complex motor patterns such as those found in courtship and threat displays. Video playback offers a potential solution to this problem, but it has recently been criticized because of sensory differences between humans and nonhuman animals, which suggest that video stimuli might be perceived as deficient relative to live conspecifics. Quantitative comparisons are therefore necessary to determine whether video sequences reliably evoke natural responses. Male Jacky dragons, Amphibolurus muricatus, compete for territories using complex displays delivered in a rapid stereotyped sequence. We evaluated video playback as a technique for studying this visual signal. Digital video sequences depicting a life-sized displaying male were indistinguishable from live male conspecifics in the rate and structure of aggressive displays evoked. Other measures of social behaviour suggested that video stimuli were more effective in this context. Lizards produced significantly more appeasement displays and had higher rates of substrate licking and locomotor activity in response to video playback than to confined male opponents, which failed to produce aggressive displays. Lizards tracked temporal changes in the display rate of video stimuli and were also sensitive to individual differences in morphology and behaviour between video exemplars. These results show that video stimuli are appropriate for the experimental analysis of Jacky dragon aggressive displays. We compare the potential shortcomings of video playback with those of other techniques and conclude that no approach offers a panacea, but that several have complementary characteristics. Copyright 2002 The Association for the Study of Animal Behaviour. Published by Elsevier Science Ltd. All rights reserved.     

Domestic chicks' runway responses to video images of conspecifics

Because chickens are highly social animals, live conspecifics are often used to provide an incentive or goal in studies of gait, sociality or fear that require the bird to traverse a runway. However, the variable behaviour of the stimulus birds can influence the approach/avoidance responses of the test birds and thereby confound the results. Because chickens modify their behaviour readily and appropriately to a variety of video images, including social stimuli, we asked if video playback might represent easily controllable and standardized alternatives to live birds. Female ISA Brown chicks were housed in groups of eight and then exposed to a blank illuminated television for 10 min per day from 2 to 7 days of age. At 8 or 9 days of age they were placed individually in the start box of a 1.6 m long runway and we recorded their responses to a monitor displaying selected video images that was situated in the goal box at the opposite end of the runway. In Experiment 1 chicks approached a monitor playing the video image and soundtrack of feeding chicks significantly sooner than one of a goal box with the food dish and background noise. In Experiment 2, chicks were exposed to the same video of feeding conspecifics with or without the associated sounds or to a video of the goal box with or without the chick soundtrack. Both the videos of other chicks elicited faster approach than did those of the goal box and the sound and silent versions were equally attractive. Adding the soundtrack of feeding chicks to the goal-box video failed to increase its attractiveness. The present results suggest that chicks are attracted towards televised images of other chicks. They also indicate that the visual and auditory components of the video stimuli did not exert additive effects and that approach reflected attraction to the visual image. Collectively, our findings suggest that video playback of selected social stimuli, such as feeding conspecifics, could be a valuable tool in tests requiring voluntary locomotion along a predetermined path.     

Behavioural responses to video playbacks by zebra finch males

A major problem for communication research is to provide standardized stimuli and to disentangle the relative contribution of different sensory channels to the compound signal and its effectiveness. Video techniques have frequently been used for this purpose. Fifty Hertz cathode ray tube (CRT) screens cannot be used for birds because their flicker frequency is lower than the time resolution of at least songbirds. Thin film transistor (TFT) screens have successfully been used to present video clips of behaving conspecifics. We show here that they are indeed transmitting video images in a way that enables zebra finches to react appropriately to live video images of conspecifics and that the test birds are able to detect small differences in the behaviour of the stimulus animals. Adding acoustic information strongly enhanced the reaction to the video clips.     

Use of digitally modified videos to examine female mate preference for orange spot coloration of males in the guppy, Poecilia reticulata

Digitally modified video techniques may provide some advantages for the behavioral study of animals, including fishes. However, the validity of the experiments that are conducted using digitally modified videos should be verified. In the present study, we examined female mate preference in the guppy, Poecilia reticulata in a Japanese population by exploring an appropriate method involving the use of digitally modified video playbacks. For the male stimulus, two video images were produced by digital modification of a video recording of a male; the brightness of the orange spot coloration of the male was enhanced (bright male) in one video and decreased (dull male) in the other video. In experiment 1, female choice was examined according to the method described in previous studies, i.e., two monitors were set on opposite sides of the test aquarium to simultaneously present two stimulus male images to the females. However, in this experiment, the stimulus male images did not attract the females to a greater extent than the blank aquarium images. In addition, although the first trial showed a female preference for bright males, in the second trial, in which each stimulus male image was shown from the monitor opposite to that used in the first trial, a significant preference for bright males could not be detected. In experiment 2, a monitor was placed on one side of the aquarium and the left and right sides of the monitor showed the two stimulus male images simultaneously. In addition, a 24-h time interval was set between the first and second trials. Females spent more time in the proximity of the male images than that of the blank images, and a female preference for bright males was observed in both trials. The results of this study clearly indicate the female preference for males possessing bright coloration of orange spots. These results also suggest that the one-sided monitor system adopted in experiment 2 is a more appropriate method than the two-sided monitor system to examine female mate preferences by using digitally modified video playbacks.     

Video Playback Versus Live Stimuli for Assessing Mate Choice in a Pipefish

Synopsis In this study, I investigated the application of the video playback technique to studies on mate choice in the pipefish, Syngnathus typhle. In this sex-role reversed species, the males are predominately the choosing sex, and given a choice, prefer to mate with larger females. As such, I tested if this known mate preference remained when using this novel experimental technique. Specifically, I compared the response of males to video images of females to that of live females. Results revealed that male pipefish showed a stronger preference for the larger female in the video playback treatment than in the clear glass (two-way interaction) live female treatment. This experiment has, therefore, demonstrated that the pipefish respond in the predicted direction in response to video playback, and as such proves to be a reliable method to study mate preferences in this species.     

Computer-manipulated stimuli as a research tool in Mozambique tilapia <Emphasis Type="Italic">Oreochromis mossambicus</Emphasis>

Multimodal communication is essential in social interactions in cichlid fish, including conspecifics’ recognition, agonistic interactions and courtship behaviour. Computer-manipulated image stimuli and sound playback offer powerful tools to assess the relative relevance of visual and acoustic stimuli in fish behavioural studies, but these techniques require validation for each taxon. The aim of the present study was to investigate whether Mozambique tilapia Oreochromis mossambicus responds to computer-manipulated visual stimuli and acoustic playback. Six experiments were conducted: computer animation playback, video playback, interaction with a mirror, presentation of a live male in a jar alone and combined with courting sound playback or with white noise playback. Individual agonistic interactions (lateral displays, up and down swimming, butting) and courting behaviours (tilting leading, digging) were tallied for each experiment. Our results suggest that non-interactive computer-manipulated visual stimuli is not a suitable tool in behavioural research with Mozambique tilapia. In contrast, interaction with a live male in a jar seems to remain the best visual research instrument inducing significant strong behavioural responses. Although none or only a few agonistic interactions were observed towards video playbacks or computer animations, such interactions significantly increased towards a male in jar and were modulated by courtship sound playback, suggesting the additional relevance of sound playback as a tool in behavioural research with Mozambique tilapia, including the study of multimodal signalling.     

Can video images imitate real stimuli in animal behaviour experiments?

The use of video images in place of natural stimuli in animal behaviour experiments is reviewed. Unlike most other artificial means of stimulus presentation, video stimuli can depict complex moving objects such as other animals, preserving the temporal and spatial patterns of movement precisely as well as colour and sounds for repeated playback. Computer editing can give flexibility and control over all elements of the stimulus. A variety of limitations of video image presentation are also considered. Televisions and video monitors are designed with human vision in mind, and some non-human animals that differ in aspects of visual processing such as their colour vision, critical flicker-fusion threshold, perception of depth and visual acuity, may perceive video images differently to ourselves. The failure of video stimuli to interact with subjects can be a drawback for some studies. For video to be useful, it is important to confirm that the subject animal responds to the image in a comparable way to the real stimulus, and the criteria used to assess this are discussed. Finally, the contribution made by video studies to date in the understanding of animal visual responses is considered, and recommendations as to the future uses of video are made.     

The relative importance of orange spot coloration and total length of males in female guppy mate preference

Female mate choice by multiple male traits is an important current topic in animal behavior. However, the relative importance among the multiple cues in female choice is not explored in most cases. Female guppies Poecilia reticulata use both the color saturation of orange spots and the total length of males as mate choice criteria. In the present study, we used digitally modified video playbacks to examine the relative importance of these two male traits to female mate preferences. We initially examined the effective difference in the color saturation of orange spots as well as that in total length between two stimulus male images. Females only showed a strong preference for a bright male image (compared to the dull image) when the difference in color saturation was large (91% versus 25%). Conversely, females only exhibited a preference for larger size when they were presented a choice between two relatively small male images (total length 26.0 mm versus 23.0 mm). When two male images in which both the two traits were modified were presented to females, they prioritized male images possessing higher color saturation of orange spots, indicating the color saturation of male orange spots to be a more important factor than the total length in their mate choice. The color saturation of orange spots may convey more reliable information about the males to the females than their total lengths. These findings imply that females may rank multiple male criteria depending on relative benefits or costs derived from their mate choice based on each criterion.     

The Use of Digitally-modified Videos to Study the Function of Ornamentation and Courtship in the Guppy, Poecilia reticulata

The use of video playback, digitally-modified video images, and animations is a potentially powerful tool for exploring the interactions between morphological and behavioral components of complex sexually selected traits. The utility of digitally-modified video was evaluated by the responses of females to male images in which either the behavioral components of display or the colors of ornamentation were manipulated. Females were presented with paired male images that varied only in the size of the orange or blue spot on the body (19.1% vs. 8.6%), courtship duration (7sec vs. 2.3sec), or courtship rate (3 displays min^-1 vs. 1 display min^-1). Females preferred male images with more vigorous courtship displays (both duration and rate) but did not discriminate between images differing in spot size. The results of the present study suggest that females discriminate more strongly between variation in male behavior than in their morphological attributes. The results of morphological manipulations should be interpreted with caution, however, because several factors could have contributed to the lack of female responses to color spot variation. Among them are lowered resolution of the computer image, which fails to capture the precision and complexity of the color pattern. Despite these potential difficulties, digitally-modified video promises to be a powerful method to study complex visual communication systems, where the function of and interaction between the various morphological and behavioral components is as yet poorly understood.     

A 3D-Video-Based Computerized Analysis of Social and Sexual Interactions in Rats

A large number of studies have analyzed social and sexual interactions between rodents in relation to neural activity. Computerized video analysis has been successfully used to detect numerous behaviors quickly and objectively; however, to date only 2D video recording has been used, which cannot determine the 3D locations of animals and encounters difficulties in tracking animals when they are overlapping, e.g., when mounting. To overcome these limitations, we developed a novel 3D video analysis system for examining social and sexual interactions in rats. A 3D image was reconstructed by integrating images captured by multiple depth cameras at different viewpoints. The 3D positions of body parts of the rats were then estimated by fitting skeleton models of the rats to the 3D images using a physics-based fitting algorithm, and various behaviors were recognized based on the spatio-temporal patterns of the 3D movements of the body parts. Comparisons between the data collected by the 3D system and those by visual inspection indicated that this system could precisely estimate the 3D positions of body parts for 2 rats during social and sexual interactions with few manual interventions, and could compute the traces of the 2 animals even during mounting. We then analyzed the effects of AM-251 (a cannabinoid CB1 receptor antagonist) on male rat sexual behavior, and found that AM-251 decreased movements and trunk height before sexual behavior, but increased the duration of head-head contact during sexual behavior. These results demonstrate that the use of this 3D system in behavioral studies could open the door to new approaches for investigating the neuroscience of social and sexual behavior.     

Motion vectors and deep neural networks for video camera traps

Commercial camera traps are usually triggered by a Passive Infra-Red (PIR) motion sensor necessitating a delay between triggering and the image being captured. This often seriously limits the ability to record images of small and fast moving animals. It also results in many “empty” images, e.g., owing to moving foliage against a background of different temperature. In this paper we detail a new triggering mechanism based solely on the camera sensor. This is intended for use by citizen scientists and for deployment on an affordable, compact, low-power Raspberry Pi computer (RPi). Our system introduces a video frame filtering pipeline consisting of movement and image-based processing. This makes use of Machine Learning (ML) feasible on a live camera stream on an RPi. We describe our free and open-source software implementation of the system; introduce a suitable ecology efficiency measure that mediates between specificity and recall; provide ground-truth for a video clip collection from camera traps; and evaluate the effectiveness of our system thoroughly. Overall, our video camera trap turns out to be robust and effective.     

Variation in female guppy preference for male olfactory and visual traits

Animals often use different sensory systems to assess different sexually selected signals from potential mates. However, the relative importance of different signals on mate choice is not well understood in many animal species. In this study, we examined the relative importance of male olfactory and visual cues on female preference in the guppy Poecilia reticulata. We used digitally modified male images to standardize visual stimuli. We found that, regardless of whether females were presented without male visual stimuli or with identical male visual stimuli, they preferred stimuli with the odor of males to those without. However, when females were allowed to choose between dull male visual stimuli with male odor, and brightly colored male visual stimuli without male odor, there was no clear preference for either. Some females preferred the dull male visual stimuli with male odor, whereas some other females preferred the brightly colored male visual stimuli without male odor. These results indicate that the relative importance of olfactory and visual cues in female mate preference varied between individuals.     

Considerations on the use of video playbacks as visual stimuli: the Lisbon workshop consensus

This paper is the consensus of a workshop that critically evaluated the utility and problems of video playbacks as stimuli in studies of visual behavior. We suggest that video playback is probably suitable for studying motion, shape, texture, size, and brightness. Studying color is problematic because video systems are specifically designed for humans. Any difference in color perception must lead to a different color sensation in most animals. Another potentially problematic limitation of video images is that they lack depth cues derived from stereopsis, accommodation, and motion parallax. Nonetheless, when used appropriately, video playback allows an unprecedented range of questions in visual communication to be addressed. It is important to note that most of the potential limitations of video playback are not unique to this technique but are relevant to all studies of visual signaling in animals. Received: 20 October 1999 / Accepted: 5 November 1999     

An evaluation of the efficacy of video displays for use with chimpanzees (Pan troglodytes)

Video displays for behavioral research lend themselves particularly well to studies with chimpanzees (Pan troglodytes), as their vision is comparable to humans', yet there has been no formal test of the efficacy of video displays as a form of social information for chimpanzees. To address this, we compared the learning success of chimpanzees shown video footage of a conspecific compared to chimpanzees shown a live conspecific performing the same novel task. Footage of an unfamiliar chimpanzee operating a bidirectional apparatus was presented to 24 chimpanzees (12 males, 12 females), and their responses were compared to those of a further 12 chimpanzees given the same task but with no form of information. Secondly, we also compared the responses of the chimpanzees in the video display condition to responses of eight chimpanzees from a previously published study of ours, in which chimpanzees observed live models. Chimpanzees shown a video display were more successful than those in the control condition and showed comparable success to those that saw a live model. Regarding fine-grained copying (i.e. the direction that the door was pushed), only chimpanzees that observed a live model showed significant matching to the model's methods with their first response. Yet, when all the responses made by the chimpanzees were considered, comparable levels of matching were shown by chimpanzees in both the live and video conditions.     

Simple method for quantification of fast plasma membrane movements.

We present a method for the quantification of the fast plasma membrane movements that are involved in ruffling, blebbing, fast shape change, and fast translocation. The method is based on the Kontron Vidas image analysis computer program. Video images from cells viewed through an inverted microscope were transmitted to the computer. The procedure was as follows: 4 consecutive video images were averaged (image 1); 28 s later a second set of 4 video images was averaged (image 2); image 2 was subtracted from image 1 and the grey level of each pixel of the resulting image was increased with 128 grey level units, resulting in the subtraction image, showing a uniform grey background speckled with brighter and darker spots corresponding to areas of movement. These spots were discriminated and turned into white objects against a black background. Interactive editing was used to delete artefacts that resulted from floating debris. The total area of the discriminated objects was measured, and the parameter motile area in micron2 per cell was calculated. We have applied our method to the study of motility induced in epithelial cell lines by the tumor promoter 12-O-tetradecanoyl-phorbol-13-acetate and by epidermal growth factor.     

Lateralisation in agonistic encounters: do mirror tests reflect aggressive behaviour? A study on a West African cichlid

In this study, population level lateralisation and the suitability of mirror tests as a test of natural aggressive behaviour in male rainbow kribs Pelvicachromis pulcher was investigated. Aggressive behaviour in live agonistic trials correlated positively with behaviours towards a mirror image and no visual lateralisation was detected.     

Through a barn owl’s eyes: interactions between scene content and visual attention

In this study we investigated visual attention properties of freely behaving barn owls, using a miniature wireless camera attached to their heads. The tubular eye structure of barn owls makes them ideal subjects for this research since it limits their eye movements. Video sequences recorded from the owl’s point of view capture part of the visual scene as seen by the owl. Automated analysis of video sequences revealed that during an active search task, owls repeatedly and consistently direct their gaze in a way that brings objects of interest to a specific retinal location (retinal fixation area). Using a projective model that captures the geometry between the eye and the camera, we recovered the corresponding location in the recorded images (image fixation area). Recording in various types of environments (aviary, office, outdoors) revealed significant statistical differences of low level image properties at the image fixation area compared to values extracted at random image patches. These differences are in agreement with results obtained in primates in similar studies. To investigate the role of saliency and its contribution to drawing the owl’s attention, we used a popular bottom-up computational model. Saliency values at the image fixation area were typically greater than at random patches, yet were only 20% out of the maximal saliency value, suggesting a top-down modulation of gaze control.     

Risky Courtship: Background Contrast,Ornamentation, and Display Behavior of Wolf Spiders Affect Visual Detection by Toad Predators

Males that search widely for females and perform conspicuous courtship displays run a high risk of being detected by their predators. Therefore, gains in reproductive success might be offset by increased mortality due to predation. Male brush‐legged wolf spiders (Schizocosa ocreata) with larger decorative traits (foreleg tufts) are preferred by females as mates, but are more readily detected by predators. However, predation risk may also be influenced by the interaction between components of signals and the environment in which signaling occurs. Courting male spiders were readily accepted as prey by a sympatric predator, the American toad (Anaxyrus americanus). We used video playback to tease apart the interactive effect between visual signals and the signaling environment on the ability of toads to detect courting spiders as a function of distance, background contrast, the presence or absence of male foreleg tufts, and behavioral activity. The response of toads to video sequences of male spiders was similar to their response to live male spiders. Toad response varied over distance toward spiders displayed against high contrast (sunny) vs. low contrast (shaded) backgrounds. Beyond 30 cm, more toads detected courting male spiders against light, ‘sunny’ backgrounds and detected them faster when compared to the same spider stimulus against darker, ‘shady’ backgrounds. In choice tests, toads oriented more often toward courting males with leg tufts than those without. Toad responses also varied with male spider behavior in that only videos of moving males were attacked. Latency to orient and detection by toads was significantly greater for walking males than courting males, and this effect was most evident at distances between 30 cm and 50 cm. Results supported that courting wolf spiders are at significant risk of predation by visually acute predators. Distance, background contrast, and the presence of foreleg decorations influence detection probability. Thus, the same complex visual signals that make males conspicuous and are preferred by females can make males more vulnerable as prey to toads.