Using deep neural networks to model similarity between visual patterns: Application to fish sexual signals

The evolution of visual patterns is a frontier in the theory of sexual selection as we seek to understand the function of complex visual patterning in courtship. Recently, the sensory drive and sensory bias models of sexual selection have been applied to higher-level visual processing. One prediction of this application is that animals' sexual signals will mimic the visual statistics of their habitats. An enduring difficulty of testing predictions of visual pattern evolution is in developing quantitative methods for comparing patterns. Advances in artificial neural networks address this challenge by allowing for the direct comparison of images using both simple and complex features. Here, we use VGG19, an industry‑leading image classification network to test predictions of sensory drive, by comparing visual patterns in darter fish (Etheostoma spp.) to images of their habitats. We find that images of female darters are significantly more similar to images of their habitat than are images of males, supporting a role of camouflage in female patterning. We do not find direct evidence for sensory drive shaping the design of male patterns; however, this work demonstrates the utility of network methods for pattern analysis and suggests future directions for visual pattern research.