Visual artificial grammar learning: comparative research on humans, kea (Nestor notabilis) and pigeons (Columba livia)

Artificial grammar learning (AGL) provides a useful tool for exploring rule learning strategies linked to general purpose pattern perception. To be able to directly compare performance of humans with other species with different memory capacities, we developed an AGL task in the visual domain. Presenting entire visual patterns simultaneously instead of sequentially minimizes the amount of required working memory. This approach allowed us to evaluate performance levels of two bird species, kea (Nestor notabilis) and pigeons (Columba livia), in direct comparison to human participants. After being trained to discriminate between two types of visual patterns generated by rules at different levels of computational complexity and presented on a computer screen, birds and humans received further training with a series of novel stimuli that followed the same rules, but differed in various visual features from the training stimuli. Most avian and all human subjects continued to perform well above chance during this initial generalization phase, suggesting that they were able to generalize learned rules to novel stimuli. However, detailed testing with stimuli that violated the intended rules regarding the exact number of stimulus elements indicates that neither bird species was able to successfully acquire the intended pattern rule. Our data suggest that, in contrast to humans, these birds were unable to master a simple rule above the finite-state level, even with simultaneous item presentation and despite intensive training.     

Processing of abstract rule violations in audition

The ability to encode rules and to detect rule-violating events outside the focus of attention is vital for adaptive behavior. Our brain recordings reveal that violations of abstract auditory rules are processed even when the sounds are unattended. When subjects performed a task related to the sounds but not to the rule, rule violations impaired task performance and activated a network involving supratemporal, parietal and frontal areas although none of the subjects acquired explicit knowledge of the rule or became aware of rule violations. When subjects tried to behaviorally detect rule violations, the brain's automatic violation detection facilitated intentional detection. This shows the brain's capacity for abstraction - an important cognitive function necessary to model the world. Our study provides the first evidence for the task-independence (i.e. automaticity) of this ability to encode abstract rules and for its immediate consequences for subsequent mental processes.     

Treacherous Pavements: Paving Slab Patterns Modify Intended Walking Directions

Current understanding in locomotion research is that, for humans, navigating natural environments relies heavily on visual input; in contrast, walking on even ground in man-made obstacle and hazard-free environments is so highly automated that visual information derived from floor patterns should not affect locomotion and in particular have no impact on the direction of travel. The vision literature on motion perception would suggest otherwise; specifically that oblique floor patterns may induce substantial veering away from the intended direction of travel due to the so-called aperture problem. Here, we tested these contrasting predictions by letting participants walk over commonly encountered floor patterns (paving slabs) and investigating participants’ ability to walk “straight ahead” for different pattern orientations. We show that, depending on pattern orientation, participants veered considerably over the measured travel distance (up to 8% across trials), in line with predictions derived from the literature on motion perception. We argue that these findings are important to the study of locomotion, and, if also observed in real world environments, might have implications for architectural design.     

The spatiotemporal learning rule and its efficiency in separating spatiotemporal patterns

The hippocampus plays an important role in the course of establishing long-term memory, i.e., to make short-term memory of spatially and temporally associated input information. In 1996 (Tsukada et al. 1996), the spatiotemporal learning rule was proposed based on differences observed in hippocampal long-term potentiation (LTP) induced by various spatiotemporal pattern stimuli. One essential point of this learning rule is that the change of synaptic weight depends on both spatial coincidence and the temporal summation of input pulses. We applied this rule to a single-layered neural network and compared its ability to separate spatiotemporal patterns with that of other rules, including the Hebbian learning rule and its extended rules. The simulated results showed that the spatiotemporal learning rule had the highest efficiency in discriminating spatiotemporal pattern sequences, while the Hebbian learning rule (including its extended rules) was sensitive to differences in spatial patterns.     

Monkeys and humans share a common computation for face/voice integration

Speech production involves the movement of the mouth and other regions of the face resulting in visual motion cues. These visual cues enhance intelligibility and detection of auditory speech. As such, face-to-face speech is fundamentally a multisensory phenomenon. If speech is fundamentally multisensory, it should be reflected in the evolution of vocal communication: similar behavioral effects should be observed in other primates. Old World monkeys share with humans vocal production biomechanics and communicate face-to-face with vocalizations. It is unknown, however, if they, too, combine faces and voices to enhance their perception of vocalizations. We show that they do: monkeys combine faces and voices in noisy environments to enhance their detection of vocalizations. Their behavior parallels that of humans performing an identical task. We explored what common computational mechanism(s) could explain the pattern of results we observed across species. Standard explanations or models such as the principle of inverse effectiveness and a "race" model failed to account for their behavior patterns. Conversely, a "superposition model", positing the linear summation of activity patterns in response to visual and auditory components of vocalizations, served as a straightforward but powerful explanatory mechanism for the observed behaviors in both species. As such, it represents a putative homologous mechanism for integrating faces and voices across primates.     

Visual Acceleration Perception for Simple and Complex Motion Patterns

Humans are able to judge whether a target is accelerating in many viewing contexts, but it is an open question how the motion pattern per se affects visual acceleration perception. We measured acceleration and deceleration detection using patterns of random dots with horizontal (simpler) or radial motion (more visually complex). The results suggest that we detect acceleration better when viewing radial optic flow than horizontal translation. However, the direction within each type of pattern has no effect on performance and observers detect acceleration and deceleration similarly within each condition. We conclude that sensitivity to the presence of acceleration is generally higher for more complex patterns, regardless of the direction within each type of pattern or the sign of acceleration.     

Visually induced plasticity of auditory spatial perception in macaques

When experiencing spatially disparate visual and auditory stimuli, a common percept is that the sound originates from the location of the visual stimulus, an illusion known as the ventriloquism effect. This illusion can persist for tens of minutes, a phenomenon termed the ventriloquism aftereffect. The underlying neuronal mechanisms of this rapidly induced plasticity remain unclear; indeed, it remains untested whether similar multimodal interactions occur in other species. We therefore tested whether macaque monkeys experience the ventriloquism aftereffect similar to the way humans do. The ability of two monkeys to determine which side of the midline a sound was presented from was tested before and after a period of 20-60 min in which the monkeys experienced either spatially identical or spatially disparate auditory and visual stimuli. In agreement with human studies, the monkeys did experience a shift in their auditory spatial perception in the direction of the spatially disparate visual stimulus, and the aftereffect did not transfer across sounds that differed in frequency by two octaves. These results show that macaque monkeys experience the ventriloquism aftereffect similar to the way humans do in all tested respects, indicating that these multimodal interactions are a basic phenomenon of the central nervous system.     

Revisiting the syntactic abilities of non-human animals: natural vocalizations and artificial grammar learning

The domain of syntax is seen as the core of the language faculty and as the most critical difference between animal vocalizations and language. We review evidence from spontaneously produced vocalizations as well as from perceptual experiments using artificial grammars to analyse animal syntactic abilities, i.e. abilities to produce and perceive patterns following abstract rules. Animal vocalizations consist of vocal units (elements) that are combined in a species-specific way to create higher order strings that in turn can be produced in different patterns. While these patterns differ between species, they have in common that they are no more complex than a probabilistic finite-state grammar. Experiments on the perception of artificial grammars confirm that animals can generalize and categorize vocal strings based on phonetic features. They also demonstrate that animals can learn about the co-occurrence of elements or learn simple 'rules' like attending to reduplications of units. However, these experiments do not provide strong evidence for an ability to detect abstract rules or rules beyond finite-state grammars. Nevertheless, considering the rather limited number of experiments and the difficulty to design experiments that unequivocally demonstrate more complex rule learning, the question of what animals are able to do remains open.     

Complexity of environment and parsimony of decision rules in insect societies

This paper shows how colonies of social insects process information and solve problems in a complex environment, while keeping some parsimony at the level of the individuals' decision rules. Two studies on ant foraging reveal the diversity of adaptive colony-level patterns that can be generated through self-organization, based on the same individual-level recruitment rules. Regarding prey scavenging, the "ability to retrieve the prey" rule accounts for changes in foraging patterns, with increasing prey size, that show all stages intermediate between an individual and a mass exploitation of food resources. Regarding liquid food foraging, the "ability to ingest a desired volume" rule enables a colony to adjust the number of tending ants to the honeydew production of aphids. In both cases, decision rules are based on intelligent criteria that intrinsically integrate information on multiple variables that are relevant to the ants. Furthermore, the environment can contribute directly to the emergence of collective patterns, independently of any individual behavioral changes. Each environmental factor, including abiotic ones, that alters the dynamics of information transfer in group-living animals should be reconsidered not simply as a constraint but also as a part of the decision-making process and as a agent that shapes the collective pattern.     

Atypical gaze patterns in children and adults with autism spectrum disorders dissociated from developmental changes in gaze behaviour

Eye tracking has been used to investigate gaze behaviours in individuals with autism spectrum disorder (ASD). However, traditional analysis has yet to find behavioural characteristics shared by both children and adults with ASD. To distinguish core ASD gaze behaviours from those that change with development, we examined temporo-spatial gaze patterns in children and adults with and without ASD while they viewed video clips. We summarized the gaze patterns of 104 participants using multidimensional scaling so that participants with similar gaze patterns would cluster together in a two-dimensional plane. Control participants clustered in the centre, reflecting a standard gaze behaviour, whereas participants with ASD were distributed around the periphery. Moreover, children and adults were separated on the plane, thereby showing a clear effect of development on gaze behaviours. Post hoc frame-by-frame analyses revealed the following findings: (i) both ASD groups shifted their gaze away from a speaker earlier than the control groups; (ii) both ASD groups showed a particular preference for letters; and (iii) typical infants preferred to watch the mouth rather than the eyes during speech, a preference that reversed with development. These results highlight the importance of taking the effect of development into account when addressing gaze behaviours characteristic of ASD.     

Learning to recognize objects

Several aspects of systems for learning pattern or object recognition rules are discussed. First, how are recognition rules developed and to what extent is structural pattern information embedded into these recognition rules. Second, how are these rules applied to the recognition of complex patterns such as objects embedded in scenes and how is evidence from different rules combined into a single evidence vector. Third, how can learned rules be improved through performance evaluation and feedback to rule generation stages.     

Specifically Human: Going Beyond Perceptual Syntax

The aim of this paper is to help refine the definition of humans as “linguistic animals” in light of a comparative approach on nonhuman animals’ cognitive systems. As Uexküll & Kriszat (1934/1992) have theorized, the epistemic access to each species-specific environment (Umwelt) is driven by different biocognitive processes. Within this conceptual framework, I identify the salient cognitive process that distinguishes each species typical perception of the world as the faculty of language meant in the following operational definition: the ability to connect different elements according to structural rules. In order to draw some conclusions about humans’ specific faculty of language, I review different empirical studies on nonhuman animals’ ability to recognize formal patterns of tokens. I suggest that what differentiates human language from other animals’ cognitive systems is the ability to categorize the units of a pattern, going beyond its perceptual aspects. In fact, humans are the only species known to be able to combine semantic units within a network of combinatorial logical relationships (Deacon 1997) that can be linked to the state of affairs in the external world (Wittgenstein 1922). I assume that this ability is the core cognitive process underlying a) the capacity to speak (or to reason) in verbal propositions and b) the general human faculty of language expressed, for instance, in the ability to draw visual conceptual maps or to compute mathematical expressions. In light of these considerations, I conclude providing some research questions that could lead to a more detailed comparative exploration of the faculty of language.     

Testing Whether and When Abstract Symmetric Patterns Produce Affective Responses

Symmetry has a central role in visual art, it is often linked to beauty, and observers can detect it efficiently in the lab. We studied what kind of fast and automatic responses are generated by visual presentation of symmetrical patterns. Specifically, we tested whether a brief presentation of novel symmetrical patterns engenders positive affect using a priming paradigm. The abstract patterns were used as primes in a pattern-word interference task. To ensure that familiarity was not a factor, no pattern and no word was ever repeated within each experiment. The task was to classify words that were selected to have either positive or negative valence. We tested irregular patterns, patterns containing vertical and horizontal reflectional symmetry, and patterns containing a 90 deg rotation. In a series of 7 experiments we found that the effect of affective congruence was present for both types of regularity but only when observers had to classify the regularity of the pattern after responding to the word. The findings show that processing abstract symmetrical shapes or random pattern can engender positive or negative affect as long as the regularity of the pattern is a feature that observers have to attend to and classify.     

Growth-related shape changes in the fetal craniofacial complex of humans (Homo sapiens) and pigtailed macaques (Macaca nemestrina): a 3D-CT comparative analysis

This study investigates whether macaques and humans possess a common pattern of relative growth during the fetal period. The fetal samples consist of 16 male pigtailed macaques (mean age, 20.5 gestational weeks) and 17 humans (9 males and 8 females; mean age, 29.5 gestational weeks). For each individual, three-dimensional coordinates of 18 landmarks on the skull were collected from three-dimensional computed tomographic (CT) reconstructed images and two-dimensional CT axial slices. Early and late groups were created from the human (early mean age, 24 weeks, N = 8; late mean age, 34 weeks, N = 9) and macaque samples (early mean age, 17.7 weeks, N = 7; late mean age, 23 weeks, N = 9). Inter- and intraspecific comparisons were made between the early and late groups. To determine if macaques and humans share a common fetal pattern of relative growth, human change in shape estimated from a comparison of early and late groups was compared to the pattern estimated between early and late macaque groups. Euclidean distance matrix analysis was used in all comparisons. Intraspecific comparisons indicate that the growing fetal skull displays the greatest amount of change along mediolateral dimensions. Changes during human growth are primarily localized to the basicranium and palate, while macaques experience localized change in the midface. Interspecific comparisons indicate that the two primate species do not share a common pattern of relative growth, and the macaque pattern is characterized by increased midfacial growth relative to humans. Our results suggest that morphological differences in the craniofacial skeleton of these species are in part established by differences in fetal growth patterns.     

Nonvisual motor training influences biological motion perception

Experimental evidence suggests a link between perception and the execution of actions . In particular, it has been proposed that motor programs might directly influence visual action perception . According to this hypothesis, the acquisition of novel motor behaviors should improve their visual recognition, even in the absence of visual learning. We tested this prediction by using a new experimental paradigm that dissociates visual and motor learning during the acquisition of novel motor patterns. The visual recognition of gait patterns from point-light stimuli was assessed before and after nonvisual motor training. During this training, subjects were blindfolded and learned a novel coordinated upper-body movement based only on verbal and haptic feedback. The learned movement matched one of the visual test patterns. Despite the absence of visual stimulation during training, we observed a selective improvement of the visual recognition performance for the learned movement. Furthermore, visual recognition performance after training correlated strongly with the accuracy of the execution of the learned motor pattern. These results prove, for the first time, that motor learning has a direct and highly selective influence on visual action recognition that is not mediated by visual learning.     

Geographical variation of human gut microbial composition

Although we know there is considerable variation in gut microbial composition within host species, little is known about how this variation is shaped and why such variation exists. In humans, obesity is associated with the relative abundance of two dominant bacterial phyla: an increase in the proportion of Firmicutes and a decrease in the proportion of Bacteroidetes. As there is evidence that humans have adapted to colder climates by increasing their body mass (e.g. Bergmann''s rule), we tested whether Firmicutes increase and Bacteroidetes decrease with latitude, using 1020 healthy individuals drawn from 23 populations and six published studies. We found a positive correlation between Firmicutes and latitude and a negative correlation between Bacteroidetes and latitude. The overall pattern appears robust to sex, age and bacterial detection methods. Comparisons between African Americans and native Africans and between European Americans and native Europeans suggest no evidence of host genotype explaining the observed patterns. The variation of gut microbial composition described here is consistent with the pattern expected by Bergmann''s rule. This surprising link between large-scale geography and human gut microbial composition merits further investigation.     

Nonmonotonic noise tuning of BOLD fMRI signal to natural images in the visual cortex of the anesthetized monkey

BACKGROUND: The perceptual ability of humans and monkeys to identify objects in the presence of noise varies systematically and monotonically as a function of how much noise is introduced to the visual display. That is, it becomes more and more difficult to identify an object with increasing noise. Here we examine whether the blood oxygen level-dependent functional magnetic resonance imaging (BOLD fMRI) signal in anesthetized monkeys also shows such monotonic tuning. We employed parametric stimulus sets containing natural images and noise patterns matched for spatial frequency and intensity as well as intermediate images generated by interpolation between natural images and noise patterns. Anesthetized monkeys provide us with the unique opportunity to examine visual processing largely in the absence of top-down cognitive modulations and can thus provide an important baseline against which work with awake monkeys and humans can be compared. RESULTS: We measured BOLD activity in occipital visual cortical areas as natural images and noise patterns, as well as intermediate interpolated patterns at three interpolation levels (25%, 50%, and 75%) were presented to anesthetized monkeys in a block paradigm. We observed reliable visual activity in occipital visual areas including V1, V2, V3, V3A, and V4 as well as the fundus and anterior bank of the superior temporal sulcus (STS). Natural images consistently elicited higher BOLD levels than noise patterns. For intermediate images, however, we did not observe monotonic tuning. Instead, we observed a characteristic V-shaped noise-tuning function in primary and extrastriate visual areas. BOLD signals initially decreased as noise was added to the stimulus but then increased again as the pure noise pattern was approached. We present a simple model based on the number of activated neurons and the strength of activation per neuron that can account for these results. CONCLUSIONS: We show that, for our parametric stimulus set, BOLD activity varied nonmonotonically as a function of how much noise was added to the visual stimuli, unlike the perceptual ability of humans and monkeys to identify such stimuli. This raises important caveats for interpreting fMRI data and demonstrates the importance of assessing not only which neural populations are activated by contrasting conditions during an fMRI study, but also the strength of this activation. This becomes particularly important when using the BOLD signal to make inferences about the relationship between neural activity and behavior.     

Infant Rule Learning: Advantage Language,or Advantage Speech?

Infants appear to learn abstract rule-like regularities (e.g., la la da follows an AAB pattern) more easily from speech than from a variety of other auditory and visual stimuli (Marcus et al., 2007). We test if that facilitation reflects a specialization to learn from speech alone, or from modality-independent communicative stimuli more generally, by measuring 7.5-month-old infants' ability to learn abstract rules from sign language-like gestures. Whereas infants appear to easily learn many different rules from speech, we found that with sign-like stimuli, and under circumstances comparable to those of Marcus et al. (1999), hearing infants were able to learn an ABB rule, but not an AAB rule. This is consistent with results of studies that demonstrate lower levels of infant rule learning from a variety of other non-speech stimuli, and we discuss implications for accounts of speech-facilitation.     

Interrelations of global macroecological patterns in wing and thorax size,sexual size dimorphism,and range size of the Drosophilidae

Support for macroecological rules in insects is mixed, with potential confounding interrelations between patterns rarely studied. We here investigate global patterns in body and wing size, sexual size dimorphism and range size in common fruit flies (Diptera: Drosophilidae) and explore potential interrelations and the predictive power of Allen's, Bergmann's, Rensch's and Rapoport's rules. We found that thorax length (r² = 0.05) and wing size (r² = 0.09) increased with latitude, supporting Bergmann's rule. Contrary to patterns often found in endothermic vertebrates, relative wing size increased towards the poles (r² = 0.12), a pattern against Allen's rule, which we attribute to selection for increased flight capacity in the cold. Sexual size dimorphism decreased with size, evincing Rensch's rule across the family (r² = 0.14). Yet, this pattern was largely driven by the virilis–repleta radiation. Finally, range size did not correlate with latitude, although a positive relationship was present in a subset of the species investigated, providing no convincing evidence for Rapoport's rule. We further found little support for confounding interrelations between body size, wing loading and range size in this taxon. Nevertheless, we demonstrate that studying several traits simultaneously at minimum permits better interpretation in case of multiple, potentially conflicting trends or hypotheses concerning the macroecology of insects.