Visual effects of haptic feedback are large but local

Vision generally provides reliable predictions for touch and motor-control, but some classes of stimuli evoke visual illusions. Using haptic feedback on virtual 3-D surfaces, we tested the function of touch in such cases. Our experiments show that in the perception of 3-D shapes from texture cues, haptic information can dominate vision in some cases, changing percepts qualitatively from convex to concave and concave to slant. The effects take time to develop, do not outlive the cessation of the feedback, are attenuated by distance, and drastically reduced by gaps in the surface. These dynamic shifts in qualitative perceived shapes could be invaluable in neural investigations that test whether haptic feedback modifies selective activation of neurons or changes the shape-tuning of neurons responsible for percepts of 3-D shapes.     

Remembrance of odors past: human olfactory cortex in cross-modal recognition memory

Episodic memory is often imbued with multisensory richness, such that the recall of an event can be endowed with the sights, sounds, and smells of its prior occurrence. While hippocampus and related medial temporal structures are implicated in episodic memory retrieval, the participation of sensory-specific cortex in representing the qualities of an episode is less well established. We combined functional magnetic resonance imaging (fMRI) with a cross-modal paradigm, where objects were presented with odors during memory encoding. We then examined the effect of odor context on neural responses at retrieval when these same objects were presented alone. Primary olfactory (piriform) cortex, as well as anterior hippocampus, was activated during the successful retrieval of old (compared to new) objects. Our findings indicate that sensory features of the original engram are preserved in unimodal olfactory cortex. We suggest that reactivation of memory traces distributed across modality-specific brain areas underpins the sensory qualities of episodic memories.     

Sensory and cognitive contributions of color to the recognition of natural scenes

Although color plays a prominent part in our subjective experience of the visual world, the evolutionary advantage of color vision is still unclear [1] [2], with most current answers pointing towards specialized uses, for example to detect ripe fruit amongst foliage [3] [4] [5] [6]. We investigated whether color has a more general role in visual recognition by looking at the contribution of color to the encoding and retrieval processes involved in pattern recognition [7] [8] [9]. Recognition accuracy was higher for color images of natural scenes than for luminance-matched black and white images, and color information contributed to both components of the recognition process. Initially, color leads to an image-coding advantage at the very early stages of sensory processing, most probably by easing the image-segmentation task. Later, color leads to an advantage in retrieval, presumably as the result of an enhanced image representation in memory due to the additional attribute. Our results ascribe color vision a general role in the processing of visual form, starting at the very earliest stages of analysis: color helps us to recognize things faster and to remember them better.     

Bayesian multisensory integration and cross-modal spatial links.

Our perception of the word is the result of combining information between several senses, such as vision, audition and proprioception. These sensory modalities use widely different frames of reference to represent the properties and locations of object. Moreover, multisensory cues come with different degrees of reliability, and the reliability of a given cue can change in different contexts. The Bayesian framework--which we describe in this review--provides an optimal solution to deal with this issue of combining cues that are not equally reliable. However, this approach does not address the issue of frames of references. We show that this problem can be solved by creating cross-modal spatial links in basis function networks. Finally, we show how the basis function approach can be combined with the Bayesian framework to yield networks that can perform optimal multisensory combination. On the basis of this theory, we argue that multisensory integration is a dialogue between sensory modalities rather that the convergence of all sensory information onto a supra-modal area.     

Visual mechanisms of recognition of vanishing figures

The acuity test Landolt C's with a complex contour imitating various kinds of high-pass spatial frequency filtering generated as a printed visual acuity charts with a grey background were studied with regard to recognition thresholds. Comparisons were made for recognition thresholds with different complex contours. When the vanishing optotypes are out of focus, their image on the retina fades rapidly into the grey background, rendering them invisible rather than merely blurred as in the standard chart. The data obtained confirm that the recognition distance depends on physical property of complex contour profile and show the importance of the Landolt C spatial frequency spectrum for recognition of different types of the complex contour.     

Visual discrimination of objects differing in spatial depth by goldfish

Training experiments were performed to investigate the ability of goldfish to discriminate objects differing in spatial depth. Tests on size constancy should give insight into the mechanisms of distance estimation. Goldfish were successfully trained to discriminate between two black disk stimuli of equal size but different distance from the tank wall. Each stimulus was presented in a white tube so that the fish could see only one stimulus at a time. For each of eight training stimulus distances, the just noticeable difference in distance was determined at a threshold criterion of 70% choice frequency. The ratio of the retinal image sizes between training stimulus and comparison stimulus at threshold was about constant. However, in contrast to Douglas et al. (Behav Brain Res 30:37–42, 1988), goldfish did not show size constancy in tests with stimuli of the same visual angle. This indicates that they did not estimate distance, but simply compared the retinal images under our experimental conditions. We did not find any indication for the use of accommodation as a depth cue. A patterned background at the rear end of the tubes did not have any effect, which, however, does not exclude the possibility that motion parallax is used as a depth cue under natural conditions.     

Visual exploration and object recognition by lattice deformation

Mechanisms of explicit object recognition are often difficult to investigate and require stimuli with controlled features whose expression can be manipulated in a precise quantitative fashion. Here, we developed a novel method (called "Dots"), for generating visual stimuli, which is based on the progressive deformation of a regular lattice of dots, driven by local contour information from images of objects. By applying progressively larger deformation to the lattice, the latter conveys progressively more information about the target object. Stimuli generated with the presented method enable a precise control of object-related information content while preserving low-level image statistics, globally, and affecting them only little, locally. We show that such stimuli are useful for investigating object recognition under a naturalistic setting--free visual exploration--enabling a clear dissociation between object detection and explicit recognition. Using the introduced stimuli, we show that top-down modulation induced by previous exposure to target objects can greatly influence perceptual decisions, lowering perceptual thresholds not only for object recognition but also for object detection (visual hysteresis). Visual hysteresis is target-specific, its expression and magnitude depending on the identity of individual objects. Relying on the particular features of dot stimuli and on eye-tracking measurements, we further demonstrate that top-down processes guide visual exploration, controlling how visual information is integrated by successive fixations. Prior knowledge about objects can guide saccades/fixations to sample locations that are supposed to be highly informative, even when the actual information is missing from those locations in the stimulus. The duration of individual fixations is modulated by the novelty and difficulty of the stimulus, likely reflecting cognitive demand.     

Class similarity and viewpoint invariance in the recognition of 3D objects

 In human vision, the processes and the representations involved in identifying specific individuals are frequently assumed to be different from those used for basic level classification, because classification is largely viewpoint-invariant, but identification is not. This assumption was tested in psychophysical experiments, in which objective similarity between stimuli (and, consequently, the level of their distinction) varied in a controlled fashion. Subjects were trained to discriminate between two classes of computer-generated three-dimensional objects, one resembling monkeys and the other, dogs. Both classes were defined by the same set of 56 parameters, which encoded sizes, shapes, and placement of the limbs, ears, snout, etc. Interpolation between parameter vectors of the class prototypes yielded shapes that changed smoothly between monkey and dog. Within-class variation was induced in each trial by randomly perturbing all the parameters. After the subjects reached 90% correct performance on a fixed canonical view of each object, discrimination performance was tested for novel views that differed by up to 60° from the training view. In experiment 1 (in which the distribution of parameters in each class was unimodal) and in experiment 2 (bimodal classes), the stimuli differed only parametrically and consisted of the same geons (parts), yet were recognized virtually independently of viewpoint in the low-similarity condition. In experiment 3, the prototypes differed in their arrangement of geons, yet the subjects’ performance depended significantly on viewpoint in the high-similarity condition. In all three experiments, higher interstimulus similarity was associated with an increase in the mean error rate and, for misorientation of up to 45°, with an increase in the degree of viewpoint dependence. These results suggest that a geon-level difference between stimuli is neither strictly necessary nor always sufficient for viewpoint-invariant performance. Thus, basic and subordinate-level processes in visual recognition may be more closely related than previously thought. Received: 15 November 1993/Accepted in revised form: 14 July 1994     

Visual priming and perception of small pictures in a scene with multiscale objects

Biederman et al. [1, 2] have shown that the priming effect does not depend on the difference between the angular sizes of the test stimulus and the primer. However, these two and other similar studies investigated only a small range of the angular sizes of stimuli. Vakhrameeva et al. [3] have shown that there exist two perceptionally different size ranges: perception of the objects with an angular size varying between 1–1.5 and 50 degrees was found to be invariant, but for the objects whose angular size is less than 1–1.5 degrees, their perception is no longer invariant. In this study, the presence of the priming effect has been investigated in the match-to-sample task with such a difference in the angular sizes of the primer and test stimuli that the sizes of the primer (about 4 degrees) and the test stimulus (about 0.5 degrees) belonged to two different size ranges. The sample stimulus was presented with and without noise superposition. It has been shown that the priming effect is suppressed when the size difference between the primer and the test stimulus is large. A congruent primer can have a positive impact on the recognition of the test objects, but this occurs under the viewing conditions complicated by noise superposition.     

Multistability, cross-modal binding and the additivity of conjoined grouping principles

We present a sceptical view of multimodal multistability--drawing most of our examples from the relation between audition and vision. We begin by summarizing some of the principal ways in which audio-visual binding takes place. We review the evidence that unambiguous stimulation in one modality may affect the perception of a multistable stimulus in another modality. Cross-modal influences of one multistable stimulus on the multistability of another are different: they have occurred only in speech perception. We then argue that the strongest relation between perceptual organization in vision and perceptual organization in audition is likely to be by way of analogous Gestalt laws. We conclude with some general observations about multimodality.     

The structures of letters and symbols throughout human history are selected to match those found in objects in natural scenes

Are there empirical regularities in the shapes of letters and other human visual signs, and if so, what are the selection pressures underlying these regularities? To examine this, we determined a wide variety of topologically distinct contour configurations and examined the relative frequency of these configuration types across writing systems, Chinese writing, and nonlinguistic symbols. Our first result is that these three classes of human visual sign possess a similar signature in their configuration distribution, suggesting that there are underlying principles governing the shapes of human visual signs. Second, we provide evidence that the shapes of visual signs are selected to be easily seen at the expense of the motor system. Finally, we provide evidence to support an ecological hypothesis that visual signs have been culturally selected to match the kinds of conglomeration of contours found in natural scenes because that is what we have evolved to be good at visually processing.     

Visual monitoring of threatening objects by captive tamarins (Saguinus labiatus)

Captive social groups of red-bellied tamarins (Saguinus labiatus) were observed in the presence of threatening, inanimate objects. The tamarins monitored the stimuli over the course of the 20-minute trials by conducting brief, periodic visual checks of the objects. The average number of checks per subject per trial was stable both across trials and between groups, and individual differences in rates varied relatively little around the group means. These data generate the hypothesis that there is a species-typical execution of vigilance in the presence of mildly threatening objects. This execution takes the form of brief visual inspections of the stimulus, usually by one tamarin at a time, at a fairly consistent rate. The discussion of the data takes place in the context of the behavioral ecology of callitrichid species.     

Visual aspects of species recognition in the damselfish Dascyllus aruanus L. (Pisces,Pomacentridae)

Attraction was found to be a reliable indicator of species recognition in the damselfish Dascyllus aruanus. Isolated fish are attracted to live or dead conspecifics significantly more than to heterospecifics. Attraction persists towards black and white photographs. Using photographs it was shown that certain parts of the pattern are more important for recognition than others. Of the three black bars of the normal colour pattern, the central is the most important, and the anterior the least so. Two alternative criteria for demonstrating species recognition in a boldly coloured reef fish, aggression and attraction, are contrasted.     

It takes two-skilled recognition of objects engages lateral areas in both hemispheres

Our object recognition abilities, a direct product of our experience with objects, are fine-tuned to perfection. Left temporal and lateral areas along the dorsal, action related stream, as well as left infero-temporal areas along the ventral, object related stream are engaged in object recognition. Here we show that expertise modulates the activity of dorsal areas in the recognition of man-made objects with clearly specified functions. Expert chess players were faster than chess novices in identifying chess objects and their functional relations. Experts' advantage was domain-specific as there were no differences between groups in a control task featuring geometrical shapes. The pattern of eye movements supported the notion that experts' extensive knowledge about domain objects and their functions enabled superior recognition even when experts were not directly fixating the objects of interest. Functional magnetic resonance imaging (fMRI) related exclusively the areas along the dorsal stream to chess specific object recognition. Besides the commonly involved left temporal and parietal lateral brain areas, we found that only in experts homologous areas on the right hemisphere were also engaged in chess specific object recognition. Based on these results, we discuss whether skilled object recognition does not only involve a more efficient version of the processes found in non-skilled recognition, but also qualitatively different cognitive processes which engage additional brain areas.     

Visual memory of shapes in quail chicks: discrimination among 2-dimensional objects

Newly hatched chicks spontaneously peck at conspicuous objects, and soon learn to discriminate between edible food particles and inedible objects. To examine whether this discrimination is based on a chick's ability to memorize objects by shape cues, we analyzed the pecking behavior. One- to 3-day old quail chicks (Coturnix japonica) were presented with dry objects of different shapes (ball, disk, triangle and T-shape) of similar size (4 mm) and color (green). Habituation occurred after repeated presentation of any one of these objects (duration: 30 sec; interval: 4 min). When chicks showed significantly more pecks at a novel object (dishabituation), we assumed that chicks had memorized the habituated shapes and distinguished the novel object. Chicks did not show dishabituation between a ball and a disk. On the other hand, chicks discriminated a triangle or T-shape from the memorized image of disk, but did not memorize either triangle or T-shape by its shape. Similarly, chicks did not memorize the size of disks as a reference for subsequent pecking behavior. Chicks proved to have a limited ability to memorize shape and size cues for selective pecking behavior, in strong contrast to their accurate memorization of colors.     

Characteristics of invariant recognition of visual objects in preschool children with typical and atypical development

The invariant recognition ability of five- to six-year-old children with typical and atypical patterns of development in terms of the shape of visual images varying in color, size, and location has been studied. It has been shown that the typically developing children of this age are able to identify the invariant form of a visual object regardless of any changes in its color, size, or location. The children with neurodevelopmental disorders have difficulties with identifying the shape of a visual object when its location among a large number of figures is changed. The children with early infantile autism exhibit different degrees of visual perceptual deficit. The children with the milder forms of autistic disorders have difficulties only with recognizing the shape of an image when its location is changed; the children with more severe forms of disorders showed a serious impairment of invariant recognition regardless of image color, size, and location.     

Depth,contrast and view-based homing in outdoor scenes

Panoramic image differences can be used for view-based homing under natural outdoor conditions, because they increase smoothly with distance from a reference location (Zeil et al., J Opt Soc Am A 20(3):450–469, 2003). The particular shape, slope and depth of such image difference functions (IDFs) recorded at any one place, however, depend on a number of factors that so far have only been qualitatively identified. Here we show how the shape of difference functions depends on the depth structure and the contrast of natural scenes, by quantifying the depth- distribution of different outdoor scenes and by comparing it to the difference functions calculated with differently processed panoramic images, which were recorded at the same locations. We find (1) that IDFs and catchment areas become systematically wider as the average distance of objects increases, (2) that simple image processing operations—like subtracting the local mean, difference-of-Gaussian filtering and local contrast normalization—make difference functions robust against changes in illumination and the spurious effects of shadows, and (3) by comparing depth-dependent translational and depth-independent rotational difference functions, we show that IDFs of contrast-normalized snapshots are predominantly determined by the depth-structure and possibly also by occluding contours in a scene. We propose a model for the shape of IDFs as a tool for quantitative comparisons between the shapes of these functions in different scenes.