Does assignment of orientation to dot patterns reveal optimization processes in the visual system?

Sixty subjects were tested to assign orientation to ten dot patterns differing in their overall form and the number of dots in the pattern. The patterns were presented in four different positions in the visual field and their orientation was estimated in two ways. It was demonstrated that the assignment of orientation did not depend on the position of the pattern in the visual field as well as on the method of estimation used. A quantitative measure for the elongation of a dot pattern is proposed which correlates with the degree of ambiguity in orientation estimation. The greater the elongation the smaller the standard deviation of the estimates given. The distributions of the estimates for the ten patterns were analyzed. It was shown that they can be presented as superpositions of two or more groups of normally distributed estimates determined by some salient characteristics of the stimuli. Data are discussed from the point of view that assignment of orientation to dot patterns reveals the existence of optimization mechanisms in human brain that extract perceptual invariants from external stimulation.     

On visual orientation of dot patterns

Two-dimensional normally distributed random dot patterns were used in two experiments on visual orientation estimation. In the first experiment the patterns differed in their sample correlation and in dot number. In the second one the number of dots was maintained constant but the patterns were generated as a superposition of two normally distributed orthogonal sets composed of different number of dots. In both experiments the estimated orientation depended on stimuli correlation-with increasing correlation the estimated orientation gets closer to the orientation of the least square distance axis of the pattern. Even at very low unsignificant correlations there still remained a hint about stimulus orientation which was not estimated at random. Equalizing consecutively the number of dots in the two orthogonal dot patterns during the second experiment did not result in chance performance either. The bimodal angular distributions of the obtained responses permitted to approach the problem of orientation ambiguity. The results are discussed in terms of optimization processes taking place in the visual system.     

Retinal encoding of ultrabrief shape recognition cues

Shape encoding mechanisms can be probed by the sequential brief display of dots that mark the boundary of the shape, and delays of less that a millisecond between successive dots can impair recognition. It is not entirely clear whether this is accomplished by preserving stimulus timing in the signal being sent to the brain, or calls for a retinal binding mechanism. Two experiments manipulated the degree of simultaneity among and within dot pairs, requiring also that the pair members be in the same half of the visual field or on opposite halves, i.e., across the midline from one another. Recognition performance was impaired the same for these two conditions. The results make it likely that simultaneity of cues is being registered within the retina. A potential mechanism is suggested, calling for linkage of stimulated sites through activation of PA1 cells. A third experiment confirmed a prior finding that the overall level of recognition deficit is partly a function of display-set size, and affirmed submillisecond resolution in binding dot pairs into effective shape-recognition cues.     

A computational analysis of separating motion signals in transparent random dot kinematograms

When multiple motion directions are presented simultaneously within the same region of the visual field human observers see motion transparency. This perceptual phenomenon requires from the visual system to separate different motion signal distributions, which are characterised by distinct means that correspond to the different dot directions and variances that are determined by the signal and processing noise. Averaging of local motion signals can be employed to reduce noise components, but such pooling could at the same time lead to the averaging of different directional signal components, arising from spatially adjacent dots moving in different directions, which would reduce the visibility of transparent directions. To study the theoretical limitations of encoding transparent motion by a biologically plausible motion detector network, the distributions of motion directions signalled by a motion detector model (2DMD) were analysed here for Random Dot Kinematograms (RDKs). In sparse dot RDKs with two randomly interleaved motion directions, the angular separation that still allows us to separate two directions is limited by the internal noise in the system. Under the present conditions direction differences down to 30 deg could be separated. Correspondingly, in a transparent motion stimulus containing multiple motion directions, more than eight directions could be separated. When this computational analysis is compared to some published psychophysical data, it appears that the experimental results do not reach the predicted limits. Whereas the computer simulations demonstrate that even an unsophisticated motion detector network would be appropriate to represent a considerable number of motion directions simultaneously within the same region, human observers usually are restricted to seeing not more than two or three directions under comparable conditions. This raises the question why human observers do not make full use of information that could be easily extracted from the representation of motion signals at the early stages of the visual system.     

The role of visual information in numerosity estimation

Mainstream theory suggests that the approximate number system supports our non-symbolic number abilities (e.g. estimating or comparing different sets of items). It is argued that this system can extract number independently of the visual cues present in the stimulus (diameter, aggregate surface, etc.). However, in a recent report we argue that this might not be the case. We showed that participants combined information from different visual cues to derive their answers. While numerosity comparison requires a rough comparison of two sets of items (smaller versus larger), numerosity estimation requires a more precise mechanism. It could therefore be that numerosity estimation, in contrast to numerosity comparison, might rely on the approximate number system. To test this hypothesis, we conducted a numerosity estimation experiment. We controlled for the visual cues according to current standards: each single visual property was not informative about numerosity. Nevertheless, the results reveal that participants were influenced by the visual properties of the dot arrays. They gave a larger estimate when the dot arrays consisted of dots with, on average, a smaller diameter, aggregate surface or density but a larger convex hull. The reliance on visual cues to estimate numerosity suggests that the existence of an approximate number system that can extract numerosity independently of the visual cues is unlikely. Instead, we propose that humans estimate numerosity by weighing the different visual cues present in the stimuli.     

Three-dimensional shape representation in monkey cortex

Using fMRI in anesthetized monkeys, this study investigates how the primate visual system constructs representations of three-dimensional (3D) shape from a variety of cues. Computer-generated 3D objects defined by shading, random dots, texture elements, or silhouettes were presented either statically or dynamically (rotating). Results suggest that 3D shape representations are highly localized, although widely distributed, in occipital, temporal, parietal, and frontal cortices and may involve common brain regions regardless of shape cue. This distributed network of areas cuts across both "what" and "where" processing streams, reflecting multiple uses for 3D shape representation in perception, recognition, and action.     

Categorical Biases in Perceiving Spatial Relations

We investigate the effect of spatial categories on visual perception. In three experiments, participants made same/different judgments on pairs of simultaneously presented dot-cross configurations. For different trials, the position of the dot within each cross could differ with respect to either categorical spatial relations (the dots occupied different quadrants) or coordinate spatial relations (the dots occupied different positions within the same quadrant). The dot-cross configurations also varied in how readily the dot position could be lexicalized. In harder-to-name trials, crosses formed a “+” shape such that each quadrant was associated with two discrete lexicalized spatial categories (e.g., “above” and “left”). In easier-to-name trials, both crosses were rotated 45° to form an “×” shape such that quadrants were unambiguously associated with a single lexicalized spatial category (e.g., “above” or “left”). In Experiment 1, participants were more accurate when discriminating categorical information between easier-to-name categories and more accurate at discriminating coordinate spatial information within harder-to-name categories. Subsequent experiments attempted to down-regulate or up-regulate the involvement of language in task performance. Results from Experiment 2 (verbal interference) and Experiment 3 (verbal training) suggest that the observed spatial relation type-by-nameability interaction is resistant to online language manipulations previously shown to affect color and object-based perceptual processing. The results across all three experiments suggest that robust biases in the visual perception of spatial relations correlate with patterns of lexicalization, but do not appear to be modulated by language online.     

Detecting binocular 3D motion in static 3D noise: no effect of viewing distance

Relative binocular disparity cannot tell us the absolute 3D shape of an object, nor the 3D trajectory of its motion, unless the visual system has independent access to how far away the object is at any moment. Indeed, as the viewing distance is changed, the same disparate retinal motions will correspond to very different real 3D trajectories. In this paper we were interested in whether binocular 3D motion detection is affected by viewing distance. A visual search task was used, in which the observer is asked to detect a target dot, moving in 3D, amidst 3D stationary distractor dots. We found that distance does not affect detection performance. Motion-in-depth is consistently harder to detect than the equivalent lateral motion, for all viewing distances. For a constant retinal motion with both lateral and motion-in-depth components, detection performance is constant despite variations in viewing distance that produce large changes in the direction of the 3D trajectory. We conclude that binocular 3D motion detection relies on retinal, not absolute, visual signals.     

Visual exploration and object recognition by lattice deformation

Mechanisms of explicit object recognition are often difficult to investigate and require stimuli with controlled features whose expression can be manipulated in a precise quantitative fashion. Here, we developed a novel method (called "Dots"), for generating visual stimuli, which is based on the progressive deformation of a regular lattice of dots, driven by local contour information from images of objects. By applying progressively larger deformation to the lattice, the latter conveys progressively more information about the target object. Stimuli generated with the presented method enable a precise control of object-related information content while preserving low-level image statistics, globally, and affecting them only little, locally. We show that such stimuli are useful for investigating object recognition under a naturalistic setting--free visual exploration--enabling a clear dissociation between object detection and explicit recognition. Using the introduced stimuli, we show that top-down modulation induced by previous exposure to target objects can greatly influence perceptual decisions, lowering perceptual thresholds not only for object recognition but also for object detection (visual hysteresis). Visual hysteresis is target-specific, its expression and magnitude depending on the identity of individual objects. Relying on the particular features of dot stimuli and on eye-tracking measurements, we further demonstrate that top-down processes guide visual exploration, controlling how visual information is integrated by successive fixations. Prior knowledge about objects can guide saccades/fixations to sample locations that are supposed to be highly informative, even when the actual information is missing from those locations in the stimulus. The duration of individual fixations is modulated by the novelty and difficulty of the stimulus, likely reflecting cognitive demand.     

Distance Estimation Is Influenced by Encoding Conditions

Background

It is well established that foveating a behaviorally relevant part of the visual field improves localization performance as compared to the situation where the gaze is directed elsewhere. Reduced localization performance in the peripheral encoding conditions has been attributed to an eccentricity-dependent increase in positional uncertainty. It is not known, however, whether and how the foveal and peripheral encoding conditions can influence spatial interval estimation. In this study we compare observers'' estimates of a distance between two co-planar dots in the condition where they foveate the two sample dots and where they fixate a central dot while viewing the sample dots peripherally.

Methodology/Principal Findings

Observers were required to reproduce, after a short delay, a distance between two sample dots based on a stationary reference dot and a movable mouse pointer. When both sample dots are foveated, we find that the distance estimation error is small but consistently increases with the dots-separation size. In comparison, distance judgment in peripheral encoding condition is significantly overestimated for smaller separations and becomes similar to the performance in foveal trials for distances from 10 to 16 degrees.

Conclusions/Significance

Although we find improved accuracy of distance estimation in the foveal condition, the fact that the difference is related to the reduction of the estimation bias present in the peripheral conditon, challenges the simple account of reducing the eccentricity-dependent positional uncertainty. Contrary to this, we present evidence for an explanation in terms of neuronal populations activated by the two sample dots and their inhibitory interactions under different visual encoding conditions. We support our claims with simulations that take into account receptive fields size differences between the two encoding conditions.     

Size-Sensitive Perceptual Representations Underlie Visual and Haptic Object Recognition

A variety of similarities between visual and haptic object recognition suggests that the two modalities may share common representations. However, it is unclear whether such common representations preserve low-level perceptual features or whether transfer between vision and haptics is mediated by high-level, abstract representations. Two experiments used a sequential shape-matching task to examine the effects of size changes on unimodal and crossmodal visual and haptic object recognition. Participants felt or saw 3D plastic models of familiar objects. The two objects presented on a trial were either the same size or different sizes and were the same shape or different but similar shapes. Participants were told to ignore size changes and to match on shape alone. In Experiment 1, size changes on same-shape trials impaired performance similarly for both visual-to-visual and haptic-to-haptic shape matching. In Experiment 2, size changes impaired performance on both visual-to-haptic and haptic-to-visual shape matching and there was no interaction between the cost of size changes and direction of transfer. Together the unimodal and crossmodal matching results suggest that the same, size-specific perceptual representations underlie both visual and haptic object recognition, and indicate that crossmodal memory for objects must be at least partly based on common perceptual representations.     

Discrimination of random dot texture patterns in bluegill sunfish,Lepomis macrochirus

In order to study the ability of fish to perceive and distinguish textures visually, bluegill sunfish (Lepomis macrochirus) were trained to discriminate between pairs of artificial texture patterns. Random dot patterns with different statistical dot distributions were presented to the fish as artificial texture patterns. The results indicate that bluegills have the ability to discriminate many pairs of patterns with different statistical features of dot distributions which have different appearance in texture. This suggests that texture could be one of the important visual features bluegill sunfish recognize and utilize.     

Spatial modulation of primate inferotemporal responses by eye position

Background

A key aspect of representations for object recognition and scene analysis in the ventral visual stream is the spatial frame of reference, be it a viewer-centered, object-centered, or scene-based coordinate system. Coordinate transforms from retinocentric space to other reference frames involve combining neural visual responses with extraretinal postural information.

Methodology/Principal Findings

We examined whether such spatial information is available to anterior inferotemporal (AIT) neurons in the macaque monkey by measuring the effect of eye position on responses to a set of simple 2D shapes. We report, for the first time, a significant eye position effect in over 40% of recorded neurons with small gaze angle shifts from central fixation. Although eye position modulates responses, it does not change shape selectivity.

Conclusions/Significance

These data demonstrate that spatial information is available in AIT for the representation of objects and scenes within a non-retinocentric frame of reference. More generally, the availability of spatial information in AIT calls into questions the classic dichotomy in visual processing that associates object shape processing with ventral structures such as AIT but places spatial processing in a separate anatomical stream projecting to dorsal structures.     

Graphical Aids to the Estimation and Discrimination of Uncertain Numerical Data

This research investigates the performance of graphical dot arrays designed to make discrimination of relative numerosity as effortless as possible at the same time as making absolute (quantitative) numerosity estimation as effortful as possible. Comparing regular, random, and hybrid (randomized regular) configurations of dots, the results indicate that both random and hybrid configurations reduce absolute numerosity estimation precision, when compared with regular dots arrays. However, discrimination of relative numerosity is significantly more accurate for hybrid dot arrays than for random dot arrays. Similarly, human subjects report significantly lower levels of subjective confidence in judgments when using hybrid dot configurations as compared with regular configurations; and significantly higher levels of subjective confidence as compared with random configurations. These results indicate that data graphics based on the hybrid, randomized-regular configurations of dots are well-suited to applications that require decisions to be based on numerical data in which the absolute quantities are less certain than the relative values. Examples of such applications include decision-making based on the outputs of empirically-based mathematical models, such as health-related policy decisions using data from predictive epidemiological models.     

Visual shape representation with geometrically characterized contour partitions

This paper proposes a biologically plausible matching method to recognize general shapes based on contour curvature information. The human visual system recognizes general shapes flexibly in real-world scenes through the ventral pathway. The pathway is typically modeled using artificial neural networks. These network models, however, do not construct a shape representation that satisfies the following required constraints: (1) The original shape should be represented by a group of partitioned contours in order to retrieve the whole shape (global information) from the partial contours (local information). (2) Coarse and fine structures of the original shapes should be individually represented in order for the visual system to respond to shapes as quickly as possible based on the least number of their features, and to discriminate between shapes based on detailed information. (3) The shape recognition realized with an artificial visual system should be invariant to geometric transformation such as expansion, rotation, or shear. In this paper, we propose a visual shape representation with geometrically characterized contour partitions described on multiple spatial scales.     

Cross- and auto-correlation in early vision

Neurons that respond selectively to the orientation of visual stimuli were discovered in V1 more than 50 years ago, but it is still not fully understood how or why this is brought about. We report experiments planned to show whether human observers use cross-correlation or auto-correlation to detect oriented streaks in arrays of randomly positioned dots, expecting that this would help us to understand what David Marr called the 'computational goal' of V1. The streaks were generated by two different methods: either by sinusoidal spatial modulation of the local mean dot density, or by introducing coherent pairs of dots to create moiré patterns, as Leon Glass did. A wide range of dot numbers was used in the randomly positioned arrays, because dot density affects cross- and auto-correlation differently, enabling us to infer which method was used. This difference stems from the fact that the cross-correlation task is limited by random fluctuations in the local mean density of individual dots in the noisy array, whereas the auto-correlation task is limited by fluctuations in the numbers of randomly occurring spurious pairs having the same separation and orientation as the deliberately introduced coherent pairs. After developing a new method using graded dot luminances, we were able to extend the range of dot densities that could be used by a large factor, and convincing results were obtained indicating that the streaks generated by amplitude modulation were discriminated by cross-correlation, while those generated as moiré patterns were discriminated by auto-correlation. Though our current results only apply to orientation selectivity, it is important to know that early vision can do more than simple filtering, for evaluating auto-correlations opens the way to more interesting possibilities, such as the detection of symmetries and suspicious coincidences.     

Non-Conscious Processing of Motion Coherence Can Boost Conscious Access

Research on the scope and limits of non-conscious vision can advance our understanding of the functional and neural underpinnings of visual awareness. Here we investigated whether distributed local features can be bound, outside of awareness, into coherent patterns. We used continuous flash suppression (CFS) to create interocular suppression, and thus lack of awareness, for a moving dot stimulus that varied in terms of coherence with an overall pattern (radial flow). Our results demonstrate that for radial motion, coherence favors the detection of patterns of moving dots even under interocular suppression. Coherence caused dots to break through the masks more often: this indicates that the visual system was able to integrate low-level motion signals into a coherent pattern outside of visual awareness. In contrast, in an experiment using meaningful or scrambled biological motion we did not observe any increase in the sensitivity of detection for meaningful patterns. Overall, our results are in agreement with previous studies on face processing and with the hypothesis that certain features are spatiotemporally bound into coherent patterns even outside of attention or awareness.     

Performance Characterization of Watson Ahumada Motion Detector Using Random Dot Rotary Motion Stimuli

The performance of Watson & Ahumada''s model of human visual motion sensing is compared against human psychophysical performance. The stimulus consists of random dots undergoing rotary motion, displayed in a circular annulus. The model matches psychophysical observer performance with respect to most parameters. It is able to replicate some key psychophysical findings such as invariance of observer performance to dot density in the display, and decrease of observer performance with frame duration of the display.Associated with the concept of rotary motion is the notion of a center about which rotation occurs. One might think that for accurate estimation of rotary motion in the display, this center must be accurately known. A simple vector analysis reveals that this need not be the case. Numerical simulations confirm this result, and may explain the position invariance of MST(d) cells. Position invariance is the experimental finding that rotary motion sensitive cells are insensitive to where in their receptive field rotation occurs.When all the dots in the display are randomly drawn from a uniform distribution, illusory rotary motion is perceived. This case was investigated by Rose & Blake previously, who termed the illusory rotary motion the omega effect. Two important experimental findings are reported concerning this effect. First, although the display of random dots evokes perception of rotary motion, the direction of motion perceived does not depend on what dot pattern is shown. Second, the time interval between spontaneous flips in perceived direction is lognormally distributed (mode≈2 s). These findings suggest the omega effect fits in the category of a typical bistable illusion, and therefore the processes that give rise to this illusion may be the same processes that underlie much of other bistable phenomenon.     

Dynamic Visual Tests to Identify and Quantify Visual Damage and Repair Following Demyelination in Optic Neuritis Patients

In order to follow optic neuritis patients and evaluate the effectiveness of their treatment, a handy, accurate and quantifiable tool is required to assess changes in myelination at the central nervous system (CNS). However, standard measurements, including routine visual tests and MRI scans, are not sensitive enough for this purpose. We present two visual tests addressing dynamic monocular and binocular functions which may closely associate with the extent of myelination along visual pathways. These include Object From Motion (OFM) extraction and Time-constrained stereo protocols. In the OFM test, an array of dots compose an object, by moving the dots within the image rightward while moving the dots outside the image leftward or vice versa. The dot pattern generates a camouflaged object that cannot be detected when the dots are stationary or moving as a whole. Importantly, object recognition is critically dependent on motion perception. In the Time-constrained Stereo protocol, spatially disparate images are presented for a limited length of time, challenging binocular 3-dimensional integration in time. Both tests are appropriate for clinical usage and provide a simple, yet powerful, way to identify and quantify processes of demyelination and remyelination along visual pathways. These protocols may be efficient to diagnose and follow optic neuritis and multiple sclerosis patients.In the diagnostic process, these protocols may reveal visual deficits that cannot be identified via current standard visual measurements. Moreover, these protocols sensitively identify the basis of the currently unexplained continued visual complaints of patients following recovery of visual acuity. In the longitudinal follow up course, the protocols can be used as a sensitive marker of demyelinating and remyelinating processes along time. These protocols may therefore be used to evaluate the efficacy of current and evolving therapeutic strategies, targeting myelination of the CNS.     

Red blood cell phenotyping from 3D confocal images using artificial neural networks

The investigation of cell shapes mostly relies on the manual classification of 2D images, causing a subjective and time consuming evaluation based on a portion of the cell surface. We present a dual-stage neural network architecture for analyzing fine shape details from confocal microscopy recordings in 3D. The system, tested on red blood cells, uses training data from both healthy donors and patients with a congenital blood disease, namely hereditary spherocytosis. Characteristic shape features are revealed from the spherical harmonics spectrum of each cell and are automatically processed to create a reproducible and unbiased shape recognition and classification. The results show the relation between the particular genetic mutation causing the disease and the shape profile. With the obtained 3D phenotypes, we suggest our method for diagnostics and theragnostics of blood diseases. Besides the application employed in this study, our algorithms can be easily adapted for the 3D shape phenotyping of other cell types and extend their use to other applications, such as industrial automated 3D quality control.