A New Standardized Stimulus Set for Studying Need-of-Help Recognition (NeoHelp)

This article presents the NeoHelp visual stimulus set created to facilitate investigation of need-of-help recognition with clinical and normative populations of different ages, including children. Need-of-help recognition is one aspect of socioemotional development and a necessary precondition for active helping. The NeoHelp consists of picture pairs showing everyday situations: The first item in a pair depicts a child needing help to achieve a goal; the second one shows the child achieving the goal. Pictures of birds in analogue situations are also included. These control stimuli enable implementation of a human-animal categorization task which serves to separate behavioral correlates specific to need-of-help recognition from general differentiation processes. It is a concern in experimental research to ensure that results do not relate to systematic perceptual differences when comparing responses to categories of different content. Therefore, we not only derived the NeoHelp-pictures within a pair from one another by altering as little as possible, but also assessed their perceptual similarity empirically. We show that NeoHelp-picture pairs are very similar regarding low-level perceptual properties across content categories. We obtained data from 60 children in a broad age range (4 to 13 years) for three different paradigms, in order to assess whether the intended categorization and differentiation could be observed reliably in a normative population. Our results demonstrate that children can differentiate the pictures'' content regarding both need-of-help category as well as species as intended in spite of the high perceptual similarities. We provide standard response characteristics (hit rates and response times) that are useful for future selection of stimuli and comparison of results across studies. We show that task requirements coherently determine which aspects of the pictures influence response characteristics. Thus, we present NeoHelp, the first open-access standardized visual stimuli set for investigation of need-of-help recognition and invite researchers to use and extend it.     

Nonmonotonic noise tuning of BOLD fMRI signal to natural images in the visual cortex of the anesthetized monkey

BACKGROUND: The perceptual ability of humans and monkeys to identify objects in the presence of noise varies systematically and monotonically as a function of how much noise is introduced to the visual display. That is, it becomes more and more difficult to identify an object with increasing noise. Here we examine whether the blood oxygen level-dependent functional magnetic resonance imaging (BOLD fMRI) signal in anesthetized monkeys also shows such monotonic tuning. We employed parametric stimulus sets containing natural images and noise patterns matched for spatial frequency and intensity as well as intermediate images generated by interpolation between natural images and noise patterns. Anesthetized monkeys provide us with the unique opportunity to examine visual processing largely in the absence of top-down cognitive modulations and can thus provide an important baseline against which work with awake monkeys and humans can be compared. RESULTS: We measured BOLD activity in occipital visual cortical areas as natural images and noise patterns, as well as intermediate interpolated patterns at three interpolation levels (25%, 50%, and 75%) were presented to anesthetized monkeys in a block paradigm. We observed reliable visual activity in occipital visual areas including V1, V2, V3, V3A, and V4 as well as the fundus and anterior bank of the superior temporal sulcus (STS). Natural images consistently elicited higher BOLD levels than noise patterns. For intermediate images, however, we did not observe monotonic tuning. Instead, we observed a characteristic V-shaped noise-tuning function in primary and extrastriate visual areas. BOLD signals initially decreased as noise was added to the stimulus but then increased again as the pure noise pattern was approached. We present a simple model based on the number of activated neurons and the strength of activation per neuron that can account for these results. CONCLUSIONS: We show that, for our parametric stimulus set, BOLD activity varied nonmonotonically as a function of how much noise was added to the visual stimuli, unlike the perceptual ability of humans and monkeys to identify such stimuli. This raises important caveats for interpreting fMRI data and demonstrates the importance of assessing not only which neural populations are activated by contrasting conditions during an fMRI study, but also the strength of this activation. This becomes particularly important when using the BOLD signal to make inferences about the relationship between neural activity and behavior.     

Asymmetry of the cerebral hemispheres during comparison of paired visual stimuli

In conditions of tachistoscopic presentation of visual stimuli, healthy (male and female) right-handed subjects carried out a paired comparison of the stimuli presented unilaterally and in the center of the visual field. In case of recognition of images of words and objects, the number of correct answers and motor reaction time usually did not significantly differ at two interstimuli intervals (1 and 10 s). In comparing images of faces, there also were no differences by the number of reactions, and the reaction time was less at the intervals of 1 s. The left hemisphere dominated at the identification of words and female faces, the right one--at the recognition of male faces. When the right visual field was stimulated images of various classes were recognized more differentially than at the stimulation of the left visual field. The male subjects had more prominent interhemispheric differences than the females. The increase of the interstimuli interval from 1 to 10 s brought to a weakening of the functional interhemispheric asymmetry and decreasing of the differences between the male and female subjects. The obtained data show that in the processes connected with short-time memory, functional interhemispheric asymmetry is basically formed at the initial stages of the information processing.     

Spatial structure of complex cell receptive fields measured with natural images

Neuronal receptive fields (RFs) play crucial roles in visual processing. While the linear RFs of early neurons have been well studied, RFs of cortical complex cells are nonlinear and therefore difficult to characterize, especially in the context of natural stimuli. In this study, we used a nonlinear technique to compute the RFs of complex cells from their responses to natural images. We found that each RF is well described by a small number of subunits, which are oriented, localized, and bandpass. These subunits contribute to neuronal responses in a contrast-dependent, polarity-invariant manner, and they can largely predict the orientation and spatial frequency tuning of the cell. Although the RF structures measured with natural images were similar to those measured with random stimuli, natural images were more effective for driving complex cells, thus facilitating rapid identification of the subunits. The subunit RF model provides a useful basis for understanding cortical processing of natural stimuli.     

Face-infringement space: the frame of reference of the ventral intraparietal area

Experimental studies have shown that responses of ventral intraparietal area (VIP) neurons specialize in head movements and the environment near the head. VIP neurons respond to visual, auditory, and tactile stimuli, smooth pursuit eye movements, and passive and active movements of the head. This study demonstrates mathematical structure on a higher organizational level created within VIP by the integration of a complete set of variables covering face-infringement. Rather than positing dynamics in an a priori defined coordinate system such as those of physical space, we assemble neuronal receptive fields to find out what space of variables VIP neurons together cover. Section 1 presents a view of neurons as multidimensional mathematical objects. Each VIP neuron occupies or is responsive to a region in a sensorimotor phase space, thus unifying variables relevant to the disparate sensory modalities and movements. Convergence on one neuron joins variables functionally, as space and time are joined in relativistic physics to form a unified spacetime. The space of position and motion together forms a neuronal phase space, bridging neurophysiology and the physics of face-infringement. After a brief review of the experimental literature, the neuronal phase space natural to VIP is sequentially characterized, based on experimental data. Responses of neurons indicate variables that may serve as axes of neural reference frames, and neuronal responses have been so used in this study. The space of sensory and movement variables covered by VIP receptive fields joins visual and auditory space to body-bound sensory modalities: somatosensation and the inertial senses. This joining of allocentric and egocentric modalities is in keeping with the known relationship of the parietal lobe to the sense of self in space and to hemineglect, in both humans and monkeys. Following this inductive step, variables are formalized in terms of the mathematics of graph theory to deduce which combinations are complete as a multidimensional neural structure that provides the organism with a complete set of options regarding objects impacting the face, such as acceptance, pursuit, and avoidance. We consider four basic variable types: position and motion of the face and of an external object. Formalizing the four types of variables allows us to generalize to any sensory system and to determine the necessary and sufficient conditions for a neural center (for example, a cortical region) to provide a face-infringement space. We demonstrate that VIP includes at least one such face-infringement space.     

A computational theory of visual receptive fields

A receptive field constitutes a region in the visual field where a visual cell or a visual operator responds to visual stimuli. This paper presents a theory for what types of receptive field profiles can be regarded as natural for an idealized vision system, given a set of structural requirements on the first stages of visual processing that reflect symmetry properties of the surrounding world. These symmetry properties include (i) covariance properties under scale changes, affine image deformations, and Galilean transformations of space–time as occur for real-world image data as well as specific requirements of (ii) temporal causality implying that the future cannot be accessed and (iii) a time-recursive updating mechanism of a limited temporal buffer of the past as is necessary for a genuine real-time system. Fundamental structural requirements are also imposed to ensure (iv) mutual consistency and a proper handling of internal representations at different spatial and temporal scales. It is shown how a set of families of idealized receptive field profiles can be derived by necessity regarding spatial, spatio-chromatic, and spatio-temporal receptive fields in terms of Gaussian kernels, Gaussian derivatives, or closely related operators. Such image filters have been successfully used as a basis for expressing a large number of visual operations in computer vision, regarding feature detection, feature classification, motion estimation, object recognition, spatio-temporal recognition, and shape estimation. Hence, the associated so-called scale-space theory constitutes a both theoretically well-founded and general framework for expressing visual operations. There are very close similarities between receptive field profiles predicted from this scale-space theory and receptive field profiles found by cell recordings in biological vision. Among the family of receptive field profiles derived by necessity from the assumptions, idealized models with very good qualitative agreement are obtained for (i) spatial on-center/off-surround and off-center/on-surround receptive fields in the fovea and the LGN, (ii) simple cells with spatial directional preference in V1, (iii) spatio-chromatic double-opponent neurons in V1, (iv) space–time separable spatio-temporal receptive fields in the LGN and V1, and (v) non-separable space–time tilted receptive fields in V1, all within the same unified theory. In addition, the paper presents a more general framework for relating and interpreting these receptive fields conceptually and possibly predicting new receptive field profiles as well as for pre-wiring covariance under scaling, affine, and Galilean transformations into the representations of visual stimuli. This paper describes the basic structure of the necessity results concerning receptive field profiles regarding the mathematical foundation of the theory and outlines how the proposed theory could be used in further studies and modelling of biological vision. It is also shown how receptive field responses can be interpreted physically, as the superposition of relative variations of surface structure and illumination variations, given a logarithmic brightness scale, and how receptive field measurements will be invariant under multiplicative illumination variations and exposure control mechanisms.     

Class prediction for high-dimensional class-imbalanced data

Background  

The goal of class prediction studies is to develop rules to accurately predict the class membership of new samples. The rules are derived using the values of the variables available for each subject: the main characteristic of high-dimensional data is that the number of variables greatly exceeds the number of samples. Frequently the classifiers are developed using class-imbalanced data, i.e., data sets where the number of samples in each class is not equal. Standard classification methods used on class-imbalanced data often produce classifiers that do not accurately predict the minority class; the prediction is biased towards the majority class. In this paper we investigate if the high-dimensionality poses additional challenges when dealing with class-imbalanced prediction. We evaluate the performance of six types of classifiers on class-imbalanced data, using simulated data and a publicly available data set from a breast cancer gene-expression microarray study. We also investigate the effectiveness of some strategies that are available to overcome the effect of class imbalance.     

A METHOD FOR ASSESSING PHYLOGENETIC LEAST SQUARES MODELS FOR SHAPE AND OTHER HIGH‐DIMENSIONAL MULTIVARIATE DATA

Studies of evolutionary correlations commonly use phylogenetic regression (i.e., independent contrasts and phylogenetic generalized least squares) to assess trait covariation in a phylogenetic context. However, while this approach is appropriate for evaluating trends in one or a few traits, it is incapable of assessing patterns in highly multivariate data, as the large number of variables relative to sample size prohibits parametric test statistics from being computed. This poses serious limitations for comparative biologists, who must either simplify how they quantify phenotypic traits, or alter the biological hypotheses they wish to examine. In this article, I propose a new statistical procedure for performing ANOVA and regression models in a phylogenetic context that can accommodate high‐dimensional datasets. The approach is derived from the statistical equivalency between parametric methods using covariance matrices and methods based on distance matrices. Using simulations under Brownian motion, I show that the method displays appropriate Type I error rates and statistical power, whereas standard parametric procedures have decreasing power as data dimensionality increases. As such, the new procedure provides a useful means of assessing trait covariation across a set of taxa related by a phylogeny, enabling macroevolutionary biologists to test hypotheses of adaptation, and phenotypic change in high‐dimensional datasets.     

Information in the Neuronal Representation of Individual Stimuli in the Primate Temporal Visual Cortex

To analyze the information provided about individual visual stimuliin the responses of single neurons in the primate temporal lobevisual cortex, neuronal responses to a set of 65 visual stimuli wererecorded in macaques performing a visual fixation task and analyzedusing information theoretical measures. The population of neuronsanalyzed responded primarily to faces. The stimuli included 23 facesand 42 nonface images of real-world scenes, so that the function ofthis brain region could be analyzed when it was processing relativelynatural scenes.It was found that for the majority of the neurons significantamounts of information were reflected about which of several of the23 faces had been seen. Thus the representation was not local, forin a local representation almost all the information available canbe obtained when the single stimulus to which the neuron respondsbest is shown. It is shown that the information available about anyone stimulus depended on how different (for example, how manystandard deviations) the response to that stimulus was from theaverage response to all stimuli. This was the case for responsesbelow the average response as well as above.It is shown that the fraction of information carried by the lowfiring rates of a cell was large—much larger than that carried bythe high firing rates. Part of the reason for this is that theprobability distribution of different firing rates is biased towardlow values (though with fewer very low values than would bepredicted by an exponential distribution). Another factor is thatthe variability of the response is large at intermediate and highfiring rates.Another finding is that at short sampling intervals (such as 20 ms)the neurons code information efficiently, by effectively acting asbinary variables and behaving less noisily than would be expectedof a Poisson process.     

A Cross Modal Performance-Based Measure of Sensory Stimuli Intricacy

We define a new measure of sensory stimuli which has the following properties: It is cross modal, performance based, robust, and well defined. We interpret this measure as the intricacy or complexity of the stimuli, yet its validity is independent of its interpretation. We tested the validity and cross modality of our measure using three olfactory and one visual experiment. In order to test the link between our measure and cognitive performance we also conducted an additional visual experiment. We found that our measure is correlated with the results of the well-established Rapid Serial Visual Presentation masking experiment. Specifically, ranking stimuli according to our measure was correlated at r = 0.75 (p < 0.002) with masking effectiveness. Thus, our novel measure of sensory stimuli provides a new quantitative tool for the study of sensory processing.     

Design considerations and techniques for constructing video stimuli

Techniques for constructing video playback stimuli fall into five categories. The first three involve manipulating video sequences: (1) edited video is a temporal rearrangement of raw footage, (2) processed video applies global filtering algorithms to edited video, and (3) frame-manipulated video involves manually altering individual frames. The last two, (4) exemplar-based animation and (5) parameter-based animation, are synthetic models derived from visual parameters based on a single exemplar and sample data, respectively. Image-based approaches are straightforward to apply and preserve fine spatiotemporal detail. Synthetic stimuli are desirable when a large number of manipulations are called for and to ensure individual stimuli reflect population characteristics. Received: 13 December 1999 / Received in revised form: 25 February 2000 / Accepted: 1 March 2000     

Does Presentation Format Influence Visual Size Discrimination in Tufted Capuchin Monkeys (Sapajus spp.)?

Most experimental paradigms to study visual cognition in humans and non-human species are based on discrimination tasks involving the choice between two or more visual stimuli. To this end, different types of stimuli and procedures for stimuli presentation are used, which highlights the necessity to compare data obtained with different methods. The present study assessed whether, and to what extent, capuchin monkeys’ ability to solve a size discrimination problem is influenced by the type of procedure used to present the problem. Capuchins’ ability to generalise knowledge across different tasks was also evaluated. We trained eight adult tufted capuchin monkeys to select the larger of two stimuli of the same shape and different sizes by using pairs of food items (Experiment 1), computer images (Experiment 1) and objects (Experiment 2). Our results indicated that monkeys achieved the learning criterion faster with food stimuli compared to both images and objects. They also required consistently fewer trials with objects than with images. Moreover, female capuchins had higher levels of acquisition accuracy with food stimuli than with images. Finally, capuchins did not immediately transfer the solution of the problem acquired in one task condition to the other conditions. Overall, these findings suggest that – even in relatively simple visual discrimination problems where a single perceptual dimension (i.e., size) has to be judged – learning speed strongly depends on the mode of presentation.     

The uses of colour vision: behavioural and physiological distinctiveness of colour stimuli

Colour and greyscale (black and white) pictures look different to us, but it is not clear whether the difference in appearance is a consequence of the way our visual system uses colour signals or a by-product of our experience. In principle, colour images are qualitatively different from greyscale images because they make it possible to use different processing strategies. Colour signals provide important cues for segmenting the image into areas that represent different objects and for linking together areas that represent the same object. If this property of colour signals is exploited in visual processing we would expect colour stimuli to look different, as a class, from greyscale stimuli. We would also expect that adding colour signals to greyscale signals should change the way that those signals are processed. We have investigated these questions in behavioural and in physiological experiments. We find that male marmosets (all of which are dichromats) rapidly learn to distinguish between colour and greyscale copies of the same images. The discrimination transfers to new image pairs, to new colours and to image pairs in which the colour and greyscale images are spatially different. We find that, in a proportion of neurons recorded in the marmoset visual cortex, colour-shifts in opposite directions produce similar enhancements of the response to a luminance stimulus. We conclude that colour is, both behaviourally and physiologically, a distinctive property of images.     

Innate and learned components of human visual preference.

BACKGROUND: Recent claims in neuroscience and evolutionary biology suggest that the aesthetic sense reflects preferences for image signals whose characteristics best fit innate brain mechanisms of visual recognition. RESULTS: This hypothesis was tested by behaviourally measuring, for a set of initially unfamiliar images, the effects of category learning on preference judgements by humans, and by relating the observed data to computationally reconstructed internal representations of categorical concepts. Category learning induced complex shifts in preference behaviour. Two distinct factors - complexity and bilateral symmetry - could be identified from the data as determinants of preference judgements. The effect of the complexity factor varied with object knowledge acquired through category learning. In contrast, the impact of the symmetry factor proved to be unaffected by learning experience. Computer simulations suggested that the preference for pattern complexity relies on active (top-down) mechanisms of visual recognition, whereas the preference for pattern symmetry depends on automatic (bottom-up) mechanisms. CONCLUSIONS: Human visual preferences are not fully determined by (objective) structural regularities of image stimuli but also depend on their learned (subjective) interpretation. These two aspects are reflected in distinct complementary factors underlying preference judgements, and may be related to complementary modes of visual processing in the brain.     

Bank of Standardized Stimuli (BOSS) Phase II: 930 New Normative Photos

Researchers have only recently started to take advantage of the developments in technology and communication for sharing data and documents. However, the exchange of experimental material has not taken advantage of this progress yet. In order to facilitate access to experimental material, the Bank of Standardized Stimuli (BOSS) project was created as a free standardized set of visual stimuli accessible to all researchers, through a normative database. The BOSS is currently the largest existing photo bank providing norms for more than 15 dimensions (e.g. familiarity, visual complexity, manipulability, etc.), making the BOSS an extremely useful research tool and a mean to homogenize scientific data worldwide. The first phase of the BOSS was completed in 2010, and contained 538 normative photos. The second phase of the BOSS project presented in this article, builds on the previous phase by adding 930 new normative photo stimuli. New categories of concepts were introduced, including animals, building infrastructures, body parts, and vehicles and the number of photos in other categories was increased. All new photos of the BOSS were normalized relative to their name, familiarity, visual complexity, object agreement, viewpoint agreement, and manipulability. The availability of these norms is a precious asset that should be considered for characterizing the stimuli as a function of the requirements of research and for controlling for potential confounding effects.     

Local non-linear interactions in the visual cortex may reflect global decorrelation

The classical receptive field in the primary visual cortex have been successfully explained by sparse activation of relatively independent units, whose tuning properties reflect the statistical dependencies in the natural environment. Robust surround modulation, emerging from stimulation beyond the classical receptive field, has been associated with increase of lifetime sparseness in the V1, but the system-wide modulation of response strength have currently no theoretical explanation. We measured fMRI responses from human visual cortex and quantified the contextual modulation with a decorrelation coefficient (d), derived from a subtractive normalization model. All active cortical areas demonstrated local non-linear summation of responses, which were in line with hypothesis of global decorrelation of voxels responses. In addition, we found sensitivity to surrounding stimulus structure across the ventral stream, and large-scale sensitivity to the number of simultaneous objects. Response sparseness across voxel population increased consistently with larger stimuli. These data suggest that contextual modulation for a stimulus event reflect optimization of the code and perhaps increase in energy efficiency throughout the ventral stream hierarchy. Our model provides a novel prediction that average suppression of response amplitude for simultaneous stimuli across the cortical network is a monotonic function of similarity of response strengths in the network when the stimuli are presented alone.     

Spectral mapping tools from the earth sciences applied to spectral microscopy data.

BACKGROUND: Spectral imaging, originating from the field of earth remote sensing, is a powerful tool that is being increasingly used in a wide variety of applications for material identification. Several workers have used techniques like linear spectral unmixing (LSU) to discriminate materials in images derived from spectral microscopy. However, many spectral analysis algorithms rely on assumptions that are often violated in microscopy applications. This study explores algorithms originally developed as improvements on early earth imaging techniques that can be easily translated for use with spectral microscopy. METHODS: To best demonstrate the application of earth remote sensing spectral analysis tools to spectral microscopy data, earth imaging software was used to analyze data acquired with a Leica confocal microscope with mechanical spectral scanning. For this study, spectral training signatures (often referred to as endmembers) were selected with the ENVI (ITT Visual Information Solutions, Boulder, CO) "spectral hourglass" processing flow, a series of tools that use the spectrally over-determined nature of hyperspectral data to find the most spectrally pure (or spectrally unique) pixels within the data set. This set of endmember signatures was then used in the full range of mapping algorithms available in ENVI to determine locations, and in some cases subpixel abundances of endmembers. RESULTS: Mapping and abundance images showed a broad agreement between the spectral analysis algorithms, supported through visual assessment of output classification images and through statistical analysis of the distribution of pixels within each endmember class. CONCLUSIONS: The powerful spectral analysis algorithms available in COTS software, the result of decades of research in earth imaging, are easily translated to new sources of spectral data. Although the scale between earth imagery and spectral microscopy is radically different, the problem is the same: mapping material locations and abundances based on unique spectral signatures.     

Affective responses by adults with autism are reduced to social images but elevated to images related to circumscribed interests

Individuals with autism spectrum disorders (ASD) demonstrate increased visual attention and elevated brain reward circuitry responses to images related to circumscribed interests (CI), suggesting that a heightened affective response to CI may underlie their disproportionate salience and reward value in ASD. To determine if individuals with ASD differ from typically developing (TD) adults in their subjective emotional experience of CI object images, non-CI object images and social images, 213 TD adults and 56 adults with ASD provided arousal ratings (sensation of being energized varying along a dimension from calm to excited) and valence ratings (emotionality varying along dimension of approach to withdrawal) for a series of 114 images derived from previous research on CI. The groups did not differ on arousal ratings for any image type, but ASD adults provided higher valence ratings than TD adults for CI-related images, and lower valence ratings for social images. Even after co-varying the effects of sex, the ASD group, but not the TD group, gave higher valence ratings to CI images than social images. These findings provide additional evidence that ASD is characterized by a preference for certain categories of non-social objects and a reduced preference for social stimuli, and support the dissemination of this image set for examining aspects of the circumscribed interest phenotype in ASD.     

VEP Responses to Op-Art Stimuli

Several types of striped patterns have been reported to cause adverse sensations described as visual discomfort. Previous research using op-art-based stimuli has demonstrated that spurious eye movement signals can cause the experience of illusory motion, or shimmering effects, which might be perceived as uncomfortable. Whilst the shimmering effects are one cause of discomfort, another possible contributor to discomfort is excessive neural responses: As striped patterns do not have the statistical redundancy typical of natural images, they are perhaps unable to be encoded efficiently. If this is the case, then this should be seen in the amplitude of the EEG response. This study found that stimuli that were judged to be most comfortable were also those with the lowest EEG amplitude. This provides some support for the idea that excessive neural responses might also contribute to discomfort judgements in normal populations, in stimuli controlled for perceived contrast.