Three-dimensional displays and stereo vision

Procedures for three-dimensional image reconstruction that are based on the optical and neural apparatus of human stereoscopic vision have to be designed to work in conjunction with it. The principal methods of implementing stereo displays are described. Properties of the human visual system are outlined as they relate to depth discrimination capabilities and achieving optimal performance in stereo tasks. The concept of depth rendition is introduced to define the change in the parameters of three-dimensional configurations for cases in which the physical disposition of the stereo camera with respect to the viewed object differs from that of the observer's eyes.     

Is visual processing in the dorsal stream accessible to consciousness?

There are two highly interconnected clusters of visually responsive areas in the primate cortex. These two clusters have relatively few interconnections with each other, though those interconnections are undoubtedly important. One of the two main clusters (the dorsal stream) links the primary visual cortex (V1) to superior regions of the occipito-parietal cortex, while the other (the ventral stream) links V1 to inferior regions of the occipito-temporal cortex. According to our current understanding of the functional anatomy of these two systems, the dorsal stream's principal role is to provide real-time 'bottom-up' visual guidance of our movements online. In contrast, the ventral stream, in conjunction with top-down information from visual and semantic memory, provides perceptual representations that can serve recognition, visual thought, planning and memory offline. In recent years, this interpretation, initially based chiefly on studies of non-human primates and human neurological patients, has been well supported by functional MRI studies in humans. This perspective presents empirical evidence for the contention that the dorsal stream governs the visual control of movement without the intervention of visual awareness.     

Vision in the dimmest habitats on Earth

A very large proportion of the world's animal species are active in dim light, either under the cover of night or in the depths of the sea. The worlds they see can be dim and extended, with light reaching the eyes from all directions at once, or they can be composed of bright point sources, like the multitudes of stars seen in a clear night sky or the rare sparks of bioluminescence that are visible in the deep sea. The eye designs of nocturnal and deep-sea animals have evolved in response to these two very different types of habitats, being optimised for maximum sensitivity to extended scenes, or to point sources, or to both. After describing the many visual adaptations that have evolved across the animal kingdom for maximising sensitivity to extended and point-source scenes, I then use case studies from the recent literature to show how these adaptations have endowed nocturnal animals with excellent vision. Nocturnal animals can see colour and negotiate dimly illuminated obstacles during flight. They can also navigate using learned terrestrial landmarks, the constellations of stars or the dim pattern of polarised light formed around the moon. The conclusion from these studies is clear: nocturnal habitats are just as rich in visual details as diurnal habitats are, and nocturnal animals have evolved visual systems capable of exploiting them. The same is certainly true of deep-sea animals, as future research will no doubt reveal.     

Machine Vision Based Measurement of Dynamic Contact Angles in Microchannel Flows

When characterizing flows in miniaturized channels, the determination of the dynamic contact angle is important. By measuring the dynamic contact angle, the flow properties of the flowing liquid and the effect of material properties on the flow can be characterized. A machine vision based system to measure the contact angle of front or rear menisci of a moving liquid plug is described in this article. In this research, transparent flow channels fabricated on thermoplastic polymer and sealed with an adhesive tape are used. The transparency of the channels enables image based monitoring and measurement of flow variables, including the dynamic contact angle. It is shown that the dynamic angle can be measured from a liquid flow in a channel using the image based measurement system. An image processing algorithm has been developed in a MATLAB environment. Images are taken using a CCD camera and the channels are illuminated using a custom made ring light. Two fitting methods, a circle and two parabolas, are experimented and the results are compared in the measurement of the dynamic contact angles.     

Spectral Test Instrument for Color Vision Measurement

Common displays such as CRT or LCD screens have hmlted capabilities in displaying most color spectra correctly. The main disadvantage of these devices is that they work with three primaries and the colors displayed are the mixture of these three colours. Consequently these devices can be confusing in testing human color identification, because the spectral distribution of the colors displayed is the combined spectrum of the three primaries. We have developed a new instrument for spectrally correct color vision measurement. This instrument uses light emitting diodes (LEDs) and is capable of producing all spectra of perceivable colors, thus with appropriate test methods this instrument can be a reliable and useful tool in testing human color vision and in verifying color vision correction.     

用于立体视检测的微机软件包的设计

为了快速、方便、准确地检测人的立体视功能,根据双眼视差原理,设计了用于立体视检测的微机软件包称为立体视检测(SVT).利用该软件可在彩色屏幕(VGA)上产生静态等视差图(图中各部分的视差不随空间位置的变化而改变)、变视差图、以及在深度上的正弦波状起伏图形.叙述了设计原理和程序框图;报导了用SVT软件包对视力正常和异常儿童的立体视检测结果并讨论了其临床应用价值．     

A Novel Form of Stereo Vision in the Praying Mantis

Download video (30MB)Help with mp4 files     

计算机视觉在植物显微结构观测中的应用

植物显微结构计算机视觉技术的研究已得到人们的重视 ,本文综述了计算机视觉在植物显微结构中几个重要方面的研究进展 ,包括计算机视觉的形成和发展 ,计算机视觉在植物显微结构中的应用和目前植物显微结构计算机视觉系统的组成和原理。     

Neocortical Topology Governs the Dendritic Integrative Capacity of Layer 5 Pyramidal Neurons

1. Download high-res image (158KB)
2. Download full-size image

     

Determination of Mitochondrial Membrane Potential and Reactive Oxygen Species in Live Rat Cortical Neurons

Mitochondrial membrane potential (ΔΨm) is critical for maintaining the physiological function of the respiratory chain to generate ATP. A significant loss of ΔΨm renders cells depleted of energy with subsequent death. Reactive oxygen species (ROS) are important signaling molecules, but their accumulation in pathological conditions leads to oxidative stress. The two major sources of ROS in cells are environmental toxins and the process of oxidative phosphorylation. Mitochondrial dysfunction and oxidative stress have been implicated in the pathophysiology of many diseases; therefore, the ability to determine ΔΨm and ROS can provide important clues about the physiological status of the cell and the function of the mitochondria. Several fluorescent probes (Rhodamine 123, TMRM, TMRE, JC-1) can be used to determine Δψm in a variety of cell types, and many fluorescence indicators (Dihydroethidium, Dihydrorhodamine 123, H₂DCF-DA) can be used to determine ROS. Nearly all of the available fluorescence probes used to assess ΔΨm or ROS are single-wavelength indicators, which increase or decrease their fluorescence intensity proportional to a stimulus that increases or decreases the levels of ΔΨm or ROS. Thus, it is imperative to measure the fluorescence intensity of these probes at the baseline level and after the application of a specific stimulus. This allows one to determine the percentage of change in fluorescence intensity between the baseline level and a stimulus. This change in fluorescence intensity reflects the change in relative levels of ΔΨm or ROS. In this video, we demonstrate how to apply the fluorescence indicator, TMRM, in rat cortical neurons to determine the percentage change in TMRM fluorescence intensity between the baseline level and after applying FCCP, a mitochondrial uncoupler. The lower levels of TMRM fluorescence resulting from FCCP treatment reflect the depolarization of mitochondrial membrane potential. We also show how to apply the fluorescence probe H₂DCF-DA to assess the level of ROS in cortical neurons, first at baseline and then after application of H₂O₂. This protocol (with minor modifications) can be also used to determine changes in ∆Ψm and ROS in different cell types and in neurons isolated from other brain regions.     

A Standardized Obstacle Course for Assessment of Visual Function in Ultra Low Vision and Artificial Vision

We describe an indoor, portable, standardized course that can be used to evaluate obstacle avoidance in persons who have ultralow vision. Six sighted controls and 36 completely blind but otherwise healthy adult male (n=29) and female (n=13) subjects (age range 19-85 years), were enrolled in one of three studies involving testing of the BrainPort sensory substitution device. Subjects were asked to navigate the course prior to, and after, BrainPort training. They completed a total of 837 course runs in two different locations. Means and standard deviations were calculated across control types, courses, lights, and visits. We used a linear mixed effects model to compare different categories in the PPWS (percent preferred walking speed) and error percent data to show that the course iterations were properly designed. The course is relatively inexpensive, simple to administer, and has been shown to be a feasible way to test mobility function. Data analysis demonstrates that for the outcome of percent error as well as for percentage preferred walking speed, that each of the three courses is different, and that within each level, each of the three iterations are equal. This allows for randomization of the courses during administration.Abbreviations: preferred walking speed (PWS) course speed (CS) percentage preferred walking speed (PPWS)     

Cortical processing and perceived timing

As of yet, it is unclear how we determine relative perceived timing. One controversial suggestion is that timing perception might be related to when analyses are completed in the cortex of the brain. An alternate proposal suggests that perceived timing is instead related to the point in time at which cortical analyses commence. Accordingly, timing illusions should not occur owing to cortical analyses, but they could occur if there were differential delays between signals reaching cortex. Resolution of this controversy therefore requires that the contributions of cortical processing be isolated from the influence of subcortical activity. Here, we have done this by using binocular disparity changes, which are known to be detected via analyses that originate in cortex. We find that observers require longer stimulus exposures to detect small, relative to larger, disparity changes; observers are slower to react to smaller disparity changes and observers misperceive smaller disparity changes as being perceptually delayed. Interestingly, disparity magnitude influenced perceived timing more dramatically than it did stimulus change detection. Our data therefore suggest that perceived timing is both influenced by cortical processing and is shaped by sensory analyses subsequent to those that are minimally necessary for stimulus change perception.     

Stereoscopic depth constancy

Depth constancy is the ability to perceive a fixed depth interval in the world as constant despite changes in viewing distance and the spatial scale of depth variation. It is well known that the spatial frequency of depth variation has a large effect on threshold. In the first experiment, we determined that the visual system compensates for this differential sensitivity when the change in disparity is suprathreshold, thereby attaining constancy similar to contrast constancy in the luminance domain. In a second experiment, we examined the ability to perceive constant depth when the spatial frequency and viewing distance both changed. To attain constancy in this situation, the visual system has to estimate distance. We investigated this ability when vergence, accommodation and vertical disparity are all presented accurately and therefore provided veridical information about viewing distance. We found that constancy is nearly complete across changes in viewing distance. Depth constancy is most complete when the scale of the depth relief is constant in the world rather than when it is constant in angular units at the retina. These results bear on the efficacy of algorithms for creating stereo content.This article is part of the themed issue ‘Vision in our three-dimensional world’.     

A Novel Vision Localization Method of Automated Micro-Polishing Robot

Based on photogrammetry technology,a novel localization method of micro-polishing robot,which is restricted withincertain working space,is presented in this paper.On the basis of pinhole camera model,a new mathematical model of visionlocalization of automated polishing robot is established.The vision localization is based on the distance-constraints of featurepoints.The method to solve the mathematical model is discussed.According to the characteristics of gray image,an adaptivemethod of automatic threshold selection based on connected components is presented.The center coordinate of the featureimage point is resolved by bilinear interpolation gray square weighted algorithm.Finally,the mathematical model of testingsystem is verified by global localization test.The experimental results show that the vision localization system in working spacehas high precision.     

Widespread plant species: natives versus aliens in our changing world

Estimates of the level of invasion for a region are traditionally based on relative numbers of native and alien species. However, alien species differ dramatically in the size of their invasive ranges. Here we present the first study to quantify the level of invasion for several regions of the world in terms of the most widely distributed plant species (natives vs. aliens). Aliens accounted for 51.3% of the 120 most widely distributed plant species in North America, 43.3% in New South Wales (Australia), 34.2% in Chile, 29.7% in Argentina, and 22.5% in the Republic of South Africa. However, Europe had only 1% of alien species among the most widespread species of the flora. Across regions, alien species relative to native species were either as well-distributed (10 comparisons) or more widely distributed (5 comparisons). These striking patterns highlight the profound contribution that widespread invasive alien plants make to floristic dominance patterns across different regions. Many of the most widespread species are alien plants, and, in particular, Europe and Asia appear as major contributors to the homogenization of the floras in the Americas. We recommend that spatial extent of invasion should be explicitly incorporated in assessments of invasibility, globalization, and risk assessments.     

Fast and Robust Stereo Vision Algorithm for Obstacle Detection

Binocular computer vision is based on bionics, after the calibration through the camera head by double-exposure image synchronization, access to the calculation of two-dimensional image pixels of the three-dimensional depth information. In this paper, a fast and robust stereo vision algorithm is described to perform in-vehicle obstacles detection and characterization. The stereo algorithm which provides a suitable representation of the geometric content of the road scene is described, and an in-vehicle embedded system is presented. We present the way in which the algorithm is used, and then report experiments on real situations which show that our solution is accurate, reliable and efficient. In particular, both processes are fast, generic, robust to noise and bad conditions, and work even with partial occlusion.     

Neural responses to depth-motion stimulation in a horizontally sensitive interneurone in the optic lobe of the blowfly (Phormia terraenovae)

The neural responses to depth-motion stimulation have been investigated in a higher-order interneurone in the optic lobe of the blowfly. The optical stimulus was generated by an outline square or elements of a square moving in real depth. Extracellular, single-unit recording and signal-averaging techniques show that this neurone is velocity coding assuming different delay constants for the excitatory and inhibitory processes. There is no systematic response to the second derivative but a partial response in the excitatory range to the third derivative of motion. The neurone responses to motion in the horizontal direction but not in the vertical direction. When there is simultaneous motion in the preferred and non-preferred directions the neurone reacts systematically with excitation to motion in depth toward the eye, and with inhibition during motion away from the eye. This response is restricted to the frontal part of the eye while in the periphery excitation and inhibition cancel each other. The status of this neurone in the process of motion perception is discussed.     

Effects of cortical damage on binocular depth perception

Stereoscopic depth perception requires considerable neural computation, including the initial correspondence of the two retinal images, comparison across the local regions of the visual field and integration with other cues to depth. The most common cause for loss of stereoscopic vision is amblyopia, in which one eye has failed to form an adequate input to the visual cortex, usually due to strabismus (deviating eye) or anisometropia. However, the significant cortical processing required to produce the percept of depth means that, even when the retinal input is intact from both eyes, brain damage or dysfunction can interfere with stereoscopic vision. In this review, I examine the evidence for impairment of binocular vision and depth perception that can result from insults to the brain, including both discrete damage, temporal lobectomy and more systemic diseases such as posterior cortical atrophy.This article is part of the themed issue ‘Vision in our three-dimensional world’.