Navigation Using Sensory Substitution in Real and Virtual Mazes

Under certain specific conditions people who are blind have a perception of space that is equivalent to that of sighted individuals. However, in most cases their spatial perception is impaired. Is this simply due to their current lack of access to visual information or does the lack of visual information throughout development prevent the proper integration of the neural systems underlying spatial cognition? Sensory Substitution devices (SSDs) can transfer visual information via other senses and provide a unique tool to examine this question. We hypothesize that the use of our SSD (The EyeCane: a device that translates distance information into sounds and vibrations) can enable blind people to attain a similar performance level as the sighted in a spatial navigation task. We gave fifty-six participants training with the EyeCane. They navigated in real life-size mazes using the EyeCane SSD and in virtual renditions of the same mazes using a virtual-EyeCane. The participants were divided into four groups according to visual experience: congenitally blind, low vision & late blind, blindfolded sighted and sighted visual controls. We found that with the EyeCane participants made fewer errors in the maze, had fewer collisions, and completed the maze in less time on the last session compared to the first. By the third session, participants improved to the point where individual trials were no longer significantly different from the initial performance of the sighted visual group in terms of errors, time and collision.     

Perception of Graphical Virtual Environments by Blind Users via Sensory Substitution

Graphical virtual environments are currently far from accessible to blind users as their content is mostly visual. This is especially unfortunate as these environments hold great potential for this population for purposes such as safe orientation, education, and entertainment. Previous tools have increased accessibility but there is still a long way to go. Visual-to-audio Sensory-Substitution-Devices (SSDs) can increase accessibility generically by sonifying on-screen content regardless of the specific environment and offer increased accessibility without the use of expensive dedicated peripherals like electrode/vibrator arrays. Using SSDs virtually utilizes similar skills as when using them in the real world, enabling both training on the device and training on environments virtually before real-world visits. This could enable more complex, standardized and autonomous SSD training and new insights into multisensory interaction and the visually-deprived brain. However, whether congenitally blind users, who have never experienced virtual environments, will be able to use this information for successful perception and interaction within them is currently unclear.We tested this using the EyeMusic SSD, which conveys whole-scene visual information, to perform virtual tasks otherwise impossible without vision. Congenitally blind users had to navigate virtual environments and find doors, differentiate between them based on their features (Experiment1:task1) and surroundings (Experiment1:task2) and walk through them; these tasks were accomplished with a 95% and 97% success rate, respectively. We further explored the reactions of congenitally blind users during their first interaction with a more complex virtual environment than in the previous tasks–walking down a virtual street, recognizing different features of houses and trees, navigating to cross-walks, etc. Users reacted enthusiastically and reported feeling immersed within the environment. They highlighted the potential usefulness of such environments for understanding what visual scenes are supposed to look like and their potential for complex training and suggested many future environments they wished to experience.     

Aging and Sensory Substitution in a Virtual Navigation Task

Virtual environments are becoming ubiquitous, and used in a variety of contexts–from entertainment to training and rehabilitation. Recently, technology for making them more accessible to blind or visually impaired users has been developed, by using sound to represent visual information. The ability of older individuals to interpret these cues has not yet been studied. In this experiment, we studied the effects of age and sensory modality (visual or auditory) on navigation through a virtual maze. We added a layer of complexity by conducting the experiment in a rotating room, in order to test the effect of the spatial bias induced by the rotation on performance. Results from 29 participants showed that with the auditory cues, it took participants a longer time to complete the mazes, they took a longer path length through the maze, they paused more, and had more collisions with the walls, compared to navigation with the visual cues. The older group took a longer time to complete the mazes, they paused more, and had more collisions with the walls, compared to the younger group. There was no effect of room rotation on the performance, nor were there any significant interactions among age, feedback modality and room rotation. We conclude that there is a decline in performance with age, and that while navigation with auditory cues is possible even at an old age, it presents more challenges than visual navigation.     

Sensory basis of vigilance behavior in birds: synthesis and future prospects

Birds gather visual information through scanning behavior to make decisions relevant for survival (e.g., detecting predators and finding food). The goal of this study was (a) to review some visual properties involved in scanning behavior (retinal specialization for visual resolution and motion detection, visual acuity, and size of the blind area), and (b) hypothesize how the inter-specific variability in these properties may lead to different scanning strategies. The avian visual system has a high degree of heterogeneity in visual performance across the visual field, with some sectors providing higher levels of visual resolution and motion detection (e.g., retinal specializations) than others (e.g., peripheral retina and blind area). Thus, information quality will vary in different parts of the visual field, which contradicts some theoretical assumptions on information gathering. Birds need to move their eyes and heads to align the retinal specializations to different sectors of visual space. The rates of eye and head movements can then be used as proxies for scanning strategies. I propose specific predictions as to how each of the visual properties studied can affect scanning strategies in the context of predator detection in different habitat types and with different levels of predation risk. Establishing the degree of association between sensory specializations and scanning strategies can enhance our understanding of the evolution of anti-predator behavior.     

Artificial vision with wirelessly powered subretinal electronic implant alpha-IMS

This study aims at substituting the essential functions of photoreceptors in patients who are blind owing to untreatable forms of hereditary retinal degenerations. A microelectronic neuroprosthetic device, powered via transdermal inductive transmission, carrying 1500 independent microphotodiode-amplifier-electrode elements on a 9 mm² chip, was subretinally implanted in nine blind patients. Light perception (8/9), light localization (7/9), motion detection (5/9, angular speed up to 35 deg s⁻¹), grating acuity measurement (6/9, up to 3.3 cycles per degree) and visual acuity measurement with Landolt C-rings (2/9) up to Snellen visual acuity of 20/546 (corresponding to decimal 0.037 or corresponding to 1.43 logMAR (minimum angle of resolution)) were restored via the subretinal implant. Additionally, the identification, localization and discrimination of objects improved significantly (n = 8; p < 0.05 for each subtest) in repeated tests over a nine-month period. Three subjects were able to read letters spontaneously and one subject was able to read letters after training in an alternative-force choice test. Five subjects reported implant-mediated visual perceptions in daily life within a field of 15° of visual angle. Control tests were performed each time with the implant''s power source switched off. These data show that subretinal implants can restore visual functions that are useful for daily life.     

Suicides in Visually Impaired Persons: A Nation-Wide Register-Linked Study from Finland Based on Thirty Years of Data

Focusing on seasonality, gender, age, and suicide methods a Finnish nation-wide cohort-based study was carried out to compare suicide data between sighted, visually-impaired (WHO impairment level I-II, i.e., visual acuity >0.05, but <0.3) and blind (WHO impairment level III-V, i.e., visual acuity <0.05) victims. Standardized mortality ratios (SMR) of age- and gender-matched populations from official 1982–2011 national registers were used. Group differences in categorical variables were assessed with Pearson''s Chi-square or Fisher''s Exact test and in continuous variables with Mann-Whitney U-test. Seasonality was assessed by Chi-square for multinomials; ratio of observed to expected number of suicides was calculated with 95% confidence level. Hanging, poisoning, drowning, but rarely shooting or jumping from high places, were preferred suicide methods of the blind. Mortality was significantly increased in the visually impaired (SMR = 1.3; 95% CI 1.07–1.61), but in gender-stratified analyses the increase only affected males (1.34; 95% CI = 1.06–1.70) and not females (1.24; 95% CI 0.82–1.88). Age-stratified analyses identified blind males of working age rather than older men (as in the general population) as a high risk group that requires particular attention. The statistically significant spring suicide peak in blind subjects mirrors that of sighted victims and its possible cause in the blind is discussed.     

Visual fields, eye movements, and scanning behavior of a sit-and-wait predator, the black phoebe (Sayornis nigricans)

Foraging mode influences the dominant sensory modality used by a forager and likely the strategies of information gathering used in foraging and anti-predator contexts. We assessed three components of visual information gathering in a sit-and-wait avian predator, the black phoebe (Sayornis nigricans): configuration of the visual field, degree of eye movement, and scanning behavior through head-movement rates. We found that black phoebes have larger lateral visual fields than similarly sized ground-foraging passerines, as well as relatively narrower binocular and blind areas. Black phoebes moved their eyes, but eye movement amplitude was relatively smaller than in other passerines. Black phoebes may compensate for eye movement constraints with head movements. The rate of head movements increased before attacking prey in comparison to non-foraging contexts and before movements between perches. These findings suggest that black phoebes use their lateral visual fields, likely subtended by areas of high acuity in the retina, to track prey items in a three-dimensional space through active head movements. These head movements may increase depth perception, motion detection and tracking. Studying information gathering through head movement changes, rather than body posture changes (head-up, head-down) as generally presented in the literature, may allow us to better understand the mechanisms of information gathering from a comparative perspective.     

Influence of uncertainty and surprise on human corticospinal excitability during preparation for action

Actions are guided by prior sensory information [1-10], which is inherently uncertain. However, how the motor system is sculpted by trial-by-trial content of current sensory information remains largely unexplored. Previous work suggests that conditional probabilities, learned under a particular context, can be used preemptively to influence the output of the motor system [11-14]. To test this we used transcranial magnetic stimulation (TMS) to read out corticospinal excitability (CSE) during preparation for action in an instructed delay task [15, 16]. We systematically varied the uncertainty about an impending action by changing the validity of the instructive visual cue. We used two information-theoretic quantities to predict changes in CSE, prior to action, on a trial-by-trial basis: entropy (average uncertainty) and surprise (the stimulus-bound information conveyed by a visual cue) [17-19]. Our data show that during preparation for action, human CSE varies according to the entropy and surprise conveyed by visual events guiding action. CSE increases on trials with low entropy about the impending action and low surprise conveyed by an event. Commensurate effects were observed in reaction times. We suggest that motor output is biased according to contextual probabilities that are represented dynamically in the brain.     

Comparison of preoperative and postoperative astigmatism after superotemporal or superonasal clear corneal incision in phacoemulsification

The aim of this work was comparison of preoperative and postoperative astigmatism after superotemporal or superonasal clear corneal incision. Twenty eight eyes of 28 patients treated with phacoemulsification through superotemporal or superonasal 3 mm clear corneal incision were examined by kerato-refractometer preoperatively and six months postoperatively. Adequate score was assigned to each preoperative and postoperative K-value with associated axis of astigmatism to enable comparison. Wilcoxon paired samples test was used for statistical analysis. Postoperative uncorrected Snellen visual acuity was 0.5 or better in 26 patients. In one patient visual acuity was 0.3 because of diabetic maculopathy. Postoperative astigmatism was less or equal than preoperative in 18 and greater in 10 patients. There was no statistical difference between the preoperative and postoperative astigmatism (Wilcoxon paired samples test, p = 0.966) and therefore the conclusion can be made that the superotemporal or superonasal clear corneal incision has minimal effect on corneal astigmatism.     

An Instrument for Biofeedback Applied to Vision

One hundred and ten patients (179 eyes) with reduced visual acuity caused by different ocular disorders underwent visual rehabilitation with an instrument for biofeedback: improved biofeedback integrated system (Ibis). One hundred and fourteen eyes had age-related macular degeneration, 39 eyes had myopic macular degeneration, and 26 eyes were affected by different ocular disorders. A placebo training was developed on 34 patients (47 eyes). Thirty-three eyes had age-related macular degeneration and 15 eyes had myopic macular degeneration. Visual acuity was found to be improved in 130/179 eyes (72.62%). Mean visual acuity was 0.24 before training and 0.36 at the last follow-up. A review of the literature and possible mechanisms are discussed.     

Optimisation and Assessment of Three Modern Touch Screen Tablet Computers for Clinical Vision Testing

Technological advances have led to the development of powerful yet portable tablet computers whose touch-screen resolutions now permit the presentation of targets small enough to test the limits of normal visual acuity. Such devices have become ubiquitous in daily life and are moving into the clinical space. However, in order to produce clinically valid tests, it is important to identify the limits imposed by the screen characteristics, such as resolution, brightness uniformity, contrast linearity and the effect of viewing angle. Previously we have conducted such tests on the iPad 3. Here we extend our investigations to 2 other devices and outline a protocol for calibrating such screens, using standardised methods to measure the gamma function, warm up time, screen uniformity and the effects of viewing angle and screen reflections. We demonstrate that all three devices manifest typical gamma functions for voltage and luminance with warm up times of approximately 15 minutes. However, there were differences in homogeneity and reflectance among the displays. We suggest practical means to optimise quality of display for vision testing including screen calibration.     

人工视觉辅助系统：现状与展望

通过视觉获取图像信息是人类学习和生活的重要功能,失明则会显著降低其生活质量.因视网膜色素变性、青光眼和黄斑变性等疾病而造成后天失明者,以及由意外事故、战争等造成眼部创伤者,有可能通过人工视觉辅助系统的帮助恢复部分视觉,或者完成复杂的生活任务.一些盲症患者视觉通路的神经传导剩余部分依然有功能,因此可以借助电极阵列刺激视神经向大脑传递视觉信息,也可在大脑视觉皮层贴敷电极阵列的方法输入视觉信息.此外,还能借助体外装置,如通过人工智能将视觉转换成语音指令、触觉阵列编码等,帮助盲症患者获得环境信息.本文综述各类人工视觉辅助系统的现状,展望其发展趋势,并提出了新的植入器件与随身体外装置的新设想.     

Phase-of-firing coding of natural visual stimuli in primary visual cortex

We investigated the hypothesis that neurons encode rich naturalistic stimuli in terms of their spike times relative to the phase of ongoing network fluctuations rather than only in terms of their spike count. We recorded local field potentials (LFPs) and multiunit spikes from the primary visual cortex of anaesthetized macaques while binocularly presenting a color movie. We found that both the spike counts and the low-frequency LFP phase were reliably modulated by the movie and thus conveyed information about it. Moreover, movie periods eliciting higher firing rates also elicited a higher reliability of LFP phase across trials. To establish whether the LFP phase at which spikes were emitted conveyed visual information that could not be extracted by spike rates alone, we compared the Shannon information about the movie carried by spike counts to that carried by the phase of firing. We found that at low LFP frequencies, the phase of firing conveyed 54% additional information beyond that conveyed by spike counts. The extra information available in the phase of firing was crucial for the disambiguation between stimuli eliciting high spike rates of similar magnitude. Thus, phase coding may allow primary cortical neurons to represent several effective stimuli in an easily decodable format.     

Processing of Spatial-Frequency Altered Faces in Schizophrenia: Effects of Illness Phase and Duration

Low spatial frequency (SF) processing has been shown to be impaired in people with schizophrenia, but it is not clear how this varies with clinical state or illness chronicity. We compared schizophrenia patients (SCZ, n = 34), first episode psychosis patients (FEP, n = 22), and healthy controls (CON, n = 35) on a gender/facial discrimination task. Images were either unaltered (broadband spatial frequency, BSF), or had high or low SF information removed (LSF and HSF conditions, respectively). The task was performed at hospital admission and discharge for patients, and at corresponding time points for controls. Groups were matched on visual acuity. At admission, compared to their BSF performance, each group was significantly worse with low SF stimuli, and most impaired with high SF stimuli. The level of impairment at each SF did not depend on group. At discharge, the SCZ group performed more poorly in the LSF condition than the other groups, and showed the greatest degree of performance decline collapsed over HSF and LSF conditions, although the latter finding was not significant when controlling for visual acuity. Performance did not change significantly over time for any group. HSF processing was strongly related to visual acuity at both time points for all groups. We conclude the following: 1) SF processing abilities in schizophrenia are relatively stable across clinical state; 2) face processing abnormalities in SCZ are not secondary to problems processing specific SFs, but are due to other known difficulties constructing visual representations from degraded information; and 3) the relationship between HSF processing and visual acuity, along with known SCZ- and medication-related acuity reductions, and the elimination of a SCZ-related impairment after controlling for visual acuity in this study, all raise the possibility that some prior findings of impaired perception in SCZ may be secondary to acuity reductions.     

Motion-Dependent Filling-In of Spatiotemporal Information at the Blind Spot

We usually do not notice the blind spot, a receptor-free region on the retina. Stimuli extending through the blind spot appear filled in. However, if an object does not reach through but ends in the blind spot, it is perceived as “cut off” at the boundary. Here we show that even when there is no corresponding stimulation at opposing edges of the blind spot, well known motion-induced position shifts also extend into the blind spot and elicit a dynamic filling-in process that allows spatial structure to be extrapolated into the blind spot. We presented observers with sinusoidal gratings that drifted into or out of the blind spot, or flickered in counterphase. Gratings moving into the blind spot were perceived to be longer than those moving out of the blind spot or flickering, revealing motion-dependent filling-in. Further, observers could perceive more of a grating’s spatial structure inside the blind spot than would be predicted from simple filling-in of luminance information from the blind spot edge. This is evidence for a dynamic filling-in process that uses spatiotemporal information from the motion system to extrapolate visual percepts into the scotoma of the blind spot. Our findings also provide further support for the notion that an explicit spatial shift of topographic representations contributes to motion-induced position illusions.     

VISUAL ACUITY AND ILLUMINATION IN DIFFERENT SPECTRAL REGIONS

The relation between visual acuity and illumination was measured in red and blue light, using a broken circle or C and a grating as test objects. The red light data fall on single continuous curves representing pure cone vision. The blue light data fall on two distinct curves with a transition at about 0.03 photons. Values below this intensity represent pure rod vision. Those immediately above represent the cooperative activity of rods and cones, and yield higher visual acuities than either. Pure cone vision in this intensity region is given by central fixation (C test object). All the rest of the values above this transition region represent pure cone vision. In blue light the rod data with the C lie about 1.5 log units lower on the intensity axis (cone scale) than they do in white light, while with the grating they lie about 1.0 log unit lower than in white light. Both the pure rod and cone data with the C test object are precisely described by one form of the stationary state equation. With the grating test object and a non-limiting pupil, the pure rod and cone data are described by another form of the same equation in which the curve is half as steep. The introduction of a small pupil, which limits maximum visual acuity, makes the relation between visual acuity and illumination appear steeper. Determinations of maximum visual acuities under a variety of conditions show that for the grating the pupil has to be larger, the longer the wavelength of the light, in order for the pupil not to be the limiting factor. Similar measurements with the C show that when intensity discrimination at the retina is experimentally made the limiting factor in resolution, visual acuity is improved by conditions designed to increase image contrast. However, intensity discrimination cannot be the limiting factor for the ordinary test object resolution because the conditions designed to improve image contrast do not improve maximum visual acuity, while those which reduce image contrast do not produce proportional reductions of visual acuity.     

The Development of Visual Areas Depends Differently on Visual Experience

Visual experience plays an important role in the development of the visual cortex; however, recent functional imaging studies have shown that the functional organization is preserved in several higher-tier visual areas in congenitally blind subjects, indicating that maturation of visual areas depend unequally on visual experience. In this study, we aim to validate this hypothesis using a multimodality MRI approach. We found increased cortical thickness in the congenitally blind was present in the early visual areas and absent in the higher-tier ones, suggesting that the structural development of the visual cortex depends hierarchically on visual experience. In congenitally blind subjects, the decreased resting-state functional connectivity with the primary somatosensory cortex was more prominent in the early visual areas than in the higher-tier ones and were more pronounced in the ventral stream than in the dorsal one, suggesting that the development of functional organization of the visual cortex also depends differently on visual experience. Moreover, congenitally blind subjects showed normal or increased functional connectivity between ipsilateral higher-tier and early visual areas, suggesting an indirect corticocortical pathway through which somatosenroy information can reach the early visual areas. These findings support our hypothesis that the development of visual areas depends differently on visual experience.     

Learning to identify near-acuity letters, either with or without flankers, results in improved letter size and spacing limits in adults with amblyopia

Amblyopia is a developmental abnormality that results in deficits for a wide range of visual tasks, most notably, the reduced ability to see fine details, the loss in contrast sensitivity especially for small objects and the difficulty in seeing objects in clutter (crowding). The primary goal of this study was to evaluate whether crowding can be ameliorated in adults with amblyopia through perceptual learning using a flanked letter identification task that was designed to reduce crowding, and if so, whether the improvements transfer to untrained visual functions: visual acuity, contrast sensitivity and the size of visual span (the amount of information obtained in one fixation). To evaluate whether the improvements following this training task were specific to training with flankers, we also trained another group of adult observers with amblyopia using a single letter identification task that was designed to improve letter contrast sensitivity, not crowding. Following 10,000 trials of training, both groups of observers showed improvements in the respective training task. The improvements generalized to improved visual acuity, letter contrast sensitivity, size of the visual span, and reduced crowding. The magnitude of the improvement for each of these measurements was similar in the two training groups. Perceptual learning regimens aimed at reducing crowding or improving letter contrast sensitivity are both effective in improving visual acuity, contrast sensitivity for near-acuity objects and reducing the crowding effect, and could be useful as a clinical treatment for amblyopia.     

Studies on the visual acuity of sheep using shape discrimination learning

Two experiments were conducted to determine the visual acuity of sheep. Three ewes were trained to discriminate between a Landolt ring and an ordinary ring of equal size associated with feed. The left and right positions of the 2 targets were shifted according to the Gellermann series. After the ewes were fully trained, their visual acuity was determined by changing the size of the rings or the distance from the target. The ewes were subjected daily to 1 or 2 sessions which consisted of 30 trials each. The criterion of successful discrimination was 2 (Exp. I) or 3 (Exp. II) consecutive sessions with more than 21 correct choices (P<0.05, Chi-square test). The best scores of visual acuity in the 3 ewes were 0.085, 0.095 and 0.19, respectively.     

Is neural filling-in necessary to explain the perceptual completion of motion and depth information?

Retinal activity is the first stage of visual perception. Retinal sampling is non-uniform and not continuous, yet visual experience is not characterized by holes and discontinuities in the world. How does the brain achieve this perceptual completion? Fifty years ago, it was suggested that visual perception involves a two-stage process of (i) edge detection followed by (ii) neural filling-in of surface properties. We examine whether this general hypothesis can account for the specific example of perceptual completion of a small target surrounded by dynamic dots (an ''artificial scotoma''), a phenomenon argued to provide insight into the mechanisms responsible for perception. We degrade the target''s borders using first blur and then depth continuity, and find that border degradation does not influence time to target disappearance. This indicates that important information for the continuity of target perception is conveyed at a coarse spatial scale. We suggest that target disappearance could result from adaptation that is not specific to borders, and question the need to hypothesize an active filling-in process to explain this phenomenon.