Does face image statistics predict a preferred spatial frequency for human face processing?

Psychophysical experiments suggested a relative importance of a narrow band of spatial frequencies for recognition of face identity in humans. There exists, however, no conclusive evidence of why it is that such frequencies are preferred. To address this question, I examined the amplitude spectra of a large number of face images and observed that face spectra generally fall off more steeply with spatial frequency compared with ordinary natural images. When external face features (such as hair) are suppressed, then whitening of the corresponding mean amplitude spectra revealed higher response amplitudes at those spatial frequencies which are deemed important for processing face identity. The results presented here therefore provide support for that face processing characteristics match corresponding stimulus properties.     

Blind Source Separation Techniques for the Decomposition of Multiply Labeled Fluorescence Images

Methods of blind source separation are used in many contexts to separate composite data sets according to their sources. Multiply labeled fluorescence microscopy images represent such sets, in which the sources are the individual labels. Their distributions are the quantities of interest and have to be extracted from the images. This is often challenging, since the recorded emission spectra of fluorescent dyes are environment- and instrument-specific. We have developed a nonnegative matrix factorization (NMF) algorithm to detect and separate spectrally distinct components of multiply labeled fluorescence images. It operates on spectrally resolved images and delivers both the emission spectra of the identified components and images of their abundance. We tested the proposed method using biological samples labeled with up to four spectrally overlapping fluorescent labels. In most cases, NMF accurately decomposed the images into contributions of individual dyes. However, the solutions are not unique when spectra overlap strongly or when images are diffuse in their structure. To arrive at satisfactory results in such cases, we extended NMF to incorporate preexisting qualitative knowledge about spectra and label distributions. We show how data acquired through excitations at two or three different wavelengths can be integrated and that multiple excitations greatly facilitate the decomposition. By allowing reliable decomposition in cases where the spectra of the individual labels are not known or are known only inaccurately, the proposed algorithms greatly extend the range of questions that can be addressed with quantitative microscopy.     

1/f2 Characteristics and Isotropy in the Fourier Power Spectra of Visual Art,Cartoons, Comics,Mangas, and Different Categories of Photographs

Art images and natural scenes have in common that their radially averaged (1D) Fourier spectral power falls according to a power-law with increasing spatial frequency (1/f² characteristics), which implies that the power spectra have scale-invariant properties. In the present study, we show that other categories of man-made images, cartoons and graphic novels (comics and mangas), have similar properties. Further on, we extend our investigations to 2D power spectra. In order to determine whether the Fourier power spectra of man-made images differed from those of other categories of images (photographs of natural scenes, objects, faces and plants and scientific illustrations), we analyzed their 2D power spectra by principal component analysis. Results indicated that the first fifteen principal components allowed a partial separation of the different image categories. The differences between the image categories were studied in more detail by analyzing whether the mean power and the slope of the power gradients from low to high spatial frequencies varied across orientations in the power spectra. Mean power was generally higher in cardinal orientations both in real-world photographs and artworks, with no systematic difference between the two types of images. However, the slope of the power gradients showed a lower degree of mean variability across spectral orientations (i.e., more isotropy) in art images, cartoons and graphic novels than in photographs of comparable subject matters. Taken together, these results indicate that art images, cartoons and graphic novels possess relatively uniform 1/f² characteristics across all orientations. In conclusion, the man-made stimuli studied, which were presumably produced to evoke pleasant and/or enjoyable visual perception in human observers, form a subset of all images and share statistical properties in their Fourier power spectra. Whether these properties are necessary or sufficient to induce aesthetic perception remains to be investigated.     

Real-time detection of breast cancer at the cellular level

Novel optoelectronic instrumentation has been developed for the multispectral imaging of autofluorescence emitted by metabolic fluorophores. The images resolve individual cells while spectra are collected for each pixel in the images. These datacubes are generated at a rate of 10 per second—fast enough for surgical guidance. The data is processed in real time to provide a single color-coded image to the surgeon. To date, the system has been applied to fresh, ex vivo, human surgical specimens and has distinguished breast cancer from benign tissue. The approach is applicable to in vivo measurements of surgical margins and needle-based optical biopsies. Ongoing work demonstrates that the system has great potential for translation to a hand-held probe with high sensitivity and specificity.     

The adaptive classification of the dynamic spectral patterns in the human EEG]

The classification technique of single spectra based on a matrix of intercorrelation between these spectra and the fixed set of standard spectral patterns (SP) has been put forward. Including in the classification technique a special procedure for automatic adaptation of the standard SP to given EEG records makes it possible to reduce the number of unclassified single spectra to a minimum (6-10%), which we can ignore during comparative analysis of the EEG classification profiles. Using the universal set of standard SP makes it possible to compare the results of classification of different EEG records. The results of the analysis of classification profiles of human multichannel EEG during performance of the memory task on perception of visual images are described in the paper. It has been shown that both the total EEG reorganization associated with the alpha rhythm blockade during eyes opening and less noticeable EEG shifts accompanying changes in the stages of cognitive activity are underlain by a rather differentiated transformations of relative contributions of each type of the SP into the total power spectrum. It has been revealed that a relatively small part (15-20%) of the elementary EEG segments participates in the reorganization of the EEG classification profile.     

Spectral analysis of muscle fiber images as a means of assessing sarcomere heterogeneity.

A new image-analysis-based method is described for assessing sarcomere heterogeneity in skinned rabbit psoas muscle fiber segments. This method consists of off-line, two-dimensional Fourier spectral analysis of video-taped muscle images. Local sarcomere length is assessed by partitioning the muscle images into half and quarter images spanning the original image and analyzing the associated spectra. The spectra are analyzed in two different ways, yielding two measures of sarcomere length. The first measure is obtained by calculating and inverting the centroid frequency of the first-order peak associated with each two-dimensional Fourier spectrum. The second measure is obtained in a similar manner, the only difference being that the two-dimensional spectra are first collapsed into one-dimensional line spectra by summing the pixels perpendicular to the fiber axis. Comparison of the two measures provides a measure of striation skewness that cannot be obtained by other image analysis based methods that determine sarcomere length by analyzing selected line luminance profiles.     

Distributed Biomedical Scheme for Controlled Recovery of Medical Encrypted Images

With an advancement in biomedical applications, many images are communicated over the public networks. Therefore, these medical images are prone to various security threats. Development of end to end secure communication protocol for these medical images is found to be a challenging task. Therefore, many researchers have proposed various image medica image encryption techniques to provide end to end security of medical images. However, the existing approaches of block-based recovery of the secret through progressive sharing paradigm have support for limited threshold value of the chosen blocks out of the total number of the blocks during the communication of the image. Most of the suggested scheme has fixed threshold value for the blocks during recovery of secret; works good for a limited threshold (k) value out of number of blocks (n) in which secret has been divided for security. A novel threshold based (any value of k and n) blockwide recovery of secret in progressive secret sharing has been introduced and analyzed for distributed environment. The proposed threshold block wise splitting using progressive visual secret sharing (T-BPVSS) achieves any general higher value of threshold for recovery of secret medical images. Proposed scheme is tested based on various parameters such as varying values of threshold for recovery of secret during enhanced security scenario, as well as changing dimensions of the images and introducing noise in the images. A detailed distributed computing recovery solution is also suggested for the original secret by using distribution technique of shares across the networks of computers. The scheme satisfies for perfect security condition in distributed environment using at least minimum decided threshold numbers of participants (k) before revealing any of the blocks of secret medical image.     

Shaping of Receptive Fields in the Visual Cortex During Retinal Maturation

We present a computational study of the formation of simple-cell receptive field patterns in the primary visual cortex. Based on the observation that the spatial frequency of the retinal filter increases postnatally, our results explain differences in the time course of the development of orientation selectivity in binocularly deprived and normally reared kittens. Development after eye-opening in normal animals is modelled by training with natural images, whereas in the case of binocular deprivation noise-like stimulation continues. Further, it is shown that different orientation selectivities are obtained for network models trained with natural images in contrast to random phase images of identical second order statistics. The latter finding suggests that higher-order statistics of the inputs influences development of primary visual cortex. Finally, we search for quantities that identify possible signatures of natural image statistics in order to specify the amount of constructiveness that visual experience has on the formation of receptive fields.     

Adaptation Aftereffects in the Perception of Radiological Images

Radiologists must classify and interpret medical images on the basis of visual inspection. We examined how the perception of radiological scans might be affected by common processes of adaptation in the visual system. Adaptation selectively adjusts sensitivity to the properties of the stimulus in current view, inducing an aftereffect in the appearance of stimuli viewed subsequently. These perceptual changes have been found to affect many visual attributes, but whether they are relevant to medical image perception is not well understood. To examine this we tested whether aftereffects could be generated by the characteristic spatial structure of radiological scans, and whether this could bias their appearance along dimensions that are routinely used to classify them. Measurements were focused on the effects of adaptation to images of normal mammograms, and were tested in observers who were not radiologists. Tissue density in mammograms is evaluated visually and ranges from "dense" to "fatty." Arrays of images varying in intermediate levels between these categories were created by blending dense and fatty images with different weights. Observers first adapted by viewing image samples of dense or fatty tissue, and then judged the appearance of the intermediate images by using a texture matching task. This revealed pronounced perceptual aftereffects – prior exposure to dense images caused an intermediate image to appear more fatty and vice versa. Moreover, the appearance of the adapting images themselves changed with prolonged viewing, so that they became less distinctive as textures. These aftereffects could not be accounted for by the contrast differences or power spectra of the images, and instead tended to follow from the phase spectrum. Our results suggest that observers can selectively adapt to the properties of radiological images, and that this selectivity could strongly impact the perceived textural characteristics of the images.     

Variation of the enhanced biologically damaging solar UV due to clouds.

The variation of the biologically damaging solar UV (UVBE) enhanced by clouds above that of clear sky UVBE has been investigated. This was undertaken for summer through to winter for SZA of 5 to 60 degrees employing an integrated automatic cloud and spectral UV measurement system that recorded the solar UV spectra and the sky images at five minute intervals. The UVBE calculated with action spectra with higher relative effectiveness in the UVA produced the lower percentage of cloud enhanced cases. The DNA UVBE provided the highest percentage of cloud enhanced cases compared to the total number of UV scans with 2.2% cloud enhanced cases. As a comparison, the plant and fish melanoma UVBE provided the lowest percentage of cloud enhanced cases with 0.6 to 0.8% cloud enhanced cases. For the cases of cloud enhanced UVBE, the average ratio of the measured UVBE to calculated cloud free UVBE for the photokeratitis, cataracts, plant, generalized plant damage and fish melanoma action spectra was 1.21 to 1.25. In comparison, the highest value of 1.4 was for the DNA action spectrum.     

Canvases of Political Competition: Image Production as Politics in Tamil Nadu,India

In this article, I explore the production of political images in the Indian state of Tamil Nadu. The state is known for the ubiquitous presence of banners, murals and posters in its public spaces, featuring prominent politicians and actors. It is commonly argued that these images help to convey the heroic or exclusive status of political leaders. However, such images are actually produced by party workers and therefore do not simply transpose status and image. Instead, political supporters praise their leader via these images and act as ‘kingmakers’ in constructing reputation and power. Simultaneously, by putting political images on display, supporters also authorise their own power. While praise is important in showing a person's dedication to a political party, the images, in the motivations of their producers, are suffused with ambivalence and competition as well. Hence, I argue, political image practices are not representative of politics, they are politics.     

A spectral analysis of stem bark for boreal and temperate tree species

The woody material of forest canopies has a significant effect on the total forest reflectance and on the interpretation of remotely sensed data, yet research on the spectral properties of bark has been limited. We developed a novel measurement setup for acquiring stem bark reflectance spectra in field conditions, using a mobile hyperspectral camera. The setup was used for stem bark reflectance measurements of ten boreal and temperate tree species in the visible (VIS) to near‐infrared (NIR) (400–1000 nm) wavelength region. Twenty trees of each species were measured, constituting a total of 200 hyperspectral reflectance images. The mean bark spectra of species were similar in the VIS region, and the interspecific variation was largest in the NIR region. The intraspecific variation of bark spectra was high for all studied species from the VIS to the NIR region. The spectral similarity of our study species did not correspond to the general phylogenetic lineages. The hyperspectral reflectance images revealed that the distributions of per‐pixel reflectance values within images were species‐specific. The spectral library collected in this study contributes toward building a comprehensive understanding of the spectral diversity of forests needed not only in remote sensing applications but also in, for example, biodiversity or land surface modeling studies.     

Molecular mechanism for the initial process of visual excitation

The torsion model with which we proposed to interpret the specific properties of the photoisomerization reaction of rhodopsin has been developed to apply to isorhodopsin I, isorhodopsin II and some intermediates. Based on this model, optical absorption wavelengths and oscillator strengths, as well as rotational strengths of visual pigments, analogues and intermediates at low temperatures are analyzed by varying twisted conformations of the chromophores. As a result, it was found that most of the optical data could be very well accounted for quantitatively by the torsion model. The twisting characters in the chromophore of rhodopsin are very similar to those of isorhodopsin. The obtained conformations of the chromophores are very similar in rhodopsin and its analogues, and in isorhodopsin and its analogues. Those of the chromophores of bathorhodopsin, lumirhodopsin and metarhodopsin I are similar to one another except that the conjugated chain of metarhodopsin I bends considerably when compared with the other intermediates.A part of this work was performed while one of the authors (T.K.) was a Visiting Investigator of Japan Society for the Promotion of Science at Kyoto University from April, 1977 to March, 1978     

Periodic inversion of the vertical component of the earth's magnetic field influences fluctuations of visual sensitivity in humans.

According to theoretical considerations, the magnetic field of the earth could influence the first steps of light-induced changes in ocular photopigment, an effect that is thought to underlie the magnetic orientation of some animals. To find out whether man could be influenced in this way, we have tested the effect of an artificial fluctuation in the direction of the earth's magnetic field on oscillations of the visual sensitivity in 27 healthy subjects. The resultant spectra show a significant influence of the field fluctuations, indicating that man is sensitive to changes in the direction of the earth's magnetic field.     

High-speed transient-recording microprocessor system for the analysis of asymmetrical diffraction spectra from striated muscle

A microprocessor based digital recording system has been developed to study the fine structure and asymmetry of diffraction spectra from striated muscle during contraction. Two linear 256-element photodiode arrays provide analog videosignals of the diffraction lines imaged onto these charged coupled devices. The photodiode arrays are alternately read and the videosignals can be digitized and stored within 1.36 ms (two images of 256 points) with a spatial resolution of 5 nm. (In this paper the spatial resolution is considered to be the standard deviation of the first-order maximum of a monochromatic wave of the He/Ne laser measured from the diode-arrays, using ideal gratings with a spacing between 1.6 and 3.6 microns.) The system's memory with a capacity of 192 pairs of images of 256 points can be optimized by means of a threshold to contain about 2000 images without any loss of information. A transient recording approach makes the system capable of recording long term slow phenomena of up to 5 s as well as fast events and the combination of fast events within slow processes. The system presented here has a significantly improved time resolution and storage capacity when compared to other systems and is more versatile. This is the first system which enables the simultaneous examination of the fine structure and asymmetry of diffraction spectra.     

Maintenance of upright stance in humans in normal and virtual visual environments

We recorded in 16 healthy subjects the sagittal and frontal components of the stabilogram when standing on a rigid motionless or movable (oscillating) platform under four conditions of visual control: (i) open eyes, OE; (ii) closed eyes, CE; (iii) central vision, CV, and (iv) virtual visual environment, VVE. Under the latter condition, subjects observed the 3D image of a room, which was generated by the computer; the image was adhered to head movements in such a manner that a peculiar connection for normal visual conditions between movements of the head and displacements of the visible visual environment was reproduced. Through a low-pass filtration of a trajectory of the center of pressure of feet (CPF), two elementary variables were received, horizontal motions of the center of gravity (CG) and the difference between the CPF and the CG (CPF-CG). Changes in these variables (CG and CPF-CG) were estimated using spectral analysis and subsequent calculation of the median frequency (MF) and root mean square value (RMS) of the spectra. The MFs of the spectra of the investigated variables were approximately identical under conditions of standing on oscillating and motionless supports and showed no clear dependence on various visual conditions. Unlike MFs, the RMSs of the spectra of body sways appeared more dependent on changes of conditions of standing and the mode of visual control (differing from each other in the higher sensitivity to modifications of conditions of standing and visual control). With standing on the motionless support, the RMSs of the spectra of both variables were the greatest under VVE and CE conditions and the smallest under OE condition. The body oscillations were considerably amplified under conditions of standing on a movable support, and a different pattern of visual influences on the RMS of both investigated variables was revealed. The RMSs had the greatest value under CE condition and were much smaller (50–40%) under other visual conditions, including the VVE condition. Therefore, our findings show that, under VVE conditions, visual sensory afferentation is ignored by cerebral structures controlling postural adjustments if standing occurs on a motionless support but is effectively used at the maintenance of upright stance on an oscillating support. Neirofiziologiya/Neurophysiology, Vol. 39, No. 6, pp. 476–485, November–December, 2007.     

Lipid bilayer vesicle fusion: intermediates captured by high-speed microfluorescence spectroscopy

The fusion of lipid bilayers can be visualized under the fluorescence microscope, but the process is very fast and requires special techniques for its study. It is reported here that vesicle fusion is susceptible to analysis by microspectrofluorometry and that for the first time, the entire fusion process has been captured. In the case of giant (>10- micro m diameter) bilayer vesicles having a high density of opposite charge, fusion proceeds through stages of adhesion, flattening, hemifusion, elimination of the intervening septum, and uptake of excess membrane to generate a spherical product very rapidly. These investigations became possible with a fluorescence microscope that was modified for recording of images simultaneously with the collection of fluorescence emission spectra from many (>100) positions along the fusion axis. Positively-charged vesicles, composed of O-ethylphosphatidylcholine and dioleoylphosphatidylcholine, were labeled with a carbocyanine fluorophore. Negatively-charged vesicles, composed of dioleoylphosphatidylglycerol and dioleoylphosphatidylcholine, were labeled with a rhodamine fluorophore that is a resonance energy transfer acceptor from the carbocyanine fluorophore. An electrophoretic chamber allowed selection of pairs of vesicles to be brought into contact and examined. Spectral changes along the axis of fusion were captured at high speed (a few ms/frame) by operating a sensitive digital camera in the virtual-chip mode, a software/hardware procedure that permits rapid readout of selected regions of interest and by pixel binning along the spectral direction. Simultaneously, color images were collected at video rates (30 frame/s). Comparison of the spectra and images revealed that vesicle fusion typically passes through a hemifusion stage and that the time from vesicle contact to fusion is <10 ms. Fluorescence spectra are well suited to rapid collection in the virtual-chip mode because spectra (in contrast to images) are accurately characterized with a relatively small number of points and interfering signals can be removed by judicious choice of barrier filters. The system should be especially well-suited to phenomena exhibiting rapid fluorescence change along an axis; under optimal conditions, it is possible to obtain sets of spectra (wavelength range of approximately 150 nm) at >100 positions along a line at rates >1000 frames/s with a spectral resolution of approximately 10 nm and spatial resolution at the limit of the light microscope ( approximately 0.2 micro m).     

Automatic CTF correction for single particles based upon multivariate statistical analysis of individual power spectra

Three-dimensional electron cryomicroscopy of randomly oriented single particles is a method that is suitable for the determination of three-dimensional structures of macromolecular complexes at molecular resolution. However, the electron-microscopical projection images are modulated by a contrast transfer function (CTF) that prevents the calculation of three-dimensional reconstructions of biological complexes at high resolution from uncorrected images. We describe here an automated method for the accurate determination and correction of the CTF parameters defocus, twofold astigmatism and amplitude-contrast proportion from single-particle images. At the same time, the method allows the frequency-dependent signal decrease (B factor) and the non-convoluted background signal to be estimated. The method involves the classification of the power spectra of single-particle images into groups with similar CTF parameters; this is done by multivariate statistical analysis (MSA) and hierarchically ascending classification (HAC). Averaging over several power spectra generates class averages with enhanced signal-to-noise ratios. The correct CTF parameters can be deduced from these class averages by applying an iterative correlation procedure with theoretical CTF functions; they are then used to correct the raw images. Furthermore, the method enables the tilt axis of the sample holder to be determined and allows the elimination of individual poor-quality images that show high drift or charging effects.     

近红外窄带光照下不同水果背景中桔小实蝇的图像分割

【目的】为了增强水果背景中桔小实蝇Bactrocera dorsalis Hendel（双翅目实蝇科）的识别效果,研究了该种昆虫与不同水果之间的反射光谱差异。【方法】采用紫外 可见光 近红外分光光度计测量了桔小实蝇与16种水果在400~2 500 nm波段的反射光谱。在中心波长为565 nm和827 nm的窄谱带光源及日光3种光源分别照射下,分别拍摄各种水果背景中的桔小实蝇照片,并用大津Otsu算法对照片进行二值化处理。【结果】发现桔小实蝇的反射率随波长增加而缓慢地增大,最大反射率小于40%。而16种水果的最强反射峰全部或部分落在在777～896 nm。不同水果平均最大反射率为41.10%～97.89%,与桔小实蝇在此波段的低反射率（约30%）形成强烈的反差。在827 nm中心波长窄带光源照射下拍摄的照片中,发现桔小实蝇为黑色,而背景水果呈现大面积的白色,形成高反差,桔小实蝇很容易被辨识。相反,在日光和565 nm中心波长窄带光源照射的照片中,水果背景存在较多的黑色斑块,容易与桔小实蝇的黑区混淆;或者该虫形成白斑,从而无法识别。【结论】选用近红外波段的窄带光源照射能明显提高桔小实蝇与水果图像的对比度,增强桔小实蝇的分割效果。     

A mathematical model of the primary visual cortex and hypercolumn

A mathematical model of the primary visual cortex is presented. Basically, the model comprises two features. Firstly, in analogy with the principle of the computerized tomography (CT), it assumes that simple cells in each hypercolumn are not merely detecting line segments in images as features, but rather that they are as a whole representing the local image with a certain representation. Secondly, it assumes that each hypercolumn is performing spatial frequency analyses of local images using that representation, and that the resultant spectra are represented by complex cells. The model is analyzed using numerical simulations and its advantages are discussed from the viewpoint of visual information processing. It is shown that 1) the proposed processing is tolerant to shifts in position of input images, and that 2) spatial frequency filtering operations can be easily performed in the model.