The uses of colour vision: behavioural and physiological distinctiveness of colour stimuli

Colour and greyscale (black and white) pictures look different to us, but it is not clear whether the difference in appearance is a consequence of the way our visual system uses colour signals or a by-product of our experience. In principle, colour images are qualitatively different from greyscale images because they make it possible to use different processing strategies. Colour signals provide important cues for segmenting the image into areas that represent different objects and for linking together areas that represent the same object. If this property of colour signals is exploited in visual processing we would expect colour stimuli to look different, as a class, from greyscale stimuli. We would also expect that adding colour signals to greyscale signals should change the way that those signals are processed. We have investigated these questions in behavioural and in physiological experiments. We find that male marmosets (all of which are dichromats) rapidly learn to distinguish between colour and greyscale copies of the same images. The discrimination transfers to new image pairs, to new colours and to image pairs in which the colour and greyscale images are spatially different. We find that, in a proportion of neurons recorded in the marmoset visual cortex, colour-shifts in opposite directions produce similar enhancements of the response to a luminance stimulus. We conclude that colour is, both behaviourally and physiologically, a distinctive property of images.     

Bioimage informatics: a new area of engineering biology

In recent years, the deluge of complicated molecular and cellular microscopic images creates compelling challenges for the image computing community. There has been an increasing focus on developing novel image processing, data mining, database and visualization techniques to extract, compare, search and manage the biological knowledge in these data-intensive problems. This emerging new area of bioinformatics can be called 'bioimage informatics'. This article reviews the advances of this field from several aspects, including applications, key techniques, available tools and resources. Application examples such as high-throughput/high-content phenotyping and atlas building for model organisms demonstrate the importance of bioimage informatics. The essential techniques to the success of these applications, such as bioimage feature identification, segmentation and tracking, registration, annotation, mining, image data management and visualization, are further summarized, along with a brief overview of the available bioimage databases, analysis tools and other resources.     

Validation of ThermoHuman automatic thermographic software for assessing foot temperature before and after running

The aim of the study was to evaluate an automatic thermographic software package (ThermoHuman®) for assessing skin temperature on the soles of the feet before and after running and to compare it with two manual definitions of the regions of interest (ROIs). 120 thermal images of the soles of the feet of 30 participants, at two measurement points (before and after running 30 min) and on two measurement days were analyzed. Three different models of thermographic image analyses were used to obtain the mean temperature of 9 ROIs: A) ThermoHuman (automatic definition of ROIs using ThermoHuman® software), B) Manual (manual delimitation of ROIs by proportion criteria), and C) Manual-TH (manual delimitation of ROIs in an attempt to replicate the regions analyzed by ThermoHuman). ThermoHuman resulted in an 86% reduction in time involved compared to manual delimitation. Fourteen of the 120 images (12%) presented some error in one or more of the ROI delimitations. Although the three procedures presented significant differences between them (53% in the comparison between ThermoHuman and Manual, 47% between ThermoHuman and Manual-TH, and 28% between Manual and Manual-TH), all differences had a small effect size (ES 0.2–0.4) or lower (ES < 0.2). Bland-Altman plots showed similar 95% limits of agreement between the three procedures before and after running. Intraclass correlation coefficient analysis of the three procedures presented excellent reliability (ICC>0.8). In conclusion, ThermoHuman® software was observed to be time-saving for image analysis with excellent reliability. Although results suggest that ThermoHuman® and manual methods are both valid in themselves, combining them is not recommended due to the differences observed between them.     

Segmentation of Image Data from Complex Organotypic 3D Models of Cancer Tissues with Markov Random Fields

Organotypic, three dimensional (3D) cell culture models of epithelial tumour types such as prostate cancer recapitulate key aspects of the architecture and histology of solid cancers. Morphometric analysis of multicellular 3D organoids is particularly important when additional components such as the extracellular matrix and tumour microenvironment are included in the model. The complexity of such models has so far limited their successful implementation. There is a great need for automatic, accurate and robust image segmentation tools to facilitate the analysis of such biologically relevant 3D cell culture models. We present a segmentation method based on Markov random fields (MRFs) and illustrate our method using 3D stack image data from an organotypic 3D model of prostate cancer cells co-cultured with cancer-associated fibroblasts (CAFs). The 3D segmentation output suggests that these cell types are in physical contact with each other within the model, which has important implications for tumour biology. Segmentation performance is quantified using ground truth labels and we show how each step of our method increases segmentation accuracy. We provide the ground truth labels along with the image data and code. Using independent image data we show that our segmentation method is also more generally applicable to other types of cellular microscopy and not only limited to fluorescence microscopy.     

Look@NanoSIMS--a tool for the analysis of nanoSIMS data in environmental microbiology

We describe an open-source freeware programme for high throughput analysis of nanoSIMS (nanometre-scale secondary ion mass spectrometry) data. The programme implements basic data processing and analytical functions, including display and drift-corrected accumulation of scanned planes, interactive and semi-automated definition of regions of interest (ROIs), and export of the ROIs' elemental and isotopic composition in graphical and text-based formats. Additionally, the programme offers new functions that were custom-designed to address the needs of environmental microbiologists. Specifically, it allows manual and automated classification of ROIs based on the information that is derived either from the nanoSIMS dataset itself (e.g. from labelling achieved by halogen in situ hybridization) or is provided externally (e.g. as a fluorescence in situ hybridization image). Moreover, by implementing post-processing routines coupled to built-in statistical tools, the programme allows rapid synthesis and comparative analysis of results from many different datasets. After validation of the programme, we illustrate how these new processing and analytical functions increase flexibility, efficiency and depth of the nanoSIMS data analysis. Through its custom-made and open-source design, the programme provides an efficient, reliable and easily expandable tool that can help a growing community of environmental microbiologists and researchers from other disciplines process and analyse their nanoSIMS data.     

Computer-assisted image analysis protocol that quantitatively measures subnuclear protein organization in cell populations

Many nuclear proteins, including the nuclear receptor co-repressor (NCoR) protein are localized to specific regions of the cell nucleus, and this subnuclear positioning is preserved when NCoR is expressed in cells as a fusion to a fluorescent protein (FP). To determine how specific factors may influence the subnuclear organization of NCoR requires an unbiased approach to the selection of cells for image analysis. Here, we use the co-expression of the monomeric red FP (mRFP) to select cells that also express NCoR labeled with yellow FP (YFP). The transfected cells are selected for imaging based on the diffuse cellular mRFP signal without prior knowledge of the subnuclear organization of the co-expressed YFP-NCoR. The images acquired of the expressed FPs are then analyzed using an automated image analysis protocol that identifies regions of interest (ROIs) using a set of empirically determined rules. The relative expression levels of both fluorescent proteins are estimated, and YFP-NCoR subnuclear organization is quantified based on the mean focal body size and relative intensity. The selected ROIs are tagged with an identifier and annotated with the acquired data. This integrated image analysis protocol is an unbiased method for the precise and consistent measurement of thousands of ROIs from hundreds of individual cells in the population.     

Graph of graphs analysis for multiplexed data with application to imaging mass cytometry

Imaging Mass Cytometry (IMC) combines laser ablation and mass spectrometry to quantitate metal-conjugated primary antibodies incubated in intact tumor tissue slides. This strategy allows spatially-resolved multiplexing of dozens of simultaneous protein targets with 1μm resolution. Each slide is a spatial assay consisting of high-dimensional multivariate observations (m-dimensional feature space) collected at different spatial positions and capturing data from a single biological sample or even representative spots from multiple samples when using tissue microarrays. Often, each of these spatial assays could be characterized by several regions of interest (ROIs). To extract meaningful information from the multi-dimensional observations recorded at different ROIs across different assays, we propose to analyze such datasets using a two-step graph-based approach. We first construct for each ROI a graph representing the interactions between the m covariates and compute an m dimensional vector characterizing the steady state distribution among features. We then use all these m-dimensional vectors to construct a graph between the ROIs from all assays. This second graph is subjected to a nonlinear dimension reduction analysis, retrieving the intrinsic geometric representation of the ROIs. Such a representation provides the foundation for efficient and accurate organization of the different ROIs that correlates with their phenotypes. Theoretically, we show that when the ROIs have a particular bi-modal distribution, the new representation gives rise to a better distinction between the two modalities compared to the maximum a posteriori (MAP) estimator. We applied our method to predict the sensitivity to PD-1 axis blockers treatment of lung cancer subjects based on IMC data, achieving 97.3% average accuracy on two IMC datasets. This serves as empirical evidence that the graph of graphs approach enables us to integrate multiple ROIs and the intra-relationships between the features at each ROI, giving rise to an informative representation that is strongly associated with the phenotypic state of the entire image.     

Toward standardized quantitative image quality (IQ) assessment in computed tomography (CT): A comprehensive framework for automated and comparative IQ analysis based on ICRU Report 87

PurposeBased on the guidelines from “Report 87: Radiation Dose and Image-quality Assessment in Computed Tomography” of the International Commission on Radiation Units and Measurements (ICRU), a software framework for automated quantitative image quality analysis was developed and its usability for a variety of scientific questions demonstrated.MethodsThe extendable framework currently implements the calculation of the recommended Fourier image quality (IQ) metrics modulation transfer function (MTF) and noise-power spectrum (NPS), and additional IQ quantities such as noise magnitude, CT number accuracy, uniformity across the field-of-view, contrast-to-noise ratio (CNR) and signal-to-noise ratio (SNR) of simulated lesions for a commercially available cone-beam phantom. Sample image data were acquired with different scan and reconstruction settings on CT systems from different manufacturers.ResultsSpatial resolution is analyzed in terms of edge-spread function, line-spread-function, and MTF. 3D NPS is calculated according to ICRU Report 87, and condensed to 2D and radially averaged 1D representations. Noise magnitude, CT numbers, and uniformity of these quantities are assessed on large samples of ROIs. Low-contrast resolution (CNR, SNR) is quantitatively evaluated as a function of lesion contrast and diameter. Simultaneous automated processing of several image datasets allows for straightforward comparative assessment.ConclusionsThe presented framework enables systematic, reproducible, automated and time-efficient quantitative IQ analysis. Consistent application of the ICRU guidelines facilitates standardization of quantitative assessment not only for routine quality assurance, but for a number of research questions, e.g. the comparison of different scanner models or acquisition protocols, and the evaluation of new technology or reconstruction methods.     

Use of a neural mass model for the analysis of effective connectivity among cortical regions based on high resolution EEG recordings

Assessment of brain connectivity among different brain areas during cognitive or motor tasks is a crucial problem in neuroscience today. Aim of this work is to use a neural mass model to assess the effect of various connectivity patterns in cortical electroencephalogram (EEG) power spectral density, and investigate the possibility to derive connectivity circuits from EEG data. To this end, a model of an individual region of interest (ROI) has been built as the parallel arrangement of three populations, each described as in Wendling et al. (Eur J Neurosci 15:1499–1508, 2002). Connectivity among ROIs includes three parameters, which specify the strength of connection in the different frequency bands. The following main steps have been followed: (1) we analyzed how the power spectral density (PSD) is significantly modified by the kind of coupling hypothesized among the ROIs; (2) with the model, and using an automatic fitting procedure, we looked for a simple connectivity circuit able to reproduce PSD of cortical EEG in three ROIs during a finger-movement task. The estimated parameters represent the strength of connections among the ROIs in the different frequency bands. Cortical EEGs were computed with an inverse propagation algorithm, starting from measurement performed with 96 electrodes on the scalp. The present study suggests that the model can be used as a simulation tool, able to mimic the effect of connectivity on EEG. Moreover, it can be used to look for simple connectivity circuits, able to explain the main features of observed cortical PSD. These results may open new prospectives in the use of neurophysiological models, instead of empirical models, to assess effective connectivity from neuroimaging information.     

Camera-based visibility estimation: Incorporating multiple regions and unlabeled observations

This paper investigates image processing and pattern recognition techniques to estimate atmospheric visibility based on the visual content of images from off-the-shelf cameras. We propose a prediction model that first relates image contrast measured through standard image processing techniques to atmospheric transmission. This is then related to the most common measure of atmospheric visibility, the coefficient of light extinction. The regression model is learned using a training set of images and corresponding light extinction values as measured using a transmissometer.The major contributions of this paper are twofold. First, we propose two predictive models that incorporate multiple scene regions into the estimation: regression trees and multivariate linear regression. Incorporating multiple regions is important since regions at different distances are effective for estimating light extinction under different visibility regimes. The second major contribution is a semi-supervised learning framework, which incorporates unlabeled training samples to improve the learned models. Leveraging unlabeled data for learning is important since in many applications, it is easier to obtain observations than to label them. We evaluate our models using a dataset of images and ground truth light extinction values from a visibility camera system in Phoenix, Arizona.     

Tissue counter analysis of histologic sections of melanoma: influence of mask size and shape, feature selection, statistical methods and tissue preparation.

BACKGROUND: Tissue counter analysis is an image analysis tool designed for the detection of structures in complex images at the macroscopic or microscopic scale. As a basic principle, small square or circular measuring masks are randomly placed across the image and image analysis parameters are obtained for each mask. Based on learning sets, statistical classification procedures are generated which facilitate an automated classification of new data sets. OBJECTIVE: To evaluate the influence of the size and shape of the measuring masks as well as the importance of feature selection, statistical procedures and technical preparation of slides on the performance of tissue counter analysis in microscopic images. As main quality measure of the final classification procedure, the percentage of elements that were correctly classified was used. STUDY DESIGN: HE-stained slides of 25 primary cutaneous melanomas were evaluated by tissue counter analysis for the recognition of melanoma elements (section area occupied by tumour cells) in contrast to other tissue elements and background elements. Circular and square measuring masks, various subsets of image analysis features and classification and regression trees compared with linear discriminant analysis as statistical alternatives were used. The percentage of elements that were correctly classified by the various classification procedures was assessed. In order to evaluate the applicability to slides obtained from different laboratories, the best procedure was automatically applied in a test set of another 50 cases of primary melanoma derived from the same laboratory as the learning set and two test sets of 20 cases each derived from two different laboratories, and the measurements of melanoma area in these cases were compared with conventional assessment of vertical tumour thickness. RESULTS: Square measuring masks were slightly superior to circular masks, and larger masks (64 or 128 pixels in diameter) were superior to smaller masks (8 to 32 pixels in diameter). As far as the subsets of image analysis features were concerned, colour features were superior to densitometric and Haralick texture features. Statistical moments of the grey level distribution were of least significance. CART (classification and regression tree) analysis turned out to be superior to linear discriminant analysis. In the best setting, 95% of melanoma tissue elements were correctly recognized. Automated measurement of melanoma area in the independent test sets yielded a correlation of r=0.846 with vertical tumour thickness (p<0.001), similar to the relationship reported for manual measurements. The test sets obtained from different laboratories yielded comparable results. CONCLUSIONS: Large, square measuring masks, colour features and CART analysis provide a useful setting for the automated measurement of melanoma tissue in tissue counter analysis, which can also be used for slides derived from different laboratories.     

Parallel processing in the mammalian retina

Our eyes send different 'images' of the outside world to the brain - an image of contours (line drawing), a colour image (watercolour painting) or an image of moving objects (movie). This is commonly referred to as parallel processing, and starts as early as the first synapse of the retina, the cone pedicle. Here, the molecular composition of the transmitter receptors of the postsynaptic neurons defines which images are transferred to the inner retina. Within the second synaptic layer - the inner plexiform layer - circuits that involve complex inhibitory and excitatory interactions represent filters that select 'what the eye tells the brain'.     

ImageParser: a tool for finite element generation from three-dimensional medical images

Background

The finite element method (FEM) is a powerful mathematical tool to simulate and visualize the mechanical deformation of tissues and organs during medical examinations or interventions. It is yet a challenge to build up an FEM mesh directly from a volumetric image partially because the regions (or structures) of interest (ROIs) may be irregular and fuzzy.

Methods

A software package, ImageParser, is developed to generate an FEM mesh from 3-D tomographic medical images. This software uses a semi-automatic method to detect ROIs from the context of image including neighboring tissues and organs, completes segmentation of different tissues, and meshes the organ into elements.

Results

The ImageParser is shown to build up an FEM model for simulating the mechanical responses of the breast based on 3-D CT images. The breast is compressed by two plate paddles under an overall displacement as large as 20% of the initial distance between the paddles. The strain and tangential Young's modulus distributions are specified for the biomechanical analysis of breast tissues.

Conclusion

The ImageParser can successfully exact the geometry of ROIs from a complex medical image and generate the FEM mesh with customer-defined segmentation information.

     

A rat model of diabetic wound infection for the evaluation of topical antimicrobial therapies

Diabetes mellitus is an epidemic multisystemic chronic disease that frequently is complicated by complex wound infections. Innovative topical antimicrobial therapy agents are potentially useful for multimodal treatment of these infections. However, an appropriately standardized in vivo model is currently not available to facilitate the screening of these emerging products and their effect on wound healing. To develop such a model, we analyzed, tested, and modified published models of wound healing. We optimized various aspects of the model, including animal species, diabetes induction method, hair removal technique, splint and dressing methods, the control of unintentional bacterial infection, sampling methods for the evaluation of bacterial burden, and aspects of the microscopic and macroscopic assessment of wound healing, all while taking into consideration animal welfare and the '3Rs' principle. We thus developed a new wound infection model in rats that is optimized for testing topical antimicrobial therapy agents. This model accurately reproduces the pathophysiology of infected diabetic wound healing and includes the current standard treatment (that is, debridement). The numerous benefits of this model include the ready availability of necessary materials, simple techniques, high reproducibility, and practicality for experiments with large sample sizes. Furthermore, given its similarities to infected-wound healing and treatment in humans, our new model can serve as a valid alternative for applied research.     

Image correction method for the colour contrast effect using inverse processes of the brain

In the colour contrast effect, the impression of a colour changes according to the situation; cases occur in which the colour appearance is misunderstood. We propose an image signal processing method for preventing such misperception of colour. Many conventional image improving methods emphasize the contrast of images as same as the brain does. However, by their processes, the colour contrast effect is not canceled; we misunderstand the colour. The objective of this study is to perceive original colour. Therefore, we propose an image correction method using inverse processes of the brain in order to cancel the processes of the brain, the colour contrast effect. We verified whether the proposed method corrected the colour contrast effect by conducting a psychological experiment. The results show that the method succeeds in canceling the colour contrast effect.     

In Vivo Optical Imaging of Brain Tumors and Arthritis Using Fluorescent SapC-DOPS Nanovesicles

We describe a multi-angle rotational optical imaging (MAROI) system for in vivo monitoring of physiopathological processes labeled with a fluorescent marker. Mouse models (brain tumor and arthritis) were used to evaluate the usefulness of this method. Saposin C (SapC)-dioleoylphosphatidylserine (DOPS) nanovesicles tagged with CellVue Maroon (CVM) fluorophore were administered intravenously. Animals were then placed in the rotational holder (MARS) of the in vivo imaging system. Images were acquired in 10° steps over 380°. A rectangular region of interest (ROI) was placed across the full image width at the model disease site. Within the ROI, and for every image, mean fluorescence intensity was computed after background subtraction. In the mouse models studied, the labeled nanovesicles were taken up in both the orthotopic and transgenic brain tumors, and in the arthritic sites (toes and ankles). Curve analysis of the multi angle image ROIs determined the angle with the highest signal. Thus, the optimal angle for imaging each disease site was characterized. The MAROI method applied to imaging of fluorescent compounds is a noninvasive, economical, and precise tool for in vivo quantitative analysis of the disease states in the described mouse models.     

Image motion environments: background noise for movement-based animal signals

Understanding the evolution of animal signals has to include consideration of the structure of signal and noise, and the sensory mechanisms that detect the signals. Considerable progress has been made in understanding sounds and colour signals, however, the degree to which movement-based signals are constrained by the particular patterns of environmental image motion is poorly understood. Here we have quantified the image motion generated by wind-blown plants at 12 sites in the coastal habitat of the Australian lizard Amphibolurus muricatus. Sampling across different plant communities and meteorological conditions revealed distinct image motion environments. At all locations, image motion became more directional and apparent speed increased as wind speeds increased. The magnitude of these changes and the spatial distribution of image motion, however, varied between locations probably as a function of plant structure and the topographic location. In addition, we show that the background motion noise depends strongly on the particular depth-structure of the environment and argue that such microhabitat differences suggest specific strategies to preserve signal efficacy. Movement-based signals and motion processing mechanisms, therefore, may reveal the same type of habitat specific structural variation that we see for signals from other modalities.     

鼻咽癌细胞双光子显微图像处理

鼻咽细胞的双光子显微图像中含有着丰富信息,借助计算机和图像处理算法可进行分析处理。图象分割是双光子显微图象处理中的一项重要技术,至今为止尚未形成一个最佳通用方法,也没有定义出双光子显微图象分割的统一标准。本文首先采用噪声干扰法进行去噪,采用低帽的变换等的数学形态学来增强鼻咽癌细胞图像,使细胞更加容易分辨,接着对几种经典边缘检测算法进行讨论比较,紧接着根据鼻咽双光子显微图像的实际特征,采取腐蚀算法求出鼻咽癌细胞边缘。然后进行区域生长定位细胞,并采用一些改进的判别分析算法和区域面积算法对鼻咽癌细胞进行阈值分割,获得较好结果。