Method: automatic segmentation of mitochondria utilizing patch classification,contour pair classification,and automatically seeded level sets

Background  

While progress has been made to develop automatic segmentation techniques for mitochondria, there remains a need for more accurate and robust techniques to delineate mitochondria in serial blockface scanning electron microscopic data. Previously developed texture based methods are limited for solving this problem because texture alone is often not sufficient to identify mitochondria. This paper presents a new three-step method, the Cytoseg process, for automated segmentation of mitochondria contained in 3D electron microscopic volumes generated through serial block face scanning electron microscopic imaging. The method consists of three steps. The first is a random forest patch classification step operating directly on 2D image patches. The second step consists of contour-pair classification. At the final step, we introduce a method to automatically seed a level set operation with output from previous steps.     

Detection of nuclei in 4D Nomarski DIC microscope images of early Caenorhabditis elegans embryos using local image entropy and object tracking

Background  

The ability to detect nuclei in embryos is essential for studying the development of multicellular organisms. A system of automated nuclear detection has already been tested on a set of four-dimensional (4D) Nomarski differential interference contrast (DIC) microscope images of Caenorhabditis elegans embryos. However, the system needed laborious hand-tuning of its parameters every time a new image set was used. It could not detect nuclei in the process of cell division, and could detect nuclei only from the two- to eight-cell stages.     

An improved approach for the segmentation of starch granules in microscopic images

Background

Starches are the main storage polysaccharides in plants and are distributed widely throughout plants including seeds, roots, tubers, leaves, stems and so on. Currently, microscopic observation is one of the most important ways to investigate and analyze the structure of starches. The position, shape, and size of the starch granules are the main measurements for quantitative analysis. In order to obtain these measurements, segmentation of starch granules from the background is very important. However, automatic segmentation of starch granules is still a challenging task because of the limitation of imaging condition and the complex scenarios of overlapping granules.

Results

We propose a novel method to segment starch granules in microscopic images. In the proposed method, we first separate starch granules from background using automatic thresholding and then roughly segment the image using watershed algorithm. In order to reduce the oversegmentation in watershed algorithm, we use the roundness of each segment, and analyze the gradient vector field to find the critical points so as to identify oversegments. After oversegments are found, we extract the features, such as the position and intensity of the oversegments, and use fuzzy c-means clustering to merge the oversegments to the objects with similar features. Experimental results demonstrate that the proposed method can alleviate oversegmentation of watershed segmentation algorithm successfully.

Conclusions

We present a new scheme for starch granules segmentation. The proposed scheme aims to alleviate the oversegmentation in watershed algorithm. We use the shape information and critical points of gradient vector flow (GVF) of starch granules to identify oversegments, and use fuzzy c-mean clustering based on prior knowledge to merge these oversegments to the objects. Experimental results on twenty microscopic starch images demonstrate the effectiveness of the proposed scheme.

     

Impact of image segmentation on high-content screening data quality for SK-BR-3 cells

Background  

High content screening (HCS) is a powerful method for the exploration of cellular signalling and morphology that is rapidly being adopted in cancer research. HCS uses automated microscopy to collect images of cultured cells. The images are subjected to segmentation algorithms to identify cellular structures and quantitate their morphology, for hundreds to millions of individual cells. However, image analysis may be imperfect, especially for "HCS-unfriendly" cell lines whose morphology is not well handled by current image segmentation algorithms. We asked if segmentation errors were common for a clinically relevant cell line, if such errors had measurable effects on the data, and if HCS data could be improved by automated identification of well-segmented cells.     

Orientation determination by wavelets matching for 3D reconstruction of very noisy electron microscopic virus images

Background  

In order to perform a 3D reconstruction of electron microscopic images of viruses, it is necessary to determine the orientation (Euler angels) of the 2D projections of the virus. The projections containing high resolution information are usually very noisy. This paper proposes a new method, based on weighted-projection matching in wavelet space for virus orientation determination. In order to speed the retrieval of the best match between projections from a model and real virus particle, a hierarchical correlation matching method is also proposed.     

Segmentation of cell nuclei in tissue section analysis

Image segmentation is a critical step in digital picture analysis, especially for that of tissue sections. As the morphology of the cell nuclei provides important biological information, their segmentation is of particular interest. The known segmentation methods are not adequate for segmenting cell nuclei of tissue sections; the reason for this lies in the optical properties of their images. We have developed new gradient methods of segmentation of previously presegmented images by taking these properties into account and by using the approximately circular shape of the cell nuclei as a priori information. In our first technique, the segment method, the images of the nuclei are divided into eight segments, special gradient filters being defined for each segment. This has enabled us to improve the gradient image. After searching for local maxima, the contours of nuclei can be found. In the second method, the method of transformation into the polar coordinate system (PCS), the a priori information serves to define a circular direction field for gradient computation and contour finding. In contrast with the first method, which offers a rapid, general idea about the nuclear shape, the PCS method permits precise segmentation and morphological analysis of the cell nuclei.     

Quantitative Segmentation of Fluorescence Microscopy Images of Heterogeneous Tissue: Application to the Detection of Residual Disease in Tumor Margins

Purpose

To develop a robust tool for quantitative in situ pathology that allows visualization of heterogeneous tissue morphology and segmentation and quantification of image features.

Materials and Methods

Tissue excised from a genetically engineered mouse model of sarcoma was imaged using a subcellular resolution microendoscope after topical application of a fluorescent anatomical contrast agent: acriflavine. An algorithm based on sparse component analysis (SCA) and the circle transform (CT) was developed for image segmentation and quantification of distinct tissue types. The accuracy of our approach was quantified through simulations of tumor and muscle images. Specifically, tumor, muscle, and tumor+muscle tissue images were simulated because these tissue types were most commonly observed in sarcoma margins. Simulations were based on tissue characteristics observed in pathology slides. The potential clinical utility of our approach was evaluated by imaging excised margins and the tumor bed in a cohort of mice after surgical resection of sarcoma.

Results

Simulation experiments revealed that SCA+CT achieved the lowest errors for larger nuclear sizes and for higher contrast ratios (nuclei intensity/background intensity). For imaging of tumor margins, SCA+CT effectively isolated nuclei from tumor, muscle, adipose, and tumor+muscle tissue types. Differences in density were correctly identified with SCA+CT in a cohort of ex vivo and in vivo images, thus illustrating the diagnostic potential of our approach.

Conclusion

The combination of a subcellular-resolution microendoscope, acriflavine staining, and SCA+CT can be used to accurately isolate nuclei and quantify their density in anatomical images of heterogeneous tissue.     

Three-dimensional segmentation of nuclei and mitotic chromosomes for the study of cell divisions in live Drosophila embryos

Drosophila embryogenesis is an established model to investigate mechanisms and genes related to cell divisions in an intact multicellular organism. Progression through the cell cycle phases can be monitored in vivo using fluorescently labeled fusion proteins and time-lapse microscopy. To measure cellular properties in microscopic images, accurate and fast image segmentation methods are a critical prerequisite. To quantify static and dynamic features of interphase nuclei and mitotic chromosomes, we developed a three-dimensional (3D) segmentation method based on multiple level sets. We tested our method on 3D time-series images of live embryos expressing histone-2Av-green fluorescence protein. Our method is robust to low signal-to-noise ratios inherent to high-speed imaging, fluorescent signals in the cytoplasm, and dynamic changes of shape and texture. Comparisons with manual ground-truth segmentations showed that our method achieves more than 90% accuracy on the object as well as voxel levels and performs consistently throughout all cell cycle phases and developmental stages from syncytial blastoderm to postblastoderm mitotic domains.     

FogBank: a single cell segmentation across multiple cell lines and image modalities

Background

Many cell lines currently used in medical research, such as cancer cells or stem cells, grow in confluent sheets or colonies. The biology of individual cells provide valuable information, thus the separation of touching cells in these microscopy images is critical for counting, identification and measurement of individual cells. Over-segmentation of single cells continues to be a major problem for methods based on morphological watershed due to the high level of noise in microscopy cell images. There is a need for a new segmentation method that is robust over a wide variety of biological images and can accurately separate individual cells even in challenging datasets such as confluent sheets or colonies.

Results

We present a new automated segmentation method called FogBank that accurately separates cells when confluent and touching each other. This technique is successfully applied to phase contrast, bright field, fluorescence microscopy and binary images. The method is based on morphological watershed principles with two new features to improve accuracy and minimize over-segmentation.First, FogBank uses histogram binning to quantize pixel intensities which minimizes the image noise that causes over-segmentation. Second, FogBank uses a geodesic distance mask derived from raw images to detect the shapes of individual cells, in contrast to the more linear cell edges that other watershed-like algorithms produce.We evaluated the segmentation accuracy against manually segmented datasets using two metrics. FogBank achieved segmentation accuracy on the order of 0.75 (1 being a perfect match). We compared our method with other available segmentation techniques in term of achieved performance over the reference data sets. FogBank outperformed all related algorithms. The accuracy has also been visually verified on data sets with 14 cell lines across 3 imaging modalities leading to 876 segmentation evaluation images.

Conclusions

FogBank produces single cell segmentation from confluent cell sheets with high accuracy. It can be applied to microscopy images of multiple cell lines and a variety of imaging modalities. The code for the segmentation method is available as open-source and includes a Graphical User Interface for user friendly execution.

Electronic supplementary material

The online version of this article (doi:10.1186/s12859-014-0431-x) contains supplementary material, which is available to authorized users.     

A coarse-to-fine approach to prostate boundary segmentation in ultrasound images

Background  

In this paper a novel method for prostate segmentation in transrectal ultrasound images is presented.     

Joint level-set and spatio-temporal motion detection for cell segmentation

Background

Cell segmentation is a critical step for quantification and monitoring of cell cycle progression, cell migration, and growth control to investigate cellular immune response, embryonic development, tumorigenesis, and drug effects on live cells in time-lapse microscopy images.

Methods

In this study, we propose a joint spatio-temporal diffusion and region-based level-set optimization approach for moving cell segmentation. Moving regions are initially detected in each set of three consecutive sequence images by numerically solving a system of coupled spatio-temporal partial differential equations. In order to standardize intensities of each frame, we apply a histogram transformation approach to match the pixel intensities of each processed frame with an intensity distribution model learned from all frames of the sequence during the training stage. After the spatio-temporal diffusion stage is completed, we compute the edge map by nonparametric density estimation using Parzen kernels. This process is followed by watershed-based segmentation and moving cell detection. We use this result as an initial level-set function to evolve the cell boundaries, refine the delineation, and optimize the final segmentation result.

Results

We applied this method to several datasets of fluorescence microscopy images with varying levels of difficulty with respect to cell density, resolution, contrast, and signal-to-noise ratio. We compared the results with those produced by Chan and Vese segmentation, a temporally linked level-set technique, and nonlinear diffusion-based segmentation. We validated all segmentation techniques against reference masks provided by the international Cell Tracking Challenge consortium. The proposed approach delineated cells with an average Dice similarity coefficient of 89 % over a variety of simulated and real fluorescent image sequences. It yielded average improvements of 11 % in segmentation accuracy compared to both strictly spatial and temporally linked Chan-Vese techniques, and 4 % compared to the nonlinear spatio-temporal diffusion method.

Conclusions

Despite the wide variation in cell shape, density, mitotic events, and image quality among the datasets, our proposed method produced promising segmentation results. These results indicate the efficiency and robustness of this method especially for mitotic events and low SNR imaging, enabling the application of subsequent quantification tasks.

     

Level set segmentation of bovine corpora lutea in <Emphasis Type="Italic">ex situ</Emphasis> ovarian ultrasound images

Background  

The objective of this study was to investigate the viability of level set image segmentation methods for the detection of corpora lutea (corpus luteum, CL) boundaries in ultrasonographic ovarian images. It was hypothesized that bovine CL boundaries could be located within 1–2 mm by a level set image segmentation methodology.     

Semi-automatic algorithm for construction of the left ventricular area variation curve over a complete cardiac cycle

Background  

Two-dimensional echocardiography (2D-echo) allows the evaluation of cardiac structures and their movements. A wide range of clinical diagnoses are based on the performance of the left ventricle. The evaluation of myocardial function is typically performed by manual segmentation of the ventricular cavity in a series of dynamic images. This process is laborious and operator dependent. The automatic segmentation of the left ventricle in 4-chamber long-axis images during diastole is troublesome, because of the opening of the mitral valve.     

A high-level 3D visualization API for Java and ImageJ

Background  

Current imaging methods such as Magnetic Resonance Imaging (MRI), Confocal microscopy, Electron Microscopy (EM) or Selective Plane Illumination Microscopy (SPIM) yield three-dimensional (3D) data sets in need of appropriate computational methods for their analysis. The reconstruction, segmentation and registration are best approached from the 3D representation of the data set.     

Extended morphological processing: a practical method for automatic spot detection of biological markers from microscopic images

Background  

A reliable extraction technique for resolving multiple spots in light or electron microscopic images is essential in investigations of the spatial distribution and dynamics of specific proteins inside cells and tissues. Currently, automatic spot extraction and characterization in complex microscopic images poses many challenges to conventional image processing methods.     

Registration Error and Intensity Similarity Based Label Fusion for Segmentation

Background

Label fusion is a core step of Multi-Atlas Segmentation (MAS), which has a decisive effect on segmentation results. Although existed strategies using image intensity or image shape to fuse labels have got acceptable results, there is still necessity for further performance improvement. Here, we propose a new label fusion strategy, which considers the joint information of intensity and registration quality.

ACME: Automated Cell Morphology Extractor for Comprehensive Reconstruction of Cell Membranes

The quantification of cell shape, cell migration, and cell rearrangements is important for addressing classical questions in developmental biology such as patterning and tissue morphogenesis. Time-lapse microscopic imaging of transgenic embryos expressing fluorescent reporters is the method of choice for tracking morphogenetic changes and establishing cell lineages and fate maps in vivo. However, the manual steps involved in curating thousands of putative cell segmentations have been a major bottleneck in the application of these technologies especially for cell membranes. Segmentation of cell membranes while more difficult than nuclear segmentation is necessary for quantifying the relations between changes in cell morphology and morphogenesis. We present a novel and fully automated method to first reconstruct membrane signals and then segment out cells from 3D membrane images even in dense tissues. The approach has three stages: 1) detection of local membrane planes, 2) voting to fill structural gaps, and 3) region segmentation. We demonstrate the superior performance of the algorithms quantitatively on time-lapse confocal and two-photon images of zebrafish neuroectoderm and paraxial mesoderm by comparing its results with those derived from human inspection. We also compared with synthetic microscopic images generated by simulating the process of imaging with fluorescent reporters under varying conditions of noise. Both the over-segmentation and under-segmentation percentages of our method are around 5%. The volume overlap of individual cells, compared to expert manual segmentation, is consistently over 84%. By using our software (ACME) to study somite formation, we were able to segment touching cells with high accuracy and reliably quantify changes in morphogenetic parameters such as cell shape and size, and the arrangement of epithelial and mesenchymal cells. Our software has been developed and tested on Windows, Mac, and Linux platforms and is available publicly under an open source BSD license (https://github.com/krm15/ACME).

This is a PLoS Computational Biology Software Article.

     

A novel method for blood vessel detection from retinal images

Background  

The morphological changes of the retinal blood vessels in retinal images are important indicators for diseases like diabetes, hypertension and glaucoma. Thus the accurate segmentation of blood vessel is of diagnostic value.     

Quantifying the effect of soil compaction on three varieties of wheat (Triticum aestivum L.) using X-ray Micro Computed Tomography (CT)

Aims

X-ray Micro Computed Tomography (CT) enables interactions between roots and soil to be visualised without disturbance. This study examined responses of root growth in three Triticum aestivum L. (wheat) cultivars to different levels of soil compaction (1.1 and 1.5?g?cm^?3).

Methods

Seedlings were scanned 2, 5 and 12?days after germination (DAG) and the images were analysed using novel root tracking software, RootViz3D?, to provide accurate visualisation of root architecture. RootViz3D? proved more successful in segmenting roots from the greyscale images than semi-automated segmentation, especially for finer roots, by combining measurements of pixel greyscale values with a probability approach to identify roots.

Results

Root density was greater in soil compacted at 1.5?g?cm^?3 than at 1.1?g?cm^?3 (P?=?0.04). This effect may have resulted from improved contact between roots and surrounding soil. Root diameter was greater in soil at a high bulk density (P?=?0.006) but overall root length was reduced (P?=?0.20). Soil porosity increased with time (P?<?0.001) in the uncompacted treatment.

Conclusions

RootViz3D? root tracking software in X-ray CT studies provided accurate, non-destructive and automated three dimensional quantification of root systems that has many applications for improving understanding on root-soil interactions.