A Pulse Coupled Neural Network Segmentation Algorithm for Reflectance Confocal Images of Epithelial Tissue

Automatic segmentation of nuclei in reflectance confocal microscopy images is critical for visualization and rapid quantification of nuclear-to-cytoplasmic ratio, a useful indicator of epithelial precancer. Reflectance confocal microscopy can provide three-dimensional imaging of epithelial tissue in vivo with sub-cellular resolution. Changes in nuclear density or nuclear-to-cytoplasmic ratio as a function of depth obtained from confocal images can be used to determine the presence or stage of epithelial cancers. However, low nuclear to background contrast, low resolution at greater imaging depths, and significant variation in reflectance signal of nuclei complicate segmentation required for quantification of nuclear-to-cytoplasmic ratio. Here, we present an automated segmentation method to segment nuclei in reflectance confocal images using a pulse coupled neural network algorithm, specifically a spiking cortical model, and an artificial neural network classifier. The segmentation algorithm was applied to an image model of nuclei with varying nuclear to background contrast. Greater than 90% of simulated nuclei were detected for contrast of 2.0 or greater. Confocal images of porcine and human oral mucosa were used to evaluate application to epithelial tissue. Segmentation accuracy was assessed using manual segmentation of nuclei as the gold standard.     

3D cell nuclei segmentation based on gradient flow tracking

Background  

Reliable segmentation of cell nuclei from three dimensional (3D) microscopic images is an important task in many biological studies. We present a novel, fully automated method for the segmentation of cell nuclei from 3D microscopic images. It was designed specifically to segment nuclei in images where the nuclei are closely juxtaposed or touching each other. The segmentation approach has three stages: 1) a gradient diffusion procedure, 2) gradient flow tracking and grouping, and 3) local adaptive thresholding.     

Automated cell nuclear segmentation in color images of hematoxylin and eosin-stained breast biopsy

OBJECTIVE: To develop an automated, reproducible epithelial cell nuclear segmentation method to quantify cytologic features quickly and accurately from breast biopsy. STUDY DESIGN: The method, based on fuzzy c-mean clustering of the hue-band of color images and the watershed transform, was applied to 39 images from 3 histologic types (typical hyperplasia, atypical hyperplasia, and ductal carcinoma in situ [cribriform and solid]). RESULTS: The performance of the segmentation algorithm was evaluated by visually determining the percentage of badly segmented nuclei (approximately 25% for all types), the percentage of nuclei that remained in clumps (4.5-16.7%) and the percentage of missed nuclei (0.4-1.5%) for each image. CONCLUSION: The segmentation algorithm was sensitive in that a small percentage of nuclei were missed. However, the percentage of badly segmented nuclei was on the order of 25%, and the percentage of nuclei that remained in clumps was on the order of 10% of the total number of nuclei in the duct. Even so, > 600 nuclei per duct, on average, were segmented correctly; that was a sufficient number by which to calculate accurate quantitative, cytologic, morphometric measurements of epithelial cell nuclei in stained tissue sections of breast biopsy.     

Mathematical morphologic segmentation dedicated to quantitative immunohistochemistry

OBJECTIVE: To develop automatic segmentation sequences for fully automated quantitative immunohistochemistry of cancer cell nuclei by image analysis. STUDY DESIGN: The study focused on the automated delineation of cancer cell lobules and nuclei, taking breast carcinoma as an example. A hierarchic segmentation was developed, employing mainly the chaining of mathematical morphology operators. The proposed sequence was tested on 22 images of various situations, collected from 18 different cases of breast carcinoma. A quality control procedure was applied, comparing the automated method with manual outlining of cancer cell foci and with manual pricking of cancer cell nuclei. RESULTS: Good concordance was found between automated and manual segmentation procedures (90% for cancer cell clumps, 97% for cancer cell nuclei on average), but the rate of false positive nuclei (small regions labeled as nuclei by the segmentation procedure) could be relatively high (11% on average, with a maximum of 35%) and can result in underestimation of the immunostaining ratio. CONCLUSION: This study examined a preliminary approach to automated immunoquantification, limited to automated segmentation without any color characterization. The automated hierarchic segmentation presented here leads to good discrimination of cancer cell nuclei at the chosen magnification.     

Automatic image segmentation of nuclear stained breast tissue sections using color active contour model and an improved watershed method

Automatic image segmentation of immunohistologically stained breast tissue sections helps pathologists to discover the cancer disease earlier. The detection of the real number of cancer nuclei in the image is a very tedious and time consuming task. Segmentation of cancer nuclei, especially touching nuclei, presents many difficulties to separate them by traditional segmentation algorithms. This paper presents a new automatic scheme to perform both classification of breast stained nuclei and segmentation of touching nuclei in order to get the total number of cancer nuclei in each class. Firstly, a modified geometric active contour model is used for multiple contour detection of positive and negative nuclear staining in the microscopic image. Secondly, a touching nuclei method based on watershed algorithm and concave vertex graph is proposed to perform accurate quantification of the different stains. Finally, benign nuclei are identified by their morphological features and they are removed automatically from the segmented image for positive cancer nuclei assessment. The proposed classification and segmentation schemes are tested on two datasets of breast cancer cell images containing different level of malignancy. The experimental results show the superiority of the proposed methods when compared with other existing classification and segmentation methods. On the complete image database, the segmentation accuracy in term of cancer nuclei number is over than 97%, reaching an improvement of 3–4% over earlier methods.     

An edge relocation segmentation algorithm

An automated procedure that refines the nuclear contour of a previously segmented nucleus is described. The algorithm makes use of intensity information, edge magnitude information and both object and edge connectivity information. This automated procedure generates a closed contour precisely along the edge of the nucleus. The procedure was tested on a database of 3,680 red-green-blue images of thionin-SO2 and orange II-stained cervical cells obtained from normal and dysplastic samples. When used in conjunction with a simple threshold selection algorithm and an artifact removal routine, this edge relocation algorithm resulted in the correct segmentation of over 98% of the nuclei. Only 63 (1.7%) of all nuclei were incorrectly segmented.     

Combined morphometrical and syntactic structure analysis as tools for histomorphological insight into human lung carcinoma growth

Histological sections of formalin-fixed, paraffin-embedded tissue comprising 60 surgical specimens of human lung carcinoma were Feulgen stained. The histomorphological images were transferred to an automated image analysing system (VISIAC) and analysed as follows. The geometrical centers of tumor cell nuclei were defined as vertices, and the minimum spanning tree (MST) was calculated based on the two-dimensional distance between the vertices. Segmentation of the images was performed semiautomatically by interactive definition of nuclei of interest and automated detection of nuclear boundaries. Several morphometric features of tumor cell nuclei were measured including size, DNA-content (extinction), and form factor, and were set in relation to parameters of the MST. The following results were obtained: DNA-content and tumor cell nucleus size ('center cell') of different microscopic tumor growth patterns are related to the number of nearest neighboring cells. No relation was found in the neighboring (surrounding) cells. The different cell types of lung carcinoma, i.e., the different microscopic tumor textures expressed the relation of center cell features to the parameters of MST. A high amount of DNA content in branching points of the MST for epidermoid carcinoma may be interpreted as carcinoma growing in epidermoid textures tend to proliferate from tumor cell nuclei related to at least one neighboring cell. The opposite was found for large cell anaplastic carcinoma (no perceptible microscopic textures of the tumors) which showed the highest DNA content in tumor cell nuclei but which was not related to any neighboring cells. This technique allows analysis of growth centers and microenvironment conditions in human lung cancer in relation to tumor texture at the light microscopy level.     

Improved and Robust Detection of Cell Nuclei from Four Dimensional Fluorescence Images

Segmentation-free direct methods are quite efficient for automated nuclei extraction from high dimensional images. A few such methods do exist but most of them do not ensure algorithmic robustness to parameter and noise variations. In this research, we propose a method based on multiscale adaptive filtering for efficient and robust detection of nuclei centroids from four dimensional (4D) fluorescence images. A temporal feedback mechanism is employed between the enhancement and the initial detection steps of a typical direct method. We estimate the minimum and maximum nuclei diameters from the previous frame and feed back them as filter lengths for multiscale enhancement of the current frame. A radial intensity-gradient function is optimized at positions of initial centroids to estimate all nuclei diameters. This procedure continues for processing subsequent images in the sequence. Above mechanism thus ensures proper enhancement by automated estimation of major parameters. This brings robustness and safeguards the system against additive noises and effects from wrong parameters. Later, the method and its single-scale variant are simplified for further reduction of parameters. The proposed method is then extended for nuclei volume segmentation. The same optimization technique is applied to final centroid positions of the enhanced image and the estimated diameters are projected onto the binary candidate regions to segment nuclei volumes.Our method is finally integrated with a simple sequential tracking approach to establish nuclear trajectories in the 4D space. Experimental evaluations with five image-sequences (each having 271 3D sequential images) corresponding to five different mouse embryos show promising performances of our methods in terms of nuclear detection, segmentation, and tracking. A detail analysis with a sub-sequence of 101 3D images from an embryo reveals that the proposed method can improve the nuclei detection accuracy by 9 over the previous methods, which used inappropriate large valued parameters. Results also confirm that the proposed method and its variants achieve high detection accuracies ( 98 mean F-measure) irrespective of the large variations of filter parameters and noise levels.     

Automatic segmentation of cell nuclei in Feulgen-stained histological sections of prostate cancer and quantitative evaluation of segmentation results

Digital image analysis of cell nuclei is useful to obtain quantitative information for the diagnosis and prognosis of cancer. However, the lack of a reliable automatic nuclear segmentation is a limiting factor for high-throughput nuclear image analysis. We have developed a method for automatic segmentation of nuclei in Feulgen-stained histological sections of prostate cancer. A local adaptive thresholding with an object perimeter gradient verification step detected the nuclei and was combined with an active contour model that featured an optimized initialization and worked within a restricted region to improve convergence of the segmentation of each nucleus. The method was tested on 30 randomly selected image frames from three cases, comparing the results from the automatic algorithm to a manual delineation of 924 nuclei. The automatic method segmented a few more nuclei compared to the manual method, and about 73% of the manually segmented nuclei were also segmented by the automatic method. For each nucleus segmented both manually and automatically, the accuracy (i.e., agreement with manual delineation) was estimated. The mean segmentation sensitivity/specificity were 95%/96%. The results from the automatic method were not significantly different from the ground truth provided by manual segmentation. This opens the possibility for large-scale nuclear analysis based on automatic segmentation of nuclei in Feulgen-stained histological sections.     

Automated detection of tunneling nanotubes in 3D images.

BACKGROUND: This paper presents an automated method for the identification of thin membrane tubes in 3D fluorescence images. These tubes, referred to as tunneling nanotubes (TNTs), are newly discovered intercellular structures that connect living cells through a membrane continuity. TNTs are 50-200 nm in diameter, crossing from one cell to another at their nearest distance. In microscopic images, they are seen as straight lines. It now emerges that the TNTs represent the underlying structure of a new type of cell-to-cell communication. METHODS: Our approach for the identification of TNTs is based on a combination of biological cell markers and known image processing techniques. Watershed segmentation and edge detectors are used to find cell borders, TNTs, and image artifacts. Mathematical morphology is employed at several stages of the processing chain. Two image channels are used for the calculations to improve classification of watershed regions into cells and background. One image channel displays cell borders and TNTs, the second is used for cell classification and displays the cytoplasmic compartments of the cells. The method for cell segmentation is 3D, and the TNT detection incorporates 3D information using various 2D projections. RESULTS: The TNT- and cell-detection were applied to numerous 3D stacks of images. A success rate of 67% was obtained compared with manual identification of the TNTs. The digitalized results were used to achieve statistical information of selected properties of TNTs. CONCLUSION: To further explore these structures, automated detection and quantification is desirable. Consequently, this automated recognition tool will be useful in biological studies on cell-to-cell communication where TNT quantification is essential.     

A multi-model approach to simultaneous segmentation and classification of heterogeneous populations of cell nuclei in 3D confocal microscope images.

Automated segmentation and morphometry of fluorescently labeled cell nuclei in batches of 3D confocal stacks is essential for quantitative studies. Model-based segmentation algorithms are attractive due to their robustness. Previous methods incorporated a single nuclear model. This is a limitation for tissues containing multiple cell types with different nuclear features. Improved segmentation for such tissues requires algorithms that permit multiple models to be used simultaneously. This requires a tight integration of classification and segmentation algorithms. Two or more nuclear models are constructed semiautomatically from user-provided training examples. Starting with an initial over-segmentation produced by a gradient-weighted watershed algorithm, a hierarchical fragment merging tree rooted at each object is built. Linear discriminant analysis is used to classify each candidate using multiple object models. On the basis of the selected class, a Bayesian score is computed. Fragment merging decisions are made by comparing the score with that of other candidates, and the scores of constituent fragments of each candidate. The overall segmentation accuracy was 93.7% and classification accuracy was 93.5%, respectively, on a diverse collection of images drawn from five different regions of the rat brain. The multi-model method was found to achieve high accuracy on nuclear segmentation and classification by correctly resolving ambiguities in clustered regions containing heterogeneous cell populations.     

Texture analysis of cervical cell nuclei by segmentation of chromatin patterns.

Texture parameters of the nuclear chromatin pattern can contribute to the automated classification of specimens on the basis of single cell analysis in cervical cytology. Current texture parameters are abstract and therefore hamper understanding. In this paper texture parameters are described that can be derived from the chromatin pattern after segmentation of the nuclear image. These texture parameters are more directly related to the visual properties of the chromatin pattern. The image segmentation procedure is based on a region grow algorithm which specifically isolates high chromatin density. The texture analysis method has been tested on a data set of images of 112 cervical nuclei on photographic negatives digitized with a step size of 0.125 micron. The preliminary results of a classification trial indicate that these visually interpretable parameters have promising discriminatory power for the distinction between negative and positive specimens.     

Segmentation of color images from serous cytology for automated cell classification

OBJECTIVE: To design an automated system for the classification of cells based on analysis of serous cytology, with the aim of segmenting both cytoplasm and nucleus using color information from the images as the main characteristic of the cells. STUDY DESIGN: The segmentation strategy uses color information coupled with mathematical morphology tools, such as watersheds. Cytoplasm and nuclei of all diagnostic cells are retained; erythrocytes and debris are eliminated. Special techniques are used for the separation of clustered cells. RESULTS: A large set of cells was assessed by experts to score the segmentation success rate. All cells were segmented whatever their spatial configurations. The average success rate was 92.5% for nuclei and 91.1% for cytoplasm. CONCLUSION: This color information-based segmentation of images of serous cells is accurate and provides a useful tool. This segmentation strategy will improve the automated classification of cells.     

Minimizing Manual Image Segmentation Turn-Around Time for Neuronal Reconstruction by Embracing Uncertainty

The ability to automatically segment an image into distinct regions is a critical aspect in many visual processing applications. Because inaccuracies often exist in automatic segmentation, manual segmentation is necessary in some application domains to correct mistakes, such as required in the reconstruction of neuronal processes from microscopic images. The goal of the automated segmentation tool is traditionally to produce the highest-quality segmentation, where quality is measured by the similarity to actual ground truth, so as to minimize the volume of manual correction necessary. Manual correction is generally orders-of-magnitude more time consuming than automated segmentation, often making handling large images intractable. Therefore, we propose a more relevant goal: minimizing the turn-around time of automated/manual segmentation while attaining a level of similarity with ground truth. It is not always necessary to inspect every aspect of an image to generate a useful segmentation. As such, we propose a strategy to guide manual segmentation to the most uncertain parts of segmentation. Our contributions include 1) a probabilistic measure that evaluates segmentation without ground truth and 2) a methodology that leverages these probabilistic measures to significantly reduce manual correction while maintaining segmentation quality.     

Automated fluorescence image cytometry. DNA quantification and detection of chlamydial infections

Digitized fluorescence microscopy in conjunction with automated image segmentation is a promising approach for screening clinical specimens quickly and reliably. This paper describes the hardware and software of a prototype image-based cytometer that can identify fluorescent objects, discriminate true objects from artifacts and divide overlapping pairs of objects. The use of this image cytometer is discussed for: (1) the measurement of the DNA ploidy distribution of isolated mature rat liver nuclei labeled with 4',6-diamidine-2-phenylindole; (2) the comparison of the DNA ploidy distributions of the same samples measured by image cytometry (ICM) and flow cytometry (FCM); and (3) the quantification of chlamydial infection by double labeling cells with antichlamydiae antibody and Hoechst 33258 for nuclear DNA analysis. Ploidy distributions measured by the automated image cytometer compared favorably to those obtained by FCM. All pairs of overlapping nuclei were automatically detected by an additional computer algorithm, and those pairs that were clearly more than one nucleus by visual inspection were correctly divided. The irregular morphology of the chlamydiae-infected cells meant that 26% of them were not correctly identified in the fluorescein-stained images (as judged by manual inspection), but all cells were nevertheless detected correctly from the images of the Hoechst-stained samples. Automated fluorescence ICM yielded results similar to those obtained with FCM and had the additional benefit of maintaining cell and tissue architecture while preserving the opportunity for subsequent manual inspection of the specimen.     

Neural network-based segmentation and classification system for automated grading of histologic sections of bladder carcinoma

OBJECTIVE: To develop an image analysis system for automated nuclear segmentation and classification of histologic bladder sections employing quantitative nuclear features. STUDY DESIGN: Ninety-two cases were classified into three classes by experienced pathologists according to the WHO grading system: 18 cases as grade 1, 45 as grade 2, and 29 as grade 3. Nuclear segmentation was performed by means of an artificial neural network (ANN)-based pixel classification algorithm, and each case was represented by 36 nuclei features. Automated grading of bladder tumor histologic sections was performed by an ANN classifier implemented in a two-stage hierarchic tree. RESULTS: On average, 95% of the nuclei were correctly detected. At the first stage of the hierarchic tree, classifier performance in discriminating between cases of grade 1 and 2 and cases of grade 3 was 89%. At the second stage, 79% of grade 1 cases were correctly distinguished from grade 2 cases. CONCLUSION: The proposed image analysis system provides the means to reduce subjectivity in grading bladder tumors and may contribute to more accurate diagnosis and prognosis since it relies on nuclear features, the value of which has been confirmed.     

Automatic Nuclei Segmentation in H&E Stained Breast Cancer Histopathology Images

The introduction of fast digital slide scanners that provide whole slide images has led to a revival of interest in image analysis applications in pathology. Segmentation of cells and nuclei is an important first step towards automatic analysis of digitized microscopy images. We therefore developed an automated nuclei segmentation method that works with hematoxylin and eosin (H&E) stained breast cancer histopathology images, which represent regions of whole digital slides. The procedure can be divided into four main steps: 1) pre-processing with color unmixing and morphological operators, 2) marker-controlled watershed segmentation at multiple scales and with different markers, 3) post-processing for rejection of false regions and 4) merging of the results from multiple scales. The procedure was developed on a set of 21 breast cancer cases (subset A) and tested on a separate validation set of 18 cases (subset B). The evaluation was done in terms of both detection accuracy (sensitivity and positive predictive value) and segmentation accuracy (Dice coefficient). The mean estimated sensitivity for subset A was 0.875 (±0.092) and for subset B 0.853 (±0.077). The mean estimated positive predictive value was 0.904 (±0.075) and 0.886 (±0.069) for subsets A and B, respectively. For both subsets, the distribution of the Dice coefficients had a high peak around 0.9, with the vast majority of segmentations having values larger than 0.8.     

Segmentation of the Clustered Cells with Optimized Boundary Detection in Negative Phase Contrast Images

Cell image segmentation plays a central role in numerous biology studies and clinical applications. As a result, the development of cell image segmentation algorithms with high robustness and accuracy is attracting more and more attention. In this study, an automated cell image segmentation algorithm is developed to get improved cell image segmentation with respect to cell boundary detection and segmentation of the clustered cells for all cells in the field of view in negative phase contrast images. A new method which combines the thresholding method and edge based active contour method was proposed to optimize cell boundary detection. In order to segment clustered cells, the geographic peaks of cell light intensity were utilized to detect numbers and locations of the clustered cells. In this paper, the working principles of the algorithms are described. The influence of parameters in cell boundary detection and the selection of the threshold value on the final segmentation results are investigated. At last, the proposed algorithm is applied to the negative phase contrast images from different experiments. The performance of the proposed method is evaluated. Results show that the proposed method can achieve optimized cell boundary detection and highly accurate segmentation for clustered cells.