Joint level-set and spatio-temporal motion detection for cell segmentation

Background

Cell segmentation is a critical step for quantification and monitoring of cell cycle progression, cell migration, and growth control to investigate cellular immune response, embryonic development, tumorigenesis, and drug effects on live cells in time-lapse microscopy images.

Methods

In this study, we propose a joint spatio-temporal diffusion and region-based level-set optimization approach for moving cell segmentation. Moving regions are initially detected in each set of three consecutive sequence images by numerically solving a system of coupled spatio-temporal partial differential equations. In order to standardize intensities of each frame, we apply a histogram transformation approach to match the pixel intensities of each processed frame with an intensity distribution model learned from all frames of the sequence during the training stage. After the spatio-temporal diffusion stage is completed, we compute the edge map by nonparametric density estimation using Parzen kernels. This process is followed by watershed-based segmentation and moving cell detection. We use this result as an initial level-set function to evolve the cell boundaries, refine the delineation, and optimize the final segmentation result.

Results

We applied this method to several datasets of fluorescence microscopy images with varying levels of difficulty with respect to cell density, resolution, contrast, and signal-to-noise ratio. We compared the results with those produced by Chan and Vese segmentation, a temporally linked level-set technique, and nonlinear diffusion-based segmentation. We validated all segmentation techniques against reference masks provided by the international Cell Tracking Challenge consortium. The proposed approach delineated cells with an average Dice similarity coefficient of 89 % over a variety of simulated and real fluorescent image sequences. It yielded average improvements of 11 % in segmentation accuracy compared to both strictly spatial and temporally linked Chan-Vese techniques, and 4 % compared to the nonlinear spatio-temporal diffusion method.

Conclusions

Despite the wide variation in cell shape, density, mitotic events, and image quality among the datasets, our proposed method produced promising segmentation results. These results indicate the efficiency and robustness of this method especially for mitotic events and low SNR imaging, enabling the application of subsequent quantification tasks.

     

Three-dimensional segmentation of nuclei and mitotic chromosomes for the study of cell divisions in live Drosophila embryos

Drosophila embryogenesis is an established model to investigate mechanisms and genes related to cell divisions in an intact multicellular organism. Progression through the cell cycle phases can be monitored in vivo using fluorescently labeled fusion proteins and time-lapse microscopy. To measure cellular properties in microscopic images, accurate and fast image segmentation methods are a critical prerequisite. To quantify static and dynamic features of interphase nuclei and mitotic chromosomes, we developed a three-dimensional (3D) segmentation method based on multiple level sets. We tested our method on 3D time-series images of live embryos expressing histone-2Av-green fluorescence protein. Our method is robust to low signal-to-noise ratios inherent to high-speed imaging, fluorescent signals in the cytoplasm, and dynamic changes of shape and texture. Comparisons with manual ground-truth segmentations showed that our method achieves more than 90% accuracy on the object as well as voxel levels and performs consistently throughout all cell cycle phases and developmental stages from syncytial blastoderm to postblastoderm mitotic domains.     

Cell cycle dependent TN-C promoter activity determined by live cell imaging

The extracellular matrix protein tenascin-C plays a critical role in development, wound healing, and cancer progression, but how it is controlled and how it exerts its physiological responses remain unclear. By quantifying the behavior of live cells with phase contrast and fluorescence microscopy, the dynamic regulation of TN-C promoter activity is examined. We employ an NIH 3T3 cell line stably transfected with the TN-C promoter ligated to the gene sequence for destabilized green fluorescent protein (GFP). Fully automated image analysis routines, validated by comparison with data derived from manual segmentation and tracking of single cells, are used to quantify changes in the cellular GFP in hundreds of individual cells throughout their cell cycle during live cell imaging experiments lasting 62 h. We find that individual cells vary substantially in their expression patterns over the cell cycle, but that on average TN-C promoter activity increases during the last 40% of the cell cycle. We also find that the increase in promoter activity is proportional to the activity earlier in the cell cycle. This work illustrates the application of live cell microscopy and automated image analysis of a promoter-driven GFP reporter cell line to identify subtle gene regulatory mechanisms that are difficult to uncover using population averaged measurements.     

Automated method for the rapid and precise estimation of adherent cell culture characteristics from phase contrast microscopy images

The quantitative determination of key adherent cell culture characteristics such as confluency, morphology, and cell density is necessary for the evaluation of experimental outcomes and to provide a suitable basis for the establishment of robust cell culture protocols. Automated processing of images acquired using phase contrast microscopy (PCM), an imaging modality widely used for the visual inspection of adherent cell cultures, could enable the non‐invasive determination of these characteristics. We present an image‐processing approach that accurately detects cellular objects in PCM images through a combination of local contrast thresholding and post hoc correction of halo artifacts. The method was thoroughly validated using a variety of cell lines, microscope models and imaging conditions, demonstrating consistently high segmentation performance in all cases and very short processing times (<1 s per 1,208 × 960 pixels image). Based on the high segmentation performance, it was possible to precisely determine culture confluency, cell density, and the morphology of cellular objects, demonstrating the wide applicability of our algorithm for typical microscopy image processing pipelines. Furthermore, PCM image segmentation was used to facilitate the interpretation and analysis of fluorescence microscopy data, enabling the determination of temporal and spatial expression patterns of a fluorescent reporter. We created a software toolbox (PHANTAST) that bundles all the algorithms and provides an easy to use graphical user interface. Source‐code for MATLAB and ImageJ is freely available under a permissive open‐source license. Biotechnol. Bioeng. 2014;111: 504–517. © 2013 Wiley Periodicals, Inc.     

Deep learning tools and modeling to estimate the temporal expression of cell cycle proteins from 2D still images

Automatic characterization of fluorescent labeling in intact mammalian tissues remains a challenge due to the lack of quantifying techniques capable of segregating densely packed nuclei and intricate tissue patterns. Here, we describe a powerful deep learning-based approach that couples remarkably precise nuclear segmentation with quantitation of fluorescent labeling intensity within segmented nuclei, and then apply it to the analysis of cell cycle dependent protein concentration in mouse tissues using 2D fluorescent still images. First, several existing deep learning-based methods were evaluated to accurately segment nuclei using different imaging modalities with a small training dataset. Next, we developed a deep learning-based approach to identify and measure fluorescent labels within segmented nuclei, and created an ImageJ plugin to allow for efficient manual correction of nuclear segmentation and label identification. Lastly, using fluorescence intensity as a readout for protein concentration, a three-step global estimation method was applied to the characterization of the cell cycle dependent expression of E2F proteins in the developing mouse intestine.     

SuperSegger: robust image segmentation,analysis and lineage tracking of bacterial cells

Many quantitative cell biology questions require fast yet reliable automated image segmentation to identify and link cells from frame‐to‐frame, and characterize the cell morphology and fluorescence. We present SuperSegger, an automated MATLAB‐based image processing package well‐suited to quantitative analysis of high‐throughput live‐cell fluorescence microscopy of bacterial cells. SuperSegger incorporates machine‐learning algorithms to optimize cellular boundaries and automated error resolution to reliably link cells from frame‐to‐frame. Unlike existing packages, it can reliably segment microcolonies with many cells, facilitating the analysis of cell‐cycle dynamics in bacteria as well as cell‐contact mediated phenomena. This package has a range of built‐in capabilities for characterizing bacterial cells, including the identification of cell division events, mother, daughter and neighbouring cells, and computing statistics on cellular fluorescence, the location and intensity of fluorescent foci. SuperSegger provides a variety of postprocessing data visualization tools for single cell and population level analysis, such as histograms, kymographs, frame mosaics, movies and consensus images. Finally, we demonstrate the power of the package by analyzing lag phase growth with single cell resolution.     

Smart Markers for Watershed-Based Cell Segmentation

Automated cell imaging systems facilitate fast and reliable analysis of biological events at the cellular level. In these systems, the first step is usually cell segmentation that greatly affects the success of the subsequent system steps. On the other hand, similar to other image segmentation problems, cell segmentation is an ill-posed problem that typically necessitates the use of domain-specific knowledge to obtain successful segmentations even by human subjects. The approaches that can incorporate this knowledge into their segmentation algorithms have potential to greatly improve segmentation results. In this work, we propose a new approach for the effective segmentation of live cells from phase contrast microscopy. This approach introduces a new set of “smart markers” for a marker-controlled watershed algorithm, for which the identification of its markers is critical. The proposed approach relies on using domain-specific knowledge, in the form of visual characteristics of the cells, to define the markers. We evaluate our approach on a total of 1,954 cells. The experimental results demonstrate that this approach, which uses the proposed definition of smart markers, is quite effective in identifying better markers compared to its counterparts. This will, in turn, be effective in improving the segmentation performance of a marker-controlled watershed algorithm.     

Correlating cell cycle with metabolism in single cells: combination of image and metabolic cytometry.

BACKGROUND: We coin two terms: First, chemical cytometry describes the use of high-sensitivity chemical analysis techniques to study single cells. Second, metabolic cytometry is a form of chemical cytometry that monitors a cascade of biosynthetic and biodegradation products generated in a single cell. In this paper, we describe the combination of metabolic cytometry with image cytometry to correlate oligosaccharide metabolic activity with cell cycle. We use this technique to measure DNA ploidy, the uptake of a fluorescent disaccharide, and the amount of metabolic products in a single cell. METHODS: A colon adenocarcinoma cell line (HT29) was incubated with a fluorescent disaccharide, which was taken up by the cells and converted into a series of biosynthetic and biodegradation products. The cells were also treated with YOYO-3 and Hoechst 33342. The YOYO-3 signal was used as a live-dead assay, while the Hoechst 33342 signal was used to estimate the ploidy of live cells by fluorescence image cytometry. After ploidy analysis, a cell was injected into a fused-silica capillary, where the cell was lysed. Fluorescent metabolic products were then separated by capillary electrophoresis and detected by laser-induced fluorescence. RESULTS: Substrate uptake measured with metabolic cytometry gave rise to results similar to those measured by use of laser scanning confocal microscopy. The DNA ploidy histogram obtained with our simple image cytometry technique was similar to that obtained using flow cytometry. The cells in the G(1) phase did not show any biosynthetic activity in respect to the substrate. Several groups of cells with unique biosynthetic patterns were distinguished within G(2)/M cells. CONCLUSIONS: This is the first report that combined metabolic and image cytometry to correlate formation of metabolic products with cell cycle. A complete enzymatic cascade is monitored on a cell-by-cell basis and correlated with cell cycle.     

FogBank: a single cell segmentation across multiple cell lines and image modalities

Background

Many cell lines currently used in medical research, such as cancer cells or stem cells, grow in confluent sheets or colonies. The biology of individual cells provide valuable information, thus the separation of touching cells in these microscopy images is critical for counting, identification and measurement of individual cells. Over-segmentation of single cells continues to be a major problem for methods based on morphological watershed due to the high level of noise in microscopy cell images. There is a need for a new segmentation method that is robust over a wide variety of biological images and can accurately separate individual cells even in challenging datasets such as confluent sheets or colonies.

Results

We present a new automated segmentation method called FogBank that accurately separates cells when confluent and touching each other. This technique is successfully applied to phase contrast, bright field, fluorescence microscopy and binary images. The method is based on morphological watershed principles with two new features to improve accuracy and minimize over-segmentation.First, FogBank uses histogram binning to quantize pixel intensities which minimizes the image noise that causes over-segmentation. Second, FogBank uses a geodesic distance mask derived from raw images to detect the shapes of individual cells, in contrast to the more linear cell edges that other watershed-like algorithms produce.We evaluated the segmentation accuracy against manually segmented datasets using two metrics. FogBank achieved segmentation accuracy on the order of 0.75 (1 being a perfect match). We compared our method with other available segmentation techniques in term of achieved performance over the reference data sets. FogBank outperformed all related algorithms. The accuracy has also been visually verified on data sets with 14 cell lines across 3 imaging modalities leading to 876 segmentation evaluation images.

Conclusions

FogBank produces single cell segmentation from confluent cell sheets with high accuracy. It can be applied to microscopy images of multiple cell lines and a variety of imaging modalities. The code for the segmentation method is available as open-source and includes a Graphical User Interface for user friendly execution.

Electronic supplementary material

The online version of this article (doi:10.1186/s12859-014-0431-x) contains supplementary material, which is available to authorized users.     

Analysis of gene expression levels in individual bacterial cells without image segmentation

Studies of stochasticity in gene expression typically make use of fluorescent protein reporters, which permit the measurement of expression levels within individual cells by fluorescence microscopy. Analysis of such microscopy images is almost invariably based on a segmentation algorithm, where the image of a cell or cluster is analyzed mathematically to delineate individual cell boundaries. However segmentation can be ineffective for studying bacterial cells or clusters, especially at lower magnification, where outlines of individual cells are poorly resolved. Here we demonstrate an alternative method for analyzing such images without segmentation. The method employs a comparison between the pixel brightness in phase contrast vs fluorescence microscopy images. By fitting the correlation between phase contrast and fluorescence intensity to a physical model, we obtain well-defined estimates for the different levels of gene expression that are present in the cell or cluster. The method reveals the boundaries of the individual cells, even if the source images lack the resolution to show these boundaries clearly.     

Smart 3D-FISH: automation of distance analysis in nuclei of interphase cells by image processing.

BACKGROUND: Detection of fluorescent probes by fluorescence in situ hybridization in cells with preserved three-dimensional nuclear structures (3D-FISH) is useful for studying the organization of chromatin and localization of genes in interphase nuclei. Fast and reliable measurements of the relative positioning of fluorescent spots specific to subchromosomal regions and genes would improve understanding of cell structure and function. METHODS: 3D-FISH protocol, confocal microscopy, and digital image analysis were used. RESULTS: New software (Smart 3D-FISH) has been developed to automate the process of spot segmentation and distance measurements in images from 3D-FISH experiments. It can handle any number of fluorescent spots and incorporate images of 4',6-diamino-2-phenylindole counterstained nuclei to measure the relative positioning of spot loci in the nucleus and inter-spot distance. Results from a pilot experiment using Smart 3D-FISH on ENL, MLL, and AF4 genes in two lymphoblastic cell lines were satisfactory and consistent with data published in the literature. CONCLUSION: Smart 3D-FISH should greatly facilitate image processing and analysis of 3D-FISH images by providing a useful tool to overcome the laborious task of image segmentation based on user-defined parameters and decrease subjectivity in data analysis. It is available as a set of plugins for ImageJ software.     

Quantitative analysis of cell cycle phase durations and PC12 differentiation using fluorescent biosensors

Cell cycle analysis typically relies on fixed time-point measurements of cells in particular phases of the cell cycle. The cell cycle, however, is a dynamic process whose subtle shifts are lost by fixed time-point methods. Live-cell fluorescent biosensors and time-lapse microscopy allows the collection of temporal information about real time cell cycle progression and arrest. Using two genetically-encoded biosensors, we measured the precision of the G1, S, G2, and M cell cycle phase durations in different cell types and identified a bimodal G1 phase duration in a fibroblast cell line that is not present in the other cell types. Using a cell line model for neuronal differentiation, we demonstrated that NGF-induced neurite extension occurs independently of NGF-induced cell cycle G1 phase arrest. Thus, we have begun to use cell cycle fluorescent biosensors to examine the proliferation of cell populations at the resolution of individual cells and neuronal differentiation as a dynamic process of parallel cell cycle arrest and neurite outgrowth.     

Fluorescence of mast cell granules in paraffin sections and cell smears induced by an N-quaternary oxazole scintillator

Summary The N-quaternized derivative of dimethyl-POPOP (termed Q4) induces a bluish-green fluorescent reaction in mast cell granules from paraffin sections and cell smears, in addition to a previously described bluish-white fluorescent reaction in chromatin DNA. The chromatin reaction was abolished by staining the samples either with Mayer's Haematoxylin before Q4 treatment or by Q4 treatment at pH 1.5. The reaction in mast cell granules was absent after substrate methylation. The staining sequence Haematoxylin-Eosin-Q4 also worked well in paraffin sections, allowing the observation of the current histological image under bright-field illumination as well as double-colour emission under fluorescence microscopy. The sequence is proposed as a new diagnostic procedure for demonstrating mast cell granules.     

Polo-like kinase 4: the odd one out of the family

Background

Fluorescent and bioluminescent time-lapse microscopy approaches have been successfully used to investigate molecular mechanisms underlying the mammalian circadian oscillator at the single cell level. However, most of the available software and common methods based on intensity-threshold segmentation and frame-to-frame tracking are not applicable in these experiments. This is due to cell movement and dramatic changes in the fluorescent/bioluminescent reporter protein during the circadian cycle, with the lowest expression level very close to the background intensity. At present, the standard approach to analyze data sets obtained from time lapse microscopy is either manual tracking or application of generic image-processing software/dedicated tracking software. To our knowledge, these existing software solutions for manual and automatic tracking have strong limitations in tracking individual cells if their plane shifts.

Results

In an attempt to improve existing methodology of time-lapse tracking of a large number of moving cells, we have developed a semi-automatic software package. It extracts the trajectory of the cells by tracking theirs displacements, makes the delineation of cell nucleus or whole cell, and finally yields measurements of various features, like reporter protein expression level or cell displacement. As an example, we present here single cell circadian pattern and motility analysis of NIH3T3 mouse fibroblasts expressing a fluorescent circadian reporter protein. Using Circadian Gene Express plugin, we performed fast and nonbiased analysis of large fluorescent time lapse microscopy datasets.

Conclusions

Our software solution, Circadian Gene Express (CGE), is easy to use and allows precise and semi-automatic tracking of moving cells over longer period of time. In spite of significant circadian variations in protein expression with extremely low expression levels at the valley phase, CGE allows accurate and efficient recording of large number of cell parameters, including level of reporter protein expression, velocity, direction of movement, and others. CGE proves to be useful for the analysis of widefield fluorescent microscopy datasets, as well as for bioluminescence imaging. Moreover, it might be easily adaptable for confocal image analysis by manually choosing one of the focal planes of each z-stack of the various time points of a time series.

Availability

CGE is a Java plugin for ImageJ; it is freely available at: http://bigwww.epfl.ch/sage/soft/circadian/.     

Videomicrofluorometry on living cells and discriminant factorial analysis to study cell cycle distributions

After a rapid overview of the approaches used to study cell cycle, a fluorescent digital imaging microscopy method is proposed. This method is improved by a factorial analysis relying on the evaluation of several parameters recorded on each living cell. Single lympho-blastoid living cells are labeled with three fluorescent markers: Hoechst 33342 for nuclear DNA, Rhodamine 123 for mitochondria and Nile Red for plasma membrane. For each cell, morphological and functional information parameters are obtained. A typological analysis is used to separate control cells into four groups: G0-G1, S, G2+M and polyploid cells Gn. These control cells define a learning population used to analyze untreated and adriamycine treated cells as supplementary individuals in a discriminant factorial analysis. Such an approach allows to accurately evidence the change of the values of some cellular parameters.     

Segmentation of the Clustered Cells with Optimized Boundary Detection in Negative Phase Contrast Images

Cell image segmentation plays a central role in numerous biology studies and clinical applications. As a result, the development of cell image segmentation algorithms with high robustness and accuracy is attracting more and more attention. In this study, an automated cell image segmentation algorithm is developed to get improved cell image segmentation with respect to cell boundary detection and segmentation of the clustered cells for all cells in the field of view in negative phase contrast images. A new method which combines the thresholding method and edge based active contour method was proposed to optimize cell boundary detection. In order to segment clustered cells, the geographic peaks of cell light intensity were utilized to detect numbers and locations of the clustered cells. In this paper, the working principles of the algorithms are described. The influence of parameters in cell boundary detection and the selection of the threshold value on the final segmentation results are investigated. At last, the proposed algorithm is applied to the negative phase contrast images from different experiments. The performance of the proposed method is evaluated. Results show that the proposed method can achieve optimized cell boundary detection and highly accurate segmentation for clustered cells.     

基于邻域最大差值与区域合并的油茶毒蛾幼虫图像分割

【目的】油茶树害虫的种类较多,其中油茶毒蛾Euproctis pseudoconspersa幼虫是危害较大的害虫之一。为完成油茶毒蛾幼虫的自动检测需要对其图像进行分割,油茶毒蛾幼虫图像的分割效果直接影响到图像的自动识别。【方法】本文提出了基于邻域最大差值与区域合并的油茶毒蛾幼虫图像分割算法,该方法主要是对相邻像素RGB的3个分量进行差值运算,最大差值若为0,则进行相邻像素合并得出初始的分割图像,根据合并准则进一步合并,得到最终分割结果。【结果】实验结果表明,该算法可以快速有效地将油茶毒蛾幼虫图像中的背景和虫体分割开来。【结论】使用JSEG分割算法、K均值聚类分割算法、快速几何可变形分割算法和本文算法对油茶毒蛾幼虫图像进行分割,将结果进行对比发现本文方法的分割效果最佳,且处理时间较短。     

Context based mixture model for cell phase identification in automated fluorescence microscopy

Background  

Automated identification of cell cycle phases of individual live cells in a large population captured via automated fluorescence microscopy technique is important for cancer drug discovery and cell cycle studies. Time-lapse fluorescence microscopy images provide an important method to study the cell cycle process under different conditions of perturbation. Existing methods are limited in dealing with such time-lapse data sets while manual analysis is not feasible. This paper presents statistical data analysis and statistical pattern recognition to perform this task.