FogBank: a single cell segmentation across multiple cell lines and image modalities

Background

Many cell lines currently used in medical research, such as cancer cells or stem cells, grow in confluent sheets or colonies. The biology of individual cells provide valuable information, thus the separation of touching cells in these microscopy images is critical for counting, identification and measurement of individual cells. Over-segmentation of single cells continues to be a major problem for methods based on morphological watershed due to the high level of noise in microscopy cell images. There is a need for a new segmentation method that is robust over a wide variety of biological images and can accurately separate individual cells even in challenging datasets such as confluent sheets or colonies.

Results

We present a new automated segmentation method called FogBank that accurately separates cells when confluent and touching each other. This technique is successfully applied to phase contrast, bright field, fluorescence microscopy and binary images. The method is based on morphological watershed principles with two new features to improve accuracy and minimize over-segmentation.First, FogBank uses histogram binning to quantize pixel intensities which minimizes the image noise that causes over-segmentation. Second, FogBank uses a geodesic distance mask derived from raw images to detect the shapes of individual cells, in contrast to the more linear cell edges that other watershed-like algorithms produce.We evaluated the segmentation accuracy against manually segmented datasets using two metrics. FogBank achieved segmentation accuracy on the order of 0.75 (1 being a perfect match). We compared our method with other available segmentation techniques in term of achieved performance over the reference data sets. FogBank outperformed all related algorithms. The accuracy has also been visually verified on data sets with 14 cell lines across 3 imaging modalities leading to 876 segmentation evaluation images.

Conclusions

FogBank produces single cell segmentation from confluent cell sheets with high accuracy. It can be applied to microscopy images of multiple cell lines and a variety of imaging modalities. The code for the segmentation method is available as open-source and includes a Graphical User Interface for user friendly execution.

Electronic supplementary material

The online version of this article (doi:10.1186/s12859-014-0431-x) contains supplementary material, which is available to authorized users.     

When Phase Contrast Fails: ChainTracer and NucTracer,Two ImageJ Methods for Semi-Automated Single Cell Analysis Using Membrane or DNA Staining

Within bacterial populations, genetically identical cells often behave differently. Single-cell measurement methods are required to observe this heterogeneity. Flow cytometry and fluorescence light microscopy are the primary methods to do this. However, flow cytometry requires reasonably strong fluorescence signals and is impractical when bacteria grow in cell chains. Therefore fluorescence light microscopy is often used to measure population heterogeneity in bacteria. Automatic microscopy image analysis programs typically use phase contrast images to identify cells. However, many bacteria divide by forming a cross-wall that is not detectable by phase contrast. We have developed ‘ChainTracer’, a method based on the ImageJ plugin ObjectJ. It can automatically identify individual cells stained by fluorescent membrane dyes, and measure fluorescence intensity, chain length, cell length, and cell diameter. As a complementary analysis method we developed ''NucTracer'', which uses DAPI stained nucleoids as a proxy for single cells. The latter method is especially useful when dealing with crowded images. The methods were tested with Bacillus subtilis and Lactococcus lactis cells expressing a GFP-reporter. In conclusion, ChainTracer and NucTracer are useful single cell measurement methods when bacterial cells are difficult to distinguish with phase contrast.     

Segmentation and detection of fluorescent 3D spots

The 3D spatial organization of genes and other genetic elements within the nucleus is important for regulating gene expression. Understanding how this spatial organization is established and maintained throughout the life of a cell is key to elucidating the many layers of gene regulation. Quantitative methods for studying nuclear organization will lead to insights into the molecular mechanisms that maintain gene organization as well as serve as diagnostic tools for pathologies caused by loss of nuclear structure. However, biologists currently lack automated and high throughput methods for quantitative and qualitative global analysis of 3D gene organization. In this study, we use confocal microscopy and fluorescence in-situ hybridization (FISH) as a cytogenetic technique to detect and localize the presence of specific DNA sequences in 3D. FISH uses probes that bind to specific targeted locations on the chromosomes, appearing as fluorescent spots in 3D images obtained using fluorescence microscopy. In this article, we propose an automated algorithm for segmentation and detection of 3D FISH spots. The algorithm is divided into two stages: spot segmentation and spot detection. Spot segmentation consists of 3D anisotropic smoothing to reduce the effect of noise, top-hat filtering, and intensity thresholding, followed by 3D region-growing. Spot detection uses a Bayesian classifier with spot features such as volume, average intensity, texture, and contrast to detect and classify the segmented spots as either true or false spots. Quantitative assessment of the proposed algorithm demonstrates improved segmentation and detection accuracy compared to other techniques.     

Cell cycle dependent TN-C promoter activity determined by live cell imaging

The extracellular matrix protein tenascin-C plays a critical role in development, wound healing, and cancer progression, but how it is controlled and how it exerts its physiological responses remain unclear. By quantifying the behavior of live cells with phase contrast and fluorescence microscopy, the dynamic regulation of TN-C promoter activity is examined. We employ an NIH 3T3 cell line stably transfected with the TN-C promoter ligated to the gene sequence for destabilized green fluorescent protein (GFP). Fully automated image analysis routines, validated by comparison with data derived from manual segmentation and tracking of single cells, are used to quantify changes in the cellular GFP in hundreds of individual cells throughout their cell cycle during live cell imaging experiments lasting 62 h. We find that individual cells vary substantially in their expression patterns over the cell cycle, but that on average TN-C promoter activity increases during the last 40% of the cell cycle. We also find that the increase in promoter activity is proportional to the activity earlier in the cell cycle. This work illustrates the application of live cell microscopy and automated image analysis of a promoter-driven GFP reporter cell line to identify subtle gene regulatory mechanisms that are difficult to uncover using population averaged measurements.     

Bright Field Microscopy as an Alternative to Whole Cell Fluorescence in Automated Analysis of Macrophage Images

Background

Fluorescence microscopy is the standard tool for detection and analysis of cellular phenomena. This technique, however, has a number of drawbacks such as the limited number of available fluorescent channels in microscopes, overlapping excitation and emission spectra of the stains, and phototoxicity.

Methodology

We here present and validate a method to automatically detect cell population outlines directly from bright field images. By imaging samples with several focus levels forming a bright field -stack, and by measuring the intensity variations of this stack over the -dimension, we construct a new two dimensional projection image of increased contrast. With additional information for locations of each cell, such as stained nuclei, this bright field projection image can be used instead of whole cell fluorescence to locate borders of individual cells, separating touching cells, and enabling single cell analysis. Using the popular CellProfiler freeware cell image analysis software mainly targeted for fluorescence microscopy, we validate our method by automatically segmenting low contrast and rather complex shaped murine macrophage cells.

Significance

The proposed approach frees up a fluorescence channel, which can be used for subcellular studies. It also facilitates cell shape measurement in experiments where whole cell fluorescent staining is either not available, or is dependent on a particular experimental condition. We show that whole cell area detection results using our projected bright field images match closely to the standard approach where cell areas are localized using fluorescence, and conclude that the high contrast bright field projection image can directly replace one fluorescent channel in whole cell quantification. Matlab code for calculating the projections can be downloaded from the supplementary site: http://sites.google.com/site/brightfieldorstaining     

Automated method for the rapid and precise estimation of adherent cell culture characteristics from phase contrast microscopy images

The quantitative determination of key adherent cell culture characteristics such as confluency, morphology, and cell density is necessary for the evaluation of experimental outcomes and to provide a suitable basis for the establishment of robust cell culture protocols. Automated processing of images acquired using phase contrast microscopy (PCM), an imaging modality widely used for the visual inspection of adherent cell cultures, could enable the non‐invasive determination of these characteristics. We present an image‐processing approach that accurately detects cellular objects in PCM images through a combination of local contrast thresholding and post hoc correction of halo artifacts. The method was thoroughly validated using a variety of cell lines, microscope models and imaging conditions, demonstrating consistently high segmentation performance in all cases and very short processing times (<1 s per 1,208 × 960 pixels image). Based on the high segmentation performance, it was possible to precisely determine culture confluency, cell density, and the morphology of cellular objects, demonstrating the wide applicability of our algorithm for typical microscopy image processing pipelines. Furthermore, PCM image segmentation was used to facilitate the interpretation and analysis of fluorescence microscopy data, enabling the determination of temporal and spatial expression patterns of a fluorescent reporter. We created a software toolbox (PHANTAST) that bundles all the algorithms and provides an easy to use graphical user interface. Source‐code for MATLAB and ImageJ is freely available under a permissive open‐source license. Biotechnol. Bioeng. 2014;111: 504–517. © 2013 Wiley Periodicals, Inc.     

SuperSegger: robust image segmentation,analysis and lineage tracking of bacterial cells

Many quantitative cell biology questions require fast yet reliable automated image segmentation to identify and link cells from frame‐to‐frame, and characterize the cell morphology and fluorescence. We present SuperSegger, an automated MATLAB‐based image processing package well‐suited to quantitative analysis of high‐throughput live‐cell fluorescence microscopy of bacterial cells. SuperSegger incorporates machine‐learning algorithms to optimize cellular boundaries and automated error resolution to reliably link cells from frame‐to‐frame. Unlike existing packages, it can reliably segment microcolonies with many cells, facilitating the analysis of cell‐cycle dynamics in bacteria as well as cell‐contact mediated phenomena. This package has a range of built‐in capabilities for characterizing bacterial cells, including the identification of cell division events, mother, daughter and neighbouring cells, and computing statistics on cellular fluorescence, the location and intensity of fluorescent foci. SuperSegger provides a variety of postprocessing data visualization tools for single cell and population level analysis, such as histograms, kymographs, frame mosaics, movies and consensus images. Finally, we demonstrate the power of the package by analyzing lag phase growth with single cell resolution.     

TLM-Quant: An Open-Source Pipeline for Visualization and Quantification of Gene Expression Heterogeneity in Growing Microbial Cells

Gene expression heterogeneity is a key driver for microbial adaptation to fluctuating environmental conditions, cell differentiation and the evolution of species. This phenomenon has therefore enormous implications, not only for life in general, but also for biotechnological applications where unwanted subpopulations of non-producing cells can emerge in large-scale fermentations. Only time-lapse fluorescence microscopy allows real-time measurements of gene expression heterogeneity. A major limitation in the analysis of time-lapse microscopy data is the lack of fast, cost-effective, open, simple and adaptable protocols. Here we describe TLM-Quant, a semi-automatic pipeline for the analysis of time-lapse fluorescence microscopy data that enables the user to visualize and quantify gene expression heterogeneity. Importantly, our pipeline builds on the open-source packages ImageJ and R. To validate TLM-Quant, we selected three possible scenarios, namely homogeneous expression, highly ‘noisy’ heterogeneous expression, and bistable heterogeneous expression in the Gram-positive bacterium Bacillus subtilis. This bacterium is both a paradigm for systems-level studies on gene expression and a highly appreciated biotechnological ‘cell factory’. We conclude that the temporal resolution of such analyses with TLM-Quant is only limited by the numbers of recorded images.     

Joint level-set and spatio-temporal motion detection for cell segmentation

Background

Cell segmentation is a critical step for quantification and monitoring of cell cycle progression, cell migration, and growth control to investigate cellular immune response, embryonic development, tumorigenesis, and drug effects on live cells in time-lapse microscopy images.

Methods

In this study, we propose a joint spatio-temporal diffusion and region-based level-set optimization approach for moving cell segmentation. Moving regions are initially detected in each set of three consecutive sequence images by numerically solving a system of coupled spatio-temporal partial differential equations. In order to standardize intensities of each frame, we apply a histogram transformation approach to match the pixel intensities of each processed frame with an intensity distribution model learned from all frames of the sequence during the training stage. After the spatio-temporal diffusion stage is completed, we compute the edge map by nonparametric density estimation using Parzen kernels. This process is followed by watershed-based segmentation and moving cell detection. We use this result as an initial level-set function to evolve the cell boundaries, refine the delineation, and optimize the final segmentation result.

Results

We applied this method to several datasets of fluorescence microscopy images with varying levels of difficulty with respect to cell density, resolution, contrast, and signal-to-noise ratio. We compared the results with those produced by Chan and Vese segmentation, a temporally linked level-set technique, and nonlinear diffusion-based segmentation. We validated all segmentation techniques against reference masks provided by the international Cell Tracking Challenge consortium. The proposed approach delineated cells with an average Dice similarity coefficient of 89 % over a variety of simulated and real fluorescent image sequences. It yielded average improvements of 11 % in segmentation accuracy compared to both strictly spatial and temporally linked Chan-Vese techniques, and 4 % compared to the nonlinear spatio-temporal diffusion method.

Conclusions

Despite the wide variation in cell shape, density, mitotic events, and image quality among the datasets, our proposed method produced promising segmentation results. These results indicate the efficiency and robustness of this method especially for mitotic events and low SNR imaging, enabling the application of subsequent quantification tasks.

     

Accurate measurements of protein interactions in cells via improved spatial image cross-correlation spectroscopy

The sensitive detection of protein interactions in living cells is an important first step toward understanding each of the multitude of cellular processes that are regulated by such interactions. Spatial image cross-correlation spectroscopy (ICCS) is one method used to measure protein-protein interactions from the analysis of two-channel fluorescence microscopy images. In spatial ICCS, cross-correlation of fluctuations in fluorescence intensity recorded as images from two independent wavelength detection channels in a fluorescence microscope is used to determine the average number of interacting particles in the imaged region. Even in situations where the particle number density is relatively high, ICCS provides an accurate measure of molecular interactions. However, it was shown previously that the method suffers from relatively high detection limits of interacting particles (approximately 20%) and can be perturbed by heterogeneous spatial distributions of the fluorescent particles within the images. Here, we demonstrate new approaches to circumvent some of the limitations of ICCS. Spatial scrambling of pixel blocks within fluorescence images was investigated as a way of extending the detection of spatial ICCS to measure lower interaction fractions as well as colocalization within cells. We also show that 'mean-intensity-padding' of regions of interest within fluorescence images is a feasible method of applying ICCS to arbitrarily selected areas of the cell with boundaries or edge morphologies that would be impossible to analyze with conventional ICCS. Using these newly developed strategies we were able to measure the fraction of actin that interacts with alpha-actinin in the leading edge of a migrating cell.     

A novel multiphoton microscopy images segmentation method based on superpixel and watershed

Multiphoton microscopy (MPM) imaging technique based on two‐photon excited fluorescence (TPEF) and second harmonic generation (SHG) shows fantastic performance for biological imaging. The automatic segmentation of cellular architectural properties for biomedical diagnosis based on MPM images is still a challenging issue. A novel multiphoton microscopy images segmentation method based on superpixels and watershed (MSW) is presented here to provide good segmentation results for MPM images. The proposed method uses SLIC superpixels instead of pixels to analyze MPM images for the first time. The superpixels segmentation based on a new distance metric combined with spatial, CIE Lab color space and phase congruency features, divides the images into patches which keep the details of the cell boundaries. Then the superpixels are used to reconstruct new images by defining an average value of superpixels as image pixels intensity level. Finally, the marker‐controlled watershed is utilized to segment the cell boundaries from the reconstructed images. Experimental results show that cellular boundaries can be extracted from MPM images by MSW with higher accuracy and robustness.

     

Automated live cell imaging of green fluorescent protein degradation in individual fibroblasts.

To accurately interpret the data from fluorescent proteins as reporters of gene activation within living cells, it is important to understand the kinetics of the degradation of the reporter proteins. We examined the degradation kinetics over a large number (>1,000) of single, living cells from a clonal population of NIH3T3 fibroblasts that were stably transfected with a destabilized, enhanced green fluorescent protein (eGFP) reporter driven by the tenascin-C promoter. Data collection and quantification of the fluorescence protein within a statistically significant number of individual cells over long times (14 h) by automated microscopy was facilitated by culturing cells on micropatterned arrays that confined their migration and allowed them to be segmented using phase contrast images. To measure GFP degradation rates unambiguously, protein synthesis was inhibited with cycloheximide. Results from automated live cell microscopy and image analysis indicated a wide range of cell-to-cell variability in the GFP fluorescence within individual cells. Degradation for this reporter was analyzed as a first order rate process with a degradation half-life of 2.8 h. We found that GFP degradation rates were independent of the initial intensity of GFP fluorescence within cells. This result indicates that higher GFP abundance in some cells is likely due to higher rates of gene expression, because it is not due to systematically lower rates of protein degradation. The approach described in this study will assist the quantification and understanding of gene activity within live cells using fluorescent protein reporters.     

Stochastic assembly of chemoreceptor clusters in Escherichia coli

Chemoreceptors and cytoplasmic chemotaxis proteins in Escherichia coli form clusters that play a key role in signal processing. These clusters localize at cell poles and at specific positions along the cell body which correspond to future division sites, but the details of cluster formation and the mechanism of cluster distribution remain unclear. Here, we used fluorescence microscopy to investigate how the numbers and sizes of receptor clusters depend on the expression level of chemotaxis proteins and on the cell length. We show that the average cluster number saturates at high levels of protein expression at approximately 3.7 clusters per cell, well below the number of available positioning sites. Correspondingly, distances between clusters in filamentous cells saturate at an average of 1 mum but, even at saturating expression levels, individual cluster numbers and distances show a broad distribution around the mean. Our data imply a stochastic mode of cluster assembly, where a defined average interval between clusters along the cell body arises from competition between nucleation of new clusters and growth of existing clusters. Upon subsequent anchorage to defined lateral sites, clusters grow with rates that inversely depend on their size, and become polar upon several rounds of cell division.     

Quantitative Analysis of Protein Expression to Study Lineage Specification in Mouse Preimplantation Embryos

This protocol presents a method to perform quantitative, single-cell in situ analyses of protein expression to study lineage specificationin mouse preimplantation embryos. The procedures necessary for embryo collection, immunofluorescence, imaging on a confocal microscope, and image segmentation and analysis are described. This method allows quantitation of the expression of multiple nuclear markers and the spatial (XYZ) coordinates of all cells in the embryo. It takes advantage of MINS, an image segmentation software tool specifically developed for the analysis of confocal images of preimplantation embryos and embryonic stem cell (ESC) colonies. MINS carries out unsupervised nuclear segmentation across the X, Y and Z dimensions, and produces information on cell position in three-dimensional space, as well as nuclear fluorescence levels for all channels with minimal user input. While this protocol has been optimized for the analysis of images of preimplantation stage mouse embryos, it can easily be adapted to the analysis of any other samples exhibiting a good signal-to-noise ratio and where high nuclear density poses a hurdle to image segmentation (e.g., expression analysis of embryonic stem cell (ESC) colonies, differentiating cells in culture, embryos of other species or stages, etc.).     

A Cell Derived Active Contour (CDAC) Method for Robust Tracking in Low Frame Rate,Low Contrast Phase Microscopy - an Example: The Human hNT Astrocyte

The problem of automated segmenting and tracking of the outlines of cells in microscope images is the subject of active research. While great progress has been made on recognizing cells that are of high contrast and of predictable shape, many situations arise in practice where these properties do not exist and thus many interesting potential studies - such as the migration patterns of astrocytes to scratch wounds - have been relegated to being largely qualitative in nature. Here we analyse a select number of recent developments in this area, and offer an algorithm based on parametric active contours and formulated by taking into account cell movement dynamics. This Cell-Derived Active Contour (CDAC) method is compared with two state-of-the-art segmentation methods for phase-contrast microscopy. Specifically, we tackle a very difficult segmentation problem: human astrocytes that are very large, thin, and irregularly-shaped. We demonstrate quantitatively better results for CDAC as compared to similar segmentation methods, and we also demonstrate the reliable segmentation of qualitatively different data sets that were not possible using existing methods. We believe this new method will enable new and improved automatic cell migration and movement studies to be made.     

Segmentation of the Clustered Cells with Optimized Boundary Detection in Negative Phase Contrast Images

Cell image segmentation plays a central role in numerous biology studies and clinical applications. As a result, the development of cell image segmentation algorithms with high robustness and accuracy is attracting more and more attention. In this study, an automated cell image segmentation algorithm is developed to get improved cell image segmentation with respect to cell boundary detection and segmentation of the clustered cells for all cells in the field of view in negative phase contrast images. A new method which combines the thresholding method and edge based active contour method was proposed to optimize cell boundary detection. In order to segment clustered cells, the geographic peaks of cell light intensity were utilized to detect numbers and locations of the clustered cells. In this paper, the working principles of the algorithms are described. The influence of parameters in cell boundary detection and the selection of the threshold value on the final segmentation results are investigated. At last, the proposed algorithm is applied to the negative phase contrast images from different experiments. The performance of the proposed method is evaluated. Results show that the proposed method can achieve optimized cell boundary detection and highly accurate segmentation for clustered cells.     

New Tools for Comparing Microscopy Images: Quantitative Analysis of Cell Types in Bacillus subtilis

Fluorescence microscopy is a method commonly used to examine individual differences between bacterial cells, yet many studies still lack a quantitative analysis of fluorescence microscopy data. Here we introduce some simple tools that microbiologists can use to analyze and compare their microscopy images. We show how image data can be converted to distribution data. These data can be subjected to a cluster analysis that makes it possible to objectively compare microscopy images. The distribution data can further be analyzed using distribution fitting. We illustrate our methods by scrutinizing two independently acquired data sets, each containing microscopy images of a doubly labeled Bacillus subtilis strain. For the first data set, we examined the expression of srfA and tapA, two genes which are expressed in surfactin-producing and matrix-producing cells, respectively. For the second data set, we examined the expression of eps and tapA; these genes are expressed in matrix-producing cells. We show that srfA is expressed by all cells in the population, a finding which contrasts with a previously reported bimodal distribution of srfA expression. In addition, we show that eps and tapA do not always have the same expression profiles, despite being expressed in the same cell type: both operons are expressed in cell chains, while single cells mainly express eps. These findings exemplify that the quantification and comparison of microscopy data can yield insights that otherwise would go unnoticed.