Object-oriented satellite image time series analysis using a graph-based representation

Nowadays, remote sensing technologies produce huge amounts of satellite images that can be helpful to monitor geographical areas over time. A satellite image time series (SITS) usually contains spatio-temporal phenomena that are complex and difficult to understand. Conceiving new data mining tools for SITS analysis is challenging since we need to simultaneously manage the spatial and the temporal dimensions at the same time. In this work, we propose a new clustering framework specifically designed for SITS data. Our method firstly detects spatio-temporal entities, then it characterizes their evolutions by mean of a graph-based representation, and finally it produces clusters of spatio-temporal entities sharing similar temporal behaviors. Unlike previous approaches, which mainly work at pixel-level, our framework exploits a purely object-based representation to perform the clustering task. Object-based analysis involves a segmentation step where segments (objects) are extracted from an image and constitute the element of analysis. We experimentally validate our method on two real world SITS datasets by comparing it with standard techniques employed in remote sensing analysis. We also use a qualitative analysis to highlight the interpretability of the results obtained.     

Feature-based image segmentation in human vision

Experiments are described which indicate that the integration of high-precision shape information along a bright line is blocked by the presence of certain image features. All the features involved have three properties: (1) they are points where contours are not smooth (i.e. not twice differentiable) within the limits set by the finite space constants of visual processes; (2) they are all points that are emphasized in the responses of certain classes of circularly symmetric bandpass spatial filter; and (3) they are all significant for three-dimensional shape analysis. The results are interpreted as implying an inflexible segmentation of the contour image before detailed shape analysis.     

A hybrid graph-based approach for right ventricle segmentation in cardiac MRI by long axis information transition

Right ventricle segmentation is a challenging task in cardiac image analysis due to its complex anatomy and huge shape variations. In this paper, we proposed a semi-automatic approach by incorporating the right ventricle region and shape information into livewire framework and using one slice segmentation result for the segmentation of adjacent slices. The region term is created using our previously proposed region growing algorithm combined with the SUSAN edge detector while the shape prior is obtained by forming a signed distance function (SDF) from a set of binary masks of the right ventricle and applying PCA on them. Short axis slices are divided into two groups: primary and secondary slices. A primary slice is segmented by the proposed modified livewire and the livewire seeds are transited to a pre-processed version of upper and lower slices (secondary) to find new seed positions in these slices. The shortest path algorithm is applied on each pair of seeds for segmentation. This method is applied on 48 MR patients (from MICCAI’12 Right Ventricle Segmentation Challenge) and yielded an average Dice Metric of 0.937 ± 0.58 and the Hausdorff Distance of 5.16 ± 2.88 mm for endocardium segmentation. The correlation with the ground truth contours were measured as 0.99, 0.98, and 0.93 for EDV, ESV and EF respectively. The qualitative and quantitative results declare that the proposed method outperforms the state-of-the-art methods that uses the same dataset and the cardiac global functional parameters are calculated robustly by the proposed method.     

Calculus of variations and image segmentation.

A survey of free discontinuity problems related to image segmentation is given. The main properties and open problems about Mumford and Shah and Blake and Zisserman functionals are shown together with an extensive bibliography about recent mathematical developments.     

Confocal DNA cytometry: a contour-based segmentation algorithm for automated three-dimensional image segmentation

BACKGROUND: Confocal laser scanning microscopy (CLSM) presents the opportunity to perform three-dimensional (3D) DNA content measurements on intact cells in thick histological sections. So far, these measurements have been performed manually, which is quite time-consuming. METHODS: In this study, an intuitive contour-based segmentation algorithm for automatic 3D CLSM image cytometry of nuclei in thick histological sections is presented. To evaluate the segmentation algorithm, we measured the DNA content and volume of human liver and breast cancer nuclei in 3D CLSM images. RESULTS: A high percentage of nuclei could be segmented fully automatically (e.g., human liver, 92%). Comparison with (time-consuming) interactive measurements on the same CLSM images showed that the results were well correlated (liver, r = 1.00; breast, r = 0.92). CONCLUSIONS: Automatic 3D CLSM image cytometry enables measurement of volume and DNA content of large numbers of nuclei in thick histological sections within an acceptable time. This makes large-scale studies feasible, whereby the advantages of CLSM can be exploited fully. The intuitive modular segmentation algorithm presented in this study detects and separates overlapping objects, also in two-dimensional (2D) space. Therefore, this algorithm may also be suitable for other applications.     

A watershed approach for improving medical image segmentation

In this paper, a novel watershed approach based on seed region growing and image entropy is presented which could improve the medical image segmentation. The proposed algorithm enables the prior information of seed region growing and image entropy in its calculation. The algorithm starts by partitioning the image into several levels of intensity using watershed multi-degree immersion process. The levels of intensity are the input to a computationally efficient seed region segmentation process which produces the initial partitioning of the image regions. These regions are fed to entropy procedure to carry out a suitable merging which produces the final segmentation. The latter process uses a region-based similarity representation of the image regions to decide whether regions can be merged. The region is isolated from the level and the residual pixels are uploaded to the next level and so on, we recall this process as multi-level process and the watershed is called multi-level watershed. The proposed algorithm is applied to challenging applications: grey matter–white matter segmentation in magnetic resonance images (MRIs). The established methods and the proposed approach are experimented by these applications to a variety of simulating immersion, multi-degree, multi-level seed region growing and multi-level seed region growing with entropy. It is shown that the proposed method achieves more accurate results for medical image oversegmentation.     

Library of deep-learning image segmentation and outcomes model-implementations

An open-source library of implementations for deep-learning-based image segmentation and outcomes models based on radiotherapy and radiomics is presented. As oncology treatment planning becomes increasingly driven by automation, such a library of model implementations is crucial to (i) validate existing models on datasets collected at different institutions, (ii) automate segmentation, (iii) create ensembles for improving performance and (iv) incorporate validated models in the clinical workflow. Inclusion of deep-learning-based image segmentation and outcomes models in the same library provides a fully automated and reproduceable pipeline to estimate prognosis. The library was developed with the Computational Environment for Radiological Research (CERR) software platform. Centralizing model implementations in CERR builds upon its rich set of radiotherapy and radiomics tools and caters to the world-wide user base. CERR provides well-validated feature extraction pipelines for radiotherapy dosimetry and radiomics with fine control over the calculation settings, allowing users to select appropriate parameters used in model derivation. Models for automatic image segmentation are distributed via containers, allowing them to be deployed with a variety of scientific computing architectures. The library includes implementations of popular DVH-based models outlined in the Quantitative Analysis of Normal Tissue Effects in the Clinic effort and recently published literature. Radiomics models include features from the Image Biomarker Standardization Initiative and application-specific features found to be relevant across multiple sites and image modalities. The library is distributed as a module within CERR at https://www.github.com/cerr/CERR under the GNU-GPL copyleft with additional restrictions on clinical and commercial use and provision to dual license in future.     

昆虫图像分割方法及其应用

昆虫图像自动鉴定是一种快速鉴定昆虫的方法,图像分割则是其中关键步骤。通过搜集和整理国内外近年来针对昆虫图像的分割方法和研究,发现对昆虫图像分割的研究日趋增多。随着计算机图像技术的发展,昆虫图像分割方法吸收了许多图像分割领域中新兴的方法, 诸如采用水平集、边缘流以及结合形状、纹理、色彩等多种要素的智能分割(如JSEG方法)等。虽然大量的图像分割方法被引入到昆虫图像研究中,但是目前分割技术依然是阻碍昆虫图像广泛应用的关键。本文经过总结和分析,发现目前昆虫图像分割研究的往往在各自的测试集上有良好表现, 但是缺乏统一的评价标准, 因此很多方法在昆虫图像中应用难以推广。针对研究中的存在的这些问题,需建立良好的昆虫图像分割评价体系,本文建议通过建立统一的昆虫图像库以及对昆虫图像分割的评价方法深入研究,并且这些工作是当前昆虫图像分割研究亟待完善任务。     

Automated image segmentation by fractal grey tone functions

A new image segmentation method is presented. It is based on mathematical derivations stemming from both mathematical morphology and fractal geometry. Structures of different nature are most often characterized by a fractal grey tone function, in a certain range of resolutions, with a particular value of the fractal dimension. Our method allows the isolation of such structures. It only requires a series of dilated and eroded grey tone images.     

Mobile image sensors for object detection using color segmentation

The intelligent mobile robot with sensors and image processing embedded system combines the suction and aerodynamic attraction to achieve good balance between strong adhesion force and high mobility. Experimental results showed that the robot can move upward on the wall at the speed of 2.9 m/min and carry 5 kg payload in addition to 2.5 kg self-weight, which record the highest payload capacity among climbing robots of similar size. It also implements object detection ability using effective color transform and segmentation technique for the exact target detection on the wall using a embedded camera system, communication module and several active sensors.     

A thresholding method for automatic cell image segmentation.

An algorithm for automatic segmentation of PAP-stained cell images and its digital implementation is described. First, the image is filtered in order to eliminate the granularily and small objects in the image which may upset the segmentation procedure. In a second step, information on gradient and compactness is extracted from the filtered image and stored in three histograms as functions of the extinction. From these histograms, two extinction thresholds are computed. These thresholds are suitable to separate the nucleus from the cytoplasm, and the cytoplasm from the background in the filtered image. Masks are determined in this way, and finally used to analyse the nucleus and the cytoplasm in the original image.     

CT image segmentation using FEM with optimized boundary condition

The authors propose a CT image segmentation method using structural analysis that is useful for objects with structural dynamic characteristics. Motivation of our research is from the area of genetic activity. In order to reveal the roles of genes, it is necessary to create mutant mice and measure differences among them by scanning their skeletons with an X-ray CT scanner. The CT image needs to be manually segmented into pieces of the bones. It is a very time consuming to manually segment many mutant mouse models in order to reveal the roles of genes. It is desirable to make this segmentation procedure automatic. Although numerous papers in the past have proposed segmentation techniques, no general segmentation method for skeletons of living creatures has been established. Against this background, the authors propose a segmentation method based on the concept of destruction analogy. To realize this concept, structural analysis is performed using the finite element method (FEM), as structurally weak areas can be expected to break under conditions of stress. The contribution of the method is its novelty, as no studies have so far used structural analysis for image segmentation. The method's implementation involves three steps. First, finite elements are created directly from the pixels of a CT image, and then candidates are also selected in areas where segmentation is thought to be appropriate. The second step involves destruction analogy to find a single candidate with high strain chosen as the segmentation target. The boundary conditions for FEM are also set automatically. Then, destruction analogy is implemented by replacing pixels with high strain as background ones, and this process is iterated until object is decomposed into two parts. Here, CT image segmentation is demonstrated using various types of CT imagery.     

Automated image detection and segmentation in blood smears.

A simple technique which automatically detects and then segments nucleated cells in Wright's giemsa-stained blood smears is presented. Our method differs from others in 1) the simplicity of our algorithms; 2) inclusion of touching (as well as nontouching) cells; and 3) use of these algorithms to segment as well as to detect nucleated cells employing conventionally prepared smears. Our method involves: 1) acquisition of spectral images; 2) preprocessing the acquired images; 3) detection of single and touching cells in the scene; 4) segmentation of the cells into nuclear and cytoplasmic regions; and 5) postprocessing of the segmented regions. The first two steps of this algorithm are employed to obtain high-quality images, to remove random noise, and to correct aberration and shading effects. Spectral information of the image is used in step 3 to segment the nucleated cells from the rest of the scene. Using the initial cell masks, nucleated cells which are just touching are detected and separated. Simple features are then extracted and conditions applied such that single nucleated cells are finally selected. In step 4, the intensity variations of the cells are then used to segment the nucleus from the cytoplasm. The success rate in segmenting the nucleated cells is between 81 and 93%. The major errors in segmentation of the nucleus and the cytoplasm in the recognized nucleated cells are 3.5% and 2.2%, respectively.     

Fast and robust image segmentation by small-world neural oscillator networks

Inspired by the temporal correlation theory of brain functions, researchers have presented a number of neural oscillator networks to implement visual scene segmentation problems. Recently, it is shown that many biological neural networks are typical small-world networks. In this paper, we propose and investigate two small-world models derived from the well-known LEGION (locally excitatory and globally inhibitory oscillator network) model. To form a small-world network, we add a proper proportion of unidirectional shortcuts (random long-range connections) to the original LEGION model. With local connections and shortcuts, the neural oscillators can not only communicate with neighbors but also exchange phase information with remote partners. Model 1 introduces excitatory shortcuts to enhance the synchronization within an oscillator group representing the same object. Model 2 goes further to replace the global inhibitor with a sparse set of inhibitory shortcuts. Simulation results indicate that the proposed small-world models could achieve synchronization faster than the original LEGION model and are more likely to bind disconnected image regions belonging together. In addition, we argue that these two models are more biologically plausible.     

Medical image segmentation based on level set and isoperimetric constraint

Level set based methods are being increasingly used in image segmentation. In these methods, various shape constraints can be incorporated into the energy functionals to obtain the desired shapes of the contours represented by their zero level sets of functions. Motivated by the isoperimetric inequality in differential geometry, we propose a segmentation method in which the isoperimetric constrain is integrated into a level set framework to penalize the ratio of its squared perimeter to its enclosed area of an active contour. The new model can ensure the compactness of segmenting objects and complete missing or/and blurred parts of their boundaries simultaneously. The isoperimetric shape constraint is free of explicit expressions of shapes and scale-invariant. As a result, the proposed method can handle various objects with different scales and does not need to estimate parameters of shapes. Our method can segment lesions with blurred or/and partially missing boundaries in ultrasound, Computed Tomography (CT) and Magnetic Resonance (MR) images efficiently. Quantitative evaluation also confirms that the proposed method can provide more accurate segmentation than two well-known level set methods. Therefore, our proposed method shows potential of accurate segmentation of lesions for applying in diagnoses and surgical planning.     

Topology-based fluorescence image analysis for automated cell identification and segmentation

Cell segmentation refers to the body of techniques used to identify cells in images and extract biologically relevant information from them; however, manual segmentation is laborious and subjective. We present Topological Boundary Line Estimation using Recurrence Of Neighbouring Emissions (TOBLERONE), a topological image analysis tool which identifies persistent homological image features as opposed to the geometric analysis commonly employed. We demonstrate that topological data analysis can provide accurate segmentation of arbitrarily-shaped cells, offering a means for automatic and objective data extraction. One cellular feature of particular interest in biology is the plasma membrane, which has been shown to present varying degrees of lipid packing, or membrane order, depending on the function and morphology of the cell type. With the use of environmentally-sensitive dyes, images derived from confocal microscopy can be used to quantify the degree of membrane order. We demonstrate that TOBLERONE is capable of automating this task.     

Adaptive color basis transformation. An aid in image segmentation

Multispectral images of stained cells enable the use of color differences to segment and/or to discriminate between image components, such as cell types and cellular subcomponents. When the spectral characteristics of the image components do not change over the area of a slide or from slide to slide, one can create a constant weighted linear combination of spectral images to generate one-dimensional or two-dimensional images that have the desired contrast between the image components that must be discriminated. However, when the spectral characteristics are not constant, i.e., when they vary from image to image, a constant weighted linear combination cannot be employed; instead, an appropriate solution must be found for each selected image. This is usually a time-consuming, manual procedure that cannot be employed in a fully automated process of discriminating and segmenting stained cells. This paper describes an algorithm that uses principal components decomposition basis vectors to generate a nonstatic weighted linear combination of color images that can be used by an automated system. This algorithm relies on a semiconstant relationship between the areas (sizes) of the image components that are to be discriminated and/or segmented. The technique has been successfully applied as an aid in the segmentation of images of stained cervical smears; the images were acquired with a three-chip CCD camera that generates three broad-band color images.