Three-dimensional spatial reconstruction of coronary arteries based on fusion of intravascular optical coherence tomography and coronary angiography

We present a three-dimensional (3D) spatial reconstruction of coronary arteries based on fusion of intravascular optical coherence tomography (IVOCT) and digital subtraction angiography (DSA). Centerline of vessel in DSA images is exacted by multi-scale filtering, adaptive segmentation, morphology thinning and Dijkstra's shortest path algorithm. We apply the cross-correction between lumen shapes of IVOCT and DSA images and match their stenosis positions to realize co-registration. By matching the location and tangent direction of the vessel centerline of DSA images and segmented lumen coordinates of IVOCT along pullback path, 3D spatial models of vessel lumen are reconstructed. Using 1121 distinct positions selected from eight vessels, the correlation coefficient between 3D IVOCT model and DSA image in measuring lumen radius is 0.94% and 97.7% of the positions fall within the limit of agreement by Bland–Altman analysis, which means that the 3D spatial reconstruction IVOCT models and DSA images have high matching level.     

Intravascular Optical Coherence Tomography Image Segmentation Based on Support Vector Machine Algorithm

Intravascular optical coherence tomography (IVOCT) is becoming more and more popular in clinical diagnosis of coronary atherosclerotic. However, reading IVOCT images is of large amount of work. This article describes a method based on image feature extraction and support vector machine (SVM) to achieve semi-automatic segmentation of IVOCT images. The image features utilized in this work including light attenuation coefficients and image textures based on gray level co-occurrence matrix. Different sets of hyper-parameters and image features were tested. This method achieved an accuracy of 83% on the test images. Single class accuracy of 89% for fibrous, 79.3% for calcification and 86.5% lipid tissue. The results show that this method can be a considerable way for semi-automatic segmentation of atherosclerotic plaque components in clinical IVOCT images.     

The Correlation Between Texture Features and Fibrous Cap Thickness of Lipid-Rich Atheroma Based on Optical Coherence Tomography Imaging

Fibrous cap thickness (FCT) is seen as critical to plaque vulnerability. Therefore, the development of automatic algorithms for the quantification of FCT is for estimating cardiovascular risk of patients. Intravascular optical coherence tomography (IVOCT) is currently the only in vivo imaging modality with which FCT, the critical component of plaque vulnerability, can be assessed accurately. This study was aimed to discussion the correlation between the texture features of OCT images and the FCT in lipid-rich atheroma. Methods: Firstly, a full automatic segmentation algorithm based on unsupervised fuzzy c means (FCM) clustering with geometric constrains was developed to segment the ROIs of IVOCT images. Then, 32 features, which are associated with the structural and biochemical changes of tissue, were carried out to describe the properties of ROIs. The FCT in grayscale IVOCT images were manually measured by two independent observers. In order to analysis the correlation between IVOCT image features and manual FCT measurements, linear regression approach was performed. Results: Inter-observer agreement of the twice manual FCT measurements was excellent with an intraclass correlation coefficient (ICC) of 0.99. The correlation coefficient between each individual feature set and mean FCT of OCT images were 0.68 for FOS, 0.80 for GLCM, 0.74 for NGTDM, 0.72 for FD, 0.62 for IM and 0.58 for SP. The fusion image features of automatic segmented ROIs and FCT measurements improved the results significantly with a high correlation coefficient (r= 0.91, p<0.001). Conclusion The OCT images features demonstrated the perfect performances and could be used for automatic qualitative analysis and the identification of high-risk plaques instead manual FCT measurements.     

Automatic lung segmentation in COVID-19 patients: Impact on quantitative computed tomography analysis

PurposeTo assess the impact of lung segmentation accuracy in an automatic pipeline for quantitative analysis of CT images.MethodsFour different platforms for automatic lung segmentation based on convolutional neural network (CNN), region-growing technique and atlas-based algorithm were considered. The platforms were tested using CT images of 55 COVID-19 patients with severe lung impairment. Four radiologists assessed the segmentations using a 5-point qualitative score (QS). For each CT series, a manually revised reference segmentation (RS) was obtained. Histogram-based quantitative metrics (QM) were calculated from CT histogram using lung segmentationsfrom all platforms and RS. Dice index (DI) and differences of QMs (ΔQMs) were calculated between RS and other segmentations.ResultsHighest QS and lower ΔQMs values were associated to the CNN algorithm. However, only 45% CNN segmentations were judged to need no or only minimal corrections, and in only 17 cases (31%), automatic segmentations provided RS without manual corrections. Median values of the DI for the four algorithms ranged from 0.993 to 0.904. Significant differences for all QMs calculated between automatic segmentations and RS were found both when data were pooled together and stratified according to QS, indicating a relationship between qualitative and quantitative measurements. The most unstable QM was the histogram 90th percentile, with median ΔQMs values ranging from 10HU and 158HU between different algorithms.ConclusionsNone of tested algorithms provided fully reliable segmentation. Segmentation accuracy impacts differently on different quantitative metrics, and each of them should be individually evaluated according to the purpose of subsequent analyses.     

Graph ranking based butterfly segmentation in ecological images

An accurate cultural insect detection and recognition relies mainly on a proper automatic segmentation. This paper deals with butterfly segmentation in ecological images characterized by several artifacts like the complexity of environmental decors and cluttered backgrounds. The distractors contained in the rich ecological environment and the huge difference between butterfly species complicate severely the segmentation and make it a challenging task. As butterflies appears to be well contrasted from their surrounding, we suggest to explore the saliency property to delineate accurately the butterfly boundaries. In this vein, we perform a graph ranking process with high level guidance according to foreground and background cues to improve the quality of segmentation. The ranking accuracy is improved through a weighting scheme that combines accurately color, texture and spatial information. The contribution of each used feature is controlled according to its relevance in highlighting butterfly regions. After that, we initialize foreground seeds from most salient pixels and background seeds from less salient pixels as an input for a Graph-cut algorithm to extract the butterfly from the background. Comparative evaluation has shown that our segmentation scheme outperforms some existing segmentation methods that provide high segmentation scores.     

Donuts, scratches and blanks: robust model-based segmentation of microarray images

MOTIVATION: Inner holes, artifacts and blank spots are common in microarray images, but current image analysis methods do not pay them enough attention. We propose a new robust model-based method for processing microarray images so as to estimate foreground and background intensities. The method starts with a very simple but effective automatic gridding method, and then proceeds in two steps. The first step applies model-based clustering to the distribution of pixel intensities, using the Bayesian Information Criterion (BIC) to choose the number of groups up to a maximum of three. The second step is spatial, finding the large spatially connected components in each cluster of pixels. The method thus combines the strengths of the histogram-based and spatial approaches. It deals effectively with inner holes in spots and with artifacts. It also provides a formal inferential basis for deciding when the spot is blank, namely when the BIC favors one group over two or three. RESULTS: We apply our methods for gridding and segmentation to cDNA microarray images from an HIV infection experiment. In these experiments, our method had better stability across replicates than a fixed-circle segmentation method or the seeded region growing method in the SPOT software, without introducing noticeable bias when estimating the intensities of differentially expressed genes. AVAILABILITY: spotSegmentation, an R language package implementing both the gridding and segmentation methods is available through the Bioconductor project (http://www.bioconductor.org). The segmentation method requires the contributed R package MCLUST for model-based clustering (http://cran.us.r-project.org). CONTACT: fraley@stat.washington.edu.     

Estimation de la distensibilité aortique à partir de séquences d’images de résonance magnétique « steady-state free-precession » et « contraste de phase »

Objective

To investigate the accuracy in the estimation of the aortic lumen area and distensibility obtained from Steady-State Free-Precession (SSFP) and Phase Contrast (PC) MR sequences.

Subjects and methods

Systolic and diastolic aortic lumen of the ascending and descending aorta of 50 subjects, collected with both acquisition sequences, were extracted using a 2D + t automated segmentation method.

Results

While the statistical study indicated very similar lumen areas for SSFP and PC data (slope = 1, r = 0.99), the corresponding distensibility values were less correlated (r = 0.54). Comparison between distensibility values in the ascending and descending aorta and study of these values with aging indicated a greater coherence with expected physiological behavior of the aorta when using SSFP images.

Discussion

Flow artifacts were more severe in PC images and could explain the better results obtained when using SSFP sequences.

Conclusion

A more accurate local assessment of the aortic stiffness is obtained from SSFP image sequences than from PC image sequences.     

Depolarization metric spaces for biological tissues classification

Classification of tissues is an important problem in biomedicine. An efficient tissue classification protocol allows, for instance, the guided‐recognition of structures through treated images or discriminating between healthy and unhealthy regions (e.g., early detection of cancer). In this framework, we study the potential of some polarimetric metrics, the so‐called depolarization spaces, for the classification of biological tissues. The analysis is performed using 120 biological ex vivo samples of three different tissues types. Based on these data collection, we provide for the first time a comparison between these depolarization spaces, as well as with most commonly used depolarization metrics, in terms of biological samples discrimination. The results illustrate the way to determine the set of depolarization metrics which optimizes tissue classification efficiencies. In that sense, the results show the interest of the method which is general, and which can be applied to study multiple types of biological samples, including of course human tissues. The latter can be useful for instance, to improve and to boost applications related to optical biopsy.     

Movement correction method for laser speckle contrast imaging of cerebral blood flow in cranial windows in rodents

Laser speckle contrast imaging (LSCI) is used in clinical research to dynamically image blood flow. One drawback is its susceptibility to movement artifacts. We demonstrate a new, simple method to correct motion artifacts in LSCI signals measured in awake mice with cranial windows during sensory stimulation. The principle is to identify a region in the image in which speckle contrast (SC) is independent of blood flow and only varies with animal movement, then to regress out this signal from the data. We show that (1) the regressed signal correlates well with mouse head movement, (2) the corrected signal correlates better with independently measured blood volume and (3) it has a (59 ± 6)% higher signal-to-noise ratio. Compared to three alternative correction methods, ours has the best performance. Regressing out flow-independent global variations in SC is a simple and accessible way to improve the quality of LSCI measurements.     

Hybrid Nature Inspired SMO-GBM Classifier for Exudate Classification on Fundus Retinal Images

Background: The diabetic retinopathy can result in loss of vision if not detected in the earlier stages. Exudates are the lesions which play a crucial role in early diagnosis of diabetic retinopathy. The localization of exudates lesions with high values of performance metrics is complicated due to presence of blood vessels and other noisy artifacts. Method: We present computer aided system for classification of retinal fundus images using a novel nature inspired spider monkey optimization for parameter tuning of gradient boosting machines classifier. The image enhancement has been performed with histogram equalization and contourlet transform. The pixels belonging to optic disc region are detected and eliminated using circular Hough transform and Otsu's segmentation method. We have employed Kirsch's matrices for blood vessel detection. The GLCM based feature vector extraction has been employed for textural features. The classification has been performed with hybrid SMO-GBM classifier. Result: We have utilized the STARE database for validation of proposed technique. The proposed system can effectively classify entire image set from test data. The SMO-GBM classifier can further sub-segregate into sub classes with an average accuracy of 97.5%. Conclusion: The proposed approach provides detection and grading of diabetic retinopathy. The abnormality is further categories as soft, moderate and severe. The hybrid SMO-GBM classifier yields a better statistical metrics than the existing exudates classification approaches.     

Improving cerebral microvascular image quality of optical coherence tomography angiography with deep learning-based segmentation

Optical coherence tomography angiography (OCTA) can map the microvascular networks of the cerebral cortices with micrometer resolution and millimeter penetration. However, the high scattering of the skull and the strong noise in the deep imaging region will distort the vasculature projections and decrease the OCTA image quality. Here, we proposed a deep learning-based segmentation method based on a U-Net convolutional neural network to extract the cortical region from the OCT image. The vascular networks were then visualized by three OCTA algorithms. The image quality of the vasculature projections was assessed by two metrics, including the peak signal-to-noise ratio (PSNR) and the contrast-to-noise ratio (CNR). The results show the accuracy of the cortical segmentation was 96.07%. The PSNR and CNR values increased significantly in the projections of the selected cortical regions. The OCTA incorporating the deep learning-based cortical segmentation can efficiently improve the image quality and enhance the vasculature clarity.     

TRUS image segmentation with non-parametric kernel density estimation shape prior

Due to noises, speckles, etc., automatic prostate segmentation is rather challenging, and using only low-level information such as intensity gradient is insufficient and unable to tackle the problem. In this paper, we propose an automatic prostate segmentation method combining intrinsic properties of TRUS images with the high-level shape prior information. First, intrinsic properties of TRUS images, such as the intensity transition near the prostate boundary as well as the speckle induced texture features obtained by Gabor filter banks, are integrated to deform the model to the target contour. These properties make our method insensitive to high gradient regions introduced by noises and speckles. Then, the preliminary segmentation is fine-tuned by the non-parametric shape prior, which is optimally distilled by non-parametric kernel density estimation as it can approximate arbitrary distributions. The refinement is along the direction of mean shift vector, and considerably strengthens the robustness of the method. The performance of our method is validated by experimental results. Compared with the state of the art, the accuracy and robustness of the method is quite promising, and the mean absolute distance is only 1.21 ± 0.85 mm.     

Automatic Region-Based Brain Classification of MRI-T1 Data

Image segmentation of medical images is a challenging problem with several still not totally solved issues, such as noise interference and image artifacts. Region-based and histogram-based segmentation methods have been widely used in image segmentation. Problems arise when we use these methods, such as the selection of a suitable threshold value for the histogram-based method and the over-segmentation followed by the time-consuming merge processing in the region-based algorithm. To provide an efficient approach that not only produce better results, but also maintain low computational complexity, a new region dividing based technique is developed for image segmentation, which combines the advantages of both regions-based and histogram-based methods. The proposed method is applied to the challenging applications: Gray matter (GM), White matter (WM) and cerebro-spinal fluid (CSF) segmentation in brain MR Images. The method is evaluated on both simulated and real data, and compared with other segmentation techniques. The obtained results have demonstrated its improved performance and robustness.     

A study on giant panda recognition based on images of a large proportion of captive pandas

1. As a highly endangered species, the giant panda (panda) has attracted significant attention in the past decades. Considerable efforts have been put on panda conservation and reproduction, offering the promising outcome of maintaining the population size of pandas. To evaluate the effectiveness of conservation and management strategies, recognizing individual pandas is critical. However, it remains a challenging task because the existing methods, such as traditional tracking method, discrimination method based on footprint identification, and molecular biology method, are invasive, inaccurate, expensive, or challenging to perform. The advances of imaging technologies have led to the wide applications of digital images and videos in panda conservation and management, which makes it possible for individual panda recognition in a noninvasive manner by using image‐based panda face recognition method.
2. In recent years, deep learning has achieved great success in the field of computer vision and pattern recognition. For panda face recognition, a fully automatic deep learning algorithm which consists of a sequence of deep neural networks (DNNs) used for panda face detection, segmentation, alignment, and identity prediction is developed in this study. To develop and evaluate the algorithm, the largest panda image dataset containing 6,441 images from 218 different pandas, which is 39.78% of captive pandas in the world, is established.
3. The algorithm achieved 96.27% accuracy in panda recognition and 100% accuracy in detection.
4. This study shows that panda faces can be used for panda recognition. It enables the use of the cameras installed in their habitat for monitoring their population and behavior. This noninvasive approach is much more cost‐effective than the approaches used in the previous panda surveys.

     

Deep-learning-based motion correction in optical coherence tomography angiography

Optical coherence tomography angiography (OCTA) is a widely applied tool to image microvascular networks with high spatial resolution and sensitivity. Due to limited imaging speed, the artifacts caused by tissue motion can severely compromise visualization of the microvascular networks and quantification of OCTA images. In this article, we propose a deep-learning-based framework to effectively correct motion artifacts and retrieve microvascular architectures. This method comprised two deep neural networks in which the first subnet was applied to distinguish motion corrupted B-scan images from a volumetric dataset. Based on the classification results, the artifacts could be removed from the en face maximum-intensity-projection (MIP) OCTA image. To restore the disturbed vasculature induced by artifact removal, the second subnet, an inpainting neural network, was utilized to reconnect the broken vascular networks. We applied the method to postprocess OCTA images of the microvascular networks in mouse cortex in vivo. Both image comparison and quantitative analysis show that the proposed method can significantly improve OCTA image by efficiently recovering microvasculature from the overwhelming motion artifacts.     

Topology-based fluorescence image analysis for automated cell identification and segmentation

Cell segmentation refers to the body of techniques used to identify cells in images and extract biologically relevant information from them; however, manual segmentation is laborious and subjective. We present Topological Boundary Line Estimation using Recurrence Of Neighbouring Emissions (TOBLERONE), a topological image analysis tool which identifies persistent homological image features as opposed to the geometric analysis commonly employed. We demonstrate that topological data analysis can provide accurate segmentation of arbitrarily-shaped cells, offering a means for automatic and objective data extraction. One cellular feature of particular interest in biology is the plasma membrane, which has been shown to present varying degrees of lipid packing, or membrane order, depending on the function and morphology of the cell type. With the use of environmentally-sensitive dyes, images derived from confocal microscopy can be used to quantify the degree of membrane order. We demonstrate that TOBLERONE is capable of automating this task.     

Automated image detection and segmentation in blood smears.

A simple technique which automatically detects and then segments nucleated cells in Wright's giemsa-stained blood smears is presented. Our method differs from others in 1) the simplicity of our algorithms; 2) inclusion of touching (as well as nontouching) cells; and 3) use of these algorithms to segment as well as to detect nucleated cells employing conventionally prepared smears. Our method involves: 1) acquisition of spectral images; 2) preprocessing the acquired images; 3) detection of single and touching cells in the scene; 4) segmentation of the cells into nuclear and cytoplasmic regions; and 5) postprocessing of the segmented regions. The first two steps of this algorithm are employed to obtain high-quality images, to remove random noise, and to correct aberration and shading effects. Spectral information of the image is used in step 3 to segment the nucleated cells from the rest of the scene. Using the initial cell masks, nucleated cells which are just touching are detected and separated. Simple features are then extracted and conditions applied such that single nucleated cells are finally selected. In step 4, the intensity variations of the cells are then used to segment the nucleus from the cytoplasm. The success rate in segmenting the nucleated cells is between 81 and 93%. The major errors in segmentation of the nucleus and the cytoplasm in the recognized nucleated cells are 3.5% and 2.2%, respectively.     

CODEX: a normalization and copy number variation detection method for whole exome sequencing

High-throughput sequencing of DNA coding regions has become a common way of assaying genomic variation in the study of human diseases. Copy number variation (CNV) is an important type of genomic variation, but detecting and characterizing CNV from exome sequencing is challenging due to the high level of biases and artifacts. We propose CODEX, a normalization and CNV calling procedure for whole exome sequencing data. The Poisson latent factor model in CODEX includes terms that specifically remove biases due to GC content, exon capture and amplification efficiency, and latent systemic artifacts. CODEX also includes a Poisson likelihood-based recursive segmentation procedure that explicitly models the count-based exome sequencing data. CODEX is compared to existing methods on a population analysis of HapMap samples from the 1000 Genomes Project, and shown to be more accurate on three microarray-based validation data sets. We further evaluate performance on 222 neuroblastoma samples with matched normals and focus on a well-studied rare somatic CNV within the ATRX gene. We show that the cross-sample normalization procedure of CODEX removes more noise than normalizing the tumor against the matched normal and that the segmentation procedure performs well in detecting CNVs with nested structures.     

A hill-climbing approach for automatic gridding of cDNA microarray images

Image and statistical analysis are two important stages of cDNA microarrays. Of these, gridding is necessary to accurately identify the location of each spot while extracting spot intensities from the microarray images and automating this procedure permits high-throughput analysis. Due to the deficiencies of the equipment used to print the arrays, rotations, misalignments, high contamination with noise and artifacts, and the enormous amount of data generated, solving the gridding problem by means of an automatic system is not trivial. Existing techniques to solve the automatic grid segmentation problem cover only limited aspects of this challenging problem and require the user to specify the size of the spots, the number of rows and columns in the grid, and boundary conditions. In this paper, a hill-climbing automatic gridding and spot quantification technique is proposed which takes a microarray image (or a subgrid) as input and makes no assumptions about the size of the spots, rows, and columns in the grid. The proposed method is based on a hill-climbing approach that utilizes different objective functions. The method has been found to effectively detect the grids on microarray images drawn from databases from GEO and the Stanford genomic laboratories.     

Automatic quantification of microvessels using unsupervised image analysis.

An automatic method for quantification of images of microvessels by computing area proportions and number of objects is presented. The objects are segmented from the background using dynamic thresholding of the average component size histogram. To be able to count the objects, fragmented objects are connected, all objects are filled, and touching objects are separated using a watershed segmentation algorithm. The method is fully automatic and robust with respect to illumination and focus settings. A test set consisting of images grabbed with different focus and illumination for each field of view, was used to test the method, and the proposed method showed less variation than the intraoperator variation using manual threshold. Further, the method showed good correlation to manual object counting (r = 0.80) on an other test set.