Accurate Image Analysis of the Retina Using Hessian Matrix and Binarisation of Thresholded Entropy with Application of Texture Mapping

In this paper, we demonstrate a comprehensive method for segmenting the retinal vasculature in camera images of the fundus. This is of interest in the area of diagnostics for eye diseases that affect the blood vessels in the eye. In a departure from other state-of-the-art methods, vessels are first pre-grouped together with graph partitioning, using a spectral clustering technique based on morphological features. Local curvature is estimated over the whole image using eigenvalues of Hessian matrix in order to enhance the vessels, which appear as ridges in images of the retina. The result is combined with a binarized image, obtained using a threshold that maximizes entropy, to extract the retinal vessels from the background. Speckle type noise is reduced by applying a connectivity constraint on the extracted curvature based enhanced image. This constraint is varied over the image according to each region''s predominant blood vessel size. The resultant image exhibits the central light reflex of retinal arteries and veins, which prevents the segmentation of whole vessels. To address this, the earlier entropy-based binarization technique is repeated on the original image, but crucially, with a different threshold to incorporate the central reflex vessels. The final segmentation is achieved by combining the segmented vessels with and without central light reflex. We carry out our approach on DRIVE and REVIEW, two publicly available collections of retinal images for research purposes. The obtained results are compared with state-of-the-art methods in the literature using metrics such as sensitivity (true positive rate), selectivity (false positive rate) and accuracy rates for the DRIVE images and measured vessel widths for the REVIEW images. Our approach out-performs the methods in the literature.     

A New Approach to Segment Both Main and Peripheral Retinal Vessels Based on Gray-Voting and Gaussian Mixture Model

Vessel segmentation in retinal fundus images is a preliminary step to clinical diagnosis for some systemic diseases and some eye diseases. The performances of existing methods for segmenting small vessels which are usually of more importance than the main vessels in a clinical diagnosis are not satisfactory in clinical use. In this paper, we present a method for both main and peripheral vessel segmentation. A local gray-level change enhancement algorithm called gray-voting is used to enhance the small vessels, while a two-dimensional Gabor wavelet is used to extract the main vessels. We fuse the gray-voting results with the 2D-Gabor filter results as pre-processing outcome. A Gaussian mixture model is then used to extract vessel clusters from the pre-processing outcome, while small vessels fragments are obtained using another gray-voting process, which complements the vessel cluster extraction already performed. At the last step, we eliminate the fragments that do not belong to the vessels based on the shape of the fragments. We evaluated the approach with two publicly available DRIVE (Staal et al., 2004) and STARE (Hoover et at., 2000) datasets with manually segmented results. For the STARE dataset, when using the second manually segmented results which include much more small vessels than the first manually segmented results as the “gold standard,” this approach achieved an average sensitivity, accuracy and specificity of 65.0%, 92.1% and 97.0%, respectively. The sensitivities of this approach were much higher than those of the other existing methods, with comparable specificities; these results thus demonstrated that this approach was sensitive to detection of small vessels.     

An Active Contour Model for the Segmentation of Images with Intensity Inhomogeneities and Bias Field Estimation

Intensity inhomogeneity causes many difficulties in image segmentation and the understanding of magnetic resonance (MR) images. Bias correction is an important method for addressing the intensity inhomogeneity of MR images before quantitative analysis. In this paper, a modified model is developed for segmenting images with intensity inhomogeneity and estimating the bias field simultaneously. In the modified model, a clustering criterion energy function is defined by considering the difference between the measured image and estimated image in local region. By using this difference in local region, the modified method can obtain accurate segmentation results and an accurate estimation of the bias field. The energy function is incorporated into a level set formulation with a level set regularization term, and the energy minimization is conducted by a level set evolution process. The proposed model first appeared as a two-phase model and then extended to a multi-phase one. The experimental results demonstrate the advantages of our model in terms of accuracy and insensitivity to the location of the initial contours. In particular, our method has been applied to various synthetic and real images with desirable results.     

Unsupervised Retinal Vessel Segmentation Using Combined Filters

Image segmentation of retinal blood vessels is a process that can help to predict and diagnose cardiovascular related diseases, such as hypertension and diabetes, which are known to affect the retinal blood vessels’ appearance. This work proposes an unsupervised method for the segmentation of retinal vessels images using a combined matched filter, Frangi’s filter and Gabor Wavelet filter to enhance the images. The combination of these three filters in order to improve the segmentation is the main motivation of this work. We investigate two approaches to perform the filter combination: weighted mean and median ranking. Segmentation methods are tested after the vessel enhancement. Enhanced images with median ranking are segmented using a simple threshold criterion. Two segmentation procedures are applied when considering enhanced retinal images using the weighted mean approach. The first method is based on deformable models and the second uses fuzzy C-means for the image segmentation. The procedure is evaluated using two public image databases, Drive and Stare. The experimental results demonstrate that the proposed methods perform well for vessel segmentation in comparison with state-of-the-art methods.     

Distortion Correction in EPI Using an Extended PSF Method with a Reversed Phase Gradient Approach

In echo-planar imaging (EPI), such as commonly used for functional MRI (fMRI) and diffusion-tensor imaging (DTI), compressed distortion is a more difficult challenge than local stretching as spatial information can be lost in strongly compressed areas. In addition, the effects are more severe at ultra-high field (UHF) such as 7T due to increased field inhomogeneity. To resolve this problem, two EPIs with opposite phase-encoding (PE) polarity were acquired and combined after distortion correction. For distortion correction, a point spread function (PSF) mapping method was chosen due to its high correction accuracy and extended to perform distortion correction of both EPIs with opposite PE polarity thus reducing the PSF reference scan time. Because the amount of spatial information differs between the opposite PE datasets, the method was further extended to incorporate a weighted combination of the two distortion-corrected images to maximize the spatial information content of a final corrected image. The correction accuracy of the proposed method was evaluated in distortion-corrected data using both forward and reverse phase-encoded PSF reference data and compared with the reversed gradient approaches suggested previously. Further we demonstrate that the extended PSF method with an improved weighted combination can recover local distortions and spatial information loss and be applied successfully not only to spin-echo EPI, but also to gradient-echo EPIs acquired with both PE directions to perform geometrically accurate image reconstruction.     

Fast retinal vessel detection and measurement using wavelets and edge location refinement

The relationship between changes in retinal vessel morphology and the onset and progression of diseases such as diabetes, hypertension and retinopathy of prematurity (ROP) has been the subject of several large scale clinical studies. However, the difficulty of quantifying changes in retinal vessels in a sufficiently fast, accurate and repeatable manner has restricted the application of the insights gleaned from these studies to clinical practice. This paper presents a novel algorithm for the efficient detection and measurement of retinal vessels, which is general enough that it can be applied to both low and high resolution fundus photographs and fluorescein angiograms upon the adjustment of only a few intuitive parameters. Firstly, we describe the simple vessel segmentation strategy, formulated in the language of wavelets, that is used for fast vessel detection. When validated using a publicly available database of retinal images, this segmentation achieves a true positive rate of 70.27%, false positive rate of 2.83%, and accuracy score of 0.9371. Vessel edges are then more precisely localised using image profiles computed perpendicularly across a spline fit of each detected vessel centreline, so that both local and global changes in vessel diameter can be readily quantified. Using a second image database, we show that the diameters output by our algorithm display good agreement with the manual measurements made by three independent observers. We conclude that the improved speed and generality offered by our algorithm are achieved without sacrificing accuracy. The algorithm is implemented in MATLAB along with a graphical user interface, and we have made the source code freely available.     

Retinal Vessel Width Measurement at Branchings Using an Improved Electric Field Theory-Based Graph Approach

The retinal vessel width relationship at vessel branch points in fundus images is an important biomarker of retinal and systemic disease. We propose a fully automatic method to measure the vessel widths at branch points in fundus images. The method is a graph-based method, in which a graph construction method based on electric field theory is applied which specifically deals with complex branching patterns. The vessel centerline image is used as the initial segmentation of the graph. Branching points are detected on the vessel centerline image using a set of detection kernels. Crossing points are distinguished from branch points and excluded. The electric field based graph method is applied to construct the graph. This method is inspired by the non-intersecting force lines in an electric field. At last, the method is further improved to give a consistent vessel width measurement for the whole vessel tree. The algorithm was validated on 100 artery branchings and 100 vein branchings selected from 50 fundus images by comparing with vessel width measurements from two human experts.     

Active Contours Driven by Multi-Feature Gaussian Distribution Fitting Energy with Application to Vessel Segmentation

Active contour models are of great importance for image segmentation and can extract smooth and closed boundary contours of the desired objects with promising results. However, they cannot work well in the presence of intensity inhomogeneity. Hence, a novel region-based active contour model is proposed by taking image intensities and ‘vesselness values’ from local phase-based vesselness enhancement into account simultaneously to define a novel multi-feature Gaussian distribution fitting energy in this paper. This energy is then incorporated into a level set formulation with a regularization term for accurate segmentations. Experimental results based on publicly available STructured Analysis of the Retina (STARE) demonstrate our model is more accurate than some existing typical methods and can successfully segment most small vessels with varying width.     

A Morphological Hessian Based Approach for Retinal Blood Vessels Segmentation and Denoising Using Region Based Otsu Thresholding

Diabetic Retinopathy (DR) harm retinal blood vessels in the eye causing visual deficiency. The appearance and structure of blood vessels in retinal images play an essential part in the diagnoses of an eye sicknesses. We proposed a less computational unsupervised automated technique with promising results for detection of retinal vasculature by using morphological hessian based approach and region based Otsu thresholding. Contrast Limited Adaptive Histogram Equalization (CLAHE) and morphological filters have been used for enhancement and to remove low frequency noise or geometrical objects, respectively. The hessian matrix and eigenvalues approach used has been in a modified form at two different scales to extract wide and thin vessel enhanced images separately. Otsu thresholding has been further applied in a novel way to classify vessel and non-vessel pixels from both enhanced images. Finally, postprocessing steps has been used to eliminate the unwanted region/segment, non-vessel pixels, disease abnormalities and noise, to obtain a final segmented image. The proposed technique has been analyzed on the openly accessible DRIVE (Digital Retinal Images for Vessel Extraction) and STARE (STructured Analysis of the REtina) databases along with the ground truth data that has been precisely marked by the experts.     

MCFSA-Net: A multi-scale channel fusion and spatial activation network for retinal vessel segmentation

As the only vascular tissue that can be directly viewed in vivo, retinal vessels are medically important in assisting the diagnosis of ocular and cardiovascular diseases. They generally appear as different morphologies and uneven thickness in fundus images. Therefore, the single-scale segmentation method may fail to capture abundant morphological features, suffering from the deterioration in vessel segmentation, especially for tiny vessels. To alleviate this issue, we propose a multi-scale channel fusion and spatial activation network (MCFSA-Net) for retinal vessel segmentation with emphasis on tiny ones. Specifically, the Hybrid Convolution-DropBlock (HC-Drop) is first used to extract deep features of vessels and construct multi-scale feature maps by progressive down-sampling. Then, the Channel Cooperative Attention Fusion (CCAF) module is designed to handle different morphological vessels in a multi-scale manner. Finally, the Global Spatial Activation (GSA) module is introduced to aggregate global feature information for improving the attention on tiny vessels in the spatial domain and realizing effective segmentation for them. Experiments are carried out on three datasets including DRIVE, CHASE_DB1, and STARE. Our retinal vessel segmentation method achieves Accuracy of 96.95%, 97.57%, and 97.83%, and F1 score of 82.67%, 81.82%, and 82.95% in the above datasets, respectively. Qualitative and quantitative analysis show that the proposed method outperforms current advanced vessel segmentation methods, especially for tiny vessels.     

An efficient algorithm for retinal blood vessel segmentation using h-maxima transform and multilevel thresholding

Retinal blood vessel detection and analysis play vital roles in early diagnosis and prevention of several diseases, such as hypertension, diabetes, arteriosclerosis, cardiovascular disease and stroke. This paper presents an automated algorithm for retinal blood vessel segmentation. The proposed algorithm takes advantage of powerful image processing techniques such as contrast enhancement, filtration and thresholding for more efficient segmentation. To evaluate the performance of the proposed algorithm, experiments were conducted on 40 images collected from DRIVE database. The results show that the proposed algorithm yields an accuracy rate of 96.5%, which is higher than the results achieved by other known algorithms.     

An efficient algorithm for retinal blood vessel segmentation using h-maxima transform and multilevel thresholding

Retinal blood vessel detection and analysis play vital roles in early diagnosis and prevention of several diseases, such as hypertension, diabetes, arteriosclerosis, cardiovascular disease and stroke. This paper presents an automated algorithm for retinal blood vessel segmentation. The proposed algorithm takes advantage of powerful image processing techniques such as contrast enhancement, filtration and thresholding for more efficient segmentation. To evaluate the performance of the proposed algorithm, experiments were conducted on 40 images collected from DRIVE database. The results show that the proposed algorithm yields an accuracy rate of 96.5%, which is higher than the results achieved by other known algorithms.     

Pseudo‐real‐time retinal layer segmentation for high‐resolution adaptive optics optical coherence tomography

We present a pseudo‐real‐time retinal layer segmentation for high‐resolution Sensorless Adaptive Optics‐Optical Coherence Tomography (SAO‐OCT). Our pseudo‐real‐time segmentation method is based on Dijkstra's algorithm that uses the intensity of pixels and the vertical gradient of the image to find the minimum cost in a geometric graph formulation within a limited search region. It segments six retinal layer boundaries in an iterative process according to their order of prominence. The segmentation time is strongly correlated to the number of retinal layers to be segmented. Our program permits en face images to be extracted during data acquisition to guide the depth specific focus control and depth dependent aberration correction for high‐resolution SAO‐OCT systems. The average processing times for our entire pipeline for segmenting six layers in a retinal B‐scan of 496 × 400 and 240 × 400 pixels are around 25.60 and 13.76 ms, respectively. When reducing the number of layers segmented to only two layers, the time required for a 240 × 400 pixel image is 8.26 ms.     

A Generic Approach for Efficient Detection of Vascular Structures

Vascular segmentation is often required in medical image analysis for various imaging modalities. Despite the rich literature in the field, the proposed methods need most of the time adaptation to the particular investigation and may sometimes lack the desired accuracy in terms of true positive and false positive detection rate. This paper proposes a general method for vascular segmentation based on locally connected filtering applied in a multiresolution scheme. The filtering scheme performs progressive detection and removal of the vessels from the image relief at each resolution level, by combining directional 2D-3D locally connected filters (LCF). An important property of the LCF is that it preserves (positive contrasted) structures in the image if they are topologically connected with other similar structures in their local environment. Vessels, which appear as curvilinear structures, can be filtered out by an appropriate LCF set-up which will minimally affect sheet-like structures. The implementation in a multiresolution framework allows dealing with different vessel sizes. The outcome of the proposed approach is illustrated on several image modalities including lung, liver and coronary arteries. It is shown that besides preserving high accuracy in detecting small vessels, the proposed technique is less sensitive with respect to noise and the presence of pathologies of positive-contrast appearance on the images. The detection accuracy is compared with a previously developed approach on the 20 patient database from the VESSEL12 challenge.     

Wavelet weighted blood vessel distortion measure for retinal images

In this paper, a novel wavelet transform based blood vessel distortion measure (WBVDM) is proposed to assess the image quality of blood vessels in the processed retinal images. The wavelet analysis of retinal image shows that different wavelet subbands carry different information about the blood vessels. The WBVDM is defined as the sum of wavelet weighted root of the normalized mean square error of subbands expressed in percentage. The proposed WBVDM is compared with other wavelet based distortion measures such as wavelet mean square error(WMSE), Relative WMSE(Rel WMSE) and root of the normalized WMSE(RNWMSE). The results show that WBVDM performs better in capturing the blood vessel distortion. For distortion in clinically nonsignificant regions, the proposed WBVDM shows a low value of 1.1676 compared to a large mean square error value of 7.9909. The evaluation of correlation using Pearson linear correlation coefficient (PLCC) and Spearman rank order correlation coefficient (SROCC) shows a higher value for the correlation between WBVDM and subjective score. The experimental observations show that WBVDM is able to capture the distortion in blood vessels more effectively and responds weakly to the distortion inherent in the other retinal features.     

The integrated form of the Brody effect

We have considered the simplest model of the Brody effect: a circular inhomogeneity into a conducting medium of infinite extent energized by a source sink pair near the disk. To correlate with the reciprocal field equations, the Brody effect has been calculated in its integrated form by the Gabor-Nelson method (1954). In these conditions, our results do not depend upon any singular position on the closed contour; they are also invariable with respect to grounding the inhomogeneity and/or shifting the inhomogeneity centre from that of the compartment around it. Contrariwise, characterizing the Brody effect by an enhancement factor of local potential values is sensitive to the above factors and so, may become confusing because inducing the belief that the effect due to an inhomogeneity intrinsically depends upon removing the point from which it is viewed.     

Hybrid Nature Inspired SMO-GBM Classifier for Exudate Classification on Fundus Retinal Images

Background: The diabetic retinopathy can result in loss of vision if not detected in the earlier stages. Exudates are the lesions which play a crucial role in early diagnosis of diabetic retinopathy. The localization of exudates lesions with high values of performance metrics is complicated due to presence of blood vessels and other noisy artifacts. Method: We present computer aided system for classification of retinal fundus images using a novel nature inspired spider monkey optimization for parameter tuning of gradient boosting machines classifier. The image enhancement has been performed with histogram equalization and contourlet transform. The pixels belonging to optic disc region are detected and eliminated using circular Hough transform and Otsu's segmentation method. We have employed Kirsch's matrices for blood vessel detection. The GLCM based feature vector extraction has been employed for textural features. The classification has been performed with hybrid SMO-GBM classifier. Result: We have utilized the STARE database for validation of proposed technique. The proposed system can effectively classify entire image set from test data. The SMO-GBM classifier can further sub-segregate into sub classes with an average accuracy of 97.5%. Conclusion: The proposed approach provides detection and grading of diabetic retinopathy. The abnormality is further categories as soft, moderate and severe. The hybrid SMO-GBM classifier yields a better statistical metrics than the existing exudates classification approaches.     

Automatic image segmentation of nuclear stained breast tissue sections using color active contour model and an improved watershed method

Automatic image segmentation of immunohistologically stained breast tissue sections helps pathologists to discover the cancer disease earlier. The detection of the real number of cancer nuclei in the image is a very tedious and time consuming task. Segmentation of cancer nuclei, especially touching nuclei, presents many difficulties to separate them by traditional segmentation algorithms. This paper presents a new automatic scheme to perform both classification of breast stained nuclei and segmentation of touching nuclei in order to get the total number of cancer nuclei in each class. Firstly, a modified geometric active contour model is used for multiple contour detection of positive and negative nuclear staining in the microscopic image. Secondly, a touching nuclei method based on watershed algorithm and concave vertex graph is proposed to perform accurate quantification of the different stains. Finally, benign nuclei are identified by their morphological features and they are removed automatically from the segmented image for positive cancer nuclei assessment. The proposed classification and segmentation schemes are tested on two datasets of breast cancer cell images containing different level of malignancy. The experimental results show the superiority of the proposed methods when compared with other existing classification and segmentation methods. On the complete image database, the segmentation accuracy in term of cancer nuclei number is over than 97%, reaching an improvement of 3–4% over earlier methods.     

An evaluation of semiautomatic approaches to contour segmentation applied to fungal hyphae

Semiautomatic image analysis techniques are particularly useful in biological applications, which commonly generate very complex images, and offer considerable flexibility. However, systematic study of such methods is lacking; most research develops fully automatic algorithms. This paper describes a study to evaluate several different semiautomatic or computer-assisted approaches to contour segmentation within the context of segmenting degraded images of fungal hyphae. Four different types of contour segmentation method, with varying degrees and types of user input, are outlined and applied to hyphal images. The methods are evaluated both quantitatively and qualitatively by comparing results obtained by several test subjects segmenting simulated images qualitatively similar to the hyphal images of interest. An active contour model approach, using control points, emerges as the method to be preferred to three more traditional approaches. Feedback from the image provider indicates that any of the methods described have something useful to offer for segmentation of hyphae.     

Biological Image Segmentation Using Region-Scalable Fitting Energy with B-Spline Level Set Implementation and Watershed

ObjectivesImage segmentation plays an important role in the analysis and understanding of the cellular process. However, this task becomes difficult when there is intensity inhomogeneity between regions, and it is more challenging in the presence of the noise and clustered cells. The goal of the paper is propose an image segmentation framework that tackles the above cited problems.Material and methodsA new method composed of two steps is proposed: First, segment the image using B-spline level set with Region-Scalable Fitting (RSF) active contour model, second apply the Watershed algorithm based on new object markers to refine the segmentation and separate clustered cells. The major contributions of the paper are: 1) Use of a continuous formulation of the level set in the B-spline basis, 2) Develop the energy function and its derivative by introducing the RSF model to deal with intensity inhomogeneity, 3) For the Watershed, propose a relevant choice of markers that considers the cell properties.ResultsExperimental results are performed on widely used synthetic images, in addition to simulated and real biological images, without and with additive noise. They attest the high quality of segmentation of the proposed method in terms of quantitative and qualitative evaluation.ConclusionThe proposed method is able to tackle many difficulties at the same time: overlapped intensities, noise, different cell sizes and clustered cells. It provides an efficient tool for image segmentation especially biological ones.