Walsh Hadamard Transform for Simple Linear Iterative Clustering (SLIC) Superpixel Based Spectral Clustering of Multimodal MRI Brain Tumor Segmentation

The automated brain tumor segmentation methods are challenging due to the diverse nature of tumors. Recently, the graph based spectral clustering method is utilized for brain tumor segmentation to make high-quality segmentation output. In this paper, a new Walsh Hadamard Transform (WHT) texture for superpixel based spectral clustering is proposed for segmentation of a brain tumor from multimodal MRI images. First, the selected kernels of WHT are utilized for creating texture saliency maps and it becomes the input for the Simple Linear Iterative Clustering (SLIC) algorithm, to generate more precise texture based superpixels. Then the texture superpixels become nodes in the graph of spectral clustering for segmenting brain tumors of MRI images. Finally, the original members of superpixels are recovered to represent Complete Tumor (CT), Tumor Core (TC) and Enhancing Tumor (ET) tissues. The observational results are taken out on BRATS 2015 datasets and evaluated using the Dice Score (DS), Hausdorff Distance (HD) and Volumetric Difference (VD) metrics. The proposed method produces competitive results than other existing clustering methods.     

A Review on Convolutional Neural Networks for Brain Tumor Segmentation: Methods,Datasets, Libraries,and Future Directions

ObjectivesAccurate and reliable segmentation of brain tumors from MRI images helps in planning an enhanced treatment and increases the life expectancy of patients. However, the manual segmentation of brain tumors is subjective and more prone to errors. Nonetheless, the recent advances in convolutional neural network (CNN)-based methods have exhibited outstanding potential in robust segmentation of brain tumors. This article comprehensively investigates recent advances in CNN-based methods for automatic segmentation of brain tumors from MRI images. It examines popular deep learning (DL) libraries/tools for an expeditious and effortless implementation of CNN models. Furthermore, a critical assessment of current DL architectures is delineated along with the scope of improvement.MethodsIn this work, more than 50 scientific papers from 2014-2020 are selected using Google Scholar and PubMed. Also, the leading journals related to our work along with proceedings from major conferences such as MICCAI, MIUA and ECCV are retrieved. This research investigated various annual challenges too related to this work including Multimodal Brain Tumor Segmentation Challenge (MICCAI BRATS) and Ischemic Stroke Lesion Segmentation Challenge (ISLES).ResultAfter a systematic literature search pertinent to the theme, we found that principally there exist three variations of CNN architecture for brain tumor segmentation: single-path and multi-path, fully convolutional, and cascaded CNNs. The respective performances of most automated methods based on CNN are appraised on the BraTS dataset, provided as a part of the MICCAI Multimodal Brain Tumor Segmentation challenge held annually since 2012.ConclusionNotwithstanding the remarkable potential of CNN-based methods, reliable and robust segmentation of brain tumors continues to be an intractable challenge. This is due to the intricate anatomy of the brain, variability in its appearance, and imperfection in image acquisition. Moreover, owing to the small size of MRI datasets, CNN-based methods cannot operate with their full capacity, as demonstrated with large scale datasets, such as ImageNet.     

Enhanced radial basis function neural network for tomato plant disease leaf image segmentation

Primary crop losses in agriculture are due to leaf diseases, which farmers cannot identify early. If the diseases are not detected early and correctly, then the farmer will have to undergo huge losses. Therefore, in the field of agriculture, the detection of leaf diseases in tomato crops plays a vital role. Recent advances in computer vision and deep learning techniques have made disease prediction easy in agriculture. Tomato crop front side leaf images are considered for research due to their high exposure to diseases. The image segmentation process assumes a significant role in identifying disease affected areas on tomato leaf images. Therefore, this paper develops an efficient tomato crop leaf disease segmentation model using an enhanced radial basis function neural network (ERBFNN). The proposed ERBFNN is enhanced using the modified sunflower optimization (MSFO) algorithm. Initially, the noise present in the images is removed by a Gaussian filter followed by CLAHE (contrast-limited adaptive histogram equalization) based on contrast enhancement and un-sharp masking. Then, color features are extracted from each leaf image and given to the segmentation stage to segment the disease portion of the input image. The performance of the proposed ERBFNN approach is estimated using different metrics such as accuracy, Jaccard coefficient (JC), Dice's coefficient (DC), precision, recall, F-Measure, sensitivity, specificity, and mean intersection over union (MIoU) and are compared with existing state-of-the-art methods of radial basis function (RBF), fuzzy c-means (FCM), and region growing (RG). The experimental results show that the proposed ERBFNN segmentation model outperformed with an accuracy of 98.92% compared to existing state-of-the-art methods like RBFNN, FCM, and RG, as well as previous research work.     

Rough-Fuzzy Clustering and Unsupervised Feature Selection for Wavelet Based MR Image Segmentation

Image segmentation is an indispensable process in the visualization of human tissues, particularly during clinical analysis of brain magnetic resonance (MR) images. For many human experts, manual segmentation is a difficult and time consuming task, which makes an automated brain MR image segmentation method desirable. In this regard, this paper presents a new segmentation method for brain MR images, integrating judiciously the merits of rough-fuzzy computing and multiresolution image analysis technique. The proposed method assumes that the major brain tissues, namely, gray matter, white matter, and cerebrospinal fluid from the MR images are considered to have different textural properties. The dyadic wavelet analysis is used to extract the scale-space feature vector for each pixel, while the rough-fuzzy clustering is used to address the uncertainty problem of brain MR image segmentation. An unsupervised feature selection method is introduced, based on maximum relevance-maximum significance criterion, to select relevant and significant textural features for segmentation problem, while the mathematical morphology based skull stripping preprocessing step is proposed to remove the non-cerebral tissues like skull. The performance of the proposed method, along with a comparison with related approaches, is demonstrated on a set of synthetic and real brain MR images using standard validity indices.     

Recognition of brain tumors in MRI images using texture analysis

ObjectivesBrain neoplasms or intracranial tumors, which are more common in older adults, can affect individuals of any age including pediatric and children. Exposure to carcinogenic agents including ionizing radiation and family history is one of the main causes of the disease. Early diagnosis is crucial to avoid prolonged. patients' suffering. The aim of the study was to efficiently recognize the brain tumors from the other brain tissues which include grey and white matter as well as cerebrospinal fluid (CSF).Materials and methodsThis study was performed using axial, sagittal and coronal views for fifty brain tumor patients randomly selected from a set of 200 patients, with a “control” set consisting of images showing no sign of disease; and the “test” brain MRI images for patients diagnosed with brain tumor. The study includes both genders with age ranging from 18 years to 83 years old, (56.5 ± 17.2). The brain images were acquired using a standard head coil Philips Intera 1.5 Tesla machine (USA). The thickness of each section in the entire sequence was 8 mm. Acquisition of T2-weighted and T1-weighted were performed. Interactive Data Language software was used to analyze the data.ResultsThe results of this study showed that: the overall accuracy of classification process was 94.8%, and for the tumor; the sensitivity was 97.3%. White matter and grey matter showed a classification accuracy of 95.7% and 89.7% and for CSF the accuracy was 94.3%.ConclusionThe results showed that brain tumor can be classified successfully and delineated using texture analysis with minimum efforts and with high accuracy for brain tumors.     

Towards a quantitative grading of bladder tumors.

The histological inspection of tumor tissue for the purpose of reporting a tumor grade is a problem of significant clinical importance. The grading by a pathologist is only partly reproducible due to vaguely defined, subjective criteria. In this article we describe and evaluate a set of measurable features that quantitate the differences in tumor tissue. Different aspects of the reproducibility of the measurements under varying conditions of image selection, focus, and noise have been investigated. Three hundred thirty-three images were digitized from 111 bladder tissue sections (4 microns thick, Feulgen stained), using the ICAS microscope-camera platform. A segmentation routine was developed to segment the images into nuclei and background without any user interaction. Size, shape, optical density, and texture features were measured on and among the objects found by this segmentation routine using the image analysis package Acuity. The results of the measurements showed that there is a significant quantitative difference between grade 1 and grade 3 tumors. Grade 2 tumors can be described as "in between grade 1 and grade 3" and falling somewhere on an increasing scale between grades 1 and 3. Grade 2 tumors do not seem to represent a statistically distinct population. The procedure described here is shown to be quite reproducible in the presence of noise, reasonably reproducible in the event of a modest amount of defocusing (with grade 3 tumors exhibiting the most sensitivity), and less reproducible in the context of which fields-of-view are chosen for analysis.     

Correction of inhomogeneous magnetic resonance images using multiscale retinex for segmentation accuracy improvement

The purpose of this study was to improve the accuracy of tissue segmentation on brain magnetic resonance (MR) images preprocessed by multiscale retinex (MSR), segmented with a combined boosted decision tree (BDT) and MSR algorithm (hereinafter referred to as the MSRBDT algorithm). Simulated brain MR (SBMR) T1-weighted images of different noise levels and RF inhomogeneities were adopted to evaluate the outcome of the proposed method; the MSRBDT algorithm was used to identify the gray matter (GM), white matter (WM), and cerebral-spinal fluid (CSF) in the brain tissues. The accuracy rates of GM, WM, and CSF segmentation, with spatial features (G, x, y, r, θ), were respectively greater than 0.9805, 0.9817, and 0.9871. In addition, images segmented with the MSRBDT algorithm were better than those obtained with the expectation maximization (EM) algorithm; brain tissue segmentation in MR images was significantly more precise. The proposed MSRBDT algorithm could be beneficial in clinical image segmentation.     

Semantic region of interest and species classification in the deep neural network feature domain

In this paper, we focus on animal object detection and species classification in camera-trap images collected in highly cluttered natural scenes. Using a deep neural network (DNN) model training for animal- background image classification, we analyze the input camera-trap images to generate a multi-level visual representation of the input image. We detect semantic regions of interest for animals from this representation using k-mean clustering and graph cut in the DNN feature domain. These animal regions are then classified into animal species using multi-class deep neural network model. According the experimental results, our method achieves 99.75% accuracy for classifying animals and background and 90.89% accuracy for classifying 26 animal species on the Snapshot Serengeti dataset, outperforming existing image classification methods.     

Glioblastomas and brain metastases differentiation following an MRI texture analysis-based radiomics approach

PurposeTo evaluate the potential of 2D texture features extracted from magnetic resonance (MR) images for differentiating brain metastasis (BM) and glioblastomas (GBM) following a radiomics approach.MethodsThis retrospective study included 50 patients with BM and 50 with GBM who underwent T1-weighted MRI between December 2010 and January 2017. Eighty-eight rotation-invariant texture features were computed for each segmented lesion using six texture analysis methods. These features were also extracted from the four images obtained after applying the discrete wavelet transform (88 features × 4 images). Three feature selection methods and five predictive models were evaluated. A 5-fold cross-validation scheme was used to randomly split the study group into training (80 patients) and testing (20 patients), repeating the process ten times. Classification was evaluated computing the average area under the receiver operating characteristic curve. Sensibility, specificity and accuracy were also computed. The whole process was tested quantizing the images with different gray-level values to evaluate their influence in the final results.ResultsHighest classification accuracy was obtained using the original images quantized with 128 gray-levels and a feature selection method based on the p-value. The best overall performance was achieved using a support vector machine model with a subset of 32 features (AUC = 0.896 ± 0.067, sensitivity of 82% and specificity of 80%). Naïve Bayes and k-nearest neighbors models showed also valuable results (AUC ≈ 0.8) with a lower number of features (<13), thus suggesting that these models may be more generalizable when using external validations.ConclusionThe proposed radiomics MRI approach is able to discriminate between GBM and BM with high accuracy employing a set of 2D texture features, thus helping in the diagnosis of brain lesions in a fast and non-invasive way.     

Directional features for automatic tumor classification of mammogram images

One way for breast cancer diagnosis is provided by taking radiographic (X-ray) images (termed mammograms) for suspect patients, images further used by physicians to identify potential abnormal areas thorough visual inspection. When digital mammograms are available, computer-aided based diagnostic may help the physician in having a more accurate decision. This implies automatic abnormal areas detection using segmentation, followed by tumor classification. This work aims at describing an approach to deal with the classification of digital mammograms. Patches around tumors are manually extracted to segment the abnormal areas from the remaining of the image, considered as background. The mammogram images are filtered using Gabor wavelets and directional features are extracted at different orientation and frequencies. Principal Component Analysis is employed to reduce the dimension of filtered and unfiltered high-dimensional data. Proximal Support Vector Machines are used to final classify the data. Superior mammogram image classification performance is attained when Gabor features are extracted instead of using original mammogram images. The robustness of Gabor features for digital mammogram images distorted by Poisson noise with different intensity levels is also addressed.     

A pipeline to quantify spinal cord atrophy with deep learning: Application to differentiation of MS and NMOSD patients

PurposeQuantitative measurement of various anatomical regions of the brain and spinal cord (SC) in MRI images are used as unique biomarkers to consider progress and effects of demyelinating diseases of the central nervous system. This paper presents a fully-automated image processing pipeline which quantifies the SC volume of MRI images.MethodsIn the proposed pipeline, after conducting some pre-processing tasks, a deep convolutional network is utilized to segment the spinal cord cross-sectional area (SCCSA) of each slice. After full segmentation, certain extra slices interpolate between each two adjacent slices using the shape-based interpolation method. Then, a 3D model of the SC is reconstructed, and, by counting the voxels of it, the SC volume is calculated. The performance of the proposed method for the SCCSA segmentation is evaluated on 140 MRI images. Subsequently, to demonstrate the application of the proposed pipeline, we study the differentiations of SC atrophy between 38 Multiple Sclerosis (MS) and 25 Neuromyelitis Optica Spectrum Disorder (NMOSD) patients.ResultsThe experimental results of the SCCSA segmentation indicate that the proposed method, adapted by Mask R-CNN, presented the most satisfactory result with the average Dice coefficient of 0.96. For this method, statistical metrics including sensitivity, specificity, accuracy, and precision are 97.51%, 99.98%, 99.92%, and 98.04% respectively. Moreover, the t-test result (p-value = 0.00089) verified a significant difference between the SC atrophy of MS and NMOSD patients.ConclusionThe pipeline efficiently quantifies the SC volume of MRI images and can be utilized as an affordable computer-aided tool for diagnostic purposes.     

Pre-cancer risk assessment in habitual smokers from DIC images of oral exfoliative cells using active contour and SVM analysis

Habitual smokers are known to be at higher risk for developing oral cancer, which is increasing at an alarming rate globally. Conventionally, oral cancer is associated with high mortality rates, although recent reports show the improved survival outcomes by early diagnosis of disease. An effective prediction system which will enable to identify the probability of cancer development amongst the habitual smokers, is thus expected to benefit sizable number of populations. Present work describes a non-invasive, integrated method for early detection of cellular abnormalities based on analysis of different cyto-morphological features of exfoliative oral epithelial cells. Differential interference contrast (DIC) microscopy provides a potential optical tool as this mode provides a pseudo three dimensional (3-D) image with detailed morphological and textural features obtained from noninvasive, label free epithelial cells. For segmentation of DIC images, gradient vector flow snake model active contour process has been adopted. To evaluate cellular abnormalities amongst habitual smokers, the selected morphological and textural features of epithelial cells are compared with the non-smoker (?ve control group) group and clinically diagnosed pre-cancer patients (+ve control group) using support vector machine (SVM) classifier. Accuracy of the developed SVM based classification has been found to be 86% with 80% sensitivity and 89% specificity in classifying the features from the volunteers having smoking habit.     

Characterizing robustness and sensitivity of convolutional neural networks for quantitative analysis of mitochondrial morphology

Background: Quantitative analysis of mitochondrial morphology plays important roles in studies of mitochondrial biology. The analysis depends critically on segmentation of mitochondria, the image analysis process of extracting mitochondrial morphology from images. The main goal of this study is to characterize the performance of convolutional neural networks (CNNs) in segmentation of mitochondria from fluorescence microscopy images. Recently, CNNs have achieved remarkable success in challenging image segmentation tasks in several disciplines. So far, however, our knowledge of their performance in segmenting biological images remains limited. In particular, we know little about their robustness, which defines their capability of segmenting biological images of different conditions, and their sensitivity, which defines their capability of detecting subtle morphological changes of biological objects. Methods: We have developed a method that uses realistic synthetic images of different conditions to characterize the robustness and sensitivity of CNNs in segmentation of mitochondria. Using this method, we compared performance of two widely adopted CNNs: the fully convolutional network (FCN) and the U-Net. We further compared the two networks against the adaptive active-mask (AAM) algorithm, a representative of high-performance conventional segmentation algorithms. Results: The FCN and the U-Net consistently outperformed the AAM in accuracy, robustness, and sensitivity, often by a significant margin. The U-Net provided overall the best performance. Conclusions: Our study demonstrates superior performance of the U-Net and the FCN in segmentation of mitochondria. It also provides quantitative measurements of the robustness and sensitivity of these networks that are essential to their applications in quantitative analysis of mitochondrial morphology.     

Robust Volume Assessment of Brain Tissues for 3-Dimensional Fourier Transformation MRI via a Novel Multispectral Technique

A new TRIO algorithm method integrating three different algorithms is proposed to perform brain MRI segmentation in the native coordinate space, with no need of transformation to a standard coordinate space or the probability maps for segmentation. The method is a simple voxel-based algorithm, derived from multispectral remote sensing techniques, and only requires minimal operator input to depict GM, WM, and CSF tissue clusters to complete classification of a 3D high-resolution multislice-multispectral MRI data. Results showed very high accuracy and reproducibility in classification of GM, WM, and CSF in multislice-multispectral synthetic MRI data. The similarity indexes, expressing overlap between classification results and the ground truth, were 0.951, 0.962, and 0.956 for GM, WM, and CSF classifications in the image data with 3% noise level and 0% non-uniformity intensity. The method particularly allows for classification of CSF with 0.994, 0.961 and 0.996 of accuracy, sensitivity and specificity in images data with 3% noise level and 0% non-uniformity intensity, which had seldom performed well in previous studies. As for clinical MRI data, the quantitative data of brain tissue volumes aligned closely with the brain morphometrics in three different study groups of young adults, elderly volunteers, and dementia patients. The results also showed very low rates of the intra- and extra-operator variability in measurements of the absolute volumes and volume fractions of cerebral GM, WM, and CSF in three different study groups. The mean coefficients of variation of GM, WM, and CSF volume measurements were in the range of 0.03% to 0.30% of intra-operator measurements and 0.06% to 0.45% of inter-operator measurements. In conclusion, the TRIO algorithm exhibits a remarkable ability in robust classification of multislice-multispectral brain MR images, which would be potentially applicable for clinical brain volumetric analysis and explicitly promising in cross-sectional and longitudinal studies of different subject groups.     

Convolutional neural network‐based malaria diagnosis from focus stack of blood smear images acquired using custom‐built slide scanner

The present paper introduces a focus stacking‐based approach for automated quantitative detection of Plasmodium falciparum malaria from blood smear. For the detection, a custom designed convolutional neural network (CNN) operating on focus stack of images is used. The cell counting problem is addressed as the segmentation problem and we propose a 2‐level segmentation strategy. Use of CNN operating on focus stack for the detection of malaria is first of its kind, and it not only improved the detection accuracy (both in terms of sensitivity [97.06%] and specificity [98.50%]) but also favored the processing on cell patches and avoided the need for hand‐engineered features. The slide images are acquired with a custom‐built portable slide scanner made from low‐cost, off‐the‐shelf components and is suitable for point‐of‐care diagnostics. The proposed approach of employing sophisticated algorithmic processing together with inexpensive instrumentation can potentially benefit clinicians to enable malaria diagnosis.      

Accuracy and clinical correlates of two different methods for chromogranin A assay in neuroendocrine tumors

Measurement of chromogranin A (CgA) plays a major role in the management of neuroendocrine tumors (NET); however, reliable assaying of CgA is made difficult by the rapid hydrolysis following its release into the bloodstream. This study was aimed at the assessment of two assays for CgA in NET patients. CgA was measured in 93 patients by means of an enzyme-linked immunosorbent assay (ELISA) and an immunoradiometric assay (IRMA). The specificity and sensitivity of CgA were evaluated in relation to tumor histology. The clinical accuracy of the two assays was evaluated by receiver-operating characteristic (ROC) curve analysis. Regression analysis demonstrated different immunoreactivity for CgA of the antibodies used in the two kits (r = 0.61). The two assays had different accuracy also in classifying patients according to their clinical condition (91% vs 64% specificity and 79% vs 79% sensitivity for the ELISA and IRMA assay, respectively) and tumor histology (81% vs 85% sensitivity for the ELISA and IRMA assays, respectively, in carcinoids; 92% vs 67% sensitivity for the ELISA and IRMA assays, respectively, in pancreatic islet cell tumors). The different clinical accuracy of the two assays was confirmed by the ROC analysis (AUC = 0.90 vs AUC = 0.87 for the ELISA and IRMA assays, respectively). In conclusion, because of the poor standardization of the commercially available measurement tools the clinical accuracy of CgA measurement depends on the assay used. This makes it difficult to compare CgA values measured with different kits and affects the clinical accuracy of the different assays for CgA.     

An Image Skeletonization-Based Tool for Pollen Tube Morphology Analysis and Phenotyping

The mechanism underlying pollen tube growth involves diverse genes and molecular pathways. Alterations in the regulatory genes or pathways cause phenotypic changes reflected by cellular morphology, which can be captured using fluorescence microscopy. Determining and classifying pollen tube morphological phenotypes in such microscopic images is key to our understanding the involvement of genes and pathways. In this context, we propose a computational method to extract quantitative morphological features, and demonstrate that these features reflect morphological differences relevant to distinguish different defects of pollen tube growth. The corresponding software tool furthermore includes a novel semi-automated image segmentation approach, allowing to highly accurately identify the boundary of a pollen tube in a microscopic image.     

A robust deep attention dense convolutional neural network for plant leaf disease identification and classification from smart phone captured real world images

Plant diseases cause significant food loss and hence economic loss around the globe. Therefore, automatic plant disease identification is a primary task to take proper medications for controlling the spread of the diseases. Large variety of plants species and their dissimilar phytopathological symptoms call for the implementation of supervised machine learning techniques for efficient and reliable disease identification and classification. With the development of deep learning strategies, convolutional neural network (CNN) has paved its way for classification of multiple plant diseases by extracting rich features. However, several characteristics of the input images especially captured in real world environment, viz. complex or indistinguishable background, presence of multiple leaves with the diseased leaf, small lesion area, solemnly affect the robustness and accuracy of the CNN modules. Available strategies usually applied standard CNN architectures on the images captured in the laboratory environment and very few have considered practical in-field leaf images for their studies. However, those studies are limited with very limited number of plant species. Therefore, there is need of a robust CNN module which can successfully recognize and classify the dissimilar leaf health conditions of non-identical plants from the in-field RGB images. To achieve the above goal, an attention dense learning (ADL) mechanism is proposed in this article by merging mixed sigmoid attention learning with the basic dense learning process of deep CNN. The basic dense learning process derives new features at higher layer considering all lower layer features and that provides fast and efficient training process. Further, the attention learning process amplifies the learning ability of the dense block by discriminating the meaningful lesion portions of the images from the background areas. Other than adding an extra layer for attention learning, in the proposed ADL block the output features from higher layer dense learning are used as an attention mask to the lower layers. For an effective and fast classification process, five ADL blocks are stacked to build a new CNN architecture named DADCNN-5 for obtaining classification robustness and higher testing accuracy. Initially, the proposed DADCNN-5 module is applied on publicly available extended PlantVillage dataset to classify 38 different health conditions of 14 plant species from 54,305 images. Classification accuracy of 99.93% proves that the proposed CNN module can be used for successful leaf disease identification. Further, the efficacy of the DADCNN-5 model is checked after performing stringent experiments on a new real world plant leaf database, created by the authors. The new leaf database contains 10,851 real-world RGB leaf images of 17 plant species for classifying their 44 distinguished health conditions. Experimental outcomes reveal that the proposed DADCNN-5 outperforms the existing machine learning and standard CNN architectures, and achieved 97.33% accuracy. The obtained sensitivity, specificity and false positive rate values are 96.57%, 99.94% and 0.063% respectively. The module takes approximately 3235 min for training process and achieves 99.86% of training accuracy. Visualization of Class activation mapping (CAM) depicts that DADCNN-5 is able to learn distinguishable features from semantically important regions (i.e. lesion regions) on the leaves. Further, the robustness of the DADCNN-5 is established after experimenting with augmented and noise contaminated images of the practical database.     

Content-Based Image Retrieval Using Spatial Layout Information in Brain Tumor T1-Weighted Contrast-Enhanced MR Images

This study aims to develop content-based image retrieval (CBIR) system for the retrieval of T1-weighted contrast-enhanced MR (CE-MR) images of brain tumors. When a tumor region is fed to the CBIR system as a query, the system attempts to retrieve tumors of the same pathological category. The bag-of-visual-words (BoVW) model with partition learning is incorporated into the system to extract informative features for representing the image contents. Furthermore, a distance metric learning algorithm called the Rank Error-based Metric Learning (REML) is proposed to reduce the semantic gap between low-level visual features and high-level semantic concepts. The effectiveness of the proposed method is evaluated on a brain T1-weighted CE-MR dataset with three types of brain tumors (i.e., meningioma, glioma, and pituitary tumor). Using the BoVW model with partition learning, the mean average precision (mAP) of retrieval increases beyond 4.6% with the learned distance metrics compared with the spatial pyramid BoVW method. The distance metric learned by REML significantly outperforms three other existing distance metric learning methods in terms of mAP. The mAP of the CBIR system is as high as 91.8% using the proposed method, and the precision can reach 93.1% when the top 10 images are returned by the system. These preliminary results demonstrate that the proposed method is effective and feasible for the retrieval of brain tumors in T1-weighted CE-MR Images.     

Accurate Image Analysis of the Retina Using Hessian Matrix and Binarisation of Thresholded Entropy with Application of Texture Mapping

In this paper, we demonstrate a comprehensive method for segmenting the retinal vasculature in camera images of the fundus. This is of interest in the area of diagnostics for eye diseases that affect the blood vessels in the eye. In a departure from other state-of-the-art methods, vessels are first pre-grouped together with graph partitioning, using a spectral clustering technique based on morphological features. Local curvature is estimated over the whole image using eigenvalues of Hessian matrix in order to enhance the vessels, which appear as ridges in images of the retina. The result is combined with a binarized image, obtained using a threshold that maximizes entropy, to extract the retinal vessels from the background. Speckle type noise is reduced by applying a connectivity constraint on the extracted curvature based enhanced image. This constraint is varied over the image according to each region''s predominant blood vessel size. The resultant image exhibits the central light reflex of retinal arteries and veins, which prevents the segmentation of whole vessels. To address this, the earlier entropy-based binarization technique is repeated on the original image, but crucially, with a different threshold to incorporate the central reflex vessels. The final segmentation is achieved by combining the segmented vessels with and without central light reflex. We carry out our approach on DRIVE and REVIEW, two publicly available collections of retinal images for research purposes. The obtained results are compared with state-of-the-art methods in the literature using metrics such as sensitivity (true positive rate), selectivity (false positive rate) and accuracy rates for the DRIVE images and measured vessel widths for the REVIEW images. Our approach out-performs the methods in the literature.