Content-Based Image Retrieval Using Spatial Layout Information in Brain Tumor T1-Weighted Contrast-Enhanced MR Images

This study aims to develop content-based image retrieval (CBIR) system for the retrieval of T1-weighted contrast-enhanced MR (CE-MR) images of brain tumors. When a tumor region is fed to the CBIR system as a query, the system attempts to retrieve tumors of the same pathological category. The bag-of-visual-words (BoVW) model with partition learning is incorporated into the system to extract informative features for representing the image contents. Furthermore, a distance metric learning algorithm called the Rank Error-based Metric Learning (REML) is proposed to reduce the semantic gap between low-level visual features and high-level semantic concepts. The effectiveness of the proposed method is evaluated on a brain T1-weighted CE-MR dataset with three types of brain tumors (i.e., meningioma, glioma, and pituitary tumor). Using the BoVW model with partition learning, the mean average precision (mAP) of retrieval increases beyond 4.6% with the learned distance metrics compared with the spatial pyramid BoVW method. The distance metric learned by REML significantly outperforms three other existing distance metric learning methods in terms of mAP. The mAP of the CBIR system is as high as 91.8% using the proposed method, and the precision can reach 93.1% when the top 10 images are returned by the system. These preliminary results demonstrate that the proposed method is effective and feasible for the retrieval of brain tumors in T1-weighted CE-MR Images.     

Accuracy and Reliability of Automated Gray Matter Segmentation Pathways on Real and Simulated Structural Magnetic Resonance Images of the Human Brain

Automated gray matter segmentation of magnetic resonance imaging data is essential for morphometric analyses of the brain, particularly when large sample sizes are investigated. However, although detection of small structural brain differences may fundamentally depend on the method used, both accuracy and reliability of different automated segmentation algorithms have rarely been compared. Here, performance of the segmentation algorithms provided by SPM8, VBM8, FSL and FreeSurfer was quantified on simulated and real magnetic resonance imaging data. First, accuracy was assessed by comparing segmentations of twenty simulated and 18 real T1 images with corresponding ground truth images. Second, reliability was determined in ten T1 images from the same subject and in ten T1 images of different subjects scanned twice. Third, the impact of preprocessing steps on segmentation accuracy was investigated. VBM8 showed a very high accuracy and a very high reliability. FSL achieved the highest accuracy but demonstrated poor reliability and FreeSurfer showed the lowest accuracy, but high reliability. An universally valid recommendation on how to implement morphometric analyses is not warranted due to the vast number of scanning and analysis parameters. However, our analysis suggests that researchers can optimize their individual processing procedures with respect to final segmentation quality and exemplifies adequate performance criteria.     

4D Segmentation of Brain MR Images with Constrained Cortical Thickness Variation

Segmentation of brain MR images plays an important role in longitudinal investigation of developmental, aging, disease progression changes in the cerebral cortex. However, most existing brain segmentation methods consider multiple time-point images individually and thus cannot achieve longitudinal consistency. For example, cortical thickness measured from the segmented image will contain unnecessary temporal variations, which will affect the time related change pattern and eventually reduce the statistical power of analysis. In this paper, we propose a 4D segmentation framework for the adult brain MR images with the constraint of cortical thickness variations. Specifically, we utilize local intensity information to address the intensity inhomogeneity, spatial cortical thickness constraint to maintain the cortical thickness being within a reasonable range, and temporal cortical thickness variation constraint in neighboring time-points to suppress the artificial variations. The proposed method has been tested on BLSA dataset and ADNI dataset with promising results. Both qualitative and quantitative experimental results demonstrate the advantage of the proposed method, in comparison to other state-of-the-art 4D segmentation methods.     

Hemodynamic Segmentation of Brain Perfusion Images with Delay and Dispersion Effects Using an Expectation-Maximization Algorithm

Automatic identification of various perfusion compartments from dynamic susceptibility contrast magnetic resonance brain images can assist in clinical diagnosis and treatment of cerebrovascular diseases. The principle of segmentation methods was based on the clustering of bolus transit-time profiles to discern areas of different tissues. However, the cerebrovascular diseases may result in a delayed and dispersed local perfusion and therefore alter the hemodynamic signal profiles. Assessing the accuracy of the segmentation technique under delayed/dispersed circumstance is critical to accurately evaluate the severity of the vascular disease. In this study, we improved the segmentation method of expectation-maximization algorithm by using the results of hierarchical clustering on whitened perfusion data as initial parameters for a mixture of multivariate Gaussians model. In addition, Monte Carlo simulations were conducted to evaluate the performance of proposed method under different levels of delay, dispersion, and noise of signal profiles in tissue segmentation. The proposed method was used to classify brain tissue types using perfusion data from five normal participants, a patient with unilateral stenosis of the internal carotid artery, and a patient with moyamoya disease. Our results showed that the normal, delayed or dispersed hemodynamics can be well differentiated for patients, and therefore the local arterial input function for impaired tissues can be recognized to minimize the error when estimating the cerebral blood flow. Furthermore, the tissue in the risk of infarct and the tissue with or without the complementary blood supply from the communicating arteries can be identified.     

Fully Automatic Localization and Segmentation of 3D Vertebral Bodies from CT/MR Images via a Learning-Based Method

In this paper, we address the problems of fully automatic localization and segmentation of 3D vertebral bodies from CT/MR images. We propose a learning-based, unified random forest regression and classification framework to tackle these two problems. More specifically, in the first stage, the localization of 3D vertebral bodies is solved with random forest regression where we aggregate the votes from a set of randomly sampled image patches to get a probability map of the center of a target vertebral body in a given image. The resultant probability map is then further regularized by Hidden Markov Model (HMM) to eliminate potential ambiguity caused by the neighboring vertebral bodies. The output from the first stage allows us to define a region of interest (ROI) for the segmentation step, where we use random forest classification to estimate the likelihood of a voxel in the ROI being foreground or background. The estimated likelihood is combined with the prior probability, which is learned from a set of training data, to get the posterior probability of the voxel. The segmentation of the target vertebral body is then done by a binary thresholding of the estimated probability. We evaluated the present approach on two openly available datasets: 1) 3D T2-weighted spine MR images from 23 patients and 2) 3D spine CT images from 10 patients. Taking manual segmentation as the ground truth (each MR image contains at least 7 vertebral bodies from T11 to L5 and each CT image contains 5 vertebral bodies from L1 to L5), we evaluated the present approach with leave-one-out experiments. Specifically, for the T2-weighted MR images, we achieved for localization a mean error of 1.6 mm, and for segmentation a mean Dice metric of 88.7% and a mean surface distance of 1.5 mm, respectively. For the CT images we achieved for localization a mean error of 1.9 mm, and for segmentation a mean Dice metric of 91.0% and a mean surface distance of 0.9 mm, respectively.     

Feature-based,Automated Segmentation of Cerebral Infarct Patterns Using T 2- and Diffusion-weighted Imaging

Diffusion-weighted imaging enables the diagnosis of cerebral ischemias very early, thus supporting therapies such as thrombolysis. However, morphology and tissue-characterizing parameters (e.g. relaxation times or water diffusion) may vary strongly in ischemic regions, indicating different underlying pathologic processes. As the determination of the parameters by a supervised segmentation is very time consuming, we evaluated whether different infarct patterns may be segmented by an automated, multidimensional feature-based method using a unified segmentation procedure. Ischemias were classified into 5 characteristic patterns. For each class, a 3D histogram based on T 2 - and diffusion-weighted images as well as calculated apparent diffusion coefficients (ADC) was generated from a representative data set. Healthy and pathologic tissue classes were segmented in the histogram as separate, local density maxima with freely shaped borders. Segmentation control parameters were optimized in a 3-step procedure. The method was evaluated using synthetic images as well as results of a supervised segmentation. For the analysis of cerebral ischemias, the optimal control parameter set led to sensitivities and specificities between 1.0 and 0.9.     

Texture Analysis of T2-Weighted MR Images to Assess Acute Inflammation in Brain MS Lesions

Brain blood barrier breakdown as assessed by contrast-enhanced (CE) T1-weighted MR imaging is currently the standard radiological marker of inflammatory activity in multiple sclerosis (MS) patients. Our objective was to evaluate the performance of an alternative model assessing the inflammatory activity of MS lesions by texture analysis of T2-weighted MR images. Twenty-one patients with definite MS were examined on the same 3.0T MR system by T2-weighted, FLAIR, diffusion-weighted and CE-T1 sequences. Lesions and mirrored contralateral areas within the normal appearing white matter (NAWM) were characterized by texture parameters computed from the gray level co-occurrence and run length matrices, and by the apparent diffusion coefficient (ADC). Statistical differences between MS lesions and NAWM were analyzed. ROC analysis and leave-one-out cross-validation were performed to evaluate the performance of individual parameters, and multi-parametric models using linear discriminant analysis (LDA), partial least squares (PLS) and logistic regression (LR) in the identification of CE lesions. ADC and all but one texture parameter were significantly different within white matter lesions compared to within NAWM (p < 0.0167). Using LDA, an 8-texture parameter model identified CE lesions with a sensitivity Se = 70% and a specificity Sp = 76%. Using LR, a 10-texture parameter model performed better with Se = 86% / Sp = 84%. Using PLS, a 6-texture parameter model achieved the highest accuracy with Se = 88% / Sp = 81%. Texture parameter from T2-weighted images can assess brain inflammatory activity with sufficient accuracy to be considered as a potential alternative to enhancement on CE T1-weighted images.     

Magnetic Resonance Imaging of the Newborn Brain: Automatic Segmentation of Brain Images into 50 Anatomical Regions

We studied methods for the automatic segmentation of neonatal and developing brain images into 50 anatomical regions, utilizing a new set of manually segmented magnetic resonance (MR) images from 5 term-born and 15 preterm infants imaged at term corrected age called ALBERTs. Two methods were compared: individual registrations with label propagation and fusion; and template based registration with propagation of a maximum probability neonatal ALBERT (MPNA). In both cases we evaluated the performance of different neonatal atlases and MPNA, and the approaches were compared with the manual segmentations by means of the Dice overlap coefficient. Dice values, averaged across regions, were 0.81±0.02 using label propagation and fusion for the preterm population, and 0.81±0.02 using the single registration of a MPNA for the term population. Segmentations of 36 further unsegmented target images of developing brains yielded visibly high-quality results. This registration approach allows the rapid construction of automatically labeled age-specific brain atlases for neonates and the developing brain.     

MR 脑图像海马自动分割法在AD 早期诊断中的应用研究

目的:研究磁共振(Magnetic resonance,MR)脑图像中海马的自动分割方法及海马的形态学分析方法,为阿尔茨海默病(Alzheimer’s disease,AD)的早期诊断提供依据。方法:对20例AD患者和60名正常对照者行MRI T1 WI 3D容积扫描,建立海马的三维主动表观模型,并以此模型对每个个体脑部磁共振图像上的海马进行自动识别和三维分割,分别建立正常对照组和AD组的海马统计形状模型,比较AD组与正常对照组间海马形状的差异性。结果:海马三维分割方法与手动分割方法在海马体积测量上无统计学差别(P>0.05);AD患者海马头部发生萎缩(P<0.05)。结论:基于主动表观模型的MR脑图像海马自动识别和三维分割法是准确可靠的;海马头部萎缩可作为AD诊断的依据之一。     

Fast and Accurate Semi-Automated Segmentation Method of Spinal Cord MR Images at 3T Applied to the Construction of a Cervical Spinal Cord Template

Objective

To design a fast and accurate semi-automated segmentation method for spinal cord 3T MR images and to construct a template of the cervical spinal cord.

Materials and Methods

A semi-automated double threshold-based method (DTbM) was proposed enabling both cross-sectional and volumetric measures from 3D T₂-weighted turbo spin echo MR scans of the spinal cord at 3T. Eighty-two healthy subjects, 10 patients with amyotrophic lateral sclerosis, 10 with spinal muscular atrophy and 10 with spinal cord injuries were studied. DTbM was compared with active surface method (ASM), threshold-based method (TbM) and manual outlining (ground truth). Accuracy of segmentations was scored visually by a radiologist in cervical and thoracic cord regions. Accuracy was also quantified at the cervical and thoracic levels as well as at C2 vertebral level. To construct a cervical template from healthy subjects’ images (n=59), a standardization pipeline was designed leading to well-centered straight spinal cord images and accurate probability tissue map.

Results

Visual scoring showed better performance for DTbM than for ASM. Mean Dice similarity coefficient (DSC) was 95.71% for DTbM and 90.78% for ASM at the cervical level and 94.27% for DTbM and 89.93% for ASM at the thoracic level. Finally, at C2 vertebral level, mean DSC was 97.98% for DTbM compared with 98.02% for TbM and 96.76% for ASM. DTbM showed similar accuracy compared with TbM, but with the advantage of limited manual interaction.

Conclusion

A semi-automated segmentation method with limited manual intervention was introduced and validated on 3T images, enabling the construction of a cervical spinal cord template.     

Increasing the Contrast of the Brain MR FLAIR Images Using Fuzzy Membership Functions and Structural Similarity Indices in Order to Segment MS Lesions

Segmentation is an important step for the diagnosis of multiple sclerosis (MS). This paper presents a new approach to the fully automatic segmentation of MS lesions in Fluid Attenuated Inversion Recovery (FLAIR) Magnetic Resonance (MR) images. With the aim of increasing the contrast of the FLAIR MR images with respect to the MS lesions, the proposed method first estimates the fuzzy memberships of brain tissues (i.e., the cerebrospinal fluid (CSF), the normal-appearing brain tissue (NABT), and the lesion). The procedure for determining the fuzzy regions of their member functions is performed by maximizing fuzzy entropy through Genetic Algorithm. Research shows that the intersection points of the obtained membership functions are not accurate enough to segment brain tissues. Then, by extracting the structural similarity (SSIM) indices between the FLAIR MR image and its lesions membership image, a new contrast-enhanced image is created in which MS lesions have high contrast against other tissues. Finally, the new contrast-enhanced image is used to segment MS lesions. To evaluate the result of the proposed method, similarity criteria from all slices from 20 MS patients are calculated and compared with other methods, which include manual segmentation. The volume of segmented lesions is also computed and compared with Gold standard using the Intraclass Correlation Coefficient (ICC) and paired samples t test. Similarity index for the patients with small lesion load, moderate lesion load and large lesion load was 0.7261, 0.7745 and 0.8231, respectively. The average overall similarity index for all patients is 0.7649. The t test result indicates that there is no statistically significant difference between the automatic and manual segmentation. The validated results show that this approach is very promising.     

Semi-Automated Detection of Cerebral Microbleeds on 3.0 T MR Images

Cerebral microbleeds are associated with vascular disease and dementia. They can be detected on MRI and receive increasing attention. Visual rating is the current standard for microbleed detection, but is rater dependent, has limited reproducibility, modest sensitivity, and can be time-consuming. The goal of the current study is to present a tool for semi-automated detection of microbleeds that can assist human raters in the rating procedure. The radial symmetry transform is originally a technique to highlight circular-shaped objects in two-dimensional images. In the current study, the three-dimensional radial symmetry transform was adapted to detect spherical microbleeds in a series of 72 patients from our hospital, for whom a ground truth visual rating was made by four raters. Potential microbleeds were automatically identified on T2*-weighted 3.0 T MRI scans and the results were visually checked to identify microbleeds. Final ratings of the radial symmetry transform were compared to human ratings. After implementing and optimizing the radial symmetry transform, the method achieved a high sensitivity, while maintaining a modest number of false positives. Depending on the settings, sensitivities ranged from 65%–84% compared to the ground truth rating. Rating of the processed images required 1–2 minutes per participant, in which 20–96 false positive locations per participant were censored. Sensitivities of individual raters ranged from 39%–86% compared to the ground truth and required 5–10 minutes per participant per rater. The sensitivities that were achieved by the radial symmetry transform are similar to those of individual experienced human raters, demonstrating its feasibility and usefulness for semi-automated microbleed detection.     

A Multi-Atlas Based Method for Automated Anatomical Rat Brain MRI Segmentation and Extraction of PET Activity

Introduction

Preclinical in vivo imaging requires precise and reproducible delineation of brain structures. Manual segmentation is time consuming and operator dependent. Automated segmentation as usually performed via single atlas registration fails to account for anatomo-physiological variability. We present, evaluate, and make available a multi-atlas approach for automatically segmenting rat brain MRI and extracting PET activies.

Methods

High-resolution 7T 2DT2 MR images of 12 Sprague-Dawley rat brains were manually segmented into 27-VOI label volumes using detailed protocols. Automated methods were developed with 7/12 atlas datasets, i.e. the MRIs and their associated label volumes. MRIs were registered to a common space, where an MRI template and a maximum probability atlas were created. Three automated methods were tested: 1/registering individual MRIs to the template, and using a single atlas (SA), 2/using the maximum probability atlas (MP), and 3/registering the MRIs from the multi-atlas dataset to an individual MRI, propagating the label volumes and fusing them in individual MRI space (propagation & fusion, PF). Evaluation was performed on the five remaining rats which additionally underwent [¹⁸F]FDG PET. Automated and manual segmentations were compared for morphometric performance (assessed by comparing volume bias and Dice overlap index) and functional performance (evaluated by comparing extracted PET measures).

Results

Only the SA method showed volume bias. Dice indices were significantly different between methods (PF>MP>SA). PET regional measures were more accurate with multi-atlas methods than with SA method.

Conclusions

Multi-atlas methods outperform SA for automated anatomical brain segmentation and PET measure’s extraction. They perform comparably to manual segmentation for FDG-PET quantification. Multi-atlas methods are suitable for rapid reproducible VOI analyses.     

Automated Hazard Assessment Techniques Using Satellite Images Following the 2008 Sichuan China Earthquake

Rapid seismic hazard assessment is crucial for accurate damage estimation right after earthquakes. New technologies provide faster damage detection compared to the traditional, manual assessments. One of the new technologies includes using satellite images. Pre- and post-earthquake satellite images can be used to identify damage patterns. One of the recent disastrous earthquakes occurred in Sichuan (M_w = 7.9) on May 12, 2008. Records show that 5 million buildings have collapsed, and more than 21 million buildings were damaged. This article presents an approach for earthquake hazard assessment using a change detection method applied to pre- and post-earthquake satellite imagery of Sichuan. The damage inspection for the identified areas was carried out performing image analysis of the pre- and post-event satellite images. In this study, a novel automated image analysis technique was developed to assess the impact of the earthquake on the flooding of the area's rivers as well as the tectonic movement of mountains. The technique was used to quantify the flooding and movement of mountains in Sichuan right after the earthquake. The proposed methodology utilizes satellite images and may potentially be used as a rapid procedure to quantify damage soon after an earthquake.     

Fully Bayesian Inference for Structural MRI: Application to Segmentation and Statistical Analysis of T2-Hypointensities

Aiming at iron-related T2-hypointensity, which is related to normal aging and neurodegenerative processes, we here present two practicable approaches, based on Bayesian inference, for preprocessing and statistical analysis of a complex set of structural MRI data. In particular, Markov Chain Monte Carlo methods were used to simulate posterior distributions. First, we rendered a segmentation algorithm that uses outlier detection based on model checking techniques within a Bayesian mixture model. Second, we rendered an analytical tool comprising a Bayesian regression model with smoothness priors (in the form of Gaussian Markov random fields) mitigating the necessity to smooth data prior to statistical analysis. For validation, we used simulated data and MRI data of 27 healthy controls (age: ; range, ). We first observed robust segmentation of both simulated T2-hypointensities and gray-matter regions known to be T2-hypointense. Second, simulated data and images of segmented T2-hypointensity were analyzed. We found not only robust identification of simulated effects but also a biologically plausible age-related increase of T2-hypointensity primarily within the dentate nucleus but also within the globus pallidus, substantia nigra, and red nucleus. Our results indicate that fully Bayesian inference can successfully be applied for preprocessing and statistical analysis of structural MRI data.     

Fully Automated Pulmonary Lobar Segmentation: Influence of Different Prototype Software Programs onto Quantitative Evaluation of Chronic Obstructive Lung Disease

Objectives

Surgical or bronchoscopic lung volume reduction (BLVR) techniques can be beneficial for heterogeneous emphysema. Post-processing software tools for lobar emphysema quantification are useful for patient and target lobe selection, treatment planning and post-interventional follow-up. We aimed to evaluate the inter-software variability of emphysema quantification using fully automated lobar segmentation prototypes.

Material and Methods

66 patients with moderate to severe COPD who underwent CT for planning of BLVR were included. Emphysema quantification was performed using 2 modified versions of in-house software (without and with prototype advanced lung vessel segmentation; programs 1 [YACTA v.2.3.0.2] and 2 [YACTA v.2.4.3.1]), as well as 1 commercial program 3 [Pulmo3D VA30A_HF2] and 1 pre-commercial prototype 4 [CT COPD ISP ver7.0]). The following parameters were computed for each segmented anatomical lung lobe and the whole lung: lobar volume (LV), mean lobar density (MLD), 15^th percentile of lobar density (15^th), emphysema volume (EV) and emphysema index (EI). Bland-Altman analysis (limits of agreement, LoA) and linear random effects models were used for comparison between the software.

Results

Segmentation using programs 1, 3 and 4 was unsuccessful in 1 (1%), 7 (10%) and 5 (7%) patients, respectively. Program 2 could analyze all datasets. The 53 patients with successful segmentation by all 4 programs were included for further analysis. For LV, program 1 and 4 showed the largest mean difference of 72 ml and the widest LoA of [-356, 499 ml] (p<0.05). Program 3 and 4 showed the largest mean difference of 4% and the widest LoA of [-7, 14%] for EI (p<0.001).

Conclusions

Only a single software program was able to successfully analyze all scheduled data-sets. Although mean bias of LV and EV were relatively low in lobar quantification, ranges of disagreement were substantial in both of them. For longitudinal emphysema monitoring, not only scanning protocol but also quantification software needs to be kept constant.     

MRS脑肿瘤分型诊断模型研究

基于对核磁波谱(MR Spectroscopy)的特征变量提取,利用模糊聚类算法来构建脑肿瘤分型诊断模型,实验结果表明该模型能准确对神经胶质细胞瘤分级诊断,为进一步实现更复杂的脑肿瘤诊断系统模型提供方法。     

Development and Evaluation of an Algorithm for the Computer-Assisted Segmentation of the Human Hypothalamus on 7-Tesla Magnetic Resonance Images

Post mortem studies have shown volume changes of the hypothalamus in psychiatric patients. With 7T magnetic resonance imaging this effect can now be investigated in vivo in detail. To benefit from the sub-millimeter resolution requires an improved segmentation procedure. The traditional anatomical landmarks of the hypothalamus were refined using 7T T1-weighted magnetic resonance images. A detailed segmentation algorithm (unilateral hypothalamus) was developed for colour-coded, histogram-matched images, and evaluated in a sample of 10 subjects. Test-retest and inter-rater reliabilities were estimated in terms of intraclass-correlation coefficients (ICC) and Dice''s coefficient (DC). The computer-assisted segmentation algorithm ensured test-retest reliabilities of ICC≥.97 (DC≥96.8) and inter-rater reliabilities of ICC≥.94 (DC = 95.2). There were no significant volume differences between the segmentation runs, raters, and hemispheres. The estimated volumes of the hypothalamus lie within the range of previous histological and neuroimaging results. We present a computer-assisted algorithm for the manual segmentation of the human hypothalamus using T1-weighted 7T magnetic resonance imaging. Providing very high test-retest and inter-rater reliabilities, it outperforms former procedures established at 1.5T and 3T magnetic resonance images and thus can serve as a gold standard for future automated procedures.