Medical image registration using fuzzy theory

Mutual information (MI)-based registration, which uses MI as the similarity measure, is a representative method in medical image registration. It has an excellent robustness and accuracy, but with the disadvantages of a large amount of calculation and a long processing time. In this paper, by computing the medical image moments, the centroid is acquired. By applying fuzzy c-means clustering, the coordinates of the medical image are divided into two clusters to fit a straight line, and the rotation angles of the reference and floating images are computed, respectively. Thereby, the initial values for registering the images are determined. When searching the optimal geometric transformation parameters, we put forward the two new concepts of fuzzy distance and fuzzy signal-to-noise ratio (FSNR), and we select FSNR as the similarity measure between the reference and floating images. In the experiments, the Simplex method is chosen as multi-parameter optimisation. The experimental results show that this proposed method has a simple implementation, a low computational cost, a fast registration and good registration accuracy. Moreover, it can effectively avoid trapping into the local optima. It is adapted to both mono-modality and multi-modality image registrations.     

自适应指数加权互信息配准医学图像的测度及相应算法

为配准医学图像,本文提出了一种新的自适应指数加权的互信息(Adaptive Exponential Weighted Mutual Informa- tion,AEWMI)测度,分析表明:通过对互信息(Mutual Information,MI)测度进行指数加权可以提高测度曲线的峰值尖锐性和平滑性;而指数的权值则可以通过评估待配准图像的质量和分辨率大小来自适应确定。仿真实验结果在验证分析结果的同时也表明,基于本文AEWMI测度的配准方案,对图像噪声、分辨率差异等有较高的鲁棒性,且可有效地提高配准的成功率。     

Noninvasive high resolution mechanical strain maps of the spine intervertebral disc using nonrigid registration of magnetic resonance images

High resolution strain measurements are of particular interest in load bearing tissues such as the intervertebral disc (IVD), permitting characterization of biomechanical conditions which could lead to injury and degenerative outcomes. Magnetic resonance (MR) imaging produces excellent image contrast in cartilaginous tissues, allowing for image-based strain determination. Nonrigid registration (NRR) of MR images has previously demonstrated sub-voxel registration accuracy although its accuracy and precision in determining strain has not been evaluated. Accuracy and precision of NRR-derived strain measurements were evaluated using computer generated deformations applied to both computer generated images and MR images. Two different measures of registration similarity--the cost function which drives the registration algorithm--were compared: Mutual Information (MI) and Least Squares (LS). Strain error was evaluated with respect to signal-to-noise ratio (SNR), contrast-to-noise ratio (CNR), and strain heterogeneity. Additionally, the creep strain response from an in vitro loaded porcine IVD is shown and comparisons between similarity measures are presented. MI showed a decrease in strain precision with increasing CNR and decreasing SNR while LS was insensitive to both. Both similarity measures showed a decrease in strain precision with increasing strain heterogeneity. When computer generated heterogeneous strains were applied to MR images of the IVD, LS showed substantially lower strain error in comparison to MI. Results suggest that LS-driven NRR provides a more accurate image-based method for mapping large and heterogeneous strain fields and this method can be applied to studies of the IVD and, potentially, other soft tissues which present sufficient image texture.     

Medical image registration using Edgeworth-based approximation of Mutual Information

We propose a new similarity measure for iconic medical image registration, an Edgeworth-based third order approximation of Mutual Information (MI) and named 3-EMI. Contrary to classical Edgeworth-based MI approximations, such as those proposed for independent component analysis, the 3-EMI measure is able to deal with potentially correlated variables. The performance of 3-EMI is then evaluated and compared with the Gaussian and B-Spline kernel-based estimates of MI, and the validation is leaded in three steps. First, we compare the intrinsic behavior of the measures as a function of the number of samples and the variance of an additive Gaussian noise. Then, they are evaluated in the context of multimodal rigid registration, using the RIRE data. We finally validate the use of our measure in the context of thoracic monomodal non-rigid registration, using the database proposed during the MICCAI EMPIRE10 challenge. The results show the wide range of clinical applications for which our measure can perform, including non-rigid registration which remains a challenging problem. They also demonstrate that 3-EMI outperforms classical estimates of MI for a low number of samples or a strong additive Gaussian noise. More generally, our measure gives competitive registration results, with a much lower numerical complexity compared to classical estimators such as the reference B-Spline kernel estimator, which makes 3-EMI a good candidate for fast and accurate registration tasks.     

Intensity-based similarity measures evaluation for CT to ultrasound 2D registration

Ultrasound is a non-invasive image modality which allows for real time acquisition. Nevertheless, the low quality of the acquired images makes this a difficult-to-interpret modality during surgical procedures. To overcome this, the registration of ultrasound images with preoperative CT or MR images has been routinely used to fuse complementary information. This work presents the evaluation of eight similarity measures used in the registration of ultrasound and CT images of the left atrium and the pulmonary veins. Each intensity-based similarity measure was evaluated computing its accuracy, capture range, distinctiveness of the optimum, risk and non-convergence and number of minima. The results show that the Woods criterion presents a globally better performance than the other similarity measures. This is especially true for the accuracy and distinctiveness of the optimum indicators. Preprocessing US images does not improve the performance of all similarity measures, except for Woods criterion that shows the optimal accuracy.     

Physical Constraint Finite Element Model for Medical Image Registration

Due to being derived from linear assumption, most elastic body based non-rigid image registration algorithms are facing challenges for soft tissues with complex nonlinear behavior and with large deformations. To take into account the geometric nonlinearity of soft tissues, we propose a registration algorithm on the basis of Newtonian differential equation. The material behavior of soft tissues is modeled as St. Venant-Kirchhoff elasticity, and the nonlinearity of the continuum represents the quadratic term of the deformation gradient under the Green- St.Venant strain. In our algorithm, the elastic force is formulated as the derivative of the deformation energy with respect to the nodal displacement vectors of the finite element; the external force is determined by the registration similarity gradient flow which drives the floating image deforming to the equilibrium condition. We compared our approach to three other models: 1) the conventional linear elastic finite element model (FEM); 2) the dynamic elastic FEM; 3) the robust block matching (RBM) method. The registration accuracy was measured using three similarities: MSD (Mean Square Difference), NC (Normalized Correlation) and NMI (Normalized Mutual Information), and was also measured using the mean and max distance between the ground seeds and corresponding ones after registration. We validated our method on 60 image pairs including 30 medical image pairs with artificial deformation and 30 clinical image pairs for both the chest chemotherapy treatment in different periods and brain MRI normalization. Our method achieved a distance error of 0.320±0.138 mm in x direction and 0.326±0.111 mm in y direction, MSD of 41.96±13.74, NC of 0.9958±0.0019, NMI of 1.2962±0.0114 for images with large artificial deformations; and average NC of 0.9622±0.008 and NMI of 1.2764±0.0089 for the real clinical cases. Student’s t-test demonstrated that our model statistically outperformed the other methods in comparison (p-values <0.05).     

Automatic Detection of Calcaneal-Fifth Metatarsal Angle Using Radiograph: A Computer-Aided Diagnosis of Flat Foot for Military New Recruits in Taiwan

Flatfoot (pes planus) is one of the most important physical examination items for military new recruits in Taiwan. Currently, the diagnosis of flatfoot is mainly based on radiographic examination of the calcaneal-fifth metatarsal (CA–MT5) angle, also known as the arch angle. However, manual measurement of the arch angle is time-consuming and often inconsistent between different examiners. In this study, seventy male military new recruits were studied. Lateral radiographic images of their right and left feet were obtained, and mutual information (MI) registration was used to automatically calculate the arch angle. Images of two critical bones, the calcaneus and the fifth metatarsal bone, were isolated from the lateral radiographs to form reference images, and were then compared with template images to calculate the arch angle. The result of this computer-calculated arch angle was compared with manual measurement results from two radiologists, which showed that our automatic arch angle measurement method had a high consistency. In addition, this method had a high accuracy of 97% and 96% as compared with the measurements of radiologists A and B, respectively. The findings indicated that our MI registration measurement method cannot only accurately measure the CA–MT5 angle, but also saves time and reduces human error. This method can increase the consistency of arch angle measurement and has potential clinical application for the diagnosis of flatfoot.     

Evaluation of a Learning-based Deformable Registration Method on Abdominal CT Images

BackgroundReliable image comparisons, based on fast and accurate deformable registration methods, are recognized as key steps in the diagnosis and follow-up of cancer as well as for radiation therapy planning or surgery. In the particular case of abdominal images, the images to compare often differ widely from each other due to organ deformation, patient motion, movements of gastrointestinal tract or breathing. As a consequence, there is a need for registration methods that can cope with both local and global large and highly non-linear deformations.MethodDeformable registration of medical images traditionally relies on the iterative minimization of a cost function involving a large number of parameters. For complex deformations and large datasets, this process is computationally very demanding, leading to processing times that are incompatible with the clinical routine workflow. Moreover, the highly non-convex nature of these optimization problems leads to a high risk of convergence toward local minima. Recently, deep learning approaches using Convolutional Neural Networks (CNN) have led to major breakthroughs by providing computationally fast unsupervised methods for the registration of 2D and 3D images within seconds. Among all the proposed approaches, the VoxelMorph learning-based framework pioneered to learn in an unsupervised way the complex mapping, parameterized using a CNN, between every couple of 2D or 3D pairs of images and the corresponding deformation field by minimizing a standard intensity-based similarity metrics over the whole learning database. Voxelmorph has so far only been evaluated on brain images. The present study proposes to evaluate this method in the context of inter-subject registration of abdominal CT images, which present a greater challenge in terms of registration than brain images, due to greater anatomical variability and significant organ deformations.ResultsThe performances of VoxelMorph were compared with the current top-performing non-learning-based deformable registration method “Symmetric Normalization” (SyN), implemented in ANTs, on two representative databases: LiTS and 3D-IRCADb-01. Three different experiments were carried out on 2D or 3D data, the atlas-based or pairwise registration, using two different similarity metrics, namely (MSE and CC). Accuracy of the registration was measured by the Dice score, which quantifies the volume overlap for the selected anatomical region.All the three experiments exhibit that the two deformable registration methods significantly outperform the affine registration and that VoxelMorph accuracy is comparable or even better than the reference non-learning based registration method ANTs (SyN), with a drastically reduced computation time.ConclusionBy substituting a time consuming optimization problem, VoxelMorph has made an outstanding achievement in learning-based registration algorithm, where a registration function is trained and thus, able to perform deformable registration almost accurately on abdominal images, while reducing the computation time from minutes to seconds and from seconds to milliseconds in comparison to ANTs (SyN) on a CPU.     

Medical image registration: a review

This paper presents a review of automated image registration methodologies that have been used in the medical field. The aim of this paper is to be an introduction to the field, provide knowledge on the work that has been developed and to be a suitable reference for those who are looking for registration methods for a specific application. The registration methodologies under review are classified into intensity or feature based. The main steps of these methodologies, the common geometric transformations, the similarity measures and accuracy assessment techniques are introduced and described.     

RAMTaB: robust alignment of multi-tag bioimages

Background

In recent years, new microscopic imaging techniques have evolved to allow us to visualize several different proteins (or other biomolecules) in a visual field. Analysis of protein co-localization becomes viable because molecules can interact only when they are located close to each other. We present a novel approach to align images in a multi-tag fluorescence image stack. The proposed approach is applicable to multi-tag bioimaging systems which (a) acquire fluorescence images by sequential staining and (b) simultaneously capture a phase contrast image corresponding to each of the fluorescence images. To the best of our knowledge, there is no existing method in the literature, which addresses simultaneous registration of multi-tag bioimages and selection of the reference image in order to maximize the overall overlap between the images.

Methodology/Principal Findings

We employ a block-based method for registration, which yields a confidence measure to indicate the accuracy of our registration results. We derive a shift metric in order to select the Reference Image with Maximal Overlap (RIMO), in turn minimizing the total amount of non-overlapping signal for a given number of tags. Experimental results show that the Robust Alignment of Multi-Tag Bioimages (RAMTaB) framework is robust to variations in contrast and illumination, yields sub-pixel accuracy, and successfully selects the reference image resulting in maximum overlap. The registration results are also shown to significantly improve any follow-up protein co-localization studies.

Conclusions

For the discovery of protein complexes and of functional protein networks within a cell, alignment of the tag images in a multi-tag fluorescence image stack is a key pre-processing step. The proposed framework is shown to produce accurate alignment results on both real and synthetic data. Our future work will use the aligned multi-channel fluorescence image data for normal and diseased tissue specimens to analyze molecular co-expression patterns and functional protein networks.     

基于区域相似性测量的CT／PET图像配准

图像配准在临床诊断中有重要意义,针对这一问题已经提出了许多方法。本文以区域相似性匹配测度,运用改进的分割方法,结合Powell寻优算法实现了CT／PET多模医学图像配准。实验结果表明,该算法易于实现,配准速度快、精度高,鲁棒性较好。     

A Practical Approach Based on Analytic Deformable Algorithm for Scenic Image Registration

Background

Image registration is to produce an entire scene by aligning all the acquired image sequences. A registration algorithm is necessary to tolerance as much as possible for intensity and geometric variation among images. However, captured image views of real scene usually produce unexpected distortions. They are generally derived from the optic characteristics of image sensors or caused by the specific scenes and objects.

Methods and Findings

An analytic registration algorithm considering the deformation is proposed for scenic image applications in this study. After extracting important features by the wavelet-based edge correlation method, an analytic registration approach is then proposed to achieve deformable and accurate matching of point sets. Finally, the registration accuracy is further refined to obtain subpixel precision by a feature-based Levenberg-Marquardt (FLM) method. It converges evidently faster than most other methods because of its feature-based characteristic.

Conclusions

We validate the performance of proposed method by testing with synthetic and real image sequences acquired by a hand-held digital still camera (DSC) and in comparison with an optical flow-based motion technique in terms of the squared sum of intensity differences (SSD) and correlation coefficient (CC). The results indicate that the proposed method is satisfactory in the registration accuracy and quality of DSC images.     

Registration accuracy and quality of real-life images

Background

A common registration problem for the application of consumer device is to align all the acquired image sequences into a complete scene. Image alignment requires a registration algorithm that will compensate as much as possible for geometric variability among images. However, images captured views from a real scene usually produce different distortions. Some are derived from the optic characteristics of image sensors, and others are caused by the specific scenes and objects.

Methodology/Principal Findings

An image registration algorithm considering the perspective projection is proposed for the application of consumer devices in this study. It exploits a multiresolution wavelet-based method to extract significant features. An analytic differential approach is then proposed to achieve fast convergence of point matching. Finally, the registration accuracy is further refined to obtain subpixel precision by a feature-based modified Levenberg-Marquardt method. Due to its feature-based and nonlinear characteristic, it converges considerably faster than most other methods. In addition, vignette compensation and color difference adjustment are also performed to further improve the quality of registration results.

Conclusions/Significance

The performance of the proposed method is evaluated by testing the synthetic and real images acquired by a hand-held digital still camera and in comparison with two registration techniques in terms of the squared sum of intensity differences (SSD) and correlation coefficient (CC). The results indicate that the proposed method is promising in registration accuracy and quality, which are statistically significantly better than other two approaches.     

Registration methods in radiotherapy

PurposeThe aim of this study is to present a short and comprehensive review of the methods of medical image registration, their conditions and applications in radiotherapy. A particular focus was placed on the methods of deformable image registration.MethodsTo structure and deepen the knowledge on medical image registration in radiotherapy, a medical literature analysis was made using the Google Scholar browser and the medical database of the PubMed library.ResultsChronological review of image registration methods in radiotherapy based on 34 selected articles. A particular attention was given to show: (i) potential regions of the application of different methods of registration, (ii) mathematical basis of the deformable methods and (iii) the methods of quality control for the registration process.ConclusionsThe primary aim of the medical image registration process is to connect the contents of images. What we want to achieve is a complementary or extended knowledge that can be used for more precise localisation of pathogenic lesions and continuous improvement of patient treatment. Therefore, the choice of imaging mode is dependent on the type of clinical study. It is impossible to visualise all anatomical details or functional changes using a single modality machine. Therefore, fusion of various modality images is of great clinical relevance. A natural problem in analysing the fusion of medical images is geographical errors related to displacement. The registered images are performed not at the same time and, very often, at different respiratory phases.     

Spatial Registration of Data on in situ Gene Expression

For registering data on the in situexpression of segmentation genes, a method of image registration was developed basing on the spline approximation. The reference points for the registration were the coordinates of extrema in one-dimensional patterns of gene expression. This registration method is characterized by a very high accuracy. A method of creating a generalized pattern of gene expression in single cells is proposed. Such patterns were constructed for nine segmentation genes belonging to the gap and pair-rule classes of genes.     

A watershed approach for improving medical image segmentation

In this paper, a novel watershed approach based on seed region growing and image entropy is presented which could improve the medical image segmentation. The proposed algorithm enables the prior information of seed region growing and image entropy in its calculation. The algorithm starts by partitioning the image into several levels of intensity using watershed multi-degree immersion process. The levels of intensity are the input to a computationally efficient seed region segmentation process which produces the initial partitioning of the image regions. These regions are fed to entropy procedure to carry out a suitable merging which produces the final segmentation. The latter process uses a region-based similarity representation of the image regions to decide whether regions can be merged. The region is isolated from the level and the residual pixels are uploaded to the next level and so on, we recall this process as multi-level process and the watershed is called multi-level watershed. The proposed algorithm is applied to challenging applications: grey matter–white matter segmentation in magnetic resonance images (MRIs). The established methods and the proposed approach are experimented by these applications to a variety of simulating immersion, multi-degree, multi-level seed region growing and multi-level seed region growing with entropy. It is shown that the proposed method achieves more accurate results for medical image oversegmentation.     

基于图像配准分析物种进化关系的新方法

图像配准是图像处理的一个重要技术,可用于分析两幅图像之间的相似度。本文提出了一种基于图像配准分析物种进化关系的新方法:首先利用一阶马尔可夫链方法计算不同基因组序列的寡聚核苷酸转移概率矩阵;然后将转移概率矩阵转换为彩色图像矩阵,并绘制物种两两之间彩色图像矩阵的联合直方图;最后分析联合直方图点集的分布情况,引入直方图点集的散度公式,将其作为相似性测度的标准,从而鉴定物种亲缘关系的远近。100种细菌全基因组的计算结果表明,相较于单基因法或基于基因组寡聚核苷酸频率组分差异信息的方法,本文提出的新方法具有更高的准确度和分辨力,它不仅能够很好地分辨科以下的分类单元,而且对科以上的分类单元同样具有较好的区分效果。该方法有望发展成为物种鉴定及系统发育推断的有效手段。     

Application of Dual Modality Contrast Agent Combined with Multi-Scale Representation in Ultrasound-Magnetic Resonance Imaging Registration Scheme

To achieve the image registration/fusion and perfect the quality of the integration, with dual modality contrast agent (DMCA), a novel multi-scale representation registration method between ultrasound imaging (US) and magnetic resonance imaging (MRI) is presented in the paper, and how DMCA influence on registration accuracy is chiefly discussed. Owing to US’s intense speckle noise, it is a tremendous challenge to register US with any other modality images. How to improve the algorithms for US processing has become the bottleneck, and in the short term it is difficult to have a breakthrough. In that case, DMCA is employed in both US and MRI to enhance the region of interest. Then, because multi-scale representation is a strategy that attempts to diminish or eliminate several possible local minima and lead to convex optimization problems to be solved quickly and more efficiently, a multi-scale representation Gaussian pyramid based affine registration (MRGP-AR) scheme is constructed to complete the US-MRI registration process. In view of the above-mentioned method, the comparison tests indicate that US-MRI registration/fusion may be a remarkable method for gaining high-quality registration image. The experiments also show that it is feasible that novel nano-materials combined with excellent algorithm are used to solve some hard tasks in medical image processing field.     

A new registration method for three-dimensional knee nearthrosis model using two X-ray images

The purpose of this study is to develop a method to analyse the pose of the knee nearthrosis mounted and to automate the registration procedure for easy use in clinical applications. The proposed registration method is essentially a model-based method, in which the CAD model is acquired by reverse engineering. The CAD model is converted into a two-dimensional (2D) image by a rendering technique, and the compatibility of the X-ray image and the image of the CAD model is investigated. To avoid the optimisation of six unknown parameters with respect to the relative pose between the condyle and tibial models, a 2D coordinate system is set on each component of the X-ray images. A 3D coordinate system is also set on each of the two nearthrosis components. With such a setup, there is only one unknown rotational angle on each component, which is determined by an optimum algorithm in accordance with the contour error between the X-ray image and the image of the CAD model. Extensive computer simulation and in vitro experiments using real X-ray images have been implemented to investigate the feasibility of the proposed registration method.