A Fast Image Alignment Approach for 2D Classification of Cryo-EM Images Using Spectral Clustering

Three-dimensional (3D) reconstruction in single-particle cryo-electron microscopy (cryo-EM) is a significant technique for recovering the 3D structure of proteins or other biological macromolecules from their two-dimensional (2D) noisy projection images taken from unknown random directions. Class averaging in single-particle cryo-EM is an important procedure for producing high-quality initial 3D structures, where image alignment is a fundamental step. In this paper, an efficient image alignment algorithm using 2D interpolation in the frequency domain of images is proposed to improve the estimation accuracy of alignment parameters of rotation angles and translational shifts between the two projection images, which can obtain subpixel and subangle accuracy. The proposed algorithm firstly uses the Fourier transform of two projection images to calculate a discrete cross-correlation matrix and then performs the 2D interpolation around the maximum value in the cross-correlation matrix. The alignment parameters are directly determined according to the position of the maximum value in the cross-correlation matrix after interpolation. Furthermore, the proposed image alignment algorithm and a spectral clustering algorithm are used to compute class averages for single-particle 3D reconstruction. The proposed image alignment algorithm is firstly tested on a Lena image and two cryo-EM datasets. Results show that the proposed image alignment algorithm can estimate the alignment parameters accurately and efficiently. The proposed method is also used to reconstruct preliminary 3D structures from a simulated cryo-EM dataset and a real cryo-EM dataset and to compare them with RELION. Experimental results show that the proposed method can obtain more high-quality class averages than RELION and can obtain higher reconstruction resolution than RELION even without iteration.     

An Efficient Correction Algorithm for Eliminating Image Misalignment Effects on Co-Phasing Measurement Accuracy for Segmented Active Optics Systems

The misalignment between recorded in-focus and out-of-focus images using the Phase Diversity (PD) algorithm leads to a dramatic decline in wavefront detection accuracy and image recovery quality for segmented active optics systems. This paper demonstrates the theoretical relationship between the image misalignment and tip-tilt terms in Zernike polynomials of the wavefront phase for the first time, and an efficient two-step alignment correction algorithm is proposed to eliminate these misalignment effects. This algorithm processes a spatial 2-D cross-correlation of the misaligned images, revising the offset to 1 or 2 pixels and narrowing the search range for alignment. Then, it eliminates the need for subpixel fine alignment to achieve adaptive correction by adding additional tip-tilt terms to the Optical Transfer Function (OTF) of the out-of-focus channel. The experimental results demonstrate the feasibility and validity of the proposed correction algorithm to improve the measurement accuracy during the co-phasing of segmented mirrors. With this alignment correction, the reconstructed wavefront is more accurate, and the recovered image is of higher quality.     

利用归一化互相关算法去除吸收强度涨落调制血管造影图像模糊

吸收强度涨落调制成像（AIFM）方法是基于血红细胞和背景组织对低相干光照明的吸收差异,通过在频域分离动态的血红细胞信号和静态的背景信号,实现对近透明活体生物样本全场无标记的光学血管造影成像. 但此成像方法需采集较长的原始图像序列,系统漂移或生物抖动会造成图像模糊,难以实现对某些特定区域的血管造影成像. 本文提出一种结合AIFM成像和归一化互相关算法的新方法来提升血管造影图像的质量：原始的图像序列被分成若干短时序列,每个短时序列先利用AIFM成像算法重构得到全场的血管造影图像;再利用归一化的互相关算法将所有的短时重构图像与第一帧重构图像相匹配,并融合得到最终的血管造影片. 我们以活体鸡蛋胚胎为样品,通过实验验证了利用短时归一化互相关AIFM成像方法,能够消除鸡胚胎心跳引起的图像模糊,从而获得高分辨率和信噪比的心血管造影片,对研究活体动物心脑血管疾病具有重要应用价值.     

Flow Measurements in a Blood-Perfused Collagen Vessel Using X-Ray Micro-Particle Image Velocimetry

Blood-perfused tissue models are joining the emerging field of tumor engineering because they provide new avenues for modulation of the tumor microenvironment and preclinical evaluation of the therapeutic potential of new treatments. The characterization of fluid flow parameters in such in-vitro perfused tissue models is a critical step towards better understanding and manipulating the tumor microenvironment. However, traditional optical flow measurement methods are inapplicable because of the opacity of blood and the thickness of the tissue sample. In order to overcome the limitations of optical method we demonstrate the feasibility of using phase-contrast x-ray imaging to perform microscale particle image velocimetry (PIV) measurements of flow in blood perfused hydrated tissue-representative microvessels. However, phase contrast x-ray images significantly depart from the traditional PIV image paradigm, as they have high intensity background, very low signal-to-noise ratio, and volume integration effects. Hence, in order to achieve accurate measurements special attention must be paid to the image processing and PIV cross-correlation methodologies. Therefore we develop and demonstrate a methodology that incorporates image preprocessing as well as advanced PIV cross-correlation methods to result in measured velocities within experimental uncertainty.     

A fast and robust method for automated analysis of axonal transport

Cargo movement along axons and dendrites is indispensable for the survival and maintenance of neuronal networks. Key parameters of this transport such as particle velocities and pausing times are often studied using kymograph construction, which converts the transport along a line of interest from a time-lapse movie into a position versus time image. Here we present a method for the automatic analysis of such kymographs based on the Hough transform, which is a robust and fast technique to extract lines from images. The applicability of the method was tested on simulated kymograph images and real data from axonal transport of synaptophysin and tetanus toxin as well as the velocity analysis of synaptic vesicle sharing between adjacent synapses in hippocampal neurons. Efficiency analysis revealed that the algorithm is able to detect a wide range of velocities and can be used at low signal-to-noise ratios. The present work enables the quantification of axonal transport parameters with high throughput with no a priori assumptions and minimal human intervention.     

Using statistical image models for objective evaluation of spot detection in two-dimensional gels

Protein spot detection is central to the analysis of two-dimensional electrophoresis gel images. There are many commercially available packages, each implementing a protein spot detection algorithm. Despite this, there have been relatively few studies comparing the performance characteristics of the different packages. This is in part due to the fact that different packages employ different sets of user-adjustable parameters. It is also partly due to the fact that the images are complex. To carry out an evaluation, "ground truth" data specifying spot position, shape and intensities needs to be defined subjectively on selected test images. We address this problem by proposing a method of evaluation using synthetic images with unambiguous interpretation. The characteristics of the spots in the synthetic images are determined from statistical models of the shape, intensity, size, spread and location of real spot data. The distribution of parameters is described using a Gaussian mixture model obtained from training images. The synthetic images allow us to investigate the effects of individual image properties, such as signal-to-noise ratios and degree of spot overlap, by measuring quantifiable outcomes, e.g. accuracy of spot position, false positive and false negative detection. We illustrate the approach by carrying out quantitative evaluations of spot detection on a number of widely used analysis packages.     

Object Segmentation and Ground Truth in 3D Embryonic Imaging

Many questions in developmental biology depend on measuring the position and movement of individual cells within developing embryos. Yet, tools that provide this data are often challenged by high cell density and their accuracy is difficult to measure. Here, we present a three-step procedure to address this problem. Step one is a novel segmentation algorithm based on image derivatives that, in combination with selective post-processing, reliably and automatically segments cell nuclei from images of densely packed tissue. Step two is a quantitative validation using synthetic images to ascertain the efficiency of the algorithm with respect to signal-to-noise ratio and object density. Finally, we propose an original method to generate reliable and experimentally faithful ground truth datasets: Sparse-dense dual-labeled embryo chimeras are used to unambiguously measure segmentation errors within experimental data. Together, the three steps outlined here establish a robust, iterative procedure to fine-tune image analysis algorithms and microscopy settings associated with embryonic 3D image data sets.     

A Zernike-moment-based non-local denoising filter for cryo-EM images

Cryo-electron microscopy (cryo-EM) plays an important role in determining the structure of proteins, viruses, and even the whole cell. It can capture dynamic structural changes of large protein complexes, which other methods such as X-ray crystallography and nuclear magnetic resonance analysis find difficult. The signal-to-noise ratio of cryo-EM images is low and the contrast is very weak, and therefore, the images are very noisy and require filtering. In this paper, a filtering method based on non-local means and Zernike moments is proposed. The method takes into account the rotational symmetry of some biological molecules to enhance the signal-to-noise ratio of cryo-EM images. The method may be useful in cryo-EM image processing such as the automatic selection of particles, orientation determination, and the building of initial models.     

Quantitative Determination of Spatial Protein-Protein Correlations in Fluorescence Confocal Microscopy

To quantify spatial protein-protein proximity (colocalization) in paired microscopic images of two sets of proteins labeled by distinct fluorophores, we showed that the cross-correlation and the autocorrelation functions of image intensity consisted of fast and slowly decaying components. The fast component resulted from clusters of proteins specifically labeled, and the slow component resulted from image heterogeneity and a broadly-distributed background. To better evaluate spatial proximity between the two specifically labeled proteins, we extracted the fast-decaying component by fitting the sharp peak in correlation functions to a Gaussian function, which was then used to obtain protein-protein proximity index and the Pearson's correlation coefficient. We also employed the median-filter method as a universal approach for background reduction to minimize nonspecific fluorescence. We illustrated our method by analyzing computer-simulated images and biological images.     

Markov random field based automatic image alignment for electron tomography

We present a method for automatic full-precision alignment of the images in a tomographic tilt series. Full-precision automatic alignment of cryo electron microscopy images has remained a difficult challenge to date, due to the limited electron dose and low image contrast. These facts lead to poor signal to noise ratio (SNR) in the images, which causes automatic feature trackers to generate errors, even with high contrast gold particles as fiducial features. To enable fully automatic alignment for full-precision reconstructions, we frame the problem probabilistically as finding the most likely particle tracks given a set of noisy images, using contextual information to make the solution more robust to the noise in each image. To solve this maximum likelihood problem, we use Markov Random Fields (MRF) to establish the correspondence of features in alignment and robust optimization for projection model estimation. The resulting algorithm, called Robust Alignment and Projection Estimation for Tomographic Reconstruction, or RAPTOR, has not needed any manual intervention for the difficult datasets we have tried, and has provided sub-pixel alignment that is as good as the manual approach by an expert user. We are able to automatically map complete and partial marker trajectories and thus obtain highly accurate image alignment. Our method has been applied to challenging cryo electron tomographic datasets with low SNR from intact bacterial cells, as well as several plastic section and X-ray datasets.     

A Bayesian method for classification of images from electron micrographs

Particle classification is an important component of multivariate statistical analysis methods that has been used extensively to extract information from electron micrographs of single particles. Here we describe a new Bayesian Gibbs sampling algorithm for the classification of such images. This algorithm, which is applied after dimension reduction by correspondence analysis or by principal components analysis, dynamically learns the parameters of the multivariate Gaussian distributions that characterize each class. These distributions describe tilted ellipsoidal clusters that adaptively adjust shape to capture differences in the variances of factors and the correlations of factors within classes. A novel Bayesian procedure to objectively select factors for inclusion in the classification models is a component of this procedure. A comparison of this algorithm with hierarchical ascendant classification of simulated data sets shows improved classification over a broad range of signal-to-noise ratios.     

Imaging obstructed ventilation with NMR using inert fluorinated gases.

We partially obstructed the left bronchi of rats and imaged an inert insoluble gas, SF(6), in the lungs with NMR using a technique that clearly differentiates obstructed and normal ventilation. When the inhaled fraction of O(2) is high, SF(6) concentrates dramatically in regions of the lung with low ventilation-to-perfusion ratios (VA/Q); therefore, these regions are brighter in an image than where VA/Q values are normal or high. A second image, made when the inhaled fraction of O(2) is low, serves as a reference because the SF(6) fraction is nearly uniform, regardless of VA/Q. The quotient of the first and second images displays the low-VA/Q regions and is corrected for other causes of brightness variation. The technique may provide sufficient quantification of VA/Q to be a useful research tool. The noise in the quotient image is described by the probability density function for the quotient of two normal random variables. When the signal-to-noise ratio of the denominator image is >10, the signal-to-noise ratio of the quotient image is similar to that of the parent images and decreases with pixel value.     

Fast rotational matching of single-particle images

The presence of noise and absence of contrast in electron micrographs lead to a reduced resolution of the final 3D reconstruction, due to the inherent limitations of single-particle image alignment. The fast rotational matching (FRM) algorithm was introduced recently for an accurate alignment of 2D images under such challenging conditions. Here, we implemented this algorithm for the first time in a standard 3D reconstruction package used in electron microscopy. This allowed us to carry out exhaustive tests of the robustness and reliability in iterative orientation determination, classification, and 3D reconstruction on simulated and experimental image data. A classification test on GroEL chaperonin images demonstrates that FRM assigns up to 13% more images to their correct reference orientation, compared to the classical self-correlation function method. Moreover, at sub-nanometer resolution, GroEL and rice dwarf virus reconstructions exhibit a remarkable resolution gain of 10-20% that is attributed to the novel image alignment kernel.     

Non-rigid registration of serial dedicated breast CT,longitudinal dedicated breast CT and PET/CT images using the diffeomorphic demons method

Rationale and objectivesDedicated breast CT and PET/CT scanners provide detailed 3D anatomical and functional imaging data sets and are currently being investigated for applications in breast cancer management such as diagnosis, monitoring response to therapy and radiation therapy planning. Our objective was to evaluate the performance of the diffeomorphic demons (DD) non-rigid image registration method to spatially align 3D serial (pre- and post-contrast) dedicated breast computed tomography (CT), and longitudinally-acquired dedicated 3D breast CT and positron emission tomography (PET)/CT images.MethodsThe algorithmic parameters of the DD method were optimized for the alignment of dedicated breast CT images using training data and fixed. The performance of the method for image alignment was quantitatively evaluated using three separate data sets; (1) serial breast CT pre- and post-contrast images of 20 women, (2) breast CT images of 20 women acquired before and after repositioning the subject on the scanner, and (3) dedicated breast PET/CT images of 7 women undergoing neo-adjuvant chemotherapy acquired pre-treatment and after 1 cycle of therapy.ResultsThe DD registration method outperformed no registration (p < 0.001) and conventional affine registration (p ≤ 0.002) for serial and longitudinal breast CT and PET/CT image alignment. In spite of the large size of the imaging data, the computational cost of the DD method was found to be reasonable (3–5 min).ConclusionsCo-registration of dedicated breast CT and PET/CT images can be performed rapidly and reliably using the DD method. This is the first study evaluating the DD registration method for the alignment of dedicated breast CT and PET/CT images.     

Boosting multiclass learning with repeating codes and weak detectors for protein subcellular localization

MOTIVATION: Determining locations of protein expression is essential to understand protein function. Advances in green fluorescence protein (GFP) fusion proteins and automated fluorescence microscopy allow for rapid acquisition of large collections of protein localization images. Recognition of these cell images requires an automated image analysis system. Approaches taken by previous work concentrated on designing a set of optimal features and then applying standard machine-learning algorithms. In fact, trends of recent advances in machine learning and computer vision can be applied to improve the performance. One trend is the advances in multiclass learning with error-correcting output codes (ECOC). Another trend is the use of a large number of weak detectors with boosting for detecting objects in images of real-world scenes. RESULTS: We take advantage of these advances to propose a new learning algorithm, AdaBoost.ERC, coupled with weak and strong detectors, to improve the performance of automatic recognition of protein subcellular locations in cell images. We prepared two image data sets of CHO and Vero cells and downloaded a HeLa cell image data set in the public domain to evaluate our new method. We show that AdaBoost.ERC outperforms other AdaBoost extensions. We demonstrate the benefit of weak detectors by showing significant performance improvements over classifiers using only strong detectors. We also empirically test our method's capability of generalizing to heterogeneous image collections. Compared with previous work, our method performs reasonably well for the HeLa cell images. AVAILABILITY: CHO and Vero cell images, their corresponding feature sets (SSLF and WSLF), our new learning algorithm, AdaBoost.ERC, and Supplementary Material are available at http://aiia.iis.sinica.edu.tw/     

Nonrigid Registration Regularized by Shape Information: Application to Atlas Construction of Cardiac CT Images

Cardiac atlases play an important role in the computer-aided diagnosis of cardiovascular diseases, in particular they need to deal with large and highly variable image datasets. In this paper, we propose a new nonrigid registration algorithm incorporating shape information, to produce comprehensive atlases. For one thing, the multiscale gradient orientation features of images are combined to form the construction of multifeature mutual information. Additionally, the shape information of multiple-objects in images is incorporated into the cost function for registration. We demonstrate the merits of the new registration algorithm on the 3D data sets of 15 patients. The experimental results show that the new registration algorithm can outperform the conventional intensity-based registration method. The obtained atlas can represent the cardiac structures more accurately.     

Quantitative comparison of algorithms for tracking single fluorescent particles

Single particle tracking has seen numerous applications in biophysics, ranging from the diffusion of proteins in cell membranes to the movement of molecular motors. A plethora of computer algorithms have been developed to monitor the sub-pixel displacement of fluorescent objects between successive video frames, and some have been claimed to have "nanometer" resolution. To date, there has been no rigorous comparison of these algorithms under realistic conditions. In this paper, we quantitatively compare specific implementations of four commonly used tracking algorithms: cross-correlation, sum-absolute difference, centroid, and direct Gaussian fit. Images of fluorescent objects ranging in size from point sources to 5 microm were computer generated with known sub-pixel displacements. Realistic noise was added and the above four algorithms were compared for accuracy and precision. We found that cross-correlation is the most accurate algorithm for large particles. However, for point sources, direct Gaussian fit to the intensity distribution is the superior algorithm in terms of both accuracy and precision, and is the most robust at low signal-to-noise. Most significantly, all four algorithms fail as the signal-to-noise ratio approaches 4. We judge direct Gaussian fit to be the best algorithm when tracking single fluorophores, where the signal-to-noise is frequently near 4.