Three-dimensional spectral signal-to-noise ratio for a class of reconstruction algorithms

A three-dimensional (3D) version of the spectral signal-to-noise ratio (SSNR)-based resolution measure is introduced. The measure is defined for a class of 3D reconstruction algorithms that use interpolation in Fourier space. The statistical properties of the SSNR are discussed and related to the properties of another resolution measure, the Fourier shell correlation (FSC). The new measure was tested on 3D structures calculated from a simulated set of quasi-evenly spaced 2D projections using a nearest-neighbor interpolation and a gridding algorithm. In the latter case, the results agree very well with the FSC-based estimate, with the exception of very high SSNR values. The main applicability of the 3D SSNR is tomography, where due to the small number of projections collected, FSC cannot be used. The new measure was applied to three sets of tomographic data. It was demonstrated that the measure is sufficiently sensitive to yield theoretically expected results. Therefore, the 3D SSNR opens up the possibility of evaluating the quality of tomographic reconstructions in an objective manner. The 3D distribution of SSNR is of major interest in single-particle analysis. It is shown that the new measure can be used to evaluate the anisotropy of 3D reconstructions. The distribution of SSNR is characterized by three anisotropy indices derived from principal axes of the 3D inertia covariance matrix of the SSNR. These indices are used to construct a 3D Fourier filter which, when applied to a 3D reconstruction of a macromolecule, maximizes the SNR in real space and minimizes real-space artifacts caused by uneven distribution of 2D projections.     

UCSF tomography: an integrated software suite for real-time electron microscopic tomographic data collection, alignment, and reconstruction

A real-time alignment and reconstruction scheme for electron microscopic tomography (EMT) has been developed and integrated within our UCSF tomography data collection software. This newly integrated software suite provides full automation from data collection to real-time reconstruction by which the three-dimensional (3D) reconstructed volume is immediately made available at the end of each data collection. Real-time reconstruction is achieved by calculating a weighted back-projection on a small Linux cluster (five dual-processor compute nodes) concurrently with the UCSF tomography data collection running on the microscope's computer, and using the fiducial-marker free alignment data generated during the data collection process. The real-time reconstructed 3D volume provides users with immediate feedback to fully asses all aspects of the experiment ranging from sample choice, ice thickness, experimental parameters to the quality of specimen preparation. This information can be used to guide subsequent data collections. Access to the reconstruction is especially useful in low-dose cryo EMT where such information is very difficult to obtain due to extraordinary low signal to noise ratio in each 2D image. In our environment, we generally collect 2048 x 2048 pixel images which are subsequently computationally binned four-fold for the on-line reconstruction. Based upon experiments performed with thick and cryo specimens at various CCD magnifications (50000x-80000x), alignment accuracy is sufficient to support this reduced resolution but should be refined before calculating a full resolution reconstruction. The reduced resolution has proven to be quite adequate to assess sample quality, or to screen for the best data set for full-resolution reconstruction, significantly improving both productivity and efficiency of system resources. The total time from start of data collection to a final reconstructed volume (512 x 512 x 256 pixels) is about 50 min for a +/-70 degrees 2k x 2k pixel tilt series acquired at every 1 degrees.     

Reconstruction for 3D PET Based on Total Variation Constrained Direct Fourier Method

This paper presents a total variation (TV) regularized reconstruction algorithm for 3D positron emission tomography (PET). The proposed method first employs the Fourier rebinning algorithm (FORE), rebinning the 3D data into a stack of ordinary 2D data sets as sinogram data. Then, the resulted 2D sinogram are ready to be reconstructed by conventional 2D reconstruction algorithms. Given the locally piece-wise constant nature of PET images, we introduce the total variation (TV) based reconstruction schemes. More specifically, we formulate the 2D PET reconstruction problem as an optimization problem, whose objective function consists of TV norm of the reconstructed image and the data fidelity term measuring the consistency between the reconstructed image and sinogram. To solve the resulting minimization problem, we apply an efficient methods called the Bregman operator splitting algorithm with variable step size (BOSVS). Experiments based on Monte Carlo simulated data and real data are conducted as validations. The experiment results show that the proposed method produces higher accuracy than conventional direct Fourier (DF) (bias in BOSVS is 70% of ones in DF, variance of BOSVS is 80% of ones in DF).     

An adaptation of the Wiener filter suitable for analyzing images of isolated single particles

The Wiener filter is a standard means of optimizing the signal in sums of aligned, noisy images obtained by electron cryo-microscopy (cryo-EM). However, estimation of the resolution-dependent (“spectral”) signal-to-noise ratio (SSNR) from the input data has remained problematic, and error reduction due to specific application of the SSNR term within a Wiener filter has not been reported. Here we describe an adjustment to the Wiener filter for optimal summation of images of isolated particles surrounded by large regions of featureless background, as is typically the case in single-particle cryo-EM applications. We show that the density within the particle area can be optimized, in the least-squares sense, by scaling the SSNR term found in the conventional Wiener filter by a factor that reflects the fraction of the image field occupied by the particle. We also give related expressions that allow the SSNR to be computed for application in this new filter, by incorporating a masking step into a Fourier Ring Correlation (FRC), a standard resolution measure. Furthermore, we show that this masked FRC estimation scheme substantially improves on the accuracy of conventional SSNR estimation methods. We demonstrate the validity of our new approach in numeric tests with simulated data corresponding to realistic cryo-EM imaging conditions. This variation of the Wiener filter and accompanying derivation should prove useful for a variety of single-particle cryo-EM applications, including 3D reconstruction.     

ResLog plots as an empirical metric of the quality of cryo-EM reconstructions

Compared to the field of X-ray crystallography, the field of single particle three-dimensional electron microscopy has few reliable metrics for assessing the quality of 3D reconstructions. New metrics are needed that can determine whether a given 3D reconstruction accurately reflects the structure of the particles from which it was derived or instead depicts a plausible though incorrect structure due to coarse misalignment of particles. Here an empirical procedure is presented for differentiating between a reconstruction with well-aligned particles and a reconstruction with grossly misclassified particles. For a given dataset, 3D reconstructions are computed from subsets of particles with decreasing numbers of particles contributing to the reconstruction. A plot of inverse resolution vs. the logarithm of the number of particles (a “ResLog” plot) provides metrics for the reliability of the reconstruction and the overall quality of the dataset and processing. Specifically, the y-intercept of a regression line provides a measure of the relative accuracy of the particle alignment and classification, and the slope is an indicator of the overall data quality including the imaging conditions and processing steps. ResLog plots can also be used to optimize conditions for data collection and reconstruction parameters. Although resolution estimates can vary by method of calculation, ResLog-derived parameters are consistent whether calculated by Fourier shell correlation or Fourier neighbor correlation, or a new coordinate-based metric that serves as a yardstick for structures where atomic coordinates are available. ResLog plots could become part of a standard set of parameters to be included in 3D reconstruction reports.     

Accelerated Optical Projection Tomography Applied to In Vivo Imaging of Zebrafish

Optical projection tomography (OPT) provides a non-invasive 3-D imaging modality that can be applied to longitudinal studies of live disease models, including in zebrafish. Current limitations include the requirement of a minimum number of angular projections for reconstruction of reasonable OPT images using filtered back projection (FBP), which is typically several hundred, leading to acquisition times of several minutes. It is highly desirable to decrease the number of required angular projections to decrease both the total acquisition time and the light dose to the sample. This is particularly important to enable longitudinal studies, which involve measurements of the same fish at different time points. In this work, we demonstrate that the use of an iterative algorithm to reconstruct sparsely sampled OPT data sets can provide useful 3-D images with 50 or fewer projections, thereby significantly decreasing the minimum acquisition time and light dose while maintaining image quality. A transgenic zebrafish embryo with fluorescent labelling of the vasculature was imaged to acquire densely sampled (800 projections) and under-sampled data sets of transmitted and fluorescence projection images. The under-sampled OPT data sets were reconstructed using an iterative total variation-based image reconstruction algorithm and compared against FBP reconstructions of the densely sampled data sets. To illustrate the potential for quantitative analysis following rapid OPT data acquisition, a Hessian-based method was applied to automatically segment the reconstructed images to select the vasculature network. Results showed that 3-D images of the zebrafish embryo and its vasculature of sufficient visual quality for quantitative analysis can be reconstructed using the iterative algorithm from only 32 projections—achieving up to 28 times improvement in imaging speed and leading to total acquisition times of a few seconds.     

Automatic 4D Reconstruction of Patient-Specific Cardiac Mesh with 1-to-1 Vertex Correspondence from Segmented Contours Lines

We propose an automatic algorithm for the reconstruction of patient-specific cardiac mesh models with 1-to-1 vertex correspondence. In this framework, a series of 3D meshes depicting the endocardial surface of the heart at each time step is constructed, based on a set of border delineated magnetic resonance imaging (MRI) data of the whole cardiac cycle. The key contribution in this work involves a novel reconstruction technique to generate a 4D (i.e., spatial–temporal) model of the heart with 1-to-1 vertex mapping throughout the time frames. The reconstructed 3D model from the first time step is used as a base template model and then deformed to fit the segmented contours from the subsequent time steps. A method to determine a tree-based connectivity relationship is proposed to ensure robust mapping during mesh deformation. The novel feature is the ability to handle intra- and inter-frame 2D topology changes of the contours, which manifests as a series of merging and splitting of contours when the images are viewed either in a spatial or temporal sequence. Our algorithm has been tested on five acquisitions of cardiac MRI and can successfully reconstruct the full 4D heart model in around 30 minutes per subject. The generated 4D heart model conforms very well with the input segmented contours and the mesh element shape is of reasonably good quality. The work is important in the support of downstream computational simulation activities.     

A Novel Weighted Total Difference Based Image Reconstruction Algorithm for Few-View Computed Tomography

In practical applications of computed tomography (CT) imaging, due to the risk of high radiation dose imposed on the patients, it is desired that high quality CT images can be accurately reconstructed from limited projection data. While with limited projections, the images reconstructed often suffer severe artifacts and the edges of the objects are blurred. In recent years, the compressed sensing based reconstruction algorithm has attracted major attention for CT reconstruction from a limited number of projections. In this paper, to eliminate the streak artifacts and preserve the edge structure information of the object, we present a novel iterative reconstruction algorithm based on weighted total difference (WTD) minimization, and demonstrate the superior performance of this algorithm. The WTD measure enforces both the sparsity and the directional continuity in the gradient domain, while the conventional total difference (TD) measure simply enforces the gradient sparsity horizontally and vertically. To solve our WTD-based few-view CT reconstruction model, we use the soft-threshold filtering approach. Numerical experiments are performed to validate the efficiency and the feasibility of our algorithm. For a typical slice of FORBILD head phantom, using 40 projections in the experiments, our algorithm outperforms the TD-based algorithm with more than 60% gains in terms of the root-mean-square error (RMSE), normalized root mean square distance (NRMSD) and normalized mean absolute distance (NMAD) measures and with more than 10% gains in terms of the peak signal-to-noise ratio (PSNR) measure. While for the experiments of noisy projections, our algorithm outperforms the TD-based algorithm with more than 15% gains in terms of the RMSE, NRMSD and NMAD measures and with more than 4% gains in terms of the PSNR measure. The experimental results indicate that our algorithm achieves better performance in terms of suppressing streak artifacts and preserving the edge structure information of the object.     

A fully automatic 3D reconstruction method using simulated annealing enables accurate posterioric angular assignment of protein projections

Single-particle analysis is a structure determining method using electron microscopic (EM) images, which does not require protein crystal. In this method, projections are picked up and used to reconstruct a three-dimensional (3D) structure. When the conical tilting method is not available, the particle images are usually classified and averaged to improve the signal-to-noise ratio. The Euler angles of these average images must be posteriorically assigned to create a primary 3D model. We developed a new, fully automatic unsupervised Euler angle assignment method, which does not require an initial 3D reference and which is applicable to asymmetric molecules. In this method, the Euler angle of each average image is initially set randomly and then automatically corrected in relation to those of the other averages by iterated optimizations using the Simulated Annealing (SA) algorithm. At each iteration, the 3D structure is reconstructed based on the current Euler angles and reprojected back in the average-input directions. A modified cross-correlation between each reprojection and its corresponding original average is then calculated. The correlations are summed as a total 3D echo-correlation score to evaluate the Euler angles at this iteration. Then, one of the projections is selected, its Euler angle is changed randomly, and the score is also calculated. Based on the score change, judgment of whether to accept or reject the new angle is made using the SA algorithm, which is introduced to overcome the local minimums. After a certain number of iterations of this process, the angles of all averages converge so as to create a reliable primary 3D model. This echo-correlated 3D reconstruction with simulated annealing also has potential for wide application to general 3D reconstruction from various types of 2D images.     

Three-dimensional biofilm image reconstruction for assessing structural parameters

Parameters representing three-dimensional (3D) biofilm structure are quantified from confocal laser-scanning microscope (CLSM) images. These 3D parameters describe the distribution of biomass pixels within the space occupied by a biofilm; however, they lack a direct connection to biofilm activity. As a result, researchers choose a handful of parameters without there being a consensus on a standard set of parameters. We hypothesized that a select 3D parameter set could be used to reconstruct a biofilm image and that the reconstructed and original biofilm images would have similar activities. To test this hypothesis, an algorithm was developed to reconstruct a biofilm image with parameters identical to those of the original CLSM image. We introduced an objective method to assess the reconstruction algorithm by comparing the activities of the original and reconstructed biofilm images. We found that biofilm images with identical structural parameters showed nearly identical activities and substrate concentration profiles. This implies that the set containing all common structural parameters can successfully describe biofilm structure. This finding is significant, as it opens the door to the next step, of finding a smaller standard set of biofilm structural parameters that can be used to compare biofilm structure.     

Towards a biomechanics-based technique for assessing myocardial contractility: an inverse problem approach

This work presents the initial development and implementation of a novel 3D biomechanics-based approach to measure the mechanical activity of myocardial tissue, as a potential non-invasive tool to assess myocardial function. This technique quantifies the myocardial contraction forces developed within the ventricular myofibers in response to electro-physiological stimuli. We provide a 3D finite element formulation of a contraction force reconstruction algorithm, along with its implementation using magnetic resonance (MR) data. Our algorithm is based on an inverse problem solution governed by the fundamental continuum mechanics principle of conservation of linear momentum, under a first-order approximation of elastic and isotropic material conditions. We implemented our technique using a subject-specific ventricle model obtained by extracting the left ventricular anatomical features from a set of high-resolution cardiac MR images acquired throughout the cardiac cycle using prospective electrocardiographic gating. Cardiac motion information was extracted by non-rigid registration of the mid-diastole reference image to the remaining images of a 4D dataset. Using our technique, we reconstructed dynamic maps that show the contraction force distribution superimposed onto the deformed ventricle model at each acquired frame in the cardiac cycle. Our next objective will consist of validating this technique by showing the correlation between the presence of low contraction force patterns and poor myocardial functionality.     

Reconstruction of axial tomographic high resolution data from confocal fluorescence microscopy: a method for improving 3D FISH images.

Fluorescent confocal laser scanning microscopy allows an improved imaging of microscopic objects in three dimensions. However, the resolution along the axial direction is three times worse than the resolution in lateral directions. A method to overcome this axial limitation is tilting the object under the microscope, in a way that the direction of the optical axis points into different directions relative to the sample. A new technique for a simultaneous reconstruction from a number of such axial tomographic confocal data sets was developed and used for high resolution reconstruction of 3D-data both from experimental and virtual microscopic data sets. The reconstructed images have a highly improved 3D resolution, which is comparable to the lateral resolution of a single deconvolved data set. Axial tomographic imaging in combination with simultaneous data reconstruction also opens the possibility for a more precise quantification of 3D data. The color images of this publication can be accessed from http://www.esacp.org/acp/2000/20-1/heintzmann.++ +htm. At this web address an interactive 3D viewer is additionally provided for browsing the 3D data. This java applet displays three orthogonal slices of the data set which are dynamically updated by user mouse clicks or keystrokes.     

基于计算机三维图象技术的失语症病灶空间定位法

首次把计算机三维重建方法应用于失语症的研究中,主要有三方面的工作:(1)建立了一套精细程度较高的标准CT脑图,用三维重建方法建立了标准立体头颅,并用伪彩色显示不同的脑结构和语言区.(2)提出标准化应在三维空间内进行的观点,改进的标准化方法充分利用了CT所能提供的关于脑结构的信息,从而使病灶在每层标准CT脑图上的定位更加准确.(3)对两类临床表现不同但CT显示病灶位置相近的失语症病人共47例进行了研究.通过对标准化之后的病灶的统计处理,得到病灶的集中部位,并对其进行三维重建,在标准立体头颅中显示其空间位置的差别.     

Three-dimensional reconstruction using an adaptive simultaneous algebraic reconstruction technique in electron tomography

Three-dimensional (3D) reconstruction of electron tomography (ET) has emerged as an important technique in analyzing structures of complex biological samples. However most of existing reconstruction methods are not suitable for extremely noisy and incomplete data conditions. We present an adaptive simultaneous algebraic reconstruction technique (ASART) in which a modified multilevel access scheme and an adaptive relaxation parameter adjustment method are developed to improve the quality of the reconstructed 3D structure. The reconstruction process is facilitated by using a column-sum substitution approach. This modified multilevel access scheme is adopted to arrange the order of projections so as to minimize the correlations between consecutive views within a limited angle range. In the adaptive relaxation parameter adjustment method, not only the weight matrix (as in the existing methods) but the gray levels of the pixels are employed to adjust the relaxation parameters so that the quality of the reconstruction is improved while the convergence process of the reconstruction is accelerated. In the column-sum substitution approach, the computation to obtain the reciprocal of the sum for the columns in each view is avoided so that the needed computations for each iteration can be reduced. Experimental results show that the proposed technique ASART is better based on objective quality measures than other methods, especially when data is noisy and limited in tilt angles. At the same time, the reconstruction by ASART outperforms that of simultaneous algebraic reconstruction technique (SART) in speed.     

Metabolic networks are NP-hard to reconstruct

High-throughput data from various omics and sequencing techniques have rendered the automated metabolic network reconstruction a highly relevant problem. Our approach reflects the inherent probabilistic nature of the steps involved in metabolic network reconstruction. Here, the goal is to arrive at networks which combine probabilistic information with the possibility to obtain a small number of disconnected network constituents by reduction of a given preliminary probabilistic metabolic network. We define automated metabolic network reconstruction as an optimization problem on four-partite graph (nodes representing genes, enzymes, reactions, and metabolites) which integrates: (1) probabilistic information obtained from the existing process for metabolic reconstruction from a given genome, (2) connectedness of the raw metabolic network, and (3) clustering of components in the reconstructed metabolic network. The practical implications of our theoretical analysis refer to the quality of reconstructed metabolic networks and shed light on the problem of finding more efficient and effective methods for automated reconstruction. Our main contributions include: a completeness result for the defined problem, polynomial-time approximation algorithm, and an optimal polynomial-time algorithm for trees. Moreover, we exemplify our approach by the reconstruction of the sucrose biosynthesis pathway in Chlamydomonas reinhardtii.     

Fast and accurate three-dimensional reconstruction from projections with random orientations via radon transforms

A new algorithm for three-dimensional reconstruction from randomly oriented projections has been developed. The algorithm recovers the 3D Radon transform from the 2D Radon transforms (sinograms) of the projections. The structure in direct space is obtained by an inversion of the 3D Radon transform. The mathematical properties of the Radon transform are exploited to design a special filter that can be used to correct inconsistencies in a data set and to fill the gaps in the Radon transform that originate from missing projections. Several versions of the algorithm have been implemented, with and without a filter and with different interpolation methods for merging the sinograms into the 3D Radon transform. The algorithms have been tested on analytical phantoms and experimental data and have been compared with a weighted back projection algorithm (WBP). A quantitative analysis of phantoms reconstructed from noise-free and noise-corrupted projections shows that the new algorithms are more accurate than WBP when the number of projections is small. Experimental structures obtained by the new methods are strictly comparable to those obtained by WBP. Moreover, the algorithm is more than 10 times faster than WPB when applied to a data set of 1000-5000 projections. Copyright 1999 Academic Press.     

3D Coronary Artery Reconstruction by 2D Motion Compensation Based on Mutual Information

Background

3D reconstruction of the coronary arteries can provide more information in the interventional surgery. Motion compensation is one kind of the 3D reconstruction method.

A multiresolution approach to orientation assignment in 3D electron microscopy of single particles

Three-dimensional (3D) electron microscopy (3DEM) aims at the determination of the spatial distribution of the Coulomb potential of macromolecular complexes. The 3D reconstruction of a macromolecule using single-particle techniques involves thousands of 2D projections. One of the key parameters required to perform such a 3D reconstruction is the orientation of each projection image as well as its in-plane orientation. This information is unknown experimentally and must be determined using image-processing techniques. We propose the use of wavelets to match the experimental projections with those obtained from a reference 3D model. The wavelet decomposition of the projection images provides a framework for a multiscale matching algorithm in which speed and robustness to noise are gained. Furthermore, this multiresolution approach is combined with a novel orientation selection strategy. Results obtained from computer simulations as well as experimental data encourage the use of this approach.     

3D虚拟复原精度的差异对头骨测量数值的影响——以Mimics软牛为例

近年来,根据三维软件虚拟复原的头骨来获取测量数据的方法被越来越多地应用在古生物,特别是古人类学的研究中,然而对于三维软件不同精度虚拟复原的头骨,其测量数值是否有差异,研究者并不是很清楚。本文以Mimics软件为例,根据其复原模型简化规则,选择未精简的最佳精度模型作为标准进行配对t检验或非参数检验,通过对43例云南人头骨的顶骨矢状弦长、颅周长、头盖部面积、乳突小房表面积、颅容量、乳突小房体积等六个测量项目的对比和分析,对Mimics软件低、中、高、最佳四种精度3D虚拟复原头骨间的测量差异进行了研究。结果显示：颅周长、头盖部面积、颅容量、乳突小房体积四项的所有简化精度模型的测量数据均与最佳精度模型测量数据的差异具有显著性;而除高精度组外,顶骨矢状弦长及乳突小房表面积的其余精度组测量数据均与最佳精度组差异具有显著性;此外,顶骨矢状弦长、颅周长、头盖部面积、颅容量的简化精度与最佳精度的测量差异占比均小于3%.而乳突小房表面积的低精度与最佳精度测量差异占比可超过50%,乳突小房体积的低精度与最佳精度测量差异占比可超过120%。这一结果提示我们,在测量Mimics复原的三维模型时,体量大差异小的测量项可以在较低精度的复原模型上进行测量;而对头骨内部腔窦这样体量小表面粗糙的结构,复原模型的精度选择及测量数据比较需要格外谨慎。     

Robust framework for PET image reconstruction incorporating system and measurement uncertainties

In Positron Emission Tomography (PET), an optimal estimate of the radioactivity concentration is obtained from the measured emission data under certain criteria. So far, all the well-known statistical reconstruction algorithms require exactly known system probability matrix a priori, and the quality of such system model largely determines the quality of the reconstructed images. In this paper, we propose an algorithm for PET image reconstruction for the real world case where the PET system model is subject to uncertainties. The method counts PET reconstruction as a regularization problem and the image estimation is achieved by means of an uncertainty weighted least squares framework. The performance of our work is evaluated with the Shepp-Logan simulated and real phantom data, which demonstrates significant improvements in image quality over the least squares reconstruction efforts.