TMaCS: A hybrid template matching and classification system for partially-automated particle selection

Selection of particle images from electron micrographs presents a bottleneck in determining the structures of macromolecular assemblies by single particle electron cryomicroscopy (cryo-EM). The problem is particularly important when an experimentalist wants to improve the resolution of a 3D map by increasing by tens or hundreds of thousands of images the size of the dataset used for calculating the map. Although several existing methods for automatic particle image selection work well for large protein complexes that produce high-contrast images, it is well known in the cryo-EM community that small complexes that give low-contrast images are often refractory to existing automated particle image selection schemes. Here we develop a method for partially-automated particle image selection when an initial 3D map of the protein under investigation is already available. Candidate particle images are selected from micrographs by template matching with template images derived from projections of the existing 3D map. The candidate particle images are then used to train a support vector machine, which classifies the candidates as particle images or non-particle images. In a final step in the analysis, the selected particle images are subjected to projection matching against the initial 3D map, with the correlation coefficient between the particle image and the best matching map projection used to assess the reliability of the particle image. We show that this approach is able to rapidly select particle images from micrographs of a rotary ATPase, a type of membrane protein complex involved in many aspects of biology.     

Automated detection of tunneling nanotubes in 3D images.

BACKGROUND: This paper presents an automated method for the identification of thin membrane tubes in 3D fluorescence images. These tubes, referred to as tunneling nanotubes (TNTs), are newly discovered intercellular structures that connect living cells through a membrane continuity. TNTs are 50-200 nm in diameter, crossing from one cell to another at their nearest distance. In microscopic images, they are seen as straight lines. It now emerges that the TNTs represent the underlying structure of a new type of cell-to-cell communication. METHODS: Our approach for the identification of TNTs is based on a combination of biological cell markers and known image processing techniques. Watershed segmentation and edge detectors are used to find cell borders, TNTs, and image artifacts. Mathematical morphology is employed at several stages of the processing chain. Two image channels are used for the calculations to improve classification of watershed regions into cells and background. One image channel displays cell borders and TNTs, the second is used for cell classification and displays the cytoplasmic compartments of the cells. The method for cell segmentation is 3D, and the TNT detection incorporates 3D information using various 2D projections. RESULTS: The TNT- and cell-detection were applied to numerous 3D stacks of images. A success rate of 67% was obtained compared with manual identification of the TNTs. The digitalized results were used to achieve statistical information of selected properties of TNTs. CONCLUSION: To further explore these structures, automated detection and quantification is desirable. Consequently, this automated recognition tool will be useful in biological studies on cell-to-cell communication where TNT quantification is essential.     

Robust filtering and particle picking in micrograph images towards 3D reconstruction of purified proteins with cryo-electron microscopy

In order to make a high resolution model of macromolecular structures from cryo-electron microscope (cryo-EM) raw images one has to be precise at every processing step from particle picking to 3D image reconstruction. In this paper we propose a collection of novel methods for filtering cryo-EM images and for automatic picking of particles. These methods have been developed for two cases: (1) when particles can be identified and (2) when particle are not distinguishable. The advantages of these methods are demonstrated in standard purified protein samples and to generalize them we do not use any ad hoc presumption of the geometry of the particle projections. We have also suggested a filtering method to increase the signal-to-noise (S/N) ratio which has proved to be useful for other levels of reconstruction, i.e., finding orientations and 3D model reconstruction.     

A fully automatic 3D reconstruction method using simulated annealing enables accurate posterioric angular assignment of protein projections

Single-particle analysis is a structure determining method using electron microscopic (EM) images, which does not require protein crystal. In this method, projections are picked up and used to reconstruct a three-dimensional (3D) structure. When the conical tilting method is not available, the particle images are usually classified and averaged to improve the signal-to-noise ratio. The Euler angles of these average images must be posteriorically assigned to create a primary 3D model. We developed a new, fully automatic unsupervised Euler angle assignment method, which does not require an initial 3D reference and which is applicable to asymmetric molecules. In this method, the Euler angle of each average image is initially set randomly and then automatically corrected in relation to those of the other averages by iterated optimizations using the Simulated Annealing (SA) algorithm. At each iteration, the 3D structure is reconstructed based on the current Euler angles and reprojected back in the average-input directions. A modified cross-correlation between each reprojection and its corresponding original average is then calculated. The correlations are summed as a total 3D echo-correlation score to evaluate the Euler angles at this iteration. Then, one of the projections is selected, its Euler angle is changed randomly, and the score is also calculated. Based on the score change, judgment of whether to accept or reject the new angle is made using the SA algorithm, which is introduced to overcome the local minimums. After a certain number of iterations of this process, the angles of all averages converge so as to create a reliable primary 3D model. This echo-correlated 3D reconstruction with simulated annealing also has potential for wide application to general 3D reconstruction from various types of 2D images.     

SwarmPS: rapid, semi-automated single particle selection software

Single particle analysis (SPA) coupled with high-resolution electron cryo-microscopy is emerging as a powerful technique for the structure determination of membrane protein complexes and soluble macromolecular assemblies. Current estimates suggest that approximately 10(4)-10(5) particle projections are required to attain a 3A resolution 3D reconstruction (symmetry dependent). Selecting this number of molecular projections differing in size, shape and symmetry is a rate-limiting step for the automation of 3D image reconstruction. Here, we present Swarm(PS), a feature rich GUI based software package to manage large scale, semi-automated particle picking projects. The software provides cross-correlation and edge-detection algorithms. Algorithm-specific parameters are transparently and automatically determined through user interaction with the image, rather than by trial and error. Other features include multiple image handling (approximately 10(2)), local and global particle selection options, interactive image freezing, automatic particle centering, and full manual override to correct false positives and negatives. Swarm(PS) is user friendly, flexible, extensible, fast, and capable of exporting boxed out projection images, or particle coordinates, compatible with downstream image processing suites.     

A Fast Image Alignment Approach for 2D Classification of Cryo-EM Images Using Spectral Clustering

Three-dimensional (3D) reconstruction in single-particle cryo-electron microscopy (cryo-EM) is a significant technique for recovering the 3D structure of proteins or other biological macromolecules from their two-dimensional (2D) noisy projection images taken from unknown random directions. Class averaging in single-particle cryo-EM is an important procedure for producing high-quality initial 3D structures, where image alignment is a fundamental step. In this paper, an efficient image alignment algorithm using 2D interpolation in the frequency domain of images is proposed to improve the estimation accuracy of alignment parameters of rotation angles and translational shifts between the two projection images, which can obtain subpixel and subangle accuracy. The proposed algorithm firstly uses the Fourier transform of two projection images to calculate a discrete cross-correlation matrix and then performs the 2D interpolation around the maximum value in the cross-correlation matrix. The alignment parameters are directly determined according to the position of the maximum value in the cross-correlation matrix after interpolation. Furthermore, the proposed image alignment algorithm and a spectral clustering algorithm are used to compute class averages for single-particle 3D reconstruction. The proposed image alignment algorithm is firstly tested on a Lena image and two cryo-EM datasets. Results show that the proposed image alignment algorithm can estimate the alignment parameters accurately and efficiently. The proposed method is also used to reconstruct preliminary 3D structures from a simulated cryo-EM dataset and a real cryo-EM dataset and to compare them with RELION. Experimental results show that the proposed method can obtain more high-quality class averages than RELION and can obtain higher reconstruction resolution than RELION even without iteration.     

Advantages of CCD detectors for de novo three-dimensional structure determination in single-particle electron microscopy

For three-dimensional (3D) structure determination of large macromolecular complexes, single-particle electron cryomicroscopy is considered the method of choice. Within this field, structure determination de novo, as opposed to refinement of known structures, still presents a major challenge, especially for macromolecules without point-group symmetry. This is primarily because of technical issues: one of these is poor image contrast, and another is the often low particle concentration and sample heterogeneity imposed by the practical limits of biochemical purification. In this work, we tested a state-of-the art 4 k x 4 k charge-coupled device (CCD) detector (TVIPS TemCam-F415) to see whether or not it can contribute to improving the image features that are especially important for structure determination de novo. The present study is therefore focused on a comparison of film and CCD detector in the acquisition of images in the low-to-medium ( approximately 10-25 A) resolution range using a 200 kV electron microscope equipped with field emission gun. For comparison, biological specimens and radiation-insensitive carbon layers were imaged under various conditions to test the image phase transmission, spatial signal-to-noise ratio, visual image quality and power-spectral signal decay for the complete image-processing chain. At all settings of the camera, the phase transmission and spectral signal-to-noise ratio were significantly better on CCD than on film in the low-to-medium resolution range. Thus, the number of particle images needed for initial structure determination is reduced and the overall quality of the initial computed 3D models is improved. However, at high resolution, film is still significantly better than the CCD camera: without binning of the CCD camera and at a magnification of 70 kx, film is better beyond 21 A resolution. With 4-fold binning of the CCD camera and at very high magnification (> 300 kx) film is still superior beyond 7 A resolution.     

Single particle electron microscopy

Electron microscopy (EM) in combination with image analysis is a powerful technique to study protein structures at low, medium, and high resolution. Since electron micrographs of biological objects are very noisy, improvement of the signal-to-noise ratio by image processing is an integral part of EM, and this is performed by averaging large numbers of individual projections. Averaging procedures can be divided into crystallographic and non-crystallographic methods. The crystallographic averaging method, based on two-dimensional (2D) crystals of (membrane) proteins, yielded in solving atomic protein structures in the last century. More recently, single particle analysis could be extended to solve atomic structures as well. It is a suitable method for large proteins, viruses, and proteins that are difficult to crystallize. Because it is also a fast method to reveal the low-to-medium resolution structures, the impact of its application is growing rapidly. Technical aspects, results, and possibilities are presented.     

Compensation of Missing Wedge Effects with Sequential Statistical Reconstruction in Electron Tomography

Electron tomography (ET) of biological samples is used to study the organization and the structure of the whole cell and subcellular complexes in great detail. However, projections cannot be acquired over full tilt angle range with biological samples in electron microscopy. ET image reconstruction can be considered an ill-posed problem because of this missing information. This results in artifacts, seen as the loss of three-dimensional (3D) resolution in the reconstructed images. The goal of this study was to achieve isotropic resolution with a statistical reconstruction method, sequential maximum a posteriori expectation maximization (sMAP-EM), using no prior morphological knowledge about the specimen. The missing wedge effects on sMAP-EM were examined with a synthetic cell phantom to assess the effects of noise. An experimental dataset of a multivesicular body was evaluated with a number of gold particles. An ellipsoid fitting based method was developed to realize the quantitative measures elongation and contrast in an automated, objective, and reliable way. The method statistically evaluates the sub-volumes containing gold particles randomly located in various parts of the whole volume, thus giving information about the robustness of the volume reconstruction. The quantitative results were also compared with reconstructions made with widely-used weighted backprojection and simultaneous iterative reconstruction technique methods. The results showed that the proposed sMAP-EM method significantly suppresses the effects of the missing information producing isotropic resolution. Furthermore, this method improves the contrast ratio, enhancing the applicability of further automatic and semi-automatic analysis. These improvements in ET reconstruction by sMAP-EM enable analysis of subcellular structures with higher three-dimensional resolution and contrast than conventional methods.     

Single particle reconstruction of membrane proteins: A tool for understanding the 3D structure of disease-related macromolecules

Membrane proteins play important roles in cell functions such as neurotransmission, muscle contraction, and hormone secretion, but their structures are mostly undetermined. Several techniques have been developed to elucidate the structure of macromolecules; X-ray or electron crystallography, nuclear magnetic resonance spectroscopy, and high-resolution electron microscopy. Electron microscopy-based single particle reconstruction, a computer-aided structure determination method, reconstructs a three-dimensional (3D) structure from projections of monodispersed protein. A large number of particle images are picked up from EM films, aligned and classified to generate two-dimensional (2D) averages, and, using the Euler angle of each 2D average, reconstructed into a 3D structure. This method is challenging due to the necessity for close collaboration between classical biochemistry and innovative information technology, including parallel computing. However, recent progress in electron microscopy, mathematical algorithms, and computational ability has greatly increased the subjects that are considered to be primarily addressable using single particle reconstruction. Membrane proteins are one of these targets to which the single particle reconstruction is successfully applied for understanding of their structures. In this paper, we will introduce recently reconstructed channel-related proteins and discuss the applicability of this technique in understanding molecular structures and their roles in pathology.     

Neuroanatomical phenotyping of the mouse brain with three-dimensional autofluorescence imaging

The structural organization of the brain is important for normal brain function and is critical to understand in order to evaluate changes that occur during disease processes. Three-dimensional (3D) imaging of the mouse brain is necessary to appreciate the spatial context of structures within the brain. In addition, the small scale of many brain structures necessitates resolution at the ～10 μm scale. 3D optical imaging techniques, such as optical projection tomography (OPT), have the ability to image intact large specimens (1 cm(3)) with ～5 μm resolution. In this work we assessed the potential of autofluorescence optical imaging methods, and specifically OPT, for phenotyping the mouse brain. We found that both specimen size and fixation methods affected the quality of the OPT image. Based on these findings we developed a specimen preparation method to improve the images. Using this method we assessed the potential of optical imaging for phenotyping. Phenotypic differences between wild-type male and female mice were quantified using computer-automated methods. We found that optical imaging of the endogenous autofluorescence in the mouse brain allows for 3D characterization of neuroanatomy and detailed analysis of brain phenotypes. This will be a powerful tool for understanding mouse models of disease and development and is a technology that fits easily within the workflow of biology and neuroscience labs.     

Visualization of Endosome Dynamics in Living Nerve Terminals with Four-dimensional Fluorescence Imaging

Four-dimensional (4D) light imaging has been used to study behavior of small structures within motor nerve terminals of the thin transversus abdominis muscle of the garter snake. Raw data comprises time-lapse sequences of 3D z-stacks. Each stack contains 4-20 images acquired with epifluorescence optics at focal planes separated by 400-1,500 nm. Steps in the acquisition of image stacks, such as adjustment of focus, switching of excitation wavelengths, and operation of the digital camera, are automated as much as possible to maximize image rate and minimize tissue damage from light exposure. After acquisition, a set of image stacks is deconvolved to improve spatial resolution, converted to the desired 3D format, and used to create a 4D "movie" that is suitable for variety of computer-based analyses, depending upon the experimental data sought. One application is study of the dynamic behavior of two classes of endosomes found in nerve terminals-macroendosomes (MEs) and acidic endosomes (AEs)-whose sizes (200-800 nm for both types) are at or near the diffraction limit. Access to 3D information at each time point provides several advantages over conventional time-lapse imaging. In particular, size and velocity of movement of structures can be quantified over time without loss of sharp focus. Examples of data from 4D imaging reveal that MEs approach the plasma membrane and disappear, suggesting that they are exocytosed rather than simply moving vertically away from a single plane of focus. Also revealed is putative fusion of MEs and AEs, by visualization of overlap between the two dye-containing structures as viewed in each three orthogonal projections.     

Automatic particle pickup method using a neural network has high accuracy by applying an initial weight derived from eigenimages: a new reference free method for single-particle analysis

The single-particle analysis is a structure-determining method for electron microscope (EM) images which does not require crystal. In this method, the projections are picked up and averaged by the images of similar Euler angles to improve the signal to noise ratio, and then create a 3-D reconstruction. The selection of a large number of particles from the cryo-EM micrographs is a pre-requisite for obtaining a high resolution. To pickup a low-contrast cryo-EM protein image, we have recently found that a three-layer pyramidal-type neural network is successful in detecting such a faint image, which had been difficult to detect by other methods. The connection weights between the input and hidden layers, which work as a matching filter, have revealed that they reflect characters of the particle projections in the training data. The images stored in terms of the connection weights were complex, more similar to the eigenimages which are created by the principal component analysis of the learning images rather than to the averages of the particle projections. When we set the initial learning weights according to the eigenimages in advance, the learning period was able to be shortened to less than half the time of the NN whose initial weights had been set randomly. Further, the pickup accuracy increased from 90 to 98%, and a combination of the matching filters were found to work as an integrated matching filter there. The integrated filters were amazingly similar to averaged projections and can be used directly as references for further two-dimensional averaging. Therefore, this research also presents a brand-new reference-free method for single-particle analysis.     

Orientation determination by wavelets matching for 3D reconstruction of very noisy electron microscopic virus images

Background  

In order to perform a 3D reconstruction of electron microscopic images of viruses, it is necessary to determine the orientation (Euler angels) of the 2D projections of the virus. The projections containing high resolution information are usually very noisy. This paper proposes a new method, based on weighted-projection matching in wavelet space for virus orientation determination. In order to speed the retrieval of the best match between projections from a model and real virus particle, a hierarchical correlation matching method is also proposed.     

A Bayesian view on cryo-EM structure determination

Three-dimensional (3D) structure determination by single-particle analysis of cryo-electron microscopy (cryo-EM) images requires many parameters to be determined from extremely noisy data. This makes the method prone to overfitting, that is, when structures describe noise rather than signal, in particular near their resolution limit where noise levels are highest. Cryo-EM structures are typically filtered using ad hoc procedures to prevent overfitting, but the tuning of arbitrary parameters may lead to subjectivity in the results. I describe a Bayesian interpretation of cryo-EM structure determination, where smoothness in the reconstructed density is imposed through a Gaussian prior in the Fourier domain. The statistical framework dictates how data and prior knowledge should be combined, so that the optimal 3D linear filter is obtained without the need for arbitrariness and objective resolution estimates may be obtained. Application to experimental data indicates that the statistical approach yields more reliable structures than existing methods and is capable of detecting smaller classes in data sets that contain multiple different structures.     

Reconstruction of low-resolution molecular structures from simulated atomic force microscopy images

BackgroundAtomic Force Microscopy (AFM) is an experimental technique to study structure-function relationship of biomolecules. AFM provides images of biomolecules at nanometer resolution. High-speed AFM experiments produce a series of images following dynamics of biomolecules. To further understand biomolecular functions, information on three-dimensional (3D) structures is beneficial.MethodWe aim to recover 3D information from an AFM image by computational modeling. The AFM image includes only low-resolution representation of a molecule; therefore we represent the structures by a coarse grained model (Gaussian mixture model). Using Monte-Carlo sampling, candidate models are generated to increase similarity between AFM images simulated from the models and target AFM image.ResultsThe algorithm was tested on two proteins to model their conformational transitions. Using a simulated AFM image as reference, the algorithm can produce a low-resolution 3D model of the target molecule. Effect of molecular orientations captured in AFM images on the 3D modeling performance was also examined and it is shown that similar accuracy can be obtained for many orientations.ConclusionsThe proposed algorithm can generate 3D low-resolution protein models, from which conformational transitions observed in AFM images can be interpreted in more detail.General significanceHigh-speed AFM experiments allow us to directly observe biomolecules in action, which provides insights on biomolecular function through dynamics. However, as only partial structural information can be obtained from AFM data, this new AFM based hybrid modeling method would be useful to retrieve 3D information of the entire biomolecule.     

A technique for the quantification of the 3D connectivity of thin articulations in Bony sutures

The anatomy and development of cranial and facial sutures have been studied in detail using histological sections, 2D radiographs and more recently CT imaging. However, little attention has been paid to evaluating and quantifying the connectivity of these thin cortical bone articulations. More recent technological advances such as micro-CT imaging has the potential to be used to provide quantitative measurements of 3D connectivity in bony articulations. This study presents a new technique for quantifying the connectivity of bony projections inside cranial and facial sutures using a combination of skeletonization, thinning algorithms and 3D intensity mapping. The technique is demonstrated in five sutures through semi-automated analysis and image processing of μCT scans. In the sagittal, coronal and frontozygomatic sutures an average bone connectivity of 6.6–11.6% was found with multiple bony projections providing an interlocking structure between adjacent bones. Much higher bone connectivity was present in the zygomaticotemporal and zygomaticomaxillary sutures (22.7–37.4%) with few bony projections. This method combining μCT scanning and image processing techniques was successfully used to quantify the connectivity of thin bone articulations and allowed detailed assessment of sutural fusion in 3D. The wider application of this technique may allow quantification of connectivity in other structures, in particular fracture healing of long bones.     

Fast rotational matching of single-particle images

The presence of noise and absence of contrast in electron micrographs lead to a reduced resolution of the final 3D reconstruction, due to the inherent limitations of single-particle image alignment. The fast rotational matching (FRM) algorithm was introduced recently for an accurate alignment of 2D images under such challenging conditions. Here, we implemented this algorithm for the first time in a standard 3D reconstruction package used in electron microscopy. This allowed us to carry out exhaustive tests of the robustness and reliability in iterative orientation determination, classification, and 3D reconstruction on simulated and experimental image data. A classification test on GroEL chaperonin images demonstrates that FRM assigns up to 13% more images to their correct reference orientation, compared to the classical self-correlation function method. Moreover, at sub-nanometer resolution, GroEL and rice dwarf virus reconstructions exhibit a remarkable resolution gain of 10-20% that is attributed to the novel image alignment kernel.     

Noise properties of reconstructed images in a kilo-voltage on-board imaging system with iterative reconstruction techniques: A phantom study

X-ray computed tomography (CT) images obtained with a kilo-voltage (kV) on-board imaging (OBI) system improve the accuracy of patient setup and treatment planning. The use of iterative reconstruction techniques (IRTs) for CT imaging can also reduce radiation dose compared to analytic reconstruction techniques. Despite these improvements, the image quality varies with IRTs, and the noise structure of reconstructed images can be distorted by IRTs. In this study, the noise properties and spatial resolution of the images reconstructed by IRTs were evaluated in terms of conventional noise metrics, high-order statistics, noise spectral density (NSD) and modulation transfer function (MTF) at different radiation doses. A kV OBI system mounted on a Varian Trilogy machine and a CATPHAN600 phantom were used to obtain projections, and the projections were reconstructed by Feldkamp (FDK), algebraic reconstruction technique (ART), maximum-likelihood expectation–maximization (MLEM) and total variation (TV) minimization algorithms. The reconstructed images were compared according to mean, standard deviation, skewness, kurtosis, NSD and MTF at different radiation doses. The results demonstrated that the noise properties and spatial resolution of reconstructed images depend on the type of IRT and the radiation dose. The noise structures are altered by IRTs and can be characterized by high-order statistics and NSD, as well as conventional noise metrics. In conclusion, high-order statistics and NSD should be considered in order to provide detailed information for the images reconstructed by IRTs. Also, trade-off among noise properties, spatial resolution and contrast is important to optimize image quality obtained using IRTs.     

Fragment-based phase extension for three-dimensional structure determination of membrane proteins by electron crystallography

In electron crystallography, membrane protein structure is determined from two-dimensional crystals where the protein is embedded in a membrane. Once large and well-ordered 2D crystals are grown, one of the bottlenecks in electron crystallography is the collection of image data to directly provide experimental phases to high resolution. Here, we describe an approach to bypass this bottleneck, eliminating the need for high-resolution imaging. We use the strengths of electron crystallography in rapidly obtaining accurate experimental phase information from low-resolution images and accurate high-resolution amplitude information from electron diffraction. The low-resolution experimental phases were used for the placement of α helix fragments and extended to high resolution using phases from the fragments. Phases were further improved by density modifications followed by fragment expansion and structure refinement against the high-resolution diffraction data. Using this approach, structures of three membrane proteins were determined rapidly and accurately to atomic resolution without high-resolution image data.