Fast tomographic reconstruction on multicore computers

SUMMARY: Tomo3D implements a multithreaded vectorized approach to tomographic reconstruction that takes full advantage of the computer power in modern multicore computers. Full resolution tomograms are generated at high speed on standard computers with no special system requirements. Tomo3D has the most common reconstruction methods implemented, namely weighted Back-projection (WBP) and simultaneous iterative reconstruction technique (SIRT). It proves to be competitive with current graphic processor unit solutions in terms of processing time, in the order of a few seconds with WBP or minutes with SIRT. The program is compatible with standard packages, which easily allows integration in the electron tomography workflow.     

Electron Tomography of Large, Multicomponent Biological Structures

Electron tomography is an extremely useful method for deriving three-dimensional structure from electron microscope images. The application of this technique to the reconstruction of large, complex structures such as mitochondria is described in conjunction with several tools for segmentation, measurement, classification, and visualization. In addition, the use of massively parallel computers to perform the tomographic reconstruction efficiently using R-weighted backprojection or iterative techniques is described.     

How to convert a traditional electron microscopy laboratory to digital imaging: follow the 'middle road'

Today, electron microscopy (EM) is increasingly confronted by the revolution in image-processing technology provoked by modern computers. Digital cameras are fast replacing film-based cameras in EM, as elsewhere, and the procedures for digital image-archiving, image-analysis, and image publication are rapidly evolving. To take advantage of these advances, we have chosen for the moment a 'middle road', in which film remains our basic recording medium in the electron microscope, but immediately thereafter, all film-based images are converted to digital files for further analysis and processing. The rationale behind this approach is that film still offers far greater sensitivity and resolution (providing an image equivalent to> 10 000 pixels per inch in a 1-s exposure), and film is still far easier to organize and archive than digital images of comparable resolution. However, digital manipulation of EM images has become mandatory. Hence, we explain here, in some detail, how we convert from film to digital.     

Fragment-based phase extension for three-dimensional structure determination of membrane proteins by electron crystallography

In electron crystallography, membrane protein structure is determined from two-dimensional crystals where the protein is embedded in a membrane. Once large and well-ordered 2D crystals are grown, one of the bottlenecks in electron crystallography is the collection of image data to directly provide experimental phases to high resolution. Here, we describe an approach to bypass this bottleneck, eliminating the need for high-resolution imaging. We use the strengths of electron crystallography in rapidly obtaining accurate experimental phase information from low-resolution images and accurate high-resolution amplitude information from electron diffraction. The low-resolution experimental phases were used for the placement of α helix fragments and extended to high resolution using phases from the fragments. Phases were further improved by density modifications followed by fragment expansion and structure refinement against the high-resolution diffraction data. Using this approach, structures of three membrane proteins were determined rapidly and accurately to atomic resolution without high-resolution image data.     

Label free high throughput screening for apoptosis inducing chemicals using time-lapse microscopy signal processing

Label free time-lapse microscopy has opened a new avenue to the study of time evolving events in living cells. When combined with automated image analysis it provides a powerful tool that enables automated large-scale spatiotemporal quantification at the cell population level. Very few attempts, however, have been reported regarding the design of image analysis algorithms dedicated to the detection of apoptotic cells in such time-lapse microscopy images. In particular, none of the reported attempts is based on sufficiently fast signal processing algorithms to enable large-scale detection of apoptosis within hours/days without access to high-end computers. Here we show that it is indeed possible to successfully detect chemically induced apoptosis by applying a two-dimensional linear matched filter tailored to the detection of objects with the typical features of an apoptotic cell in phase-contrast images. First a set of recorded computational detections of apoptosis was validated by comparison with apoptosis specific caspase activity readouts obtained via a fluorescence based assay. Then a large screen encompassing 2,866 drug like compounds was performed using the human colorectal carcinoma cell line HCT116. In addition to many well known inducers (positive controls) the screening resulted in the detection of two compounds here reported for the first time to induce apoptosis.     

A Parallel Distributed-Memory Particle Method Enables Acquisition-Rate Segmentation of Large Fluorescence Microscopy Images

Modern fluorescence microscopy modalities, such as light-sheet microscopy, are capable of acquiring large three-dimensional images at high data rate. This creates a bottleneck in computational processing and analysis of the acquired images, as the rate of acquisition outpaces the speed of processing. Moreover, images can be so large that they do not fit the main memory of a single computer. We address both issues by developing a distributed parallel algorithm for segmentation of large fluorescence microscopy images. The method is based on the versatile Discrete Region Competition algorithm, which has previously proven useful in microscopy image segmentation. The present distributed implementation decomposes the input image into smaller sub-images that are distributed across multiple computers. Using network communication, the computers orchestrate the collectively solving of the global segmentation problem. This not only enables segmentation of large images (we test images of up to 10¹⁰ pixels), but also accelerates segmentation to match the time scale of image acquisition. Such acquisition-rate image segmentation is a prerequisite for the smart microscopes of the future and enables online data compression and interactive experiments.     

Scanning x-ray microdiffraction: In situ molecular imaging of tissue and materials

Scanning x-ray microdiffraction of complex tissues and materials is an emerging method for the study of macromolecular structures in situ, providing information on the way molecular constituents are arranged and interact with their microenvironment. Acting as a bridge between high-resolution images of individual constituents and lower resolution microscopies that generate global views of material, scanning microdiffraction provides an approach to study the functioning of complex tissues across multiple length scales. Here, we discuss the methodology, summarize results from recent studies, and discuss the potential of the technique for future studies coordinated with other biophysical techniques.     

Serial section scanning electron microscopy (S3EM) on silicon wafers for ultra-structural volume imaging of cells and tissues

High resolution, three-dimensional (3D) representations of cellular ultrastructure are essential for structure function studies in all areas of cell biology. While limited subcellular volumes have been routinely examined using serial section transmission electron microscopy (ssTEM), complete ultrastructural reconstructions of large volumes, entire cells or even tissue are difficult to achieve using ssTEM. Here, we introduce a novel approach combining serial sectioning of tissue with scanning electron microscopy (SEM) using a conductive silicon wafer as a support. Ribbons containing hundreds of 35 nm thick sections can be generated and imaged on the wafer at a lateral pixel resolution of 3.7 nm by recording the backscattered electrons with the in-lens detector of the SEM. The resulting electron micrographs are qualitatively comparable to those obtained by conventional TEM. S(3)EM images of the same region of interest in consecutive sections can be used for 3D reconstructions of large structures. We demonstrate the potential of this approach by reconstructing a 31.7 μm(3) volume of a calyx of Held presynaptic terminal. The approach introduced here, Serial Section SEM (S(3)EM), for the first time provides the possibility to obtain 3D ultrastructure of large volumes with high resolution and to selectively and repetitively home in on structures of interest. S(3)EM accelerates process duration, is amenable to full automation and can be implemented with standard instrumentation.     

Coordinate-based colocalization analysis of single-molecule localization microscopy data

Colocalization of differently labeled biomolecules is a valuable tool in fluorescence microscopy and can provide information on biomolecular interactions. With the advent of super-resolution microscopy, colocalization analysis is getting closer to molecular resolution, bridging the gap to other technologies such as fluorescence resonance energy transfer. Among these novel microscopic techniques, single-molecule localization-based super-resolution methods offer the advantage of providing single-molecule coordinates that, rather than intensity information, can be used for colocalization analysis. This requires adapting the existing mathematical algorithms for localization microscopy data. Here, we introduce an algorithm for coordinate-based colocalization analysis which is suited for single-molecule super-resolution data. In addition, we present an experimental configuration for simultaneous dual-color imaging together with a robust approach to correct for optical aberrations with an accuracy of a few nanometers. We demonstrate the potential of our approach for cellular structures and for two proteins binding actin filaments.     

Denoising of Electron Tomographic Reconstructions Using Multiscale Transformations

The visualization of volume maps obtained by electron tomographic reconstruction is severely hampered by noise. As electron tomography is usually applied to individual, nonrepeatable structures, e.g., cell sections or cell organelles, the noise cannot be removed by averaging as is done implicitly in electron crystallography or explicitly in single particle analysis. In this paper, an approach for noise reduction is presented, based on a multiscale transformation, e.g., the wavelet transformation, in conjunction with a nonlinear filtration of the transform coefficients. After a brief introduction to the theoretical background, the effect of this type of noise reduction is demonstrated by test calculations as well as by applications to tomographic reconstructions of ice-embedded specimens. Regarding noise reduction and structure preservation, the method turns out to be superior to conventional filter techniques, such as the median filter or the Wiener filter. Results obtained with the use of different types of multiscale transformations are compared and the choice of suitable filter parameters is discussed.     

Microwave imaging of tissue blood content changes

Active microwave imaging gives information on the dielectric properties of the body, allowing the collection of data that are distinct from, but complementary to, those available from other imaging methods based on different radiations. Two types of microwave imaging systems have been developed. The first is a planar system that irradiates the object with a plane wave and collects scattered phase and amplitude data at 1024 points on a parallel plane. The data can be reconstructed using a back propagation technique to give an image of the object. The second type of system is a tomographic scanner, consisting of a multiplexed 64-element circular array of waveguides. The waveguides are electronically scanned, alternately as sources and receivers, to give a complete scan of the object with no mechanical movement. A tomographic ‘slice’ of the object is reconstructed using spectral domain interpolation. Both systems work at 2.45 GHz with an incident power < 1 mW cm⁻² at the object and require a coupling medium (usually water) between the object and the source/receiver. Imaging parameters are appropriate for clinical use: a spatial resolution of 1 cm, measurement time of a few seconds and contrast resolution of around 1%. The effects of changes in perfusion on images of isolated animal organs are presented. Images have also been obtained, with both systems, of the internal dielectric structure of the forearm and of variations in dielectric properties due to changes of tissue blood content effected by application and release of tourniquets to the upper arm. Results s how that these changes are well demonstrated by microwave imaging, and possible clinical applications are discussed.     

Visualizing Escherichia coli sub-cellular structure using sparse deconvolution Spatial Light Interference Tomography

Studying the 3D sub-cellular structure of living cells is essential to our understanding of biological function. However, tomographic imaging of live cells is challenging mainly because they are transparent, i.e., weakly scattering structures. Therefore, this type of imaging has been implemented largely using fluorescence techniques. While confocal fluorescence imaging is a common approach to achieve sectioning, it requires fluorescence probes that are often harmful to the living specimen. On the other hand, by using the intrinsic contrast of the structures it is possible to study living cells in a non-invasive manner. One method that provides high-resolution quantitative information about nanoscale structures is a broadband interferometric technique known as Spatial Light Interference Microscopy (SLIM). In addition to rendering quantitative phase information, when combined with a high numerical aperture objective, SLIM also provides excellent depth sectioning capabilities. However, like in all linear optical systems, SLIM's resolution is limited by diffraction. Here we present a novel 3D field deconvolution algorithm that exploits the sparsity of phase images and renders images with resolution beyond the diffraction limit. We employ this label-free method, called deconvolution Spatial Light Interference Tomography (dSLIT), to visualize coiled sub-cellular structures in E. coli cells which are most likely the cytoskeletal MreB protein and the division site regulating MinCDE proteins. Previously these structures have only been observed using specialized strains and plasmids and fluorescence techniques. Our results indicate that dSLIT can be employed to study such structures in a practical and non-invasive manner.     

An image processing system for digital chest X-ray images

This paper investigates the requirements for image processing of digital chest X-ray images. These images are conventionally recorded on film and are characterised by large size, wide dynamic range and high resolution. X-ray detection systems are now becoming available for capturing these images directly in photoelectronic-digital form. In this report, the hardware and software facilities required for handling these images are described. These facilities include high resolution digital image displays, programmable video look up tables, image stores for image capture and processing and a full range of software tools for image manipulation. Examples are given of the application of digital image processing techniques to this class of image.     

Use of frozen-hydrated axonemes to assess imaging parameters and resolution limits in cryoelectron tomography

Using a 400-kV cryoelectron microscope, we have obtained tomographic reconstructions of frozen-hydrated sea urchin axonemes with 8-10-nm resolution, as assessed by detection of characteristic components including doublet microtubules, radial spokes, central sheath projections, and outer dynein arms. We did not detect the inner dynein arms or the microtubule lattice. The 1/(8 nm) and 1/(16 nm) layer lines are consistently present in power spectra of both projection images and tomographic reconstructions. Strength and detection of the layer lines are dependent upon total electron dose and defocus. Both layer lines are surprisingly resistant to electron doses of up to 11000 electrons/nm(2). We present a summary of resolution considerations in cryoelectron tomography and conclude that the fundamental limitation is the total electron dose required for statistical significance. The electron dose can be fractionated among the numerous angular views in a tomographic data set, but there is an unavoidable fourth-power dependence of total dose on target resolution. Since higher-resolution features are more beam-sensitive, this dose requirement places an ultimate limit on the resolution of individual tomographic reconstructions. Instrumental and computational strategies to circumvent this limitation are discussed.     

Computational challenges of tumor spheroid modeling

The speed and the versatility of today's computers open up new opportunities to simulate complex biological systems. Here we review a computational approach recently proposed by us to model large tumor cell populations and spheroids, and we put forward general considerations that apply to any fine-grained numerical model of tumors. We discuss ways to bypass computational limitations and discuss our incremental approach, where each step is validated by experimental observations on a quantitative basis. We present a few results on the growth of tumor cells in closed and open environments and of tumor spheroids. This study suggests new ways to explore the initial growth phase of solid tumors and to optimize antitumor treatments.     

An image processing system for digital chest X-ray images

This paper investigates the requirements for image processing of digital chest X-ray images. These images are conventionally recorded on film and are characterised by large size, wide dynamic range and high resolution. X-ray detection systems are now becoming available for capturing these images directly in photoelectronic-digital form. In this report, the hardware and software facilities required for handling these images are described. These facilities include high resolution digital image displays, programmable video look up tables, image stores for image capture and processing and a full range of software tools for image manipulation. Examples are given of the application of digital image processing techniques to this class of image.     

Solution structure of the loops of bacteriorhodopsin closely resembles the crystal structure

Bacteriorhodopsin is one of very few transmembrane proteins for which high resolution structures have been solved. The structure shows a bundle of seven helices connected by six turns. Some turns in proteins are stabilized by short range interactions and can behave as small domains. These observations suggest that peptides containing the sequence of the turns in a membrane protein such as bacteriorhodopsin may form stable turn structures in solution. To test this hypothesis, we determined the solution structure of three peptides each containing the sequence of one of the turns in bacteriorhodopsin. The solution structures of the peptides closely resemble the structures of the corresponding turns in the high resolution structures of the intact protein.