An accurate and effective FMM-based approach for freehand 3D ultrasound reconstruction

Freehand three-dimensional ultrasound imaging is a highly attractive research area because it is capable of volumetric visualization and analysis of tissues and organs. The reconstruction algorithm plays a key role to the construction of three-dimensional ultrasound volume data with higher image quality and faster reconstruction speed. However, a systematic approach to such problem is still missing. A new fast marching method (FMM) for three-dimensional ultrasound volume reconstruction using the tracked and hand-held probe is proposed in this paper. Our reconstruction approach consists of two stages: bin-filling stage and hole-filling stage. Each pixel in the B-scan images is traversed and its intensity value is assigned to its nearest voxel in the bin-filling stage. For the efficient and accurate reconstruction, we present a new hole-filling algorithm based on the fast marching method. Our algorithm advances the interpolation boundary along its normal direction and fills the area closest to known voxel points in first, which ensure that the structural details of image can be preserved. Experimental results on both ultrasonic abdominal phantom and in vivo urinary bladder of human subject and comparisons with some popular algorithms are used to demonstrate its improvement in both reconstruction accuracy and efficiency.     

Correlation of topographic surface and volume data from three-dimensional electron microscopy

Three-dimensional(3D) reconstructions from tilt series in an electron microscope show in general an anisotropic resolution due to an instrumentally limited tilt angle. As a consequence, the information in the z direction is blurred, thus making it difficult to detect the boundary of the reconstructed structures. In contrast, high-resolution topography data from microscopic surface techniques provide exactly complementary information. The combination of topographic surface and volume data leads to a better understanding of the 3D structure. The new correlation procedure presented determines both the height scaling of the topographic surface and the relative position of surface and volume data, thus allowing information to be combined. Experimental data for crystalline T4 bacteriophage polyheads were used to test the new method. Three-dimensional volume data were reconstructed from a negatively stained tilt series. Topographic data for both surfaces were obtained by surface relief reconstruction of electron micrographs of freeze-dried and unidirectionally metal-shadowed polyheads. The combined visualization of volume data with the scaled and aligned surface data shows that the correlation technique yields meaningful results. The reported correlation method may be applied to surface data obtained by any microscopic technique yielding topographic data.     

Three-dimensional velocity field reconstruction

The problem of inter-slice magnetic resonance (MR) image reconstruction is encountered often in medical imaging applications, in such scenarios, there is a need to approximate information not captured in contiguously acquired MR images due to hardware sampling limitations. In the context of velocity field reconstruction, these data are required for visualization and computational analyses of flow fields to be effective. To provide more complete velocity information, a method has been developed for the reconstruction of flow fields based on adaptive control grid interpolation (ACGI). In this study, data for reconstruction were acquired via MRJ from in vitro models of surgically corrected pediatric cardiac vasculatures. Reconstructed velocity fields showed strong qualitative agreement with those obtained via other acquisition techniques. Quantitatively reconstruction was shown to produce data of comparable quality to accepted velocity data acquisition methods. Results indicate that ACGI-based velocity field reconstruction is capable of producing information suitable for a variety of applications demanding three-dimensional in vivo velocity data.     

UCSF tomography: an integrated software suite for real-time electron microscopic tomographic data collection, alignment, and reconstruction

A real-time alignment and reconstruction scheme for electron microscopic tomography (EMT) has been developed and integrated within our UCSF tomography data collection software. This newly integrated software suite provides full automation from data collection to real-time reconstruction by which the three-dimensional (3D) reconstructed volume is immediately made available at the end of each data collection. Real-time reconstruction is achieved by calculating a weighted back-projection on a small Linux cluster (five dual-processor compute nodes) concurrently with the UCSF tomography data collection running on the microscope's computer, and using the fiducial-marker free alignment data generated during the data collection process. The real-time reconstructed 3D volume provides users with immediate feedback to fully asses all aspects of the experiment ranging from sample choice, ice thickness, experimental parameters to the quality of specimen preparation. This information can be used to guide subsequent data collections. Access to the reconstruction is especially useful in low-dose cryo EMT where such information is very difficult to obtain due to extraordinary low signal to noise ratio in each 2D image. In our environment, we generally collect 2048 x 2048 pixel images which are subsequently computationally binned four-fold for the on-line reconstruction. Based upon experiments performed with thick and cryo specimens at various CCD magnifications (50000x-80000x), alignment accuracy is sufficient to support this reduced resolution but should be refined before calculating a full resolution reconstruction. The reduced resolution has proven to be quite adequate to assess sample quality, or to screen for the best data set for full-resolution reconstruction, significantly improving both productivity and efficiency of system resources. The total time from start of data collection to a final reconstructed volume (512 x 512 x 256 pixels) is about 50 min for a +/-70 degrees 2k x 2k pixel tilt series acquired at every 1 degrees.     

共聚焦图像数据的三维重建和显示

本文介绍利用激光扫描共聚焦显微镜获得的共聚焦图像的三维重建和显示方法,并以ＡＣＡＳ Ｕｌｔｉｎａ３１２激光扫描共聚焦显微镜系统为例,分析了ＳＰＦ算法、投影算法和深度阴影算法等共聚焦图像数据的三维重建和图像显示方法的特点。     

Noise Reduction in Electron Tomographic Reconstructions Using Nonlinear Anisotropic Diffusion

Electron tomography is a powerful technique capable of giving unique insights into the three-dimensional structural organization of pleomorphic biological objects. However, visualization and interpretation of the resulting volumetric data are hampered by an extremely low signal-to-noise ratio, especially when ice-embedded biological specimens are investigated. Usually, isosurface representation or volume rendering of such data is hindered without any further signal enhancement. We propose a novel technique for noise reduction based on nonlinear anisotropic diffusion. The approach combines efficient noise reduction with excellent signal preservation and is clearly superior to conventional methods (e.g., low-pass and median filtering) and invariant wavelet transform filtering. The gain in the signal-to-noise ratio is verified and demonstrated by means of Fourier shell correlation. Improved visualization performance after processing the 3D images is demonstrated with two examples, tomographic reconstructions of chromatin and of a mitochondrion. Parameter settings and discretization stencils are presented in detail.     

MedicCyc: a biochemical pathway database for Medicago truncatula

MOTIVATION: There is an imperative need to integrate functional genomics data to obtain a more comprehensive systems-biology view of the results. We believe that this is best achieved through the visualization of data within the biological context of metabolic pathways. Accordingly, metabolic pathway reconstruction was used to predict the metabolic composition for Medicago truncatula and these pathways were engineered to enable the correlated visualization of integrated functional genomics data. Results: Metabolic pathway reconstruction was used to generate a pathway database for M. truncatula (MedicCyc), which currently features more than 250 pathways with related genes, enzymes and metabolites. MedicCyc was assembled from more than 225,000 M. truncatula ESTs (MtGI Release 8.0) and available genomic sequences using the Pathway Tools software and the MetaCyc database. The predicted pathways in MedicCyc were verified through comparison with other plant databases such as AraCyc and RiceCyc. The comparison with other plant databases provided crucial information concerning enzymes still missing from the ongoing, but currently incomplete M. truncatula genome sequencing project. MedicCyc was further manually curated to remove non-plant pathways, and Medicago-specific pathways including isoflavonoid, lignin and triterpene saponin biosynthesis were modified or added based upon available literature and in-house expertise. Additional metabolites identified in metabolic profiling experiments were also used for pathway predictions. Once the metabolic reconstruction was completed, MedicCyc was engineered to visualize M. truncatula functional genomics datasets within the biological context of metabolic pathways. Availability: freely accessible at http://www.noble.org/MedicCyc/     

Visualization of macromolecular complexes using cryo-electron microscopy with FEI Tecnai transmission electron microscopes

This protocol details the steps used for visualizing the frozen-hydrated grids as prepared following the accompanying protocol entitled 'Preparation of macromolecular complexes for visualization using cryo-electron microscopy.' This protocol describes how to transfer the grid to the microscope using a standard cryo-transfer holder or, alternatively, using a cryo-cartridge loading system, and how to collect low-dose data using an FEI Tecnai transmission electron microscope. This protocol also summarizes and compares the various options that are available in data collection for three-dimensional (3D) single-particle reconstruction. These options include microscope settings, choice of detectors and data collection strategies both in situations where a 3D reference is available and in the absence of such a reference (random-conical and common lines).     

Visualizing the 3D architecture of multiple erythrocytes infected with Plasmodium at nanoscale by focused ion beam-scanning electron microscopy

Different methods for three-dimensional visualization of biological structures have been developed and extensively applied by different research groups. In the field of electron microscopy, a new technique that has emerged is the use of a focused ion beam and scanning electron microscopy for 3D reconstruction at nanoscale resolution. The higher extent of volume that can be reconstructed with this instrument represent one of the main benefits of this technique, which can provide statistically relevant 3D morphometrical data. As the life cycle of Plasmodium species is a process that involves several structurally complex developmental stages that are responsible for a series of modifications in the erythrocyte surface and cytoplasm, a high number of features within the parasites and the host cells has to be sampled for the correct interpretation of their 3D organization. Here, we used FIB-SEM to visualize the 3D architecture of multiple erythrocytes infected with Plasmodium chabaudi and analyzed their morphometrical parameters in a 3D space. We analyzed and quantified alterations on the host cells, such as the variety of shapes and sizes of their membrane profiles and parasite internal structures such as a polymorphic organization of hemoglobin-filled tubules. The results show the complex 3D organization of Plasmodium and infected erythrocyte, and demonstrate the contribution of FIB-SEM for the obtainment of statistical data for an accurate interpretation of complex biological structures.     

基于VTK的医学图像三维可视化系统

医学图像的三维可视化可以通过可视化工具包（VTK）提供的API实现。VTK是医学图像可视化的开法工具包,它把可视化的算法封装起来,利用简单的代码生成所需图形。基于VTK的医学图像三维可视化系统阐述了如何借助VTKAPI读入二维医学图像序列、操作二维图像、重建三维图像以及进行三维图像可视化的全套方案,为临床医生的诊断、治疗提供了有益的途径。     

Laser-scanning microscopy as applied to mouse early embryos: Cytometry and analysis of cell morphology

This paper updates our knowledge on quantitative laser scanning microscopy and summarizes the capabilities of this method as applied to cytometry and analysis of cell structure of the mouse early embryo and the oocyte. This method requires a stack of optical sections obtained as Z-series with subsequent 3D reconstruction. This approach was used for visualization of the 3D cell model, measurement of the cell volume and surface area, as well as a study of the cell interior via optical sections. To maintain the dimensional characteristics of embryos or oocytes the method of sample preparation involved the following consequent steps: rapid cryofixation, low-temperature dehydration, infiltration by optically transparent mounting media, and laser-scanning microscopy. This strategy enables volume measurement, even in the case of a single cell within the multicellular system of the mouse early embryo.     

Denoising of Electron Tomographic Reconstructions Using Multiscale Transformations

The visualization of volume maps obtained by electron tomographic reconstruction is severely hampered by noise. As electron tomography is usually applied to individual, nonrepeatable structures, e.g., cell sections or cell organelles, the noise cannot be removed by averaging as is done implicitly in electron crystallography or explicitly in single particle analysis. In this paper, an approach for noise reduction is presented, based on a multiscale transformation, e.g., the wavelet transformation, in conjunction with a nonlinear filtration of the transform coefficients. After a brief introduction to the theoretical background, the effect of this type of noise reduction is demonstrated by test calculations as well as by applications to tomographic reconstructions of ice-embedded specimens. Regarding noise reduction and structure preservation, the method turns out to be superior to conventional filter techniques, such as the median filter or the Wiener filter. Results obtained with the use of different types of multiscale transformations are compared and the choice of suitable filter parameters is discussed.     

基于VTK和MFC的医学图像三维重建研究与实现

VTK是医学可视化领域的主流工具,MFC是Windows平台下的应用程序框架。尝试将两者进行结合编程,以实现二维医学图像的三维重建。实现医学图像三维重建的主要方法是面绘制和体绘制。将利用多组医学图像数据进行三维重建研究,其中面绘制用移动立方体法,体绘制用光线投射法、最大密度投影法和合成体绘制法实现。最后比较两种绘制技术的结果并讨论了它们的特点。结果表明,VTK作为一种图像处理和三维可视化工具其功能是十分强大的。     

Sparse/Low Rank Constrained Reconstruction for Dynamic PET Imaging

In dynamic Positron Emission Tomography (PET), an estimate of the radio activity concentration is obtained from a series of frames of sinogram data taken at ranging in duration from 10 seconds to minutes under some criteria. So far, all the well-known reconstruction algorithms require known data statistical properties. It limits the speed of data acquisition, besides, it is unable to afford the separated information about the structure and the variation of shape and rate of metabolism which play a major role in improving the visualization of contrast for some requirement of the diagnosing in application. This paper presents a novel low rank-based activity map reconstruction scheme from emission sinograms of dynamic PET, termed as SLCR representing Sparse/Low Rank Constrained Reconstruction for Dynamic PET Imaging. In this method, the stationary background is formulated as a low rank component while variations between successive frames are abstracted to the sparse. The resulting nuclear norm and l ₁ norm related minimization problem can also be efficiently solved by many recently developed numerical methods. In this paper, the linearized alternating direction method is applied. The effectiveness of the proposed scheme is illustrated on three data sets.     

The Next Decade of Big Data in Ecosystem Science

Ecosystem scientists will increasingly be called on to inform forecasts and define uncertainty about how changing planet conditions affect human well-being. We should be prepared to leverage the best tools available, including big data. Use of the term ‘big data’ implies an approach that includes capacity to aggregate, search, cross-reference, and mine large volumes of data to generate new understanding that can inform decision-making about emergent properties of complex systems. Although big-data approaches are not a panacea, there are large-scale environmental questions for which big data are well suited, even necessary. Ecosystems are complex biophysical systems that are not easily defined by any one data type, location, or time. Understanding complex ecosystem properties is data intensive along axes of volume (size of data), velocity (frequency of data), and variety (diversity of data types). Ecosystem scientists have employed impressive technology for generating high-frequency, large-volume data streams. Yet important challenges remain in both theoretical and infrastructural development to support visualization and analysis of large and diverse data. The way forward includes greater support for network science approaches, and for development of big-data infrastructure that includes capacity for visualization and analysis of integrated data products. Likewise, a new paradigm of cross-disciplinary training and professional evaluation is needed to increase the human capital to fully exploit big-data analytics in a way that is sustainable and adaptable to emerging disciplinary needs.     

Electron Tomography of Large, Multicomponent Biological Structures

Electron tomography is an extremely useful method for deriving three-dimensional structure from electron microscope images. The application of this technique to the reconstruction of large, complex structures such as mitochondria is described in conjunction with several tools for segmentation, measurement, classification, and visualization. In addition, the use of massively parallel computers to perform the tomographic reconstruction efficiently using R-weighted backprojection or iterative techniques is described.     

A multi-neighbor-joining approach for phylogenetic tree reconstruction and visualization

The computationally challenging problem of reconstructing the phylogeny of a set of contemporary data, such as DNA sequences or morphological attributes, was treated by an extended version of the neighbor-joining (NJ) algorithm. The original NJ algorithm provides a single-tree topology, after a cascade of greedy pairing decisions that tries to simultaneously optimize the minimum evolution and the least squares criteria. Given that some sub-trees are more stable than others, and that the minimum evolution tree may not be achieved by the original NJ algorithm, we propose a multi-neighbor-joining (MNJ) algorithm capable of performing multiple pairing decisions at each level of the tree reconstruction, keeping various partial solutions along the recursive execution of the NJ algorithm. The main advantages of the new reconstruction procedure are: 1) as is the case for the original NJ algorithm, the MNJ algorithm is still a low-cost reconstruction method; 2) a further investigation of the alternative topologies may reveal stable and unstable sub-trees; 3) the chance of achieving the minimum evolution tree is greater; 4) tree topologies with very similar performances will be simultaneously presented at the output. When there are multiple unrooted tree topologies to be compared, a visualization tool is also proposed, using a radial layout to uniformly distribute the branches with the help of well-known metaheuristics used in computer science.     

A boundary delimitation algorithm to approximate cell soma volumes of bipolar cells from topographical data obtained by scanning probe microscopy

Background  

Cell volume determination plays a pivotal role in the investigation of the biophysical mechanisms underlying various cellular processes. Whereas light microscopy in principle enables one to obtain three dimensional data, the reconstruction of cell volume from z-stacks is a time consuming procedure. Thus, three dimensional topographic representations of cells are easier to obtain by scanning probe microscopical measurements.