Portable telepathology: methods and tools

Telepathology is becoming easier to implement in most pathology departments. In fact e-mail image transmit can be done from almost any pathologist as a simplistic telepathology system. We tried to develop a way to improve capabilities of communication among pathologists with the idea that the system should be affordable for everybody. We took the premise that any pathology department would have microscopes and computers with Internet connection, and selected a few elements to convert them into a telepathology station. Needs were reduced to a camera to collect images, a universal microscope adapter for the camera, a device to connect the camera to the computer, and a software for the remote image transmit. We found out a microscope adapter (MaxView Plus) that allowed us connect almost any domestic digital camera to any microscope. The video out signal from the camera was sent to the computer through an Aver Media USB connector. At last, we selected a group of portable applications that were assembled into a USB memory device. Portable applications are computer programs that can be carried generally on USB flash drives, but also in any other portable device, and used on any (Windows) computer without installation. Besides, when unplugging the device, none of personal data is left behind. We selected open-source applications, and based the pathology image transmission to VLC Media Player due to its functionality as streaming server, portability and ease of use and configuration. Audio transmission was usually done through normal phone lines. We also employed alternative videoconferencing software, SightSpeed for bi-directional image transmission from microscopes, and conventional cameras allowing visual communication and also image transmit from gross pathology specimens. All these elements allowed us to install and use a telepathology system in a few minutes, fully prepared for real time image broadcast.     

Combined confocal and wide-field high-resolution cytometry of fluorescent in situ hybridization-stained cells

BACKGROUND: The recently developed technique of high-resolution cytometry (HRCM) enables automated acquisition and analysis of fluorescent in situ hybridization (FISH)-stained cell nuclei using conventional wide-field fluorescence microscopy. The method has now been extended to confocal imaging and offers the opportunity to combine the advantages of confocal and wide-field modes. METHODS: We have automated image acquisition and analysis from a standard inverted fluorescence microscope equipped with a confocal module with Nipkow disk and a cooled digital CCD camera. The system is fully controlled by a high-performance computer that performs both acquisition and related on-line image analysis. The system can be used either for an automatic two (2D) and three-dimensional (3D) analysis of FISH- stained interphase nuclei or for a semiautomatic 3D analysis of FISH-stained cells in tissues. The user can select which fluorochromes are acquired using wide-field mode and which using confocal mode. The wide-field and confocal images are overlaid automatically in computer memory. The developed software compensates automatically for both chromatic color shifts and spatial shifts caused by switching to a different imaging mode. RESULTS: Using the combined confocal and wide-field HRCM technique, it is possible to take advantage of both imaging modes. Images of some dyes (such as small hybridization dots or counterstain images of individual interphase nuclei) do not require confocal quality and can be acquired quickly in wide-field mode. On the contrary, images of other dyes (such as chromosome territories or counterstain images of cells in tissues) do require improved quality and are acquired in confocal mode. The dual-mode approach is two to three times faster compared with the single-mode confocal approach and the spectrum of its applications is much broader compared with both single-mode confocal and single-mode wide-field systems. CONCLUSIONS: The combination of high speed specific to the wide-field mode and high quality specific to the confocal mode gives optimal system performance.     

Multiphase method for automatic alignment of transmission electron microscope images using markers

In order to successfully perform the 3D reconstruction in electron tomography, transmission electron microscope images must be accurately aligned or registered. So far, the problem is solved by either manually showing the corresponding fiducial markers from the set of images or automatically using simple correlation between the images on several rotations and scales. The present solutions, however, share the problem of being inefficient and/or inaccurate. We therefore propose a method in which the registration is automated using conventional colloidal gold particles as reference markers between images. We approach the problem from the computer vision viewpoint; hence, the alignment problem is divided into several subproblems: (1) finding initial matches from successive images, (2) estimating the epipolar geometry between consecutive images, (3) finding and localizing the gold particles with subpixel accuracy in each image, (4) predicting the probable matching gold particles using the epipolar constraint and its uncertainty, (5) matching and tracking the gold beads through the tilt series, and (6) optimizing the transformation parameters for the whole image set. The results show not only the reliability of the suggested method but also a high level of accuracy in alignment, since practically all the visible gold markers can be used.     

Confocal microscopy: a tool to visualise differentiation of stem cells into cardiomyocytes

Confocal microscopy offers important advantages compared to conventional epifluorescence microscopy. It works as an "optical microtome" leading to a accurate image resolution of a defined focal plane. Furthermore, the addition of a Nipkow disk on the confocal microscope greatly accelerates the image acquisition, up to 30 frames per second. Nevertheless, the software-assisted mathematical restoration of images acquired using a wide-field microscope allows to get images with a resolution similar to the one obtained in confocal microscopy. These imaging technologies allowed us to monitor on line cardiac differentiation of murine embryonic stem (ES) cells within 3D structures called embryoid bodies. The high rate acquisition of images using the confocal microscope equipped with a Nipkow disk allows to monitor calcium spiking in differentiating cardiomyocytes within embryoid bodies.     

Three-dimensional localization of ultrasmall immuno-gold labels by HAADF-STEM tomography

The localization of scarce antigens in thin sections of biological material can be accomplished by pre-embedment labeling with ultrasmall immuno-gold labels. Moreover, with this method, labeling is not restricted to the section surface but occurs throughout the section volume. Thus, when combined with electron tomography, antigens can be localized in three dimensions in relation to the 3D (three-dimensional) ultrastructure of the cell. However, for visualization in a transmission electron microscope, these labels need to be enlarged by silver or gold enhancement. The increase in particle size reduces the resolution of the antigen detection and the large particles obscure ultrastructural details in the tomogram. In this paper we show for the first time that these problems can be avoided and that ultrasmall gold labels can be localized in three dimensions without the need for gold or silver enhancement by using HAADF-STEM (high angular annular dark-field-scanning transmission electron microscopy) tomography. This method allowed us to three-dimensionally localize Aurion ultrasmall goat anti-rabbit immuno-gold labels on sections of Epon-embedded, osmium-uranium-lead-stained biological material. Calculations show that a 3D reconstruction obtained from HAADF-STEM projection images can be spatially aligned to one obtained from transmission electron microscopy (TEM) projections with subpixel accuracy. We conclude that it is possible to combine the high-fidelity structural information of TEM tomograms with the ultrasmall label localization ability of HAADF-STEM tomograms.     

Interactions between protein-gold complexes and cell surfaces: a method for precise quantitation

We have developed a rapid and precise electron microscope technique for the quantitation of gold particles in suspension using latex microspheres as a reference (EM latex technique). This technique allowed us to determine the specific absorption of colloidal gold at its absorption maximum (520 nm) and the average number of ligands ([125I]IgG) bound to one gold particle. On the basis of these values important binding characteristics of protein-gold complexes to cell surfaces were analyzed in a model system consisting of Staphylococcus aureus with protein A on the cell wall as a specific binding site for IgG-Au. Our observations showed that the number of binding sites represented by one IgG-gold complex depended primarily on the particle size, with one 20-nm IgG-Au corresponding to 15 and one 6-nm IgG-Au to 2.5 binding sites. Hence, the efficiency of binding of IgG-Au complexes increased with decreasing gold particle size. Saturation of binding sites, however, was not achieved. The technique also made possible the determination of the affinity between IgG-Au complexes and the cell surface; this affinity can either be regarded as a characteristic of the ligand IgG or of the gold particle. We observed that the affinity of IgG decreased with the size of the gold particles to which IgG was bound, whereas the affinity of the entire gold particle increased with particle size. The EM latex technique for quantitation of gold particles extends the general use of protein-gold complexes to the quantitative characterization of their interaction with cell surface constituents.     

图像反卷积复原技术在玉米45S rDNA转录图式研究中的运用

由于成像焦平面外杂光的干扰,宽场荧光显微镜所得的图像往往较模糊,使其不适合用来观察植物细胞核内的精细结构。该实验讨论了反卷积软件中对图像复原结果有较大影响的几个重要参数的设置。经过合适的图像反卷积复原,由宽场荧光显微镜获取的玉米45S rRNA原位杂交信号图像得以清楚显示。对所得杂交图像的分析表明:玉米45S rDNA转录往往先发生在核仁外围,且随着核仁转录活性的提高逐渐向核仁内部扩散,并最终与5S rRNA一起,在核仁内部的空洞结构中形成成熟rRNA。研究结果显示,反卷积复原可有效提高宽场荧光显微镜所得二维图像的分辨率,从而使宽场荧光显微镜在植物细胞核内精细结构研究中发挥更多的作用。     

Assessing technician effects when extracting quantities from microscope images

Consider an experiment where the response is based on an image; e.g., an image captured to a computer file by a digital camera mounted on a microscope. Suppose relevant quantitative measures are extracted from the images so that results can be analyzed by conventional statistical methods. The steps involved in extracting the measures may require that the technicians, who are processing the images, perform some subjective manipulations. In this case, it is important to determine the bias and variability, if any, attributable to the technicians' decisions. This paper describes the experimental design and statistical analyses that are useful for those determinations. The design and analysis are illustrated by application to two biofilm research projects that involved quantitative image analysis. In one investigation, the technician was required to choose a threshold level, then the image analysis program automatically extracted relevant measures from the resulting black and white image. In the other investigation, the technician was required to choose fiducial points in each of two images collected on different microscopes; then the image analysis program registered the images by stretching, rotating, and overlaying them, so that their quantitative features could be correlated. These investigations elucidated the effects of the technicians' decisions, thereby helping us to assess properly the statistical uncertainties in the conclusions for the primary experiments.     

Mapping gold-labeled IgE receptors on mast cells by scanning electron microscopy: receptor distributions revealed by silver enhancement, backscattered electron imaging, and digital image analysis

Immunogold labeling and silver enhancement techniques are widely used to determine density and distribution of cell membrane receptors by light and transmission electron microscopy. However, these techniques have not been widely used for receptor detection by scanning electron microscopy. We used antigen- or protein A-conjugated colloidal gold particles, together with silver enhancement, sequential secondary and back-scattered electron imaging (SEI and BEI), and digital image processing, to explore cell surface distribution of IgE-receptor complexes on RBL-2H3 cells, a rat leukemia line that provides a model for the study of mucosal mast cells. Cells were first incubated with a monoclonal antidinitrophenol IgE (anti-DNP-IgE) that binds with high affinity to cell surface IgE receptors. The resulting IgE-receptor complexes were cross-linked either with the multivalent antigen, DNP-BSA-gold, or with a polyclonal anti-IgE antibody. Antibody-treated cells were labeled after fixation with protein A-gold. Fixed, gold-labeled cell monolayers were silver enhanced (or not), dehydrated, critical point-dried, and coated with gold-palladium (for SEI analysis) or carbon (for combined SEI/BEI analysis). They were observed in an Hitachi S800 SEM equipped with a field emission tip and a Robinson backscattered electron detector. An image processor (MegaVision 1024XM) digitized images directly from the S800 microscope at 500-1000 line resolution. Silver enhancement significantly improves detection of gold particles in both SEI and BEI modes of SEM. On gold-palladium-coated samples, 20-nm particles are resolved by SEI after enhancement. BEI resolves 15-nm particles without enhancement and 5- or 10-nm particles are resolved by BEI on silver-enhanced, carbon-coated samples. Neither BEI nor SEI alone can yield high resolution topographical maps of receptor distribution (BEI forms images on the basis of atomic number contrast which reveals gold but not surface features). Image analysis techniques were therefore introduced to digitize, enhance, and process BEI and SEI images of the same field of view. The resulting high-contrast, high-resolution images were superimposed, yielding well-resolved maps of the distribution of antigen-IgE-receptor complexes on the surface of RBL-2H3 mast cells. The maps are stored in digital form, as required for computer-based quantitative morphometric analyses. These techniques of silver enhancement, combined BEI/SEI imaging, and digital image analysis can be applied to analyze density and distribution of any gold-labeled ligand on its target cell.     

High-speed multicolor microscopy of repeating dynamic processes

Images of multiply labeled fluorescent samples provide unique insights into the localization of molecules, cells, and tissues. The ability to image multiple channels simultaneously at high speed without cross talk is limited to a few colors and requires dedicated multichannel or multispectral detection procedures. Simpler microscopes, in which each color is imaged sequentially, produce a much lower frame rate. Here, we describe a technique to image, at high frame rate, multiply labeled samples that have a repeating motion. We capture images in a single channel at a time over one full occurrence of the motion then repeat acquisition for other channels over subsequent occurrences. We finally build a high-speed multichannel image sequence by combining the images after applying a normalized mutual information-based time registration procedure. We show that this technique is amenable to image the beating heart of a double-labeled embryonic quail in three channels (brightfield, yellow, and mCherry fluorescent proteins) using a fluorescence wide-field microscope equipped with a single monochrome camera and without fast channel switching optics. We experimentally evaluate the accuracy of our method on image series from a two-channel confocal microscope.     

TYSON: robust searching, sorting, and selecting of single particles in electron micrographs

We here present TYSON, a new program for automatic and semi-automatic particle selection from electron micrographs. TYSON employs a three-step strategy of searching, sorting and selecting single particles. In the first step, TYSON finds the positions of potential particles by one of three different methods: local averaging, template matching or local variance. The practical merits and drawbacks of these methods are discussed. In the second step, these potential particles are automatically sorted according to their probability of being true positives. Many criteria are provided for this sort. In the final -interactive- step, whole categories of poorly fitting false positives can be removed with a single mouse-click. We present results obtained using cryo-EM micrographs of both spherical virus particles and asymmetric particles. The procedures are fast and use of TYSON allowed, for example, some 20,000 particles to be selected in a single working day.     

Assessing the capabilities of a 4kx4k CCD camera for electron cryo-microscopy at 300kV

CCD cameras have numerous advantages over photographic film for detecting electrons; however the point spread function of these cameras has not been sufficient for single particle data collection to subnanometer resolution with 300kV microscopes. We have adopted spectral signal to noise ratio (SNR) as a parameter for assessing detector quality for single particle imaging. The robustness of this parameter is confirmed under a variety of experimental conditions. Using this parameter, we demonstrate that the SNR of images of either amorphous carbon film or ice embedded virus particles collected on a new commercially available 4kx4k CCD camera are slightly better than photographic film at low spatial frequency (<1/5 Nyquist frequency), and as good as photographic film out to half of the Nyquist frequency. In addition it is slightly easier to visualize ice embedded particles on this CCD camera than on photographic film. Based on this analysis it is realistic to collect images containing subnanometer resolution data (6-9A) using this CCD camera at an effective magnification of approximately 112000x on a 300kV electron microscope.     

Markov random field based automatic image alignment for electron tomography

We present a method for automatic full-precision alignment of the images in a tomographic tilt series. Full-precision automatic alignment of cryo electron microscopy images has remained a difficult challenge to date, due to the limited electron dose and low image contrast. These facts lead to poor signal to noise ratio (SNR) in the images, which causes automatic feature trackers to generate errors, even with high contrast gold particles as fiducial features. To enable fully automatic alignment for full-precision reconstructions, we frame the problem probabilistically as finding the most likely particle tracks given a set of noisy images, using contextual information to make the solution more robust to the noise in each image. To solve this maximum likelihood problem, we use Markov Random Fields (MRF) to establish the correspondence of features in alignment and robust optimization for projection model estimation. The resulting algorithm, called Robust Alignment and Projection Estimation for Tomographic Reconstruction, or RAPTOR, has not needed any manual intervention for the difficult datasets we have tried, and has provided sub-pixel alignment that is as good as the manual approach by an expert user. We are able to automatically map complete and partial marker trajectories and thus obtain highly accurate image alignment. Our method has been applied to challenging cryo electron tomographic datasets with low SNR from intact bacterial cells, as well as several plastic section and X-ray datasets.     

Interactive, computer-assisted tracking of speckle trajectories in fluorescence microscopy: application to actin polymerization and membrane fusion

Analysis of particle trajectories in images obtained by fluorescence microscopy reveals biophysical properties such as diffusion coefficient or rates of association and dissociation. Particle tracking and lifetime measurement is often limited by noise, large mobilities, image inhomogeneities, and path crossings. We present Speckle TrackerJ, a tool that addresses some of these challenges using computer-assisted techniques for finding positions and tracking particles in different situations. A dynamic user interface assists in the creation, editing, and refining of particle tracks. The following are results from application of this program: 1), Tracking single molecule diffusion in simulated images. The shape of the diffusing marker on the image changes from speckle to cloud, depending on the relationship of the diffusion coefficient to the camera exposure time. We use these images to illustrate the range of diffusion coefficients that can be measured. 2), We used the program to measure the diffusion coefficient of capping proteins in the lamellipodium. We found values ∼0.5 μm²/s, suggesting capping protein association with protein complexes or the membrane. 3), We demonstrate efficient measuring of appearance and disappearance of EGFP-actin speckles within the lamellipodium of motile cells that indicate actin monomer incorporation into the actin filament network. 4), We marked appearance and disappearance events of fluorescently labeled vesicles to supported lipid bilayers and tracked single lipids from the fused vesicle on the bilayer. This is the first time, to our knowledge, that vesicle fusion has been detected with single molecule sensitivity and the program allowed us to perform a quantitative analysis. 5), By discriminating between undocking and fusion events, dwell times for vesicle fusion after vesicle docking to membranes can be measured.     

CELL SURFACE LOCALIZATION OF THE 60 kDa HEAT SHOCK CHAPERONIN PROTEIN (hsp60) IN MAMMALIAN CELLS

To investigate whether the 60-kDa heat shock chaperonin protein (hsp60) is present on the surface of mammalian cells, we used immunogold labeling of intact cells and backscattered electron imaging to image gold particles. Chinese hamster ovary cells and the human leukemic CD4-positive T-cell line CEM-SS on glass coverslips were labeled using affinity-purified monoclonal and polyclonal antibodies specific for hsp60 and 30 nm gold markers. Cells were imaged using the scanning mode of the conventional transmission electron microscope. Backscattered electron imaging provided definitive identification of the gold markers while secondary electron imaging gave information on surface architecture. Labeling intensity was 250–800 gold particles per cell in Chinese hamster ovary cells and 600–2000 in CEM-SS human lymphoblasts. The finding of hsp60 on the cell surface of mammalian cells may signify chaperone involvement in surface functions.     

Three-dimensional image of tubulin in zinc-induced sheets, reconstructed from electron micrographs

A three-dimensional image of zinc-induced brain tubulin sheets has been reconstructed by computer from digitized electron microscope images of negatively stained specimens. Different views of the sheets were obtained by tilting the specimens in the microscope and also by sectioning normal to the plane of the sheets. The overall resolution of the data is about 2 nm. The features of the resulting three-dimensional model suggest an explanation for the somewhat variable appearance of tubulin subunits in electron microscope images of negatively stained intact and opened-out microtubules.     

Casein accumulation in distended rough endoplasmic reticulum of collagen gel-cultivated mouse mammary epithelia

Mouse mammary epithelial cells cultivated on collagen gels synthesize and secrete casein in a hormone-dependent manner. Fine-structure electron microscopy of secretory cultures revealed numerous cytoplasmic structures surrounded by membrane that is studded with ribosomes. The structures appear to be distended rough endoplasmic reticulum (RER). Electron microscope protein A-colloidal gold immunolocalization showed casein antiserum-specific deposition of gold particles over the RER cytoplasmic vesicles in cells provided insulin, prolactin, and hydrocortisone (IPF). Nonimmune antiserum showed no gold particle deposition over these cytoplasmic structures. Epithelia provided only insulin showed no such cytoplasmic vesicles nor any specific deposition of gold particles. Immunoblot analysis of cell lysate and culture medium showed casein only in IPF-treated cultures. It appears that the casein secretory pathway in collagen gel cultured mammary epithelia is blocked at the step that fuses RER vesicles to Golgi membrane. The data raise questions regarding the processing and maturation of casein and the mechanism of casein secretion in these cultures.