Hyperspectral imaging: a novel approach for microscopic analysis

BACKGROUND: The usefulness of the light microscope has been dramatically enhanced by recent developments in hardware and software. However, current technologies lack the ability to capture and analyze a high-resolution image representing a broad diversity of spectral signatures in a single-pass view. We show that hyperspectral imaging offers such a technology. METHODS AND RESULTS We developed a prototype hyperspectral imaging microscope capable of collecting the complete emission spectrum from a microscope slide. A standard epifluorescence microscope was optically coupled to an imaging spectrograph, with output recorded by a CCD camera. Software was developed for image acquisition and computer display of resultant X--Y images with spectral information. Individual images were captured representing Y-wavelength planes, with the stage successively moved in the X direction, allowing an image cube to be constructed from the compilation of generated scan files. This prototype instrument was tested with samples relevant to cytogenetic, histologic, cell fusion, microarray scanning, and materials science applications. CONCLUSIONS: Hyperspectral imaging microscopy permits the capture and identification of different spectral signatures present in an optical field during a single-pass evaluation, including molecules with overlapping but distinct emission spectra. This instrument can reduce dependence on custom optical filters and, in future imaging applications, should facilitate the use of new fluorophores or the simultaneous use of similar fluorophores.     

Assessing the capabilities of a 4kx4k CCD camera for electron cryo-microscopy at 300kV

CCD cameras have numerous advantages over photographic film for detecting electrons; however the point spread function of these cameras has not been sufficient for single particle data collection to subnanometer resolution with 300kV microscopes. We have adopted spectral signal to noise ratio (SNR) as a parameter for assessing detector quality for single particle imaging. The robustness of this parameter is confirmed under a variety of experimental conditions. Using this parameter, we demonstrate that the SNR of images of either amorphous carbon film or ice embedded virus particles collected on a new commercially available 4kx4k CCD camera are slightly better than photographic film at low spatial frequency (<1/5 Nyquist frequency), and as good as photographic film out to half of the Nyquist frequency. In addition it is slightly easier to visualize ice embedded particles on this CCD camera than on photographic film. Based on this analysis it is realistic to collect images containing subnanometer resolution data (6-9A) using this CCD camera at an effective magnification of approximately 112000x on a 300kV electron microscope.     

Imaging technologies for the detection of multiple stains in proteomics

Laser-based scanners and charge-coupled device (CCD) camera systems are evolving to have greater functional capabilities for capturing images from a range of staining technologies used in gel electrophoresis and electroblotting. Digitizing Coomassie Brilliant Blue (CBB) stained gels and silver stained gels has now become possible using a laser-based gel scanner, the FLA-5000 fluorescent image analyzer system. Also, a simultaneous dual fluorescent imaging function has been incorporated into the FLA-5000 system, utilizing dichroic mirrors with both the optical system and the emission filter. In the workflow of routine proteomics research, the relationship between SYPRO dye staining and fluorescent detection using the FLA-5000 system have become symbiotic. Additionally in many cases, subsequent staining of the gel with CBB is useful for future research, and thus imaging instruments should be able to handle both staining formats. Digitizing the CBB stained gel can now be easily performed by the FLA-5000 fluorescent image analyzer system using a fluorescent board as an epi-illumination background. A cooled CCD camera system has the potential of imaging not only chemiluminescent membranes but also digitizing molecular weight markers and fluorescent detection of SYPRO dye-stained gels. With Multi Gauge software version 2.0 it is now a simple task to combine two images into one, as commonly required in dual detection experiments. The LAS-3000 system was designed to capture chemiluminescent images and to digitize the images automatically. Thus, new capabilities added to gel imaging systems make them capable of detecting and displaying multiple signals more conveniently.     

Practical performance evaluation of a 10k × 10k CCD for electron cryo-microscopy

Electron cryo-microscopy (cryo-EM) images are commonly collected using either charge-coupled devices (CCD) or photographic film. Both film and the current generation of 16 megapixel (4k × 4k) CCD cameras have yielded high-resolution structures. Yet, despite the many advantages of CCD cameras, more than two times as many structures of biological macromolecules have been published in recent years using photographic film. The continued preference to film, especially for subnanometer-resolution structures, may be partially influenced by the finer sampling and larger effective specimen imaging area offered by film. Large format digital cameras may finally allow them to overtake film as the preferred detector for cryo-EM. We have evaluated a 111-megapixel (10k × 10k) CCD camera with a 9 μm pixel size. The spectral signal-to-noise ratios of low dose images of carbon film indicate that this detector is capable of providing signal up to at least 2/5 Nyquist frequency potentially retrievable for 3D reconstructions of biological specimens, resulting in more than double the effective specimen imaging area of existing 4k × 4k CCD cameras. We verified our estimates using frozen-hydrated ε15 bacteriophage as a biological test specimen with previously determined structure, yielding a ～7 ? resolution single particle reconstruction from only 80 CCD frames. Finally, we explored the limits of current CCD technology by comparing the performance of this detector to various CCD cameras used for recording data yielding subnanometer resolution cryo-EM structures submitted to the electron microscopy data bank (http://www.emdatabank.org/).     

An instrument capable of imaging chlorophyll a fluorescence from intact leaves at very low irradiance and at cellular and subcellular levels of organization

An instrument capable of imaging chlorophyll a fluorescence, from intact leaves, and generating images of widely used fluorescence parameters is described. This instrument, which is based around a fluorescence microscope and a Peltier-cooled charge-coupled device (CCD) camera, differs from those described previously in two important ways. First, the instrument has a large dynamic range and is capable of generating images of chlorophyll a fluorescence at levels of incident irradiance as low as 0.1 μmol m^?2 s^?1. Secondly, chlorophyll fluorescence, and consequently photosynthetic performance, can be resolved down to the level of individual cells and chloroplasts. Control of the instrument, as well as image capture, manipulation, analysis and presentation, are executed through an integrated computer application, developed specifically for the task. Possible applications for this instrument include detection of early and differential responses to environmental stimuli, including various types of stress. Images illustrating the instrument's capabilities are presented.     

Advantages of CCD detectors for de novo three-dimensional structure determination in single-particle electron microscopy

For three-dimensional (3D) structure determination of large macromolecular complexes, single-particle electron cryomicroscopy is considered the method of choice. Within this field, structure determination de novo, as opposed to refinement of known structures, still presents a major challenge, especially for macromolecules without point-group symmetry. This is primarily because of technical issues: one of these is poor image contrast, and another is the often low particle concentration and sample heterogeneity imposed by the practical limits of biochemical purification. In this work, we tested a state-of-the art 4 k x 4 k charge-coupled device (CCD) detector (TVIPS TemCam-F415) to see whether or not it can contribute to improving the image features that are especially important for structure determination de novo. The present study is therefore focused on a comparison of film and CCD detector in the acquisition of images in the low-to-medium ( approximately 10-25 A) resolution range using a 200 kV electron microscope equipped with field emission gun. For comparison, biological specimens and radiation-insensitive carbon layers were imaged under various conditions to test the image phase transmission, spatial signal-to-noise ratio, visual image quality and power-spectral signal decay for the complete image-processing chain. At all settings of the camera, the phase transmission and spectral signal-to-noise ratio were significantly better on CCD than on film in the low-to-medium resolution range. Thus, the number of particle images needed for initial structure determination is reduced and the overall quality of the initial computed 3D models is improved. However, at high resolution, film is still significantly better than the CCD camera: without binning of the CCD camera and at a magnification of 70 kx, film is better beyond 21 A resolution. With 4-fold binning of the CCD camera and at very high magnification (> 300 kx) film is still superior beyond 7 A resolution.     

Temporally and spectrally resolved imaging microscopy of lanthanide chelates.

The combination of temporal and spectral resolution in fluorescence microscopy based on long-lived luminescent labels offers a dramatic increase in contrast and probe selectivity due to the suppression of scattered light and short-lived autofluorescence. We describe various configurations of a fluorescence microscope integrating spectral and microsecond temporal resolution with conventional digital imaging based on CCD cameras. The high-power, broad spectral distribution and microsecond time resolution provided by microsecond xenon flashlamps offers increased luminosity with recently developed fluorophores with lifetimes in the submicrosecond to microsecond range. On the detection side, a gated microchannel plate intensifier provides the required time resolution and amplification of the signal. Spectral resolution is achieved with a dual grating stigmatic spectrograph and has been applied to the analysis of luminescent markers of cytochemical specimens in situ and of very small volume elements in microchambers. The additional introduction of polarization optics enables the determination of emission polarization; this parameter reflects molecular orientation and rotational mobility and, consequently, the nature of the microenvironment. The dual spectral and temporal resolution modes of acquisition complemented by a posteriori image analysis gated on the spatial, spectral, and temporal dimensions lead to a very flexible and versatile tool. We have used a newly developed lanthanide chelate, Eu-DTPA-cs124, to demonstrate these capabilities. Such compounds are good labels for time-resolved imaging microscopy and for the estimation of molecular proximity in the microscope by fluorescence (luminescence) resonance energy transfer and of molecular rotation via fluorescence depolarization. We describe the spectral distribution, polarization states, and excited-state lifetimes of the lanthanide chelate crystals imaged in the microscope.     

Modular Scanning Confocal Microscope with Digital Image Processing

In conventional confocal microscopy, a physical pinhole is placed at the image plane prior to the detector to limit the observation volume. In this work, we present a modular design of a scanning confocal microscope which uses a CCD camera to replace the physical pinhole for materials science applications. Experimental scans were performed on a microscope resolution target, a semiconductor chip carrier, and a piece of etched silicon wafer. The data collected by the CCD were processed to yield images of the specimen. By selecting effective pixels in the recorded CCD images, a virtual pinhole is created. By analyzing the image moments of the imaging data, a lateral resolution enhancement is achieved by using a 20 × / NA = 0.4 microscope objective at 532 nm laser wavelength.     

Quantifying and Optimizing Single-Molecule Switching Nanoscopy at High Speeds

Single-molecule switching nanoscopy overcomes the diffraction limit of light by stochastically switching single fluorescent molecules on and off, and then localizing their positions individually. Recent advances in this technique have greatly accelerated the data acquisition speed and improved the temporal resolution of super-resolution imaging. However, it has not been quantified whether this speed increase comes at the cost of compromised image quality. The spatial and temporal resolution depends on many factors, among which laser intensity and camera speed are the two most critical parameters. Here we quantitatively compare the image quality achieved when imaging Alexa Fluor 647-immunolabeled microtubules over an extended range of laser intensities and camera speeds using three criteria – localization precision, density of localized molecules, and resolution of reconstructed images based on Fourier Ring Correlation. We found that, with optimized parameters, single-molecule switching nanoscopy at high speeds can achieve the same image quality as imaging at conventional speeds in a 5–25 times shorter time period. Furthermore, we measured the photoswitching kinetics of Alexa Fluor 647 from single-molecule experiments, and, based on this kinetic data, we developed algorithms to simulate single-molecule switching nanoscopy images. We used this software tool to demonstrate how laser intensity and camera speed affect the density of active fluorophores and influence the achievable resolution. Our study provides guidelines for choosing appropriate laser intensities for imaging Alexa Fluor 647 at different speeds and a quantification protocol for future evaluations of other probes and imaging parameters.     

Screening algal mutant colonies with altered thylakoid electrochemical gradient through fluorescence and delayed luminescence digital imaging

A digital imaging instrument intended to monitor fluorescence and delayed luminescence of algal colonies grown on Petri plates is described. The system includes light-emitting diodes, a cooled line transfer charge-coupled device (CCD) camera, and a personal computer. Software developments were made to capture pictures and kinetics in real time during illuminations. This instrument makes the fluorescence induction kinetics of individual colonies readily accessible with a good time resolution. It offers a great refinement for screening colonies deficient in photosynthetic electron transfer thanks to appropriate computed fluorescence images. The high sensitivity of the instrument allows it to capture fluorescence images under non-actinic illuminations, and for the first time, delayed luminescence images, opening thus the way to screening mutants that have altered thylakoid electrochemical gradients.     

Photothermal confocal spectromicroscopy of multiple cellular chromophores and fluorophores

Confocal fluorescence microscopy is a powerful biological tool providing high-resolution, three-dimensional (3D) imaging of fluorescent molecules. Many cellular components are weakly fluorescent, however, and thus their imaging requires additional labeling. As an alternative, label-free imaging can be performed by photothermal (PT) microscopy (PTM), based on nonradiative relaxation of absorbed energy into heat. Previously, little progress has been made in PT spectral identification of cellular chromophores at the 3D microscopic scale. Here, we introduce PTM integrating confocal thermal-lens scanning schematic, time-resolved detection, PT spectral identification, and nonlinear nanobubble-induced signal amplification with a tunable pulsed nanosecond laser. The capabilities of this confocal PTM were demonstrated for high-resolution 3D imaging and spectral identification of up to four chromophores and fluorophores in live cells and Caenorhabditis elegans. Examples include cytochrome c, green fluorescent protein, Mito-Tracker Red, Alexa-488, and natural drug-enhanced or genetically engineered melanin as a PT contrast agent. PTM was able to guide spectral burning of strong absorption background, which masked weakly absorbing chromophores (e.g., cytochromes in the melanin background). PTM provided label-free monitoring of stress-related changes to cytochrome c distribution, in C. elegans at the single-cell level. In nonlinear mode ultrasharp PT spectra from cyt c and the lateral resolution of 120 nm during calibration with 10-nm gold film were observed, suggesting a potential of PTM to break through the spectral and diffraction limits, respectively. Confocal PT spectromicroscopy could provide a valuable alternative or supplement to fluorescence microscopy for imaging of nonfluorescent chromophores and certain fluorophores.     

Lucky Imaging: Improved Localization Accuracy for Single Molecule Imaging

We apply the astronomical data-analysis technique, Lucky imaging, to improve resolution in single molecule fluorescence microscopy. We show that by selectively discarding data points from individual single-molecule trajectories, imaging resolution can be improved by a factor of 1.6 for individual fluorophores and up to 5.6 for more complex images. The method is illustrated using images of fluorescent dye molecules and quantum dots, and the in vivo imaging of fluorescently labeled linker for activation of T cells.     

Multivariate chromosome analysis and complete karyotyping using dual labeling and fluorescence digital imaging microscopy

The combination of multiple dye-DNA interactions, a fluorescence digital imaging system with a scientific CCD camera, and multivariate image analysis allows the rapid karyotyping of fluorescent human metaphase chromosome spreads. Chromosomes are stained with the bisbenzimidazole dye Hoechst 33342 and chromomycin A3, a dye pair used frequently in bivariate flow analysis and sorting of metaphase chromosomes in suspension. The use of ratio functions involving the total and peak intensities of the two dyes provides increased resolution of the karyotype in the microscope, and it can be anticipated that the same approach could lead to improved performance with flow systems as well. High pass filtering with a Laplace operator yields characteristic banded images of the individual chromosomes, even with total fields that are less than 200 pixels on a side.     

Quality assessment of confocal microscopy slide based systems: performance.

BACKGROUND: All fluorescence slide-based cytometry detections systems basically include the following components: (1) an excitation light source, (2) intermediate optics, and (3) a detection device consisting of a CCD camera or a PMT. The optical principles employed is slide-based systems are similar to those of confocal microscopes (CLSM). METHODS: The following tests evaluated confocal equipment performance: dichroic reflectivity, field illumination, lens performance, laser power output, spectral registration, axial resolution, PMT reliability, and system noise. RESULTS: Quality assurance tests provide a basis to determine if the equipment is operating correctly. Laser power, PMTs function, dichroic reflection, spectral registration, axial registration, system noise and sensitivity, lens performance and laser stability were tested colocalization of UV and visible peaks of a bead should be less than 210 nm. Interference contrast optics decrease fluorescence resolution. CONCLUSIONS: QA tests that assess CLSM system performance are also applicable to other slide-based systems. By utilization this type of testing approach, the subjective nature of assessing the CLSM may be eliminated. These tests serve as guidelines for other investigators to ensure that their machines are providing data that is accurate with the necessary resolution, sensitivity and precision.     

Fluorescence lifetime imaging.

We describe a new fluorescence imaging methodology in which the image contrast is derived from the fluorescence lifetime at each point in a two-dimensional image and not the local concentration and/or intensity of the fluorophore. In the present apparatus, lifetime images are created from a series of images obtained with a gain-modulated image intensifier. The frequency of gain modulation is at the light-modulation frequency (or a harmonic thereof), resulting in homodyne phase-sensitive images. These stationary phase-sensitive images are collected using a slow-scan CCD camera. A series of such images, obtained with various phase shifts of the gain-modulation signal, is used to determine the phase angle and/or modulation of the emission at each pixel, which is in essence the phase or modulation lifetime image. An advantage of this method is that pixel-to-pixel scanning is not required to obtain the images, as the information from all pixels is obtained at the same time. The method has been experimentally verified by creating lifetime images of standard fluorophores with known lifetimes, ranging from 1 to 10 ns. As an example of biochemical imaging we created life-time images of Yt-base when quenched by acrylamide, as a model for a fluorophore in distinct environments that affect its decay time. Additionally, we describe a faster imaging procedure that allows images in which a specific decay time is suppressed to be calculated, allowing rapid visualization of unique features and/or regions with distinct decay times. The concepts and methodologies of fluorescence lifetime imaging (FLIM) have numerous potential applications in the biosciences. Fluorescence lifetimes are known to be sensitive to numerous chemical and physical factors such as pH, oxygen, temperature, cations, polarity, and binding to macromolecules. Hence the FLIM method allows chemical or physical imaging of macroscopic and microscopic samples.     

Imaging technique implemented in CellTracks system

BACKGROUND: We developed the CellTracks cell analysis system that, similar to flow cytometry, yields multiparameter information by which the cells can be differentiated. We describe the implementation of a laser scanning imaging method in the system. Image analysis of the cells improves the specificity of cell classification, especially in cases where the particular cells are found relatively infrequently and one has to discriminate between artifacts and real events. METHODS: Fluorescent images of immunomagnetically labeled and aligned cells are obtained by passing the cells through a laser focus. The laser focus is smaller than the objects and subsequent frames captured by a regular surveillance CCD camera with a frame grabber board represent different parts of the cells. Complete images of the cells are constructed by shifting each image with respect to each other and adding individual pixel values. RESULTS: The power of combining a fluorescent image with multiparametric data is demonstrated by imaging fluorescent and magnetically labeled beads and cells. The image gives additional information about the dye distribution across the objects. Changes in dye distribution as a function of time were observed in leukocytes labeled with the red fluorescent label, Oxazine750, which are imaged at different time intervals. CONCLUSIONS: An imaging technique implemented in the CellTracks system provides high-resolution fluorescent images of events previously identified by the system. The images of the fluorescent cells enhance the ability to classify rare events.     

Simultaneously Capturing Real-time Images in Two Emission Channels Using a Dual Camera Emission Splitting System: Applications to Cell Adhesion

Multi-color immunofluorescence microscopy to detect specific molecules in the cell membrane can be coupled with parallel plate flow chamber assays to investigate mechanisms governing cell adhesion under dynamic flow conditions. For instance, cancer cells labeled with multiple fluorophores can be perfused over a potentially reactive substrate to model mechanisms of cancer metastasis. However, multi-channel single camera systems and color cameras exhibit shortcomings in image acquisition for real-time live cell analysis. To overcome these limitations, we used a dual camera emission splitting system to simultaneously capture real-time image sequences of fluorescently labeled cells in the flow chamber. Dual camera emission splitting systems filter defined wavelength ranges into two monochrome CCD cameras, thereby simultaneously capturing two spatially identical but fluorophore-specific images. Subsequently, psuedocolored one-channel images are combined into a single real-time merged sequence that can reveal multiple target molecules on cells moving rapidly across a region of interest.     

Making blind robots see: the synergy between fluorescent dyes and imaging devices in automated proteomics

Proteomics investigations endeavor to provide a global understanding of gene product synthesis rate, degradation rate, functional competence, posttranslational modification, subcellular distribution and physical interactions with other cell components. Protein expression encompasses an enormous dynamic range. Since rare proteins cannot be amplified by any type of PCR method, sensitive detection is critical to proteome projects. Fluorescence methods deliver streamlined detection protocols, superior detection sensitivity, broad linear dynamic range and excellent compatibility with modern microchemical identification methods such as mass spectrometry. Two general approaches to fluorescence detection of proteins are currently practiced: the covalent derivatization of proteins with fluorophores or noncovalent interaction of fluorophores either via the SDS micelle or through direct electrostatic interaction with proteins. One approach for quantifying fluorescence is to use a photomultiplier tube detector combined with a laser light scanner. In addition, fluorescence imaging is performed using a charge-coupled device camera combined with a UV light or xenon arc source. Fluorescent dyes with bimodal excitation spectra may be broadly implemented on a wide range of analytical imaging devices, permitting their widespread application to proteomics studies and incorporation into semiautomated analysis environments.     

A high-speed multispectral spinning-disk confocal microscope system for fluorescent speckle microscopy of living cells

Fluorescent speckle microscopy (FSM) uses a small fraction of fluorescently labeled subunits to give macromolecular assemblies such as the cytoskeleton fluorescence image properties that allow quantitative analysis of movement and subunit turnover. We describe a multispectral microscope system to analyze the dynamics of multiple cellular structures labeled with spectrally distinct fluorophores relative to one another over time in living cells. This required a high-resolution, highly sensitive, low-noise, and stable imaging system to visualize the small number of fluorophores making up each fluorescent speckle, a means by which to switch between excitation wavelengths rapidly, and a computer-based system to integrate image acquisition and illumination functions and to allow a convenient interface for viewing multispectral time-lapse data. To reduce out-of-focus fluorescence that degrades speckle contrast, we incorporated the optical sectioning capabilities of a dual-spinning-disk confocal scanner. The real-time, full-field scanning allows the use of a low-noise, fast, high-dynamic-range, and quantum-efficient cooled charge-coupled device (CCD) as a detector as opposed to the more noisy photomultiplier tubes used in laser-scanning confocal systems. For illumination, our system uses a 2.5-W Kr/Ar laser with 100-300mW of power at several convenient wavelengths for excitation of few fluorophores in dim FSM specimens and a four-channel polychromatic acousto-optical modulator fiberoptically coupled to the confocal to allow switching between illumination wavelengths and intensity control in a few microseconds. We present recent applications of this system for imaging the cytoskeleton in migrating tissue cells and neurons.     

Dual-mode Imaging of Cutaneous Tissue Oxygenation and Vascular Function

Accurate assessment of cutaneous tissue oxygenation and vascular function is important for appropriate detection, staging, and treatment of many health disorders such as chronic wounds. We report the development of a dual-mode imaging system for non-invasive and non-contact imaging of cutaneous tissue oxygenation and vascular function. The imaging system integrated an infrared camera, a CCD camera, a liquid crystal tunable filter and a high intensity fiber light source. A Labview interface was programmed for equipment control, synchronization, image acquisition, processing, and visualization. Multispectral images captured by the CCD camera were used to reconstruct the tissue oxygenation map. Dynamic thermographic images captured by the infrared camera were used to reconstruct the vascular function map. Cutaneous tissue oxygenation and vascular function images were co-registered through fiduciary markers. The performance characteristics of the dual-mode image system were tested in humans.