Optical hyperspectral imaging in microscopy and spectroscopy – a review of data acquisition

Rather than simply acting as a photographic camera capturing two‐dimensional (x, y) intensity images or a spectrometer acquiring spectra (λ), a hyperspectral imager measures entire three‐dimensional (x, y, λ) datacubes for multivariate analysis, providing structural, molecular, and functional information about biological cells or tissue with unprecedented detail. Such data also gives clinical insights for disease diagnosis and treatment. We summarize the principles underpinning this technology, highlight its practical implementation, and discuss its recent applications at microscopic to macroscopic scales.

Datacube acquisition strategies in hyperspectral imaging x, y, spatial coordinates; λ, wavelength.     

Wearable scanning photoacoustic brain imaging in behaving rats

A wearable scanning photoacoustic imaging (wPAI) system is presented for noninvasive brain study in behaving rats. This miniaturized wPAI system consists of four pico linear servos and a single transducer‐based PAI probe. It has a dimension of 50 mm × 35 mm × 40 mm, and a weight of 26 g excluding cablings. Phantom evaluation shows that wPAI achieves a lateral resolution of ～0.5 mm and an axial resolution of ～0.1 mm at a depth of up to 11 mm. Its imaging ability is also tested in a behaving rat, and the results indicate that wPAI is able to image blood vessels at a depth of up to 5 mm with intact scalp and skull. With its noninvasive, deep penetration, and functional imaging ability in behaving animals, wPAI can be used for behavior, cognition, and preclinical brain disease studies.

     

Novel biomedical applications of Cerenkov radiation and radioluminescence imaging

The main goals of this review is to provide an up-to-date account of the different uses of Cerenkov radiation (CR) and radioluminescence imaging for pre-clinical small animal imaging. We will focus on new emerging applications such as the use of Cerenkov imaging for monitoring radionuclide and external radiotherapy in humans. Another novel application that will be described is the monitoring of radiochemical synthesis using microfluidic chips.Several pre-clinical aspects of CR will be discussed such as the development of 3D reconstruction methods for Cerenkov images and the use of CR as excitation source for nanoparticles or for endoscopic imaging.We will also include a discussion on radioluminescence imaging that is a more general method than Cerenkov imaging for the detection using optical methods of alpha and gamma emitters.     

Molecular probes for fluorescent sensing of metal ions in non-mammalian organisms

While metal ions play an important role in the proper functioning of all life, many questions remain unanswered about exactly how different metals contribute to health and disease. The development of fluorescent probes, which respond to metals, has allowed greater understanding of the cellular location, concentration and speciation of metals in living systems, giving a new appreciation of their function. While the focus of studies using these fluorescent tools has largely been on mammalian organisms, there has been relatively little application of these powerful tools to other organisms. In this review, we highlight recent examples of molecular fluorophores, which have been applied to sensing metals in non-mammalian organisms.     

Maximizing content across scales: Moving multimodal microscopy and mesoscopy toward molecular imaging

Molecular imaging aims to depict the molecules in living patients. However, because this aim is still far beyond reach, patchworks of different solutions need to be used to tackle this overarching goal. From the vast toolbox of imaging techniques, we focus on those recent advances in optical microscopy that image molecules and cells at the submicron to centimeter scale. Mesoscopic imaging covers the “imaging gap” between techniques such as confocal microscopy and magnetic resonance imagingthat image entire live samples but with limited resolution. Microscopy focuses on the cellular level; mesoscopy visualizes the organization of molecules and cells into tissues and organs. The correlation between these techniques allows us to combine disciplines ranging from whole body imaging to basic research of model systems. We review current developments focused on improving microscopic and mesoscopic imaging technologies and on hardware and software that push the current sensitivity and resolution boundaries.     

Wide‐field color imaging of scatter‐based tissue contrast using both high spatial frequency illumination and cross‐polarization gating

This study characterizes the scatter‐specific tissue contrast that can be obtained by high spatial frequency (HSF) domain imaging and cross‐polarization (CP) imaging, using a standard color imaging system, and how combining them may be beneficial. Both HSF and CP approaches are known to modulate the sensitivity of epi‐illumination reflectance images between diffuse multiply scattered and superficially backscattered photons, providing enhanced contrast from microstructure and composition than what is achieved by standard wide‐field imaging. Measurements in tissue‐simulating optical phantoms show that CP imaging returns localized assessments of both scattering and absorption effects, while HSF has uniquely specific sensitivity to scatter‐only contrast, with a strong suppression of visible contrast from blood. The combination of CP and HSF imaging provided an expanded sensitivity to scatter compared with CP imaging, while rejecting specular reflections detected by HSF imaging. ex vivo imaging of an atlas of dissected rodent organs/tissues demonstrated the scatter‐based contrast achieved with HSF, CP and HSF‐CP imaging, with the white light spectral signal returned by each approach translated to a color image for intuitive encoding of scatter‐based contrast within images of tissue. The results suggest that visible CP‐HSF imaging could have the potential to aid diagnostic imaging of lesions in skin or mucosal tissues and organs, where just CP is currently the standard practice imaging modality.      

Smartphone-based multimodal tethered capsule endoscopic platform for white-light,narrow-band,and fluorescence/autofluorescence imaging

Multimodal low-cost endoscopy is highly desirable in poor resource settings such as in developing nations. In this work, we developed a smartphone-based low-cost, reusable tethered capsule endoscopic platform that allows white-light, narrowband, and fluorescence/autofluorescence imaging of the esophagus. The ex-vivo studies of swine esophagus were performed and compared with a commercial endoscope to test the white-light imaging capabilities of the endoscope. The efficacy of the capsule for narrow-band imaging was tested by imaging the vascularization of the tongue. To determine the autofluorescence/fluorescence capability of the endoscope, fluorescein dye with different concentrations was imaged. Furthermore, swine esophagus injected with fluorescein dye was imaged using the fluorescence/autofluorescence and the white-light imaging modules, ex-vivo. The overall cost of the capsules is approximately 12 €, 15 €, and 42 € for the white light imaging, the narrow-band imaging, and the fluorescence/autofluorescence imaging respectively. In addition, the cost of the laser source module required for the narrow-band imaging and the fluorescence/autofluorescence imaging is approximately 218 €. This device will open the possibility of imaging the esophagus in underprivileged areas.     

Multi‐ATOM: Ultrahigh‐throughput single‐cell quantitative phase imaging with subcellular resolution

A growing body of evidence has substantiated the significance of quantitative phase imaging (QPI) in enabling cost‐effective and label‐free cellular assays, which provides useful insights into understanding the biophysical properties of cells and their roles in cellular functions. However, available QPI modalities are limited by the loss of imaging resolution at high throughput and thus run short of sufficient statistical power at the single‐cell precision to define cell identities in a large and heterogeneous population of cells—hindering their utility in mainstream biomedicine and biology. Here we present a new QPI modality, coined multiplexed asymmetric‐detection time‐stretch optical microscopy (multi‐ATOM) that captures and processes quantitative label‐free single‐cell images at ultrahigh throughput without compromising subcellular resolution. We show that multi‐ATOM, based upon ultrafast phase‐gradient encoding, outperforms state‐of‐the‐art QPI in permitting robust phase retrieval at a QPI throughput of >10 000 cell/sec, bypassing the need for interferometry which inevitably compromises QPI quality under ultrafast operation. We employ multi‐ATOM for large‐scale, label‐free, multivariate, cell‐type classification (e.g. breast cancer subtypes, and leukemic cells vs peripheral blood mononuclear cells) at high accuracy (>94%). Our results suggest that multi‐ATOM could empower new strategies in large‐scale biophysical single‐cell analysis with applications in biology and enriching disease diagnostics.      

Nanoscale spectroscopy and imaging of hemoglobin

Sub diffraction limited infrared absorption imaging of hemoglobin was performed by coupling IR optics with an atomic force microscope. Comparisons between the AFM topography and IR absorption images of micron sized hemoglobin features are presented, along with nanoscale IR spectroscopic analysis of the metalloprotein. (© 2011 WILEY‐VCH Verlag GmbH & Co. KGaA, Weinheim)     

Intraoperative multispectral and hyperspectral label‐free imaging: A systematic review of in vivo clinical studies

Multispectral and hyperspectral imaging (HSI) are emerging optical imaging techniques with the potential to transform the way surgery is performed but it is not clear whether current systems are capable of delivering real‐time tissue characterization and surgical guidance. We conducted a systematic review of surgical in vivo label‐free multispectral and HSI systems that have been assessed intraoperatively in adult patients, published over a 10‐year period to May 2018. We analysed 14 studies including 8 different HSI systems. Current in‐vivo HSI systems generate an intraoperative tissue oxygenation map or enable tumour detection. Intraoperative tissue oxygenation measurements may help to predict those patients at risk of postoperative complications and in‐vivo intraoperative tissue characterization may be performed with high specificity and sensitivity. All systems utilized a line‐scanning or wavelength‐scanning method but the spectral range and number of spectral bands employed varied significantly between studies and according to the system's clinical aim. The time to acquire a hyperspectral cube dataset ranged between 5 and 30 seconds. No safety concerns were reported in any studies. A small number of studies have demonstrated the capabilities of intraoperative in‐vivo label‐free HSI but further work is needed to fully integrate it into the current surgical workflow.      

Ultrafast vascular strain compounding using plane wave transmission

Deformations of the atherosclerotic vascular wall induced by the pulsating blood can be estimated using ultrasound strain imaging. Because these deformations indirectly provide information on mechanical plaque composition, strain imaging is a promising technique for differentiating between stable and vulnerable atherosclerotic plaques. This paper first explains 1-D radial strain estimation as applied intravascularly in coronary arteries. Next, recent methods for noninvasive vascular strain estimation in a transverse imaging plane are discussed. Finally, a compounding technique that our group recently developed is explained. This technique combines motion estimates of subsequently acquired focused ultrasound images obtained at various insonification angles. However, because the artery moves and deforms during the multi-angle acquisition, errors are introduced when compounding. Recent advances in computational power have enabled plane wave ultrasound acquisition, which allows 100 times faster image acquisition and thus might resolve the motion artifacts. In this paper the performance of strain imaging using plane wave compounding is investigated using simulations of an artery with a vulnerable plaque and experimental data of a two-layered vessel phantom. The results show that plane wave compounding outperforms 0° focused strain imaging. For the simulations, the root mean squared error reduced by 66% and 50% for radial and circumferential strain, respectively. For the experiments, the elastographic signal-to-noise and contrast-to-noise ratio (SNR_e and CNR_e) increased with 2.1 dB and 3.7 dB radially, and 5.6 dB and 16.2 dB circumferentially. Because of the high frame rate, the plane wave compounding technique can even be further optimized and extended to 3D in future.     

Characterising live cell behaviour: Traditional label-free and quantitative phase imaging approaches

Label-free imaging uses inherent contrast mechanisms within cells to create image contrast without introducing dyes/labels, which may confound results. Quantitative phase imaging is label-free and offers higher content and contrast compared to traditional techniques. High-contrast images facilitate generation of individual cell metrics via more robust segmentation and tracking, enabling formation of a label-free dynamic phenotype describing cell-to-cell heterogeneity and temporal changes. Compared to population-level averages, individual cell-level dynamic phenotypes have greater power to differentiate between cellular responses to treatments, which has clinical relevance e.g. in the treatment of cancer. Furthermore, as the data is obtained label-free, the same cells can be used for further assays or expansion, of potential benefit for the fields of regenerative and personalised medicine.     

Squamous cell carcinoma of the head and neck—The role of diffusion and perfusion imaging in tumor recurrence and follow-up

Computed tomography and magnetic resonance imaging-based techniques of functional imaging are proven to be sensitive and reliable tools for detection and staging of head and neck cancer.These new techniques enable to visualize and differentiate subtle pathologic changes before they become evident on standard cross-sectional images.However, it is their role in evaluating possible recurrence and estimation of treatment response that holds the biggest promise.This article describes the role and usefulness of diffusion and perfusion in detecting recurrence and follow-up in patients with head and neck squamous cell carcinoma.     

Optical emission of 223Radium: in vitro and in vivo preclinical applications

²²³Radium (²²³Ra) is widely used in nuclear medicine to treat patients with osseous metastatic prostate cancer. In clinical practice ²²³Ra cannot be imaged directly; however, gamma photons produced by its short‐lived daughter nuclides can be captured by conventional gamma cameras. In this work, we show that ²²³Ra and its short‐lived daughter nuclides can be detected with optical imaging techniques. The light emission of ²²³Ra was investigated in vitro using different setups in order to clarify the mechanism of light production. The results demonstrate that the luminescence of the ²²³Ra chloride solution, usually employed in clinical treatments, is compatible with Cerenkov luminescence having an emission spectrum that is almost indistinguishable from CR one. This study proves that luminescence imaging can be successfully employed to detect ²²³Ra in vivo in mice by imaging whole body ²²³Ra biodistribution and more precisely its uptake in bones.      

多尺度的光声显微镜用于癌细胞及实体瘤成像

多尺度显微成像系统(M-PAM)被发展,并被用于成像从癌细胞到实体肿瘤的多尺度生物结构.该装置由二维运动平台,扫描振镜,物镜,聚焦超声换能器组成,其横向分辨率达到3 μm.结果显示该系统可以对体外培养黑色素瘤细胞与体内的黑色素瘤进行无标记成像.基于具有靶向性的探针,M-PAM系统可以对体外培养的U87-MG肿瘤细胞以及体内U87-MG实体肿瘤进行成像.综上所述,M-PAM系统将是研究肿瘤的有力工具.     

In vivo quantification of renal function in mice using clinical gamma cameras

IntroductionIn preclinical research, the growing number of transgenic models has led to the need for renal-function studies in mice. Many efforts have been made to develop dedicated SPECT systems for rodents, but their availability is limited due to high capital costs. The aim of this work is to demonstrate the feasibility of mouse renal imaging by using an inexpensive alternative based on clinical gamma-cameras.MethodsA healthy mouse was scanned 3 h after injection of 6 mCi of Dimercaptosuccinic acid (DMSA) labeled with 99mTc by using a single-head gamma-camera in conjunction with a dedicated pinhole collimator. List-mode data were binned to emulate multiple injections of 1 mCi, 0.1 mCi and 0.01 mCi of 99mTc-DMSA and 6-min ventral and dorsal planar images were acquired and SPECT imaging (60 projection images acquired over 60 min) was performed. An optimization of the protocols in terms of injected activity, time scan, renal cortex uniformity and cortex-to-pelvis contrast was carried out.ResultsThe appropriate protocols were an injected activity of 0.6 mCi, combined with duration of scanning of 1 min for planar and 60 min for SPECT imaging. Our results were validated through the relative quantification of renal function, which showed that both kidneys contributed equally to the total function. They showed that functional structures of the mouse kidneys can be visually distinguished as easily as in human studies.ConclusionsOur findings showed the feasibility of conducting quantitative DMSA SPECT studies of anesthetized mice on clinical gamma cameras.     

Effects of multispectral excitation on the sensitivity of molecular optoacoustic imaging

Molecular optoacoustic (photoacoustic) imaging typically relies on the spectral identification of absorption signatures from molecules of interest. To achieve this, two or more excitation wavelengths are employed to sequentially illuminate tissue. Due to depth‐related spectral dependencies and detection related effects, the multispectral optoacoustic tomography (MSOT) spectral unmixing problem presents a complex non‐linear inversion operation. So far, different studies have showcased the spectral capacity of optoacoustic imaging, without however relating the performance achieved to the number of wavelengths employed. Overall, the dependence of the sensitivity and accuracy of optoacoustic imaging as a function of the number of illumination wavelengths has not been so far comprehensively studied. In this paper we study the impact of the number of excitation wavelengths employed on the sensitivity and accuracy achieved by molecular optoacoustic tomography. We present a quantitative analysis, based on synthetic MSOT datasets and observe a trend of sensitivity increase for up to 20 wavelengths. Importantly we quantify this relation and demonstrate an up to an order of magnitude sensitivity increase of multi‐wavelength illumination vs. single or dual wavelength optoacoustic imaging. Examples from experimental animal studies are finally utilized to support the findings.

In vivo MSOT imaging of a mouse brain bearing a tumor that is expressing a near‐infrared fluorescent protein. ( a ) Monochromatic optoacoustic imaging at the peak excitation wavelength of the fluorescent protein. ( b ) Overlay of the detected bio‐distribution of the protein (red pseudocolor) on the monochromatic optoacoustic image. ( c ) Ex vivo validation by means of cryoslicing fluorescence imaging.     

Fast dual-excitation ratiometry with light-emitting diodes and high-speed liquid crystal shutters

Dual-excitation ratiometric dyes permit quantitative measurements of Ca2+ concentrations ([Ca2+]s), by minimizing the effects of several artifacts that are unrelated to changes in [Ca2+]. These dyes are excited at two different wavelengths, and the resultant fluorescence intensities are measured sequentially. Therefore, it is difficult to follow fast [Ca2+] dynamics or [Ca2+] changes in highly motile cell samples. To overcome this problem, we have developed a new dual-excitation ratiometry system that employs two high-power light-emitting diodes (LEDs), two high-speed liquid crystal shutters, and a CCD camera. The open/close operation of the two shutters is synchronized with the on/off switching of the two LEDs. This system increases the rate at which ratio measurements are made to 1 kHz, and provides ratio images at 10-100 Hz depending on the signal intensity. We demonstrate the effectiveness of this system by monitoring changes in [Ca2+] in cardiac muscle cells loaded with Fura-2.     

Simultaneous dual-excitation ratiometry using orthogonal linear polarized lights

Dual-excitation ratiometric dyes permit quantitative Ca2+ measurements by minimizing the effects of several artifacts that are unrelated to changes in the concentration of free Ca2+ ([Ca2+]). These dyes are excited alternately at two different wavelengths, and the pair of intensity measurements must be collected sequentially. Therefore, it is difficult to follow very fast Ca2+ dynamics or Ca2+ changes in highly motile cell samples. Here, we present a novel but simple dual-excitation ratiometric method which overcomes this problem. By the use of our home-made illuminator, each sample is illuminated by two orthogonal linear polarized lights of different wavelengths. Fluorescence images are captured by two CCD cameras through two analyzers, whose polarization directions are at right angles. This methodology allows us to perform simultaneous measurements of any dual-excitation ratiometric dye, and we demonstrate its validity by monitoring [Ca2+] changes in rat cardiac muscle cells loaded with Fura Red.