Single-shot optical projection tomography for high-speed volumetric imaging of dynamic biological samples

A single-shot adaptation of Optical Projection Tomography (OPT) for high-speed volumetric snapshot imaging of dynamic mesoscopic biological samples is presented. Conventional OPT has been applied to in vivo imaging of animal models such as D. rerio, but the sequential acquisition of projection images typically requires samples to be immobilized during the acquisition. A proof-of-principle system capable of single-shot tomography of a ~1 mm³ volume is presented, demonstrating camera-limited rates of up to 62.5 volumes/s, which has been applied to 3D imaging of a freely swimming zebrafish embryo. This is achieved by recording eight projection views simultaneously on four low-cost CMOS cameras. With no stage required to rotate the sample, this single-shot OPT system can be implemented with a component cost of under £5000. The system design can be adapted to different sized fields of view and may be applied to a broad range of dynamic samples, including high throughput flow cytometry applied to model organisms and fluid dynamics studies.     

Spectrally encoded coherence tomography and reflectometry: Simultaneous en face and cross‐sectional imaging at 2 gigapixels per second

Non‐invasive biological imaging is crucial for understanding in vivo structure and function. Optical coherence tomography (OCT) and reflectance confocal microscopy are two of the most widely used optical modalities for exogenous contrast‐free, high‐resolution, three‐dimensional imaging in non‐fluorescent scattering tissues. However, sample motion remains a critical barrier to raster‐scanned acquisition and reconstruction of wide‐field anatomically accurate volumetric datasets. We introduce spectrally encoded coherence tomography and reflectometry (SECTR), a high‐speed, multimodality system for simultaneous OCT and spectrally encoded reflectance (SER) imaging. SECTR utilizes a robust system design consisting of shared optical relays, scanning mirrors, swept laser and digitizer to achieve the fastest reported in vivo multimodal imaging rate of 2 gigapixels per second. Our optical design and acquisition scheme enable spatiotemporally co‐registered acquisition of OCT cross‐sections simultaneously with en face SER images for multivolumetric mosaicking. Complementary axial and lateral translation and rotation are extracted from OCT and SER data, respectively, for full volumetric estimation of sample motion with micron spatial and millisecond temporal resolution.      

Is oblique scanning laser ophthalmoscope applicable to human ocular optics? A feasibility study using an eye model for volumetric imaging

Oblique scanning laser ophthalmoscopy (oSLO) is a novel imaging modality to provide volumetric retinal imaging without depth sectioning over a large field of view (FOV). It has been successfully demonstrated in vivo in rodent eyes for volumetric fluorescein angiography (vFA). However, engineering oSLO for human retinal imaging is challenging because of the low numerical aperture (NA) of human ocular optics. To overcome this challenge, we implement optical designs to (a) increase the angle of the intermediate image under Scheimpflug condition, and (b) expand the magnification in the depth dimension with cylindrical lens to enable sufficient sampling density. In addition, we adopt a scanning‐and‐descaning strategy, resulting in a compact oSLO system. We experimentally show that the current setup can achieve a FOV of ~3 × 6 × 0.8 mm³, and the transverse and axial resolutions of 7 and 41 μm, respectively. This feasibility study serves an important step for future in vivo human retinal imaging.     

High throughput slanted scanning whole slide imaging system for digital pathology

In whole slide imaging (WSI), normally only a one layer imaging of the slide is performed. Autofocus at multiple positions is usually required. But defocus blur still exists due to tissue folding or specimen thickness. Repeated Z-stack scan be applied here, which, however, is too time consuming. Here, a high throughput slanted scanning WSI system is reported. In this system, the slide surface was slanted 1° relative to the focal plane. Thus, the focal plane spanned multiple layers of the sample. By moving the slide, multi-layer image data of the sample can be acquired simultaneously at a time frame comparable to conventional 1-layer imaging. With image fusion, defocus blur can be avoided. High quality and fast imaging of both cytological and histological slide specimens was demonstrated without applying aberration correction. The system can be a highly efficient way for the application of WSI in digital pathology.     

Spherical-matching hyperbolic-array photoacoustic computed tomography

Linear-array photoacoustic computed tomography (LA-PACT), for its flexibility and simplicity, has great potential in providing anatomical and functional information of tissues. However, the limited coverage view impedes the LA-PACT obtaining high-quality images. In this study, a photoacoustic tomographic system with a hyperbolic-array transducer was developed for stereoscopic PA imaging of carotid artery. The hyperbolic-array PACT increases the receiving sensitivity for PA signal detection due to its transducer's geometric structure matching with the spherical wave. The control phantom experiment shows that the proposed system can expand the angular coverage of ∼1/3 more than that of the LA-PACT system, and the volumetric PA images of rat's carotid artery demonstrates the potential of the system for carotid artery imaging. Furthermore, volumetric imaging of the human forearm verifies that the system has significant capability in human imaging, which indicates that it has bright prospect for assisting diagnosis in the vascular disease.     

High-resolution volumetric information fusion for depth of field enhancement in photoacoustic microscopy

Optical-resolution photoacoustic microscopy suffers from limited depth of field due to the strongly focused laser beam. Here, a novel volumetric information fusion is proposed to achieve large volumetric and high-resolution imaging. First, three-dimensional stationary wavelet transform was performed on the multi-focus data to obtain eight wavelet coefficients. Differential evolution based on joint weighted evaluation was then employed to optimize the block size of division for each wavelet coefficient. The proposed fusion rule using standard deviation for focus detection was used to fuse the corresponding sub-coefficients. Finally, photoacoustic imaging with large depth of field can be achieved by the inverse stationary wavelet transform. Performance test shows that the depth of field of photoacoustic imaging can be doubled without sacrificing lateral resolution. The proposed volumetric information fusion can further promote the capability of volumetric imaging of optical-resolution photoacoustic microscopy and will be helpful in the acquisition of physiological and pathological process.     

Double-Exposure Optical Sectioning Structured Illumination Microscopy Based on Hilbert Transform Reconstruction

Structured illumination microscopy (SIM) with axially optical sectioning capability has found widespread applications in three-dimensional live cell imaging in recent years, since it combines high sensitivity, short image acquisition time, and high spatial resolution. To obtain one sectioned slice, three raw images with a fixed phase-shift, normally 2π/3, are generally required. In this paper, we report a data processing algorithm based on the one-dimensional Hilbert transform, which needs only two raw images with arbitrary phase-shift for each single slice. The proposed algorithm is different from the previous two-dimensional Hilbert spiral transform algorithm in theory. The presented algorithm has the advantages of simpler data processing procedure, faster computation speed and better reconstructed image quality. The validity of the scheme is verified by imaging biological samples in our developed DMD-based LED-illumination SIM system.     

Exploring the utility of Deep Red Anthraquinone 5 for digital staining of ex vivo confocal micrographs of optically sectioned skin

We investigated the utility of the fluorescent dye Deep Red Anthraquinone 5 (DRAQ5) for digital staining of optically sectioned skin in comparison to acridine orange (AO). Eight fresh-frozen thawed Mohs discard tissue specimens were stained with AO and DRAQ5, and imaged using an ex vivo confocal microscope at three wavelengths (488 nm and 638 nm for fluorescence, 785 nm for reflectance). Images were overlaid (AO + Reflectance, DRAQ5 + Reflectance), digitally stained, and evaluated by three investigators for perceived image quality (PIQ) and histopathological feature identification. In addition to nuclear staining, AO seemed to stain dermal fibers in a subset of cases in digitally stained images, while DRAQ5 staining was more specific to nuclei. Blinded evaluation showed substantial agreement, favoring DRAQ5 for PIQ (82%, Cl 75%-90%, Gwet's AC 0.74) and for visualization of histopathological features in (81%, Cl 73%-89%, Gwet's AC 0.67), supporting its use in digital staining of multimodal confocal micrographs of skin.     

Restored interlaced volumetric imaging increases image quality and scanning speed during intravital imaging in living mice

Dynamic intravital imaging is essential for revealing ongoing biological phenomena within living organisms and is influenced primarily by several factors: motion artifacts, optical properties and spatial resolution. Conventional imaging quality within a volume, however, is degraded by involuntary movements and trades off between the imaged volume, imaging speed and quality. To balance such trade‐offs incurred by two‐photon excitation microscopy during intravital imaging, we developed a unique combination of interlaced scanning and a simple image restoration algorithm based on biological signal sparsity and a graph Laplacian matrix. This method increases the scanning speed by a factor of four for a field size of 212 μm × 106 μm × 130 μm, and significantly improves the quality of four‐dimensional dynamic volumetric data by preventing irregular artifacts due to the movement observed with conventional methods. Our data suggest this method is robust enough to be applied to multiple types of soft tissue.     

Optimization for continuous-wave terahertz reflection imaging for biological tissues

Continuous-wave terahertz reflection imaging is a potential tool for biological tissues. Based on our home-made continuous-wave terahertz reflection imaging system, the effect of both polarization mode and reflection window on the imaging performance is studied theoretically and experimentally, showing good agreement. By taking obtaining sample information and image contrast into consideration, p-polarized terahertz waves are recommended. Moreover, considering the sample boundary identification and the image contrast, selection criteria for reflection window are proposed. This work will help to improve the performance of continuous-wave terahertz reflection imaging and accelerate the THz imaging in biological application.     

Development a flexible light‐sheet fluorescence microscope for high‐speed 3D imaging of calcium dynamics and 3D imaging of cellular microstructure

We report a flexible light‐sheet fluorescence microscope (LSFM) designed for studying dynamic events in cardiac tissue at high speed in 3D and the correlation of these events to cell microstructure. The system employs two illumination‐detection modes: the first uses angle‐dithering of a Gaussian light sheet combined with remote refocusing of the detection plane for video‐rate volumetric imaging; the second combines digitally‐scanned light‐sheet illumination with an axially‐swept light‐sheet waist and stage‐scanned acquisition for improved axial resolution compared to the first mode. We present a characterisation of the spatial resolution of the system in both modes. The first illumination‐detection mode achieves dual spectral‐channel imaging at 25 volumes per second with 1024 × 200 × 50 voxel volumes and is demonstrated by time‐lapse imaging of calcium dynamics in a live cardiomyocyte. The second illumination‐detection mode is demonstrated through the acquisition of a higher spatial resolution structural map of the t‐tubule network in a fixed cardiomyocyte cell.     

Convolutional neural networks for reconstruction of undersampled optical projection tomography data applied to in vivo imaging of zebrafish

Optical projection tomography (OPT) is a 3D mesoscopic imaging modality that can utilize absorption or fluorescence contrast. 3D images can be rapidly reconstructed from tomographic data sets sampled with sufficient numbers of projection angles using the Radon transform, as is typically implemented with optically cleared samples of the mm‐to‐cm scale. For in vivo imaging, considerations of phototoxicity and the need to maintain animals under anesthesia typically preclude the acquisition of OPT data at a sufficient number of angles to avoid artifacts in the reconstructed images. For sparse samples, this can be addressed with iterative algorithms to reconstruct 3D images from undersampled OPT data, but the data processing times present a significant challenge for studies imaging multiple animals. We show here that convolutional neural networks (CNN) can be used in place of iterative algorithms to remove artifacts—reducing processing time for an undersampled in vivo zebrafish dataset from 77 to 15 minutes. We also show that using CNN produces reconstructions of equivalent quality to compressed sensing with 40% fewer projections. We further show that diverse training data classes, for example, ex vivo mouse tissue data, can be used for CNN‐based reconstructions of OPT data of other species including live zebrafish.      

Development of concurrent magnetic resonance imaging and volumetric optoacoustic tomography: A phantom feasibility study

Optoacoustic tomography (OAT) and magnetic resonance imaging (MRI) provide highly complementary capabilities for anatomical and functional imaging of living organisms. Herein, we investigate on the feasibility of combining both modalities to render concurrent images. This was achieved by introducing a specifically-designed copper-shielded spherical ultrasound array into a preclinical MRI scanner. Phantom experiments revealed that the OAT probe caused minimal distortion in the MRI images, while synchronization of the laser and the MRI pulse sequence enabled defining artifact-free acquisition windows for OAT. Good dynamic OAT contrast from superparamagnetic iron oxide nanoparticles, a commonly used agent for MRI contrast enhancement, was also observed. The hybrid OAT-MRI system thus provides an excellent platform for cross-validating functional readings of both modalities. Overall, this initial study serves to establish the technical feasibility of developing a hybrid OAT-MRI system for biomedical research.     

Dynamic imaging of zebrafish heart with multi-planar light sheet microscopy

Light sheet fluorescence microscopy has become a research hotspot in biomedicine because of low phototoxicity, high speed, and high resolution. However, the conventional methods to acquire three-dimensional spatial information are mainly based on scanning, which inevitably increases photodamage and is not real-time. Here, we propose a method to generate controllable multi-planar illumination with a dielectric isosceles triangular array and a design of multi-planar light sheet fluorescence microscopy system. We carry out experiments of three-dimensional illumination beam measurement, volumetric imaging of fluorescent microspheres, and dynamic in vivo imaging of zebrafish heart to evaluate the performance of this system. In addition, we apply this system to study the effects of bisphenol fluorene on the heart shape and heart-beating rate of zebrafish. Our experiment results indicate that the multi-planar light sheet microscopy system provides a novel and feasible method for three-dimensional selected plane imaging and low-phototoxicity in vivo imaging.     

Three‐dimensional mapping of the attenuation coefficient in optical coherence tomography to enhance breast tissue microarchitecture contrast

Effective intraoperative tumor margin assessment is needed to reduce re‐excision rates in breast‐conserving surgery (BCS). Mapping the attenuation coefficient in optical coherence tomography (OCT) throughout a sample to create an image (attenuation imaging) is one promising approach. For the first time, three‐dimensional OCT attenuation imaging of human breast tissue microarchitecture using a wide‐field (up to ~45 × 45 × 3.5 mm) imaging system is demonstrated. Representative results from three mastectomy and one BCS specimen (from 31 specimens) are presented with co‐registered postoperative histology. Attenuation imaging is shown to provide substantially improved contrast over OCT, delineating nuanced features within tumors (including necrosis and variations in tumor cell density and growth patterns) and benign features (such as sclerosing adenosis). Additionally, quantitative micro‐elastography (QME) images presented alongside OCT and attenuation images show that these techniques provide complementary contrast, suggesting that multimodal imaging could increase tissue identification accuracy and potentially improve tumor margin assessment.     

A hybrid blob-slice model for accurate and efficient detection of fluorescence labeled nuclei in 3D

Background  

To exploit the flood of data from advances in high throughput imaging of optically sectioned nuclei, image analysis methods need to correctly detect thousands of nuclei, ideally in real time. Variability in nuclear appearance and undersampled volumetric data make this a challenge.     

Hyperspectral scanning laser optical tomography

In order to study physical relationships within tissue volumes or even organism‐level systems, the spatial distribution of multiple fluorescent markers needs to be resolved efficiently in three dimensions. Here, rather than acquiring discrete spectral images sequentially using multiple emission filters, a hyperspectral scanning laser optical tomography system is developed to obtain hyperspectral volumetric data sets with 2‐nm spectral resolution of optically transparent mesoscopic (millimeter‐centimeter) specimens. This is achieved by acquiring a series of point‐scanning hyperspectral extended depth of field images at different angles and subsequently tomographically reconstructing the 3D intensity distribution for each wavelength. This technique is demonstrated to provide robust measurements via the comparison of spectral and intensity profiles of fluorescent bead phantoms. Due to its enhanced spectral resolving ability, this technique is also demonstrated to resolve largely overlapping fluorophores, as demonstrated by the 3D fluorescence hyperspectral reconstruction of a dual‐labeled mouse thymus gland sample and the ability to distinguish tumorous and normal tissues of an unlabeled mouse intestine sample.      

Computed tomography for in vivo deep over‐1000 nm near‐infrared fluorescence imaging

This study aims to develop a novel cross‐sectional imaging of fluorescence in over‐1000 nm near‐infrared (OTN‐NIR), which allows in vivo deep imaging, using computed tomography (CT) system. Cylindrical specimens of composite of OTN‐NIR fluorophore, NaGdF₄ co‐doped with Yb³⁺ and Ho³⁺ (ex: 980 nm, em: 1150 nm), were embedded in cubic agar (10.5–12 mm) or in the peritoneal cavity of mice and placed on a rotatable stage. When the fluorescence from inside of the samples was serially captured from multiple angles, the images were disrupted by the reflection and refraction of emitted light on the sample‐air interface. Immersing the sample into water filled in a rectangular bath suppressed the disruption at the interface and successfully reconstructed the position and concentration of OTN‐NIR fluorophores on the cross‐sectional images using a CT technique. This is promising as a novel three‐dimensional imaging technique for OTN‐NIR fluorescent image projections of small animals captured from multiple angles.     

Handheld volumetric manual compression‐based quantitative microelastography

Compression optical coherence elastography (OCE) typically requires a mechanical actuator to impart a controlled uniform strain to the sample. However, for handheld scanning, this adds complexity to the design of the probe and the actuator stroke limits the amount of strain that can be applied. In this work, we present a new volumetric imaging approach that utilizes bidirectional manual compression via the natural motion of the user's hand to induce strain to the sample, realizing compact, actuator‐free, handheld compression OCE. In this way, we are able to demonstrate rapid acquisition of three‐dimensional quantitative microelastography (QME) datasets of a tissue volume (6 × 6 × 1 mm³) in 3.4 seconds. We characterize the elasticity sensitivity of this freehand manual compression approach using a homogeneous silicone phantom and demonstrate comparable performance to a benchtop mounted, actuator‐based approach. In addition, we demonstrate handheld volumetric manual compression‐based QME on a tissue‐mimicking phantom with an embedded stiff inclusion and on freshly excised human breast specimens from both mastectomy and wide local excision (WLE) surgeries. Tissue results are coregistered with postoperative histology, verifying the capability of our approach to measure the elasticity of tissue and to distinguish stiff tumor from surrounding soft benign tissue.     

Real‐time video mosaicking to guide handheld in vivo microscopy

Handheld and endoscopic optical‐sectioning microscopes are being developed for noninvasive screening and intraoperative consultation. Imaging a large extent of tissue is often desired, but miniature in vivo microscopes tend to suffer from limited fields of view. To extend the imaging field during clinical use, we have developed a real‐time video mosaicking method, which allows users to efficiently survey larger areas of tissue. Here, we modified a previous post‐processing mosaicking method so that real‐time mosaicking is possible at >30 frames/second when using a device that outputs images that are 400 × 400 pixels in size. Unlike other real‐time mosaicking methods, our strategy can accommodate image rotations and deformations that often occur during clinical use of a handheld microscope. We perform a feasibility study to demonstrate that the use of real‐time mosaicking is necessary to enable efficient sampling of a desired imaging field when using a handheld dual‐axis confocal microscope.