Real‐time video mosaicking to guide handheld in vivo microscopy

Handheld and endoscopic optical‐sectioning microscopes are being developed for noninvasive screening and intraoperative consultation. Imaging a large extent of tissue is often desired, but miniature in vivo microscopes tend to suffer from limited fields of view. To extend the imaging field during clinical use, we have developed a real‐time video mosaicking method, which allows users to efficiently survey larger areas of tissue. Here, we modified a previous post‐processing mosaicking method so that real‐time mosaicking is possible at >30 frames/second when using a device that outputs images that are 400 × 400 pixels in size. Unlike other real‐time mosaicking methods, our strategy can accommodate image rotations and deformations that often occur during clinical use of a handheld microscope. We perform a feasibility study to demonstrate that the use of real‐time mosaicking is necessary to enable efficient sampling of a desired imaging field when using a handheld dual‐axis confocal microscope.     

Comparison of the Iowa Reference Algorithm to the Heidelberg Spectralis optical coherence tomography segmentation algorithm

For spectral‐domain optical coherence tomography (SD‐OCT) studies of neurodegeneration, it is important to understand how segmentation algorithms differ in retinal layer thickness measurements, segmentation error locations and the impact of manual correction. Using macular SD‐OCT images of frontotemporal degeneration patients and controls, we compare the individual and aggregate retinal layer thickness measurements provided by two commonly used algorithms, the Iowa Reference Algorithm and Heidelberg Spectralis, with manual correction of significant segmentation errors. We demonstrate small differences of most retinal layer thickness measurements between these algorithms. Outer sectors of the Early Treatment Diabetic Retinopathy Study grid require a greater percent of eyes to be corrected than inner sectors of the retinal nerve fiber layer (RNFL). Manual corrections affect thickness measurements mildly, resulting in at most a 5% change in RNFL thickness. Our findings can inform researchers how to best use different segmentation algorithms when comparing retinal layer thicknesses.     

N2NSR-OCT: Simultaneous denoising and super-resolution in optical coherence tomography images using semisupervised deep learning

Optical coherence tomography (OCT) imaging shows a significant potential in clinical routines due to its noninvasive property. However, the quality of OCT images is generally limited by inherent speckle noise of OCT imaging and low sampling rate. To obtain high signal-to-noise ratio (SNR) and high-resolution (HR) OCT images within a short scanning time, we presented a learning-based method to recover high-quality OCT images from noisy and low-resolution OCT images. We proposed a semisupervised learning approach named N2NSR-OCT, to generate denoised and super-resolved OCT images simultaneously using up- and down-sampling networks (U-Net (Semi) and DBPN (Semi)). Additionally, two different super-resolution and denoising models with different upscale factors (2× and 4× ) were trained to recover the high-quality OCT image of the corresponding down-sampling rates. The new semisupervised learning approach is able to achieve results comparable with those of supervised learning using up- and down-sampling networks, and can produce better performance than other related state-of-the-art methods in the aspects of maintaining subtle fine retinal structures.     

Three‐dimensional mapping of the attenuation coefficient in optical coherence tomography to enhance breast tissue microarchitecture contrast

Effective intraoperative tumor margin assessment is needed to reduce re‐excision rates in breast‐conserving surgery (BCS). Mapping the attenuation coefficient in optical coherence tomography (OCT) throughout a sample to create an image (attenuation imaging) is one promising approach. For the first time, three‐dimensional OCT attenuation imaging of human breast tissue microarchitecture using a wide‐field (up to ~45 × 45 × 3.5 mm) imaging system is demonstrated. Representative results from three mastectomy and one BCS specimen (from 31 specimens) are presented with co‐registered postoperative histology. Attenuation imaging is shown to provide substantially improved contrast over OCT, delineating nuanced features within tumors (including necrosis and variations in tumor cell density and growth patterns) and benign features (such as sclerosing adenosis). Additionally, quantitative micro‐elastography (QME) images presented alongside OCT and attenuation images show that these techniques provide complementary contrast, suggesting that multimodal imaging could increase tissue identification accuracy and potentially improve tumor margin assessment.     

Three‐dimensional multiphoton/optical coherence tomography for diagnostic applications in dermatology

A preliminary clinical trial using state‐of‐the‐art multiphoton tomography (MPT) and optical coherence tomography (OCT) for three‐dimensional (3D) multimodal in vivo imaging of normal skin, nevi, scars and pathologic skin lesions has been conducted. MPT enabled visualization of sub‐cellular details with axial and transverse resolutions of <2 μm and <0.5 μm, respectively, from a volume of 0.35 × 0.35 × 0.2 mm³ at a frame rate of 0.14 Hz (512 × 512 pixels). State‐of‐the‐art OCT, operating at a center wavelength of 1300 nm, was capable of acquiring 3D images depicting the layered architecture of skin with axial and transverse resolutions ～8 μm and ～20 μm, respectively, from a volume of 7 × 3.5 × 1.5 mm³ at a frame rate of 46 Hz (1024 × 1024 pixels). This study demonstrates the clinical diagnostic potential of MPT/OCT for pre‐screening relatively large areas of skin using 3D OCT to identify suspicious regions at microscopic level and subsequently using high resolution MPT to obtain zoomed in, sub‐cellular level information of the respective regions (© 2013 WILEY‐VCH Verlag GmbH & Co. KGaA, Weinheim)     

通过光学相干断层扫描图像进行自动视网膜分割评估黄斑水肿的投影面积

在本文中,我们提出了一种自动视网膜分割方法,以评估光学相干断层扫描（OCT）图像中黄斑水肿（ME）在视网膜特定层上的投影面积。首先使用基于权重矩阵的优化的最短路径最快算法对十个视网膜层边界进行分割,这有效降低了算法对血管阴影的敏感性。然而,ME的存在将导致水肿区域的分割不准确。因此,我们使用强度阈值方法提取每个OCT图像中的水肿区域,并将该区域中的值设置为零,并确保获得的分割边界可以自动穿过而不是绕过水肿区域。我们使用最小值投影来计算ME在不同层的投影面积。为了测试我们的方法,我们使用了从Topcon的OCT机器收集的数据。在轴向和B扫描方向上测得的黄斑区域分辨率分别为11.7微米和46.8微米。与手动分割相比,视网膜层边界分割的平均绝对误差和标准偏差为4.5±3.2微米。因此,所提出的方法为评估水肿提供了一种自动,无创和定量的工具。     

Noninvasive detection of nanoscale structural changes in cornea associated with cross‐linking treatment

Corneal cross‐linking (CXL) using ultraviolet‐A (UVA) irradiation with a riboflavin photosensitizer has grown from an interesting concept to a practical clinical treatment for corneal ectatic diseases globally, such as keratoconus. To characterize the corneal structural changes, existing methods such as X‐ray microscopy, transmission electron microscopy, histology and optical coherence tomography (OCT) have been used. However, these methods have various drawbacks such as invasive detection, the impossibility for in vivo measurement, or limited resolution and sensitivity to structural alterations. Here, we report the application of oversampling nanosensitive OCT for probing the corneal structural alterations. The results indicate that the spatial period increases slightly after 30 minutes riboflavin instillation but decreases significantly after 30 minutes UVA irradiation following the Dresden protocol. The proposed noninvasive method can be implemented using existing OCT systems, without any additional components, for detecting nanoscale changes with the potential to assist diagnostic assessment during CXL treatment, and possibly to be a real‐time monitoring tool in clinics.     

A novel automatic 3D stitching algorithm for optical coherence tomography angiography and its application in dermatology

Optical coherence tomography (OCT) and OCT angiography (OCTA) techniques offer numerous advantages in clinical skin applications but the field of view (FOV) of current commercial systems are relatively limited to cover the entire skin lesion. The typical method to expand the FOV is to apply wide field objective lens. However, lateral resolution is often sacrificed when scanning with these lenses. To overcome this drawback, we developed an automated 3D stitching method for creating high-resolution skin structure and vascular volumes with large field of view, which was realized by montaging multiple adjacent OCT and OCTA volumes. The proposed stitching method is demonstrated by montaging 3 × 3 OCT and OCTA volumes (nine OCT/OCTA volumes as one data set with each volume covers 2.5 cm × 2.5 cm area) of healthy thin and thick skin from six volunteers. The proposed stitching protocol achieves high flexibility and repeatable for all the participants. Moreover, according to evaluation of structural similarity index and feature similarity index, our proposed stitched result has a superior similarity to single scanning protocol in large-scaled. We had also verified its improved performance through assessing metrics of vessel contrast-noise-ratio (CNR) from 2.07 ± 0.44 (single large-scaled scanning protocol) to 3.05 ± 0.51 (proposed 3 × 3 sub-volume stitching method).     

Cross‐scanning optical coherence tomography angiography for eye motion correction

We propose a cross‐scanning optical coherence tomography (CS‐OCT) system to correct eye motion artifacts in OCT angiography images. This system employs a dual‐illumination configuration with two orthogonally polarized beams, each of which simultaneously perform raster scanning in perpendicular direction with each other over the same area. In the reference arm, a polarization delay unit is used to acquire the two orthogonally polarized interferograms with a single photo detector by introducing different optical delay lines. The two cross‐scanned volume data are affected by the same eye motion but in two orthogonal directions. We developed a motion correction algorithm, which removes artifacts in the slow axis of each angiogram using the other and merges them through a nonrigid registration algorithm. In this manner, we obtained a motion‐corrected angiogram within a single volume scanning time without additional eye‐tracking devices.     

En‐face optical coherence tomography for the detection of cancer in prostatectomy specimens: Quantitative analysis in 20 patients

The increase histopathological evaluation of prostatectomy specimens rises the workload on pathologists. Automated histopathology systems, preferably directly on unstained specimens, would accelerate the pathology workflow. In this study, we investigate the potential of quantitative analysis of optical coherence tomography (OCT) to separate benign from malignant prostate tissue automatically. Twenty fixated prostates were cut, from which 54 slices were scanned by OCT. Quantitative OCT metrics (attenuation coefficient, residue, goodness‐of‐fit) were compared for different tissue types, annotated on the histology slides. To avoid misclassification, the poor‐quality slides, and edges of annotations were excluded. Accurate registration of OCT data with histology was achieved in 31 slices. After removing outliers, 56% of the OCT data was compared with histopathology. The quantitative data could not separate malignant from benign tissue. Logistic regression resulted in malignant detection with a sensitivity of 0.80 and a specificity of 0.34. Quantitative OCT analysis should be improved before clinical use.     

Dual‐ and single‐shot susceptibility ratio measurements with circular polarizations in second‐harmonic generation microscopy

Polarization‐resolved second‐harmonic generation (P‐SHG) microscopy is a technique capable of characterizing nonlinear optical properties of noncentrosymmetric biomaterials by extracting the nonlinear susceptibility tensor components ratio , with z‐axis parallel and x‐axis perpendicular to the C₆ symmetry axis of molecular fiber, such as a myofibril or a collagen fiber. In this paper, we present two P‐SHG techniques based on incoming and outgoing circular polarization states for a fast extraction of : A dual‐shot configuration where the SHG circular anisotropy generated using incident right‐ and left‐handed circularly‐polarized light is measured; and a single‐shot configuration for which the SHG circular anisotropy is measured using only one incident circular polarization state. These techniques are used to extract the of myosin fibrils in the body wall muscles of Drosophila melanogaster larva. The results are in good agreement with values obtained from the double Stokes‐Mueller polarimetry. The dual‐ and single‐shot circular anisotropy measurements can be used for fast imaging that is independent of the in‐plane orientation of the sample. They can be used for imaging of contracting muscles, or for high throughput imaging of large sample areas.     

Development a flexible light‐sheet fluorescence microscope for high‐speed 3D imaging of calcium dynamics and 3D imaging of cellular microstructure

We report a flexible light‐sheet fluorescence microscope (LSFM) designed for studying dynamic events in cardiac tissue at high speed in 3D and the correlation of these events to cell microstructure. The system employs two illumination‐detection modes: the first uses angle‐dithering of a Gaussian light sheet combined with remote refocusing of the detection plane for video‐rate volumetric imaging; the second combines digitally‐scanned light‐sheet illumination with an axially‐swept light‐sheet waist and stage‐scanned acquisition for improved axial resolution compared to the first mode. We present a characterisation of the spatial resolution of the system in both modes. The first illumination‐detection mode achieves dual spectral‐channel imaging at 25 volumes per second with 1024 × 200 × 50 voxel volumes and is demonstrated by time‐lapse imaging of calcium dynamics in a live cardiomyocyte. The second illumination‐detection mode is demonstrated through the acquisition of a higher spatial resolution structural map of the t‐tubule network in a fixed cardiomyocyte cell.     

The older plant gets the sun: Age‐related changes in Miscanthus × giganteus phenology

Age‐related changes are usually overlooked in perennial grass research; when they are considered it is usually as a change in plant size (e.g., biomass). Whether other physiological or developmental aspects change as stands age, and how those aspects may impact long‐term stand dynamics, remains unclear. Conventional experimental designs study a single stand over multiple growing seasons and thereby confound age‐related changes with growing season conditions. Here we used a staggered‐start experimental design with three repeated planting years over two growing seasons to isolate growing season effects. We studied changes in Miscanthus × giganteus phenology during its yield‐building stage (first 3 years) and estimated age, growing season and nitrogen (N) effects on development using nonlinear regression parameters. Stand age clearly changed plant growth; faster developmental rates were usually seen in 1‐year‐old stands (young), but because 2‐ and 3‐year‐old stands (mature) emerged 3 months earlier than newly planted stands they produced 30% more stems with 30%–60% more leaves. Nitrogen fertilization modulated some age‐related phenological changes. Fertilized 2‐year‐old stands reached similar stem densities as unfertilized 3‐year‐old stands and had fewer number of senesced leaves like 1‐year‐old stands. In addition, N fertilization had no effect on young M. × giganteus, but extended mature stands’ growing season more than 2 weeks by hastening emergence and delaying senescence. It also delayed flowering regardless of stand age. Our results suggest that, along with changes in size, M. × giganteus stands showed shifts in developmental strategies: young stands emerged later and developed faster, while mature stands grew for longer but more slowly. In temperate regions, where hard frost events are likely to interrupt development in late autumn, rapid early development is critical to plant survival. Nonlinear regression parameter differences proved effective in identifying phenological shifts.     

Reducing data acquisition for light‐sheet microscopy by extrapolation between imaged planes

Light‐sheet fluorescence microscopy (LSFM) is a powerful technique that can provide high‐resolution images of biological samples. Therefore, this technique offers significant improvement for three‐dimensional (3D) imaging of living cells. However, producing high‐resolution 3D images of a single cell or biological tissues, normally requires high acquisition rate of focal planes, which means a large amount of sample sections. Consequently, it consumes a vast amount of processing time and memory, especially when studying real‐time processes inside living cells. We describe an approach to minimize data acquisition by interpolation between planes using a phase retrieval algorithm. We demonstrate this approach on LSFM data sets and show reconstruction of intermediate sections of the sparse samples. Since this method diminishes the required amount of acquisition focal planes, it also reduces acquisition time of samples as well. Our suggested method has proven to reconstruct unacquired intermediate planes from diluted data sets up to 10× fold. The reconstructed planes were found correlated to the original preacquired samples (control group) with correlation coefficient of up to 90%. Given the findings, this procedure appears to be a powerful method for inquiring and analyzing biological samples.     

Multicontrast endomyocardial imaging by single‐channel high‐resolution cross‐polarization optical coherence tomography

A single‐channel high‐resolution cross‐polarization (CP) optical coherence tomography (OCT) system is presented for multicontrast imaging of human myocardium in one‐shot measurement. The intensity and functional contrasts, including the ratio between the cross‐ and co‐polarization channels as well as the cumulative retardation, are reconstructed from the CP‐OCT readout. By comparing the CP‐OCT results with histological analysis, it is shown that the system can successfully delineate microstructures in the myocardium and differentiate the fibrotic myocardium from normal or ablated myocardium based on the functional contrasts provided by the CP‐OCT system. The feasibility of using A‐line profiles from the 2 orthogonal polarization channels to identify fibrotic myocardium, normal myocardium and ablated lesion is also discussed.      

Optical coherence tomography image denoising using a generative adversarial network with speckle modulation

Optical coherence tomography (OCT) is widely used for biomedical imaging and clinical diagnosis. However, speckle noise is a key factor affecting OCT image quality. Here, we developed a custom generative adversarial network (GAN) to denoise OCT images. A speckle‐modulating OCT (SM‐OCT) was built to generate low speckle images to be used as the ground truth. In total, 210 000 SM‐OCT images were used for training and validating the neural network model, which we call SM‐GAN. The performance of the SM‐GAN method was further demonstrated using online benchmark retinal images, 3D OCT images acquired from human fingers and OCT videos of a beating fruit fly heart. The denoise performance of the SM‐GAN model was compared to traditional OCT denoising methods and other state‐of‐the‐art deep learning based denoise networks. We conclude that the SM‐GAN model presented here can effectively reduce speckle noise in OCT images and videos while maintaining spatial and temporal resolutions.     

Retinal pulse wave velocity measurement using spectral‐domain optical coherence tomography

The human eyes provide a natural window for noninvasive measurement of the pulse wave velocity (PWV) of small arteries. By measuring the retinal PWV, the stiffness of small arteries can be assessed, which may better detect early vascular diseases. Therefore, retinal PWV measurement has attracted increasing attention. In this study, a jump‐scanning method was proposed for noninvasive measurement of retinal PWV using spectral‐domain optical coherence tomography (SD‐OCT). The jump‐scanning method uses the phase‐resolved Doppler OCT to obtain the pulse shapes. To realize PWV measurement, the jump‐scanning method extracts the transit time of the pulse wave from an original OCT scanning site to another through a transient jump. The measured retinal arterial PWV of a young human subject with normal blood pressure was in the order of 20 to 30 mm/s, which was consistent with previous studies. As a comparison, PWV of 50 mm/s was measured for a young human subject with prehypertension, which was in accordance with the finding of strong association between retinal PWV and blood pressure. In summary, it is believed the proposed jump‐scanning method could benefit the research and diagnosis of vascular diseases through the window of human eyes.      

Shear‐induced diffusion of red blood cells measured with dynamic light scattering‐optical coherence tomography

Quantitative measurements of intravascular microscopic dynamics, such as absolute blood flow velocity, shear stress and the diffusion coefficient of red blood cells (RBCs), are fundamental in understanding the blood flow behavior within the microcirculation, and for understanding why diffuse correlation spectroscopy (DCS) measurements of blood flow are dominantly sensitive to the diffusive motion of RBCs. Dynamic light scattering‐optical coherence tomography (DLS‐OCT) takes the advantages of using DLS to measure particle flow and diffusion within an OCT resolution‐constrained three‐dimensional volume, enabling the simultaneous measurements of absolute RBC velocity and diffusion coefficient with high spatial resolution. In this work, we applied DLS‐OCT to measure both RBC velocity and the shear‐induced diffusion coefficient within penetrating venules of the somatosensory cortex of anesthetized mice. Blood flow laminar profile measurements indicate a blunted laminar flow profile and the degree of blunting decreases with increasing vessel diameter. The measured shear‐induced diffusion coefficient was proportional to the flow shear rate with a magnitude of ~0.1 to 0.5 × 10^?6 mm². These results provide important experimental support for the recent theoretical explanation for why DCS is dominantly sensitive to RBC diffusive motion.      

Evaluation of corneal structures in myopic eyes more than twenty‐two years after photorefractive keratectomy

The aim of this study is to evaluate corneal epithelial thickness (CET), corneal densitometry (CD) in 84 myopic eyes (57 patients) more than 22 years after photorefractive keratectomy, using anterior segment‐optical coherence tomography (AS‐OCT) and Scheimpflug imaging system. The CET was significantly higher in all operated eyes than in unoperated eyes in central sector. A statistically significant increase in CD in corneal anterior layer of central sector was shown in groups of operated eyes with greater ablation depth respect to unoperated eyes. While there was no significant difference in CD between the operated eyes groups with lower ablation depth and unoperated eyes. A significant trend toward higher values in anterior CD with deeper ablations in central sector was found. These noninvasive imaging techniques allow to better understand the corneal remodeling process after photoablation and to monitor the patients over time.     

Contrast‐enhanced optical coherence tomography for melanoma detection: An in vitro study

Optical coherence tomography (OCT), with a high‐spatial resolution (<10 microns), intermediate penetration depth (~1.5 mm) and volumetric imaging capability is a great candidate to be used as a diagnostic‐assistant modality in dermatology. At this time, the accuracy of OCT for melanoma detection is lower than anticipated. In this letter, we studied for the first time, the use of a novel contrast agent consist of ultra‐small nanoparticles conjugated to a melanoma biomarker to improve the accuracy of OCT for differentiation of melanoma cells from nonmelanoma cells, in vitro. We call this approach SMall nanoparticle Aggregation‐enhanced Radiomics of Tumor (SMART)‐OCT imaging. This initial proof of concept study is the first step toward the broad utilization of this method for high accuracy all types of tumor detection applications.