Automated quantification of superficial retinal capillaries and large vessels for diabetic retinopathy on optical coherence tomographic angiography

Optical coherence tomography angiography (OCTA) is a relatively new technique with capillary‐level resolution, which has shown great potential for the diagnosis of diabetic retinopathy (DR). A fully automatic algorithm for the quantitative measurement of microcirculatory changes in sight‐threatening DR is presented. The foveal avascular zone (FAZ) segmentation was improved with a graph‐theoretic method and the large vessels and capillaries were separately identified and analyzed. The method was evaluated in healthy and diabetic eyes with various stages of retinopathy. Results showed that, compared with the healthy group, the diabetic group showed a significantly larger large vessel density, but a significantly smaller capillary density (P < .001). Circularity of FAZ was significantly smaller while nonperfusion area was significantly larger in the diabetic group. The combined variable of all image metrics reached an area under the ROC of 0.853 (95% CI, 0.784‐0.923) for mild to moderate nonproliferative DR and 0.950 (95% CI, 0.922‐0.979) for proliferative DR. Microvascular and FAZ changes with various DR stages can be accurately delineated using the developed automatic program. Quantitative metrics on OCTA serve as potential biomarkers for the staging of DR.     

Quantitative and rapid estimations of human sub‐surface skin mass using ultra‐high‐resolution spectral domain optical coherence tomography

Non‐invasive and quantitative estimations for the delineation of sub‐surface tumor margins could greatly aid in the early detection and monitoring of the morphological appearances of tumor growth, ensure complete tumor excision without the unnecessary sacrifice of healthy tissue, and facilitate post‐operative follow‐up for recurrence. In this study, a high‐speed, non‐invasive, and ultra‐high‐resolution spectral domain optical coherence tomography (UHR‐SDOCT) imaging platform was developed for the quantitative measurement of human sub‐surface skin mass. With a proposed robust, semi‐automatic analysis, the system can rapidly quantify lesion area and shape regularity by an en‐face‐oriented algorithm. Various sizes of nylon sutures embedded in pork skin were used first as a phantom to verify the accuracy of our algorithm, and then in vivo, feasibility was proven using benign human angiomas and pigmented nevi. Clinically, this is the first step towards an automated skin lesion measurement system.

In vivo optical coherence tomography (OCT) image of angioma (A). Thin red arrows point to a blood vessel (BV).     

Quantification of diabetic macular ischemia using novel three‐dimensional optical coherence tomography angiography metrics

We applied three‐dimensional (3D) analysis to optical coherence tomography angiography (OCTA) to measure macular ischemia in eyes affected by non‐proliferative diabetic retinopathy (DR). A previously validated algorithm was applied to OCTA data in order to obtain 3D visualization of the retinal vasculature. Successively, a global thresholding algorithm was applied and two novel quantitative metrics were introduced: 3D vascular volume and 3D perfusion density. Two‐dimensional (2D) OCTA metrics were also obtained with different binarization thresholds for comparison. Of the 30 patients included, 15 were diagnosed with DR and 15 were controls. The 3D vascular volume and 3D perfusion density were reduced in DR eyes (P < .0001). The 2D variables also significantly differ between groups. The 3D perfusion density had the highest area under the receiver operating characteristic curve (0.964) among tested variables. Assessing quantitative perfusion using 3D analysis is reliable and promising, and with an elevated diagnostic efficacy in identifying DR eyes.     

An automated framework to quantify areas of regional ischemia in retinal vascular diseases with OCT angiography

In this observational and cross‐sectional study, capillary nonperfusion (CNP) and vascular changes in branch retinal vein occlusion (BRVO, sample size [n] = 26) and choroidal neovascularization (CNV, n = 29) were evaluated. Subjects underwent imaging using Optical coherence tomography angiography (Angiovue OCTA, RTVue XR, Optovue Inc., Fremont, California). Local fractal analysis was applied to the OCTA images of superficial, deep and choriocapillaris layer. CNP area (BRVO eyes) and vascular parameters were computed using local fractal‐based method. Sensitivity and specificity of vascular parameters were assessed with receiver operating characteristics curve. Automated CNP area showed excellent agreement with manually quantified CNP areas in both superficial (intraclass coefficient [ICC] = 0.96) and deep (ICC = 0.96) layers. BRVO eyes showed significantly altered (P < .05) vascular parameters in both superficial and deep layer as compared to normal eyes (n = 30). CNVM eyes had significantly higher capillary free zones (P < .001) as compared to normal eyes. In normal vs BRVO eyes, vessel density and spacing between the large vessels had similar area under the curve (AUC) (P > .05) in both superficial (0.97 and 0.97, respectively) and deep layer (0.99 and 0.98, respectively). Further, capillary free zones showed high AUC (0.92) in differentiating CNV eyes from normal eyes.      

Physiological model using diffuse reflectance spectroscopy for nonmelanoma skin cancer diagnosis

Diffuse reflectance spectroscopy (DRS) is a noninvasive, fast, and low‐cost technology with potential to assist cancer diagnosis. The goal of this study was to test the capability of our physiological model, a computational Monte Carlo lookup table inverse model, for nonmelanoma skin cancer diagnosis. We applied this model on a clinical DRS dataset to extract scattering parameters, blood volume fraction, oxygen saturation and vessel radius. We found that the model was able to capture physiological information relevant to skin cancer. We used the extracted parameters to classify (basal cell carcinoma [BCC], squamous cell carcinoma [SCC]) vs actinic keratosis (AK) and (BCC, SCC, AK) vs normal. The area under the receiver operating characteristic curve achieved by the classifiers trained on the parameters extracted using the physiological model is comparable to that of classifiers trained on features extracted via Principal Component Analysis. Our findings suggest that DRS can reveal physiologic characteristics of skin and this physiologic model offers greater flexibility for diagnosing skin cancer than a pure statistical analysis. Physiological parameters extracted from diffuse reflectance spectra data for nonmelanoma skin cancer diagnosis.     

Flexible wide‐field optical micro‐angiography based on Fourier‐domain multiplexed dual‐beam swept source optical coherence tomography

Wide‐field optical coherence tomography angiography (OCTA) is gaining interest in clinical imaging applications. In this pursuit, it is challenging to maintain the imaging resolution and sensitivity throughout the wide field of view (FoV). Here, we propose a novel method/system of dual‐beam arrangement and Fourier‐domain multiplexing to achieve wide‐field OCTA when imaging the uneven surface samples. The proposed system provides 2 separate FoVs, with flexibility that the imaging area, focus of the imaging beam and imaging depth range can be individually adjusted for each FoV, leading to either (1) increased system imaging FoV or (2) capability of targeting 2 regions of interests that locate at depths with large difference between each other. We demonstrate this novel method by employing 100 kHz laser source in a swept source OCTA to achieve an effective 200 kHz sweeping rate, covering a 22 × 22 mm FoV. The results are verified by a SS‐OCTA system employing a 200 kHz laser source, together with the experimental demonstrations when imaging whole brain vasculature in rodent models and skin blood perfusion in human fingers, show‐casing the capability of proposed system to image live large samples with complex surface topography.      

Machine learning in optical coherence tomography angiography

Optical coherence tomography angiography (OCTA) offers a noninvasive label-free solution for imaging retinal vasculatures at the capillary level resolution. In principle, improved resolution implies a better chance to reveal subtle microvascular distortions associated with eye diseases that are asymptomatic in early stages. However, massive screening requires experienced clinicians to manually examine retinal images, which may result in human error and hinder objective screening. Recently, quantitative OCTA features have been developed to standardize and document retinal vascular changes. The feasibility of using quantitative OCTA features for machine learning classification of different retinopathies has been demonstrated. Deep learning-based applications have also been explored for automatic OCTA image analysis and disease classification. In this article, we summarize recent developments of quantitative OCTA features, machine learning image analysis, and classification.     

A novel automatic 3D stitching algorithm for optical coherence tomography angiography and its application in dermatology

Optical coherence tomography (OCT) and OCT angiography (OCTA) techniques offer numerous advantages in clinical skin applications but the field of view (FOV) of current commercial systems are relatively limited to cover the entire skin lesion. The typical method to expand the FOV is to apply wide field objective lens. However, lateral resolution is often sacrificed when scanning with these lenses. To overcome this drawback, we developed an automated 3D stitching method for creating high-resolution skin structure and vascular volumes with large field of view, which was realized by montaging multiple adjacent OCT and OCTA volumes. The proposed stitching method is demonstrated by montaging 3 × 3 OCT and OCTA volumes (nine OCT/OCTA volumes as one data set with each volume covers 2.5 cm × 2.5 cm area) of healthy thin and thick skin from six volunteers. The proposed stitching protocol achieves high flexibility and repeatable for all the participants. Moreover, according to evaluation of structural similarity index and feature similarity index, our proposed stitched result has a superior similarity to single scanning protocol in large-scaled. We had also verified its improved performance through assessing metrics of vessel contrast-noise-ratio (CNR) from 2.07 ± 0.44 (single large-scaled scanning protocol) to 3.05 ± 0.51 (proposed 3 × 3 sub-volume stitching method).     

Jones matrix‐based speckle‐decorrelation angiography using polarization‐sensitive optical coherence tomography

We show that polarization‐sensitive optical coherence tomography angiography (PS‐OCTA) based on full Jones matrix assessment of speckle decorrelation offers improved contrast and depth of vessel imaging over conventional OCTA. We determine how best to combine the individual Jones matrix elements and compare the resulting image quality to that of a conventional OCT scanner by co‐locating and imaging the same skin locations with closely matched scanning setups. Vessel projection images from finger and forearm skin demonstrate the benefits of Jones matrix‐based PS‐OCTA. Our study provides a promising starting point and a useful reference for future pre‐clinical and clinical applications of Jones matrix‐based PS‐OCTA.     

Multiparametric evaluation of hindlimb ischemia using time‐series indocyanine green fluorescence imaging

Peripheral arterial disease (PAD) can further cause lower limb ischemia. Quantitative evaluation of the vascular perfusion in the ischemic limb contributes to diagnosis of PAD and preclinical development of new drug. In vivo time‐series indocyanine green (ICG) fluorescence imaging can noninvasively monitor blood flow and has a deep tissue penetration. The perfusion rate estimated from the time‐series ICG images is not enough for the evaluation of hindlimb ischemia. The information relevant to the vascular density is also important, because angiogenesis is an essential mechanism for post‐ischemic recovery. In this paper, a multiparametric evaluation method is proposed for simultaneous estimation of multiple vascular perfusion parameters, including not only the perfusion rate but also the vascular perfusion density and the time‐varying ICG concentration in veins. The target method is based on a mathematical model of ICG pharmacokinetics in the mouse hindlimb. The regression analysis performed on the time‐series ICG images obtained from a dynamic reflectance fluorescence imaging system. The results demonstrate that the estimated multiple parameters are effective to quantitatively evaluate the vascular perfusion and distinguish hypo‐perfused tissues from well‐perfused tissues in the mouse hindlimb. The proposed multiparametric evaluation method could be useful for PAD diagnosis.

The estimated perfusion rate and vascular perfusion density maps (left) and the time‐varying ICG concentration in veins of the ankle region (right) of the normal and ischemic hindlimbs.     

Multiphoton Multispectral Fluorescence Lifetime Tomography for the Evaluation of Basal Cell Carcinomas

We present the first detailed study using multispectral multiphoton fluorescence lifetime imaging to differentiate basal cell carcinoma cells (BCCs) from normal keratinocytes. Images were acquired from 19 freshly excised BCCs and 27 samples of normal skin (in & ex vivo). Features from fluorescence lifetime images were used to discriminate BCCs with a sensitivity/specificity of 79%/93% respectively. A mosaic of BCC fluorescence lifetime images covering >1 mm² is also presented, demonstrating the potential for tumour margin delineation. Using 10,462 manually segmented cells from the image data, we quantify the cellular morphology and spectroscopic differences between BCCs and normal skin for the first time. Statistically significant increases were found in the fluorescence lifetimes of cells from BCCs in all spectral channels, ranging from 19.9% (425–515 nm spectral emission) to 39.8% (620–655 nm emission). A discriminant analysis based diagnostic algorithm allowed the fraction of cells classified as malignant to be calculated for each patient. This yielded a receiver operator characteristic area under the curve for the detection of BCC of 0.83. We have used both morphological and spectroscopic parameters to discriminate BCC from normal skin, and provide a comprehensive base for how this technique could be used for BCC assessment in clinical practice.     

Optoacoustic mesoscopy analysis and quantitative estimation of specific imaging metrics in Fitzpatrick skin phototypes II to V

Raster Scanning Optoacoustic Mesoscopy (RSOM) is a novel optoacoustic imaging modality that offers non‐invasive, label‐free, high resolution (~7 μm axial, ~30 μm lateral) imaging up to 1 to 2 mm below the skin, providing novel quantitative insights into skin pathophysiology. As the RSOM image contrast mechanism is based on light absorption, it is expected that the amount of melanin present in the skin will affect RSOM images. However, the effect of skin tone in the performance of RSOM has not been addressed so far. Herein, we present the efficiency of RSOM for in vivo skin imaging of human subjects with Fitzpatrick (FP) skin types between II to V. RSOM images acquired from the volar forearms of the subjects were used to derive metrics used in RSOM studies, such as total blood volume, vessel diameter and melanin signal intensity. Our study shows that the melanin signal intensity derived from the RSOM images exhibited an excellent correlation with that obtained from a clinical colorimeter for the subjects of varying FP skin types. We could successfully estimate the vessel diameter at different depths of the dermis. Furthermore, our study shows that there is a need to compensate for total blood volume calculated for subjects with higher FP skin types due to the lower signal‐to‐noise ratio in dermis, owing to strong absorption of light by melanin. This study sheds light into how RSOM can be used for studying various skin conditions in populations with different skin phenotypes.     

Quantitative investigation of vascular response to mesenteric venous thrombosis using large‐field‐of‐view photoacoustic microscopy

Mesenteric venous thrombosis (MVT) is one of major causes leading to severe mesenteric ischemia. Vascular network plays an important role during the occurrence and development of MVT. However, there lacks an appropriate imaging method, which features advanced volumetric resolving capability, superior sensitivity to hemoglobin, and ultra‐large field‐of‐view (FOV), to investigate vascular response of MVT. In this study, we developed and applied a large‐FOV optical resolution photoacoustic microscopy to quantify the vascular response during the entire course of two different MVT models in which we ligated the superior mesenteric vein and inferior mesenteric vein, respectively. Furthermore, we developed a quantitative algorithm to derive total vascular length, relative concentration of total hemoglobin and vascular density over the FOV to reveal different vascular responses in different MVT models.     

Polarization‐multiplexed,dual‐beam swept source optical coherence tomography angiography

A polarization‐multiplexed, dual‐beam setup is proposed to expand the field of view (FOV) for a swept source optical coherence tomography angiography (OCTA) system. This method used a Wollaston prism to split sample path light into 2 orthogonal‐polarized beams. This allowed 2 beams to shine on the cornea at an angle separation of ~14°, which led to a separation of ~4.2 mm on the retina. A 3‐mm glass plate was inserted into one of the beam paths to set a constant path length difference between the 2 polarized beams so the interferogram from the 2 beams are coded at different frequency bands. The resulting OCTA images from the 2 beams were coded with a depth separation of ~2 mm. A total of 5 × 5 mm² angiograms from the 2 beams were obtained simultaneously in 4 seconds. The 2 angiograms then were montaged to get a wider FOV of ~5 × 9.2 mm².      

Endoscopic optical coherence tomography angiography using a forward imaging piezo scanner probe

A forward imaging endoscope for optical coherence tomography angiography (OCTA) featuring a piezoelectric fiber scanner is presented. Imaging is performed with an optical coherence tomography (OCT) system incorporating an akinetic light source with a center wavelength of 1300 nm, bandwidth of 90 nm and A‐line rate of 173 kHz. The endoscope operates in contact mode to avoid motion artifacts, in particular, beneficial for OCTA measurements, and achieves a transversal resolution of 12 μm in air at a rigid probe size of 4 mm in diameter and 11.3 mm in length. A spiral scan pattern is generated at a scanning frequency of 360 Hz to sample a maximum field of view of 1.3 mm. OCT images of a human finger as well as visualization of microvasculature of the human palm are presented both in two and three dimensions. The combination of morphological tissue contrast with qualitative dynamic blood flow information within this endoscopic imaging approach potentially enables improved early diagnostic capabilities of internal organs for diseases such as bladder cancer.      

Automatic and label‐free identification of blood vessels in gliomas using the combination of multiphoton microscopy and image analysis

Currently, the targeted treatment of tumor based on the tumor microenvironment is newly developed. Blood vessels are the key parts in the tumor microenvironment, which is taken as a new visible target for tumor therapy. Multiphoton microscopy (MPM), based on the second harmonic generation and two‐photon excited fluorescence, is available to make the label‐free analysis on the blood vessels in human gliomas. MPM can reveal the vascular morphological characteristics in gliomas, including vascular malformation, intense vascular proliferation, perivascular collagen deposition, perivascular lymphocytes aggregation and microvascular proliferation. In addition, the image analysis algorithms were developed to automatically calculate the perivascular collagen content, vascular cavity area, lumen area, wall area and vessel number. Thus, the vascular morphology, the perivascular collagen deposition and intense vascular proliferation degree can be further quantitatively characterized. Compared with the pathological analysis, the combination of MPM and image analysis has potential advantages in making a quantitative and qualitative analyzing on vascular morphology in glioma microenvironment. As micro‐endoscope and two‐photon fiberscope are technologically improved, this combined method will be a useful imaging way to make the real‐time research on the targeting tumor microenvironment in gliomas.     

Quantitative evaluation of optical coherence tomography angiography images of diabetic retinopathy eyes before and after removal of projection artifacts

Projection artifacts (PAs) affect the quantification of vascular parameters in the deep layer optical coherence tomography (OCT) angiography image. This study eliminated PA and quantified its effect on imaging. 53 eyes (30 subjects) of normal Indian subjects and 113 eyes (92 patients) of type 2 diabetes mellitus with retinopathy (DR) underwent imaging with a scan area of 3 mm × 3 mm. In this study, a normalized cross‐correlation between superficial and deep layer was used to remove PA in deep layer. Local fractal analysis was done to compute vascular parameters such as foveal avascular zone area (mm²), vessel density (%), spacing between large vessels (%) and spacing between small vessels (%). Before PA removal, vessel density for mild nonproliferative (NPDR), moderate NPDR, severe NPDR and proliferative DR were 42.56 ±1.69%, 40.69 ±0.72%, 37.34 ±0.85% and 35.61 ±1.26%, respectively. After artifact removal, vessel density was 28.9 ±1.22%, 29.9 ±0.56%, 26.19 ±0.59% and 24.02 ±0.94%, respectively. All the vascular parameters were statistically significant (P <.001) between normal and disease eyes, irrespective of superficial and deep retinal layers. Parafoveal sectoral analyses showed that temporal zone had the lowest vessel density and may undergo DR‐related changes first. The current approach enabled rapid and accurate quantitative interpretation of DR eyes, without PA.      

Three‐dimensional multispectral optoacoustic mesoscopy reveals melanin and blood oxygenation in human skin in vivo

Optical imaging plays a major role in disease detection in dermatology. However, current optical methods are limited by lack of three‐dimensional detection of pathophysiological parameters within skin. It was recently shown that single‐wavelength optoacoustic (photoacoustic) mesoscopy resolves skin morphology, i.e. melanin and blood vessels within epidermis and dermis. In this work we employed illumination at multiple wavelengths for enabling three‐dimensional multispectral optoacoustic mesoscopy (MSOM) of natural chromophores in human skin in vivo operating at 15–125 MHz. We employ a per‐pulse tunable laser to inherently co‐register spectral datasets, and reveal previously undisclosed insights of melanin, and blood oxygenation in human skin. We further reveal broadband absorption spectra of specific skin compartments. We discuss the potential of MSOM for label‐free visualization of physiological biomarkers in skin in vivo.

Cross‐sectional optoacoustic image of human skin in vivo. The epidermal layer is characterized by melanin absorption. A vascular network runs through the dermal layer, exhibiting blood oxygenation values of 50–90%. All scale bars: 250 µm