Inside Cover

A novel volumetric information fusion based on joint weighted evaluation and stationary wavelet transform is proposed. Threedimensional stationary wavelet transform was performed on multi-focus data to obtain wavelet coefficients. Differential evolution based on joint weighted evaluation was then employed to optimize the block size of division. Corresponding sub-coefficients of multi-focus data were fused with the proposed fusion rule. Finally, large volumetric and high-resolution photoacoustic imaging can be achieved by applying the inverse stationary wavelet transform. Further details can be found in the article by Xianlin Song, Sihang Li, Zhuangzhuang Wang, and| Xiongjun Cao ( e202200234 )

     

High-security photoacoustic identity recognition by capturing hierarchical vascular structure of finger

Currently, most biometric methods mainly use single features, making them easily forged and cracked. In this study, a novel triple-layers biometric recognition method, based on photoacoustic microscopy, is proposed to improve the security of biometric identity recognition. Using the photoacoustic (PA) dermoscope, three-dimensional absorption-structure information of the fingers was obtained. Then, by combining U-Net, Gabor filtering, wavelet analysis and morphological transform, a lightweight algorithm called photoacoustic depth feature recognition algorithm (PADFR) was developed to automatically realize stratification (the fingerprint, blood vessel fingerprint and venous vascular), extracting feature points and identity recognition. The experimental results show that PADFR can automatically recognize the PA hierarchical features with an average accuracy equal to 92.99%. The proposed method is expected to be widely used in biometric identification system due to its high security.     

Spherical-matching hyperbolic-array photoacoustic computed tomography

Linear-array photoacoustic computed tomography (LA-PACT), for its flexibility and simplicity, has great potential in providing anatomical and functional information of tissues. However, the limited coverage view impedes the LA-PACT obtaining high-quality images. In this study, a photoacoustic tomographic system with a hyperbolic-array transducer was developed for stereoscopic PA imaging of carotid artery. The hyperbolic-array PACT increases the receiving sensitivity for PA signal detection due to its transducer's geometric structure matching with the spherical wave. The control phantom experiment shows that the proposed system can expand the angular coverage of ∼1/3 more than that of the LA-PACT system, and the volumetric PA images of rat's carotid artery demonstrates the potential of the system for carotid artery imaging. Furthermore, volumetric imaging of the human forearm verifies that the system has significant capability in human imaging, which indicates that it has bright prospect for assisting diagnosis in the vascular disease.     

Is oblique scanning laser ophthalmoscope applicable to human ocular optics? A feasibility study using an eye model for volumetric imaging

Oblique scanning laser ophthalmoscopy (oSLO) is a novel imaging modality to provide volumetric retinal imaging without depth sectioning over a large field of view (FOV). It has been successfully demonstrated in vivo in rodent eyes for volumetric fluorescein angiography (vFA). However, engineering oSLO for human retinal imaging is challenging because of the low numerical aperture (NA) of human ocular optics. To overcome this challenge, we implement optical designs to (a) increase the angle of the intermediate image under Scheimpflug condition, and (b) expand the magnification in the depth dimension with cylindrical lens to enable sufficient sampling density. In addition, we adopt a scanning‐and‐descaning strategy, resulting in a compact oSLO system. We experimentally show that the current setup can achieve a FOV of ~3 × 6 × 0.8 mm³, and the transverse and axial resolutions of 7 and 41 μm, respectively. This feasibility study serves an important step for future in vivo human retinal imaging.     

Photoacoustic and ultrasound (PAUS) dermoscope with high sensitivity and penetration depth by using a bimorph transducer

A bimorph transducer was proposed to improve the detection sensitivity and imaging depth of photoacoustic and ultrasound (PAUS) dermoscope. By applying the bimorph transducer, the imaging depth and sensitivity of PAUS dermoscope were enhanced by simultaneously improving excitation efficiency and reception bandwidth. The integrated design of the imaging head of the dermoscope makes it highly convenient for detecting human skin. The PAUS imaging performance was demonstrated via visualizing subcutaneous tumor and depicting full structures of different skin layers from epidermis to subcutaneous tissue. The results confirm that the dermoscope with the bimorph transducer is well suited for PA and US dual‐modality imaging, which can provide multi‐information for skin disease.     

基于直线电机的大视场快速光声显微成像系统

光声成像技术是近年来发展的一种新型的无损医学成像技术,它是以脉冲激光作为激发源,以检测的声信号为信息载体,通过相应的图像重建算法重建组织内部结构和功能信息的成像方法。该方法结合了光学成像和声学成像的特点,可提供深层组织高分辨率和高对比度的组织层析图像,在生物医学临床诊断以及在体成像领域具有广泛的应用前景。目前光声成像的扫描方式主要有基于步进电机扫描方式和基于振镜的扫描方式,本文针对目前步进电机扫描速度慢(10 mm×10 mm;0.001帧/s),振镜扫描范围小(1 mm2)的不足,发展了基于直线电机扫描的大视场快速光声显微成像系统。同一条扫描线过程中直线电机速度最高可达200 mm/s。该技术采用逐线采集光声信号的方式,比逐点采集光声信号的步进电机快800倍。该系统对10 mm×10 mm全场扫描的扫描速度为0.8帧/s。最大可扫描视场范围可以达到50 mm×50 mm。大视场快速光声显微成像系统的发展将为生物医学提供新的成像工具。     

Deep learning protocol for improved photoacoustic brain imaging

One of the key limitations for the clinical translation of photoacoustic imaging is penetration depth that is linked to the tissue maximum permissible exposures (MPE) recommended by the American National Standards Institute (ANSI). Here, we propose a method based on deep learning to virtually increase the MPE in order to enhance the signal‐to‐noise ratio of deep structures in the brain tissue. The proposed method is evaluated in an in vivo sheep brain imaging experiment. We believe this method can facilitate clinical translation of photoacoustic technique in brain imaging, especially in transfontanelle brain imaging in neonates.     

Dynamic imaging of zebrafish heart with multi-planar light sheet microscopy

Light sheet fluorescence microscopy has become a research hotspot in biomedicine because of low phototoxicity, high speed, and high resolution. However, the conventional methods to acquire three-dimensional spatial information are mainly based on scanning, which inevitably increases photodamage and is not real-time. Here, we propose a method to generate controllable multi-planar illumination with a dielectric isosceles triangular array and a design of multi-planar light sheet fluorescence microscopy system. We carry out experiments of three-dimensional illumination beam measurement, volumetric imaging of fluorescent microspheres, and dynamic in vivo imaging of zebrafish heart to evaluate the performance of this system. In addition, we apply this system to study the effects of bisphenol fluorene on the heart shape and heart-beating rate of zebrafish. Our experiment results indicate that the multi-planar light sheet microscopy system provides a novel and feasible method for three-dimensional selected plane imaging and low-phototoxicity in vivo imaging.     

High-speed volumetric imaging in vivo based on structured illumination microscopy with interleaved reconstruction

Wide-field fluorescence microscopy (WFFM) is widely adopted in biomedical studies, due to its high imaging speed over large field-of-views. However, WFFM is susceptible to out-of-focus background. To overcome this problem, structured illumination microscopy (SIM) was proposed as a wide-field, optical-sectioning technique, which needs multiple raw images for image reconstruction and thus has a lower imaging speed. Here we propose SIM with interleaved reconstruction, to make SIM of lossless speed. We apply this method in volumetric imaging of neural network dynamics in brains of zebrafish larva in vivo.     

Miniature probe for dual‐modality photoacoustic microscopy and white‐light microscopy for image guidance: A prototype toward an endoscope

In this study, a novel photoacoustic microscopy (PAM) probe integrating white‐light microscopy (WLM) modality that provides guidance for PAM imaging and complementary information is implemented. One single core of an imaging fiber bundle is employed to deliver a pulsed laser for photoacoustic excitation for PAM mode, which provides high resolution with deep penetration. Meanwhile, for WLM mode, the imaging fiber bundle is used to transmit two‐dimensional superficial images. Lateral resolution of 7.2 μm for PAM is achieved. Since miniature components are used, the probe diameter is only 1.7 mm. Imaging of phantom and animals in vivo is conducted to show the imaging capability of the probe. The probe has several advantages by introducing the WLM mode, such as being able to conveniently identify regions of interest and align the focus for PAM mode. The prototype of an endoscope shows potential to facilitate clinical photoacoustic endoscopic applications.     

Single-shot optical projection tomography for high-speed volumetric imaging of dynamic biological samples

A single-shot adaptation of Optical Projection Tomography (OPT) for high-speed volumetric snapshot imaging of dynamic mesoscopic biological samples is presented. Conventional OPT has been applied to in vivo imaging of animal models such as D. rerio, but the sequential acquisition of projection images typically requires samples to be immobilized during the acquisition. A proof-of-principle system capable of single-shot tomography of a ~1 mm³ volume is presented, demonstrating camera-limited rates of up to 62.5 volumes/s, which has been applied to 3D imaging of a freely swimming zebrafish embryo. This is achieved by recording eight projection views simultaneously on four low-cost CMOS cameras. With no stage required to rotate the sample, this single-shot OPT system can be implemented with a component cost of under £5000. The system design can be adapted to different sized fields of view and may be applied to a broad range of dynamic samples, including high throughput flow cytometry applied to model organisms and fluid dynamics studies.     

Optical‐resolution photoacoustic microscopy with ultrafast dual‐wavelength excitation

Fast functional and molecular photoacoustic microscopy requires pulsed laser excitations at multiple wavelengths with enough pulse energy and short wavelength‐switching time. Recent development of stimulated Raman scattering in optical fiber offers a low‐cost laser source for multiwavelength photoacoustic imaging. In this approach, long fibers temporally separate different wavelengths via optical delay. The time delay between adjacent wavelengths may eventually limits the highest A‐line rate. In addition, a long‐time delay in fiber may limit the highest pulse energy, leading to poor image quality. In order to achieve high pulse energy and ultrafast dual‐wavelength excitation, we present optical‐resolution photoacoustic microscopy with ultrafast dual‐wavelength excitation and a signal separation method. The signal separation method is validated in numerical simulation and phantom experiments. We show that when two photoacoustic signals are partially overlapped with a 50‐ns delay, they can be recovered with 98% accuracy. We apply this ultrafast dual‐wavelength excitation technique to in vivo OR‐PAM. Results demonstrate that A‐lines at two wavelengths can be successfully separated, and sO₂ values can be reliably computed from the separated data. The ultrafast dual‐wavelength excitation enables fast functional photoacoustic microscopy with negligible misalignment among different wavelengths and high pulse energy, which is important for in vivo imaging of microvascular dynamics.     

Miniature intravascular photoacoustic endoscopy with coaxial excitation and detection

Recent research pointed out that the degree of inflammation in the adventitia could correlate with the severity of atherosclerotic plaques. Intravascular photoacoustic endoscopy can provide the information of arterial morphology and plaque composition, and even detecting the inflammation. However, most reported work used a noncoaxial configuration for the photoacoustic catheter design, which formed a limited light-sound overlap area for imaging so as to miss the adventitia information. Here we developed a novel 0.9 mm-diameter intravascular photoacoustic catheter with coaxial excitation and detection to resolve the aforementioned issue. A miniature hollow ultrasound transducer with a 0.18 mm-diameter orifice in the center was successfully fabricated. To show the significance and merits of our design, phantom and ex vivo imaging experiments were conducted on both coaxial and noncoaxial catheters for comparison. The results demonstrated that the coaxial catheter exhibited much better photoacoustic/ultrasound imaging performance from the intima to the adventitia.     

Front Cover: Wide‐field monitoring and real‐time local recording of microvascular networks on small animals with a dual‐raster‐scanned photoacoustic microscope

A dual‐raster‐scanned photoacoustic microscope (DRS‐PAM) was reported, which integrates a two‐dimensional motorized translation stage for large field‐of‐view imaging and a two‐axis fast galvanometer scanner for real‐time imaging. The DRS‐PAM provides a flexible transition from wide‐field monitoring the vasculature of organs to real‐time imaging of local dynamics. Further details can be found in the article by Fei Yang, Zhiyang Wang, Wuyu Zhang, et al. ( e202000022 ).

     

Wide‐field monitoring and real‐time local recording of microvascular networks on small animals with a dual‐raster‐scanned photoacoustic microscope

Photoacoustic microscopy (PAM) provides a new method for the imaging of small‐animals with high‐contrast and deep‐penetration. However, the established PAM systems have suffered from a limited field‐of‐view or imaging speed, which are difficult to both monitor wide‐field activity of organ and record real‐time change of local tissue. Here, we reported a dual‐raster‐scanned photoacoustic microscope (DRS‐PAM) that integrates a two‐dimensional motorized translation stage for large field‐of‐view imaging and a two‐axis fast galvanometer scanner for real‐time imaging. The DRS‐PAM provides a flexible transition from wide‐field monitoring the vasculature of organs to real‐time imaging of local dynamics. To test the performance of DRS‐PAM, clear characterization of angiogenesis and functional detail was illustrated, hemodynamic activities of vasculature in cerebral cortex of a mouse were investigated. Furthermore, response of tumor to treatment were successfully monitored during treatment. The experimental results demonstrate the DRS‐PAM holds the great potential for biomedical research of basic biology.     

一体化的光声-荧光显微镜用于活体肿瘤成像

报道了一种利用单一波长激发的同时产生光声和荧光信号的显微成像系统,本成像系统具有超高的成像分辨率(<6μm)。借助外源的造影剂在近红外的吸收特性,利用光声-荧光显微成像系统对活体肿瘤进行光声/荧光成像。实验结果表明,光声-荧光显微镜在早期肿瘤的成像和检测等方面具有潜在的应用价值。因此,通过研究和选择适当的双模态造影剂,该系统在不同病理模型中可以提供更准确的组织信息及生理参数。     

Theoretical background of light‐emitting diode total internal reflection fluorescence microscopy and photobleaching lifetime analysis of membrane‐associated proteins—Part II

The selective microscopic imaging of the plasma membrane and adjacent structures by total internal reflection fluorescence (TIRF) microscopy is a versatile and frequently used technique in cell biology. A reduction of imaging artifacts in objective‐type TIRF microscopy can be achieved by circular or multi‐spot laser illumination or by using noncoherent light sources that are projected into the back focal plane as a light annulus. Light‐emitting diode (LED)‐based TIRF excitation is a recent advancement of the latter strategy. While some basic principles of LED‐TIRF remain the same as in laser‐based methods, the calculation of penetration depth, the flatness of illumination and the amount of available illumination power differ. This study provides the theoretical framework for the construction and adjustment of LED‐TIRF. Using state‐of‐the art high power LED emitters, LED‐TIRF achieves excitation efficiencies that are comparable to laser‐based systems and homogenously illuminate the entire field of view, thus, allowing variation of the penetration depth or quantitative photobleaching‐assisted imaging protocols. Using autofluorescent transmembrane, soluble and membrane‐attached fusion proteins, we provide examples for a photobleaching‐based assessment of the exchange kinetics of proteins within living human endothelial cells.     

Reduction in required volume of imaging data and image reconstruction time for adaptive-illumination Fourier ptychographic microscopy

Fourier ptychographic microscopy (FPM) is a promising super-resolution computational imaging technology. It stitches a series of low-resolution (LR) images in the Fourier domain by an iterative method. Thus, it obtains a large field of view and high-resolution quantitative phase images. Owing to its capability to perform high-spatial bandwidth product imaging, FPM is widely used in the reconstruction of conventional static samples. However, the influence of the FPM imaging mechanism limits its application in high-speed dynamic imaging. To solve this problem, an adaptive-illumination FPM scheme using regional energy estimation is proposed. Starting with several captured real LR images, the energy distribution of all LR images is estimated, and select the measurement images with large information to perform FPM reconstruction. Simulation and experimental results show that the method produces efficient imaging performance and reduces the required volume of data to more than 65% while ensuring the quality of FPM reconstruction.     

Noise suppressed,multifocus image fusion for enhanced intraoperative navigation

Current intraoperative imaging systems are typically not able to provide ‘sharp’ images over entire large areas or entire organs. Distinct structures such as tissue margins or groups of malignant cells are therefore often difficult to detect, especially under low signal‐to‐noise‐ratio conditions. In this report, we introduce a noise suppressed multifocus image fusion algorithm, that provides detailed reconstructions even when images are acquired under sub‐optimal conditions, such is the case for real time fluorescence intraoperative surgery. The algorithm makes use of the Anscombe transform combined with a multi‐level stationary wavelet transform with individual threshold‐based shrinkage. While the imaging system is integrated with a respiratory monitor triggering system, it can be easily adapted to any commercial imaging system. The developed algorithm is made available as a plugin for Osirix. (© 2013 WILEY‐VCH Verlag GmbH & Co. KGaA, Weinheim)     

Integrating photoacoustic microscopy with other imaging technologies for multimodal imaging

As a hybrid optical microscopic imaging technology, photoacoustic microscopy images the optical absorption contrasts and takes advantage of low acoustic scattering of biological tissues to achieve high-resolution anatomical and functional imaging. When combined with other imaging modalities, photoacoustic microscopy-based multimodal technologies can provide complementary contrast mechanisms to reveal complementary information of biological tissues. To achieve intrinsically and precisely registered images in a multimodal photoacoustic microscopy imaging system, either the ultrasonic transducer or the light source can be shared among the different imaging modalities. These technologies are the major focus of this minireview. It also covered the progress of the recently developed penta-modal photoacoustic microscopy imaging system featuring a novel dynamic focusing technique enabled by OCT contour scan.