Portable deep learning singlet microscope

Having the least lenses, the significant feature of the singlet imaging system, helps the development of the portable and cost‐effective microscopes. A novel method of monochromatic/color singlet microscopy, which is combined with only one aspheric lens and deep learning computational imaging technology, is proposed in this article. The designed singlet aspheric lens is an approximate linear signal system, which means modulation‐transfer‐function curves on all field‐of‐views (5 mm diagonally) are almost coincident with each other. The purpose of the designed linear signal system is to further improve the resolution of our microscope by using deep learning algorithm. As a proof of concept, we designed a singlet microscopy based on our method, which weighs only 400 g. The experimental data and results of the sample USAF?1951 target and bio‐sample (the Equisetum‐arvense Strobile L.S), prove that the performance of the proposed singlet microscope is competitive to a commercial microscope with the 4X/NA0.1 objective lens. We believe that our idea and method would guide to design more cost‐effective and powerful singlet imaging system.     

Fast denoising and lossless spectrum extraction in stimulated Raman scattering microscopy

Stimulated Raman scattering (SRS) microscopy is a nonlinear optical imaging method for visualizing chemical content based on molecular vibrational bonds. However, the imaging speed and sensitivity are currently limited by the noise of the light beam probing the Raman process. In this paper, we present a fast non-average denoising and high-precision Raman shift extraction method, based on a self-reinforcing signal-to-noise ratio (SNR) enhancement algorithm, for SRS spectroscopy and microscopy. We compare the results of this method with the filtering methods and the reported experimental methods to demonstrate its high efficiency and high precision in spectral denoising, Raman peak extraction and image quality improvement. We demonstrate a maximum SNR enhancement of 10.3 dB in fixed tissue imaging and 11.9 dB in vivo imaging. This method reduces the cost and complexity of the SRS system and allows for high-quality SRS imaging without use of special laser, complicated system design and Raman tags.     

Neuromodulation and Mitochondrial Transport: Live Imaging in Hippocampal Neurons over Long Durations

To understand the relationship between mitochondrial transport and neuronal function, it is critical to observe mitochondrial behavior in live cultured neurons for extended durations^1-3. This is now possible through the use of vital dyes and fluorescent proteins with which cytoskeletal components, organelles, and other structures in living cells can be labeled and then visualized via dynamic fluorescence microscopy. For example, in embryonic chicken sympathetic neurons, mitochondrial movement was characterized using the vital dye rhodamine 123⁴. In another study, mitochondria were visualized in rat forebrain neurons by transfection of mitochondrially targeted eYFP⁵. However, imaging of primary neurons over minutes, hours, or even days presents a number of issues. Foremost among these are: 1) maintenance of culture conditions such as temperature, humidity, and pH during long imaging sessions; 2) a strong, stable fluorescent signal to assure both the quality of acquired images and accurate measurement of signal intensity during image analysis; and 3) limiting exposure times during image acquisition to minimize photobleaching and avoid phototoxicity.Here, we describe a protocol that permits the observation, visualization, and analysis of mitochondrial movement in cultured hippocampal neurons with high temporal resolution and under optimal life support conditions. We have constructed an affordable stage-top incubator that provides good temperature regulation and atmospheric gas flow, and also limits the degree of media evaporation, assuring stable pH and osmolarity. This incubator is connected, via inlet and outlet hoses, to a standard tissue culture incubator, which provides constant humidity levels and an atmosphere of 5-10% CO₂/air. This design offers a cost-effective alternative to significantly more expensive microscope incubators that don''t necessarily assure the viability of cells over many hours or even days. To visualize mitochondria, we infect cells with a lentivirus encoding a red fluorescent protein that is targeted to the mitochondrion. This assures a strong and persistent signal, which, in conjunction with the use of a stable xenon light source, allows us to limit exposure times during image acquisition and all but precludes photobleaching and phototoxicity. Two injection ports on the top of the stage-top incubator allow the acute administration of neurotransmitters and other reagents intended to modulate mitochondrial movement. In sum, lentivirus-mediated expression of an organelle-targeted red fluorescent protein and the combination of our stage-top incubator, a conventional inverted fluorescence microscope, CCD camera, and xenon light source allow us to acquire time-lapse images of mitochondrial transport in living neurons over longer durations than those possible in studies deploying conventional vital dyes and off-the-shelf life support systems.     

Deep-skin multiphoton microscopy in vivo excited at 1600 nm: A comparative investigation with silicone oil and deuterium dioxide immersion

Multiphoton microscopy (MPM) excited at the 1700-nm window has enabled deep-tissue penetration in biological tissue, especially brain. MPM of skin may also benefit from this deep-penetration capability. Skin is a layered structure with varying refractive index (from 1.34 to 1.5). Consequently, proper immersion medium should be selected when imaging with high numerical aperture objective lens. To provide guidelines for immersion medium selection for skin MPM, here we demonstrate comparative experimental investigation of deep-skin MPM excited at 1600 nm in vivo, using both silicone oil and deuterium dioxide (D₂O) immersion. We specifically characterize imaging depths, signal levels and spatial resolution. Our results show that both immersion media give similar performance in imaging depth and spatial resolution, while signal levels are slightly better with silicone oil immersion. We also demonstrate that local injection of fluorescent beads into the skin is a viable technique for spatial resolution characterization in vivo.      

Comparison of higher‐order multiphoton signal generation and collection at the 1700‐nm window based on transmittance measurement of objective lenses

One benefit of excitation at the 1700‐nm window is the more accessible modalities of multiphoton signal generation. It is demonstrated here that the transmittance performance of the objective lens is of vital importance for efficient higher‐order multiphoton signal generation and collection excited at the 1700‐nm window. Two commonly used objective lenses for multiphoton microscopy (MPM) are characterized and compared, one with regular coating and the other with customized coating for high transmittance at the 1700‐nm window. Our results show that, fourth harmonic generation imaging of mouse tail tendon and 5‐photon fluorescence of carbon quantum dots using the regular objective lens shows an order of magnitude signal higher than those using the customized objective lens. Besides, the regular objective lens also enables a 3‐photon fluorescence imaging depth of >1600 μm in mouse brain in vivo. Our results will provide guidelines for objective lens selection for MPM at the 1700‐nm window.     

Visible‐near infrared‐II skull optical clearing window for in vivo cortical vasculature imaging and targeted manipulation

Skull optical clearing window permits us to perform in vivo cortical imaging without craniotomy, but mainly limits to visible (vis)‐near infrared (NIR)‐I light imaging. If the skull optical clearing window is available for NIR‐II, the imaging depth will be further enhanced. Herein, we developed a vis‐NIR‐II skull optical clearing agents with deuterium oxide instead of water, which could make the skull transparent in the range of visible to NIR‐II. Using a NIR‐II excited third harmonic generation microscope, the cortical vasculature of mice could be clearly distinguished even at the depth of 650 μm through the vis‐NIR‐II skull clearing window. The imaging depth after clearing is close to that without skull, and increases by three times through turbid skull. Furthermore, the new skull optical clearing window promises to realize NIR‐II laser‐induced targeted injury of cortical single vessel. This work enhances the ability of NIR‐II excited nonlinear imaging techniques for accessing to cortical neurovasculature in deep tissue.     

Development a flexible light‐sheet fluorescence microscope for high‐speed 3D imaging of calcium dynamics and 3D imaging of cellular microstructure

We report a flexible light‐sheet fluorescence microscope (LSFM) designed for studying dynamic events in cardiac tissue at high speed in 3D and the correlation of these events to cell microstructure. The system employs two illumination‐detection modes: the first uses angle‐dithering of a Gaussian light sheet combined with remote refocusing of the detection plane for video‐rate volumetric imaging; the second combines digitally‐scanned light‐sheet illumination with an axially‐swept light‐sheet waist and stage‐scanned acquisition for improved axial resolution compared to the first mode. We present a characterisation of the spatial resolution of the system in both modes. The first illumination‐detection mode achieves dual spectral‐channel imaging at 25 volumes per second with 1024 × 200 × 50 voxel volumes and is demonstrated by time‐lapse imaging of calcium dynamics in a live cardiomyocyte. The second illumination‐detection mode is demonstrated through the acquisition of a higher spatial resolution structural map of the t‐tubule network in a fixed cardiomyocyte cell.     

High light field confinement for fluorescent correlation spectroscopy using a solid immersion lens

In this paper we present recent single molecule detection experiment using a solid immersion lens (SIL) for fluorescent correlation spectroscopy measurements. We compared the performance of the SIL in combination with an air objective (40x, numerical aperture (NA)=1.15) with a water immersion objective (40x, NA=0.6) in a confocal microscope system (ConfoCorr 1). Important parameters for single molecule experiments such as collection efficiency and excitation field confinement were investigated. Although the two set-ups have similar numerical aperture the measurements demonstrated higher field confinement and better collection efficiency for the SIL system in comparison to the conventional confocal set-up. Adding spherical aberrations shifts the sample volume up to 4 microm away from the plane surface of the SIL and conserves a diffraction limited focal volume. In this case the FCS autocorrelation demonstrates a free 3D diffusion of dye molecules in a highly confined light field.     

Lightsheet fluorescence lifetime imaging microscopy with wide‐field time‐correlated single photon counting

We report on wide‐field time‐correlated single photon counting (TCSPC)‐based fluorescence lifetime imaging microscopy (FLIM) with lightsheet illumination. A pulsed diode laser is used for excitation, and a crossed delay line anode image intensifier, effectively a single‐photon sensitive camera, is used to record the position and arrival time of the photons with picosecond time resolution, combining low illumination intensity of microwatts with wide‐field data collection. We pair this detector with the lightsheet illumination technique, and apply it to 3D FLIM imaging of dye gradients in human cancer cell spheroids, and C. elegans.     

Efficient and cost‐effective 3D cellular imaging by sub‐voxel‐resolving light‐sheet add‐on microscopy

Light‐sheet fluorescence microscopy (LSFM) allows volumetric live imaging at high‐speed and with low photo‐toxicity. Various LSFM modalities are commercially available, but their size and cost limit their access by the research community. A new method, termed sub‐voxel‐resolving (SVR) light‐sheet add‐on microscopy (SLAM), is presented to enable fast, resolution‐enhanced light‐sheet fluorescence imaging from a conventional wide‐field microscope. This method contains two components: a miniature add‐on device to regular wide‐field microscopes, which contains a horizontal laser light‐sheet illumination path to confine fluorophore excitation at the vicinity of the focal plane for optical sectioning; an off‐axis scanning strategy and a SVR algorithm that utilizes sub‐voxel spatial shifts to reconstruct the image volume that results in a twofold increase in resolution. SLAM method has been applied to observe the muscle activity change of crawling C. elegans, the heartbeat of developing zebrafish embryo, and the neural anatomy of cleared mouse brains, at high spatiotemporal resolution. It provides an efficient and cost‐effective solution to convert the vast number of in‐service microscopes for fast 3D live imaging with voxel‐super‐resolved capability.     

Practical Image Restoration of Thick Biological Specimens Using Multiple Focus Levels in Transmission Electron Microscopy

Three-dimensional electron tomographic studies of thick specimens such as cellular organelles or supramolecular structures require accurate interpretations of transmission electron micrograph intensities. In addition to microscope lens aberrations, thick specimen imaging is complicated by additional distortions resulting from multiple elastic and inelastic scattering. Extensive analysis of the mechanism of image formation using electron energy-loss spectroscopy and imaging as well as exit wavefront reconstruction demonstrated that multiple scattering does not contribute to the coherent component of the exit wave (Hanet al.,1996, 1995). Although exit wavefront restored images showed enhanced contrast and resolution, that technique, which requires the collection of more than 30 images at different focus levels, is not practical for routine data collection in 3D electron tomography, where usually over 100 projection views are required for each reconstruction. Using a 0.7-μm-thick specimen imaged at 200 keV, the accuracy of reconstructions using small numbers of defocused images and a simple linear filter (Schiske, 1968) was assessed by comparison to the complete exit wave restoration. We demonstrate that only four optimal focus levels are required to effectively restore the coherent component (deviation 5.1%). By contrast, the optimal single image (zero defocus) shows a 25.5% deviation to the exit wave restoration. Two pairs of under- and over-defocus images should be taken: one pair at quite high defocus (>10 μm) to differentiate the coherent (single elastic scattering) from the incoherent (multiple elastic and inelastic scattering) components, and the second pair to optimize information content at the highest desired resolution (e.g., 5 μm for (2.5 nm)⁻¹resolution). We also propose a new interpretation of the restored amplitude and phase components where the specimen mass-density is proportional to the logarithm of the amplitude component and linearly related to the phase component. This approach should greatly facilitate the collection of high resolution tomographic data from thick samples.     

Inside Cover: Efficient and cost‐effective 3D cellular imaging by sub‐voxel‐resolving light‐sheet add‐on microscopy

A type of compact and cost‐effective light‐sheet imaging device, termed sub‐voxel‐resolving light‐sheet add‐on module (SLAM), is developed to cooperate with conventional 2D epifluorescence microscope, allowing high‐contrast, resolution‐improved 3D imaging of various biological samples at high throughput. Further details can be found in the article by Fang Zhao, Yicong Yang, Yi Li, et al. ( e201960243 ).

     

Label‐free stimulated Raman scattering imaging reveals silicone breast implant material in tissue

Millions of women worldwide have silicone breast implants. It has been reported that implant failure occurs in approximately a tenth of patients within 10 years, and the consequences of dissemination of silicone debris are poorly understood. Currently, silicone detection in histopathological slides is based on morphological features as no specific immunohistochemical technique is available. Here, we show the feasibility and sensitivity of stimulated Raman scattering (SRS) imaging to specifically detect silicone material in stained histopathological slides, without additional sample treatment. Histology slides of four periprosthetic capsules from different implant types were obtained after explantation, as well as an enlarged axillary lymph node from a patient with a ruptured implant. SRS images coregistered with bright‐field images revealed the distribution and quantity of silicone material in the tissue. Fast and high‐resolution imaging of histology slides with molecular specificity using SRS provides an opportunity to investigate the role of silicone debris in the pathophysiology of implant‐linked diseases.     

Real‐time video mosaicking to guide handheld in vivo microscopy

Handheld and endoscopic optical‐sectioning microscopes are being developed for noninvasive screening and intraoperative consultation. Imaging a large extent of tissue is often desired, but miniature in vivo microscopes tend to suffer from limited fields of view. To extend the imaging field during clinical use, we have developed a real‐time video mosaicking method, which allows users to efficiently survey larger areas of tissue. Here, we modified a previous post‐processing mosaicking method so that real‐time mosaicking is possible at >30 frames/second when using a device that outputs images that are 400 × 400 pixels in size. Unlike other real‐time mosaicking methods, our strategy can accommodate image rotations and deformations that often occur during clinical use of a handheld microscope. We perform a feasibility study to demonstrate that the use of real‐time mosaicking is necessary to enable efficient sampling of a desired imaging field when using a handheld dual‐axis confocal microscope.     

Is oblique scanning laser ophthalmoscope applicable to human ocular optics? A feasibility study using an eye model for volumetric imaging

Oblique scanning laser ophthalmoscopy (oSLO) is a novel imaging modality to provide volumetric retinal imaging without depth sectioning over a large field of view (FOV). It has been successfully demonstrated in vivo in rodent eyes for volumetric fluorescein angiography (vFA). However, engineering oSLO for human retinal imaging is challenging because of the low numerical aperture (NA) of human ocular optics. To overcome this challenge, we implement optical designs to (a) increase the angle of the intermediate image under Scheimpflug condition, and (b) expand the magnification in the depth dimension with cylindrical lens to enable sufficient sampling density. In addition, we adopt a scanning‐and‐descaning strategy, resulting in a compact oSLO system. We experimentally show that the current setup can achieve a FOV of ~3 × 6 × 0.8 mm³, and the transverse and axial resolutions of 7 and 41 μm, respectively. This feasibility study serves an important step for future in vivo human retinal imaging.     

Intravascular molecular-structural imaging with a miniaturized integrated near-infrared fluorescence and ultrasound catheter

Coronary artery disease (CAD) remains a leading cause of mortality and warrants new imaging approaches to better guide clinical care. We report on a miniaturized, hybrid intravascular catheter and imaging system for comprehensive coronary artery imaging in vivo. Our catheter exhibits a total diameter of 1.0 mm (3.0 French), equivalent to standalone clinical intravascular ultrasound (IVUS) catheters but enables simultaneous near-infrared fluorescence (NIRF) and IVUS molecular-structural imaging. We demonstrate NIRF-IVUS imaging in vitro in coronary stents using NIR fluorophores, and compare NIRF signal strengths for prism and ball lens sensor designs in both low and high scattering media. Next, in vivo intravascular imaging in pig coronary arteries demonstrates simultaneous, co-registered molecular-structural imaging of experimental CAD inflammation on IVUS and distance-corrected NIRF images. The obtained results suggest substantial potential for the NIRF-IVUS catheter to advance standalone IVUS, and enable comprehensive phenotyping of vascular disease to better assess and treat patients with CAD.     

Second-harmonic imaging microscopy for visualizing biomolecular arrays in cells, tissues and organisms

Although the nonlinear optical effect known as second-harmonic generation (SHG) has been recognized since the earliest days of laser physics and was demonstrated through a microscope over 25 years ago, only in the past few years has it begun to emerge as a viable microscope imaging contrast mechanism for visualization of cell and tissue structure and function. Only small modifications are required to equip a standard laser-scanning two-photon microscope for second-harmonic imaging microscopy (SHIM). Recent studies of the three-dimensional in vivo structures of well-ordered protein assemblies, such as collagen, microtubules and muscle myosin, are beginning to establish SHIM as a nondestructive imaging modality that holds promise for both basic research and clinical pathology. Thus far the best signals have been obtained in a transmitted light geometry that precludes in vivo measurements on large living animals. This drawback may be addressed through improvements in the collection of SHG signals via an epi-illumination microscope configuration. In addition, SHG signals from certain membrane-bound dyes have been shown to be highly sensitive to membrane potential. Although this indicates that SHIM may become a valuable tool for probing cell physiology, the small signal size would limit the number of photons that could be collected during the course of a fast action potential. Better dyes and optimized microscope optics could ultimately lead to the imaging of neuronal electrical activity with SHIM.     

Two‐ and three‐photon absorption cross‐section characterization for high‐brightness,cell‐specific multiphoton fluorescence brain imaging

We demonstrate an accurate quantitative characterization of absolute two‐ and three‐photon absorption (2PA and 3PA) action cross sections of a genetically encodable fluorescent marker Sypher3s. Both 2PA and 3PA action cross sections of this marker are found to be remarkably high, enabling high‐brightness, cell‐specific two‐ and three‐photon fluorescence brain imaging. Brain imaging experiments on sliced samples of rat's cortical areas are presented to demonstrate these imaging modalities. The 2PA action cross section of Sypher3s is shown to be highly sensitive to the level of pH, enabling pH measurements via a ratiometric readout of the two‐photon fluorescence with two laser excitation wavelengths, thus paving the way toward fast optical pH sensing in deep‐tissue experiments.     

Fingerprint‐to‐CH stretch continuously tunable high spectral resolution stimulated Raman scattering microscope

Stimulated Raman scattering (SRS) microscopy is a label‐free method generating images based on chemical contrast within samples, and has already shown its great potential for high‐sensitivity and fast imaging of biological specimens. The capability of SRS to collect molecular vibrational signatures in bio‐samples, coupled with the availability of powerful statistical analysis methods, allows quantitative chemical imaging of live cells with sub‐cellular resolution. This application has substantially driven the development of new SRS microscopy platforms. Indeed, in recent years, there has been a constant effort on devising configurations able to rapidly collect Raman spectra from samples over a wide vibrational spectral range, as needed for quantitative analysis by using chemometric methods. In this paper, an SRS microscope which exploits spectral shaping by a narrowband and rapidly tunable acousto‐optical tunable filter (AOTF) is presented. This microscope enables spectral scanning from the Raman fingerprint region to the Carbon‐Hydrogen (CH)‐stretch region without any modification of the optical setup. Moreover, it features also a high enough spectral resolution to allow resolving Raman peaks in the crowded fingerprint region. Finally, application of the developed SRS microscope to broadband hyperspectral imaging of biological samples over a large spectral range from 800 to 3600 cm^?1, is demonstrated.     

Quadrature demodulation in line‐scan focal modulation microscopy for imaging three‐dimensional zebrafish neural structure

Visualizing biological processes in neuroscience requires in vivo functional imaging at single‐neuron resolution, high image acquisition speed and strong optical sectioning ability. However, due to light scattering of in tissue, very often conventional wide‐field fluorescence microscopes are unable to resolve cells in the presence of a strong out‐of‐focus background. Line‐scan focal modulation microscopy enables high temporal resolution and good optical sectioning ability at the same time. Here we demonstrate a quadrature demodulation method to extract the focal information with an extended frequency bandwidth and therefore higher spatial resolution. The performance of the demodulation scheme in line‐scan focal modulation microscope has been evaluated by performing imaging experiments with fluorescence beads and zebrafish neural structure. Reduced background, reduced artifacts and more detailed morphological information are evident in the obtained images.