Hyperspectral imaging (HSI) is a technology with high potential in the field of non‐invasive detection of cancer. However, in complex imaging situations like HSI of the larynx with a rigid endoscope, various image interferences can disable a proper classification of cancerous tissue. We identified three main problems: i) misregistration of single images in a HS cube due to patient heartbeat ii) image noise and iii) specular reflections (SR). Consequently, an image pre‐processor is developed in the current paper to overcome these image interferences. It encompasses i) image registration ii) noise removal by minimum noise fraction (MNF) transformation and iii) a novel SR detection method. The results reveal that the pre‐processor improves classification performance, while the newly developed SR detection method outperforms global thresholding technique hitherto used by 46%. The novel pre‐processor will be used for future studies towards the development of an operational scheme for HS‐based larynx cancer detection.
RGB image of the larynx derived from the hyperspectral cube and corresponding specular reflections ( a ) manually segmented and ( b ) detected by a novel specular reflection detection method. 相似文献
It is pivotal for medical applications, such as noninvasive histopathologic characterization of tissue, to realize label‐free and molecule‐specific representation of morphologic and biochemical composition in real‐time with subcellular spatial resolution. This unmet clinical need requires new approaches for rapid and reliable real‐time assessment of pathologies to complement established diagnostic tools. Photonic imaging combined with digitalization offers the potential to provide the clinician the requested information both under in vivo and ex vivo conditions. This report summarizes photonic approaches and their use in combination with image processing, machine learning and augmented virtual reality that might solve current challenges in modern medicine. Details are given for pathology, intraoperative diagnosis in head and neck cancer and endoscopic diagnosis in gastroenterology. 相似文献
With homemade active crystalline fibers, we generated bright and broadband light sources for full-field optical coherence tomography, offering deep penetration into skin tissues with cellular resolution at a high frame rate. Extraction of backscattered spectra from the tissue has potential applications in biomedicine. The hysteresis nonlinearity of the piezoelectric transducer actuating the Mirau interferometer has been greatly reduced by a feedforward compensation approach. The linearized hysteresis response enables us to extract depth-dependent spectra accurately. To validate, the complex dispersion of a fused silica plate was characterized with 2% error. Further validation on an in vitro setting, the backscattered spectra from indocyanine green pigment and nonpigmented microspheres were obtained and verified. For in vivo skin measurement, the backscattered spectra show depth-dependent spectral shift and bandwidth variation due to the complex skin anatomy and pigment absorption. Such a high-speed spectra acquisition of in vivo deep tissue backscattering could lead to disease diagnosis in clinical settings. 相似文献
A simplified theory of image formation in phase contrast microscopy is presented. It is shown that the phase shift induced
in light (related to the refractive index) by the observed object can be reconstructed, point by point, from the phase-contrast
digitally sampled image through an appropriate algorithm. This allows one to make quantitative observations on unstained,
living cells. 相似文献
Previous studies for melanin visualization in the retinal pigment epithelium (RPE) have exploited either its absorption properties (using photoacoustic tomography or photothermal optical coherence tomography [OCT]) or its depolarization properties (using polarization sensitive OCT). However, these methods are only suitable when the melanin concentration is sufficiently high. In this work, we present the concept of hyperspectral OCT for melanin visualization in the RPE when the concentration is low. Based on white light OCT, a hyperspectral stack of 27 wavelengths (440‐700 nm) was created in post‐processing for each depth‐resolved image. Owing to the size and shape of the melanin granules in the RPE, the variations in backscattering coefficient as a function of wavelength could be identified—a result which is to be expected from Mie theory. This effect was successfully identified both in eumelanin‐containing phantoms and in vivo in the low‐concentration Brown Norway rat RPE. 相似文献
Psoriasis is a chronic inflammatory skin disease involved with both complex morphological changes of skin and immune processes. The clinical diagnostics and research of psoriasis often require invasive biopsy which lacks their real-time dynamics in vivo. Here we report a noninvasive microscopic system developed by combining in vivo fluorescent microscopy, optical clearing, and immunolabeling to enable real-time imaging of immune cells and cytokines in blood flow in psoriatic animal models. The vascular morphology and time-lapse kinetics of interleukin (IL)-23, IL-17, tumor necrosis factor-α, and CD4+ cells in blood are captured at submicron resolution through the thickening epidermis and opaque scales during the development of psoriasis in vivo. Our data suggest IL-23 recruits CD4+ cells to release IL-17 in blood that further leaks out in the psoriatic skin area. This optical system enables noninvasive and real-time assessment of immune molecules and cells in vivo, providing good potential for medical researches on psoriasis. 相似文献
A method based on Fourier transforms is described for obtaining a 3-D reconstruction from a paracrystalline object with static disorder. The method is derived from the standard methods used in 3-D reconstruction of 2-D crystals except that all of the Fourier coefficients are used and not just the sampled data from the periodic lattice. Thus, not only is the spatially ordered part of the structure visualized in 3-D, but also the spatially disordered part. Application of the method to 3-D reconstructions of insect flight muscle is described as well as prospects for extension of the method to radiation-sensitive specimens. 相似文献
Analysis of vesicle formation and degradation is a central issue in autophagy research and microscopy imaging is revolutionizing the study of such dynamic events inside living cells. A limiting factor is the need for labeling techniques that are labor intensive, expensive, and not always completely reliable. To enable label-free analyses we introduced a generic computational algorithm, the label-free vesicle detector (LFVD), which relies on a matched filter designed to identify circular vesicles within cells using only phase-contrast microscopy images. First, the usefulness of the LFVD is illustrated by presenting successful detections of autophagy modulating drugs found by analyzing the human colorectal carcinoma cell line HCT116 exposed to each substance among 1266 pharmacologically active compounds. Some top hits were characterized with respect to their activity as autophagy modulators using independent in vitro labeling of acidic organelles, detection of LC3-II protein, and analysis of the autophagic flux. Selected detection results for 2 additional cell lines (DLD1 and RKO) demonstrate the generality of the method. In a second experiment, label-free monitoring of dose-dependent vesicle formation kinetics is demonstrated by recorded detection of vesicles over time at different drug concentrations. In conclusion, label-free detection and dynamic monitoring of vesicle formation during autophagy is enabled using the LFVD approach introduced. 相似文献
Analysis of vesicle formation and degradation is a central issue in autophagy research and microscopy imaging is revolutionizing the study of such dynamic events inside living cells. A limiting factor is the need for labeling techniques that are labor intensive, expensive, and not always completely reliable. To enable label-free analyses we introduced a generic computational algorithm, the label-free vesicle detector (LFVD), which relies on a matched filter designed to identify circular vesicles within cells using only phase-contrast microscopy images. First, the usefulness of the LFVD is illustrated by presenting successful detections of autophagy modulating drugs found by analyzing the human colorectal carcinoma cell line HCT116 exposed to each substance among 1266 pharmacologically active compounds. Some top hits were characterized with respect to their activity as autophagy modulators using independent in vitro labeling of acidic organelles, detection of LC3-II protein, and analysis of the autophagic flux. Selected detection results for 2 additional cell lines (DLD1 and RKO) demonstrate the generality of the method. In a second experiment, label-free monitoring of dose-dependent vesicle formation kinetics is demonstrated by recorded detection of vesicles over time at different drug concentrations. In conclusion, label-free detection and dynamic monitoring of vesicle formation during autophagy is enabled using the LFVD approach introduced. 相似文献
In this study, a novel photoacoustic microscopy (PAM) probe integrating white‐light microscopy (WLM) modality that provides guidance for PAM imaging and complementary information is implemented. One single core of an imaging fiber bundle is employed to deliver a pulsed laser for photoacoustic excitation for PAM mode, which provides high resolution with deep penetration. Meanwhile, for WLM mode, the imaging fiber bundle is used to transmit two‐dimensional superficial images. Lateral resolution of 7.2 μm for PAM is achieved. Since miniature components are used, the probe diameter is only 1.7 mm. Imaging of phantom and animals in vivo is conducted to show the imaging capability of the probe. The probe has several advantages by introducing the WLM mode, such as being able to conveniently identify regions of interest and align the focus for PAM mode. The prototype of an endoscope shows potential to facilitate clinical photoacoustic endoscopic applications. 相似文献
For in‐vivo diagnostics of cancer and pre‐cancer in the stomach, there is no endoscopic procedure offering both high sensitivity and high specificity. Our data suggest that multispectral or hyperspectral imaging may be helpful to solve this problem. It is successfully applied to the detection and analysis of easily reachable carcinomas, ex‐vivo samples of hollow organ mucosal carcinomas and also histological samples. An endoscopy system which allows flexible multispectral videoendoscopy for in‐vivo diagnostics has so far been unavailable. To overcome this problem, we modified a standard Olympus endoscopy system to conduct in‐vivo multispectral imaging of the upper GI tract. The pilot study is performed on 14 patients with adeno carcinomas in the stomach. For analysis, Support Vector Machine with linear and Gaussian Kernel, AdaBoost, RobustBoost and Random‐Forest‐walk are used and compared for the data classification with a leave‐one‐out strategy. The margin of the carcinoma for the training of the classifier is drawn by expert‐labeling. The cancer findings are cross‐checked by biopsies. We expect that the present study will help to improve the further development of hyperspectral endoscopy and to overcome some of the problems to be faced in this process.
Skin carcinoma such as melanoma (MM) and cutaneous squamous cell carcinoma (cSCC) are considered as the highest mortality and the most aggressive skin cancers in dermatology. In view that early diagnosis and treatment can greatly improve the survival rate and life quality of the patients, developing noninvasive and effective evaluation methods is of great significance for the detection and identification of early stage cutaneous cancers. In this article, we propose a hybrid photoacoustic and hyperspectral dual‐modality microscopy to evaluate and differentiate skin carcinoma by structural and multiphysiological parameters. The proposed system's imaging abilities are verified by mimic phantoms and normal mice experiments. Furthermore, in vivo characterization and evaluation results of MM and cSCC mice are obtained successfully, which prove this novel method could be used as a reliable and useful method for skin cancer detection in early stages. 相似文献
Navigation‐guided brain biopsies are the standard of care for diagnosis of several brain pathologies. However, imprecise targeting and tissue heterogeneity often hinder obtaining high‐quality tissue samples, resulting in poor diagnostic yield. We report the development and first clinical testing of a navigation‐guided fiberoptic Raman probe that allows surgeons to interrogate brain tissue in situ at the tip of the biopsy needle prior to tissue removal. The 900 μm diameter probe can detect high spectral quality Raman signals in both the fingerprint and high wavenumber spectral regions with minimal disruption to the neurosurgical workflow. The probe was tested in three brain tumor patients, and the acquired spectra in both normal brain and tumor tissue demonstrated the expected spectral features, indicating the quality of the data. As a proof‐of‐concept, we also demonstrate the consistency of the acquired Raman signal with different systems and experimental settings. Additional clinical development is planned to further evaluate the performance of the system and develop a statistical model for real‐time tissue classification during the biopsy procedure. 相似文献
Giant T4 phage capsoids formed in canavanine-treated cultures infected by phage mutants in genes 21 and 17, respectively, differ with regard to cleavage of the major capsid protein, gp 23, and in the fine structure of their hexagonal surface lattices. Quantitative computer processing of electron micrographs shows that the significant differences in capsomer morphology amount to six symmetrically placed features present in the uncleaved hexamer but absent after cleavage. These features may be related with the N-terminal portions of gp 23 monomers excised by phage-specific proteolysis. Cleaved 17? giants can be induced to undergo a further structural transformation (expansion). Structural characteristics of partially transformed giant particles give clues about the dynamics of the cleavage and expansion transformations. Both processes appear to be polar, initiating in one cap and propagating along the particle. The transition zone of partial cleavage is diffuse, whereas the transition between unexpanded and expanded areas is confined to a narrow band of some 20 nm width. 相似文献
Summary— The 6 × 6meric hemocyanin of the centipede Scutigera coleoptrata, prepared by the single layer negative staining technique with uranyl acetate, has been investigated under the electron microscope. Isolated molecules were windowed from selected digitized micrographs. After alignment, they were submitted to correspondence analysis and hierarchical ascendant classification. Two main clusters of molecules were differentiated, and their average images were obtained. A 3D-model constructed from these images is proposed. 相似文献
The paper presents problems and solutions related to hyperspectral image pre‐processing. New methods of preliminary image analysis are proposed. The paper shows problems occurring in Matlab when trying to analyse this type of images. Moreover, new methods are discussed which provide the source code in Matlab that can be used in practice without any licensing restrictions.
The proposed application and sample result of hyperspectral image analysis. 相似文献
Electron microscopy of macromolecular structures is an approach that is in increasing demand in the field of structural biology. The automation of image acquisition has greatly increased the potential throughput of electron microscopy. Here, the focus is on the possibilities in Scipion to implement flexible and robust image‐processing workflows that allow the electron‐microscope operator and the user to monitor the quality of image acquisition, assessing very simple acquisition measures or obtaining a first estimate of the initial volume, or the data resolution and heterogeneity, without any need for programming skills. These workflows can implement intelligent automatic decisions and they can warn the user of possible acquisition failures. These concepts are illustrated by analysis of the well known 2.2 Å resolution β‐galactosidase data set. 相似文献
A novel machine‐learning method to distinguish between tumor and normal tissue in optical coherence tomography (OCT) has been developed. Pre‐clinical murine ear model implanted with mouse colon carcinoma CT‐26 was used. Structural‐image‐based feature sets were defined for each pixel and machine learning classifiers were trained using “ground truth” OCT images manually segmented by comparison with histology. The accuracy of the OCT tumor segmentation method was then quantified by comparing with fluorescence imaging of tumors expressing genetically encoded fluorescent protein KillerRed that clearly delineates tumor borders. Because the resultant 3D tumor/normal structural maps are inherently co‐registered with OCT derived maps of tissue microvasculature, the latter can be color coded as belonging to either tumor or normal tissue. Applications to radiomics‐based multimodal OCT analysis are envisioned. 相似文献
