Planning of Electroporation-Based Treatments Using Web-Based Treatment-Planning Software

Electroporation-based treatment combining high-voltage electric pulses and poorly permanent cytotoxic drugs, i.e., electrochemotherapy (ECT), is currently used for treating superficial tumor nodules by following standard operating procedures. Besides ECT, another electroporation-based treatment, nonthermal irreversible electroporation (N-TIRE), is also efficient at ablating deep-seated tumors. To perform ECT or N-TIRE of deep-seated tumors, following standard operating procedures is not sufficient and patient-specific treatment planning is required for successful treatment. Treatment planning is required because of the use of individual long-needle electrodes and the diverse shape, size and location of deep-seated tumors. Many institutions that already perform ECT of superficial metastases could benefit from treatment-planning software that would enable the preparation of patient-specific treatment plans. To this end, we have developed a Web-based treatment-planning software for planning electroporation-based treatments that does not require prior engineering knowledge from the user (e.g., the clinician). The software includes algorithms for automatic tissue segmentation and, after segmentation, generation of a 3D model of the tissue. The procedure allows the user to define how the electrodes will be inserted. Finally, electric field distribution is computed, the position of electrodes and the voltage to be applied are optimized using the 3D model and a downloadable treatment plan is made available to the user.     

Effect of Blood Vessel Segmentation on the Outcome of Electroporation-Based Treatments of Liver Tumors

Electroporation-based treatments rely on increasing the permeability of the cell membrane by high voltage electric pulses applied to tissue via electrodes. To ensure that the whole tumor is covered with sufficiently high electric field, accurate numerical models are built based on individual patient anatomy. Extraction of patient''s anatomy through segmentation of medical images inevitably produces some errors. In order to ensure the robustness of treatment planning, it is necessary to evaluate the potential effect of such errors on the electric field distribution. In this work we focus on determining the effect of errors in automatic segmentation of hepatic vessels on the electric field distribution in electroporation-based treatments in the liver. First, a numerical analysis was performed on a simple ''sphere and cylinder'' model for tumors and vessels of different sizes and relative positions. Second, an analysis of two models extracted from medical images of real patients in which we introduced variations of an error of the automatic vessel segmentation method was performed. The results obtained from a simple model indicate that ignoring the vessels when calculating the electric field distribution can cause insufficient coverage of the tumor with electric fields. Results of this study indicate that this effect happens for small (10 mm) and medium-sized (30 mm) tumors, especially in the absence of a central electrode inserted in the tumor. The results obtained from the real-case models also show higher negative impact of automatic vessel segmentation errors on the electric field distribution when the central electrode is absent. However, the average error of the automatic vessel segmentation did not have an impact on the electric field distribution if the central electrode was present. This suggests the algorithm is robust enough to be used in creating a model for treatment parameter optimization, but with a central electrode.     

Deep learning tools and modeling to estimate the temporal expression of cell cycle proteins from 2D still images

Automatic characterization of fluorescent labeling in intact mammalian tissues remains a challenge due to the lack of quantifying techniques capable of segregating densely packed nuclei and intricate tissue patterns. Here, we describe a powerful deep learning-based approach that couples remarkably precise nuclear segmentation with quantitation of fluorescent labeling intensity within segmented nuclei, and then apply it to the analysis of cell cycle dependent protein concentration in mouse tissues using 2D fluorescent still images. First, several existing deep learning-based methods were evaluated to accurately segment nuclei using different imaging modalities with a small training dataset. Next, we developed a deep learning-based approach to identify and measure fluorescent labels within segmented nuclei, and created an ImageJ plugin to allow for efficient manual correction of nuclear segmentation and label identification. Lastly, using fluorescence intensity as a readout for protein concentration, a three-step global estimation method was applied to the characterization of the cell cycle dependent expression of E2F proteins in the developing mouse intestine.     

Image segmentation for automatic particle identification in electron micrographs based on hidden Markov random field models and expectation maximization

Three-dimensional reconstruction of large macromolecules like viruses at resolutions below 10 A requires a large set of projection images. Several automatic and semi-automatic particle detection algorithms have been developed along the years. Here we present a general technique designed to automatically identify the projection images of particles. The method is based on Markov random field modelling of the projected images and involves a pre-processing of electron micrographs followed by image segmentation and post-processing. The image is modelled as a coupling of two fields--a Markovian and a non-Markovian. The Markovian field represents the segmented image. The micrograph is the non-Markovian field. The image segmentation step involves an estimation of coupling parameters and the maximum á posteriori estimate of the realization of the Markovian field i.e, segmented image. Unlike most current methods, no bootstrapping with an initial selection of particles is required.     

基于F3Net显著性目标检测的蝴蝶图像前背景自动分割

[目的]具有复杂背景的蝴蝶图像前背景分割难度大.本研究旨在探索基于深度学习显著性目标检测的蝴蝶图像自动分割方法.[方法]应用DUTS-TR数据集训练F3Net显著性目标检测算法构建前背景预测模型,然后将模型用于具有复杂背景的蝴蝶图像数据集实现蝴蝶前背景自动分割.在此基础上,采用迁移学习方法,保持ResNet骨架不变,利...     

通过光学相干断层扫描图像进行自动视网膜分割评估黄斑水肿的投影面积

在本文中,我们提出了一种自动视网膜分割方法,以评估光学相干断层扫描（OCT）图像中黄斑水肿（ME）在视网膜特定层上的投影面积。首先使用基于权重矩阵的优化的最短路径最快算法对十个视网膜层边界进行分割,这有效降低了算法对血管阴影的敏感性。然而,ME的存在将导致水肿区域的分割不准确。因此,我们使用强度阈值方法提取每个OCT图像中的水肿区域,并将该区域中的值设置为零,并确保获得的分割边界可以自动穿过而不是绕过水肿区域。我们使用最小值投影来计算ME在不同层的投影面积。为了测试我们的方法,我们使用了从Topcon的OCT机器收集的数据。在轴向和B扫描方向上测得的黄斑区域分辨率分别为11.7微米和46.8微米。与手动分割相比,视网膜层边界分割的平均绝对误差和标准偏差为4.5±3.2微米。因此,所提出的方法为评估水肿提供了一种自动,无创和定量的工具。     

3-Dimensional Diffusion Tensor Imaging (DTI) Atlas of the Rat Brain

Anatomical atlases play an important role in the analysis of neuroimaging data in rodent neuroimaging studies. Having a high resolution, detailed atlas not only can expand understanding of rodent brain anatomy, but also enables automatic segmentation of new images, thus greatly increasing the efficiency of future analysis when applied to new data. These atlases can be used to analyze new scans of individual cases using a variety of automated segmentation methods. This project seeks to develop a set of detailed 3D anatomical atlases of the brain at postnatal day 5 (P5), 14 (P14), and adults (P72) in Sprague-Dawley rats. Our methods consisted of first creating a template image based on fixed scans of control rats, then manually segmenting various individual brain regions on the template. Using itk-SNAP software, subcortical and cortical regions, including both white matter and gray matter structures, were manually segmented in the axial, sagittal, and coronal planes. The P5, P14, and P72 atlases had 39, 45, and 29 regions segmented, respectively. These atlases have been made available to the broader research community.     

Lesion Explorer: A Video-guided,Standardized Protocol for Accurate and Reliable MRI-derived Volumetrics in Alzheimer's Disease and Normal Elderly

Obtaining in vivo human brain tissue volumetrics from MRI is often complicated by various technical and biological issues. These challenges are exacerbated when significant brain atrophy and age-related white matter changes (e.g. Leukoaraiosis) are present. Lesion Explorer (LE) is an accurate and reliable neuroimaging pipeline specifically developed to address such issues commonly observed on MRI of Alzheimer''s disease and normal elderly. The pipeline is a complex set of semi-automatic procedures which has been previously validated in a series of internal and external reliability tests^1,2. However, LE''s accuracy and reliability is highly dependent on properly trained manual operators to execute commands, identify distinct anatomical landmarks, and manually edit/verify various computer-generated segmentation outputs.LE can be divided into 3 main components, each requiring a set of commands and manual operations: 1) Brain-Sizer, 2) SABRE, and 3) Lesion-Seg. Brain-Sizer''s manual operations involve editing of the automatic skull-stripped total intracranial vault (TIV) extraction mask, designation of ventricular cerebrospinal fluid (vCSF), and removal of subtentorial structures. The SABRE component requires checking of image alignment along the anterior and posterior commissure (ACPC) plane, and identification of several anatomical landmarks required for regional parcellation. Finally, the Lesion-Seg component involves manual checking of the automatic lesion segmentation of subcortical hyperintensities (SH) for false positive errors.While on-site training of the LE pipeline is preferable, readily available visual teaching tools with interactive training images are a viable alternative. Developed to ensure a high degree of accuracy and reliability, the following is a step-by-step, video-guided, standardized protocol for LE''s manual procedures.     

A 3D Network Based Shape Prior for Automatic Myocardial Disease Segmentation in Delayed-Enhancement MRI

Objectives: In this work, a new deep learning model for relevant myocardial infarction segmentation from Late Gadolinium Enhancement (LGE)-MRI is proposed. Moreover, our novel segmentation method aims to detect microvascular-obstructed regions accurately. Material and methods: We first segment the anatomical structures, i.e., the left ventricular cavity and the myocardium, to achieve a preliminary segmentation. Then, a shape prior based framework that fuses the 3D U-Net architecture with 3D Autoencoder segmentation framework to constrain the segmentation process of pathological tissues is applied. Results: The proposed network reached outstanding myocardial segmentation compared with the human-level performance with the average Dice score of ‘0.9507’ for myocardium, ‘0.7656’ for scar, and ‘0.8377’ for MVO on the validation set consisting of 16 DE-MRI volumes selected from the training EMIDEC dataset. Conclusion: It is concluded that our approach's extensive validation and comprehensive comparison against existing state-of-the-art deep learning models on three annotated datasets, including healthy and diseased exams, make this proposal a reliable tool to enhance MI diagnosis.     

Tumor classification of six common cancer types based on proteomic profiling by MALDI imaging

In clinical diagnostics, it is of outmost importance to correctly identify the source of a metastatic tumor, especially if no apparent primary tumor is present. Tissue-based proteomics might allow correct tumor classification. As a result, we performed MALDI imaging to generate proteomic signatures for different tumors. These signatures were used to classify common cancer types. At first, a cohort comprised of tissue samples from six adenocarcinoma entities located at different organ sites (esophagus, breast, colon, liver, stomach, thyroid gland, n = 171) was classified using two algorithms for a training and test set. For the test set, Support Vector Machine and Random Forest yielded overall accuracies of 82.74 and 81.18%, respectively. Then, colon cancer liver metastasis samples (n = 19) were introduced into the classification. The liver metastasis samples could be discriminated with high accuracy from primary tumors of colon cancer and hepatocellular carcinoma. Additionally, colon cancer liver metastasis samples could be successfully classified by using colon cancer primary tumor samples for the training of the classifier. These findings demonstrate that MALDI imaging-derived proteomic classifiers can discriminate between different tumor types at different organ sites and in the same site.     

Rotationally resliced 3D prostate segmentation of MR images using Bhattacharyya similarity and active band theory

PurposeIn this article, we propose a novel, semi-automatic segmentation method to process 3D MR images of the prostate using the Bhattacharyya coefficient and active band theory with the goal of providing technical support for computer-aided diagnosis and surgery of the prostate.MethodsOur method consecutively segments a stack of rotationally resectioned 2D slices of a prostate MR image by assessing the similarity of the shape and intensity distribution in neighboring slices. 2D segmentation is first performed on an initial slice by manually selecting several points on the prostate boundary, after which the segmentation results are propagated consecutively to neighboring slices. A framework of iterative graph cuts is used to optimize the energy function, which contains a global term for the Bhattacharyya coefficient with the help of an auxiliary function. Our method does not require previously segmented data for training or for building statistical models, and manual intervention can be applied flexibly and intuitively, indicating the potential utility of this method in the clinic.ResultsWe tested our method on 3D T2-weighted MR images from the ISBI dataset and PROMISE12 dataset of 129 patients, and the Dice similarity coefficients were 90.34 ± 2.21% and 89.32 ± 3.08%, respectively. The comparison was performed with several state-of-the-art methods, and the results demonstrate that the proposed method is robust and accurate, achieving similar or higher accuracy than other methods without requiring training.ConclusionThe proposed algorithm for segmenting 3D MR images of the prostate is accurate, robust, and readily applicable to a clinical environment for computer-aided surgery or diagnosis.     

Classification of Leukemia and Leukemoid Using VGG-16 Convolutional Neural Network Architecture

Leukemoid reaction like leukemia indicates noticeable increased count of WBCs (White Blood Cells) but the cause of it is due to severe inflammation or infections in other body regions. In automatic diagnosis in classifying leukemia and leukemoid reactions, ALL IDB2 (Acute Lymphoblastic Leukemia-Image Data Base) dataset has been used which comprises 110 training images of blast cells and healthy cells. This paper aimed at an automatic process to distinguish leukemia and leukemoid reactions from blood smear images using Machine Learning. Initially, automatic detection and counting of WBC is done to identify leukocytosis and then an automatic detection of WBC blasts is performed to support classification of leukemia and leukemoid reactions. Leukocytosis is commonly observed both in leukemia and leukemoid hence physicians may have chance of wrong diagnosis of malignant leukemia for the patients with leukemoid reactions. BCCD (blood cell count detection) Dataset has been used which has 364 blood smear images of which 349 are of single WBC type. The Image segmentation algorithm of Hue Saturation Value color based on watershed has been applied. VGG16 (Visual Geometric Group) CNN (Convolution Neural Network) architecture based deep learning technique is being incorporated for classification and counting WBC type from segmented images. The VGG16 architecture based CNN used for classification and segmented images obtained from first part were tested to identify WBC blasts.     

A Three-Dimensional In?Vitro Tumor Platform for Modeling Therapeutic Irreversible Electroporation

Irreversible electroporation (IRE) is emerging as a powerful tool for tumor ablation that utilizes pulsed electric fields to destabilize the plasma membrane of cancer cells past the point of recovery. The ablated region is dictated primarily by the electric field distribution in the tissue, which forms the basis of current treatment planning algorithms. To generate data for refinement of these algorithms, there is a need to develop a physiologically accurate and reproducible platform on which to study IRE in vitro. Here, IRE was performed on a 3D in vitro tumor model consisting of cancer cells cultured within dense collagen I hydrogels, which have been shown to acquire phenotypes and respond to therapeutic stimuli in a manner analogous to that observed in in vivo pathological systems. Electrical and thermal fluctuations were monitored during treatment, and this information was incorporated into a numerical model for predicting the electric field distribution in the tumors. When correlated with Live/Dead staining of the tumors, an electric field threshold for cell death (500 V/cm) comparable to values reported in vivo was generated. In addition, submillimeter resolution was observed at the boundary between the treated and untreated regions, which is characteristic of in vivo IRE. Overall, these results illustrate the advantages of using 3D cancer cell culture models to improve IRE-treatment planning and facilitate widespread clinical use of the technology.     

Feature-based,Automated Segmentation of Cerebral Infarct Patterns Using T 2- and Diffusion-weighted Imaging

Diffusion-weighted imaging enables the diagnosis of cerebral ischemias very early, thus supporting therapies such as thrombolysis. However, morphology and tissue-characterizing parameters (e.g. relaxation times or water diffusion) may vary strongly in ischemic regions, indicating different underlying pathologic processes. As the determination of the parameters by a supervised segmentation is very time consuming, we evaluated whether different infarct patterns may be segmented by an automated, multidimensional feature-based method using a unified segmentation procedure. Ischemias were classified into 5 characteristic patterns. For each class, a 3D histogram based on T 2 - and diffusion-weighted images as well as calculated apparent diffusion coefficients (ADC) was generated from a representative data set. Healthy and pathologic tissue classes were segmented in the histogram as separate, local density maxima with freely shaped borders. Segmentation control parameters were optimized in a 3-step procedure. The method was evaluated using synthetic images as well as results of a supervised segmentation. For the analysis of cerebral ischemias, the optimal control parameter set led to sensitivities and specificities between 1.0 and 0.9.     

Automated Glioblastoma Segmentation Based on a Multiparametric Structured Unsupervised Classification

Automatic brain tumour segmentation has become a key component for the future of brain tumour treatment. Currently, most of brain tumour segmentation approaches arise from the supervised learning standpoint, which requires a labelled training dataset from which to infer the models of the classes. The performance of these models is directly determined by the size and quality of the training corpus, whose retrieval becomes a tedious and time-consuming task. On the other hand, unsupervised approaches avoid these limitations but often do not reach comparable results than the supervised methods. In this sense, we propose an automated unsupervised method for brain tumour segmentation based on anatomical Magnetic Resonance (MR) images. Four unsupervised classification algorithms, grouped by their structured or non-structured condition, were evaluated within our pipeline. Considering the non-structured algorithms, we evaluated K-means, Fuzzy K-means and Gaussian Mixture Model (GMM), whereas as structured classification algorithms we evaluated Gaussian Hidden Markov Random Field (GHMRF). An automated postprocess based on a statistical approach supported by tissue probability maps is proposed to automatically identify the tumour classes after the segmentations. We evaluated our brain tumour segmentation method with the public BRAin Tumor Segmentation (BRATS) 2013 Test and Leaderboard datasets. Our approach based on the GMM model improves the results obtained by most of the supervised methods evaluated with the Leaderboard set and reaches the second position in the ranking. Our variant based on the GHMRF achieves the first position in the Test ranking of the unsupervised approaches and the seventh position in the general Test ranking, which confirms the method as a viable alternative for brain tumour segmentation.     

Feature-based,automated segmentation of cerebral infarct patterns using T2- and diffusion-weighted imaging

Diffusion-weighted imaging enables the diagnosis of cerebral ischemias very early, thus supporting therapies such as thrombolysis. However, morphology and tissue-characterizing parameters (e.g. relaxation times or water diffusion) may vary strongly in ischemic regions, indicating different underlying pathologic processes. As the determination of the parameters by a supervised segmentation is very time consuming, we evaluated whether different infarct patterns may be segmented by an automated, multidimensional feature-based method using a unified segmentation procedure. Ischemias were classified into 5 characteristic patterns. For each class, a 3D histogram based on T(2)- and diffusion-weighted images as well as calculated apparent diffusion coefficients (ADC) was generated from a representative data set. Healthy and pathologic tissue classes were segmented in the histogram as separate, local density maxima with freely shaped borders. Segmentation control parameters were optimized in a 3-step procedure. The method was evaluated using synthetic images as well as results of a supervised segmentation. For the analysis of cerebral ischemias, the optimal control parameter set led to sensitivities and specificities between 1.0 and 0.9.     

Confocal DNA cytometry: a contour-based segmentation algorithm for automated three-dimensional image segmentation

BACKGROUND: Confocal laser scanning microscopy (CLSM) presents the opportunity to perform three-dimensional (3D) DNA content measurements on intact cells in thick histological sections. So far, these measurements have been performed manually, which is quite time-consuming. METHODS: In this study, an intuitive contour-based segmentation algorithm for automatic 3D CLSM image cytometry of nuclei in thick histological sections is presented. To evaluate the segmentation algorithm, we measured the DNA content and volume of human liver and breast cancer nuclei in 3D CLSM images. RESULTS: A high percentage of nuclei could be segmented fully automatically (e.g., human liver, 92%). Comparison with (time-consuming) interactive measurements on the same CLSM images showed that the results were well correlated (liver, r = 1.00; breast, r = 0.92). CONCLUSIONS: Automatic 3D CLSM image cytometry enables measurement of volume and DNA content of large numbers of nuclei in thick histological sections within an acceptable time. This makes large-scale studies feasible, whereby the advantages of CLSM can be exploited fully. The intuitive modular segmentation algorithm presented in this study detects and separates overlapping objects, also in two-dimensional (2D) space. Therefore, this algorithm may also be suitable for other applications.     

Automatic Segmentation of Eight Tissue Classes in Neonatal Brain MRI

Purpose

Volumetric measurements of neonatal brain tissues may be used as a biomarker for later neurodevelopmental outcome. We propose an automatic method for probabilistic brain segmentation in neonatal MRIs.

Materials and Methods

In an IRB-approved study axial T1- and T2-weighted MR images were acquired at term-equivalent age for a preterm cohort of 108 neonates. A method for automatic probabilistic segmentation of the images into eight cerebral tissue classes was developed: cortical and central grey matter, unmyelinated and myelinated white matter, cerebrospinal fluid in the ventricles and in the extra cerebral space, brainstem and cerebellum. Segmentation is based on supervised pixel classification using intensity values and spatial positions of the image voxels. The method was trained and evaluated using leave-one-out experiments on seven images, for which an expert had set a reference standard manually. Subsequently, the method was applied to the remaining 101 scans, and the resulting segmentations were evaluated visually by three experts. Finally, volumes of the eight segmented tissue classes were determined for each patient.

Results

The Dice similarity coefficients of the segmented tissue classes, except myelinated white matter, ranged from 0.75 to 0.92. Myelinated white matter was difficult to segment and the achieved Dice coefficient was 0.47. Visual analysis of the results demonstrated accurate segmentations of the eight tissue classes. The probabilistic segmentation method produced volumes that compared favorably with the reference standard.

Conclusion

The proposed method provides accurate segmentation of neonatal brain MR images into all given tissue classes, except myelinated white matter. This is the one of the first methods that distinguishes cerebrospinal fluid in the ventricles from cerebrospinal fluid in the extracerebral space. This method might be helpful in predicting neurodevelopmental outcome and useful for evaluating neuroprotective clinical trials in neonates.