Automated classification of hepatocellular carcinoma differentiation using multiphoton microscopy and deep learning

In the case of hepatocellular carcinoma (HCC) samples, classification of differentiation is crucial for determining prognosis and treatment strategy decisions. However, a label‐free and automated classification system for HCC grading has not been yet developed. Hence, in this study, we demonstrate the fusion of multiphoton microscopy and a deep‐learning algorithm for classifying HCC differentiation to produce an innovative computer‐aided diagnostic method. Convolutional neural networks based on the VGG‐16 framework were trained using 217 combined two‐photon excitation fluorescence and second‐harmonic generation images; the resulting classification accuracy of the HCC differentiation grade was over 90%. Our results suggest that a combination of multiphoton microscopy and deep learning can realize label‐free, automated methods for various tissues, diseases and other related classification problems.      

Diseased thyroid tissue classification in OCT images using deep learning: Towards surgical decision support

Intraoperative guidance tools for thyroid surgery based on optical coherence tomography (OCT) could aid distinguish between normal and diseased tissue. However, OCT images are difficult to interpret, thus, real-time automatic analysis could support the clinical decision-making. In this study, several deep learning models were investigated for thyroid disease classification on 2D and 3D OCT data obtained from ex vivo specimens of 22 patients undergoing surgery and diagnosed with several thyroid pathologies. Additionally, two open-access datasets were used to evaluate the custom models. On the thyroid dataset, the best performance was achieved by the 3D vision transformer model with a Matthew's correlation coefficient (MCC) of 0.79 (accuracy = 0.90) for the normal-versus-abnormal classification. On the open-access datasets, the custom models achieved the best performance (MCC > 0.88, accuracy > 0.96). Results obtained for the normal-versus-abnormal classification suggest OCT, complemented with deep learning-based analysis, as a tool for real-time automatic diseased tissue identification in thyroid surgery.     

Wildlife surveillance using deep learning methods

相似文献   

Habitat-Net: Segmentation of habitat images using deep learning

Understanding environmental factors that influence forest health, as well as the occurrence and abundance of wildlife, is a central topic in forestry and ecology. However, the manual processing of field habitat data is time-consuming and months are often needed to progress from data collection to data interpretation. To shorten the time to process the data we propose here Habitat-Net: a novel deep learning application based on Convolutional Neural Networks (CNN) to segment habitat images of tropical rainforests. Habitat-Net takes color images as input and after multiple layers of convolution and deconvolution, produces a binary segmentation of the input image. We worked on two different types of habitat datasets that are widely used in ecological studies to characterize the forest conditions: canopy closure and understory vegetation. We trained the model with 800 canopy images and 700 understory images separately and then used 149 canopy and 172 understory images to test the performance of Habitat-Net. We compared the performance of Habitat-Net to the performance of a simple threshold based method, manual processing by a second researcher and a CNN approach called U-Net, upon which Habitat-Net is based. Habitat-Net, U-Net and simple thresholding reduced total processing time to milliseconds per image, compared to 45 s per image for manual processing. However, the higher mean Dice coefficient of Habitat-Net (0.94 for canopy and 0.95 for understory) indicates that accuracy of Habitat-Net is higher than that of both the simple thresholding (0.64, 0.83) and U-Net (0.89, 0.94). Habitat-Net will be of great relevance for ecologists and foresters, who need to monitor changes in their forest structures. The automated workflow not only reduces the time, it also standardizes the analytical pipeline and, thus, reduces the degree of uncertainty that would be introduced by manual processing of images by different people (either over time or between study sites).     

Multi-input deep learning approach for Cardiovascular Disease diagnosis using Myocardial Perfusion Imaging and clinical data

PurposeAccurate detection and treatment of Coronary Artery Disease is mainly based on invasive Coronary Angiography, which could be avoided provided that a robust, non-invasive detection methodology emerged. Despite the progress of computational systems, this remains a challenging issue. The present research investigates Machine Learning and Deep Learning methods in competing with the medical experts' diagnostic yield. Although the highly accurate detection of Coronary Artery Disease, even from the experts, is presently implausible, developing Artificial Intelligence models to compete with the human eye and expertise is the first step towards a state-of-the-art Computer-Aided Diagnostic system.MethodsA set of 566 patient samples is analysed. The dataset contains Polar Maps derived from scintigraphic Myocardial Perfusion Imaging studies, clinical data, and Coronary Angiography results. The latter is considered as reference standard. For the classification of the medical images, the InceptionV3 Convolutional Neural Network is employed, while, for the categorical and continuous features, Neural Networks and Random Forest classifier are proposed.ResultsThe research suggests that an optimal strategy competing with the medical expert's accuracy involves a hybrid multi-input network composed of InceptionV3 and a Random Forest. This method matches the expert's accuracy, which is 79.15% in the particular dataset.ConclusionImage classification using deep learning methods can cooperate with clinical data classification methods to enhance the robustness of the predicting model, aiming to compete with the medical expert's ability to identify Coronary Artery Disease subjects, from a large scale patient dataset.     

Genetic classification of populations using supervised learning

There are many instances in genetics in which we wish to determine whether two candidate populations are distinguishable on the basis of their genetic structure. Examples include populations which are geographically separated, case-control studies and quality control (when participants in a study have been genotyped at different laboratories). This latter application is of particular importance in the era of large scale genome wide association studies, when collections of individuals genotyped at different locations are being merged to provide increased power. The traditional method for detecting structure within a population is some form of exploratory technique such as principal components analysis. Such methods, which do not utilise our prior knowledge of the membership of the candidate populations. are termed unsupervised. Supervised methods, on the other hand are able to utilise this prior knowledge when it is available.In this paper we demonstrate that in such cases modern supervised approaches are a more appropriate tool for detecting genetic differences between populations. We apply two such methods, (neural networks and support vector machines) to the classification of three populations (two from Scotland and one from Bulgaria). The sensitivity exhibited by both these methods is considerably higher than that attained by principal components analysis and in fact comfortably exceeds a recently conjectured theoretical limit on the sensitivity of unsupervised methods. In particular, our methods can distinguish between the two Scottish populations, where principal components analysis cannot. We suggest, on the basis of our results that a supervised learning approach should be the method of choice when classifying individuals into pre-defined populations, particularly in quality control for large scale genome wide association studies.     

Metagenomic taxonomic classification using extreme learning machines

Next-generation sequencing technologies have allowed researchers to determine the collective genomes of microbial communities co-existing within diverse ecological environments. Varying species abundance, length and complexities within different communities, coupled with discovery of new species makes the problem of taxonomic assignment to short DNA sequence reads extremely challenging. We have developed a new sequence composition-based taxonomic classifier using extreme learning machines referred to as TAC-ELM for metagenomic analysis. TAC-ELM uses the framework of extreme learning machines to quickly and accurately learn the weights for a neural network model. The input features consist of GC content and oligonucleotides. TAC-ELM is evaluated on two metagenomic benchmarks with sequence read lengths reflecting the traditional and current sequencing technologies. Our empirical results indicate the strength of the developed approach, which outperforms state-of-the-art taxonomic classifiers in terms of accuracy and implementation complexity. We also perform experiments that evaluate the pervasive case within metagenome analysis, where a species may not have been previously sequenced or discovered and will not exist in the reference genome databases. TAC-ELM was also combined with BLAST to show improved classification results. Code and Supplementary Results: http://www.cs.gmu.edu/~mlbio/TAC-ELM (BSD License).     

New image dataset and new negative sample judgment method for crop pest recognition based on deep learning models

Crop pests are responsible for serious economic loss around the worldwide. Accurate recognition of pests is the key to pest control and is a considerable challenge in farming. Deep learning models have shown great promise in image recognition, drawing the attention of many agricultural experts. However, the lack of pest image datasets and the inexplicability of deep learning models have hindered the development of deep learning models in the field of pest recognition. Our work provides the following four contributions: (1) We constructed a new and more effective dataset, for crop pest recognition, named IP41 comprising 46,567 original images of crop pests in 41 classes. (2) We trained three different deep learning models based on IP41, using transfer learning combined with fine-tuning. The results of the three deep learning models exceeded 80.00% recognition. (3) A negative sample judgment method was proposed to exclude the uploaded pest-free images of the user. (4) We provided reasonable visual explanations for the most critical areas of the recognition layers by using the gradient-weighted class activation mapping method. This research suggests that the recognition process focuses more on image details than the image as a whole, and that overall difference is ignored to a certain extent. These results will be helpful to future research in the field of agricultural pest recognition     

Gene classification using parameter-free semi-supervised manifold learning

A new manifold learning method, called parameter-free semi-supervised local Fisher discriminant analysis (pSELF), is proposed to map the gene expression data into a low-dimensional space for tumor classification. Motivated by the fact that semi-supervised and parameter-free are two desirable and promising characteristics for dimension reduction, a new difference-based optimization objective function with unlabeled samples has been designed. The proposed method preserves the global structure of unlabeled samples in addition to separating labeled samples in different classes from each other. The semi-supervised method has an analytic form of the globally optimal solution, which can be computed efficiently by eigen decomposition. Experimental results on synthetic data and SRBCT, DLBCL, and Brain Tumor gene expression data sets demonstrate the effectiveness of the proposed method.     

Graphical classification of DNA sequences of HLA alleles by deep learning

Alleles of human leukocyte antigen (HLA)-A DNAs are classified and expressed graphically by using artificial intelligence “Deep Learning (Stacked autoencoder)”. Nucleotide sequence data corresponding to the length of 822 bp, collected from the Immuno Polymorphism Database, were compressed to 2-dimensional representation and were plotted. Profiles of the two-dimensional plots indicate that the alleles can be classified as clusters are formed. The two-dimensional plot of HLA-A DNAs gives a clear outlook for characterizing the various alleles.     

Multi-feature fusion for deep learning to predict plant lncRNA-protein interaction

Long non-coding RNAs (lncRNAs) play key roles in regulating cellular biological processes through diverse molecular mechanisms including binding to RNA binding proteins. The majority of plant lncRNAs are functionally uncharacterized, thus, accurate prediction of plant lncRNA–protein interaction is imperative for subsequent functional studies. We present an integrative model, namely DRPLPI. Its uniqueness is that it predicts by multi-feature fusion. Structural and four groups of sequence features are used, including tri-nucleotide composition, gapped k-mer, recursive complement and binary profile. We design a multi-head self-attention long short-term memory encoder-decoder network to extract generative high-level features. To obtain robust results, DRPLPI combines categorical boosting and extra trees into a single meta-learner. Experiments on Zea mays and Arabidopsis thaliana obtained 0.9820 and 0.9652 area under precision/recall curve (AUPRC) respectively. The proposed method shows significant enhancement in the prediction performance compared with existing state-of-the-art methods.     

Foliar pathogenesis and plant water relations: a review

As the world population grows, there is a pressing need to improve productivity from water use in irrigated and rain-fed agriculture. Foliar diseases have been reported to decrease crop water-use efficiency (WUE) substantially, yet the effects of plant pathogens are seldom considered when methods to improve WUE are debated. We review the effects of foliar pathogens on plant water relations and the consequences for WUE. The effects reported vary between host and pathogen species and between host genotypes. Some general patterns emerge however. Higher fungi and oomycetes cause physical disruption to the cuticle and stomata, and also cause impairment of stomatal closing in the dark. Higher fungi and viruses are associated with impairment of stomatal opening in the light. A number of toxins produced by bacteria and higher fungi have been identified that impair stomatal function. Deleterious effects are not limited to compatible plant-pathogen interactions. Resistant and non-host interactions have been shown to result in stomatal impairment in light and dark conditions. Mitigation of these effects through selection of favourable resistance responses could be an important breeding target in the future. The challenges for researchers are to understand how the effects reported from work under controlled conditions translate to crops in the field, and to elucidate underlying mechanisms.     

V-BANet: Land cover change detection using effective deep learning technique

Urban development alters landscapes, frequently degrading environmental services and quality of life. High-resolution remote sensing images provide a chance to detect subtle changes in land cover and can capture the features of a ground object. However, traditional approaches usually experience difficulties when processing large and quickly expanding datasets, low levels of automation, limited computational efficiency, and inconsistent identification accuracies and standards brought on by inconsistent operators. Conducting change detection in a more accurate, automated, and standardized manner has become crucial and increasingly difficult due to the quick collection of remote sensing data. Therefore, in this paper, V-Net and Bilateral Attention Network (V-BANet) based deep learning is implemented to segment the landscapes and extract the features from the images. Initially, the bi-temporal images are segmented using V-Net to independently identify the objects in each image. Then spatial and channel attention blocks are employed in Bilateral Attention Network to learn more discriminative features from the images. Finally, the features' relationships are discovered by contrasting the original feature map in one image with the updated feature map in the other. Objective and subjective experiments are performed on a public bi-temporal high-resolution ONERA Satellite Change Detection (OSCD) dataset and the LEVIR-CD dataset. Moreover, the proposed approach reached an accuracy of 99.29% and IoU of 98.31% with the OSCD Dataset and 99.42% accuracy and 98.83% IoU with the LEVIR-CD Dataset. The experimental outcomes with each specified dataset demonstrated that the suggested methodology outperformed several state-of-the-art techniques and produced superior results.     

Fall classification by machine learning using mobile phones

Fall prevention is a critical component of health care; falls are a common source of injury in the elderly and are associated with significant levels of mortality and morbidity. Automatically detecting falls can allow rapid response to potential emergencies; in addition, knowing the cause or manner of a fall can be beneficial for prevention studies or a more tailored emergency response. The purpose of this study is to demonstrate techniques to not only reliably detect a fall but also to automatically classify the type. We asked 15 subjects to simulate four different types of falls-left and right lateral, forward trips, and backward slips-while wearing mobile phones and previously validated, dedicated accelerometers. Nine subjects also wore the devices for ten days, to provide data for comparison with the simulated falls. We applied five machine learning classifiers to a large time-series feature set to detect falls. Support vector machines and regularized logistic regression were able to identify a fall with 98% accuracy and classify the type of fall with 99% accuracy. This work demonstrates how current machine learning approaches can simplify data collection for prevention in fall-related research as well as improve rapid response to potential injuries due to falls.     

Extreme learning machine for plant diseases classification: a sustainable approach for smart agriculture

Cluster Computing - Nowadays, the economy of countries highly depends on the agriculture productivity which has a great effect on the development of human civilization. Sometimes, plant diseases...     

Automatic deep learning-based pleural effusion classification in lung ultrasound images for respiratory pathology diagnosis

Lung ultrasound (LUS) imaging as a point-of-care diagnostic tool for lung pathologies has been proven superior to X-ray and comparable to CT, enabling earlier and more accurate diagnosis in real-time at the patient’s bedside. The main limitation to widespread use is its dependence on the operator training and experience. COVID-19 lung ultrasound findings predominantly reflect a pneumonitis pattern, with pleural effusion being infrequent. However, pleural effusion is easy to detect and to quantify, therefore it was selected as the subject of this study, which aims to develop an automated system for the interpretation of LUS of pleural effusion. A LUS dataset was collected at the Royal Melbourne Hospital which consisted of 623 videos containing 99,209 2D ultrasound images of 70 patients using a phased array transducer. A standardized protocol was followed that involved scanning six anatomical regions providing complete coverage of the lungs for diagnosis of respiratory pathology. This protocol combined with a deep learning algorithm using a Spatial Transformer Network provides a basis for automatic pathology classification on an image-based level. In this work, the deep learning model was trained using supervised and weakly supervised approaches which used frame- and video-based ground truth labels respectively. The reference was expert clinician image interpretation. Both approaches show comparable accuracy scores on the test set of 92.4% and 91.1%, respectively, not statistically significantly different. However, the video-based labelling approach requires significantly less effort from clinical experts for ground truth labelling.     

青藏高原植物群落样方数据集

为便于了解青藏高原植被特殊物种组成、群落特征及分布格局, 该文利用2018-2021年在青藏高原不同区域内调查的338个样地、共758个样方的数据, 分析了高原植物群落的物种组成、区系特征和植被分类, 整合形成青藏高原植物群落样方数据集。结果表明: 青藏高原高寒和温性植物群落758个样方中, 共有植物65科279属837种; 其中, 物种数最多的5个科依次是菊科(134种)、禾本科(88种)、豆科(75种)、蔷薇科(43种)和莎草科(40种), 物种数最多的5个属依次是蒿属(Artemisia, 29种)、马先蒿属(Pedicularis, 27种)、风毛菊属(Saussurea, 25种)、黄耆属(Astragalus, 23种)和早熟禾属(Poa, 23种)。植物区系主要由温带(145属)和世界广布(36属)的成分所组成。物种的生长型以草本(83.51%)和灌木(10.87%)为主, 草本和木本的生活型分别以多年生草本(88.23%)和落叶灌木(83.67%)为主。338个样地可以划分为4个植被型组, 10个植被型, 20个植被亚型, 78个群系组和117个群系, 其中草原群系34个, 草甸群系33个, 荒漠群系33个, 灌丛群系14个和针叶林群系3个。该数据集覆盖青藏高原绝大部分高寒灌丛、高寒草原、高寒草甸、高寒荒漠、温性草原和温性荒漠植被区域, 可为研究高原植被特征和地带性分异规律, 气候变化和人类活动对高原植被的影响及其生态恢复提供坚实的数据基础, 同时为下一代中国植被图的更新提供参考。