A Review of the Deep Learning Methods for Medical Images Super Resolution Problems

Super resolution problems are widely discussed in medical imaging. Spatial resolution of medical images are not sufficient due to the constraints such as image acquisition time, low irradiation dose or hardware limits. To address these problems, different super resolution methods have been proposed, such as optimization or learning-based approaches. Recently, deep learning methods become a thriving technology and are developing at an exponential speed. We think it is necessary to write a review to present the current situation of deep learning in medical imaging super resolution. In this paper, we first briefly introduce deep learning methods, then present a number of important deep learning approaches to solve super resolution problems, different architectures as well as up-sampling operations will be introduced. Afterwards, we focus on the applications of deep learning methods in medical imaging super resolution problems, the challenges to overcome will be presented as well.     

Large-scale pharmacogenomic studies and drug response prediction for personalized cancer medicine

The response rate of most anti-cancer drugs is limited because of the high heterogeneity of cancer and the complex mechanism of drug action. Personalized treatment that stratifies patients into subgroups using molecular biomarkers is promising to improve clinical benefit. With the accumulation of preclinical models and advances in computational approaches of drug response prediction, pharmacogenomics has made great success over the last 20 years and is increasingly used in the clinical practice of personalized cancer medicine. In this article, we first summarize FDA-approved pharmacogenomic biomarkers and large-scale pharmacogenomic studies of preclinical cancer models such as patient-derived cell lines, organoids, and xenografts. Furthermore, we comprehensively review the recent developments of computational methods in drug response prediction, covering network, machine learning, and deep learning technologies and strategies to evaluate immunotherapy response. In the end, we discuss challenges and propose possible solutions for further improvement.     

Smart de novo Macromolecular Structure Modeling from Cryo-EM Maps

The study of macromolecular structures has expanded our understanding of the amazing cell machinery and such knowledge has changed how the pharmaceutical industry develops new vaccines in recent years. Traditionally, X-ray crystallography has been the main method for structure determination, however, cryogenic electron microscopy (cryo-EM) has increasingly become more popular due to recent advancements in hardware and software. The number of cryo-EM maps deposited in the EMDataResource (formerly EMDatabase) since 2002 has been dramatically increasing and it continues to do so. De novo macromolecular complex modeling is a labor-intensive process, therefore, it is highly desirable to develop software that can automate this process. Here we discuss our automated, data-driven, and artificial intelligence approaches including map processing, feature extraction, modeling building, and target identification. Recently, we have enabled DNA/RNA modeling in our deep learning-based prediction tool, DeepTracer. We have also developed DeepTracer-ID, a tool that can identify proteins solely based on the cryo-EM map. In this paper, we will present our accumulated experiences in developing deep learning-based methods surrounding macromolecule modeling applications.     

Estimating gene expression from DNA methylation and copy number variation: A deep learning regression model for multi-omics integration

Gene expression analysis plays a significant role for providing molecular insights in cancer. Various genetic and epigenetic factors (being dealt under multi-omics) affect gene expression giving rise to cancer phenotypes. A recent growth in understanding of multi-omics seems to provide a resource for integration in interdisciplinary biology since they altogether can draw the comprehensive picture of an organism's developmental and disease biology in cancers. Such large scale multi-omics data can be obtained from public consortium like The Cancer Genome Atlas (TCGA) and several other platforms. Integrating these multi-omics data from varied platforms is still challenging due to high noise and sensitivity of the platforms used. Currently, a robust integrative predictive model to estimate gene expression from these genetic and epigenetic data is lacking. In this study, we have developed a deep learning-based predictive model using Deep Denoising Auto-encoder (DDAE) and Multi-layer Perceptron (MLP) that can quantitatively capture how genetic and epigenetic alterations correlate with directionality of gene expression for liver hepatocellular carcinoma (LIHC). The DDAE used in the study has been trained to extract significant features from the input omics data to estimate the gene expression. These features have then been used for back-propagation learning by the multilayer perceptron for the task of regression and classification. We have benchmarked the proposed model against state-of-the-art regression models. Finally, the deep learning-based integration model has been evaluated for its disease classification capability, where an accuracy of 95.1% has been obtained.     

Recent applications of machine learning in medicinal chemistry

In recent decades, artificial intelligence and machine learning have played a significant role in increasing the efficiency of processes across a wide spectrum of industries. When it comes to the pharmaceutical and biotechnology sectors, numerous tools enabled by advancement of computer science have been developed and are now routinely utilized. However, there are many aspects of the drug discovery process, which can further benefit from refinement of computational methods and tools, as well as improvement of accessibility of these new technologies. In this review, examples of recent developments in machine learning application are described, which have the potential to impact different parts of the drug discovery and development flow scheme. Notably, new deep learning-based approaches across compound design and synthesis, prediction of binding, activity and ADMET properties, as well as applications of genetic algorithms are highlighted.     

Machine learning in quantitative PET: A review of attenuation correction and low-count image reconstruction methods

The rapid expansion of machine learning is offering a new wave of opportunities for nuclear medicine. This paper reviews applications of machine learning for the study of attenuation correction (AC) and low-count image reconstruction in quantitative positron emission tomography (PET). Specifically, we present the developments of machine learning methodology, ranging from random forest and dictionary learning to the latest convolutional neural network-based architectures. For application in PET attenuation correction, two general strategies are reviewed: 1) generating synthetic CT from MR or non-AC PET for the purposes of PET AC, and 2) direct conversion from non-AC PET to AC PET. For low-count PET reconstruction, recent deep learning-based studies and the potential advantages over conventional machine learning-based methods are presented and discussed. In each application, the proposed methods, study designs and performance of published studies are listed and compared with a brief discussion. Finally, the overall contributions and remaining challenges are summarized.     

High-dimensional feature selection in competing risks modeling: A stable approach using a split-and-merge ensemble algorithm

Variable selection is critical in competing risks regression with high-dimensional data. Although penalized variable selection methods and other machine learning-based approaches have been developed, many of these methods often suffer from instability in practice. This paper proposes a novel method named Random Approximate Elastic Net (RAEN). Under the proportional subdistribution hazards model, RAEN provides a stable and generalizable solution to the large-p-small-n variable selection problem for competing risks data. Our general framework allows the proposed algorithm to be applicable to other time-to-event regression models, including competing risks quantile regression and accelerated failure time models. We show that variable selection and parameter estimation improved markedly using the new computationally intensive algorithm through extensive simulations. A user-friendly R package RAEN is developed for public use. We also apply our method to a cancer study to identify influential genes associated with the death or progression from bladder cancer.     

A novel method for non-invasive detection of aflatoxin contaminated dried figs with deep transfer learning approach

Aflatoxins are the most dangerous mycotoxin produced by Aspergillus fungal species, such as Aspergillus flavus and Aspergillus parasiticus, and can cause various health problems, including liver cancer, in humans. Figs and many agricultural products are affected by aflatoxins. It is crucial to detect it before consumption since it is impossible to clean aflatoxin from contaminated foods. Chromatographic methods are considered the gold standard for aflatoxin detection, but these methods are pretty expensive, time-consuming, and destructive. Therefore, various studies have been conducted on non-invasive aflatoxin detection using optical spectroscopic methods. Specifically, aflatoxin-contaminated figs are sorted manually by employees in production facilities using the Bright Greenish Yellow Fluorescence (BGYF) method under ultraviolet (UV) light. However, accurate and safe manual sorting depends on expertise of employees, along with this long exposure time to UV radiation may cause employees skin cancer and eye disorders. This study presents a deep transfer learning-based approach for non-invasive detection and classification of aflatoxin-contaminated dried figs using images captured under UV light. Pre-trained transfer learning models, such as DenseNet, ResNet, VGG, and InceptionNet, are applied to the dataset, but the accuracy of these models does not outperform the other methods that detect aflatoxin with the BGYF method. Therefore, fine-tuning is performed on the models. As a result, training accuracy of 98.57% and validation accuracy of 97.50% is obtained using the DenseNet169 model. The experimental results show that our proposed method achieves the highest accuracy among other methods. Also, the proposed method shows that deep CNN can be used to automatically, rapidly, and effectively detect aflatoxin-contaminated figs.     

Deep learning methods for 3D structural proteome and interactome modeling

Bolstered by recent methodological and hardware advances, deep learning has increasingly been applied to biological problems and structural proteomics. Such approaches have achieved remarkable improvements over traditional machine learning methods in tasks ranging from protein contact map prediction to protein folding, prediction of protein–protein interaction interfaces, and characterization of protein–drug binding pockets. In particular, emergence of ab initio protein structure prediction methods including AlphaFold2 has revolutionized protein structural modeling. From a protein function perspective, numerous deep learning methods have facilitated deconvolution of the exact amino acid residues and protein surface regions responsible for binding other proteins or small molecule drugs. In this review, we provide a comprehensive overview of recent deep learning methods applied in structural proteomics.     

利用人工智能预测癌症的易感性、复发性和生存期

癌症具有较高的发病率和致死率,对人类健康具有重大威胁。癌症预后分析可以有效避免过度治疗及医疗资源的浪费,为医务人员及家属进行医疗决策提供科学依据,已成为癌症研究的必要条件。随着近年来人工智能技术的迅速发展,对癌症患者的预后情况进行自动化分析成为可能。此外,随着医疗信息化的发展,智慧医疗的理念受到广泛关注。癌症患者作为智慧医疗的重要组成部分,对其进行有效的智能预后分析十分必要。本文综述现有基于机器学习的癌症预后方法。首先,对机器学习与癌症预后进行概述,介绍癌症预后及相关的机器学习方法,分析机器学习在癌症预后中的应用;然后,对基于机器学习的癌症预后方法进行归纳,包括癌症易感性预测、癌症复发性预测、癌症生存期预测,梳理了它们的研究现状、涉及到的癌症类型与数据集、用到的机器学习方法及预后性能、特点、优势与不足;最后,对癌症预后方法进行总结与展望。     

A review of deep learning based methods for medical image multi-organ segmentation

Deep learning has revolutionized image processing and achieved the-state-of-art performance in many medical image segmentation tasks. Many deep learning-based methods have been published to segment different parts of the body for different medical applications. It is necessary to summarize the current state of development for deep learning in the field of medical image segmentation. In this paper, we aim to provide a comprehensive review with a focus on multi-organ image segmentation, which is crucial for radiotherapy where the tumor and organs-at-risk need to be contoured for treatment planning. We grouped the surveyed methods into two broad categories which are ‘pixel-wise classification’ and ‘end-to-end segmentation’. Each category was divided into subgroups according to their network design. For each type, we listed the surveyed works, highlighted important contributions and identified specific challenges. Following the detailed review, we discussed the achievements, shortcomings and future potentials of each category. To enable direct comparison, we listed the performance of the surveyed works that used thoracic and head-and-neck benchmark datasets.     

A Comprehensive Review of Dysregulated miRNAs Involved in Cervical Cancer

MicroRNAs(miRNAs) have become the center of interest in oncology. In recent years, various studies have demonstrated that miRNAs regulate gene expression by influencing important regulatory genes and thus are responsible for causing cervical cancer. Cervical cancer being the third most diagnosed cancer among the females worldwide, is the fourth leading cause of cancer related mortality. Prophylactic human papillomavirus (HPV) vaccines and new HPV screening tests, combined with traditional Pap test screening have greatly reduced cervical cancer. Yet, thousands of women continue to be diagnosed with and die of this preventable disease annually. This has necessitated the scientists to ponder over ways of evolving new methods and chalk out novel treatment protocols/strategies. As miRNA deregulation plays a key role in malignant transformation of cervical cancer along with its targets that can be exploited for both prognostic and therapeutic strategies, we have collected and reviewed the role of miRNA in cervical cancer. A systematic search was performed using PubMed for articles that report aberrant expression of miRNA in cervical cancer. The present review provides comprehensive information for 246 differentially expressed miRNAs gathered from 51 published articles that have been implicated in cervical cancer progression. Of these, more than 40 miRNAs have been reported in the literature in several instances signifying their role in the regulation of cancer. We also identified 40 experimentally validated targets, studied the cause of miRNAs dysregulation along with its mechanism and role in different stages of cervical cancer. We also identified and analysed miRNA clusters and their expression pattern in cervical cancer. This review is expected to further enhance our understanding in this field and serve as a valuable reference resource.     

From cancer big data to treatment: Artificial intelligence in cancer research

In recent years, developing the idea of “cancer big data” has emerged as a result of the significant expansion of various fields such as clinical research, genomics, proteomics and public health records. Advances in omics technologies are making a significant contribution to cancer big data in biomedicine and disease diagnosis. The increasingly availability of extensive cancer big data has set the stage for the development of multimodal artificial intelligence (AI) frameworks. These frameworks aim to analyze high-dimensional multi-omics data, extracting meaningful information that is challenging to obtain manually. Although interpretability and data quality remain critical challenges, these methods hold great promise for advancing our understanding of cancer biology and improving patient care and clinical outcomes. Here, we provide an overview of cancer big data and explore the applications of both traditional machine learning and deep learning approaches in cancer genomic and proteomic studies. We briefly discuss the challenges and potential of AI techniques in the integrated analysis of omics data, as well as the future direction of personalized treatment options in cancer.     

Protein structure prediction in the deep learning era

Significant advances have been achieved in protein structure prediction, especially with the recent development of the AlphaFold2 and the RoseTTAFold systems. This article reviews the progress in deep learning-based protein structure prediction methods in the past two years. First, we divide the representative methods into two categories: the two-step approach and the end-to-end approach. Then, we show that the two-step approach is possible to achieve similar accuracy to the state-of-the-art end-to-end approach AlphaFold2. Compared to the end-to-end approach, the two-step approach requires fewer computing resources. We conclude that it is valuable to keep developing both approaches. Finally, a few outstanding challenges in function-orientated protein structure prediction are pointed out for future development.     

In situ immunopathological events in human cervical intraepithelial neoplasia and cervical cancer: Review

Neoplasia of the cervix represents one of the most common cancers in women. Clinical and molecular research has identified immunological impairment in squamous intraepithelial cervical lesions and cervical cancer patients. The in-situ expression of several cytokines by uterine epithelial cells and by infiltrating leukocytes occurs during the cervical intraepithelial neoplasia and cervical cancer. Some of these cytokines can prevent and others can induce the progression of the neoplasm. The infiltrating leukocytes also produce cytokines and growth factors relate to angiogenesis, chemotaxis, and apoptosis capable of modulating the dysplasia progression. In this review we analyzed several interleukins with an inductive effect or blocking effect on the neoplastic progression. We also analyze the genetic polymorphism of some cytokines and their relationship with the risk of developing cervical neoplasia. In addition, we describe the leukocyte cells that infiltrate the cervical uterine tissue during the neoplasia and their effects on neoplasia progression.     

Structure-based protein design with deep learning

Since the first revelation of proteins functioning as macromolecular machines through their three dimensional structures, researchers have been intrigued by the marvelous ways the biochemical processes are carried out by proteins. The aspiration to understand protein structures has fueled extensive efforts across different scientific disciplines. In recent years, it has been demonstrated that proteins with new functionality or shapes can be designed via structure-based modeling methods, and the design strategies have combined all available information — but largely piece-by-piece — from sequence derived statistics to the detailed atomic-level modeling of chemical interactions. Despite the significant progress, incorporating data-derived approaches through the use of deep learning methods can be a game changer. In this review, we summarize current progress, compare the arc of developing the deep learning approaches with the conventional methods, and describe the motivation and concepts behind current strategies that may lead to potential future opportunities.     

Deep learning for reconstructing protein structures from cryo-EM density maps: Recent advances and future directions

Cryo-Electron Microscopy (cryo-EM) has emerged as a key technology to determine the structure of proteins, particularly large protein complexes and assemblies in recent years. A key challenge in cryo-EM data analysis is to automatically reconstruct accurate protein structures from cryo-EM density maps. In this review, we briefly overview various deep learning methods for building protein structures from cryo-EM density maps, analyze their impact, and discuss the challenges of preparing high-quality data sets for training deep learning models. Looking into the future, more advanced deep learning models of effectively integrating cryo-EM data with other sources of complementary data such as protein sequences and AlphaFold-predicted structures need to be developed to further advance the field.     

AMP-BERT: Prediction of antimicrobial peptide function based on a BERT model

Antimicrobial resistance is a growing health concern. Antimicrobial peptides (AMPs) disrupt harmful microorganisms by nonspecific mechanisms, making it difficult for microbes to develop resistance. Accordingly, they are promising alternatives to traditional antimicrobial drugs. In this study, we developed an improved AMP classification model, called AMP-BERT. We propose a deep learning model with a fine-tuned bidirectional encoder representations from transformers (BERT) architecture designed to extract structural/functional information from input peptides and identify each input as AMP or non-AMP. We compared the performance of our proposed model and other machine/deep learning-based methods. Our model, AMP-BERT, yielded the best prediction results among all models evaluated with our curated external dataset. In addition, we utilized the attention mechanism in BERT to implement an interpretable feature analysis and determine the specific residues in known AMPs that contribute to peptide structure and antimicrobial function. The results show that AMP-BERT can capture the structural properties of peptides for model learning, enabling the prediction of AMPs or non-AMPs from input sequences. AMP-BERT is expected to contribute to the identification of candidate AMPs for functional validation and drug development. The code and dataset for the fine-tuning of AMP-BERT is publicly available at https://github.com/GIST-CSBL/AMP-BERT .