Targeted mass spectrometry approaches for protein biomarker verification

The search for protein biomarkers has been a highly pursued topic in the proteomics community in the last decade. This relentless search is due to the constant need for validated biomarkers that could facilitate disease risk stratification, disease diagnosis, prognosis, monitoring as well as drug development, which ultimately would improve our quality of life. The recent development of proteomic technologies including the advancement of mass spectrometers with high sensitivity and speed has greatly advanced the discovery of potential biomarkers. One of the bottlenecks lies in the development of well-established verification assays to screen the biomarker candidates identified in the discovery stage. Recently, absolute quantitation using multiple-reaction monitoring mass spectrometry (MRM-MS) in combination with isotope-labeled internal standards has been extensively investigated as a tool for high-throughput protein biomarker verification. In this review, we describe and discuss recent developments and applications of MRM-MS methods for biomarker verification.     

Applications of urinary proteomics in biomarker discovery

Urine is an important source of biomarkers. This article reviews current advances, major challenges, and future prospects in the field of urinary proteomics. Because the practical clinical problem is to distinguish diseases with similar symptoms, merely comparing samples from patients of a particular disease to those of healthy individuals is inadequate for finding biomarkers with sufficient diagnostic power. In addition, the variation of expression levels of urinary proteins among healthy individuals and individuals under different physiological conditions adds to the difficulty in identifying biomarkers. We propose that establishing the natural variation in urinary protein expression among a healthy population can serve as a reference to help identify protein abundance changes that are caused by disease, not by individual variations or physiological changes. We also discuss that comparing protein expression levels between urine and plasma may reveal the physiological function of the kidney and that may facilitate biomarker discovery. Finally, we propose that establishing a data-sharing platform for data collection and integrating results from all urinary biomarker studies will help promote the development of urinary proteomics.     

Statistical significance analysis of nuclear magnetic resonance-based metabonomics data

Use of nuclear magnetic resonance (NMR)-based metabonomics to search for human disease biomarkers is becoming increasingly common. For many researchers, the ultimate goal is translation from biomarker discovery to clinical application. Studies typically involve investigators from diverse educational and training backgrounds, including physicians, academic researchers, and clinical staff. In evaluating potential biomarkers, clinicians routinely use statistical significance testing language, whereas academicians typically use multivariate statistical analysis techniques that do not perform statistical significance evaluation. In this article, we outline an approach to integrate statistical significance testing with conventional principal components analysis data representation. A decision tree algorithm is introduced to select and apply appropriate statistical tests to loadings plot data, which are then heat map color-coded according to P score, enabling direct visual assessment of statistical significance. A multiple comparisons correction must be applied to determine P scores from which reliable inferences can be made. Knowledge of means and standard deviations of statistically significant buckets enabled computation of effect sizes and study sizes for a given statistical power. Methods were demonstrated using data from a previous study. Integrated metabonomics data assessment methodology should facilitate translation of NMR-based metabonomics discovery of human disease biomarkers to clinical use.     

Computational Biomarker Pipeline from Discovery to Clinical Implementation: Plasma Proteomic Biomarkers for Cardiac Transplantation

Recent technical advances in the field of quantitative proteomics have stimulated a large number of biomarker discovery studies of various diseases, providing avenues for new treatments and diagnostics. However, inherent challenges have limited the successful translation of candidate biomarkers into clinical use, thus highlighting the need for a robust analytical methodology to transition from biomarker discovery to clinical implementation. We have developed an end-to-end computational proteomic pipeline for biomarkers studies. At the discovery stage, the pipeline emphasizes different aspects of experimental design, appropriate statistical methodologies, and quality assessment of results. At the validation stage, the pipeline focuses on the migration of the results to a platform appropriate for external validation, and the development of a classifier score based on corroborated protein biomarkers. At the last stage towards clinical implementation, the main aims are to develop and validate an assay suitable for clinical deployment, and to calibrate the biomarker classifier using the developed assay. The proposed pipeline was applied to a biomarker study in cardiac transplantation aimed at developing a minimally invasive clinical test to monitor acute rejection. Starting with an untargeted screening of the human plasma proteome, five candidate biomarker proteins were identified. Rejection-regulated proteins reflect cellular and humoral immune responses, acute phase inflammatory pathways, and lipid metabolism biological processes. A multiplex multiple reaction monitoring mass-spectrometry (MRM-MS) assay was developed for the five candidate biomarkers and validated by enzyme-linked immune-sorbent (ELISA) and immunonephelometric assays (INA). A classifier score based on corroborated proteins demonstrated that the developed MRM-MS assay provides an appropriate methodology for an external validation, which is still in progress. Plasma proteomic biomarkers of acute cardiac rejection may offer a relevant post-transplant monitoring tool to effectively guide clinical care. The proposed computational pipeline is highly applicable to a wide range of biomarker proteomic studies.     

Why have so few proteomic biomarkers “survived” validation? (Sample size and independent validation considerations)

Proteomic biomarker discovery has led to the identification of numerous potential candidates for disease diagnosis, prognosis, and prediction of response to therapy. However, very few of these identified candidate biomarkers reach clinical validation and go on to be routinely used in clinical practice. One particular issue with biomarker discovery is the identification of significantly changing proteins in the initial discovery experiment that do not validate when subsequently tested on separate patient sample cohorts. Here, we seek to highlight some of the statistical challenges surrounding the analysis of LC‐MS proteomic data for biomarker candidate discovery. We show that common statistical algorithms run on data with low sample sizes can overfit and yield misleading misclassification rates and AUC values. A common solution to this problem is to prefilter variables (via, e.g. ANOVA and or use of correction methods such as Bonferonni or false discovery rate) to give a smaller dataset and reduce the size of the apparent statistical challenge. However, we show that this exacerbates the problem yielding even higher performance metrics while reducing the predictive accuracy of the biomarker panel. To illustrate some of these limitations, we have run simulation analyses with known biomarkers. For our chosen algorithm (random forests), we show that the above problems are substantially reduced if a sufficient number of samples are analyzed and the data are not prefiltered. Our view is that LC‐MS proteomic biomarker discovery data should be analyzed without prefiltering and that increasing the sample size in biomarker discovery experiments should be a very high priority.     

Statistical Aspects of the Use of Biomarkers in Nutritional Epidemiology Research

Few strong and consistent associations have arisen from observational studies of dietary consumption in relation to chronic disease risk. Measurement error in self-reported dietary assessment may be obscuring many such associations. Attempts to correct for measurement error have mostly used a second self-reported assessment in a subset of a study cohort to calibrate the self-reported assessment used throughout the cohort, under the dubious assumption of uncorrelated measurement errors between the two assessments. The use, instead, of objective biomarkers of nutrient consumption to produce calibrated consumption estimates provides a promising approach to enhance study reliability. As summarized here, we have recently applied this nutrient biomarker approach to examine energy, protein, and percent of energy from protein, in relation to disease incidence in Women’s Health Initiative cohorts, and find strong associations that are not evident without biomarker calibration. A major bottleneck for the broader use of a biomarker-calibration approach is the rather few nutrients for which a suitable biomarker has been developed. Some methodologic approaches to the development of additional pertinent biomarkers, including the possible use of a respiratory quotient from indirect calorimetry for macronutrient biomarker development, and the potential of human feeding studies for the evaluation of a range of urine- and blood-based potential biomarkers, will briefly be described.     

Integrated pipeline for mass spectrometry-based discovery and confirmation of biomarkers demonstrated in a mouse model of breast cancer

Despite their potential to impact diagnosis and treatment of cancer, few protein biomarkers are in clinical use. Biomarker discovery is plagued with difficulties ranging from technological (inability to globally interrogate proteomes) to biological (genetic and environmental differences among patients and their tumors). We urgently need paradigms for biomarker discovery. To minimize biological variation and facilitate testing of proteomic approaches, we employed a mouse model of breast cancer. Specifically, we performed LC-MS/MS of tumor and normal mammary tissue from a conditional HER2/Neu-driven mouse model of breast cancer, identifying 6758 peptides representing >700 proteins. We developed a novel statistical approach (SASPECT) for prioritizing proteins differentially represented in LC-MS/MS datasets and identified proteins over- or under-represented in tumors. Using a combination of antibody-based approaches and multiple reaction monitoring-mass spectrometry (MRM-MS), we confirmed the overproduction of multiple proteins at the tissue level, identified fibulin-2 as a plasma biomarker, and extensively characterized osteopontin as a plasma biomarker capable of early disease detection in the mouse. Our results show that a staged pipeline employing shotgun-based comparative proteomics for biomarker discovery and multiple reaction monitoring for confirmation of biomarker candidates is capable of finding novel tissue and plasma biomarkers in a mouse model of breast cancer. Furthermore, the approach can be extended to find biomarkers relevant to human disease.     

Poor antibody validation is a challenge in biomedical research: a case study for detection of c-FLIP

Successful translation of findings derived from preclinical studies into effective therapies is critical in biomedical research. Lack of robustness and reproducibility of the preclinical data, due to insufficient number of repeats, inadequate cell-based and mouse models contribute to the poor success rate. Antibodies are widely used in preclinical research, notably to determine the expression of potential therapeutic targets in tissues of interest, including tumors, but also to identify disease and/or treatment response biomarkers. We sought to determine whether the current antibody characterization standards in preclinical research are sufficient to ensure reliability of the data found in peer-reviewed publications. To address this issue, we used detection of the protein c-FLIP, a major factor of resistance to apoptosis, as a proof of concept. Accurate detection of endogenous c-FLIP levels in the preclinical settings is imperative since it is considered as a potential theranostic biomarker. Several sources of c-FLIP antibodies validated by their manufacturer and recommended for western blotting were therefore rigorously tested. We found a wide divergence in immune recognition properties. While these antibodies have been used in many publications, our results show that several of them failed to detect endogenous c-FLIP protein by Western blotting. Our results suggest that antibody validation standards are inadequate, and that systematic use of genetic knockdowns and/or knockouts to establish proof of specificity is critical, even for antibodies previously used in the scientific literature. Because antibodies are fundamental tools in both preclinical and clinical research, ensuring their specificity is crucial.     

A targeted proteomics-based pipeline for verification of biomarkers in plasma

High-throughput technologies can now identify hundreds of candidate protein biomarkers for any disease with relative ease. However, because there are no assays for the majority of proteins and de novo immunoassay development is prohibitively expensive, few candidate biomarkers are tested in clinical studies. We tested whether the analytical performance of a biomarker identification pipeline based on targeted mass spectrometry would be sufficient for data-dependent prioritization of candidate biomarkers, de novo development of assays and multiplexed biomarker verification. We used a data-dependent triage process to prioritize a subset of putative plasma biomarkers from >1,000 candidates previously identified using a mouse model of breast cancer. Eighty-eight novel quantitative assays based on selected reaction monitoring mass spectrometry were developed, multiplexed and evaluated in 80 plasma samples. Thirty-six proteins were verified as being elevated in the plasma of tumor-bearing animals. The analytical performance of this pipeline suggests that it should support the use of an analogous approach with human samples.     

Qualification of translational safety biomarkers

Safety biomarkers are important drug development tools, both preclinically and clinically. It is a straightforward process to correlate the performance of nonclinical safety biomarkers with histopathology, and ideally, the biomarker is useful in all species commonly used in safety assessment. In clinical validation studies, where histopathology is not feasible, safety biomarkers are compared to the response of standard biomarkers and/or to clinical adjudication. Worldwide, regulatory agencies have put in place processes to qualify biomarkers to provide confidence in the manner of use and interpretation of biomarker data in drug development studies. This paper describes currently qualified safety biomarkers which can be utilized to monitor for nephrotoxicity and cardiotoxicity and ongoing projects to qualify safety biomarkers for liver, skeletal muscle, and vascular injury. In many cases, the development and use of these critical drug development tools is dependent upon partnerships and the precompetitive sharing of data to support qualification efforts.     

Robust Estimation of Area Under ROC Curve Using Auxiliary Variables in the Presence of Missing Biomarker Values

Summary In medical research, the receiver operating characteristic (ROC) curves can be used to evaluate the performance of biomarkers for diagnosing diseases or predicting the risk of developing a disease in the future. The area under the ROC curve (ROC AUC), as a summary measure of ROC curves, is widely utilized, especially when comparing multiple ROC curves. In observational studies, the estimation of the AUC is often complicated by the presence of missing biomarker values, which means that the existing estimators of the AUC are potentially biased. In this article, we develop robust statistical methods for estimating the ROC AUC and the proposed methods use information from auxiliary variables that are potentially predictive of the missingness of the biomarkers or the missing biomarker values. We are particularly interested in auxiliary variables that are predictive of the missing biomarker values. In the case of missing at random (MAR), that is, missingness of biomarker values only depends on the observed data, our estimators have the attractive feature of being consistent if one correctly specifies, conditional on auxiliary variables and disease status, either the model for the probabilities of being missing or the model for the biomarker values. In the case of missing not at random (MNAR), that is, missingness may depend on the unobserved biomarker values, we propose a sensitivity analysis to assess the impact of MNAR on the estimation of the ROC AUC. The asymptotic properties of the proposed estimators are studied and their finite‐sample behaviors are evaluated in simulation studies. The methods are further illustrated using data from a study of maternal depression during pregnancy.     

Latent class models for joint analysis of disease prevalence and high-dimensional semicontinuous biomarker data

High-dimensional biomarker data are often collected in epidemiological studies when assessing the association between biomarkers and human disease is of interest. We develop a latent class modeling approach for joint analysis of high-dimensional semicontinuous biomarker data and a binary disease outcome. To model the relationship between complex biomarker expression patterns and disease risk, we use latent risk classes to link the 2 modeling components. We characterize complex biomarker-specific differences through biomarker-specific random effects, so that different biomarkers can have different baseline (low-risk) values as well as different between-class differences. The proposed approach also accommodates data features that are common in environmental toxicology and other biomarker exposure data, including a large number of biomarkers, numerous zero values, and complex mean-variance relationship in the biomarkers levels. A Monte Carlo EM (MCEM) algorithm is proposed for parameter estimation. Both the MCEM algorithm and model selection procedures are shown to work well in simulations and applications. In applying the proposed approach to an epidemiological study that examined the relationship between environmental polychlorinated biphenyl (PCB) exposure and the risk of endometriosis, we identified a highly significant overall effect of PCB concentrations on the risk of endometriosis.     

A tool for biomarker discovery in the urinary proteome: a manually curated human and animal urine protein biomarker database

Urine is an important source of biomarkers. A single proteomics assay can identify hundreds of differentially expressed proteins between disease and control samples; however, the ability to select biomarker candidates with the most promise for further validation study remains difficult. A bioinformatics tool that allows accurate and convenient comparison of all of the existing related studies can markedly aid the development of this area. In this study, we constructed the Urinary Protein Biomarker (UPB) database to collect existing studies of urinary protein biomarkers from published literature. To ensure the quality of data collection, all literature was manually curated. The website (http://122.70.220.102/biomarker) allows users to browse the database by disease categories and search by protein IDs in bulk. Researchers can easily determine whether a biomarker candidate has already been identified by another group for the same disease or for other diseases, which allows for the confidence and disease specificity of their biomarker candidate to be evaluated. Additionally, the pathophysiological processes of the diseases can be studied using our database with the hypothesis that diseases that share biomarkers may have the same pathophysiological processes. Because of the natural relationship between urinary proteins and the urinary system, this database may be especially suitable for studying the pathogenesis of urological diseases. Currently, the database contains 553 and 275 records compiled from 174 and 31 publications of human and animal studies, respectively. We found that biomarkers identified by different proteomic methods had a poor overlap with each other. The differences between sample preparation and separation methods, mass spectrometers, and data analysis algorithms may be influencing factors. Biomarkers identified from animal models also overlapped poorly with those from human samples, but the overlap rate was not lower than that of human proteomics studies. Therefore, it is not clear how well the animal models mimic human diseases.     

Identification of Circulating Biomarker Candidates for Hepatocellular Carcinoma (HCC): An Integrated Prioritization Approach

Hepatocellular carcinoma (HCC) is the world’s third most widespread cancer. Currently available circulating biomarkers for this silently progressing malignancy are not sufficiently specific and sensitive to meet all clinical needs. There is an imminent and pressing need for the identification of novel circulating biomarkers to increase disease-free survival rate. In order to facilitate the selection of the most promising circulating protein biomarkers, we attempted to define an objective method likely to have a significant impact on the analysis of vast data generated from cutting-edge technologies. Current study exploits data available in seven publicly accessible gene and protein databases, unveiling 731 liver-specific proteins through initial enrichment analysis. Verification of expression profiles followed by integration of proteomic datasets, enriched for the cancer secretome, filtered out 20 proteins including 6 previously characterized circulating HCC biomarkers. Finally, interactome analysis of these proteins with midkine (MDK), dickkopf-1 (DKK-1), current standard HCC biomarker alpha-fetoprotein (AFP), its interacting partners in conjunction with HCC-specific circulating and liver deregulated miRNAs target filtration highlighted seven novel statistically significant putative biomarkers including complement component 8, alpha (C8A), mannose binding lectin (MBL2), antithrombin III (SERPINC1), 11β-hydroxysteroid dehydrogenase type 1 (HSD11B1), alcohol dehydrogenase 6 (ADH6), beta-ureidopropionase (UPB1) and cytochrome P450, family 2, subfamily A, polypeptide 6 (CYP2A6). Our proposed methodology provides a swift assortment process for biomarker prioritization that eventually reduces the economic burden of experimental evaluation. Further dedicated validation studies of potential putative biomarkers on HCC patient blood samples are warranted. We hope that the use of such integrative secretome, interactome and miRNAs target filtration approach will accelerate the selection of high-priority biomarkers for other diseases as well, that are more amenable to downstream clinical validation experiments.     

Isotope-labeled protein standards: toward absolute quantitative proteomics

Diagnostic development and public health surveillance require technologies that provide specific identification and absolute quantification of protein biomarkers. Beside immunologically related techniques (e.g. enzyme-linked immunosorbent assay), MS is gaining increasing interest due to its high sensitivity and specificity. Furthermore, MS-based analyses are extremely accurate quantitatively, provided that suitable reference standards are available. Recently, the use of chemically synthesized isotope-labeled marker peptides for MS-based absolute quantification of proteins has led to major advances. However, we show here that the use of such peptides can lead to severe biases. In this work, we present an innovative strategy (Protein Standard Absolute Quantification) that uses in vitro-synthesized isotope-labeled full-length proteins as standards for absolute quantification. As those protein standards perfectly match the biochemical properties of the target proteins, they can be directly added into the samples to be analyzed, allowing a highly accurate quantification of proteins even in prefractionated complex samples. The power of our Protein Standard Absolute Quantification methodology for accurate absolute quantification of biomarkers was demonstrated both on water and urine samples contaminated with Staphylococcus aureus superantigenic toxins as typical biomarkers of public health interest.     

Toward a standardized urine proteome analysis methodology

Urine is an easily accessible bodily fluid particularly suited for the routine clinical analysis of disease biomarkers. Actually, the urinary proteome is more diverse than anticipated a decade ago. Hence, significant analytical and practical issues of urine proteomics such as sample collection and preparation have emerged, in particular for large-scale studies. We have undertaken a systematic study to define standardized and integrated analytical protocols for a biomarker development pipeline, employing two LC-MS analytical platforms, namely accurate mass and time tags and selected reaction monitoring, for the discovery and verification phase, respectively. Urine samples collected from hospital patients were processed using four different protocols, which were evaluated and compared on both analytical platforms. Addition of internal standards at various stages of sample processing allowed the estimation of protein extraction yields and the absolute quantification of selected urinary proteins. Reproducibility of the entire process and dynamic range of quantification were also evaluated. Organic solvent precipitation followed by in-solution digestion provided the best performances and was thus selected as the standard method common to the discovery and verification phases. Finally, we applied this protocol for platforms' cross-validation and obtained excellent consistency between urinary protein concentration estimates by both analytical methods performed in parallel in two laboratories.     

Exploring metabolic pathway disruption in the subchronic phencyclidine model of schizophrenia with the Generalized Singular Value Decomposition

Background

One of the major goals in gene and protein expression profiling of cancer is to identify biomarkers and build classification models for prediction of disease prognosis or treatment response. Many traditional statistical methods, based on microarray gene expression data alone and individual genes' discriminatory power, often fail to identify biologically meaningful biomarkers thus resulting in poor prediction performance across data sets. Nonetheless, the variables in multivariable classifiers should synergistically interact to produce more effective classifiers than individual biomarkers.

Results

We developed an integrated approach, namely network-constrained support vector machine (netSVM), for cancer biomarker identification with an improved prediction performance. The netSVM approach is specifically designed for network biomarker identification by integrating gene expression data and protein-protein interaction data. We first evaluated the effectiveness of netSVM using simulation studies, demonstrating its improved performance over state-of-the-art network-based methods and gene-based methods for network biomarker identification. We then applied the netSVM approach to two breast cancer data sets to identify prognostic signatures for prediction of breast cancer metastasis. The experimental results show that: (1) network biomarkers identified by netSVM are highly enriched in biological pathways associated with cancer progression; (2) prediction performance is much improved when tested across different data sets. Specifically, many genes related to apoptosis, cell cycle, and cell proliferation, which are hallmark signatures of breast cancer metastasis, were identified by the netSVM approach. More importantly, several novel hub genes, biologically important with many interactions in PPI network but often showing little change in expression as compared with their downstream genes, were also identified as network biomarkers; the genes were enriched in signaling pathways such as TGF-beta signaling pathway, MAPK signaling pathway, and JAK-STAT signaling pathway. These signaling pathways may provide new insight to the underlying mechanism of breast cancer metastasis.

Conclusions

We have developed a network-based approach for cancer biomarker identification, netSVM, resulting in an improved prediction performance with network biomarkers. We have applied the netSVM approach to breast cancer gene expression data to predict metastasis in patients. Network biomarkers identified by netSVM reveal potential signaling pathways associated with breast cancer metastasis, and help improve the prediction performance across independent data sets.     

Targeted quantitation of CVD-linked plasma proteins for biomarker verification and validation

Despite significant advances in treatment, cardiovascular disease (CVD) remains one of the leading causes of morbidity and mortality in developed and developing countries. Judicious monitoring of common risk factors has been unable to control this global epidemic, necessitating novel biomarkers for improved screening and earlier disease detection and management. Although numerous plasma proteins have been associated with CVD, only a few of these potential biomarkers have been validated for clinical use. Here we review the quantitative proteomic methods used to verify and validate new biomarker candidates in human plasma. These methods center on a bottom-up approach involving multiple or selected reaction monitoring, for targeted detection, with stable isotope-labeled standards, for peptide normalization. Also included are a discussion of future strategies for improved CVD protein biomarker verification and validation, recommendations for method translation to the clinic, and future projections for protein biomarker research.     

High-performance proteomics as a tool in biomarker discovery

Biomarkers allowing early detection of disease or therapy control have a huge influence in curing a disease. A wide variety of methods were applied to find new biomarkers. In contrast to methods focused on DNA or mRNA techniques, approaches considering proteins as potential biomarker candidates have the advantage that proteins are more diverse than DNA or RNA and are more reflective of a biological system. Here, we present an approach for the identification of new biomarkers relying on our experience from the past 10 years of proteomics, outlining a concept of "high-performance proteomics" This approach is based on quantitative proteome analysis using a sufficient number of clinical samples and statistical validation of proteomics data by independent methods, such as Western blot analysis or immunohistochemistry.     

A Modified Risk Set Approach to Biomarker Evaluation Studies

There is tremendous scientific and medical interest in the use of biomarkers to better facilitate medical decision making. In this article, we present a simple framework for assessing the predictive ability of a biomarker. The methodology requires use of techniques from a subfield of survival analysis termed semi-competing risks; results are presented to make the article self-contained. As we show in the article, one natural interpretation of semi-competing risks model is in terms of modifying the classical risk set approach to survival analysis that is more germane to medical decision making. A crucial parameter for evaluating biomarkers is the predictive hazard ratio, which is different from the usual hazard ratio from Cox regression models for right-censored data. This quantity will be defined; its estimation, inference, and adjustment for covariates will be discussed. Aspects of causal inference related to these procedures will also be described. The methodology is illustrated with an evaluation of serum albumin in terms of predicting death in patients with primary biliary cirrhosis.