Statistical analysis of systematic errors in high-throughput screening

High-throughput screening (HTS) is an efficient technology for drug discovery. It allows for screening of more than 100,000 compounds a day per screen and requires effective procedures for quality control. The authors have developed a method for evaluating a background surface of an HTS assay; it can be used to correct raw HTS data. This correction is necessary to take into account systematic errors that may affect the procedure of hit selection. The described method allows one to analyze experimental HTS data and determine trends and local fluctuations of the corresponding background surfaces. For an assay with a large number of plates, the deviations of the background surface from a plane are caused by systematic errors. Their influence can be minimized by the subtraction of the systematic background from the raw data. Two experimental HTS assays from the ChemBank database are examined in this article. The systematic error present in these data was estimated and removed from them. It enabled the authors to correct the hit selection procedure for both assays.     

Development, validation and implementation of immobilized metal affinity for phosphochemicals (IMAP)-based high-throughput screening assays for low-molecular-weight compound libraries

This protocol describes assay development, validation and implementation of automated immobilized metal affinity for phosphochemicals (IMAP)-based fluorescence polarization (FP) and time-resolved fluorescence resonance energy transfer (TR-FRET) high-throughput screening (HTS) assays for identification of low-molecular-weight kinase inhibitors. Both procedures are performed in miniaturized kinase reaction volumes and involve the stepwise addition of test or control compounds, enzyme and substrate/ATP. Kinase reactions are stopped by subsequent addition of IMAP-binding buffer. Assay attributes of the IMAP FP and TR-FRET methodologies are described. HTS assays developed using these procedures should result in Z-factors and low assay variability necessary for robust HTS assays. Providing that the required reagents and equipment are available, one scientist should be able to develop a 384-well, miniaturized HTS assay in approximately 6-8 weeks. Specific automated HTS assay conditions will determine the number of assay plates processed in a screening session, but two scientists should expect to process between 100 and 150 assay plates in one 8-h screening day.     

An efficient method for the detection and elimination of systematic error in high-throughput screening

MOTIVATION: High-throughput screening (HTS) is an early-stage process in drug discovery which allows thousands of chemical compounds to be tested in a single study. We report a method for correcting HTS data prior to the hit selection process (i.e. selection of active compounds). The proposed correction minimizes the impact of systematic errors which may affect the hit selection in HTS. The introduced method, called a well correction, proceeds by correcting the distribution of measurements within wells of a given HTS assay. We use simulated and experimental data to illustrate the advantages of the new method compared to other widely-used methods of data correction and hit selection in HTS. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.     

A cell-based beta-lactamase reporter gene assay for the identification of inhibitors of hepatitis C virus replication

This report describes the development, optimization, and implementation of a cell-based assay for high-throughput screening (HTS) to identify inhibitors to hepatitis C virus (HCV) replication. The assay is based on a HCV subgenomic RNA replicon that expresses beta-lactamase as a reporter for viral replication in enhanced Huh-7 cells. The drug targets in this assay are viral and cellular enzymes required for HCV replication, which are monitored by fluorescence resonance energy transfer using cell-permeable CCF4-AM as a beta-lactamase substrate. Digital image processing was used to visualize cells that harbor viral RNA and to optimize key assay development parameters such as transfection and culturing conditions to obtain a cell line which produced a robust assay window. Formatting the assay for compound screening was problematic due to small signal-to-background ratio and reduced potency to known HCV inhibitors. These technical difficulties were solved by using clavulanic acid, an irreversible inhibitor of beta-lactamase, to eliminate residual beta-lactamase activity after HCV replication was terminated, thus resulting in an improved assay window. HTS was carried out in 384-well microplate format, and the signal-to-background ratio and Z factor for the assay plates during the screen were approximately 13-fold and 0.5, respectively.     

Identifying actives from HTS data sets: practical approaches for the selection of an appropriate HTS data-processing method and quality control review

High-throughput screening (HTS) has achieved a dominant role in drug discovery over the past 2 decades. The goal of HTS is to identify active compounds (hits) by screening large numbers of diverse chemical compounds against selected targets and/or cellular phenotypes. The HTS process consists of multiple automated steps involving compound handling, liquid transfers, and assay signal capture, all of which unavoidably contribute to systematic variation in the screening data. The challenge is to distinguish biologically active compounds from assay variability. Traditional plate controls-based and non-controls-based statistical methods have been widely used for HTS data processing and active identification by both the pharmaceutical industry and academic sectors. More recently, improved robust statistical methods have been introduced, reducing the impact of systematic row/column effects in HTS data. To apply such robust methods effectively and properly, we need to understand their necessity and functionality. Data from 6 HTS case histories are presented to illustrate that robust statistical methods may sometimes be misleading and can result in more, rather than less, false positives or false negatives. In practice, no single method is the best hit detection method for every HTS data set. However, to aid the selection of the most appropriate HTS data-processing and active identification methods, the authors developed a 3-step statistical decision methodology. Step 1 is to determine the most appropriate HTS data-processing method and establish criteria for quality control review and active identification from 3-day assay signal window and DMSO validation tests. Step 2 is to perform a multilevel statistical and graphical review of the screening data to exclude data that fall outside the quality control criteria. Step 3 is to apply the established active criterion to the quality-assured data to identify the active compounds.     

Sensitive and accurate quantification of human leukocyte migration using high-content Discovery-1 imaging system and ATPlite assay

Migration is a fundamental aspect of leukocyte behavior and represents a significant therapeutic target clinically. However, most migration assays used in research are relatively low throughput and not easily compatible with rapid analysis or high-throughput screening (HTS) protocols required for drug screening assays. We therefore investigated the quantification of the migration of human leukocytes using the Molecular Devices high-content Discovery-1 platform or PerkinElmer ATPlite assay compared to manual counting. We have conducted extensive assay validation, investigating the detection limits, sensitivity, and precision of each method to count human leukocytes. Leukocyte migration assays were conducted using 96-well HTS-Transwell plates and the potent chemokine stromal cell-derived factor-1 (SDF-1). We reveal that the Discovery-1 and ATPlite methods developed here provide useful approaches to quantify leukocyte migration in an HTS manner with high levels of detection, sensitivity, and precision.     

Colloidal aggregate detection by rapid fluorescence measurement of liquid surface curvature changes in multiwell plates

A simple fluorescence method is reported for the detection of colloidal aggregate formation in solution, with specific applications to determine the critical micelle concentration (CMC) of surfactants and detect small-molecule promiscuous inhibitors. The method exploits the meniscus curvature changes in high-density multiwell plates associated with colloidal changes in solution. The shape of the meniscus has a significant effect on fluorescence intensity when detected using a top-read fluorescence plate reader because of the effect of total internal reflection on fluorescence emission through a curved liquid surface. A dynamic range of 60% is calculated and observed and is measured with a relative sensitivity of 2%. Facile determination of the CMC of a variety of surfactants is demonstrated, as well as a screening assay for aggregate forming properties of small drug-like compounds, a common cause of promiscuous inhibition in high-throughput screening (HTS) enzyme inhibitor assays. Our preliminary results show a potential HTS assay with Z' factor of 0.76, with good separation between aggregating and nonaggregating small molecules. The method combines the high sensitivity and universality of classic surface tension methods with simplicity and high-throughput determination, enabling facile detection of molecular interactions involving a change in liquid or solid surface character.     

Use of mixture distributions to deconvolute the behavior of "hits" and controls in high-throughput screening data

The stochastic nature of high-throughput screening (HTS) data indicates that information may be gleaned by applying statistical methods to HTS data. A foundation of parametric statistics is the study and elucidation of population distributions, which can be modeled using modern spreadsheet software. The methods and results described here use fundamental concepts of statistical population distributions analyzed using a spreadsheet to provide tools in a developing armamentarium for extracting information from HTS data. Specific examples using two HTS kinase assays are analyzed. The analyses use normal and gamma distributions, which combine to form mixture distributions. HTS data were found to be described well using such mixture distributions, and deconvolution of the mixtures to the constituent gamma and normal parts provided insight into how the assays performed. In particular, the proportion of hits confirmed was predicted from the original HTS data and used to assess screening assay performance. The analyses also provide a method for determining how hit thresholds--values used to separate active from inactive compounds--affect the proportion of compounds verified as active and how the threshold can be chosen to optimize the selection process.     

Novel patient cell-based HTS assay for identification of small molecules for a lysosomal storage disease

Small molecules have been identified as potential therapeutic agents for lysosomal storage diseases (LSDs), inherited metabolic disorders caused by defects in proteins that result in lysosome dysfunctional. Some small molecules function assisting the folding of mutant misfolded lysosomal enzymes that are otherwise degraded in ER-associated degradation. The ultimate result is the enhancement of the residual enzymatic activity of the deficient enzyme. Most of the high throughput screening (HTS) assays developed to identify these molecules are single-target biochemical assays. Here we describe a cell-based assay using patient cell lines to identify small molecules that enhance the residual arylsulfatase A (ASA) activity found in patients with metachromatic leukodystrophy (MLD), a progressive neurodegenerative LSD. In order to generate sufficient cell lines for a large scale HTS, primary cultured fibroblasts from MLD patients were transformed using SV40 large T antigen. These SV40 transformed (SV40t) cells showed to conserve biochemical characteristics of the primary cells. Using a specific colorimetric substrate para-nitrocatechol sulfate (pNCS), detectable ASA residual activity were observed in primary and SV40t fibroblasts from a MLD patient (ASA-I179S) cultured in multi-well plates. A robust fluorescence ASA assay was developed in high-density 1,536-well plates using the traditional colorimetric pNCS substrate, whose product (pNC) acts as "plate fluorescence quencher" in white solid-bottom plates. The quantitative cell-based HTS assay for ASA generated strong statistical parameters when tested against a diverse small molecule collection. This cell-based assay approach can be used for several other LSDs and genetic disorders, especially those that rely on colorimetric substrates which traditionally present low sensitivity for assay-miniaturization. In addition, the quantitative cell-based HTS assay here developed using patient cells creates an opportunity to identify therapeutic small molecules in a disease-cellular environment where potentially disrupted pathways are exposed and available as targets.     

Statistical and graphical methods for quality control determination of high-throughput screening data

High-throughput screening (HTS) is used in modern drug discovery to screen hundreds of thousands to millions of compounds on selected protein targets. It is an industrial-scale process relying on sophisticated automation and state-of-the-art detection technologies. Quality control (QC) is an integral part of the process and is used to ensure good quality data and mini mize assay variability while maintaining assay sensitivity. The authors describe new QC methods and show numerous real examples from their biologist-friendly Stat Server HTS application, a custom-developed software tool built from the commercially available S-PLUS and Stat Server statistical analysis and server software. This system remotely processes HTS data using powerful and sophisticated statistical methodology but insulates users from the technical details by outputting results in a variety of readily interpretable graphs and tables. It allows users to visualize HTS data and examine assay performance during the HTS campaign to quickly react to or avoid quality problems.     

Evaluating real-life high-throughput screening data

High-throughput screening (HTS) is the result of a concerted effort of chemistry, biology, information technology, and engineering. Many factors beyond the biology of the assay influence the quality and outcome of the screening process, yet data analysis and quality control are often focused on the analysis of a limited set of control wells and the calculated values derived from these wells. Taking into account the large number of variables and the amount of data generated, multiple views of the screening data are necessary to guarantee quality and validity of HTS results. This article does not aim to give an exhaustive outlook on HTS data analysis but tries to illustrate the shortfalls of a reductionist approach focused on control wells and give examples for further analysis.     

HTS-Corrector: software for the statistical analysis and correction of experimental high-throughput screening data

MOTIVATION: High-throughput screening (HTS) plays a central role in modern drug discovery, allowing for testing of >100,000 compounds per screen. The aim of our work was to develop and implement methods for minimizing the impact of systematic error in the analysis of HTS data. To the best of our knowledge, two new data correction methods included in HTS-Corrector are not available in any existing commercial software or freeware. RESULTS: This paper describes HTS-Corrector, a software application for the analysis of HTS data, detection and visualization of systematic error, and corresponding correction of HTS signals. Three new methods for the statistical analysis and correction of raw HTS data are included in HTS-Corrector: background evaluation, well correction and hit-sigma distribution procedures intended to minimize the impact of systematic errors. We discuss the main features of HTS-Corrector and demonstrate the benefits of the algorithms.     

A colorimetric assay optimization for high-throughput screening of dihydroorotase by detecting ureido groups

Dihydroorotase (DHOase) is the third enzyme in the de novo pyrimidine biosynthesis pathway and is a potential new antibacterial drug target. No target-based high-throughput screening (HTS) assay for this enzyme has been reported to date. Here, we optimized two colorimetric-based enzymatic assays that detect the ureido moiety of the DHOase substrate, carbamyl-aspartate (Ca-asp). Each assay was developed in a 40-μl assay volume using 384-well plates with a different color mix, diacetylmonoxime (DAMO)–thiosemicarbazide (TSC) or DAMO–antipyrine. The sensitivity and color interference of both color mixes were compared in the presence of common HTS buffer additives, including dimethyl sulfoxide, reducing agents, detergents, and bovine serum albumin. DAMO–TSC (Z′-factors 0.7–0.8) was determined to be superior to DAMO–antipyrine (Z′-factors 0.5–0.6) with significantly less variability within replicates. An HTS pilot screening with 29,552 compounds from four structurally diverse libraries confirmed the quality of our newly optimized colorimetric assay with DAMO–TSC. This robust method has no heating requirement, which was the main obstacle to applying previous assays to HTS. More important, this well-optimized HTS assay for DHOase, the first of its kind, should make it possible to screen large-scale compound libraries to develop new inhibitors against any enzymes that produce ureido functional groups.     

Digital Imaging as a Detection Method for a Fluorescent Protease Assay in 96-Well and Miniaturized Assay Plate Formats

The demand to increase throughput in HTS programs, without a concomitant addition to costs, has grown significantly during the past few years. One approach to handle this demand is assay miniaturization, which can provide greater throughput, as well as significant cost savings through reduced reagent costs. Currently, one of the major challenges facing assay miniaturization is the ability to detect the assay signal accurately and rapidly in miniaturized formats. Digital imaging is a detection method that can measure fluorescent or luminescent signals in these miniaturized formats. In this study, an imaging system capable of detecting the signal from a fluorescent protease assay in multiple plate formats was used to evaluate this detection method in an HTS environment. A direct comparison was made between the results obtained from the imaging system and a fluorescent plate reader by screening 8,800 compounds in a 96-well plate format. The imaging system generated similar changes in relative signal for each well in the screen, identified the same active compounds, and yielded similar IC(50) values as compared to the plate reader. When a standard protease inhibitor was evaluated in 96-, 384-, 864-, and 1536-well plates using imaging detection, similar IC(50) values were obtained. Furthermore, similar dose-response curves were generated for the compound in 96- and 384-well assay plates read in a plate reader. These results provide support for digital imaging as an accurate and rapid detection method for high-density microtiter plates.     

Analysis of protein-peptide interaction by a miniaturized fluorescence polarization assay using cyclin-dependent kinase 2/cyclin E as a model system.

As a result of the increasing size of chemical libraries, more rapid and highly sensitive strategies are needed to accelerate the process of drug discovery without increasing the cost. One means of accomplishing this is to miniaturize the assays that enter high-throughput screening (HTS). Miniaturization requires an assay design that has few steps, has a large degree of separation between the signal and background, and has a low well to well signal variation. Fluorescence polarization (FP) is an assay type that, in many cases, meets all of the above requirements. FP is a homogenous method that allows interactions between molecules to be measured directly in solution. This article demonstrates the application of FP in a miniaturized HTS format, using 1536-well plates, to measure direct binding between cyclin-dependent kinase 2/cyclin E complex (CDK2/E) and an 8-mer-peptide kinase inhibitor. The data indicate that low variability and high specificity allow rapid and precise identification of antagonist compounds affecting CDK2/E-peptide interactions.     

Adaptation of aequorin functional assay to high throughput screening

AequoScreen, a cellular aequorin-based functional assay, has been optimized for luminescent high-throughput screening (HTS) of G protein-coupled receptor (GPCRs). AequoScreen is a homogeneous assay in which the cells are loaded with the apoaequorin cofactor coelenterazine, diluted in assay buffer, and injected into plates containing the samples to be tested. A flash of light is emitted following the calcium increase resulting from the activation of the GPCR by the sample. Here we have validated a new plate reader, the Hamamatsu Photonics FDSS6000, for HTS in 96- and 384-well plates with CHO-K1 cells stably coexpressing mitochondrial apoaequorin and different GPCRs (AequoScreen cell lines). The acquisition time, plate type, and cell number per well have been optimized to obtain concentration-response curves with 4000 cells/well in 384-well plates and a high signal:background ratio. The FDSS6000 and AequoScreen cell lines allow reading of twenty 96- or 384-well plates in 1 h with Z' values of 0.71 and 0.78, respectively. These results bring new insights to functional assays, and therefore reinforce the interest in aequorin-based assays in a HTS environment.     

Development and validation of a generic fluorescent methyltransferase activity assay based on the transcreener AMP/GMP assay

Methylation is a ubiquitous covalent modification used to control the function of diverse biomolecules including hormones, neurotransmitters, xenobiotics, proteins, nucleic acids, and lipids. Histone methyltransferases (HMTs) are currently of high interest as drug targets because of their role in epigenetic regulation; however, most HMT assay methods are either not amenable to a high-throughput screening (HTS) environment or are applicable to a limited number of enzymes. The authors developed a generic methyltransferase assay method using fluorescent immunodetection of adenosine monophosphate (AMP), which is formed from the MT reaction product S-adenosylhomocysteine in a dual-enzyme coupling step. The detection range of the assay; its suitability for HTS, including stability of reagents following dispensing and after addition to reactions; and the potential for interference from drug-like molecules was investigated. In addition, the use of the assay for measuring inhibitor potencies with peptide or intact protein substrates was examined through pilot screening with selected reference enzymes including HMT G9a. By combining a novel enzymatic coupling step with the well-characterized Transcreener AMP/GMP assay, the authors have developed a robust HTS assay for HMTs that should be broadly applicable to other types of methyltransferases as well.     

From molecular engineering to process engineering: development of high-throughput screening methods in enzyme directed evolution

With increasing concerns in sustainable development, biocatalysis has been recognized as a competitive alternative to traditional chemical routes in the past decades. As nature’s biocatalysts, enzymes are able to catalyze a broad range of chemical transformations, not only with mild reaction conditions but also with high activity and selectivity. However, the insufficient activity or enantioselectivity of natural enzymes toward non-natural substrates limits their industrial application, while directed evolution provides a potent solution to this problem, thanks to its independence on detailed knowledge about the relationship between sequence, structure, and mechanism/function of the enzymes. A proper high-throughput screening (HTS) method is the key to successful and efficient directed evolution. In recent years, huge varieties of HTS methods have been developed for rapid evaluation of mutant libraries, ranging from in vitro screening to in vivo selection, from indicator addition to multi-enzyme system construction, and from plate screening to computation- or machine-assisted screening. Recently, there is a tendency to integrate directed evolution with metabolic engineering in biosynthesis, using metabolites as HTS indicators, which implies that directed evolution has transformed from molecular engineering to process engineering. This paper aims to provide an overview of HTS methods categorized based on the reaction principles or types by summarizing related studies published in recent years including the work from our group, to discuss assay design strategies and typical examples of HTS methods, and to share our understanding on HTS method development for directed evolution of enzymes involved in specific catalytic reactions or metabolic pathways.

     

Assay concordance between SPA and TR-FRET in high-throughput screening

High-throughput screening (HTS) of large chemical libraries has become the main source of new lead compounds for drug development. Several specialized detection technologies have been developed to facilitate the cost- and time-efficient screening of millions of compounds. However, concerns have been raised, claiming that different HTS technologies may produce different hits, thus limiting trust in the reliability of HTS data. This study was aimed to investigate the reliability of the authors most frequently used assay techniques: scintillation proximity assay (SPA) and homogeneous time-resolved fluorescence resonance energy transfer (TR-FRET). To investigate the data concordance between these 2 detection technologies, the authors screened a large subset of the Schering compound library consisting of 300,000 compounds for inhibitors of a nonreceptor tyrosine kinase. They chose to set up this study in realistic HTS scale to ensure statistical significance of the results. The findings clearly demonstrate that the choice of detection technology has no significant impact on hit finding, provided that assays are biochemically equivalent. Data concordance is up to 90%. The little differences in hit findings are caused by threshold setting but not by systematic differences between the technologies. The most significant difference between the compared techniques is that in the SPA format, more false-positive primary hits were obtained.