Adopting a practical statistical approach for evaluating assay agreement in drug discovery

The authors assess the equivalence of 2 assays and put forward a general approach for assay agreement analysis that can be applied during drug discovery. Data sets generated by different assays are routinely compared to each other during the process of drug discovery. For a given target, the assays used for high-throughput screening and structure-activity relationship studies will most likely differ in their assay reagents, assay conditions, and/or detection technology, which makes the interpretation of data between assays difficult, particularly as most assays are used to measure quantitative changes in compound potency against the target. To better quantify the relationship of data sets from different assays for the same target, the authors evaluated the agreement between results generated by 2 different assays that measure the activity of compounds against the same protein, ALK5. The authors show that the agreement between data sets can be quantified using correlation and Bland-Altman plots, and the precision of the assays can be used to define the expectations of agreement between 2 assays. They propose a scheme for addressing issues of assay data equivalence, which can be applied to address questions of how data sets compare during the lead identification and lead optimization processes in which assays are frequently added and changed.     

Minimum significant ratio of selectivity ratios (MSRSR) and confidence in ratio of selectivity ratios (CRSR): quantitative measures for selectivity ratios obtained by screening assays

Development of inhibitor compounds selective against undesirable targets is critical in drug discovery. Selectivity ratios for candidate compounds are evaluated by dividing potencies from two assays assessing the off-target and target. Because all potency measurements have underlying uncertainty, understanding error propagation is essential to interpreting selectivity data. Assay noise introduces ambiguity in the statistical significance of selectivity ratios, particularly at low replicate numbers when compounds are often prioritized for subsequent testing. The ability to differentiate potency results for any pair of compounds in one assay is evaluated using a metric called minimum significant ratio (MSR). Potency results of one compound tested in a pair of assays can be differentiated by the minimum significant selectivity ratio (MSSR). To differentiate selectivity ratios for any pair of compounds, we extend this concept by proposing two new parameters called the minimum significant ratio of selectivity ratios (MSRSR) and confidence in ratio of selectivity ratios (CRSR). Importantly, these tools can be used after a single selectivity measurement. We describe these methods and illustrate their usefulness using structure-activity relationship data from a Janus kinase inhibitor project, in which these tools informed a cogent retesting strategy and enabled rapid and objective decision making.     

A universal and reliable assay for molecular sex identification of three‐spined sticklebacks (Gasterosteus aculeatus)

In heterogametic species, biological differences between the two sexes are ubiquitous, and hence, errors in sex identification can be a significant source of noise and bias in studies where sex‐related sources of variation are of interest or need to be controlled for. We developed and validated a universal multimarker assay for reliable sex identification of three‐spined sticklebacks (Gasterosteus aculeatus). The assay makes use of genotype scores from three sex‐linked loci and utilizes Bayesian probabilistic inference to identify sex of the genotyped individuals. The results, validated with 286 phenotypically sexed individuals from six populations of sticklebacks representing all major genetic lineages (cf. Pacific, Atlantic and Japan Sea), indicate that in contrast to commonly used single‐marker‐based sex identification assays, the developed multimarker assay should be 100% accurate. As the markers in the assay can be scored from agarose gels, it provides a quick and cost‐efficient tool for universal sex identification of three‐spined sticklebacks. The general principle of combining information from multiple markers to improve the reliability of sex identification is transferable and can be utilized to develop and validate similar assays for other species.     

Multiplexed G-protein-coupled receptor Ca2+ flux assays for high-throughput screening

An early drug discovery approach focusing on gene families can benefit from strategies that exploit common signaling mechanisms to more effectively identify and characterize novel chemical lead structures. Multiplexing, defined as the screening of multiple targets within the same experiment, is an example of this strategy. Here, the authors describe a technique that allows multiplexing of a common assay type used to study G-protein-coupled receptors: changes in intracellular Ca2+ levels as measured by Molecular Device's fluorometric imaging plate reader (FLIPR). The multiplexed FLIPR assays showed the expected pharmacological properties of single assays, with good reproducibility and Z* factors. The authors used them to screen large compound libraries in 2 multiplexed assay designs. The 1st used a single-cell line expressing 2 different receptors and the 2nd a mixture of 2 cell lines of the same type each expressing distinct receptors. Screening using these multiplexed assays produced significant savings in reagents, time, and human resources and allowed the authors to quickly identify specific and selective hits.     

Colorimetric Assays for Quantitative Analysis and Screening of Epoxide Hydrolase Activity

Focusing on directed evolution to tailor enzymes as usable biocatalysts for fine chemistry, we have studied in detail several colorimetric assays for quantitative analysis of epoxide hydrolase (EH) activity. In particular, two assays have been optimized to characterize variants issued from the directed evolution of the EH from Aspergillus niger. Assays described in this paper are sufficiently reliable for quantitative screening of EH activity in microtiter plates and are low cost alternatives to GC or MS analysis. Moreover, they are usable for various epoxides and not restricted to a type of substrate, such as those amenable to assay by UV absorbancy. They can be used to assay EH activity on any epoxide and to directly assay enantioselectivity when both (R) and (S) substrates are available. The advantages and drawbacks of these two methods to assay EH activity of a large number of natural samples are summarized.     

A novel cell-based, high-content assay for phosphorylation of Lats2 by Aurora A

Aurora A kinase is a key regulator of mitosis, which is upregulated in several human cancers, making it a potential target for anticancer therapeutics. Consequently, robust medium- to high-throughput cell-based assays to measure Aurora A kinase activity are critical for the development of small-molecule inhibitors. Here the authors compare measurement of the phosphorylation of two Aurora A substrates previously used in high-content screening Aurora A assays, Aurora A itself and TACC3, with a novel substrate Lats2. Using antibodies directed against phosphorylated forms of Aurora A (pThr288), P-TACC3 (pSer558), and P-Lats2 (pSer83), the authors investigate their suitability in parallel for development of a cell-based assay using several reference Aurora inhibitors: MLN8054, VX680, and AZD1152-HQPA. They validate a combined assay of target-specific phosphorylation of Lats2 at the centrosome and an increase in mitotic index as a measure of Aurora A activity. The assay is both sensitive and robust and has acceptable assay performance for high-throughput screening or potency estimation from concentration-response assays. It has the advantage that it can be carried out using a commercially available monoclonal antibody against phospho-Lats2 and the widely available Cellomics ArrayScan HCS reader and thus represents a significant addition to the tools available for the identification of Aurora A specific inhibitors.     

Transport by Populations of Fast and Slow Kinesins Uncovers Novel Family-Dependent Motor Characteristics Important for In?Vivo Function

Intracellular cargo transport frequently involves multiple motor types, either having opposite directionality or having the same directionality but different speeds. Although significant progress has been made in characterizing kinesin motors at the single-molecule level, predicting their ensemble behavior is challenging and requires tight coupling between experiments and modeling to uncover the underlying motor behavior. To understand how diverse kinesins attached to the same cargo coordinate their movement, we carried out microtubule gliding assays using pairwise mixtures of motors from the kinesin-1, -2, -3, -5, and -7 families engineered to have identical run lengths and surface attachments. Uniform motor densities were used and microtubule gliding speeds were measured for varying proportions of fast and slow motors. A coarse-grained computational model of gliding assays was developed and found to recapitulate the experiments. Simulations incorporated published force-dependent velocities and run lengths, along with mechanical interactions between motors bound to the same microtubule. The simulations show that the force-dependence of detachment is the key parameter that determines gliding speed in multimotor assays, while motor compliance, surface density, and stall force all play minimal roles. Simulations also provide estimates for force-dependent dissociation rates, suggesting that kinesin-1 and the mitotic motors kinesin-5 and -7 maintain microtubule association against loads, whereas kinesin-2 and -3 readily detach. This work uncovers unexpected motor behavior in multimotor ensembles and clarifies functional differences between kinesins that carry out distinct mechanical tasks in cells.     

Correlation of XMAP and ELISA cytokine profiles; development and validation for immunotoxicological studies in vitro

There is an emerging trend in immunotoxicological studies to use the multiplex technologies for testing the safety and the efficacy of new pharmaceuticals by using cytokines profiling as biomarker. The Luminex 200 xMAP (multi-analyte profiling) technology provides simultaneous measurement of multiple cytokines in small sample volumes, expressing rapidly the differences between various test compounds. The aim is to develop and validate the Luminex 200 multiplex immunoassays by correlation with ELISA (enzyme-linked immunosorbent assays) for implementation in evaluating cytokine profiling in immunotoxicological studies in vitro. METHODS: Human peripheral whole blood from healthy subject diluted 1+4 with RPMI 1640 was cultured 48 hours in 28 experimental variants: control, in presence of mitogens, bioflavonoid extracts (from Crataegus monogyna and Echinacea purpurea) as cytoprotectors and with a toxic compound [Pb(NO3)2]), separately or variously combined. IL-1beta and IL-2 were comparatively performed by xMAP and ELISA immunoassays from the same sample to initialize validation of multiplex cytokine panel: IL-1beta, IL-2, IL-4, IL-6, IL-8, IL-10, TNF-alpha, IFN-gamma, usually performed by Luminex 200 system in our immunotoxicological studies. The results indicate similarly typed trends of cytokine values obtained by both methods, with comparable relative changes in presence of mitogens, bioflavonoids and toxic, respectively. Although xMAP absolute cytokine values were higher than ELISA values, the correlation between multiplexed assay and ELISA was good for IL-1beta and IL-2 with positive correlation coefficients near to 1. Conclusions. Quantitative differences between absolute values for IL-1beta and IL-2 obtained by xMAP and ELISA assays are found, but the relative values are comparable and the two methods keep similar trends in similar exposure conditions. The performance parameters of the xMAP assay and the good correlation coefficients with the "gold standard" ELISA recommend to validate the multiplex assay for analyzing cytokine profiles in immunotoxicological studies in vitro.     

Comparison of methods for measuring oxygen consumption in tumor cells in vitro

The oxygen consumption rate of tumor cells affects tumor oxygenation and response to therapies. Highly sensitive methods for determining cellular oxygen consumption are, therefore, needed to identify treatments that can modulate this parameter. We compared the performances of three different methods for measuring cellular oxygen consumption: electron paramagnetic resonance (EPR) oximetry, the Clark electrode, and the MitoXpress fluorescent assay. To compare the assays, we used K562 cells in the presence of rotenone and hydrocortisone, compounds that are known to inhibit the mitochondrial electron transport chain to different extents. The EPR method was the only one that could identify both rotenone and hydrocortisone as inhibitors of tumor cell oxygen consumption. The Clark electrode and the fluorescence assay demonstrated a significant decrease in cellular oxygen consumption after administration of the most potent inhibitor (rotenone) but failed to show any significant effect of hydrocortisone. EPR oximetry is, therefore, the most sensitive method for identifying inhibitors of oxygen consumption on cell assays, whereas the Clark electrode offers the unique opportunity to add external compounds during experiments and still shows great sensitivity in studying enzyme and chemical reactions that consume oxygen (non-cell assays). Finally, the MitoXpress fluorescent assay has the advantage of a high-sample throughput and low bulk requirements but at the cost of a lower sensitivity.     

Src homology-2 domain binding assays by scintillation proximity and surface plasmon resonance

Various SH2 competitive binding assays, based on different techniques, have been described in the literature to identify and characterize SH2 ligands. The consideration that most reported methods show experimental limitations associated with assay parameters has prompted us to base our Src-SH2 inhibitor discovery program on the use of two different assays. In this study, two conceptually different biochemical methods designed to discover Src-SH2 inhibitors, respectively scintillation proximity assay (SPA) and surface plasmon resonance (SPR), have been evaluated and compared. For its high sensitivity and adaptability to automation SPA was chosen for high capacity screening (primary screen), whereas SPR was used for hits confirmation (secondary screening). However with the drastic improvement of inhibitor affinities, the limit of sensitivity was rapidly reached for the SPR assay based on the canonical pYEEI ligand. The substitution of the natural, monophosphorylated peptide ligand with a triphosphorylated peptide has allowed us to remarkably increase its sensitivity, so that molecules with nanomolar affinities could be easily differentiated in terms of IC(50) ranking. Such a new, improved SPR assay can be of great interest for the study of high affinity ligands of different SH2-based drug targets.     

Transport by Populations of Fast and Slow Kinesins Uncovers Novel Family-Dependent Motor Characteristics Important for In Vivo Function

Intracellular cargo transport frequently involves multiple motor types, either having opposite directionality or having the same directionality but different speeds. Although significant progress has been made in characterizing kinesin motors at the single-molecule level, predicting their ensemble behavior is challenging and requires tight coupling between experiments and modeling to uncover the underlying motor behavior. To understand how diverse kinesins attached to the same cargo coordinate their movement, we carried out microtubule gliding assays using pairwise mixtures of motors from the kinesin-1, -2, -3, -5, and -7 families engineered to have identical run lengths and surface attachments. Uniform motor densities were used and microtubule gliding speeds were measured for varying proportions of fast and slow motors. A coarse-grained computational model of gliding assays was developed and found to recapitulate the experiments. Simulations incorporated published force-dependent velocities and run lengths, along with mechanical interactions between motors bound to the same microtubule. The simulations show that the force-dependence of detachment is the key parameter that determines gliding speed in multimotor assays, while motor compliance, surface density, and stall force all play minimal roles. Simulations also provide estimates for force-dependent dissociation rates, suggesting that kinesin-1 and the mitotic motors kinesin-5 and -7 maintain microtubule association against loads, whereas kinesin-2 and -3 readily detach. This work uncovers unexpected motor behavior in multimotor ensembles and clarifies functional differences between kinesins that carry out distinct mechanical tasks in cells.     

RNA interference screening in Drosophila primary cells for genes involved in muscle assembly and maintenance

To facilitate the genetic analysis of muscle assembly and maintenance, we have developed a method for efficient RNA interference (RNAi) in Drosophila primary cells using double-stranded RNAs (dsRNAs). First, using molecular markers, we confirm and extend the observation that myogenesis in primary cultures derived from Drosophila embryonic cells follows the same developmental course as that seen in vivo. Second, we apply this approach to analyze 28 Drosophila homologs of human muscle disease genes and find that 19 of them, when disrupted, lead to abnormal muscle phenotypes in primary culture. Third, from an RNAi screen of 1140 genes chosen at random, we identify 49 involved in late muscle differentiation. We validate our approach with the in vivo analyses of three genes. We find that Fermitin 1 and Fermitin 2, which are involved in integrin-containing adhesion structures, act in a partially redundant manner to maintain muscle integrity. In addition, we characterize CG2165, which encodes a plasma membrane Ca2+-ATPase, and show that it plays an important role in maintaining muscle integrity. Finally, we discuss how Drosophila primary cells can be manipulated to develop cell-based assays to model human diseases for RNAi and small-molecule screens.     

Development and validation of qualitative SYBR®Green Real-Time PCR for detection and discrimination of Listeria spp. and Listeria monocytogenes

A combination of four qualitative SYBR®Green qPCR screening assays targeting two levels of discrimination: Listeria genus (except Listeria grayi) and Listeria monocytogenes, is presented. These assays have been developed to be run simultaneously using the same polymerase chain reaction (PCR) programme. The paper also proposes a new validation procedure to specifically validate qPCR assays applied to food microbiology according to two guidelines: the ISO 22118 norm and the “Definition of minimum performance requirements for analytical methods of GMO testing”. The developed assays target the iap, prs and hlyA genes that belong to or neighbour the virulence cluster of Listeria spp. The selected primers were designed to amplify short fragments (60 to 103 bp) in order to obtain optimal PCR efficiency (between 97 and 107 % efficiency). The limit of detection of the SYBR®Green qPCR assays is two to five copies of target genes per qPCR reaction. These assays are highly accurate (98.08 and 100 % accuracy for the Listeria spp. and L. monocytogenes assays, respectively).     

No simple answers for ecological immunology: relationships among immune indices at the individual level break down at the species level in waterfowl

Understanding immune function in the context of other life-history traits is crucial to understand the evolution of life histories, at both the individual and species levels. As the interest in assessing immune function for these comparative purposes grows, an important question remains unanswered: can immune function be broadly characterized using one or two simple measures? Often, interpretation of individual assays is ambiguous and relationships among different measures of immune function remain poorly understood. Thus, we employed five protocols to measure 13 variables of immune function in ten species of waterfowl (Anseriformes). All assays were based on a single blood sample subdivided into leukocyte (blood smear) and plasma (frozen until analysis) components. All assays were run using samples from every individual, and a nested analysis was used to partition variation/covariation at the levels of species and individuals within species. We detected positive correlations between functionally related measures of immunity within species, but these were absent from comparisons between species. A canonical correlation analysis revealed no significant relationships between the plasma and leukocyte assays at the levels of both individual and species, suggesting that these measures of immunity are neither competitive nor synergistic. We conclude that one measure of each assay type may be required to maximally characterize immune function in studies of a single species, while the same is not true in studies among species.     

Assessment of antioxidant activity by using different in vitro methods

In this study, six common tests for measuring antioxidant activity were evaluated by comparing four antioxidants and applying them to beverages (tea and juices): Trolox equivalent antioxidant capacity assay (TEAC I-III assay), Total radical-trapping antioxidant parameter assay (TRAP assay), 2,2-diphenyl- l -picrylhydrazyl assay (DPPH assay), N , N -dimethyl- p -phenylendiamine assay (DMPD assay), Photochemiluminescence assay (PCL assay) and Ferric reducing ability of plasma assay (FRAP assay). The antioxidants included gallic acid representing the group of polyphenols, uric acid as the main antioxidant in human plasma, ascorbic acid as a vitamin widely spread in fruits and Trolox ® as water soluble vitamin E analogue. The six methods presented can be divided into two groups depending on the oxidising reagent. Five methods use organic radical producers (TEAC I-III, TRAP, DPPH, DMPD, PCL) and one method works with metal ions for oxidation (FRAP). Another difference between these tests is the reaction procedure. Three assays use the delay in oxidation and determine the lag phase as parameter for the antioxidant activity (TEAC I, TRAP, PCL). They determine the delay of radical generation as well as the ability to scavenge the radical. In contrast, the assays TEAC II and III, DPPH, DMPD and FRAP analyse the ability to reduce the radical cation (TEAC II and III, DPPH, DMPD) or the ferric ion (FRAP). The three tests acting by radical reduction use preformed radicals and determine the decrease in absorbance while the FRAP assay measures the formed ferrous ions by increased absorbance. Gallic acid was the strongest antioxidant in all tests with exception of the DMPD assay. In contrast, uric acid and ascorbic acid showed low activity in some assays. Most of the assays determine the antioxidant activity in the micromolar range needing minutes to hours. Only one assay (PCL) is able to analyse the antioxidant activity in the nanomolar range. Black currant juice showed highest antioxidant activity in all tests compared to tea, apple juice and tomato juice. Despite these differences, results of these in vitro assays give an idea of the protective efficacy of secondary plant products. It is strongly recommended to use at least two methods due to the differences between the test systems investigated.     

Immunological studies on pancreatic phospholipase A2. Antigenic characterization of the NH2-terminal region.

Rabbit antisera elicited against pure pig, horse, ox, and sheep pancreatic phospholipase A2 revealed considerable immunological differences when tested by double immunodiffusion and microcomplement fixation assays. Snake venom phospholipases did not show any detectable cross-reactions with the pancreatic enzymes. Microcomplement fixation also clearly demonstrated conformational differences between porcine phospholipase A2 and its zymogen. NH2 terminally modified analogs of porcine phospholipase A2 could be clearly distinguished using the same assay. Moreover, strong evidence was obtained that Ala1-Arg6 is a part of an antigenic determinant. Radioimmune assay, using monovalent phospholipase-specific Fab fragments revealed a maximum number of three antigenic sites of phospholipase that can simultaneously be occupied by antibody. The Fab fragments were separated into three fractions, using three immunoadsorbent columns in series. These Fab fractions showed different inhibitory properties toward micellar binding of phospholipase A2. They also exhibited different protective effects against active center modification.     

Development of ELISAs for quantification of HMFG1-specific human anti-mouse IgG and IgM antibodies

The aim of this study was to develop and validate ELISAs for quantification of HAMA-IgM and HAMA-IgG in serum of patients with ovarian cancer who enrolled in a large international randomized phase III trial of intraperitoneal Yttrium-90-labeled HMFG1 murine monoclonal antibody therapy. The capture antibody of these 2 assays was the murine antibody HMFG1, while mouse anti-human IgM-HRP or mouse anti-human IgG(Fc)-HRP served as tracer antibodies. A pool of HAMA-positive serum samples was used to prepare a series of assay standards and another pool served as reference preparation. The analytical sensitivity of the HAMA-IgM assay was 2.5 arbitrary units per mL (AU/mL) and 4.7 AU/mL for the HAMA-IgG ELISA. Diluted serum samples showed good parallelism with the HAMA-IgM and HAMA-IgG standard dose-response curves. Within-assay coefficient of variation was 7.5% for HAMA-IgM and 6.5% for HAMA-IgG. Between-assay variation was 14.2% for HAMA-IgM and 15.3% for HAMA-IgG. The developed HAMA-IgM and HAMA-IgG ELISAs show satisfactory reliability criteria (sensitivity, parallelism and precision) and are suitable for monitoring of HAMA-IgM and HAMA-IgG responses in ovarian cancer patients. These ELISAs will be used to monitor the development of HAMAs in patients who received radioimmunotherapy with murine HMFG1.     

A simple haemolytic method for quantitation of the delta endotoxin of Bacillus thuringiensis subsp. israelensis from crude samples

A simple haemolytic assay method for quantitative estimation of the delta endotoxin of Bacillus thuringiensis subsp. israelensis from a crude preparation has been developed. The method has several advantages over mosquito-larvicidal methods of assay as it is inexpensive, highly sensitive and easier to run and can be used for performing a reasonably large number of assays rapidly with high precision and with a coefficient of variation that does not exceed 1.96%.