Selected biostatistical aspects of the validation of in vitro toxicological assays

An overview is presented on selected biostatistical aspects of the validation of in vitro toxicological assays. Primarily, the statistical analysis of single assays is discussed. Several approaches are compared for the possible non-monotonic dose-response relationship with a priori unknown shapes. The use of confidence intervals instead of p values for toxicologically appropriate decision making is explained. New methods are discussed for demonstrating interlaboratory similarity for dose-response designs are discussed. For validation, the inappropriateness of the concordance coefficient is shown, and sensitive and specificity as well as predictive values are proposed as alternatives. The problem of the missing gold standard is highlighted.     

Structure-activity relationships for unsaturated dialdehydes. 6. The mutagenic activity of 11 compounds in the V79/HGPRT assay.

The mutagenic activity of 11 sesquiterpenoid unsaturated dialdehydes in the V79/HGPRT assay has been determined, and is compared with previously published data on the mutagenicity of the same compounds towards Ames Salmonella strains. One compound, isovelleral, is a potent mutagen in both assays, while six compounds, which are positive in the Ames Salmonella/microsome assay, show no significant activity in this study. One compound, acetylmerulidial, is negative in the Ames Salmonella/microsome assay but significantly although weakly mutagenic in the V79/HGPRT assay. The remaining three compounds are inactive in both assays. The study is part of a general investigation of quantitative structure-activity relationships for unsaturated dialdehydes, a class of natural occurring compounds known for their potent and numerous biological activities.     

Development and validation of the spiral Salmonella assay: an automated approach to bacterial mutagenicity testing

Since its development by Dr. Bruce Ames and his colleagues more than a decade ago, the Salmonella/mammalian microsome mutagenicity assay has become a widely accepted tool to assist in the identification of chemicals with mutagenic and carcinogenic potential. Several automated approaches to Salmonella testing have been proposed in recent years but have failed to gain acceptance in the scientific community due to poor performance or lack of demonstrated usefulness. In this paper we report on an automated system that successfully generates dose-response data and, moreover, reduces the labor, materials, and sample mass required to obtain such information. In the standard plate-incorporation assay, dose-response relationships are defined by testing discrete doses of the test agent on a series of agar plates. In contrast, the spiral Salmonella assay generates dose-response data from a continuous concentration gradient on a single agar plate. Upon analysis, each spiral plate yields a dose-response curve consisting of 13 data points that span a concentration range of about 15:1, which is equivalent to 5 two-fold serial dilutions. The performance of the spiral Salmonella assay was compared to that of the conventional plate-incorporation assay using 13 mutagens and 7 nonmutagens selected from a variety of chemical classes. Concordant qualitative responses were obtained for all compounds tested, and comparable dose-response relationships were generated by all mutagens with the exception of sodium azide and cyclophosphamide, which are highly water-soluble and, thus, are unable to maintain a well-defined concentration gradient on a spiral plate due to rapid diffusion. In general, toxicity was expressed at a lower dose in the spiral assay, and the mutagenic potencies (slopes of the dose-response curves) were greater in the spiral assay relative to the plate-incorporation assay. These differences will be discussed, as will the applicability of the spiral plating technique to routine screening and its relevancy to future mutagenesis testing.     

Improving Risk Assessment: Research Opportunities in Dose Response Modeling to Improve Risk Assessment

Substantial improvements in dose response modeling for risk assessment may result from recent and continuing advances in biological research, biochemical techniques, biostatistical/mathematical methods and computational power. This report provides a ranked set of recommendations for proposed research to advance the state of the art in dose response modeling. The report is the result of a meeting of invited workgroup participants charged with identifying five areas of research in dose response modeling that could be incorporated in a national agenda to improve risk assessment methods. Leading topics of emphasis are interindividual variability, injury risk assessment modeling, and procedures to incorporate distributional methods and mechanistic considerations into now-standard methods of deriving a reference dose (RfD), reference concentration (RfC), minimum risk level (MRL) or similar dose-response parameter estimates.     

Human urine mutagenicity study comparing cigarettes which burn or only heat tobacco

Cigarette smokers have been reported to void urine which is more mutagenic, as measured in the Ames bacterial mutation assay, than urine voided by non-smokers. Condensate from the mainstream smoke of a cigarette which heats, but does not burn tobacco (test cigarette) showed no evidence of mutagenicity in a battery of in vitro genotoxicity assays under conditions in which condensate from the mainstream smoke of cigarettes that burn tobacco was mutagenic. The objective of this study was to determine whether the absence of mutagenic activity observed in the in vitro assays would be reflected in the urine of smokers of the test cigarette. 72 subjects (31 smokers and 41 non-smokers) were enrolled in a 6-week study, with the smokers randomly divided into 2 groups. The study was designed as a double crossover, with each smoker smoking both test (tobacco-heating) and reference (tobacco-burning) cigarettes. This design allowed each smoker to serve as his or her own control while at the same time allowing comparisons between groups of non-smokers and smokers of both test and reference cigarettes. 24-h urine samples were collected twice a week and concentrated using XAD-2 resin. Urine concentrates were tested in Ames bacterial strains TA98 and TA100, with and without metabolic activation and with and without beta-glucuronidase/aryl sulfatase. Individuals who smoked the test cigarette voided urine which was significantly less mutagenic than that voided when they smoked reference cigarettes. The mutagenicity of urine from smokers who smoked the test cigarette and non-smokers did not differ under any of the assay conditions used in this study.     

Comprehensive Realism's Weight-of-Evidence Based Distributional Dose-Response Characterization

Challenges to low-dose linearity and other default assumptions in cancer risk assessment and the limitations associated with NOAELs, LOAELs, and constant uncertainty factor values in the evaluation of noncancer health effects have stimulated the continued evolution of risk assessment methodologies. The increasing need for more realistic estimates of the dose-response relationship, better uncertainty characterization, and greater utilization of cost-benefit analyses have also contributed to this evolution. “Comprehensive Realism” is an emerging quantitative weight-of-evidence based risk assessment methodology for both cancer and noncancer health effects which utilizes probability distributions and decision analysis techniques to reflect more of the relevant human exposure data, more of the available and pertinent human and animal dose-response data, and the current state of knowledge about the relative plausibility of alternative dose-response analyses. A tree (like a decision tree and a probability tree) is used to decompose the dose-response assessment into component factors, to provide a structure for explicitly considering multiple alternatives for each factor, and to explicitly incorporate the current state of knowledge about the relative plausibility of these alternatives. Groundbreaking work has demonstrated the feasibility of weight-of-evidence based distributional characterizations, and provided initial examples. Computer software implementations are also available.     

A modified Vibrio harveyi mutagenicity assay based on bioluminescence induction

AIMS: Mutagenic pollution of natural environment is currently one of the most serious ecological problems. Therefore, rapid detection of the presence of mutagens is a very important issue. Although many mutagenicity assays have already been described, only a few are suitable for testing samples from natural environment. One of such assays is a microbiological mutagenicity test based on genetically modified Vibrio harveyi strains. The aim of this work was to modify and improve the V. harveyi assay. METHODS AND RESULTS: A series of V. harveyi dark and dim mutants were tested for reversion of their phenotype towards efficient light emission in response to incubation with known mutagens. Luminescence of the A16 strain (luxE mutant) increased significantly after a few hours of such a treatment with various mutagenic agents, revealing a dose-response correlation. Sensitivity of the assay has been determined for different mutagens. CONCLUSIONS: The luminescence-based V. harveyi mutagenicity assay is rapid, sensitive and reveals a dose-response correlation for various mutagens. SIGNIFICANCE AND IMPACT OF THE STUDY: The assay developed in this study is a potentially useful tool in studies on mutagenic pollution of environment, especially marine water.     

Mutagenicity screening of crude drugs with Bacillus subtilis rec-assay and Salmonella/microsome reversion assay

This paper describes the screening studies of 104 commercial crude drugs for mutagenicity by the rec-assay with Bacillus subtilis as well as the reversion assay with Ames strains TA98 and TA100 of Salmonella typhimurium. The rec-assays showed that 13 water extracts and 27 methanol extracts of the crude drugs were positive. The Ames assays with or without metabolic activation showed that 24 water extracts and 16 methanol extracts were mutagenic. In total, mutagenic activities were found in 45 samples among the 104 crude drugs tested.     

Mutagenicity testing of imidazole and related compounds.

Ames tests have been performed with imidazole and its principal metabolites, hydantoin and hydantoic acid. N-Acetyl-imidazole, a potential metabolite resulting from the action of intestinal bacteria, and histamine, a structurally related compound which is widely distributed in mammalian tissues, have also been tested. Imidazole and histamine were also tested in the UDS assay in primary rat hepatocytes, while imidazole alone was tested in the M2-C3H mouse fibroblast malignant transformation assay. Imidazole gave consistently negative results in the Ames test, the UDS assay and the transformation assay. The three metabolites of imidazole, namely hydantoin, hydantoic acid and N-acetyl-imidazole, all gave negative results in the Ames test. Histamine gave no evidence of mutagenic activity in the Ames test or of genotoxicity in the UDS assay. These results indicate that imidazole and its metabolites are unlikely to present a mutagenic or carcinogenic hazard.     

The bacterial tryptophan reverse mutation assay with Escherichia coli WP2

The Escherichia coli WP2 tryptophan reverse mutation assay detects trp(-) to trp(+) reversion at a site blocking a step in the biosynthesis of tryptophan prior to the formation of anthranilic acid. The different WP2 strains all carry the same AT base pair at the critical mutation site within the trpE gene. The assay is currently used by many laboratories in conjunction with the Ames Salmonella assay for screening chemicals for mutagenic activity. In general the WP2 strains are used as a substitute for, or as an addition to Salmonella strain TA102 which also carries an AT base pair at the mutation site. The assay is also recommended together with the Ames assay for data submission to regulatory agencies. National and international guidelines have been established for performing these mutagenicity assays.The E. coli WP2 assay procedures are the same as those described elsewhere in this volume for the Ames Salmonella assay (Mortelmans and Zeiger, 2000) with the exception that limited tryptophan instead of limited histidine is used. This chapter is an addendum to the previous chapter and the reader should refer to the previous chapter for details regarding experimental procedures and assay design.     

A solution to the problems of cytolysis assays with additional applications to other immunological and biochemical assays

After cellular immunoassays are compared with classical bioassays, conventional methods and consequent problems of data analysis for cytolysis assays are reviewed and a new solution is proposed. This solution incorporates new methods, called dose-response surface assays and analysis (DRSA), which estimate cytolytic activity coefficients on a surface in a three-dimensional space with two dose variables (killers and targets) and one response variable (counts). These new methods based on dose-response surfaces are demonstrated to be more informative and reliable than classical methods based on dose-response curves. In a test of the methods' robustness (sensitivity of parameter estimates to changes in the dose levels of the assay design), cytolytic activity coefficients estimated by DRSA varied by less than or equal to 30% over a reduction of three to four orders of magnitude in the dose levels. This remarkable robustness should be compared with the corresponding figures of as much as 500% over less than 1 order of magnitude for previously published results of coefficients estimated by conventional methods. DRSA is distinguished from replot-of-plots methods such as those used for enzyme inhibition assays in biochemistry, and is recommended as a more efficient method that should replace replot-of-plot methods now antiquated by the advent of microcomputers. DRSA can be applied to any experimental system that requires an activity coefficient to be estimated on a dose-response surface in a space of greater than or equal to 3 dimensions (greater than or equal to 2 dose variables and one response variable), regardless of the mathematical model and statistical estimators used to analyze the dose-response interaction. Finally, DRSA is compared with the methods known as response surface methodology (RSM), and is described as a new class of methods to be added to those that constitute RSM.     

Assessing the cytotoxic and mutagenic effects of secondary metabolites produced by several fungal biological control agents with the Ames assay and the VITOTOX(®) test

The potential genotoxic effects of several pure secondary metabolites produced by fungi used as biological control agents (BCAs) were studied with the Ames Salmonella/microsome mutagenicity assay and the Vitotox test, with and without metabolic activation. A complete set of Salmonella tester strains was used to avoid false negative results. To detect possible mutagenic and/or cytotoxic effects of fungal secondary metabolites due to synergistic action, crude extracts and fungal cell extracts of the BCAs were also examined. Although the sensitivity of the methods varied depending on the metabolite used, clearly no genotoxicity was observed in all cases. The results of the two assays are discussed in the light of being used in a complementary fashion for a convincing risk-assessment evaluation of fungal BCAs and their secondary metabolites.     

The Salmonella mutagenicity of industrial, surface and ground water samples of Aligarh region of India

The genotoxicity of three water bodies, viz. industrial waste water of Aligarh city, ground water pumped out from the industrial area of Aligarh, and river water of Yamuna, downstream of Agra, was carried out by means of Ames plate incorporation test and the Ames fluctuation test. All the test samples were significantly mutagenic in both the testing systems. The ground water and river water samples were subjected to XAD concentration prior to the mutagenicity/genotoxicity testing, while the industrial waste water was used directly. Whereas TA98, TA102 and TA104 strains have been found to be maximally sensitive in the Ames plate incorporation assay conducted for various water samples, TA98 and TA100 strains were the most responsive strains in the Ames fluctuation test. The apparent disparity in the sensitivity patterns of various Ames strains by plate incorporation and fluctuation assays could be attributed to a large extent to the different conventional ways of interpretation of the data in these systems.     

Genetic toxicology: can we design predictive in vivo assays?

The present analysis examines the assumptions in, the perceptions and predictivity of and the need for short-term tests (STTs) for genotoxicity in light of recent findings that most noncarcinogens from the National Toxicology Program are genotoxic (i.e., positive in one or more in vitro STTs). Reasonable assumptions about the prevalence for carcinogens (1-10% of all chemicals), the sensitivity of these STTs (ca. 90% of all carcinogens are genotoxic) and their estimated "false positive" incidence (60-75%) imply that the majority of chemicals elicit genotoxic responses and, consequently, that most in vitro genotoxins are likely to be noncarcinogenic. Thus, either the usual treatment conditions used in these in vitro STTS are producing a large proportion of artifactual and meaningless positive results or else in vitro mutagenicity is too common a property of chemicals to serve as a useful predictor of carcinogenicity or other human risk. In contrast, the limited data base on in vivo STTs suggests that the current versions of these assays may have low sensitivity which appears unlikely to improve without dropping either their 'short-term' aspect or the rodent carcinogenicity benchmark. It is suggested that in vivo genotoxicity protocols be modified to take into consideration both the fundamentals of toxicology as well as the lessons learned from in vitro genetic toxicology. In the meantime, while in vivo assays are undergoing rigorous validation, genetic toxicology, as currently practiced, should not be a formal aspect of chemical or drug development on the grounds that it is incapable of providing realistic and reliable information on human risk. It is urged that data generated in new, unvalidated in vivo genotoxicity assays be exempted from the normal regulatory reporting requirements in order to encourage industry to participate in the laborious and expensive development of this next phase of genetic toxicology.     

Genotoxic evaluation of the organophosphorous pesticide temephos

The chemical compound temephos (0,0,0',0'-tetrametyl-0,0'-thiodi-p-phenylene phosphorothioate) is an organophosphorous pesticide that has been used in Brazil since 1967 in control campaigns against the mosquito Aedes aegypti, the vector of dengue and yellow fever. We used single cell gel electrophoresis (SCGE), SOS/umu and Ames/Salmonella assays to test the toxicity and mutagenicity of temephos. Temephos was genotoxic in the SCGE assay, inducing severe DNA lesions (type IV lesions) at doses above 1.34 micro M. It was mutagenic, but not toxic, in the SOS/umu assay to Escherichia coli strain PQ37, but not to PQ35, at concentrations above 1.33 micro M, particularly when the S9 mixture was not used in the assay. Temephos was not mutagenic in the Ames assay with S. typhimurium strains TA97, TA98, TA100 and TA102, both with and without metabolic activation. However, temephos at concentrations above 3.33 micro M was mutagenic to TA98NR, YG7104 and YG7108, both with and without metabolic activation. In conclusion, temephos was genotoxic and mutagenic in all the three tests used, and in two of them at concentrations similar to those routinely used to combat Aedes aegypti.     

Mutagenicity of N-nitrosopyrrolidine derivatives in Salmonella (Ames) and Escherichia coli K-12 (343/113) assays

The mutagenicity of nitrosopyrrolidine (NPYR) and its derivatives was determined by use of the Ames Salmonella assay. A clear specificity to revert the missense stain of TA1535 and a requirement for the phenobarbital-induced rat-liver activation system (S9 mix) were noted. 3,4-Dichloronitrosopyrrolidine was more mutagenic than NPYR, whereas 3-hydroxynitrosopyrrolidine was weakly mutagenic. The carcinogenic nitroso-3-pyrrolidine was not mutagenic under the test conditions. The noncarcinogenic derivatives (2,5-dimethylnitrosopyrrolidine, nitrosoproline and 4-hydroxynitrosoproline) were not mutagenic. Liquid preincubation assays were not any more effective than the pour-plate assays. Selected derivatives of NPYR were tested in the Escherichia coli K-12 (343/113) assay A specificity to revert the missense mutation at the arg locus and a dependence on phenobarbital-induced rat-liver S9 mix were noted with NPYR and its derivatives. 3,4-Dibromonitrosopyrrolidine, which was not mutagenic in Salmonella, was effective in E. coli, and the weakly carcinogenic NPRL was a weak mutagen resulting in a 2-fold enhancement in the E. coli arginine reversion assay.     

Mutagenicity of benzyl chloride in the Salmonella/microsome mutagenesis assay depends on exposure conditions

Benzyl chloride (BCl) is a clear yellowish, volatile liquid that is widely used as an intermediate for the production of benzyl alcohol and benzyl compounds used in perfumery, dyes and pharmaceuticals. In previous studies BCl has shown weak and inconsistent mutagenicity in the Salmonella/microsome mutagenesis assay (Ames test). The aim of the present study was to investigate the potential mutagenic activity of BCl using modifications of the standard Ames test in order to adapt the method to the volatile nature of the test compound. Tests were performed using (a) the standard plate-incorporation method, (b) incubation of the treated plates in closed containers, (c) a vaporization-diffusion method to expose Ames test plates to volatilised BCl and (d) the pre-incubation method. Using the standard plate-incorporation method, BCl showed no (in the absence of metabolic activation) or very weak (in the presence of metabolic activation) mutagenic activity in Salmonella typhimurium tester strain TA 100. The use of the pre-incubation method did not improve detection of mutagenic activity of BCl. The use of closed containers significantly increased the response, but the most marked response was obtained by testing BCl in volatilised form in the vaporization-diffusion method. Using the latter approach there appeared to be less toxicity of the BCl treatments to the tester bacteria. Our findings suggest that BCl may show greater mutagenic activity in the gaseous phase. This work underlines the importance of using appropriate methods for the evaluation of volatile compounds. The modifications described here are easy to realize in practice and should prove useful for the investigation of other volatile materials or atmospheric contaminants.     

Utility of short-term tests for genetic toxicity

By definition, short-term tests (STTs) for genetic toxicity detect genotoxic agents, not carcinogens specifically. However, there is sufficient evidence, based on mechanistic considerations alone, to say that genotoxic agents are potential carcinogens. STTs have high statistical power, are almost always replicated, can be performed rather easily under various sets of experimental conditions, are relatively inexpensive, and detect a variety of endpoints relevant to carcinogenesis. In addition, several STTs have shown considerable utility in evaluating the genotoxic effects of real-world, environmental complex mixtures as well as the antimutagenic effects of various pure compounds and complex mixtures. STTs are likely to continue to be refined, resulting in STTs that are increasingly more relevant to human mutation and disease. Their utility should not be judged solely against the questionable standard of a rodent carcinogenicity assay.     

A procedure for the statistical evaluation of Ames Salmonella assay results. Comparison of results among 4 laboratories

Ames Salmonella test data collected in our laboratory and 3 National Cancer Institute contract laboratories were analyzed to study the distribution of experimental errors associated with the test. It is shown that the Poisson distribution is not appropriate, and that the power transformation model Y = (revertants/plate)lambda, with lambda = 0.2 as estimated by the methods of Box and Cox, produced a measurement scale on which the experimental errors could be adequately described by a normal (Gaussian) distribution with a constant variance. The modeling procedure enables one to properly use analysis of variance, regression analysis, and Student's t test to analyze Ames Salmonella test results, and well-known statistical quality control procedures to monitor laboratory performance. The method detects weak mutagenic activity and measures the amount and uncertainty of the increase in revertants/plate. The development of the power transformation model is discussed and examples of its use in the interpretation of Ames Salmonella assay results are included.