Peer review of validation studies: an assessment of the role of the OECD by reference to the validation of the uterotrophic assay for endocrine disruptors

The involvement of the OECD in managing the validation of the rat uterotrophic assay for endocrine disruptors, and in organising the peer review of the results of this study, has been assessed and compared with the many conclusions and recommendations in several published reports of international workshops on validation, and information in guidance documents, produced by the European Centre for the Validation of Alternative Methods (ECVAM), the US Interagency Coordinating Committee on the Validation of Alternative Methods (ICCVAM) and the OECD itself. It is concluded that the OECD has not followed the recommendations for full transparency and independence of the peer-review process. This is based on the fact that it has published a draft guidance document that differs from the report of a recent OECD workshop on validation, in such a way as to give the OECD the flexibility to fully control the peer-review process and, in so doing, to avoid full transparency. Comparison of the timing of the organisation of workshops by the OECD and the progression of the validation study, together with the fact that a draft test guideline for the assay was written before completion of the peer review, suggest that the OECD has given a higher priority to the expedition of the validation and regulatory acceptance of the uterotrophic assay than it has to good scientific and logistical practice. This severely undermines its credibility in the validation process, so, in order for the OECD to be rightly perceived as an honest broker, it is recommended that the OECD should play no role in the validation of new or revised tests, until after they have been successfully validated, peer reviewed, and endorsed by the appropriate authorities, and are ready for test guideline development. With regard to the on-going OECD validation studies of other in vivo assays for endocrine disruptors, the OECD should take immediate steps to ensure full independence and transparency of their peer review.     

In vivo test systems for the quantitative and qualitative analysis of the biological activity of phytoestrogens

Many compounds of plant origin with the ability to bind to the estrogen receptor have been identified in the last decades. One of the most extensively used in vivo assays to characterise the estrogenic potency of these phytoestrogens and mechanisms of their action is the rodent uterotrophic assay. Various protocols exist for this test system, using immature, hypophysectomized, or ovariectomized rats and mice and oral or subcutaneous administration of the test compound. However, just monitoring the ability of a compound to stimulate uterine growth is not sufficient to characterize its estrogenicity. Over the last decades, an increasing number of estrogen sensitive tissues has been identified. Moreover, a variety of different molecular mechanisms have been discovered for the action of estrogens, including non-genomic actions. Therefore, an in vivo test design for estrogenicity should include an analysis of several estrogen sensitive parameters in different estrogen sensitive tissues. To distinguish between agonistic and antagonistic properties of a substance, combinations of the test compound with estrogens and antiestrogens should be analyzed. A reasonable supplement to this enhanced uterotrophic assay are selected estrogen sensitive tumor models, which can be used to test for potential chemopreventive properties of phytoestrogens.     

Mutagenicity testing with transgenic mice. Part II: Comparison with the mouse spot test

The mouse spot test, an in vivo mutation assay, has been used to assess a number of chemicals. It is at present the only in vivo mammalian test system capable of detecting somatic gene mutations according to OECD guidelines (OECD guideline 484). It is however rather insensitive, animal consuming and expensive type of test. More recently several assays using transgenic animals have been developed. From data in the literature, the present study compares the results of in vivo testing of over twenty chemicals using the mouse spot test and compares them with results from the two transgenic mouse models with the best data base available, the lacI model (commercially available as the Big Blue(R) mouse), and the lacZ model (commercially available as the Mutatrade mark Mouse). There was agreement in the results from the majority of substances. No differences were found in the predictability of the transgenic animal assays and the mouse spot test for carcinogenicity. However, from the limited data available, it seems that the transgenic mouse assay has several advantages over the mouse spot test and may be a suitable test system replacing the mouse spot test for detection of gene but not chromosome mutations in vivo.     

A statistical evaluation of the fixed dose procedure

The Fixed Dose Procedure (FDP) was first proposed in 1984 by the British Toxicology Society, as an alternative to the conventional LD50 test (OECD Test Guideline 401), for determining acute oral toxicity. The FDP used fewer animals and caused less suffering than the LD50 test, and provided information on acute toxicity which allowed substances to be classified according to the European Union hazard classification system. In 1992, the FDP was introduced as OECD Test Guideline 420. In 1999, as part of an initiative to phase out Test Guideline 401, a review of the FDP was undertaken. The aim of the review was to provide further reductions and refinements, and classification according to the criteria of the Globally Harmonised Hazard Classification and Labelling Scheme. The revised FDP was adopted by the OECD in 2001. This article concerns the development and revision of the FDP. It illustrates how statistical modelling and simulation can be used to increase the efficiency of a test procedure and reduce the number of animals needed for an in vivo validation of the procedure.     

Refinement and reduction of acute oral toxicity testing: a critical review of the use of cytotoxicity data

Acute oral toxicity testing is still required for the classification and labelling of chemicals, agrochemicals and related formulations. There have been increasing efforts over the last two decades to reduce the number of animals needed for this testing, according to the Three Rs concept. To evaluate the utility of an in vitro cytotoxicity test in our routine testing for acute oral toxicity, we have implemented in our laboratory the neutral red uptake (NRU) method, with Balb/c 3T3 fibroblasts after a 48-hour exposure, which was recommended in ICCVAM Report 07-4519, 2006. Initially, we tested 16 substances that had existing in vivo and in vitro data available, to prove our technical proficiency with the in vitro test. Then, testing was performed with 187 test substances, including a broad variety of chemicals, agrochemicals and formulations. The starting dose for acute oral systemic toxicity assays in rats (LD50) was estimated by using the prediction model presented in the ICCVAM validation study, and subsequently compared to the results obtained by in vivo testing performed according to, or similar to, OECD Test Guideline 423. Comparison of all of the 203 predicted LD50 values that were deduced from the in vitro IC50 values, with the in vivo results from oral toxicity studies in rats, resulted in a low overall concordance of 35%. The in vitro cytotoxicity assay achieved a good concordance of 74%, only for the weakly toxic substances (EU-GHS Cat. 4). However, it must be noted that 71% of the substances tested (i.e. 145/203) were classified as being weakly toxic in vitro. We further analysed the utility of the in vitro test for predicting the starting dose for an in vivo study, and the potential reduction in animal usage that this would engender. In this regard, the prediction by the cytotoxicity test was useful for 59% of the substances. However, the use of a standard starting dose of 300 mg/kg bw by default (without previous cytotoxicity testing) would have been almost as useful (50%). In contrast, the prediction by an experienced toxicologist was correct for 95% of the substances. However, this was only performed for 40% of the substances, mainly those of no to low toxicity. Calculating the theoretical animal numbers needed in several scenarios supported these results. The additional analysis, considering some physicochemical data (solubility, molecular weight, log POW), substance class and mode of action, revealed no specific applicability domains. In summary, the use of the 3T3 NRU cytotoxicity data alone did not sufficiently contribute to refinement and reduction in the acute oral toxicity testing of the substance portfolio tested routinely in our laboratory.     

ECVAM prevalidation study on in vitro cell transformation assays: general outline and conclusions of the study

The potential for a compound to induce carcinogenicity is a key consideration when ascertaining hazard and risk assessment of chemicals. Among the in vitro alternatives that have been developed for predicting carcinogenicity, in vitro cell transformation assays (CTAs) have been shown to involve a multistage process that closely models important stages of in vivo carcinogenesis and have the potential to detect both genotoxic and non-genotoxic carcinogens. These assays have been in use for decades and a substantial amount of data demonstrating their performance is available in the literature. However, for the standardised use of these assays for regulatory purposes, a formal evaluation of the assays, in particular focusing on development of standardised transferable protocols and further information on assay reproducibility, was considered important to serve as a basis for the drafting of generally accepted OECD test guidelines. To address this issue, a prevalidation study of the CTAs using the BALB/c 3T3 cell line, SHE cells at pH 6.7, and SHE cells at pH 7.0 was coordinated by the European Centre for the Validation of Alternative Methods (ECVAM) and focused on issues of standardisation of protocols, test method transferability and within- and between-laboratory reproducibility. The study resulted in the availability of standardised protocols that had undergone prevalidation [1,2]. The results of the ECVAM study demonstrated that for the BALB/c 3T3 method, some modifications to the protocol were needed to obtain reproducible results between laboratories, while the SHE pH 6.7 and the SHE pH 7.0 protocols are transferable between laboratories, and results are reproducible within- and between-laboratories. It is recommended that the BALB/c 3T3 and SHE protocols as instituted in this prevalidation study should be used in future applications of these respective transformation assays. To support their harmonised use and regulatory application, the development of an OECD test guideline for the SHE CTAs, based on the protocol published in this issue, is recommended. The development of an OECD test guideline for the BALB/c 3T3 CTA should likewise be further pursued upon the availability of additional supportive data and improvement of the statistical analysis.     

In vivo erythrocyte micronucleus assay III. Validation and regulatory acceptance of automated scoring and the use of rat peripheral blood reticulocytes, with discussion of non-hematopoietic target cells and a single dose-level limit test

The in vivo micronucleus assay working group of the International Workshop on Genotoxicity Testing (IWGT) discussed new aspects in the in vivo micronucleus (MN) test, including the regulatory acceptance of data derived from automated scoring, especially with regard to the use of flow cytometry, the suitability of rat peripheral blood reticulocytes to serve as the principal cell population for analysis, the establishment of in vivo MN assays in tissues other than bone marrow and blood (for example liver, skin, colon, germ cells), and the biological relevance of the single-dose-level test. Our group members agreed that flow cytometric systems to detect induction of micronucleated immature erythrocytes have advantages based on the presented data, e.g., they give good reproducibility compared to manual scoring, are rapid, and require only small quantities of peripheral blood. Flow cytometric analysis of peripheral blood reticulocytes has the potential to allow monitoring of chromosome damage in rodents and also other species as part of routine toxicology studies. It appears that it will be applicable to humans as well, although in this case the possible confounding effects of splenic activity will need to be considered closely. Also, the consensus of the group was that any system that meets the validation criteria recommended by the IWGT (2000) should be acceptable. A number of different flow cytometric-based micronucleus assays have been developed, but at the present time the validation data are most extensive for the flow cytometric method using anti-CD71 fluorescent staining especially in terms of inter-laboratory collaborative data. Whichever method is chosen, it is desirable that each laboratory should determine the minimum sample size required to ensure that scoring error is maintained below the level of animal-to-animal variation. In the second IWGT, the potential to use rat peripheral blood reticulocytes as target cells for the micronucleus assay was discussed, but a consensus regarding acceptability for regulatory purposes could not be reached at that time. Subsequent validation efforts, combined with accumulated published data, demonstrate that blood-derived reticulocytes from rats as well as mice are acceptable when young reticulocytes are analyzed under proper assay protocol and sample size. The working group reviewed the results of micronucleus assays using target cells/tissues other than hematopoietic cells. We also discussed the relevance of the liver micronucleus assay using young rats, and the importance of understanding the maturation of enzyme systems involved in the processes of metabolic activation in the liver of young rats. Although the consensus of the group was that the more information with regard to the metabolic capabilities of young rats would be useful, the published literature shows that young rats have sufficient metabolic capacity for the purposes of this assay. The use of young rats as a model for detecting MN induction in the liver offers a good alternative methodology to the use of partial hepatectomy or mitogenic stimulation. Additional data obtained from colon and skin MN models have been integrated into the data bases, enhancing confidence in the utility of these models. A fourth topic discussed by the working group was the regulatory acceptance of the single-dose-level assay. There was no consensus regarding the acceptability of a single dose level protocol when dose-limiting toxicity occurs. The use of a single dose level can lead to problems in data interpretation or to the loss of animals due to unexpected toxicity, making it necessary to repeat the study with additional doses. A limit test at a single dose level is currently accepted when toxicity is not dose-limiting.     

Prevalidation study of the Syrian hamster embryo (SHE) cell transformation assay at pH 6.7 for assessment of carcinogenic potential of chemicals

The Syrian hamster embryo (SHE) cell transformation assay (CTA) is an important in vitro method that is highly predictive of rodent carcinogenicity. It is a key method for reducing animal usage for carcinogenicity prediction. The SHE assay has been used for many years primarily to investigate and identify potential rodent carcinogens thereby reducing the number of 2-year bioassays performed in rodents. As for other assays with a long history of use, the SHE CTA has not undergone formal validation. To address this, the European Centre for the Validation of Alternative Methods (ECVAM) coordinated a prevalidation study. The aim of this study was to evaluate the within-laboratory reproducibility, test method transferability, and between-laboratory reproducibility and to develop a standardised state-of-the-art protocol for the SHE CTA at pH 6.7. Formal ECVAM principles for criteria on reproducibility (including the within-laboratory reproducibility, the transferability and the between-laboratories reproducibility) were applied. In addition to the assessment of reproducibility, this study helped define a standard protocol for use in developing an Organisation for Economic Co-operation and Development (OECD) test guideline for the SHE CTA. Six compounds were evaluated in this study: benzo(a)pyrene, 3-methylcholanthrene, o-toluidine HCl, 2,4-diaminotoluene, phthalic anhydride and anthracene. Results of this study demonstrate that a protocol is available that is transferable between laboratories, and that the SHE CTA at pH 6.7 is reproducible within- and between-laboratories.     

ECVAM's activities in validating alternative tests for skin corrosion and irritation

ECVAM has funded and managed validation studies on in vitro tests for skin corrosion, resulting in the validities of four in vitro tests being endorsed by the ECVAM Scientific Advisory Committee: the rat skin transcutaneous electrical resistance (TER) assay, two tests based on the use of commercial reconstituted human skin equivalents, EPISKIN and EpiDerm, and another commercially-produced test, CORROSITEX. In the European Union (EU), a new test method on skin corrosion (B.40), incorporating the rat skin TER and human skin model assays, was included in Annex V of Directive 67/548/EEC in mid-2000, thereby making the use of in vitro alternatives for skin corrosion testing of chemicals mandatory in the EU. At the recommendation of its Skin Irritation Task Force, ECVAM has funded prevalidation studies on five in vitro tests for acute skin irritation: EpiDerm, EPISKIN, PREDISKIN, the pig-ear test, and the mouse-skin integrity function test (SIFT). However, none of the tests met the criteria (set by the Management Team for the studies) for inclusion in a large-scale formal validation study. Thus, to date, there are no validated in vitro tests for predicting the dermal irritancy of chemicals. Following further work on the EPISKIN, EpiDerm and SIFT test protocols and/or prediction models after the completion of the prevalidation studies, it appears that the modified tests could meet the performance criteria defined for progression to a validation study. This will now be assessed independently by the ECVAM Skin Irritation Task Force, with the objective of taking a decision before the end of 2002 on whether to conduct a formal validation study.     

Assessment of the long-term and transgenerational consequences of perturbing preimplantation embryo development in mice

Perturbations of the development of preimplantation embryos may have long-term consequences for the health of progeny. There are no standardized methods for assessing such risks. The OECD/OCDE 416 Guideline for Testing of Chemicals (Two-Generation Reproduction Toxicity Study) is a standardized assay for detecting potential toxic effects of chemicals. The present study assessed the utility of this guideline for identifying long-term consequences of perturbing preimplantation development. Extended culturing of mammalian zygotes commonly results in retarded preimplantation development. Mouse zygotes were cultured in vitro for 96 h until the blastocyst stage (cultured blastocysts) or blastocysts were collected from the Day-3.5 uterus (in vivo blastocysts). The resulting blastocysts were transferred to the uteri of pseudopregnant recipients (P generation). Progeny from both treatments were mated for a further two generations (F1 and F2 generations). There was no effect of treatment group on gross fertility across the generations tested. Progeny of the cultured blastocysts had lower body weights to the time of weaning compared to in vivo blastocysts in the P and F1 generations, but not in the F2 generation. At maturity, there was no effect of treatment group on body weight, although thyroid weight was higher in the in vivo blastocyst group in the P generation, while the brain, pituitary, and kidneys were larger in the progeny of the cultured blastocysts of the F1 generation. The OECD/OCDE 416 assessment may have a role as a standardized test for the assessment of the biological consequences of perturbing the growth environment of the preimplantation embryo. Embryo culture influenced the somatometric parameters of the resulting progeny, some of which were maintained across a generation.     

Experimental Study on the Estrogen-Like Effect of Boric Acid

There are now considerable evidences that boric acid has reproductive and developmental toxicity, but it is uncertain whether such toxicity is caused by estrogen-like effect. Our objective is to determine the estrogen-like effect of boric acid. Proliferation assay of MCF-7 human breast cancer cells, uterotrophic assay, measure assay of the estradiol (E₂), proliferation assay of mucous membrane cells, and assay of estrogen receptor were conducted in this study. Boric acid could increase the weight of uterus of ovariectomized SD rats and the height of epithelium cells of mucous membrane, enhance the expression of the proliferating cell nucleus antigen, and reduce the density of estrogen receptors. However, boric acid could not affect the level of estradiol in serum and stimulate the proliferation of MCF-7 human breast cancer cells. In this study, boric acid exhibited the estrogen-like effect in vivo.     

Proliferation assays for estrogenicity testing with high predictive value for the in vivo uterotrophic effect

Proliferation assays based on human cell lines are the most used in vitro tests to determine estrogenic properties of compounds. Our objective was to characterise to what extent these in vitro tests provide alternatives for the in vivo Allen and Doisy test, a uterotrophic assay in immature or ovariectomised rodents with uterus weight as a crucial read-out parameter. In the present study four different human cell lines derived from three different female estrogen-sensitive tissues, i.e. breast (MCF-7/BOS and T47D), endometrial (ECC-1) and ovarian (BG-1) cells, were characterised by investigating their relative ERα and ERβ amounts, as the ERα/ERβ ratio is a dominant factor determining their estrogen-dependent proliferative responses. All four cell lines clearly expressed the ERα type and a very low but detectable amount of ERβ on both the mRNA and protein level, with the T47D cell line expressing the highest level of the ERβ type. Subsequently, a set of reference compounds representing different modes of estrogen action and estrogenic potency were used to investigate the proliferative response in the four cell lines, to determine which cell line most accurately predicts the effect observed in vivo. All four cell lines revealed a reasonable to good correlation with the in vivo uterotrophic effect, with the correlation being highest for the MCF-7/BOS cell line (R2=0.85). The main differences between the in vivo uterotrophic assay and the in vitro proliferation assays were observed for tamoxifen and testosterone. The proliferative response of the MCF-7/BOS cells to testosterone was partially caused by its conversion to estradiol by aromatase or via androstenedione to estrone. It is concluded that of the four cell lines tested, the best assay to include in an integrated testing strategy for replacement of the in vivo uterotrophic assay is the human MCF-7/BOS breast cancer cell line.     

The need for a formal invalidation process for animal and non-animal tests

A plethora of regulations require that many chemicals and chemical products are tested for efficacy and/or toxicity. When permitted to operate effectively and without bias, the ECVAM/ICCVAM/OECD validation process can be used to independently establish that new animal and non-animal test procedures are sufficiently relevant and reliable for their stated purposes and should be considered for regulatory use. However, the validation process is under threat because of vested interests of various kinds, and it is clear that many currently-accepted animal tests and candidate animal and non-animal tests do not, and could never, meet the agreed criteria for necessity, test development, prevalidation, validation and acceptance. We therefore need an invalidation process to parallel and protect the validation process, so that such methods could be independently reviewed and declared irrelevant and/or unreliable for their claimed purposes. An additional advantage of such a process would be that valuable resources would no longer be wasted in attempts to secure the acceptance of inherently inadequate tests.     

The importance of the prediction model in the validation of alternative tests

An overview is presented of the validation process adopted by the European Centre for the Validation of Alternative Methods, with particular emphasis on the central role of the prediction model (PM). The development of an adequate PM is considered to be just as important as the development of an adequate test system, since the validity of an alternative test can only be established when both components (the test system and the PM) have successfully undergone validation. It is argued, however, that alternative tests and their associated PMs do not necessarily need to undergo validation at the same time, and that retrospective validation may be appropriate when a test system is found to be reliable, but the case for its relevance remains to be demonstrated. For an alternative test to be considered "scientifically valid", it is necessary for three conditions to be fulfilled, referred to here as the criteria for scientific relevance, predictive relevance, and reliability. A minimal set of criteria for the acceptance of any PM is defined, but it should be noted that required levels of predictive ability need to be established on a case-by-case basis, taking into account the inherent variability of the alternative and in vivo test data. Finally, in view of the growing shift in emphasis from the use of stand-alone alternative tests to alternative testing strategies, the importance of making the PM an integral part of the testing strategy is discussed.     

Validation successes: chemicals

The ECVAM validation concept, which was defined at two validation workshops held in Amden (Switzerland) in 1990 and 1994, and which takes into account the essential elements of prevalidation and biostatistically defined prediction models, has been officially accepted by European Union (EU) Member States and by the Federal regulatory agencies of the USA and the OECD. The ECVAM validation concept was introduced into the ongoing ECVAM/COLIPA validation study of in vitro phototoxicity tests, which ended successfully in 1998. The 3T3 neutral red uptake in vitro phototoxicity test was the first experimentally validated in vitro toxicity test recommended for regulatory purposes by the ECVAM Scientific Advisory Committee (ESAC). It was accepted by the EU into the legislation for chemicals in the year 2000. From 1996 to 1998, two in vitro skin corrosivity tests were successfully validated by ECVAM, and they were also officially accepted into the EU regulations for chemicals in the year 2000. Meanwhile, in 2002, the OECD Test Guidelines Programme is considering the worldwide acceptance of the validated in vitro phototoxicity and corrosivity tests. Finally, from 1997 to 2000, an ECVAM validation study on three in vitro embryotoxicity tests was successfully completed. Therefore, the three in vitro embryotoxicity tests, the whole embryo culture (WEC) test on rat embryos, the micromass (MM) test on limb bud cells of mouse embryos, and the embryonic stem cell test (EST) including a permanent embryonic mouse stem cell line, are considered for routine use in laboratories of the European pharmaceutical and chemicals industries.     

Assessment of the skin irritation potential of chemicals by using the SkinEthic reconstructed human epidermal model and the common skin irritation protocol evaluated in the ECVAM skin irritation validation study

Currently, two reconstructed human skin models, EpiDerm and EPISKIN are being evaluated in an ECVAM skin irritation validation study. A common skin irritation protocol has been developed, differing only in minor technical details for the two models. A small-scale study, applying this common skin irritation protocol to the SkinEthic reconstructed human epidermis (RHE), was performed at ZEBET at the BfR, Berlin, Germany, to consider whether this protocol could be successfully transferred to another epidermal model. Twenty substances from Phase III of the ECVAM prevalidation study on skin irritation were tested with the SkinEthic RHE. After minor, model-specific adaptations for the SkinEthic RHE, almost identical results to those obtained with the EpiDerm and EPISKIN models were achieved. The overall accuracy of the method was more than 80%, indicating a reliable prediction of the skin irritation potential of the tested chemicals when compared to in vivo rabbit data. As a next step, inter laboratory reproducibility was assessed in a study conducted between ZEBET and the Department of Experimental Toxicology, Schering AG, Berlin, Germany. Six coded substances were tested in both laboratories, with three different batches of the SkinEthic model. The assay results showed good reproducibility and correct predictions of the skin irritation potential for all six test chemicals. The results obtained with the SkinEthic RHE and the common protocol were reproducible in both phases, and the overall outcome is very similar to that of earlier studies with the EPISKIN and EpiDerm models. Therefore, the SkinEthic skin irritation assay test protocol can now be evaluated in a formal "catch-up" validation study.     

Assessment of the eye irritating properties of chemicals by applying alternatives to the Draize rabbit eye test: the use of QSARs and in vitro tests for the classification of eye irritation

Huggins has reported on the current situation relating to the development of alternatives to the Draize eye irritation test with rabbits, and an ECVAM Working Group have reviewed the efforts needed in order to replace this animal test within the next 10 years by using the results of non-animal assessment methods. Our report reviews regulatory experience gained over the last 20 years with the EU chemicals notification procedure with respect to the assessment of eye lesions observed in Draize tests. The nature of eye lesions and their importance for classification and labelling of possible hazards to human eyes are evaluated and discussed, with a view to promoting the development of specific in vitro assays which are able to discriminate between eye damage, moderate eye irritation, and minor irritation effects which are completely reversible within a few days. Structural alerts for the prediction of eye irritation/corrosion hazards to be classified and labelled according to international classification criteria, are presented, which should be validated in accordance with internationally agreed (OECD) principles for (Q)SAR system validation. Physicochemical limit values for prediction of the absence of any eye irritation potential relevant for human health can make available a definition of the applicability domains of alternative methods developed for the replacement of the Draize eye irritation test.     

The ECVAM international validation study on in vitro embryotoxicity tests: results of the definitive phase and evaluation of prediction models. European Centre for the Validation of Alternative Methods

From 1996 to 2000, ZEBET (Centre for Documentation and Evaluation of Alternative Methods to Animal Experiments at the BgVV, Berlin, Germany) coordinated the European Centre for the Validation of Alternative Methods (ECVAM) prevalidation and validation study on three embryotoxicity tests: a) a test employing embryonic stem cell lines (EST); b) the micromass (MM) test; and c) the postimplantation rat whole-embryo culture assay (WEC test). The main objectives of the study were to assess the performance of these three in vitro tests in discriminating between non- embryotoxic, weakly embryotoxic and strongly embryotoxic compounds. Phase I of the study (1997) was designed as a prevalidation phase, for test protocol optimisation, and for the establishment of a comprehensive database of in vivo and in vitro data on embryotoxic compounds. Phase II (1998-2000) involved a formal validation trial, conducted under blind conditions on 20 test compounds selected from the database, which were coded and distributed to the participating laboratories. In the preliminary phase of the validation study, six chemicals out of the 20, which showed embryotoxic potential, were tested. These results were used to define new biostatistically based prediction models (PMs) for the MM and WEC tests, and to evaluate those developed previously for the EST. As a next step, the PMs were evaluated by using the results for the remaining 14 chemicals of the definitive phase of the validation study. The three in vitro embryotoxicity tests proved to be applicable to testing a diverse group of chemicals with different embryotoxic potentials (non-embryotoxic, weakly embryotoxic, and strongly embryotoxic). The reproducibility of the three in vitro embryotoxicity tests were acceptable according to the acceptance criteria defined by the Management Team. The concordances between the embryotoxic potentials derived from the in vitro data and from the in vivo data were good for the EST and the WEC (PM2) test, and sufficient for the MM test and the WEC (PM1) tests according to the performance criteria defined by the Management Team before the formal validation study. When applying the PM of the EST to the in vitro data obtained in the definitive phase of the formal validation study, chemicals were classified correctly in 78% of the experiments. For the MM and the WEC tests, the PMs provided 70% and 80% (PM2) correct classifications, respectively. And, very importantly, an excellent predictivity (100%, except for PM1 of the WEC test, with 79%, considered as good) was obtained with strong embryotoxic chemicals in each of the three in vitro tests.     

The ECVAM international validation study on in vitro tests for acute skin irritation: report on the validity of the EPISKIN and EpiDerm assays and on the Skin Integrity Function Test

ECVAM sponsored a formal validation study on three in vitro tests for skin irritation, of which two employ reconstituted human epidermis models (EPISKIN, EpiDerm), and one, the skin integrity function test (SIFT), employs ex vivo mouse skin. The goal of the study was to assess whether the in vitro tests would correctly predict in vivo classifications according to the EU classification scheme, "R38" and "no label" (i.e. non-irritant). 58 chemicals (25 irritants and 33 non-irritants) were tested, having been selected to give broad coverage of physico-chemical properties, and an adequate distribution of irritancy scores derived from in vivo rabbit skin irritation tests. In Phase 1, 20 of these chemicals (9 irritants and 11 non-irritants) were tested with coded identities by a single lead laboratory for each of the methods, to confirm the suitability of the protocol improvements introduced after a prevalidation phase. When cell viability (evaluated by the MTT reduction test) was used as the endpoint, the predictive ability of both EpiDerm and EPISKIN was considered sufficient to justify their progression to Phase 2, while the predictive ability of the SIFT was judged to be inadequate. Since both the reconstituted skin models provided false predictions around the in vivo classification border (a rabbit Draize test score of 2), the release of a cytokine, interleukin-1alpha (IL-1alpha), was also determined. In Phase 2, each human skin model was tested in three laboratories, with 58 chemicals. The main endpoint measured for both EpiDerm and EPISKIN was cell viability. In samples from chemicals which gave MTT assay results above the threshold of 50% viability, IL-1alpha release was also measured, to determine whether the additional endpoint would improve the predictive ability of the tests. For EPISKIN, the sensitivity was 75% and the specificity was 81% (MTT assay only); with the combination of the MTT and IL-1alpha assays, the sensitivity increased to 91%, with a specificity of 79%. For EpiDerm, the sensitivity was 57% and the specificity was 85% (MTT assay only), while the predictive capacity of EpiDerm was not improved by the measurement of IL-1alpha release. Following independent peer review, in April 2007 the ECVAM Scientific Advisory Committee endorsed the scientific validity of the EPISKIN test as a replacement for the rabbit skin irritation method, and of the EpiDerm method for identifying skin irritants as part of a tiered testing strategy. This new alternative approach will probably be the first use of in vitro toxicity testing to replace the Draize rabbit skin irritation test in Europe and internationally, since, in the very near future, new EU and OECD Test Guidelines will be proposed for regulatory acceptance.     

Biostatistical methods for the validation of alternative methods for in vitro toxicity testing

Statistical methods for the validation of toxicological in vitro test assays are developed and applied. Validation is performed either in comparison with in vivo assays or in comparison with other in vitro assays of established validity. Biostatistical methods are presented which are of potential use and benefit for the validation of alternative methods for the risk assessment of chemicals, providing at least an equivalent level of protection through in vitro toxicity testing to that obtained through the use of current in vivo methods. Characteristic indices are developed and determined. Qualitative outcomes are characterised by the rates of false-positive and false-negative predictions, sensitivity and specificity, and predictive values. Quantitative outcomes are characterised by regression coefficients derived from predictive models. The receiver operating characteristics (ROC) technique, applicable when a continuum of cut-off values is considered, is discussed in detail, in relation to its use for statistical modelling and statistical inference. The methods presented are examined for their use for the proof of safety and for toxicity detection and testing. We emphasise that the final validation of toxicity testing is human toxicity, and that the in vivo test itself is only a predictor with an inherent uncertainty. Therefore, the validation of the in vitro test has to account for the vagueness and uncertainty of the "gold standard" in vivo test. We address model selection and model validation, and a four-step scheme is proposed for the conduct of validation studies. Gaps and research needs are formulated to improve the validation of alternative methods for in vitro toxicity testing.