Threats to Validity in the Design and Conduct of Preclinical Efficacy Studies: A Systematic Review of Guidelines for In Vivo Animal Experiments

Background

The vast majority of medical interventions introduced into clinical development prove unsafe or ineffective. One prominent explanation for the dismal success rate is flawed preclinical research. We conducted a systematic review of preclinical research guidelines and organized recommendations according to the type of validity threat (internal, construct, or external) or programmatic research activity they primarily address.

Methods and Findings

We searched MEDLINE, Google Scholar, Google, and the EQUATOR Network website for all preclinical guideline documents published up to April 9, 2013 that addressed the design and conduct of in vivo animal experiments aimed at supporting clinical translation. To be eligible, documents had to provide guidance on the design or execution of preclinical animal experiments and represent the aggregated consensus of four or more investigators. Data from included guidelines were independently extracted by two individuals for discrete recommendations on the design and implementation of preclinical efficacy studies. These recommendations were then organized according to the type of validity threat they addressed. A total of 2,029 citations were identified through our search strategy. From these, we identified 26 guidelines that met our eligibility criteria—most of which were directed at neurological or cerebrovascular drug development. Together, these guidelines offered 55 different recommendations. Some of the most common recommendations included performance of a power calculation to determine sample size, randomized treatment allocation, and characterization of disease phenotype in the animal model prior to experimentation.

Conclusions

By identifying the most recurrent recommendations among preclinical guidelines, we provide a starting point for developing preclinical guidelines in other disease domains. We also provide a basis for the study and evaluation of preclinical research practice. Please see later in the article for the Editors'' Summary     

Site-Specific Phosphorylation of the DNA Damage Response Mediator Rad9 by Cyclin-Dependent Kinases Regulates Activation of Checkpoint Kinase 1

The mediators of the DNA damage response (DDR) are highly phosphorylated by kinases that control cell proliferation, but little is known about the role of this regulation. Here we show that cell cycle phosphorylation of the prototypical DDR mediator Saccharomyces cerevisiae Rad9 depends on cyclin-dependent kinase (CDK) complexes. We find that a specific G2/M form of Cdc28 can phosphorylate in vitro the N-terminal region of Rad9 on nine consensus CDK phosphorylation sites. We show that the integrity of CDK consensus sites and the activity of Cdc28 are required for both the activation of the Chk1 checkpoint kinase and its interaction with Rad9. We have identified T125 and T143 as important residues in Rad9 for this Rad9/Chk1 interaction. Phosphorylation of T143 is the most important feature promoting Rad9/Chk1 interaction, while the much more abundant phosphorylation of the neighbouring T125 residue impedes the Rad9/Chk1 interaction. We suggest a novel model for Chk1 activation where Cdc28 regulates the constitutive interaction of Rad9 and Chk1. The Rad9/Chk1 complex is then recruited at sites of DNA damage where activation of Chk1 requires additional DDR–specific protein kinases.     

Location of the CD8 T Cell Epitope within the Antigenic Precursor Determines Immunogenicity and Protection against the Toxoplasma gondii Parasite

CD8 T cells protect the host from disease caused by intracellular pathogens, such as the Toxoplasma gondii (T. gondii) protozoan parasite. Despite the complexity of the T. gondii proteome, CD8 T cell responses are restricted to only a small number of peptide epitopes derived from a limited set of antigenic precursors. This phenomenon is known as immunodominance and is key to effective vaccine design. However, the mechanisms that determine the immunogenicity and immunodominance hierarchy of parasite antigens are not well understood.Here, using genetically modified parasites, we show that parasite burden is controlled by the immunodominant GRA6-specific CD8 T cell response but not by responses to the subdominant GRA4- and ROP7-derived epitopes. Remarkably, optimal processing and immunodominance were determined by the location of the peptide epitope at the C-terminus of the GRA6 antigenic precursor. In contrast, immunodominance could not be explained by the peptide affinity for the MHC I molecule or the frequency of T cell precursors in the naive animals. Our results reveal the molecular requirements for optimal presentation of an intracellular parasite antigen and for eliciting protective CD8 T cells.     

Small Intestine Inflammation in Roquin-Mutant and Roquin-Deficient Mice

Roquin, an E3 ubiquitin ligase that localizes to cytosolic RNA granules, is involved in regulating mRNA stability and translation. Mice that have a M199R mutation in the Roquin protein (referred to as sanroque or Roquin^san/san mice) develop autoimmune pathologies, although the extent to which these occur in the intestinal mucosa has not been determined. Here, we demonstrate that Roquin^san/san mice reproducibly develop intestinal inflammation in the small intestine but not the colon. Similarly, mice generated in our laboratory in which the Roquin gene was disrupted by insertion of a gene trap cassette (Roquin^gt/gt mice) had small intestinal inflammation that mimicked that of Roquin^san/san mice. MLN cells in Roquin^san/san mice consisted of activated proliferating T cells, and had increased numbers of CD44^hi CD62L^lo KLRG1⁺ short-lived effector cells. Proportionally more small intestinal intraepithelial lymphocytes in Roquin^san/san mice expressed the ICOS T cell activation marker. Of particular interest, small intestinal lamina propria lymphocytes in Roquin^san/san mice consisted of a high proportion of Gr-1⁺ T cells that included IL-17A⁺ cells and CD8⁺ IFN-γ⁺ cells. Extensive cytokine dysregulation resulting in both over-expression and under-expression of chemotactic cytokines occurred in the ileum of Roquin^san/san mice, the region most prone to the development of inflammation. These findings demonstrate that chronic inflammation ensues in the intestine following Roquin alteration either as a consequence of protein mutation or gene disruption, and they have implications for understanding how small intestinal inflammation is perpetuated in Crohn''s disease (CD). Due to the paucity of animal models of CD-like pathophysiology in the small intestine, and because the primary gene/protein defects of the Roquin animal systems used here are well-defined, it will be possible to further elucidate the underlying genetic and molecular mechanisms that drive the disease process.     

Contrasting sensitivity of nestling and fledgling Barn Swallow Hirundo rustica body mass to local weather conditions

Local weather can influence the growth and development of young birds either indirectly, by modifying prey availability, or directly, by affecting energetic trade-offs. Such effects can have lasting implications for life history traits, but the nature of these effets may vary with the developmental stage of the birds, and over timescales from days to weeks. We examined the interactive effects of temperature, rainfall and wind speed on the mass of nestling and fledgling Barn Swallows Hirundo rustica both on the day of capture and averaging weather across the time since hatching. At the daily timescale, nestling mass was negatively correlated with temperature, but the strength of this association depended on the level of rainfall and wind speed; nestlings were typically heavier on dry or windy days, and the negative effect of temperature was strongest under calm or wet conditions. At the early lifetime timescale (i.e. from hatching to pre-fledging), nestling mass was negatively correlated with temperature at low wind speed. Fledgling body mass was less sensitive to weather; the only weather effect evident was a negative correlation with temperature at the daily scale under high rainfall that became slightly positive under low rainfall. These changes are consistent with weather effects on the availability and distribution of insects within the landscape (e.g. causing high concentrations of flying insects) and with the effects of weather variation on nest microclimate. These results together demonstrate the impacts of weather on chick growth, over immediate (daily) and longer term (nestling/fledgling lifetime) timescales. This shows that sensitivity to local weather conditions varies across the early lifetime of young birds (nestling–fledgling stages) and illustrates the mechanisms by which larger scale (climate) variations influence the body condition of individuals.     

Ecomorphology of eye shape and retinal topography in waterfowl (Aves: Anseriformes: Anatidae) with different foraging modes

Despite the large body of literature on ecomorphological adaptations to foraging in waterfowl, little attention has been paid to their sensory systems, especially vision. Here, we compare eye shape and retinal topography across 12 species representing 4 different foraging modes. Eye shape was significantly different among foraging modes, with diving and pursuit-diving species having relatively smaller corneal diameters compared to non-diving species. This may be associated with differences in ambient light intensity while foraging or an ability to tightly constrict the pupil in divers in order to facilitate underwater vision. Retinal topography was similar across all species, consisting of an oblique visual streak, a central area of peak cell density, and no discernible fovea. Because the bill faces downwards when the head is held in the normal posture in waterfowl, the visual streak will be held horizontally, allowing the horizon to be sampled with higher visual acuity. Estimates of spatial resolving power were similar among species with only the Canada goose having a higher spatial resolution. Overall, we found no evidence of ecomorphological adaptations to different foraging modes in the retinal ganglion cell layer in waterfowl. Rather, retinal topography in these birds seems to reflect the ‘openness’ of their habitats.     

Survival and behavior of juvenile steelhead trout (Oncorhynchus mykiss) in two estuaries in Oregon, USA

Anadromous salmonids are viewed as a prized commodity and cultural symbol throughout the Pacific coast of North America. Unfortunately, several native salmonid populations are threatened or at risk of extinction. Despite this, little is known about the behavior and survival of these fish as the juveniles transition from freshwater to the ocean. Our primary objectives were to estimate survival of juvenile steelhead migrating between trapping sites and the ocean and evaluate whether survival in the estuary varies temporally (within a year) or spatially (within and between estuaries) within the same distinct population segment. We also evaluated whether flow or fork length were correlated with survival and collected information on variables that have been demonstrated to affect smolt survival in other studies to lend insight regarding differences in survival estimates between basins. We compared run timing, migration rate, survival, condition factor, age composition and time of residence in the estuary for steelhead outmigrants from each basin and measured parasite loads in outmigrating steelhead to evaluate potential differences in parasite density and parasite community between basins. In 2009, we implanted acoustic transmitters in 139 wild steelhead smolts in two small rivers on the Oregon Coast. In general, only 40–50 % of the wild steelhead smolts tagged at upstream smolt traps were detected entering the ocean. The majority of mortality occurred in the lower estuary near the ocean. Wild steelhead smolts typically spent less than 1 day in the estuary in both basins. Using similar data from previous studies in the Nehalem and Alsea basins, we showed that survival appears to be negatively correlated with flow in most releases, and in 2009 fork length was not correlated with survival. Our observations provide baseline information on factors that could influence smolt survival through the estuary as well as smolt to adult survival in these basins, and emphasize the importance of monitoring smolt survival in the estuary.