Peer Review of Grant Applications: Criteria Used and Qualitative Study of Reviewer Practices

Background

Peer review of grant applications has been criticized as lacking reliability. Studies showing poor agreement among reviewers supported this possibility but usually focused on reviewers’ scores and failed to investigate reasons for disagreement. Here, our goal was to determine how reviewers rate applications, by investigating reviewer practices and grant assessment criteria.

Methods and Findings

We first collected and analyzed a convenience sample of French and international calls for proposals and assessment guidelines, from which we created an overall typology of assessment criteria comprising nine domains relevance to the call for proposals, usefulness, originality, innovativeness, methodology, feasibility, funding, ethical aspects, and writing of the grant application. We then performed a qualitative study of reviewer practices, particularly regarding the use of assessment criteria, among reviewers of the French Academic Hospital Research Grant Agencies (Programmes Hospitaliers de Recherche Clinique, PHRCs). Semi-structured interviews and observation sessions were conducted. Both the time spent assessing each grant application and the assessment methods varied across reviewers. The assessment criteria recommended by the PHRCs were listed by all reviewers as frequently evaluated and useful. However, use of the PHRC criteria was subjective and varied across reviewers. Some reviewers gave the same weight to each assessment criterion, whereas others considered originality to be the most important criterion (12/34), followed by methodology (10/34) and feasibility (4/34). Conceivably, this variability might adversely affect the reliability of the review process, and studies evaluating this hypothesis would be of interest.

Conclusions

Variability across reviewers may result in mistrust among grant applicants about the review process. Consequently, ensuring transparency is of the utmost importance. Consistency in the review process could also be improved by providing common definitions for each assessment criterion and uniform requirements for grant application submissions. Further research is needed to assess the feasibility and acceptability of these measures.     

Differential regulation of stimulated glucose transport by free fatty acids and PPARα or -δ agonists in cardiac myocytes

Stimulation of glucose transport in response to insulin or metabolic stress is an important determinant of cardiac myocyte function and survival, particularly during ischemia-reperfusion episodes. The impact of dyslipidemia and its consequence PPAR activation on stimulated glucose transport in cardiac myocytes remains unknown. Isolated adult rat cardiac myocytes were chronically exposed to free fatty acids (FFA) or PPAR agonists. Insulin- (ISGT) and oligomycin-stimulated glucose transport (OSGT) and related cell signaling were analyzed. Exposure of cardiac myocytes to FFA reduced both ISGT and OSGT. Exposure to either PPARα or PPARδ agonists, but not to a PPARγ agonist, reduced ISGT but not OSGT and increased fatty acid oxidation (FAO). The reduction in ISGT was associated with impaired insulin signaling and, in the case of PPAR stimulation, overexpression of SOCS-3, a protein known to hinder proximal insulin signaling. In contrast, the reduction of OSGT could not be explained by a reduced activity of the cellular energy-sensing system, as assessed from the maintained phosphorylation state of AMPK. Inhibition of FAO at the level of mitochondrial acylcarnitine uptake restored OSGT but not ISGT. Seemingly paradoxically, further stimulation of FAO with PPARα or PPARδ agonists also restored OSGT but not ISGT. Together, these results suggest that inhibition of OSGT occurs downstream of energy gauging and is caused by some intermediate(s) of fatty acid oxidation, which does not appear to be acylcarnitines. The results indicate that the mechanisms underlying FFA-mediated inhibition of ISGT and OSGT differ remarkably.     

Spin labeling of the Escherichia coli NADH ubiquinone oxidoreductase (complex I)

The proton-pumping NADH:ubiquinone oxidoreductase, the respiratory complex I, couples the transfer of electrons from NADH to ubiquinone with the translocation of protons across the membrane. Electron microscopy revealed the two-part structure of the complex with a peripheral arm involved in electron transfer and a membrane arm most likely involved in proton translocation. It was proposed that the quinone binding site is located at the joint of the two arms. Most likely, proton translocation in the membrane arm is enabled by the energy of the electron transfer reaction in the peripheral arm transmitted by conformational changes. For the detection of the conformational changes and the localization of the quinone binding site, we set up a combination of site-directed spin labeling and EPR spectroscopy. Cysteine residues were introduced to the surface of the Escherichia coli complex I. The spin label (1-oxyl-2,2,5,5-tetramethyl-Δ3-pyrroline-3-methyl)-methanethiosulfonate (MTSL) was exclusively bound to the engineered positions. Neither the mutation nor the labeling had an effect on the NADH:decyl-ubiquinone oxidoreductase activity. The characteristic signals of the spin label were detected by EPR spectroscopy, which did not change by reducing the preparation with NADH. A decyl-ubiquinone derivative with the spin label covalently attached to the alkyl chain was synthesized in order to localize the quinone binding site. The distance between a MTSL labeled complex I variant and the bound quinone was determined by continuous-wave (cw) EPR allowing an inference on the location of the quinone binding site. The distances between the labeled quinone and other complex I variants will be determined in future experiments to receive further geometry information by triangulation.     

Sensory nerve induced inflammation contributes to heterotopic ossification

Heterotopic ossification (HO), or bone formation in soft tissues, is often the result of traumatic injury. Much evidence has linked the release of BMPs (bone morphogenetic proteins) upon injury to this process. HO was once thought to be a rare occurrence, but recent statistics from the military suggest that as many as 60% of traumatic injuries, resulting from bomb blasts, have associated HO. In this study, we attempt to define the role of peripheral nerves in this process. Since BMP2 has been shown previously to induce release of the neuroinflammatory molecules, substance P (SP) and calcitonin gene related peptide (CGRP), from peripheral, sensory neurons, we examined this process in vivo. SP and CGRP are rapidly expressed upon delivery of BMP2 and remain elevated throughout bone formation. In animals lacking functional sensory neurons (TRPV1(-/-) ), BMP2-mediated increases in SP and CGRP were suppressed as compared to the normal animals, and HO was dramatically inhibited in these deficient mice, suggesting that neuroinflammation plays a functional role. Mast cells, known to be recruited by SP and CGRP, were elevated after BMP2 induction. These mast cells were localized to the nerve structures and underwent degranulation. When degranulation was inhibited using cromolyn, HO was again reduced significantly. Immunohistochemical analysis revealed nerves expressing the stem cell markers nanog and Klf4, as well as the osteoblast marker osterix, after BMP2 induction, in mice treated with cromolyn. The data collectively suggest that BMP2 can act directly on sensory neurons to induce neurogenic inflammation, resulting in nerve remodeling and the migration/release of osteogenic and other stem cells from the nerve. Further, blocking this process significantly reduces HO, suggesting that the stem cell population contributes to bone formation.     

Site-directed perturbation of protein kinase C- integrin interaction blocks carcinoma cell chemotaxis

Polarized cell movement is an essential requisite for cancer metastasis; thus, interference with the tumor cell motility machinery would significantly modify its metastatic behavior. Protein kinase C alpha (PKC alpha) has been implicated in the promotion of a migratory cell phenotype. We report that the phorbol ester-induced cell polarization and directional motility in breast carcinoma cells is determined by a 12-amino-acid motif (amino acids 313 to 325) within the PKC alpha V3 hinge domain. This motif is also required for a direct association between PKC alpha and beta 1 integrin. Efficient binding of beta 1 integrin to PKC alpha requires the presence of both NPXY motifs (Cyto-2 and Cyto-3) in the integrin distal cytoplasmic domains. A cell-permeant inhibitor based on the PKC-binding sequence of beta 1 integrin was shown to block both PKC alpha-driven and epidermal growth factor (EGF)-induced chemotaxis. When introduced as a minigene by retroviral transduction into human breast carcinoma cells, this inhibitor caused a striking reduction in chemotaxis towards an EGF gradient. Taken together, these findings identify a direct link between PKC alpha and beta 1 integrin that is critical for directed tumor cell migration. Importantly, our findings outline a new concept as to how carcinoma cell chemotaxis is enhanced and provide a conceptual basis for interfering with tumor cell dissemination.     

Structural insights into the inhibition of cytosolic 5'-nucleotidase II (cN-II) by ribonucleoside 5'-monophosphate analogues

Cytosolic 5'-nucleotidase II (cN-II) regulates the intracellular nucleotide pools within the cell by catalyzing the dephosphorylation of 6-hydroxypurine nucleoside 5'-monophosphates. Beside this physiological function, high level of cN-II expression is correlated with abnormal patient outcome when treated with cytotoxic nucleoside analogues. To identify its specific role in the resistance phenomenon observed during cancer therapy, we screened a particular class of chemical compounds, namely ribonucleoside phosphonates to predict them as potential cN-II inhibitors. These compounds incorporate a chemically and enzymatically stable phosphorus-carbon linkage instead of a regular phosphoester bond. Amongst them, six compounds were predicted as better ligands than the natural substrate of cN-II, inosine 5'-monophosphate (IMP). The study of purine and pyrimidine containing analogues and the introduction of chemical modifications within the phosphonate chain has allowed us to define general rules governing the theoretical affinity of such ligands. The binding strength of these compounds was scrutinized in silico and explained by an impressive number of van der Waals contacts, highlighting the decisive role of three cN-II residues that are Phe 157, His 209 and Tyr 210. Docking predictions were confirmed by experimental measurements of the nucleotidase activity in the presence of the three best available phosphonate analogues. These compounds were shown to induce a total inhibition of the cN-II activity at 2 mM. Altogether, this study emphasizes the importance of the non-hydrolysable phosphonate bond in the design of new competitive cN-II inhibitors and the crucial hydrophobic stacking promoted by three protein residues.     

Dynamic proton-dependent motors power type IX secretion and gliding motility in Flavobacterium

Motile bacteria usually rely on external apparatus like flagella for swimming or pili for twitching. By contrast, gliding bacteria do not rely on obvious surface appendages to move on solid surfaces. Flavobacterium johnsoniae and other bacteria in the Bacteroidetes phylum use adhesins whose movement on the cell surface supports motility. In F. johnsoniae, secretion and helicoidal motion of the main adhesin SprB are intimately linked and depend on the type IX secretion system (T9SS). Both processes necessitate the proton motive force (PMF), which is thought to fuel a molecular motor that comprises the GldL and GldM cytoplasmic membrane proteins. Here, we show that F. johnsoniae gliding motility is powered by the pH gradient component of the PMF. We further delineate the interaction network between the GldLM transmembrane helices (TMHs) and show that conserved glutamate residues in GldL TMH2 are essential for gliding motility, although having distinct roles in SprB secretion and motion. We then demonstrate that the PMF and GldL trigger conformational changes in the GldM periplasmic domain. We finally show that multiple GldLM complexes are distributed in the membrane, suggesting that a network of motors may be present to move SprB along a helical path on the cell surface. Altogether, our results provide evidence that GldL and GldM assemble dynamic membrane channels that use the proton gradient to power both T9SS-dependent secretion of SprB and its motion at the cell surface.

Motile bacteria usually rely on external apparatus like flagella or pili, but gliding bacteria do not rely on obvious surface appendages for their movement. This study shows that bacteria in the phylum Bacteroidetes use proton-dependent motors to power protein secretion and gliding motility.     

Quantifying Translocation of Listeria monocytogenes in Rats by Using Urinary Nitric Oxide-Derived Metabolites

The urinary nitric oxide metabolites NO₂⁻ and NO₃⁻ (summed as NO_x) are a noninvasive, quantitative biomarker of translocation of salmonella from the intestinal lumen to systemic organs. Listeria monocytogenes is a food-borne gram-positive pathogen that can also cross the intestinal epithelium. In this study, we tested the efficacy of urinary NO_x as a marker of listeria translocation. Rats (eight per group) were orally infected with increasing doses of L. monocytogenes; control rats received heat-killed listeria. The kinetics of urinary NO_x and population levels of listeria in feces were determined for 7 days. Another group of rats was killed 1 day after infection to verify translocation by culturing viable listeria from systemic organs. Oral administration of increasing doses of L. monocytogenes resulted in a time- and dose-dependent increase in urinary NO_x excretion. Translocation was a prerequisite for inducing a NO_x response, since heat-killed L. monocytogenes did not elevate NO_x excretion in urine. Fecal counts of listeria also showed dose and time dependency. Moreover, the number of viable L. monocytogenes cells in mesenteric lymph nodes also increased in a dose-dependent manner and correlated with urinary NO_x. In conclusion, urinary NO_x is a quantitative, noninvasive biomarker of listeria translocation.