The Use of Bayesian Networks to Assess the Quality of Evidence from Research Synthesis: 2. Inter-Rater Reliability and Comparison with Standard GRADE Assessment

Background

The grades of recommendation, assessment, development and evaluation (GRADE) approach is widely implemented in systematic reviews, health technology assessment and guideline development organisations throughout the world. We have previously reported on the development of the Semi-Automated Quality Assessment Tool (SAQAT), which enables a semi-automated validity assessment based on GRADE criteria. The main advantage to our approach is the potential to improve inter-rater agreement of GRADE assessments particularly when used by less experienced researchers, because such judgements can be complex and challenging to apply without training. This is the first study examining the inter-rater agreement of the SAQAT.

Methods

We conducted two studies to compare: a) the inter-rater agreement of two researchers using the SAQAT independently on 28 meta-analyses and b) the inter-rater agreement between a researcher using the SAQAT (who had no experience of using GRADE) and an experienced member of the GRADE working group conducting a standard GRADE assessment on 15 meta-analyses.

Results

There was substantial agreement between independent researchers using the Quality Assessment Tool for all domains (for example, overall GRADE rating: weighted kappa 0.79; 95% CI 0.65 to 0.93). Comparison between the SAQAT and a standard GRADE assessment suggested that inconsistency was parameterised too conservatively by the SAQAT. Therefore the tool was amended. Following amendment we found fair-to-moderate agreement between the standard GRADE assessment and the SAQAT (for example, overall GRADE rating: weighted kappa 0.35; 95% CI 0.09 to 0.87).

Conclusions

Despite a need for further research, the SAQAT may aid consistent application of GRADE, particularly by less experienced researchers.     

Non-pertussis components of combination vaccines: problems with potency testing.

Vaccines comprising combinations of diphtheria, tetanus and pertussis (DTP) with Haemophilus influenzae type b polysaccharide-protein conjugate (Hib), inactivated poliomyelitis virus (IPV) and hepatitis B virus (HBV) are already available, and new combinations using acellular pertussis components in a triple vaccine (DTaP) are under development. Evidence to date has shown that control of the efficacy, safety and stability of combination vaccines cannot be based on information already available on the individual components or existing licensed formulations. Several examples of immunological interference between components of a combination vaccine have been observed both in clinical trials and in laboratory tests. Examples of these for D, T and Hib components in DTP and DTaP combinations have been investigated.     

Inducibility of the response of yeast cells to peroxide stress.

Exponential phase cells of the yeast, Saccharomyces cerevisiae when treated with a non-lethal concentration of hydrogen peroxide (H2O2; 0.2mM) for 60 min adapted to become resistant to the lethal effects of a higher dose of H2O2 (2mM). From studies using cycloheximide to inhibit protein synthesis it appears that protein synthesis is required for maximal induction of resistance but that some degree of protection from the lethal effects of peroxide can be acquired in the absence of protein synthesis. Treatment of cells with 50 micrograms cycloheximide ml-1 alone lead to them acquiring some protection from peroxide. Cells subjected to heat shock became more resistant to 2mM-H2O2; however, peroxide pretreatment did not confer thermotolerance. L-[35S]Methionine labelling of cells subjected to 0.2 mM-H2O2 stress showed that synthesis of at least ten polypeptides was induced by peroxide treatment. Some of these were also induced in cells subjected to heat shock (23 to 37 degrees C shift) but the synthesis of at least four polypeptides (45, 39.5, 38 and 24 kDa) was unique to peroxide-stressed cells. Resistance to peroxide was also inducible in an isogenic petite and an isogenic strain with a mutation in the HAP1 gene, indicating that the adaptive response does not require functional mitochondria.     

Application of genome-wide expression analysis to identify molecular markers useful in monitoring industrial fermentations

Genome-wide expression analysis of an industrial strain of Saccharomyces cerevisiae identified the YOR387c and YGL258w homologues as highly inducible in zinc-depleted conditions. Induction was specific for zinc deficiency and was dependent on Zap1p. The results indicate that these sequences may be valuable molecular markers for detecting zinc deficiency in industrial fermentations.     

Whole plant response of Pongamia pinnata to drought stress tolerance revealed by morpho-physiological,biochemical and transcriptome analysis

Molecular Biology Reports - Pongamia is considered an important biofuel species worldwide. Drought stress in the early growth stages of Pongamia influences negatively on the germination and...     

Does Mangrove Leaf Chemistry Help Explain Crab Herbivory Patterns?

We examined feeding by the mangrove tree crab Aratus pisonii in Tampa Bay, Florida, in relation to the percent dry weight of carbohydrate, protein, phenolics, condensed tannins, ash, carbon, nitrogen, carbonmitrogen ratio, water content, and sclerophylly for leaves of the red mangrove Rhizophora mangle. Comparisons of leaf chemistry were made among leaves that experienced variable levels of crab damage. Because R. mangle is the crab's preferred food source based on damage patterns in the field, comparisons of R. mangle leaf chemistry were made in relation to that of the black mangrove Avicennia germinans and the white mangrove Laguncularia racemosa. We observed a negative relationship between level of leaf damage and percent dry weight of nitrogen, carbohydrates, condensed tannins, and sclerophylly. In contrast, a positive relationship was found between leaf damage and the carbon:nitrogen ratio. The chemical constituents that provided the best explanation for differences in damage among the three mangrove species include condensed tannins, nitrogen, carbon:nitrogen ratio, carbohydrates, phenolics, water content, and ash. The results from this study suggest that chemistry only partially explains food preference by A. pisonii. It appears that A. pisonii feeding behavior and preference may be influenced by a more complex series of factors and interactions, which may include reproduction by, predation on, and interspecific competition with A. pisonii.