How to Determine the Accuracy of an Alternative Diagnostic Test when It Is Actually Better than the Reference Tests: A Re-Evaluation of Diagnostic Tests for Scrub Typhus Using Bayesian LCMs

BackgroundThe indirect immunofluorescence assay (IFA) is considered a reference test for scrub typhus. Recently, the Scrub Typhus Infection Criteria (STIC; a combination of culture, PCR assays and IFA IgM) were proposed as a reference standard for evaluating alternative diagnostic tests. Here, we use Bayesian latent class models (LCMs) to estimate the true accuracy of each diagnostic test, and of STIC, for diagnosing scrub typhus.ConclusionsThe low specificity of STIC was caused by the low specificity of IFA IgM. Neither STIC nor IFA IgM can be used as reference standards against which to evaluate alternative diagnostic tests. Further evaluation of new diagnostic tests should be done with a carefully selected set of diagnostic tests and appropriate statistical models.     

Development and validation of Burkholderia pseudomallei-specific real-time PCR assays for clinical, environmental or forensic detection applications

The bacterium Burkholderia pseudomallei causes melioidosis, a rare but serious illness that can be fatal if untreated or misdiagnosed. Species-specific PCR assays provide a technically simple method for differentiating B. pseudomallei from near-neighbor species. However, substantial genetic diversity and high levels of recombination within this species reduce the likelihood that molecular signatures will differentiate all B. pseudomallei from other Burkholderiaceae. Currently available molecular assays for B. pseudomallei detection lack rigorous validation across large in silico datasets and isolate collections to test for specificity, and none have been subjected to stringent quality control criteria (accuracy, precision, selectivity, limit of quantitation (LoQ), limit of detection (LoD), linearity, ruggedness and robustness) to determine their suitability for environmental, clinical or forensic investigations. In this study, we developed two novel B. pseudomallei specific assays, 122018 and 266152, using a dual-probe approach to differentiate B. pseudomallei from B. thailandensis, B. oklahomensis and B. thailandensis-like species; other species failed to amplify. Species specificity was validated across a large DNA panel (>2,300 samples) comprising Burkholderia spp. and non-Burkholderia bacterial and fungal species of clinical and environmental relevance. Comparison of assay specificity to two previously published B. pseudomallei-specific assays, BurkDiff and TTS1, demonstrated comparable performance of all assays, providing between 99.7 and 100% specificity against our isolate panel. Last, we subjected 122018 and 266152 to rigorous quality control analyses, thus providing quantitative limits of assay performance. Using B. pseudomallei as a model, our study provides a framework for comprehensive quantitative validation of molecular assays and provides additional, highly validated B. pseudomallei assays for the scientific research community.     

Arthropod borne disease: the leading cause of fever in pregnancy on the Thai-Burmese border

Background

Fever in pregnancy is dangerous for both mother and foetus. In the 1980''s malaria was the leading cause of death in pregnant women in refugee camps on the Thai-Burmese border. Artemisinin combination therapy has significantly reduced the incidence of malaria in the population. The remaining causes of fever in pregnancy are not well documented.

Methodology

Pregnant women attending antenatal care, where weekly screening for malaria is routine, were invited to have a comprehensive clinical and laboratory screen if they had fever. Women were admitted to hospital, treated and followed up weekly until delivery. A convalescent serum was collected on day 21. Delivery outcomes were recorded.

Principal Findings

Febrile episodes (n = 438) occurred in 5.0% (409/8,117) of pregnant women attending antenatal clinics from 7-Jan-2004 to 17-May-2006. The main cause was malaria in 55.5% (227/409). A cohort of 203 (49.6% of 409) women had detailed fever investigations and follow up. Arthropod-borne (malaria, rickettsial infections, and dengue) and zoonotic disease (leptospirosis) accounted for nearly half of all febrile illnesses, 47.3% (96/203). Coinfection was observed in 3.9% (8/203) of women, mostly malaria and rickettsia. Pyelonephritis, 19.7% (40/203), was also a common cause of fever. Once malaria, pyelonephritis and acute respiratory illness are excluded by microscopy and/or clinical findings, one-third of the remaining febrile infections will be caused by rickettsia or leptospirosis. Scrub and murine typhus were associated with poor pregnancy outcomes including stillbirth and low birth weight. One woman died (no positive laboratory tests).

Conclusion/Significance

Malaria remains the leading cause of fever in pregnancy on the Thai-Burmese border. Scrub and murine typhus were also important causes of fever associated with poor pregnancy outcomes. Febrile pregnant women on the Thai-Burmese border who do not have malaria, pyelonephritis or respiratory tract infection should be treated with azithromycin, effective for typhus and leptospirosis.     

Application of carbohydrate microarray technology for the detection of Burkholderia pseudomallei, Bacillus anthracis and Francisella tularensis antibodies

We developed a microarray platform by immobilizing bacterial 'signature' carbohydrates onto epoxide modified glass slides. The carbohydrate microarray platform was probed with sera from non-melioidosis and melioidosis (Burkholderia pseudomallei) individuals. The platform was also probed with sera from rabbits vaccinated with Bacillus anthracis spores and Francisella tularensis bacteria. By employing this microarray platform, we were able to detect and differentiate B. pseudomallei, B. anthracis and F. tularensis antibodies in infected patients, and infected or vaccinated animals. These antibodies were absent in the sera of na?ve test subjects. The advantages of the carbohydrate microarray technology over the traditional indirect hemagglutination and microagglutination tests for the serodiagnosis of melioidosis and tularemia are discussed. Furthermore, this array is a multiplex carbohydrate microarray for the detection of all three biothreat bacterial infections including melioidosis, anthrax and tularemia with one, multivalent device. The implication is that this technology could be expanded to include a wide array of infectious and biothreat agents.     

IFN-gamma at the site of infection determines rate of clearance of infection in cryptococcal meningitis

In animal models, immunity to cryptococcal infection, as in many chronic fungal and bacterial infections, is associated with a granulomatous inflammatory response, intact cell-mediated immunity, and a Th1 pattern of cytokine release. To examine the correlates of human immunity to cryptococcal infection in vivo, we analyzed immune parameters at the site of infection over time and assessed the rate of clearance of infection by serial quantitative cerebrospinal fluid (CSF) fungal cultures in 62 patients in a trial of antifungal therapy for HIV-associated cryptococcal meningitis. CSF IL-6, IFN-gamma, TNF-alpha, and IL-8 were significantly higher in survivors compared with nonsurvivors. There were negative correlations between log TNF-alpha, IFN-gamma, and IL-6 levels and baseline cryptococcal CFU. Log IFN-gamma, G-CSF, TNF-alpha, and IL-6 were correlated positively with the rate of fall in log CFU/ml CSF/day. In a linear regression model including antifungal treatment group, baseline CFU, and these cytokines, only treatment group and log IFN-gamma remained independently associated with rate of clearance of infection. The results provide direct in vivo evidence for the importance of quantitative differences in IFN-gamma secretion in human immune control of granulomatous infections, and increase the rationale for adjunctive IFN-gamma in the treatment of refractory HIV-associated cryptococcosis.     

A dominant clone of Leptospira interrogans associated with an outbreak of human leptospirosis in Thailand

Background

A sustained outbreak of leptospirosis occurred in northeast Thailand between 1999 and 2003, the basis for which was unknown.

Methods and Findings

A prospective study was conducted between 2000 and 2005 to identify patients with leptospirosis presenting to Udon Thani Hospital in northeast Thailand, and to isolate the causative organisms from blood. A multilocus sequence typing scheme was developed to genotype these pathogenic Leptospira. Additional typing was performed for Leptospira isolated from human cases in other Thai provinces over the same period, and from rodents captured in the northeast during 2004. Sequence types (STs) were compared with those of Leptospira drawn from a reference collection. Twelve STs were identified among 101 isolates from patients in Udon Thani. One of these (ST34) accounted for 77 (76%) of isolates. ST34 was Leptospira interrogans, serovar Autumnalis. 86% of human Leptospira isolates from Udon Thani corresponded to ST34 in 2000/2001, but this figure fell to 56% by 2005 as the outbreak waned (p = 0.01). ST34 represented 17/24 (71%) of human isolates from other Thai provinces, and 7/8 (88%) rodent isolates. By contrast, 59 STs were found among 76 reference strains, indicating a much more diverse population genetic structure; ST34 was not identified in this collection.

Conclusions

Development of an MLST scheme for Leptospira interrogans revealed that a single ecologically successful pathogenic clone of L. interrogans predominated in the rodent population, and was associated with a sustained outbreak of human leptospirosis in Thailand.     

Molecular typing of Leptospira spp. based on putative O-antigen polymerase gene (wzy), the benefit over 16S rRNA gene sequence

Molecular typing of leptospiral strains based on variation within putative O-antigen polymerase gene (wzy) was determined among reference strains and those isolated from patients. Using the PCR primers designed from the flanking gene of wzy derived from Leptospira interrogans serovar Copenhageni, all L. interrogans serovars as well as human and rodent leptospiral isolates from Thailand could be amplified. The size of PCR product ranged from 1 to 1.5 kb. The limitation of these primer pairs was the inability to amplify those strains whose sequences differ in the region of the primers, these included Leptospira biflexa (serovar Patoc), Leptospira borgpetersenii (serovar Tarassovi) and Leptospira kirschneri (serovar Bim, Bulgarica, Butembo). Notably, amplification was not limited to L. interrogans as demonstrated by the amplification of some strains from L. kirschneri, Leptospira meyeri, Leptospira noguchii, Leptospira santarosai, L. borgpetersenii and Leptospira weilii. The phylogenetic tree of wzy sequence, inferred by posterior probability of the Bayesian, enabled the categorization of leptospiral serovars into seven genetically related group, of which its differentiation power was better than that of the more highly conserved 16S rRNA gene, which is used extensively for genotyping.     

Multiple phylogenetically-diverse,differentially-virulent Burkholderia pseudomallei isolated from a single soil sample collected in Thailand

Burkholderia pseudomallei is a soil-dwelling bacterium endemic to Southeast Asia and northern Australia that causes the disease, melioidosis. Although the global genomic diversity of clinical B. pseudomallei isolates has been investigated, there is limited understanding of its genomic diversity across small geographic scales, especially in soil. In this study, we obtained 288 B. pseudomallei isolates from a single soil sample (~100g; intensive site 2, INT2) collected at a depth of 30cm from a site in Ubon Ratchathani Province, Thailand. We sequenced the genomes of 169 of these isolates that represent 7 distinct sequence types (STs), including a new ST (ST1820), based on multi-locus sequence typing (MLST) analysis. A core genome SNP phylogeny demonstrated that all identified STs share a recent common ancestor that diverged an estimated 796–1260 years ago. A pan-genomics analysis demonstrated recombination between clades and intra-MLST phylogenetic and gene differences. To identify potential differential virulence between STs, groups of BALB/c mice (5 mice/isolate) were challenged via subcutaneous injection (500 CFUs) with 30 INT2 isolates representing 5 different STs; over the 21-day experiment, eight isolates killed all mice, 2 isolates killed an intermediate number of mice (1–2), and 20 isolates killed no mice. Although the virulence results were largely stratified by ST, one virulent isolate and six attenuated isolates were from the same ST (ST1005), suggesting that variably conserved genomic regions may contribute to virulence. Genomes from the animal-challenged isolates were subjected to a bacterial genome-wide association study to identify genomic regions associated with differential virulence. One associated region is a unique variant of Hcp1, a component of the type VI secretion system, which may result in attenuation. The results of this study have implications for comprehensive sampling strategies, environmental exposure risk assessment, and understanding recombination and differential virulence in B. pseudomallei.     

Evaluation of antigen-detecting and antibody-detecting diagnostic test combinations for diagnosing melioidosis

BackgroundMelioidosis, an infectious disease caused by Burkholderia pseudomallei, is endemic in many tropical developing countries and has a high mortality. Here we evaluated combinations of a lateral flow immunoassay (LFI) detecting B. pseudomallei capsular polysaccharide (CPS) and enzyme-linked immunosorbent assays (ELISA) detecting antibodies against hemolysin co-regulated protein (Hcp1) or O-polysaccharide (OPS) for diagnosing melioidosis.Methodology/Principal findingsWe conducted a cohort-based case-control study. Both cases and controls were derived from a prospective observational study of patients presenting with community-acquired infections and sepsis in northeast Thailand (Ubon-sepsis). Cases included 192 patients with a clinical specimen culture positive for B. pseudomallei. Controls included 502 patients who were blood culture positive for Staphylococcus aureus, Escherichia coli or Klebsiella pneumoniae or were polymerase chain reaction assay positive for malaria or dengue. Serum samples collected within 24 hours of admission were stored and tested using a CPS-LFI, Hcp1-ELISA and OPS-ELISA. When assessing diagnostic tests in combination, results were considered positive if either test was positive. We selected ELISA cut-offs corresponding to a specificity of 95%. Using a positive cut-off OD of 2.912 for Hcp1-ELISA, the combination of the CPS-LFI and Hcp1-ELISA had a sensitivity of 67.7% (130/192 case patients) and a specificity of 95.0% (477/502 control patients). The sensitivity of the combination (67.7%) was higher than that of the CPS-LFI alone (31.3%, p<0.001) and that of Hcp1-ELISA alone (53.6%, p<0.001). A similar phenomenon was also observed for the combination of CPS-LFI and OPS-ELISA. In case patients, positivity of the CPS-LFI was associated with a short duration of symptoms, high modified Sequential (sepsis-related) Organ Failure Assessment (SOFA) score, bacteraemia and mortality outcome, while positivity of Hcp1-ELISA was associated with a longer duration of symptoms, low modified SOFA score, non-bacteraemia and survival outcome.Conclusions/SignificanceA combination of antigen-antibody diagnostic tests increased the sensitivity of melioidosis diagnosis over individual tests while preserving high specificity. Point-of-care tests for melioidosis based on the use of combination assays should be further developed and evaluated.