Using a Web-Based Application to Define the Accuracy of Diagnostic Tests When the Gold Standard Is Imperfect

Background

Estimates of the sensitivity and specificity for new diagnostic tests based on evaluation against a known gold standard are imprecise when the accuracy of the gold standard is imperfect. Bayesian latent class models (LCMs) can be helpful under these circumstances, but the necessary analysis requires expertise in computational programming. Here, we describe open-access web-based applications that allow non-experts to apply Bayesian LCMs to their own data sets via a user-friendly interface.

Methods/Principal Findings

Applications for Bayesian LCMs were constructed on a web server using R and WinBUGS programs. The models provided (http://mice.tropmedres.ac) include two Bayesian LCMs: the two-tests in two-population model (Hui and Walter model) and the three-tests in one-population model (Walter and Irwig model). Both models are available with simplified and advanced interfaces. In the former, all settings for Bayesian statistics are fixed as defaults. Users input their data set into a table provided on the webpage. Disease prevalence and accuracy of diagnostic tests are then estimated using the Bayesian LCM, and provided on the web page within a few minutes. With the advanced interfaces, experienced researchers can modify all settings in the models as needed. These settings include correlation among diagnostic test results and prior distributions for all unknown parameters. The web pages provide worked examples with both models using the original data sets presented by Hui and Walter in 1980, and by Walter and Irwig in 1988. We also illustrate the utility of the advanced interface using the Walter and Irwig model on a data set from a recent melioidosis study. The results obtained from the web-based applications were comparable to those published previously.

Conclusions

The newly developed web-based applications are open-access and provide an important new resource for researchers worldwide to evaluate new diagnostic tests.     

Public Awareness of Melioidosis in Thailand and Potential Use of Video Clips as Educational Tools

Background

Melioidosis causes more than 1,000 deaths in Thailand each year. Infection occurs via inoculation, ingestion or inhalation of the causative organism (Burkholderia pseuodmallei) present in soil and water. Here, we evaluated public awareness of melioidosis using a combination of population-based questionnaire, a public engagement campaign to obtain video clips made by the public, and viewpoints on these video clips as potential educational tools about the disease and its prevention.

Methods

A questionnaire was developed to evaluate public awareness of melioidosis, and knowledge about its prevention. From 1 March to 31 April 2012, the questionnaire was delivered to five randomly selected adults in each of 928 districts in Thailand. A video clip contest entitled “Melioidosis, an infectious disease that Thais must know” was run between May and October 2012. The best 12 video clips judged by a contest committee were shown to 71 people at risk from melioidosis (diabetics). Focus group interviews were used to evaluate their perceptions of the video clips.

Results

Of 4,203 Thais who completed our study questionnaire, 74% had never heard of melioidosis, and 19% had heard of the disease but had no further knowledge. Most participants in all focus group sessions felt that video clips were beneficial and could positively influence them to increase adherence to recommended preventive behaviours, including drinking boiled water and wearing protective gear if in contact with soil or environmental water. Participants suggested that video clips should be presented in the local dialect with simple words rather than medical terms, in a serious manner, with a doctor as the one presenting the facts, and having detailed pictures of each recommended prevention method.

Conclusions

In summary, public awareness of melioidosis in Thailand is very low, and video clips could serve as a useful medium to educate people and promote disease prevention.

Presented in Part

World Melioidosis Congress 2013, Bangkok, Thailand, 18–20 September 2013 (abstract OS VII-04).