Publication: How to determine the accuracy of an alternative diagnostic test when it is actually better than the reference tests: A re-evaluation of diagnostic tests for scrub typhus using Bayesian LCMs
Issued Date
2015-05-29
Resource Type
ISSN
19326203
Other identifier(s)
2-s2.0-84934924882
Rights
Mahidol University
Rights Holder(s)
SCOPUS
Bibliographic Citation
PLoS ONE. Vol.10, No.5 (2015)
Suggested Citation
Cherry Lim, Daniel H. Paris, Stuart D. Blacksell, Achara Laongnualpanich, Pacharee Kantipong, Wirongrong Chierakul, Vanaporn Wuthiekanun, Nicholas P.J. Day, Ben S. Cooper, Direk Limmathurotsakul How to determine the accuracy of an alternative diagnostic test when it is actually better than the reference tests: A re-evaluation of diagnostic tests for scrub typhus using Bayesian LCMs. PLoS ONE. Vol.10, No.5 (2015). doi:10.1371/journal.pone.0114930 Retrieved from: https://repository.li.mahidol.ac.th/handle/123456789/35156
Research Projects
Organizational Units
Authors
Journal Issue
Thesis
Title
How to determine the accuracy of an alternative diagnostic test when it is actually better than the reference tests: A re-evaluation of diagnostic tests for scrub typhus using Bayesian LCMs
Other Contributor(s)
Abstract
Background: The indirect immunofluorescence assay (IFA) is considered a reference test for scrub typhus. Recently, the Scrub Typhus Infection Criteria (STIC; a combination of culture, PCR assays and IFA IgM) were proposed as a reference standard for evaluating alternative diagnostic tests. Here, we use Bayesian latent class models (LCMs) to estimate the true accuracy of each diagnostic test, and of STIC, for diagnosing scrub typhus. Methods/Principal Findings: Data from 161 patients with undifferentiated fever were re-evaluated using Bayesian LCMs. Every patient was evaluated for the presence of an eschar, and tested with blood culture for Orientia tsutsugamushi, three different PCR assays, IFA IgM, and the Panbio IgM immunochromatographic test (ICT). True sensitivity and specificity of culture (24.4% and 100%), 56kDa PCR assay (56.8% and 98.4%), 47kDa PCR assay (63.2% and 96.1%), groEL PCR assay (71.4% and 93.0%), IFA IgM (70.0% and 83.8%), PanBio IgM ICT (72.8% and 96.8%), presence of eschar (42.7% and 98.9%) and STIC (90.5% and 82.5%) estimated by Bayesian LCM were considerably different from those obtained when using STIC as a reference standard. The IgM ICT had comparable sensitivity and significantly higher specificity compared to IFA (p=0.34 and p<0.001, respectively). Conclusions: The low specificity of STIC was caused by the low specificity of IFA IgM. Neither STIC nor IFA IgM can be used as reference standards against which to evaluate alternative diagnostic tests. Further evaluation of new diagnostic tests should be done with a carefully selected set of diagnostic tests and appropriate statistical models.