Publication:
Selective cutoff reporting in studies of the accuracy of the Patient Health Questionnaire-9 and Edinburgh Postnatal Depression Scale: Comparison of results based on published cutoffs versus all cutoffs using individual participant data meta-analysis

Issued Date

2021-09-01

Resource Type

Article

ISSN

15570657
10498931

DOI

10.1002/mpr.1873

Other identifier(s)

2-s2.0-85115048600

Rights

Mahidol University

Rights Holder(s)

SCOPUS

Bibliographic Citation

International Journal of Methods in Psychiatric Research. Vol.30, No.3 (2021)

Suggested Citation

Dipika Neupane, Brooke Levis, Parash M. Bhandari, Brett D. Thombs, Andrea Benedetti, Ying Sun, Chen He, Yin Wu, Ankur Krishnan, Zelalem Negeri, Mahrukh Imran, Danielle B. Rice, Kira E. Riehm, Nazanin Saadat, Marleine Azar, Tatiana A. Sanchez, Matthew J. Chiovitti, Alexander W. Levis, Jill T. Boruff, Pim Cuijpers, Simon Gilbody, John P.A. Ioannidis, Lorie A. Kloda, Scott B. Patten, Ian Shrier, Roy C. Ziegelstein, Liane Comeau, Nicholas D. Mitchell, Marcello Tonelli, Simone N. Vigod, Dickens H. Akena, Rubén Alvarado, Bruce Arroll, Muideen O. Bakare, Hamid R. Baradaran, Cheryl Tatano Beck, Charles H. Bombardier, Adomas Bunevicius, Gregory Carter, Marcos H. Chagas, Linda H. Chaudron, Rushina Cholera, Kerrie Clover, Yeates Conwell, Tiago Castro e Couto, Janneke M. de Man-van Ginkel, Jaime Delgadillo, Jesse R. Fann, Nicolas Favez, Daniel Fung, Lluïsa Garcia-Esteve, Bizu Gelaye, Felicity Goodyear-Smith, Thomas Hyphantis, Masatoshi Inagaki, Khalida Ismail, Nathalie Jetté, Dina Sami Khalifa, Mohammad E. Khamseh, Jane Kohlhoff, Zoltán Kozinszky, Laima Kusminskas, Shen Ing Liu, Manote Lotrakul, Sonia R. Loureiro, Bernd Löwe, Sherina Mohd Sidik, Sandra Nakić Radoš, Flávia L. Osório, Susan J. Pawlby, Brian W. Pence, Tamsen J. Rochat, Alasdair G. Rooney, Deborah J. Sharp, Lesley Stafford, Kuan Pin Su, Sharon C. Sung, Meri Tadinac, S. Darius Tandon, Pavaani Thiagayson, Annamária Töreki, Anna Torres-Giménez, Alyna Turner, Christina M. van der Feltz-Cornelis, Johann M. Vega-Dienstmaier, Paul A. Vöhringer, Jennifer White, Mary A. Whooley, Kirsty Winkley, Mitsuhiko Yamada Selective cutoff reporting in studies of the accuracy of the Patient Health Questionnaire-9 and Edinburgh Postnatal Depression Scale: Comparison of results based on published cutoffs versus all cutoffs using individual participant data meta-analysis. International Journal of Methods in Psychiatric Research. Vol.30, No.3 (2021). doi:10.1002/mpr.1873 Retrieved from: https://repository.li.mahidol.ac.th/handle/20.500.14594/77887

Research Projects

Organizational Units

Authors

Journal Issue

Thesis

Title

Selective cutoff reporting in studies of the accuracy of the Patient Health Questionnaire-9 and Edinburgh Postnatal Depression Scale: Comparison of results based on published cutoffs versus all cutoffs using individual participant data meta-analysis

Author(s)

Dipika Neupane
 Brooke Levis
 Parash M. Bhandari
 Brett D. Thombs
 Andrea Benedetti
 Ying Sun
 Chen He
 Yin Wu
 Ankur Krishnan
 Zelalem Negeri
 Mahrukh Imran
 Danielle B. Rice
 Kira E. Riehm
 Nazanin Saadat
 Marleine Azar
 Tatiana A. Sanchez
 Matthew J. Chiovitti
 Alexander W. Levis
 Jill T. Boruff
 Pim Cuijpers
 Simon Gilbody
 John P.A. Ioannidis
 Lorie A. Kloda
 Scott B. Patten
 Ian Shrier
 Roy C. Ziegelstein
 Liane Comeau
 Nicholas D. Mitchell
 Marcello Tonelli
 Simone N. Vigod
 Dickens H. Akena
 Rubén Alvarado
 Bruce Arroll
 Muideen O. Bakare
 Hamid R. Baradaran
 Cheryl Tatano Beck
 Charles H. Bombardier
 Adomas Bunevicius
 Gregory Carter
 Marcos H. Chagas
 Linda H. Chaudron
 Rushina Cholera
 Kerrie Clover
 Yeates Conwell
 Tiago Castro e Couto
 Janneke M. de Man-van Ginkel
 Jaime Delgadillo
 Jesse R. Fann
 Nicolas Favez
 Daniel Fung
 Lluïsa Garcia-Esteve
 Bizu Gelaye
 Felicity Goodyear-Smith
 Thomas Hyphantis
 Masatoshi Inagaki
 Khalida Ismail
 Nathalie Jetté
 Dina Sami Khalifa
 Mohammad E. Khamseh
 Jane Kohlhoff
 Zoltán Kozinszky
 Laima Kusminskas
 Shen Ing Liu
 Manote Lotrakul
 Sonia R. Loureiro
 Bernd Löwe
 Sherina Mohd Sidik
 Sandra Nakić Radoš
 Flávia L. Osório
 Susan J. Pawlby
 Brian W. Pence
 Tamsen J. Rochat
 Alasdair G. Rooney
 Deborah J. Sharp
 Lesley Stafford
 Kuan Pin Su
 Sharon C. Sung
 Meri Tadinac
 S. Darius Tandon
 Pavaani Thiagayson
 Annamária Töreki
 Anna Torres-Giménez
 Alyna Turner
 Christina M. van der Feltz-Cornelis
 Johann M. Vega-Dienstmaier
 Paul A. Vöhringer
 Jennifer White
 Mary A. Whooley
 Kirsty Winkley
 Mitsuhiko Yamada

Other Contributor(s)

Ramathibodi Hospital
 Makerere University College of Health Sciences
 School of Medicine
 School of Medicine and Public Health
 Bristol Medical School
 Lietuvos sveikatos mokslų universitetas
 Duke-NUS Medical School
 Universidad Peruana Cayetano Heredia, Facultad de Medicina Alberto Hurtado
 University of New South Wales Faculty of Medicine, School of Psychiatry
 University of the Witwatersrand Faculty of Health Sciences
 Concordia University
 Stanford University School of Medicine
 University Medical Center Utrecht
 Royal Women's Hospital, Carlton
 Harvard T.H. Chan School of Public Health
 China Medical University Hospital
 University of Alberta
 Hospital Clinic Barcelona
 McGill Faculty of Medicine and Health Sciences
 Faculty of Medicine
 Szegedi Tudományegyetem (SZTE)
 The University of Edinburgh
 Danderyds Sjukhus
 Universiti Putra Malaysia
 The University of North Carolina at Chapel Hill
 Iran University of Medical Sciences
 University of Rochester Medical Center
 University of California, San Francisco
 Lady Davis Institute for Medical Research
 Monash University
 Keele University, School of Medicine
 National Center of Neurology and Psychiatry Kodaira
 University of Newcastle, Faculty of Health and Medicine
 University of Toronto
 University of York
 University of Washington
 Universidade Federal de Uberlândia
 Northwestern University Feinberg School of Medicine
 University of Rochester School of Medicine and Dentistry
 Hospital Clínico Universidad De Chile
 King's College London
 University of Montreal
 Singapore Institute of Mental Health
 Shimane University Faculty of Medicine
 University of Zagreb
 School of Nursing
 Universidade de São Paulo
 Centre Universitaire de Santé McGill
 The University of Auckland
 Duke University School of Medicine
 Universitätsklinikum Hamburg-Eppendorf
 Université de Genève
 Medisinske Fakultet
 Facultad de Medicina de la Universidad de Chile
 Université McGill
 Universiteit van Amsterdam
 University of Calgary
 The University of Sheffield
 Johns Hopkins School of Medicine
 Cumming School of Medicine
 Private Practice
 Federal Neuropsychiatric Hospital
 Catholic University of Croatia

Abstract

Objectives: Selectively reported results from only well-performing cutoffs in diagnostic accuracy studies may bias estimates in meta-analyses. We investigated cutoff reporting patterns for the Patient Health Questionnaire-9 (PHQ-9; standard cutoff 10) and Edinburgh Postnatal Depression Scale (EPDS; no standard cutoff, commonly used 10–13) and compared accuracy estimates based on published cutoffs versus all cutoffs. Methods: We conducted bivariate random effects meta-analyses using individual participant data to compare accuracy from published versus all cutoffs. Results: For the PHQ-9 (30 studies, N = 11,773), published results underestimated sensitivity for cutoffs below 10 (median difference: −0.06) and overestimated for cutoffs above 10 (median difference: 0.07). EPDS (19 studies, N = 3637) sensitivity estimates from published results were similar for cutoffs below 10 (median difference: 0.00) but higher for cutoffs above 13 (median difference: 0.14). Specificity estimates from published and all cutoffs were similar for both tools. The mean cutoff of all reported cutoffs in PHQ-9 studies with optimal cutoff below 10 was 8.8 compared to 11.8 for those with optimal cutoffs above 10. Mean for EPDS studies with optimal cutoffs below 10 was 9.9 compared to 11.8 for those with optimal cutoffs greater than 10. Conclusion: Selective cutoff reporting was more pronounced for the PHQ-9 than EPDS.

Keyword(s)

Medicine

Availability

URI

https://repository.li.mahidol.ac.th/handle/20.500.14594/77887

Collections

Scopus 2021