turner-selectivecutoff-2021.pdf (1.01 MB)
Selective cutoff reporting in studies of the accuracy of the Patient Health Questionnaire-9 and Edinburgh Postnatal Depression Scale: Comparison of results based on published cutoffs versus all cutoffs using individual participant data meta-analysis
journal contribution
posted on 2021-09-01, 00:00 authored by D Neupane, B Levis, P M Bhandari, B D Thombs, A Benedetti, Y Sun, C He, Y Wu, A Krishnan, Z Negeri, M Imran, D B Rice, K E Riehm, N Saadat, M Azar, T A Sanchez, M J Chiovitti, A W Levis, J T Boruff, P Cuijpers, S Gilbody, J P A Ioannidis, L A Kloda, S B Patten, I Shrier, R C Ziegelstein, L Comeau, N D Mitchell, M Tonelli, S N Vigod, D H Akena, R Alvarado, B Arroll, M O Bakare, H R Baradaran, C T Beck, C H Bombardier, A Bunevicius, G Carter, M H Chagas, L H Chaudron, R Cholera, K Clover, Y Conwell, T Castro e Couto, J M de Man-van Ginkel, J Delgadillo, J R Fann, N Favez, D Fung, L Garcia-Esteve, B Gelaye, F Goodyear-Smith, T Hyphantis, M Inagaki, K Ismail, N Jetté, D S Khalifa, M E Khamseh, J Kohlhoff, Z Kozinszky, L Kusminskas, S I Liu, M Lotrakul, S R Loureiro, B Löwe, S M Sidik, S Nakić Radoš, F L Osório, S J Pawlby, B W Pence, T J Rochat, A G Rooney, D J Sharp, L Stafford, K P Su, S C Sung, M Tadinac, S Darius Tandon, P Thiagayson, A Töreki, A Torres-Giménez, Alyna TurnerAlyna Turner, C M van der Feltz-Cornelis, J M Vega-Dienstmaier, P A Vöhringer, J White, M A Whooley, K Winkley, M YamadaObjectives: Selectively reported results from only well-performing cutoffs in diagnostic accuracy studies may bias estimates in meta-analyses. We investigated cutoff reporting patterns for the Patient Health Questionnaire-9 (PHQ-9; standard cutoff 10) and Edinburgh Postnatal Depression Scale (EPDS; no standard cutoff, commonly used 10–13) and compared accuracy estimates based on published cutoffs versus all cutoffs. Methods: We conducted bivariate random effects meta-analyses using individual participant data to compare accuracy from published versus all cutoffs. Results: For the PHQ-9 (30 studies, N = 11,773), published results underestimated sensitivity for cutoffs below 10 (median difference: −0.06) and overestimated for cutoffs above 10 (median difference: 0.07). EPDS (19 studies, N = 3637) sensitivity estimates from published results were similar for cutoffs below 10 (median difference: 0.00) but higher for cutoffs above 13 (median difference: 0.14). Specificity estimates from published and all cutoffs were similar for both tools. The mean cutoff of all reported cutoffs in PHQ-9 studies with optimal cutoff below 10 was 8.8 compared to 11.8 for those with optimal cutoffs above 10. Mean for EPDS studies with optimal cutoffs below 10 was 9.9 compared to 11.8 for those with optimal cutoffs greater than 10. Conclusion: Selective cutoff reporting was more pronounced for the PHQ-9 than EPDS.
History
Journal
International Journal of Methods in Psychiatric ResearchVolume
30Issue
3Article number
e1873Pagination
1 - 15Publisher
WileyLocation
Chichester, Eng.Publisher DOI
Link to full text
ISSN
1049-8931eISSN
1557-0657Language
engPublication classification
C1 Refereed article in a scholarly journalUsage metrics
Categories
No categories selectedKeywords
Licence
Exports
RefWorks
BibTeX
Ref. manager
Endnote
DataCite
NLM
DC