Toshi A. Furukawa
- Society for Clinical Epidemiology
- Annals of Clinical Epidemiology (ISSN:24344338)
- vol.3, no.2, pp.46-55, 2021 (Released:2021-04-01)
BACKGROUNDThe objective of this study was to investigate the methodological quality of coronavirus disease 2019 (COVID-19) systematic reviews (SRs) indexed in medRxiv and PubMed, compared with Cochrane COVID Reviews.METHODSThis is a cross-sectional meta-epidemiological study. We searched medRxiv, PubMed, and Cochrane Database of Systematic Reviews for SRs of COVID-19. We evaluated the methodological quality using A MeaSurement Tool to Assess systematic Reviews (AMSTAR) checklists. The maximum AMSTAR score is 11, and minimum is 0. Higher score means better quality.RESULTSWe included 9 Cochrane reviews as well as randomly selected 100 non-Cochrane reviews in medRxiv and PubMed. Compared with Cochrane reviews (mean 9.33, standard deviation 1.32), the mean AMSTAR scores of the articles in medRxiv were lower (mean difference (MD): −2.85, 98.3% confidence intervals (CI): −0.96 to −4.74), and those in PubMed were also lower (MD: −3.28, 98.3%CI: −1.40 to −5.15), with no difference between the latter two.CONCLUSIONSReaders should pay attention to the potentially low methodological quality of SRs related to COVID-19 in both PubMed and medRxiv. Evidence users might be better to search the Cochrane Library rather than medRxiv or PubMed to search SRs related to COVID-19.