Abstract
Introduction: In early January 2020, when the COVID-19 pandemic broke out, in vitro and animal studies showed preliminary positive results for repurposing drugs. Healthcare professionals had to critically assess the vast and emerging literature with an evidence-based approach to best clinical practices. Objective: To describe and reflect on the integration of a meta-research with a university extension program to promote critical reading of COVID-19 scientific studies among undergraduates. The meta-research aims to map the evidence and to estimate the prevalence of biases in comparative studies evaluating repurposing drugs for the treatment of COVID-19 during the pandemic. Methods: We integrated an online training on literature critical appraisal with a systematic review of methods. We searched for “COVID-19” and repurposed drug-related terms in MEDLINE, Embase, Cochrane Library, and LILACS by January 10th, 2022. Two independent researchers reviewed titles and abstracts and comparative studies had data fully extracted, including risk-of-bias. Results: A total of 171 students in Brazil signed into the online critical appraisal course. Of those, 24 were invited to collaborate with the meta-research, after robust evidence critical appraisal training. During the COVID-19 pandemic (2020-2021), 30.896 references assessed repurposing drug were identified and 6.246 papers were included. Our preliminary data showed 146 randomized controlled trials (RCT) with the word “randomized” in the title and 146 cohort studies identified by the word “cohort” in the title or abstract. Conclusions: The health emergency, there was an important volume of articles on interventions for COVID-19. Our preliminary results suggest that less than 5% of these studies were comparative longitudinal studies, being that most of the pertinent articles represent a challenge to be critically assessed, and probably have low level of evidence for clinical decision making. Our extension activity highlighted the interests of undergraduate healthcare students in developing skills on critical review of scientific articles. Thus, the experience of integrating university extension activity with research allows linking the community with knowledge generation.
References
Mahase E. Covid-19: WHO declares pandemic because of “alarming levels” of spread, severity, and inaction. BMJ [Internet]. 2020;368:m1036.
Rosa SGV, Santos WC. Clinical trials on drug repositioning for COVID-19 treatment. Rev Panam Salud Publica. 2020; 44: e40. doi: 10.26633/RPSP.2020.40
Rome BN, Avorn J. Drug Evaluation during the Covid-19 Pandemic. N Engl J Med. 2020; 382(24): 2282-2284. doi: 10.1056/NEJMp2009457
Spiteri J. Media bias exposure and the incidence of COVID-19 in the USA. BMJ Glob Health. 2021; 6(9): e006798. doi: 10.1136/bmjgh-2021-006798
Sackett DL, Rosenberg WM, Gray JA, Haynes RB, Richardson WS. Evidence based medicine: what it is and what it isn’t. BMJ. 1996; 312(7023): 71-72. doi: 10.1136/bmj.312.7023.71
Depallens MA, Guimarães JMM, Faria L, Cardoso AJC, Almeida-Filho N. Quaternary prevention, curricular reform and medical education. Interface (Botucatu). 2020; 24: e190584. doi: 10.1590/Interface.190584
Gill PJ, Ali SM, Elsobky Y, Okechukwu RC, Ribeiro TB, Soares Dos Santos Junior AC, et al. Building capacity in evidence-based medicine in low-income and middle-income countries: problems and potential solutions. BMJ Evid Based Med. 2021; 26(3): 82-84. doi: 10.1136/bmjebm-2019-111272
Wyer PC, Keitz S, Hatala R, Hayward R, Barratt A, Montori V, et al. Tips for learning and teaching evidence-based medicine: introduction to the series. CMAJ. 2004;171(4):347-8. doi: 10.1503/cmaj.1031665
Chandran VP, Balakrishnan A, Rashid M, Khan S, Devi ES, Kulyadi GP, et al. Teaching and learning strategies of evidence-based medicine: A metasynthesis of learners and instructors perspective. Clin Epidemiol Glob Health. 2023; 21: 101280. doi: 10.1016/j.cegh.2023.101280
Huddart D, Hirniak J, Sethi R, Hayer G, Dibblin C, Meghna Rao B, et al. #MedStudentCovid: How social media is supporting students during COVID-19. Med Educ. 2020 Oct;54(10):951-952. doi: 10.1111/medu.14215. Epub 2020 Jun 29.
Idrovo AJ. Primeras lecciones de la pandemia de COVID-19 a la educación médica colombiana. Salud UIS [Internet]. 2020; 52(2): 87-88. https://doi.org/10.18273/revsal.v52n2-2020002
USP, Faculdade de Saúde Pública da. Primeiro Encontro de Pesquisadores em Formação do LINCEUSP - Manhã. Youtube Faculdade de Saúde Pública da USP. [Online] 2022. [Cited 2023 Sep 28] https://www.youtube.com/watch?v=FASnuXmxFwE
Faculdade de Saúde Pública da USP. Primeiro Encontro de Pesquisadores em Formação do LINCEUSP – Tarde [Internet]. Youtube. 28 Sep 2023. https://www.youtube.com/watch?v=_tEQ1V8EIsg
Ribeiro T, Diaz Quijano F, Ramirez P, Pelissari D. Sources of error in comparative drug studies treating Covid-19, a systematic review of methods. PROSPERO [Online]. 2022 [Cited 2023 Sep 28]; CRD42022360331. Available at: https://www.crd.york.ac.uk/PROSPERO/display_record.php?RecordID=360331.
Siemieniuk RA, Bartoszko JJ, Zeraatkar D, Kum E, Qasim A, Martinez JPD, et al. Drug treatments for covid-19: living systematic review and network metaanalysis. BMJ. 2020;370:m2980. doi: 10.1136/bmj.m2980. Update in: BMJ. 2020 Sep 11; 370: m3536. Update in: BMJ. 2020 Dec 17; 371: m4852. Update in: BMJ. 2021 Mar 31; 372: n858. Erratum in: BMJ. 2021 Apr 13;373: n967.
USA, National Institutes of Health. Coronavirus Disease 2019 (COVID-19) Treatment Guidelines [Internet]. Bethesda: National Institutes of Health; 2020 [Cited 2023 Sep 28] https://www.covid19treatmentguidelines.nih.gov/
Sterne JA, Hernán MA, Reeves BC, Savović J, Berkman ND, Viswanathan M, et al. ROBINS-I: A tool for assessing risk of bias in non-randomised studies of interventions. BMJ. 2016; 355: i4919. doi: 10.1136/bmj.i4919
Sterne JAC, Savović J, Page MJ, Elbers RG, Blencowe NS, Boutron I, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ. 2019; 366: l4898. doi: 10.1136/bmj.l4898
Modgil S, Singh RK, Gupta S, Dennehy D. A Confirmation Bias View on Social Media Induced Polarisation During Covid-19. Inf Syst Front. 2021; 1-25. doi: 10.1007/s10796-021-10222-9
Bero L, Lawrence R, Leslie L, Chiu K, McDonald S, Page MJ, et al. Cross-sectional study of preprints and final journal publications from COVID-19 studies: Discrepancies in results reporting and spin in interpretation. BMJ Open. 2021;11(7): e051821. doi: 10.1136/bmjopen-2021-051821
Evidence-Based Medicine Working Group. Evidence-based medicine. A new approach to teaching the practice of medicine. JAMA. 1992; 268(17): 2420-2425. doi: 10.1001/jama.1992.03490170092032
Raynaud M, Zhang H, Louis K, Goutaudier V, Wang J, Dubourg Q, et al. COVID-19-related medical research: a meta-research and critical appraisal. BMC Med Res Methodol. 2021; 21(1): 1. doi: 10.1186/s12874-020-01190-w
Fourtassi M, Hjiej G, Touissi Y, Hajjioui A, Abda N. How has the COVID-19 pandemic improved evidence-based-medicine awareness among undergraduate medical students? Med Educ Online. 2020; 25(1): 1787123. doi: 10.1080/10872981.2020.1787123
Greenhalgh T, Fisman D, Cane DJ, Oliver M, Macintyre CR. Adapt or die: how the pandemic made the shift from EBM to EBM+ more urgent. BMJ Evid Based Med. 2022; 27(5): 253–260. doi: 10.1136/bmjebm-2022-111952
Augustin Y, Staines HM, Velavan TP, Kamarulzaman A, Kremsner PG, Krishna S. Drug repurposing for COVID-19: current evidence from randomized controlled adaptive platform trials and living systematic reviews. Br Med Bull. 2023; 147(1): 31-49. doi: 10.1093/bmb/ldac037
Kotecha P, Light A, Checcucci E, Amparore D, Fiori C, Porpiglia F, et al. Repurposing of drugs for COVID-19: a systematic review and metaanalysis. Panminerva Med. 2022; 64(1): 96-114. doi: 10.23736/S0031-0808.20.04024-0
Krishnamurthy N, Grimshaw AA, Axson SA, Choe SH, Miller JE. Drug repurposing: a systematic review on root causes, barriers and facilitators. BMC Health Serv Res. 2022; 22(1): 970. doi: 10.1186/s12913-022-08272-z
This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright (c) 2024 Tatiane Ribeiro, Paula Ramírez, Daniele Maria Pelissari, Adriano Tito Souza Vieira, Luís Ricardo Santos de Melo, Gustavo Pereira-Persch , João Guilherme Campêlo Brandim de Sá Lopes, Rafael de Sousa-Alves, Gustavo Alves-Rizzo, Elisama Adorno-Brito, Thiago Santos-Evangelista , Rachel Campos-Ornelas , Aída Rita Tedesco e Silva, Ândrea Pires-Daneris, Larissa Ferraz-Mota , Jade Bento-de Moura, Júlia dos Santos-França , Pedro Nascimento-Martins , Poliana Espindula-da Silva, Karen Kariny-Gomes , Thais Pinheiro-da Costa , Fredi Alexander Diaz-Quijano