Retracted publications in pharmacy systematic reviews
DOI:
https://doi.org/10.5195/jmla.2022.1280Keywords:
Retraction of Publication as Topic, Systematic Reviews as Topic, Ethics, Research, Pharmacy, Evidence-Based Pharmacy Practice, PublishingAbstract
Objective: Systematic reviews and other evidence syntheses, the pinnacle of the evidence pyramid, embody comprehensiveness and rigor; however, retracted data are being incorporated into these publications. This study examines the use of retracted publications in the field of pharmacy, describes characteristics of retracted publications cited by systematic reviews, and discusses factors associated with citation likelihood.
Methods: Using data from Retraction Watch, we identified retracted publications in the pharmacy field. We identified all articles citing these retracted publications in Web of Science and Scopus and limited results to systematic reviews. We classified the retraction reason, determined whether the citation occurred before or after retraction, and analyzed factors associated with the likelihood of systematic reviews citing a retracted publication.
Results: Of 1,396 retracted publications, 283 were cited 1,096 times in systematic reviews. Most (65.0%) (712/1096) citations occurred before retraction. Citations were most often to items retracted due to data falsification or manipulation (39.2%), followed by items retracted due to ethical misconduct including plagiarism (30.4%), or concerns about or errors in data or methods (26.2%). Compared to those not cited in systematic reviews, cited items were significantly more likely to be retracted due to data falsification and manipulation, were published in high impact factor journals, and had longer delays between publication and retraction.
Conclusions: Further analysis of systematic reviews citing retracted publications is needed to determine the impact of flawed data. Librarians understand the nuances involved and can advocate for greater transparency around the retraction process and increase awareness of challenges posed by retractions.
References
Paul M, Leibovici L. Systematic review or meta-analysis? Their place in the evidence hierarchy. Clin Microbiol Infect. 2014 20(2):97–100. DOI: https://doi.org/10.1111/1469-0691.12489.
Steen RG. Retractions in the medical literature: how many patients are put at risk by flawed research? J Med Ethics. 2011 Nov;37(11):688–92. DOI: https://doi.org/10.1136/jme.2011.043133.
Retraction Watch. 2021 [cited 2021]. Available from: https://retractionwatch.com/retracted-coronavirus-covid-19-papers/.
Ledford H, Van Noorden R. High-profile coronavirus retractions raise concerns about data oversight. Nature. 2020 Jun;582(160). DOI: https://doi.org/10.1038/d41586-020-01695-w.
Foo JY. A retrospective analysis of the trend of retracted publications in the field of biomedical and life sciences. Sci Eng Ethics. 2011 Sep;17(3):459–68. DOI: https://doi.org/10.1007/s11948-010-9212-8.
Steen RG, Casadevall A, Fang FC. Why has the number of scientific retractions increased? PLoS One. 2013 8(7):e68397. DOI: https://doi.org/10.1371/journal.pone.0068397.
Trikalinos NA, Evangelou E, Ioannidis JP. Falsified papers in high-impact journals were slow to retract and indistinguishable from nonfraudulent papers. J Clin Epidemiol. 2008 May;61(5):464–70. DOI: https://doi.org/10.1016/j.jclinepi.2007.11.019.
Chalmers I, Glasziou P. Avoidable waste in the production and reporting of research evidence. Lancet. 2009;374(9683):86–89. DOI: https://doi.org/10.1016/s0140-6736(09)60329-9.
Macleod MR, Michie S, Roberts I, Dirnagl U, Chalmers I, Ioannidis JPA, Salman RA-S, Chan A-W, Glasziou P. Biomedical research: increasing value, reducing waste. Lancet. 2014;383(9912):101–4. DOI: https://doi.org/10.1016/s0140-6736(13)62329-6.
Faggion CM, Jr. More detailed guidance on the inclusion/exclusion of retracted articles in systematic reviews is needed. J Clin Epidemiol. 2019 Dec;116:133–4. DOI: https://doi.org/10.1016/j.jclinepi.2019.07.006.
Nogueira TE, Goncalves AS, Leles CR, Batista AC, Costa LR. A survey of retracted articles in dentistry. BMC Res Notes. 2017 Jul;10(1):253. DOI: https://doi.org/10.1186/s13104-017-2576-y.
Theis-Mahon NR, Bakker CJ. The continued citation of retracted publications in dentistry. J Med Libr Assoc. 2020 Jul;108(3):389–97. DOI: https://doi.org/10.5195/jmla.2020.824.
Bozzo A, Bali K, Evaniew N, Ghert M. Retractions in cancer research: a systematic survey. Res Integr Peer Rev. 2017;2:5. DOI: https://doi.org/10.1186/s41073-017-0031-1.
Rosenkrantz AB. Retracted publications within radiology journals. AJR Am J Roentgenol. 2016 Feb;206(2):231–5. DOI: https://doi.org/10.2214/AJR.15.15163.
Wasiak J, Hamilton DG, Foroudi F, Faggion CM, Jr. Surveying retracted studies and notices within the field of radiation oncology. Int J Radiat Oncol Biol Phys. 2018 Nov 1;102(3):660–5. DOI: https://doi.org/10.1016/j.ijrobp.2018.06.028.
Bakker C, Riegelman A. Retracted publications in mental health literature: discovery across bibliographic platforms. J Librariansh Inf Sci. 2018;6(1):eP2199. DOI: https://doi.org/10.7710/2162-3309.2199.
Chauvin A, De Villelongue C, Pateron D, Yordanov Y. A systematic review of retracted publications in emergency medicine. Eur J Emerg Med. 2019 Feb;26(1):19–23. DOI: https://doi.org/10.1097/mej.0000000000000491.
Bennett C, Chambers LM, Al-Hafez L, Michener CM, Falcone T, Yao M, Berghella V. Retracted articles in the obstetrics literature: lessons from the past to change the future. Am J Obstet Gynecol MFM. 2020 Nov;2(4):100201. DOI: https://doi.org/10.1016/j.ajogmf.2020.100201.
Chambers LM, Michener CM, Falcone T. Plagiarism and data falsification are the most common reasons for retracted publications in obstetrics and gynaecology. BJOG. 2019 Aug;126(9):1134–40. DOI: https://doi.org/10.1111/1471-0528.15689.
King EG, Oransky I, Sachs TE, Farber A, Flynn DB, Abritis A, Kalish JA, Siracuse JJ. Analysis of retracted articles in the surgical literature. Am J Surg. 2018 Nov;216(5):851–5. DOI: https://doi.org/10.1016/j.amjsurg.2017.11.033.
Yan J, MacDonald A, Baisi LP, Evaniew N, Bhandari M, Ghert M. Retractions in orthopaedic research: a systematic review. Bone Joint Res. 2016 Jun;5(6):263–8. DOI: https://doi.org/10.1302/2046-3758.56.BJR-2016-0047.
Samp JC, Schumock GT, Pickard AS. Retracted publications in the drug literature. Pharmacotherapy. 2012 Jul;32(7):586–95. DOI: https://doi.org/10.1002/j.1875-9114.2012.01100.x.
Talebi R, Redberg RF, Ross JS. Consistency of trial reporting between ClinicalTrials.gov and corresponding publications: one decade after FDAAA. Trials. 2020 Jul 23;21(1):675. DOI: https://doi.org/10.1186/s13063-020-04603-9.
Anderson ML, Chiswell K, Peterson ED, Tasneem A, Topping J, Califf RM. Compliance with results reporting at ClinicalTrials.gov. N Engl J Med. 2015 Mar 12;372(11):1031–9. DOI: https://doi.org/10.1056/NEJMsa1409364.
Atlas MC. Retraction policies of high-impact biomedical journals. J Med Libr Assoc. 2004 92(2):242–50. https://pubmed.ncbi.nlm.nih.gov/15098054.
Hesselmann F, Graf V, Schmidt M, Reinhart M. The visibility of scientific misconduct: a review of the literature on retracted journal articles. Curr Sociol. 2017 Oct;65(6):814–45. DOI: https://doi.org/10.1177/0011392116663807.
COPE Council. COPE Retraction guidelines — English [Internet]. Version 2: November 2019 ed. Committee on Publication Ethics; 2019. <https://doi.org/10.24318/cope.2019.1.4>.
International Committee of Medical Journal Editors. Corrections, retractions, republications and version control [Internet]. [cited April 21 2021]. <http://www.icmje.org/recommendations/browse/publishing-and-editorial-issues/corrections-and-version-control.html>.
Resnik DB, Wager E, Kissling GE. Retraction policies of top scientific journals ranked by impact factor. J Med Libr Assoc. 2015 Jul;103(3):136–9. DOI: https://doi.org/10.3163/1536-5050.103.3.006.
Suelzer EM, Deal J, Hanus KL. Challenges in discovering the retracted status of an article. Discussion paper for Reducing the Inadvertent Spread of Retracted Science: Shaping a Research and Implementation Agenda 2020. http://hdl.handle.net/2142/108367.
Garfield E. Can citation indexing be automated? In: Stevens ME, Giuliano VE, Heilprin LB, editors. Statistical association methods for mechanical documentation, symposium proceedings. Miscelleaneous publication 269. Washington, DC National Bureau of Standards; 1965. p. 189–92.
Retraction watch database [Internet]. Center for Scientific Integrity. [cited May 2019]. Available from: http://retractiondatabase.org/RetractionSearch.aspx.
Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan — a web and mobile app for systematic reviews. Syst Rev. 2016 5(1):210. DOI: https://doi.org/10.1186/s13643-016-0384-4.
Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009 Jul;339:b2535. DOI: https://doi.org/10.1136/bmj.b2535.
Bar-Ilan J, Halevi G. Temporal characteristics of retracted articles. Scientometrics. 2018 116(3):1771–83. DOI: https://doi.org/10.1007/s11192-018-2802-y.
Web of Science. Journal Citation Reports: learn the basics [Internet]. [cited 24 Feb 2021]. <https://clarivate.libguides.com/jcr/basics>.
Himmelstein DS, Powell K. Analysis for "the history of publishing delays" blog post v1.0. Zenodo. 3 Feb 2016. DOI: http://doi.org/10.5281/zenodo.45516.
R Core Team. R: a language and environment for statistical computing 3.6.0. Vienna, Austria: R Foundation for Statistical Computing; 2019 [cited 26 Apr 2021]. <https://www.R-project.org/>.
Azoulay P, Bonatti A, Krieger JL. The career effects of scandal: evidence from scientific retractions. Res Policy. 2017 46(9):1552–69. DOI: https://doi.org/10.1016/j.respol.2017.07.003.
Sonfield MC. Academic plagiarism at the faculty level: legal versus ethical issues and a case study. J Acad Ethics. 2014;12(2):75–87. DOI: https://doi.org/10.1007/s10805-014-9205-3.
Bakker C, Cooper K, Langham-Putrow A, McBurney J. Qualitative analysis of faculty opinions on and perceptions of research impact metrics. College & Research Libraries. 2020;81(6). DOI: https://doi.org/https://doi.org/10.5860/crl.81.6.896.
Brito R, Rodríguez-Navarro A. Evaluating research and researchers by the journal impact factor: is it better than coin flipping? J Informetr. 2019 Feb;13(1):314–24. DOI: https://doi.org/10.1016/j.joi.2019.01.009.
Moher D, Naudet F, Cristea IA, Miedema F, Ioannidis JPA, Goodman SN. Assessing scientists for hiring, promotion, and tenure. PLoS Biol. 2018 Mar;16(3):e2004089. DOI: https://doi.org/10.1371/journal.pbio.2004089.
Shojania KG, Sampson M, Ansari MT, Ji J, Doucette S, Moher D. How quickly do systematic reviews go out of date? A survival analysis. Ann Intern Med. 2007 Aug;147(4):224–33. DOI: https://doi.org/10.7326/0003-4819-147-4-200708210-00179.
Lefebvre C, Glanville J, Briscoe S, Littlewood A, Marshall C, Metzendorf M-I, Noel-Storr A, Rader T, Shokraneh F, Thomas J, Wieland L. Chapter 4: Searching for and selecting studies. In: Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, and Welch VA, editors. Cochrane handbook for systematic reviews of interventions. Version 6.1: Cochrane; 2020.
Aromataris E, Munn Z. JBI Manual for evidence synthesis 2020. Available from: https://jbi-global-wiki.refined.site/space/MANUAL.
Barnish M. The inclusion of retracted studies in systematic reviews: a response to Gray et al. Int J Nurs Stud. 2018 Apr;80:90–1. DOI: https://doi.org/10.1016/j.ijnurstu.2017.12.013.
Grey A, Avenell A, Bolland M. Timeliness and content of retraction notices for publications by a single research group. Account Res. 2021 May;5:1–15. DOI: https://doi.org/10.1080/08989621.2021.1920409.
Moylan EC, Kowalczuk MK. Why articles are retracted: a retrospective cross-sectional study of retraction notices at BioMed Central. BMJ Open. 2016 Nov;6(11):e012047. DOI: https://doi.org/10.1136/bmjopen-2016-012047.
Wager E, Williams P. Why and how do journals retract articles? An analysis of Medline retractions 1988-2008. J Med Ethics. 2011 Sep;37(9):567–70. DOI: https://doi.org/10.1136/jme.2010.040964.
Nair S, Yean C, Yoo J, Leff J, Delphin E, Adams DC. Reasons for article retraction in anesthesiology: a comprehensive analysis. Can J Anaesth. 2020 Jan;67(1):57–63. DOI: https://doi.org/10.1007/s12630-019-01508-3.
Kesselheim AS, Mello MM. Confidentiality laws and secrecy in medical research: improving public access to data on drug safety. Health Aff. 2007 Mar-Apr;26(2):483–91. DOI: https://doi.org/10.1377/hlthaff.26.2.483.
Riley IL, Boulware LE, Sun JL, Chiswell K, Que LG, Kraft M, Todd JL, Palmer SM, Anderson ML. Factors associated with reporting results for pulmonary clinical trials in ClinicalTrials.gov. Clin Trials. 2018 Feb;15(1):87–94. DOI: https://doi.org/10.1177/1740774517740352.
Siebert M, Gaba JF, Caquelin L, Gouraud H, Dupuy A, Moher D, Naudet F. Data-sharing recommendations in biomedical journals and randomised controlled trials: an audit of journals following the ICMJE recommendations. BMJ Open. 2020 May 30;10(5):e038887. DOI: https://doi.org/10.1136/bmjopen-2020-038887.
Teixeira da Silva JA, Al-Khatib A. Ending the retraction stigma: encouraging the reporting of errors in the biomedical record. Res Ethics. 2019:251–9. DOI: https://doi.org/10.1177/1747016118802970.
Fanelli D. Set up a ‘self-retraction’ system for honest errors. Nature. 2016 531(7595):415. DOI: https://doi.org/10.1038/531415a.
Published
Issue
Section
License
Copyright (c) 2022 Sarah Jane Brown, Caitlin J. Bakker, Nicole R. Theis-Mahon
This work is licensed under a Creative Commons Attribution 4.0 International License.
