MEDLINE citation tool accuracy: an analysis in two platforms

Authors

DOI:

https://doi.org/10.5195/jmla.2024.1718

Keywords:

Auto-citation generator, librarians, information literacy, citation on demand, biomedical databases, PubMed, Ovid MEDLINE

Abstract

Background: Libraries provide access to databases with auto-cite features embedded into the services; however, the accuracy of these auto-cite buttons is not very high in humanities and social sciences databases. 

Case Presentation: This case compares two biomedical databases, Ovid MEDLINE and PubMed, to see if either is reliable enough to confidently recommend to students for use when writing papers. A total of 60 citations were assessed, 30 citations from each citation generator, based on the top 30 articles in PubMed from 2010 to 2020.

Conclusions: Error rates were higher in Ovid MEDLINE than PubMed but neither database platform provided error free references.The auto-cite tools were not reliable. Zero of the sixty citations examined were 100% correct. Librarians should continue to advise students not to rely solely upon citation generators in these biomedical databases.

Author Biographies

Laurel Scheinfeld, Senior Assistant Librarian, Health Sciences Library, Stony Brook University, Stony Brook, NY

Senior Assistant Librarian, Health Sciences Library, Stony Brook University, Stony Brook, NY

Sunny Chung, Senior Assistant Librarian, Health Sciences Library, Stony Brook University, Stony Brook, NY

Sunny Chung, MLIS, is a Health Sciences Librarian at the Stony Brook University Health Sciences Library, where she serves as the Liaison to the School of Nursing and Program in Public Health. Sunny is a member of the Community and Outreach Working Group, which partners with student association groups, participates in University events (such as Pet Therapy Day), and creates banners promoting the Library’s events on Instagram, Twitter, Facebook, and the Library’s website. She has worked previously as a  Medical Librarian at NYIT College of Osteopathic Medicine. Sunny holds a Master of Library and Information Science from Queens College, City University of New York (CUNY). She is an active member of the Liberty Chapter of MLA, and she has also presented at the annual meeting. In addition, she currently serves on the board of the Medical and Scientific Libraries of Long Island (MEDLI) as Vice President/President-Elect. 

References

Cain TJ, Cheek FM, Kupsco J, Hartel LJ, Getselman A. Health sciences libraries forecasting information service trends for researchers: Models applicable to all academic libraries. College & Research Libraries. 2017 Sep;77(5):595-613. DOI: https://doi.org/10.5860/crl.77.5.595.

Gunton L. Librarians as drivers of academic integrity for student success at university. Journal of the Australian Library and Information Association. 2022 Apr;71(2):156–70. DOI: https://doi.org/10.1080/24750158.2022.2063101.

Dawe L, Stevens J, Hoffman B, Quilty M. Citation and referencing support at an academic library: Exploring student and faculty perspectives on authority and effectiveness. College & Research Libraries. 2021 Nov; 82(7):991. DOI: https://doi.org/10.5860/crl.82.7.991.

Ury CJ, Wyatt P. What we do for the sake of correct citations. In: Brick and Click Libraries; Proceedings of an academic library symposium. Maryville, NO; 2009. Available from: https://eric.ed.gov/?id=ED507380.

Shull DL. An examination of librarian attitudes towards teaching citations [Master’s Thesis]. 2012. DOI: https://doi.org/10.17615/3dbc-j490.

Wilkinson J, Denneler A, Nay L, Johnson AM. Constructing citations: Reviewing chat transcripts to improve citation assistance as a service. Reference Services Review. 2021. Jun;49(2):194-210. DOI: https://doi.org/10.1108/RSR-03-2021-0007.

Salem J, Fehrmann P. Bibliographic management software: A focus group study of the preferences and practices of undergraduate students. Public Services Quarterly. 2013 Apr;9(2):110–20. DOI: https://doi.org/10.1080/15228959.2013.785878.

Dahlstrom E, Walker JD, Dziuban C. ECAR study of undergraduate students and information technology. Educause Research Report. 2013. http://www.educause.edu.proxy.library.stonybrook.edu/ir/library/pdf/ERS1302/ERS1302.pdf.

Homol, L. Web-based citation management tools: Comparing the accuracy of their electronic journal citations. The Journal of Academic Librarianship. 2014. Nov;40(6):552-557. DOI: https://doi.org/10.1016/j.acalib.2014.09.011.

Lonergan, N. Reference management software preferences among liberal arts faculty. Dickinson College Faculty Publications. 2017. DOI: http://scholar.dickinson.edu/faculty_publications/775.

Ho CC. Free online citation generators: which should undergraduates use with confidence? Voice of Academia. 2022 Nov;18(2):70–92. Available from: https://voa.uitm.edu.my/v1/voa-issue/2022-volume-18/issue-2.

Laing K, James K. EBSCO and Summon Discovery generator tools: How accurate are they? The Journal of Academic Librarianship. 2022 Jul;102587. DOI: https://doi.org/10.1016/j.acalib.2022.102587.

Kessler J, Van Ullen MK. Citation help in databases: Helpful or harmful? Public Services Quarterly. 2006 Jan;2(1):21–42. DOI: https://doi.org/10.1300/J295v02n01_03.

Van Ullen M, Kessler J. Citation help in databases: The more things change, the more they stay the same. Public Services Quarterly. 2012 Jan;8(1):40–56. DOI: https://doi.org/10.1080/15228959.2011.620403.

Kratochvíl J. Comparison of the accuracy of bibliographical references generated for medical citation styles by EndNote, Mendeley, RefWorks and Zotero. The Journal of Academic Librarianship. 2017 Jan;43(1):57–66. DOI: https://doi.org/10.1016/j.acalib.2016.09.001.

Gusenbauer M, Haddaway NR. Which academic search systems are suitable for systematic reviews or meta-analyses? Evaluating retrieval qualities of Google Scholar, PubMed, and 26 other resources. Research Synthesis Methods. 2020. Dec;11(2):181–217. DOI: https://doi.org/10.1002/jrsm.1378.

Downloads

Published

2024-05-22

Issue

Section

Case Report