PubMed’s core clinical journals filter: redesigned for contemporary clinical impact and utility

Authors

DOI:

https://doi.org/10.5195/jmla.2023.1631

Keywords:

MEDLINE, clinical medicine, databases, bibliographic, evidence-based medicine, periodicals as topic, PubMed

Abstract

Objective: The Core Clinical Journals (CCJ) list, produced by the U.S. National Library of Medicine (NLM), has been used by clinicians and librarians for half a century for two main purposes: narrowing a literature search to clinically useful journals and identifying high priority titles for library collections. After documentation of low usage of the existing CCJ, a review was undertaken to assess current validity, followed by an update to current clinical needs.

Methods: As the subject coverage of the 50-year-old list had never been evaluated, the CCJ committee began its innovative step-wise approach by analyzing the existing subject scope. To determine whether clinical subjects had changed over the last half-century, the committee collected data on journal usage in hospitals and medical facilities, adding journal usage from Morning Report blogs recording the journal article citations used by physicians and residents in response to clinical questions. Patient-driven high-frequency diagnoses and subjects added contextual data by depicting the clinical environment.

Results: The analysis identified a total of 80 subjects and selected 241 journals for the updated Clinical Journals filter, based on actual clinical utility of each journal.

Discussion: These data-driven methods created a different framework for evaluating the structure and content of this filter. It is the real-world evidence needed to highlight CCJ clinical impact and push clinically useful journals to first page results. Since the new process resulted in a new product, the name warrants a change from Core Clinical Journals (CCJ) to Clinically Useful Journals (CUJ). Therefore, the redesigned NLM Core Clinical Journals/AIM set from this point forward will be referred to as Clinically Useful Journals (CUJ). The evidence-based process used to reframe evaluation of the clinical impact and utility of biomedical journals is documented in this article.

References

An abbreviated index medicus. JAMA. 1969 Dec 22;210(12):2272-3.

Klein-Fedyshin M, Ketchum AM, Arnold RM, Fedyshin PJ. Evaluating the MEDLINE Core Clinical Journals filter: data-driven evidence assessing clinical utility. J Eval Clin Pract. 2014 Dec;20(6):837-43. DOI: 10.1111/jep.12190. Available from: https://doi-org.pitt.idm.oclc.org/10.1111/jep.12190

Kaiser Permanente. Kaiser Permanente: Who We Are - Fast Facts [Internet]. 2021 [cited 21 Sep 2022]. https://about.kaiserpermanente.org/who-we-are/fast-facts.

H-CUP National Inpatient Sample, 2012-2013, Principal diagnoses 2012-2013. [Internet]. Healthcare Cost and Utilization Project (HCUP). 2012. Agency for Healthcare Research and Quality, Rockville, MD. Available from: https://www.hcup-us.ahrq.gov/nisoverview.jsp

Doody Core Titles’ subject classification (used with permission of Dan Doody), May 13, 2015.

Healthy People 2020. Washington, DC: U.S. Department of Health and Human Services, Office of Disease Prevention and Health Promotion. [Internet] Available from: https://www.healthypeople.gov/2020/topics-objectives

Medscape. My Alerts, topics. Available from: https://profreg.medscape.com/px/topicalert.do (Members)

National Library of Medicine. Medical Subject Headings. [Internet] NLM; 2021 [cited 21 Sept 2022]. Available from: https://www.nlm.nih.gov/mesh/meshhome.html

National Library of Medicine Broad Subject Terms for Indexed Journals. [Internet]. NLM [cited 21 Sept 2022]. Available from: https://journal-reports.nlm.nih.gov/broad-subjects/

Johnson R, Watkinson A, Mabe M. The STM Report: an overview of scientific and scholarly publishing. International Association of Scientific, Technical and Medical Publishers. [Internet] Fifth Ed, 2018 Available from: https://www.stm-assoc.org/2018_10_04_STM_Report_2018.pdf

Journal Citation Reports. 2018 Journal Impact Factor™. [Internet] Clarivate; [cited 21 Sep 2022]. Available from: https://clarivate.com/blog/the-2018-jcr-is-here/

Alper BS, Hand JA, Elliott SG, Kinkade S, Hauan MJ, Onion DK, Sklar BM. How much effort is needed to keep up with the literature relevant for primary care? J Med Libr Assoc. 2004 Oct; 92(4):429-37. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC521514/

NEJM Group. About NEJM Journal Watch. [Internet]. Massachusetts Medical Society. [Cited 21 Sep 2022] Available from: https://www.jwatch.org/about/journal-watch.

Biener AI, Decker SL, Rohde F. Source of Increased Health Care Spending in the United States. JAMA. 2019 Mar 26;321(12):1147. doi: 10.1001/jama.2019.0679. Available from: https://jamanetwork.com/journals/jama/fullarticle/2728907

National Institutes of Health. Rigor and Reproducibility Bethesda, MD: [Internet] National Institutes of Health. [cited 21 Sep 2022] Available from: https://www.nih.gov/research-training/rigor-reproducibility

Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA. Cochrane Handbook for Systematic Reviews of Interventions version 6.0 Cochrane; 2019. Available from: https://www.training.cochrane.org/handbook.

Institute of Medicine (US) Committee on Standards for Systematic Reviews of Comparative Effectiveness Research. Finding What Works in Health Care: Standards for Systematic Reviews. Eden J, Levit L, Berg A, Morton S, editors. Washington (DC): National Academies Press (US); 2011. Available from: https://www.ncbi.nlm.nih.gov/books/NBK209518/

Kiester L, Turp C. Artificial intelligence behind the scenes: PubMed’s Best Match algorithm. J Med Libr Assoc. 2022 Jan 1;110(1):15-22. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8830327/pdf/jmla-110-1-15.pdf

Gundersen OE; Kjensmo S. State of the Art: Reproducibility in Artificial Intelligence.

AAAI Conference on Artificial Intelligence, AAAI [Internet]. 2018 Apr.25 [cited 21 Sept 2022];32(1). Available from: https://ojs.aaai.org/index.php/AAAI/article/view/11503

Fiorini N, Leaman R, Lipman DJ, Lu Z. How user intelligence is improving PubMed. Nat Biotechnol. 2018;36(10):937-45. Available from: https://www.nature.com/articles/nbt.4267.

Dunn K, Marshall JG, Wells AL, Backus JEB. Examining the role of MEDLINE as a patient care information resource: an analysis of data from the Value of Libraries study. J Med Libr Assoc. 2917 Oct;105(4):336-346. DOI: dx.doi.org/10.5195/jmla.2017.8 Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5624423/pdf/jmla-105-336.pdf

Published

2023-07-10

Issue

Section

Original Investigation