Development and validation of a geographic search filter for PubMed for retrieving studies about Nordic countries
DOI:
https://doi.org/10.5195/jmla.2026.2311Keywords:
Information Storage and Retrieval, Scandinavian and Nordic Countries, PubMedAbstract
Objective: This study describes the development and validation of a geographic search filter. The filter is intended to find references on the Nordic countries in PubMed. This type of filter enables efficient systematic literature searches for evidence that is relevant for the region, and no validated filter for these countries is publicly available at the time of this publication.
Methods: The Nordic countries are Denmark, Finland, Iceland, Norway and Sweden. References on one or more of these countries were identified by relative recall, using systematic and scoping reviews that did not limit searches to any geographic region but presented the countries of included studies. The references (n = 288) were equally split into a development set and a validation set. A combination of objective and subjective methods was used to identify relevant terms from the development set. The filter was then tested, first on the development set, then on the validation set. A sample of the reviews that were used to identify references for recall testing was also used to test precision.
Results: The final filter surpassed the threshold recall of 90%. Recall was 94.4% for the development set, capturing 136 of 144 references, and 96.5% for the validation set, or 139 of 144. Precision was 95.8% with one false positive of 24 retrieved references.
Conclusions: A validated filter has been developed that can be used to find studies on the Nordic countries when searching PubMed on topics related to human health.
References
1. Lefebvre C, Glanville J, Briscoe S, Featherstone R, Littlewood A, Metzendorf M-I, Noel-Storr A, Paynter R, Rader T, Thomas J, Wieland LS. Chapter 4.2.2 Minimizing bias [last updated March 2025]. In: J. P. T. Higgins, J. Thomas, J. Chandler, M. Cumpston, T. Li, M. J. Page, and V. A. Welch, editors. Cochrane Handbook for Systematic Reviews of Interventions version 6.5.1: Cochrane; 2025.
2. Jenkins M. Evaluation of Methodological Search filters: A review. Health Info Libr J. 2004;21(3):148-63. DOI: https://doi.org/10.1111/j.1471-1842.2004.00511.x.
3. Ayiku L, Levay P, Hudson T, Craven J, Barrett E, Finnegan A, Adams R. The Medline UK Filter: Development and Validation of a Geographic Search Filter to Retrieve Research About the UK From OVID Medline. Health Info Libr J. 2017;34(3):200-16. DOI: https://doi.org/10.1111/hir.12187.
4. Pachanov A, Münte C, Hirt J, Pieper D. Development and Validation of a Geographic Search Filter for MEDLINE (PubMed) to Identify Studies about Germany. Res Synth Methods. 2024;15(6):1147-60. DOI: https://doi.org/10.1002/jrsm.1763.
5. Ayiku L, Levay P, Hudson T. The NICE OECD Countries' Geographic Search Filters: Part 1-Methodology for Developing the Draft MEDLINE and Embase (Ovid) Filters. J Med Libr Assoc. 2021;109(2):258-66. DOI: https://doi.org/10.5195/jmla.2021.978.
6. Zeidan A. Nordic Countries. Encyclopedia Britannica 2025.
7. Nordic Co-Operation in the Welfare Sector [Internet]. Nordic Welfare Center [cited 19 Aug 2025]. https://nordicwelfare.org/en/.
8. Himmels JPW, Magnusson K, Brurberg KG. Systematic Review of Post-COVID Condition in Nordic Population-Based Registry Studies. Nat Commun. 2025;16(1):5717. DOI: https://doi.org/10.1038/s41467-025-60784-4.
9. Åkerman E, Wängborg A, Persson M, Klingberg-Allvin M. Experiences of Menstrual Health in the Nordic Countries: A Scoping Review of Qualitative Research, Applying an Intersectional Lens. Sex Reprod Health Matters. 2024;32(1):2446081. DOI: https://doi.org/10.1080/26410397.2024.2446081.
10. Sheikh NS, Biele GPE, Straiton ML, Kjøllesdal MKR. Health Among Youth and Young Adults Born in the Nordic Countries to Immigrant Parents: A Scoping Review. BMC Public Health. 2025;25(1):243. DOI: https://doi.org/10.1186/s12889-025-21426-y.
11. InterTASC Information Specialists’ Sub-Group. Geographic Filters [Internet]. InterTASC Information Specialists’ Sub-Group [cited 13 Aug 2025]. https://sites.google.com/a/york.ac.uk/issg-search-filters-resource/home/geography.
12. Glanville J, Bayliss S, Booth A, Dundar Y, Fernandes H, Fleeman ND, Foster L, Fraser C, Fry-Smith A, Golder S, Lefebvre C, Miller C, Paisley S, Payne L, Price A, Welch K. So many filters, so little time: the development of a search filter appraisal checklist. J Med Libr Assoc. 2008;96(4):356-61. DOI: https://doi.org/10.3163/1536-5050.96.4.011.
13. Heintz M, Tornes RA. Filter for nordiske forhold [Filter for Nordic conditions]. Folkehelseinstituttet, 2025. DOI: https://doi.org/10.21349/rj8p-5k32. Norwegian.
14. Ayiku L, Craven J, Hudson T, Levay P. How to Develop a Validated Geographic Search Filter: Five Key Steps. Evid Based Lib Inf Pract. 2020;15(1):170-8. DOI: https://doi.org/10.18438/eblip29633.
15. Frické M. Measuring recall. J Inf Sci. 1998;24(6):409-17. DOI: https://doi.org/10.1177/016555159802400604.
16. Sampson M, Zhang L, Morrison A, Barrowman NJ, Clifford TJ, Platt RW, Klassen TP, Moher D. An Alternative to the Hand Searching Gold Standard: Validating Methodological Search Filters Using Relative Recall. BMC Med Res Methodol. 2006;6(1):33. DOI: https://doi.org/10.1186/1471-2288-6-33.
17. Muente C, Pachanov A, Hirt J, Ayiku L, Pieper D. Validated Geographic Search Filters for Bibliographic Databases: A Scoping Review. JBI Evid Synth. 2025;23(8) DOI: https://doi.org/10.11124/JBIES-24-00395.
18. AntConc (Version 4.2.4). Waseda University, Tokyo, Japan; https://www.laurenceanthony.net/software/AntConc.
19. Potts A, Baker P. Does Semantic Tagging Identify Cultural Change in British and American English? Int J Corpus Linguist. 2012;17(3):295-324. DOI: https://doi.org/10.1075/ijcl.17.3.01pot.
20. Smalheiser NR, Zhou W, Torvik VI. Anne O'Tate: A Tool to Support User-Driven Summarization, Drill-Down and Browsing of PubMed Search Results. J Biomed Discov Collab. 2008;3(1):2. DOI: https://doi.org/10.1186/1747-5333-3-2.
21. Ayiku L, Hudson T, Glover S, Walsh N, Adams R, Deane J, Finnegan A. The NICE MEDLINE and Embase (Ovid) Health Apps Search Filters: Development of Validated Filters to Retrieve Evidence About Health Apps. Int J Technol Assess Health Care. 2021;37(1):e16. DOI: https://doi.org/10.1017/S026646232000080X.
22. Askin N, Mueller MH. Acute Mental Health Concerns in Emergency Settings: Development and Validation of an Ovid MEDLINE Search Filter. J Medical Library Assn. 2025;113(3):195-203. DOI: https://doi.org/10.5195/jmla.2025.2081.
23. Balaj M, York HW, Sripada K, Besnier E, Vonen HD, Aravkin A, Friedman J, Griswold M, Jensen MR, Mohammad T, Mullany EC, Solhaug S, Sorensen R, Stonkute D, Tallaksen A, Whisnant J, Zheng P, Gakidou E, Eikemo TA. Parental Education and Inequalities in Child Mortality: A Global Systematic Review and Meta-Analysis. Lancet. 2021;398(10300):608-20. DOI: https://doi.org/10.1016/S0140-6736(21)00534-1.
24. Ayiku L, Hudson T, Williams C, Levay P, Jacob C. The NICE OECD Countries' Geographic Search Filters: Part 2-Validation of the MEDLINE and Embase (Ovid) Filters J Med Libr Assoc. 2021;109(4):583-9. DOI: https://doi.org/10.5195/jmla.2021.1224.
25. Elvbakken K-T, Veggeland F. The Roots and Routes of Public Health Institutes in Scandinavia. Scan Polit Stud. 2024;47(4):601-23. DOI: https://doi.org/10.1111/1467-9477.12286.
26. Ayiku L, Levay P, Hudson T, Craven J, Finnegan A, Adams R, Barrett E. The Embase UK Filter: Validation of a Geographic Search Filter to Retrieve Research about the UK from OVID Embase. Health Info Libr J. 2019;36(2):121-33. DOI: https://doi.org/10.1111/hir.12252.
27. Valderas JM, Mendivil J, Parada A, Losada-Yáñez M, Alonso J. Development of a Geographic Filter for PubMed to Identify Studies Performed in Spain. Rev Esp Cardiol (Engl Ed). 2006;59(12):1244-51. DOI: https://doi.org/10.1016/S1885-5857(07)60080-2.
28. Pienaar E, Grobler L, Busgeeth K, Eisinga A, Siegfried N. Developing a Geographic Search Filter to Identify Randomised Controlled Trials in Africa: Finding the Optimal Balance Between Sensitivity and Precision. Health Info Libr J. 2011;28(3):210-5. DOI: https://doi.org/10.1111/j.1471-1842.2011.00936.x.
Additional Files
Published
Issue
Section
License
Copyright (c) 2026 Malin Barkelind
This work is licensed under a Creative Commons Attribution 4.0 International License.
