Understanding the performance of geographic limits on Web of Science Core Collection databases, using the United Kingdom as an example

Authors

DOI:

https://doi.org/10.5195/jmla.2024.1669

Keywords:

geographic search filters, information retrieval, literature searching, web of science, core collection

Abstract

Objective: To consider the approaches within Web of Science Core Collection (WoSCC) databases for limiting geographically. To compare the limits to an adaptation of NICE’s UK MEDLINE filter for use on WoSCC databases.

Methods: We tested and appraised the inbuilt functions and search field options that support identification by countries/regions and affiliations. We compared these with an adapted filter to identify healthcare research on or about the UK. We calculated the recall of the inbuilt limits and filter using 177 studies and investigated why records were missed. We also calculated the percentage reduction of the overall number-needed-to-screen (ONNS).

Results: Inbuilt limits within WoSCC enable identification of research from specific countries/regions or affiliations if there is data in the address field. Refining by affiliations allows retrieval of research where affiliations are in the 200 or 500 most frequent for a set of results. An adaptation of the UK MEDLINE filter achieved an average of 97% recall. ONNS was significantly reduced using the filter. However, studies where the countries or regions are only mentioned within the full text or other non-searchable fields will be missed.

Conclusions: Information specialists should consider how inbuilt geographic limits operate on WoSCC and whether these are suitable for their research. The adapted filter can sensitively limit to the UK and could be useful for systematic reviews due to its high recall and ability to significantly reduce ONNS. Geographic filters can be feasible to adapt for use on WoSCC databases (where similar search fields are used between platforms).

References

Ayiku L, Levay P, Hudson T, Finnegan A. The NICE UK geographic search filters for MEDLINE and Embase (Ovid): Post‐development study to further evaluate precision and number‐needed‐to‐read when retrieving UK evidence. Research Synthesis Methods. 2020;11:669–677. https://dx.doi.org/10.1002/jrsm.1431.

Ayiku L, Craven J, Hudson T, Levay P. How to develop a validated geographic search filter: Five key steps. Evidence Based Library and Information Practice. 2020;15(1):170-178. https://dx.doi.org/10.18438/eblip29633.

Ayiku L, Levay P, Hudson T, Craven J, Barrett E, Finnegan A, et al. The MEDLINE UK filter: development and validation of a geographic search filter to retrieve research about the UK from OVID MEDLINE. Health Information Libraries Journal. 2017;34(3):200-216. https://dx.doi.org/10.1111/hir.12187.

Ayiku L, Levay P, Hudson T, Craven J, Barrett E, Finnegan A, et al. The MEDLINE UK filter: development and validation of a geographic search filter to retrieve research about the UK from OVID MEDLINE. Health Information Libraries Journal. 2017;34(3):200-216. https://dx.doi.org/10.1111/hir.12187.

Ayiku L, Levay P, Hudson T, Craven J, Barrett E, Finnegan A, et al. The MEDLINE UK filter: development and validation of a geographic search filter to retrieve research about the UK from OVID MEDLINE. Health Information Libraries Journal. 2017;34(3):200-216. https://dx.doi.org/10.1111/hir.12187.

Sutton A, Campbell F. The ScHARR LMIC filter: Adapting a low‐ and middle‐income countries geographic search filter to identify studies on preterm birth prevention and management. Research Synthesis Methods. 2022;13(4):447-456. https://dx.doi.org/10.1002/jrsm.1552.

ISSG Search filters resource [Internet]. The InterTASC Information Specialists' Sub-Group; n.d. [cited 9 August 2022]. https://sites.google.com/a/york.ac.uk/issg-search-filters-resource/.

Hirt J, Buhtz C, Meyer G, Balzer K. Publikationen aus dem deutschsprachigen raum in zeitschriften mit hohem impact factor: entwicklung und validierung eines suchfilters. Pflege. 2019; 32(2):97-106. https://dx.doi.org/10.1024/1012-5302/a000658.

Trusted publisher-independent paper database - Web of Science Group [Internet]. Clarivate Analytics; n.d. [cited 9 August 2022]. https://clarivate.com/webofsciencegroup/solutions/web-of-science/.

Birkle C, Pendlebury DA, Schnell J, & Adams J. Web of Science as a data source for research on scientific and scholarly activity. Quantitative Science Studies. 2020;1(1):363–376. https://doi.org/10.1162/qss_a_00018.

Stansfield C, & Liabo K. Identifying social care research literature: case studies from guideline development. Evidence Based Library and Information Practice. 2017;12(3):114–131. https://doi.org/10.18438/B8M371.

Liu W. The data source of this study is Web of Science Core Collection? Not enough. Scientometrics. 2019;121(3):1815–1824. https://doi.org/10.1007/s11192-019-03238-1.

Personal communication [Internet]. E-mail to WoSG Support, 20 April 2022.

Web of Science Core Collection: Viewing affiliation-enhanced name(s) [Internet]. Clarivate Analytics; n.d. [cited 9 August 2022]. https://support.clarivate.com/ScientificandAcademicResearch/s/article/Web-of-Science-Core-Collection-Viewing-Organization-Enhanced-Names?language=en_US.

Ayiku L, Levay P, Hudson T, Craven J, Barrett E, Finnegan A, et al. The MEDLINE UK filter: development and validation of a geographic search filter to retrieve research about the UK from OVID MEDLINE. Health Information Libraries Journal. 2017;34(3):200-216. https://dx.doi.org/10.1111/hir.12187.

Rees R, Oliver K, Woodman J, Thomas J. Children’s views about obesity, body size, shape and weight: a systematic review. EPPI Centre, Social Science Research Unit, Institute of Education, University of London; 2009 [cited 15 August 2023]. https://eppi.ioe.ac.uk/cms/Default.aspx?tabid=2463.

National Institute for Health and Care Excellence. Appendix A. In: Transition from children’s to adults' services for young people using health or social care services: NICE guideline [NG43]. NICE; 2016 [cited 15 August 2023]. https://www.nice.org.uk/guidance/ng43/evidence/appendix-a-how-this-guideline-was-developed-pdf-2360240174.

Stokes G, Rees R, Khatwa M, Stansfield C, Burchett H, Dickson, K, Brunton G, Thomas J. Public health service provision by community pharmacies: a systematic map of evidence. EPPI Centre, Social Science Research Unit, Institute of Education, University College London; 2019 [cited 15 August 2023]. https://eppi.ioe.ac.uk/cms/Default.aspx?tabid=3753.

Personal communication [Internet]. E-mail to Paul Levay, 27 April 2022.

Bethel AC, Rogers M, Abbott R. Use of a search summary table to improve systematic review search methods, results, and efficiency. Journal of the Medical Library Association: JMLA. 2021 Jan 1;109(1):97. https://doi.org/10.5195/jmla.2021.809.

Personal communication [Internet]. E-mail to WoSG Support, 22 April 2022.

Personal communication [Internet]. E-mail to WoSG Support, 20 April 2022.

Web of Science Core Collection help: advanced search field tags [Internet]. Clarivate Analytics; n.d. [cited 11 July 2023]. https://images.webofknowledge.com/images/help/WOS/hs_advanced_fieldtags.html.

Personal communication [Internet]. E-mail to WoSG Support, 24 July 2023.

Personal communication [Internet]. E-mail to WoSG Support, 29 June 2023.

Personal communication [Internet]. E-mail to WoSG Support, 29 June 2023.

Web of Science help: analyze results [Internet]. Clarivate Analytics; n.d. [cited 11 July 2023]. https://webofscience.help.clarivate.com/en-us/Content/analyze-results.html.

Personal communication [Internet]. E-mail to WoSG Support, 20 April 2022.

Web of Science Core Collection advanced search field tags [Internet]. Clarivate Analytics; n.d. [cited 9 August 2022]. https://webofscience.help.clarivate.com/en-us/Content/wos-core-collection/woscc-search-field-tags.htm.

Web of Science Core Collection help: advanced search field tags [Internet]. Clarivate Analytics; n.d. [cited 11 July 2023]. https://images.webofknowledge.com/images/help/WOS/hs_advanced_fieldtags.html.

Web of Science Core Collection: Viewing affiliation-enhanced name(s) [Internet]. Clarivate Analytics; n.d. [cited 9 August 2022]. https://support.clarivate.com/ScientificandAcademicResearch/s/article/Web-of-Science-Core-Collection-Viewing-Organization-Enhanced-Names?language=en_US.

Personal communication [Internet]. E-mail to WoSG Support, 27 April 2022.

Web of Science Core Collection help: advanced search field tags [Internet]. Clarivate Analytics; n.d. [cited 11 July 2023]. https://images.webofknowledge.com/images/help/WOS/hs_advanced_fieldtags.html.

Web of Science Core Collection advanced search field tags [Internet]. Clarivate Analytics; n.d. [cited 28 July 2023]. https://webofscience.help.clarivate.com/en-us/Content/wos-core- collection/woscc-search-field-tags.htm.

Personal communication [Internet]. E-mail to WoSG Support, 20 April 2022.

Sutton A, Campbell F. The ScHARR LMIC filter: Adapting a low‐ and middle‐income countries geographic search filter to identify studies on preterm birth prevention and management. Research Synthesis Methods. 2022;13(4):447-456. https://dx.doi.org/10.1002/jrsm.1552.

Ayiku L, Levay P, Hudson T, Finnegan A. The NICE UK geographic search filters for MEDLINE and Embase (Ovid): Post‐development study to further evaluate precision and number‐needed‐to‐read when retrieving UK evidence. Research Synthesis Methods. 2020;11:669–677. https://dx.doi.org/10.1002/jrsm.1431.

Downloads

Additional Files

Published

2024-10-07

Issue

Section

Original Investigation