The NICE OECD countries’ geographic search filters: Part 1—methodology for developing the draft MEDLINE and Embase (Ovid) filters
DOI:
https://doi.org/10.5195/jmla.2021.978Keywords:
search filter, literature searching, MEDLINE, Embase, GeographyAbstract
Objective: There are no existing validated search filters for the group of 37 Organisation for Economic Co-operation and Development (OECD) countries. This study describes how information specialists from the United Kingdom’s National Institute for Health and Care Excellence (NICE) developed and evaluated novel OECD countries’ geographic search filters for MEDLINE and Embase (Ovid) to improve literature search effectiveness for evidence about OECD countries.
Methods: We created the draft filters using an alternative approach to standard filter construction. They are composed entirely of geographic subject headings and are designed to retain OECD country evidence by excluding non-OECD country evidence using the NOT Boolean operator. To evaluate the draft filters’ effectiveness, we used MEDLINE and Embase literature searches for three NICE guidelines that retrieved >5,000 search results. A 10% sample of the excluded references was screened to check that OECD country evidence was not inadvertently excluded.
Results: The draft MEDLINE filter reduced results for each NICE guideline by 9.5% to 12.9%. In Embase, search results were reduced by 10.7% to 14%. Of the sample references, 7 of 910 (0.8%) were excluded inadvertently. These references were from a guideline about looked-after minors that concerns both OECD and non-OECD countries.
Conclusion: The draft filters look promising—they reduced search result volumes while retaining most OECD country evidence from MEDLINE and Embase. However, we advise caution when using them in topics about both non-OECD and OECD countries. We have created final versions of the search filters and will validate them in a future study.
References
Organisation for Economic Co-operation and Development. Organisation for Economic Co-operation and Development website [Internet]. Paris: Members and partners. http://www.oecd.org/about/members-and-partners/ [2020; cited 8 Dec 2020].
Trade Union Advisory Committee (TUAC) to the OECD. OECD Membership and the Values of the Organisation [Internet]. Paris: Trade Union Advisory Committee (TUAC) to the OECD [2018; cited 8 Dec 2020] https://tuac.org/news/oecd-membership-and-the-values-of-the-organisation/.
National Institute for Health and Care Excellence. National Institute for Health and Care Excellence website [Internet]. London: National Institute for Health and Care Excellence [2020; cited 8 Dec 2020] https://www.nice.org.uk/.
National Institute for Health and Care Excellence. Chapter 5 Identifying the evidence: Literature searching and evidence submission. In: National Institute for Health and Care Excellence (Ed.), Developing NICE guidelines: The manual (PMG20) [Internet]. London: National Institute for Health and Care Excellence [2018; cited 8 Dec 2020] https://www.nice.org.uk/process/pmg20/chapter/identifying-the-evidence-literature-searching-and-evidence-submission.
National Institute for Health and Care Excellence. NG33 Tuberculosis [Internet]. London: National Institute for Health and Care Excellence [2019; cited 8 Dec 2020] https://www.nice.org.uk/guidance/ng33.
National Institute for Health and Care Excellence. NG77 Cataracts in adults: management [Internet]. London: National Institute for Health and Care Excellence [2017; cited 30 Nov 2020] https://www.nice.org.uk/guidance/ng77.
National Institute for Health and Care Excellence. NG13 Workplace health: management practices [Internet]. London: National Institute for Health and Care Excellence [2015; cited 8 Dec 2020] https://www.nice.org.uk/guidance/ng13.
National Institute for Health and Care Excellence. PH55 Oral health: local authorities and partners [Internet]. London: National Institute for Health and Care Excellence [2014; cited 8 Dec 2020] https://www.nice.org.uk/guidance/ph55.
Glanville J, Bayliss S, Booth A, Dundar Y, Fernandes H, Fleeman ND, Foster L, Fraser C, Fry-Smith A, Golder S, Lefebvre C, Miller C, Paisley S, Payne L, Price A, Welch K. So many filters, so little time: The development of a search filter appraisal checklist. J Med Libr Assoc. 2008 Oct;96(4):356–361. DOI: http://dx.doi.org/10.3163/1536-5050.96.4.011.
Jenkins M. Evaluation of methodological search filters: A review. Health Info Libr J. 2004 Aug;21(3):148-163. DOI: https://doi.org/10.1111/j.1471-1842.2004.00511.x.
Glanville J, Lefebvre C, Wright K. The InterTASC Information Specialists’ Sub?Group Search Filter Resource [Internet]. York: University of York [2020; cited 8 Dec 2020] https://sites.google.com/a/york.ac.uk/issg-search-filters-resource/home.
Pienaar E, Grobler L, Busgeeth K, Eisinga A, Siegfried N. Developing a geographic search filter to identify randomised controlled trials in Africa: Finding the optimal balance between sensitivity and precision. Health Info Libr J. 2011 Mar;28(3):210–215. DOI: https://doi.org/10.1111/j.1471-1842.2011.00936.x.
Valderas J, Mendivil J, Parada A, Losada?Yáñez M, Alonso J. Development of a geographic filter for PubMed to identify studies performed in Spain. Revista Española de Cardiología. 2006; 59(12):1244-1251. DOI: https://doi.org/10.1016/S1885-5857(07)60080-2 .
Ayiku L, Levay P, Hudson T, Craven J, Barrett E, Finnegan A, Adams R. The MEDLINE UK filter: development and validation of a geographic search filter to retrieve research about the UK from OVID MEDLINE. Health Info Libr J. 2017 Jul;34(3):200-216. DOI: https://onlinelibrary.wiley.com/doi/full/10.1111/hir.12187
Ayiku L, Levay P, Hudson T, Craven J, Finnegan A, Adams R, Barrett E. The Embase UK filter: validation of a geographic search filter to retrieve research about the UK from OVID Embase. Health Info Libr J. 2019 Mar;36(2):121-133. DOI: https://onlinelibrary.wiley.com/doi/full/10.1111/hir.12252
Ayiku L, Levay P, Hudson T, Finnegan A. The NICE UK geographic search filters for MEDLINE and Embase (Ovid): Post-development study to further evaluate precision and number-needed-to-read when retrieving UK evidence. Res Synth Methods. 2020 Sept;11(5):669-677. DOI: https://onlinelibrary.wiley.com/doi/abs/10.1002/jrsm.1431.
National Institute for Health and Care Excellence. NG106 Chronic heart failure in adults: diagnosis and management [Internet]. London: National Institute for Health and Care Excellence [2018; cited 8 Dec 2020] https://www.nice.org.uk/guidance/ng106.
National Institute for Health and Care Excellence. NG97 Dementia: assessment, management and support for people living with dementia and their carers [Internet]. London: National Institute for Health and Care Excellence [2018; cited 8 Dec 2020] https://www.nice.org.uk/guidance/ng97.
National Institute for Health and Care Excellence (2020). NG150 Supporting adult carers [Internet]. London: National Institute for Health and Care Excellence [2020; cited 8 Dec 2020] https://www.nice.org.uk/guidance/ng150.
Cantrell A, Croot E, Johnson M, Wong R, Chambers D, Baxter SK, Booth A. Access to primary and community health-care services for people 16 years and over with intellectual disabilities: a mapping and targeted systematic review. NIHR Health Services and Delivery Research. 2020;8(5). ISSN 2050-4349 NBK553283 https://www.ncbi.nlm.nih.gov/books/NBK553283/.
Public Health England. The older adults’ NHS and social care return on investment tool: Technical report [Internet]. London: Public Health England [2020; cited 8 Dec 2020] https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/860616/Older_Adults_NHS_and_Social_Care_ROI_Tool_-_Technical_Report__2_.pdf.
British Thoracic Society. Literature review: the economic costs of lung disease and the cost effectiveness of policy and service interventions [Internet]. London: British Thoracic Society [2017; cited 8 Dec 2020] < http://allcatsrgrey.org.uk/wp/download/respiratory_diseases/download.pdf >.
Association Pour L'Advancement Des Science Et Des Techniques. Pays de l'OCDE (OECD countries) [Internet]. Quebec: Association Pour L'Advancement Des Science Et Des Techniques [2018; cited 8 Dec 2020] http://extranet.santecom.qc.ca/wiki/!biblio3s/doku.php?id=concepts:pays-de-l-ocde.
Dickersin K, Scherer R, Lefebvre C. Identifying relevant studies for systematic reviews. BMJ. 1994 Nov;309(6964):1286-91. DOI:10.1136/bmj.309.6964.1286.
Lefebvre C, Glanville J, Briscoe S, Littlewood A, Marshall C, Metzendorf M-I, Noel-Storr A, Rader T, Shokraneh F, Thomas J, Wieland LS. Technical Supplement to Chapter 4: Searching for and selecting studies. In: Higgins JPT, Thomas J, Chandler J, Cumpston MS, Li T, Page MJ, Welch VA (eds). Cochrane Handbook for Systematic Reviews of Interventions Version 6 [Internet]. London: Cochrane [2019; cited 8 Dec 2020] www.training.cochrane.org/handbook.
Encyclopaedia Britannica. French Guiana [Internet]. Chicago: Encyclopaedia Britannica [2020; cited 8 Dec 2020] https://www.britannica.com/place/French-Guiana.
Encyclopaedia Britannica. Gibraltar [Internet]. Chicago: Encyclopaedia Britannica [2020; cited 8 Dec 2020] https://www.britannica.com/place/Gibraltar.
National Institute for Health and Care Excellence. Indoor air quality at home [Internet]. London: National Institute for Health and Care Excellence [2020; cited 8 Dec 2020] https://www.nice.org.uk/guidance/ng149.
National Institute for Health and Care Excellence. Looked-after children and young people (in development) [Internet]. London. National Institute for Health and Care Excellence [due 2021; cited 8 Dec 2020] https://www.nice.org.uk/guidance/indevelopment/gid-ng10121.
National Institute for Health and Care Excellence. Social, emotional and mental wellbeing in primary and secondary education (in development) [Internet]. National Institute for Health and Care Excellence: London [due 2022; cited 8 Dec 2020] https://www.nice.org.uk/guidance/indevelopment/gid-ng10125.
King K, Browning JC, Metry DW, Prestigiacomo J, Scollard D, Schutze GE, Stryjewska B, Schwarzwald H. Leprosy and international adoption: a case report and review of diagnostic and treatment dilemmas. J Pediatr Infect Dis; 2009 Apr;28(4):322-5. DOI: https://doi.org/10.1097/inf.0b013e31818de21e.
Tan TX. Developmental delays at arrival, early intervention enrollment, and adopted Chinese girls' academic performance and internalizing problems in adolescence. J Genet Psychol. 2014 Jun;175(34):318-31 https://doi.org/10.1080/00221325.2014.913547.
Fuglestad AJ, Kroupina MG, Johnson DE, Georgieff MK. Micronutrient status and neurodevelopment in internationally adopted children. Acta Paediatr; 2016 Oct;105(2):e67-e76. DOI: https://doi.org/10.1111/apa.13234.
Raabe VN, Sautter C, Chesney M, Eckerle JK, Howard CR, John CC. Hepatitis A screening for internationally adopted children from hepatitis A endemic countries. Clin Pediatr. 2014 Oct;53(1):31-37. DOI: https://doi.org/10.1177/0009922813505903.
Roman M, Palacios J, Moreno C, Lopez A. Attachment representations in internationally adopted children. Attach Human Dev. 2012 Oct;14(6):585-600. DOI: https://doi.org/10.1080/14616734.2012.727257.
Williams B, Boullier M, Cricks Z, Ward A, Naidoo R, Williams A, Robinson K, Eisen S, Cohen J. Screening for infection in unaccompanied asylum-seeking children and young people. Arch Dis Child. 2020 Feb;318077. DOI: https://doi.org/10.1136/archdischild-2019-318077.
Buonsenso D, Graffeo R, Scarlato L, Acampora A, Grotti G, Scerlato L, Pata D, Colonna AT, Salerno G, Colussi L, Masucci L, Valentini P. Intestinal Parasitic Infections in Internationally Adopted Children: A 10-Year Retrospective Study. Pediatr Infect Dis J. 2019 Oct;38(10):983-989. DOI: https://doi.org/10.1097/inf.0000000000002399.
Lefebvre C, Glanville J, Briscoe S, Littlewood A, Marshall C, Metzendorf M, Noel?Storr A, Rader T, Shokraneh F, Thomas JL, Wieland S on behalf of the Cochrane Information Retrieval Methods Group. Chapter 4: Searching for and selecting studies. Higgins JPT, Thomas J, Chandler J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA. (Eds.), Cochrane Handbook for Systematic Reviews of Interventions Version 6 [Internet]. London: Cochrane [2019; cited 30 Nov 2020] https://onlinelibrary.wiley.com/doi/abs/10.1002/9781119536604.ch4.
Sampson M, Zhang L, Morrison A, Barrowman NJ, Clifford TJ, Platt RW, Klassen TP, Moher D. An alternative to the hand searching gold standard: validating methodological search filters using relative recall. BMC Med Res Methodol. 2006 Jul;6(1):33. DOI: https://doi.org/10.1186/1471-2288-6-33.
Macmillan dictionary. The BRIC countries [Internet]. London: Macmillan [2020; cited 30 Nov 2020] https://www.macmillandictionary.com/dictionary/british/the-bric-countries.
The World Bank Group. High Income [Internet]. Washington: The World Bank Group: Washington [2020; cited 30 Novr 2020] https://data.worldbank.org/income-level/high-income?view=chart .
Ayiku L, Craven J, Hudson T, Levay P. How to Develop a Validated Geographic Search Filter: Five Key Steps. EBLIP. 2020 Mar; 15(1): 170-178. DOI: https://doi.org/10.18438/eblip29633.