Thirty-seven OECD countries
Lynda Ayiku1, Paul Levay2, Thomas Hudson3
doi: http://dx.doi.org/10.5195/jmla.2021.978
Volume 109, Number 2: 258-266
Received 07 2020: Accepted 12 2020
ABSTRACT
Objective:There are no existing validated search filters for the group of 37 Organisation for Economic Co-operation and Development (OECD) countries. This study describes how information specialists from the United Kingdom's National Institute for Health and Care Excellence (NICE) developed and evaluated novel OECD countries’ geographic search filters for MEDLINE and Embase (Ovid) to improve literature search effectiveness for evidence about OECD countries.
Methods:We created the draft filters using an alternative approach to standard filter construction. They are composed entirely of geographic subject headings and are designed to retain OECD country evidence by excluding non-OECD country evidence using the NOT Boolean operator. To evaluate the draft filters’ effectiveness, we used MEDLINE and Embase literature searches for three NICE guidelines that retrieved >5,000 search results. A 10% sample of the excluded references was screened to check that OECD country evidence was not inadvertently excluded.
Results:The draft MEDLINE filter reduced results for each NICE guideline by 9.5% to 12.9%. In Embase, search results were reduced by 10.7% to 14%. Of the sample references, 7 of 910 (0.8%) were excluded inadvertently. These references were from a guideline about looked-after minors that concerns both OECD and non-OECD countries.
Conclusion:The draft filters look promising—they reduced search result volumes while retaining most OECD country evidence from MEDLINE and Embase. However, we advise caution when using them in topics about both non-OECD and OECD countries. We have created final versions of the search filters and will validate them in a future study.
Keywords: search filter; literature searching; MEDLINE; Embase; Geography.
The Organisation for Economic Co-operation and Development (OECD) is an international agency that works in collaboration with member countries to develop policies for the reduction of inequality and poverty in all nations [1]. OECD members must be democratic and have open, transparent, free-market economies [2]. There are currently 37 OECD country members (Figure 1).
Figure 1Thirty-seven OECD countries
The National Institute for Health and Care Excellence (NICE) in the United Kingdom (U.K.) produces evidence-based national guidance and advice with the aim of improving health and social care [3]. There are nearly 200 NICE guidelines on a variety of clinical, public health and social care topics. The guidelines provide evidence-based recommendations on preventing or managing specific conditions and on planning services and interventions to improve the health of communities [3]. They are used to advise health and social care professionals on how to manage people in their care and deliver services. Evidence about the U.K. and similar countries is often required to inform NICE guideline recommendations. OECD countries are often used as a proxy for countries with similarities to the U.K. [4–8].
Search filters are collections of pre-made, reusable search terms that are applied to bibliographic database literature searches to retrieve evidence with a common feature [9]. Search filters are different from search strategies because their recall (also known as “sensitivity”) has been tested and validated against a gold standard (GS) set (also known as a “reference set”) of known relevant records [10]. Recall is the proportion of references that a filter retrieves from the GS set [10]. The recall figure provides users with an indication of how well the filter works in retrieving the type of evidence they require [10].
Geographic search filters aim to retrieve evidence about geographic locations, such as continents or countries. The InterTASC Information Specialists’ Sub-Group (ISSG) Search Filter Resource is updated regularly through high-quality systematic searches of relevant literature to identify filters [11]. As of December 2020, validated filters for three geographic areas were available in the resource:
We previously developed and validated the NICE U.K. geographic search filters for MEDLINE and Embase (Ovid) [14, 15]. These filters retrieve evidence about the U.K. effectively and efficiently when needed for context-sensitive NICE guidance topics [14–16]. They have been used to inform U.K.-focused topics in NICE guidelines [17–19] as well as national reports and systematic reviews produced by external organizations [20–22].
The ISSG search filter resource [11] contains an untested search strategy for OECD countries, [23] but no validated search filters for OECD countries are available. This means that geographic limits are not applied to literature searches for NICE guidelines when OECD country evidence is required. The search process for identifying evidence about OECD countries was time-consuming and inefficient. For example, the NICE guideline on tuberculosis [5] required only OECD evidence as an inclusion criterion. However, because validated filters for OECD countries were not available, no geographic restrictions were applied to the search strategy, and the relevant references had to be selected from all the search results.
Due to the large number of OECD country members, it would be challenging to develop an effective search filter following the “third generation” search filter development approach, in which search terms are derived objectively through word frequency analysis on a set of relevant references [10]. Instead, the “second generation” search filter development approach was employed to draft the OECD countries filters subjectively, using knowledge about the subject [10].
Creating a geographic search filter for OECD countries that includes free-text terms would be difficult and time-consuming. From our experience gained from developing the NICE U.K. filters [14, 15] plus information from the Spain filter [12], a geographic filter with free-text terms would need to include the following:
As a pragmatic solution to the challenges of creating filters for OECD countries, we adopted the structure of the “humans” limit for the draft filters as a solution to the challenges of using free-text terms. The humans limit was devised by Carol Lefebvre to exclude results about animals and retain results about humans and was originally appended to a search filter for systematic reviews [24]. The limit was created for the MEDLINE bibliographic database and comprises National Library of Medicine (NLM) Medical Subject Heading (MeSH) terms alone. The limit works by excluding MEDLINE records for animal studies that are indexed with only the “animal” MeSH term using the NOT Boolean operator [24]. It retains MEDLINE records that are indexed with both the human and animal MeSH terms in addition to retaining records that are not indexed with either the human or animal MeSH terms [24].
Since its creation, the humans limit has been adopted widely in literature searches and modified in relation to updates made to MeSH terms and searching functions in MEDLINE. For instance, the Cochrane Highly Sensitive Search Strategies for identifying randomized trials in MEDLINE contain an updated version of the limit [25]. The humans limit has also been translated for use in other databases. The limit is applied to search strategies using the NOT Boolean operator: NOT ([animal subject headings] NOT [human subject headings]).
A limitation of using subject headings alone in the humans limit is that references that are about animals but that are not indexed with subject headings for animals are retained in the search results. However, it would be inadvisable to add free-text terms to the limit because relevant references about humans could be inadvertently excluded if omissions in terms about humans are made. Using subject headings alone reduces the risk of relevant references being missed.
In March 2020, we created draft NICE OECD countries filters to examine the feasibility of the humans limit approach for retaining OECD country evidence and excluding non-OECD evidence. The aim of our study is to improve the effectiveness of literature searches when evidence about OECD countries is required. Our objectives are to develop geographic search filters that retrieve evidence about OECD countries effectively and validate the search filters. We will also share the search filters with information professionals, researchers and health professionals and advise on their use.
In this paper we focus on objective 1.
Following the humans limit structure [24], the drafts comprise a set of geographic subject heading terms (MeSH in MEDLINE and Emtree in Embase) for OECD countries plus related subject headings and a separate set of geographic subject headings that were available for the non-OECD countries [1]. In our study, non-OECD countries are defined as those that are not members of the OECD.
The draft filters contain subject headings for 36 of the 37 OECD country members. The filters were drafted in March 2020, and Colombia did not become an OECD member until April 2020 [1]. We included Colombia in the non-OECD country subject headings in the drafts.
We created the draft MEDLINE filter first. To identify individual geographic subject headings, we “exploded” the Geographic Locations/MeSH term to reveal the narrower headings beneath. We selected subject headings for the 36 OECD countries in addition to relevant geographic regions that include the countries (for example, Australasia for Australia and New Zealand). Where relevant, we opted for efficiency by exploding geographic subject headings to capture subject headings for the OECD countries simultaneously. For example, ‘exp “Scandinavian and Nordic countries"/’ was used to retrieve subject headings for Denmark, Finland, Iceland, Norway and Sweden. We combined the subject headings with the OR Boolean operator.
We also added further subject headings of relevance to OECD countries. The MeSH terms “Organisation for Economic Co-Operation and Development"/, “Developed Countries”/and “European Union”/were selected and combined with the other OECD country MeSH terms using the OR Boolean operator.
Next, we identified MeSH terms for non-OECD countries from the narrower headings beneath the Geographic Locations/MeSH subject heading. These headings were combined with the OR Boolean operator.
When the draft MEDLINE filter was complete, we created the draft Embase filter. The Geographic Names/Emtree term was “exploded” and the same process was used to select OECD and non-OECD country headings.
We found the identification of OECD and non-OECD country subject headings to be complex in some cases. For instance, some geographically remote overseas territories are linked to OECD countries. Examples include French Guiana, which is an overseas region of the French Republic, and Gibraltar, which is on overseas territory of the United Kingdom [26, 27]. The relevance of evidence from territories such as these was unclear. We decided to omit subject headings such as these from the exclusion line of the filters to ensure that references about these territories were retained.
Following the humans limit structure [24], the draft NICE OECD countries filters must be applied to literature search strategies using the NOT Boolean operator. This contrasts with the usual use of the AND Boolean operator to apply search filters to search strategies with the aim of retrieving evidence directly. We used the NOT Boolean operator to exclude evidence about non-OECD countries. We structured the draft NICE OECD filters as follows:
* NOT ([‘Non-OECD country’ subject heading terms] NOT [‘OECD country’ subject heading])
The draft NICE OECD filters aim to do the following:
The Venn diagram in Figure 2 illustrates the concepts above.
Figure 2Venn diagram showing the conceptual structure of the OECD countries filters (not to scale)
We applied the draft filters to MEDLINE and Embase (Ovid) literature search strategies for the following three NICE guidelines:
We chose the literature search strategies for these guidelines because they retrieved >5,000 results in both the MEDLINE and Embase databases, and we believed the large search results would provide useful sets to test the ability of the filters to exclude non-OECD country references and retain OECD country references. The MEDLINE literature search strategies can be found in Appendix 1, and the Embase literature search strategies can be found in Appendix 2.
On March 31 and April 1 of 2020, we re-ran the MEDLINE and Embase literature search strategies for each of the guidelines and applied the relevant draft filter to each of the strategies. The MEDLINE filter was applied to the MEDLINE strategies and the Embase filter was applied to the Embase strategies. We calculated and recorded the percentage of results that were excluded by the filters by comparing the number of results retrieved by the original strategies with the number of results retrieved when the filters were applied to the strategies.
To evaluate the search filters’ effectiveness at excluding non-OECD country evidence, the lead author screened samples of 10% of the excluded MEDLINE and Embase database records for each guideline to determine whether OECD country results had inadvertently been excluded by the draft filters. To generate a representative selection of records, the lead author downloaded and imported the first 10 records from sets of 100 records (e.g., 1–10, 101–110, 201–210, etc.) into EPPI-Reviewer software. The lead author screened the title, abstract, and subject heading fields of the sample database records in EPPI-Reviewer to determine whether they contained details about OECD countries. The lead author marked records that contained OECD country details in EPPI-Reviewer.
We have updated the draft filters for the validation phase of the project (see Appendix 3). The OECD countries section of the filters now includes Colombia, which joined the OECD in April 2020, and Costa Rica, which is in the process of joining [1]. In addition, we amended the structure of the geographic subject headings. Subject headings for all the individual OECD and non-OECD countries have now been included (some broad headings had been previously exploded to capture individual countries).
Our draft NICE OECD countries geographic search filters for MEDLINE and Embase (Ovid) can be found in Figure 3, with final versions available in Appendix 3.
Figure 3Draft NICE OECD countries geographic search filters
The draft MEDLINE filter reduced result volumes by 12.4% for NICE guideline 1, by 9.5% for NICE guideline 2, and by 12.9% for NICE guideline 3 (Table 1). Details of the MEDLINE literature search strategies, including number of search results, can be found in Appendix 1.
Table 1Draft NICE MEDLINE OECD countries filter results
| NICE guideline topic | No. of results from MEDLINE search strategy | No. of results from MEDLINE search strategy with draft MEDLINE filter applied | Reduction | No. of sample MEDLINE records | No. of sample MEDLINE records about OECD countries that were excluded inadvertently |
|---|---|---|---|---|---|
| NICE guideline 1: Indoor air quality at home | 11,842 | 10,370 | 1,472 (12.4%) | 150 | 0 |
| NICE guideline 2: Looked after children and young people | 14,687 | 13,288 | 1,399 (9.5%) | 140 | 2 |
| NICE guideline 3: Social, emotional and mental wellbeing in primary and secondary education | 11,328 | 9,759 | 1,569 (12.9%) | 160 | 0 |
Overall, we examined 450 database records from the 4,440 excluded MEDLINE results, and no records about OECD countries were identified for NICE guidelines 1 and 3 (Table 1). For NICE guideline 2, “Looked after children and young people,” two records (1.4%) of relevance to an OECD country were identified [31, 32]. These references were about the international adoption of minors from China by adoptive parents based in the United States [31, 32]. All the references used for the MEDLINE evaluation are available in Appendixes 4 and 5.
The draft Embase filter reduced result volumes by 12.5% for NICE guideline 1, by 10.7% for NICE guideline 2, and by 14.0% for NICE guideline 3 (Table 2). Details of the Embase literature searches and search result numbers can be found in Appendix 2.
Table 2Draft NICE Embase OECD countries filter results
| NICE guideline topic | No. of results from Embase search strategy | No. of results from Embase search strategy with draft Embase filter applied | Reduction | No. of sample Embase records | No. of sample Embase records about OECD countries that were excluded inadvertently |
|---|---|---|---|---|---|
| NICE guideline 1: Indoor air quality at home | 16,719 | 14,622 | 2,097 (12.5%) | 210 | 0 |
| NICE guideline 2: Looked after children and young people | 13,183 | 11,770 | 1,413 (10.7%) | 150 | 5 |
| NICE guideline 3: Social, emotional and mental wellbeing in primary and secondary education | 6,879 | 5,913 | 966 (14.0%) | 100 | 0 |
We examined 460 database records from the 4,476 excluded Embase results, and no records about OECD countries were identified for NICE guidelines 1 and 3 (Table 2). We found five records of relevance to an OECD country (3.3%) within excluded Embase results for NICE guideline 2 [33–37]. These references were about the international adoption of minors from non-OECD countries by adoptive parents based in OECD countries or about unaccompanied asylum seeker minors from non-OECD countries in OECD countries [33–37]. All the Embase references used for the evaluation are available in Appendixes 6 and 7.
Our findings show that the draft NICE OECD geographic countries search filters for MEDLINE and Embase exclude non-OECD evidence and retain the vast majority of OECD country evidence. Our draft filters reduced search results by 9.5% to 12.9% in MEDLINE and by 10.7% to 14% in Embase. This is important because screening references during evidence selection processes for evidence-based products such as guidelines and systematic reviews is time-consuming. The Cochrane Handbook, for example, estimates that 500–1,000 abstracts can be screened in an 8-hour period [38]. Using this calculation, our results show that the draft search filters equated to a saving of approximately two days spent on evidence selection. This could ultimately reduce guideline and systematic review development times when OECD country evidence is required, because fewer irrelevant geographic search results means that time spent on selecting evidence (plus associated resource costs) is reduced.
Once validated, the filters could be used to exclude evidence about a variety of geographic regions beyond OECD country distinctions because the filters are composed of country subject headings. For instance, for research topics that require a broader criteria for developed nations (such as the inclusion of the BRICS countries [Brazil, Russia, India, China, and South Africa] [40] or World Bank nations [41]), searchers could transfer subject headings from the non-OECD countries section of the filter to the OECD countries section to retain the additional relevant geographic results. Similarly, for research topics about low-and middle-income countries (LMICs), the order of the geographic subject headings in the filters could be reversed to exclude search results about OECD countries and other high-income nations. Although the retrieval effectiveness for this has not yet been examined, we plan to test the potential to modify the filters to retrieve evidence about other geographic regions during a later phase of the project.
The final draft filters will be validated using a gold standard (GS) set in accordance with search filter development methodology [9, 10]. The GS set will be generated via the relative recall method [39] and will contain references about OECD countries that have informed NICE guidelines. The final draft filters will then be validated by calculating their recall against the GS set references. When complete, our NICE OECD countries search filters will be the first validated geographic filters to be composed of subject headings and make exclusive use of the NOT Boolean operator to exclude irrelevant evidence and retain relevant evidence.
There are currently only three validated geographic search filters for the U.K., Africa and Spain [12–15]. We hope that this work on geographic search filters will encourage the development of additional validated search filters for more locations around the world [42].
Using geographic subject heading terms alone for the draft filters has limitations. For instance, not all references are indexed with geographic subject headings [12–16]; therefore, some irrelevant non-OECD country evidence will be retained. However, this limitation does not pose risks for OECD evidence to be excluded inadvertently.
The draft filters did not exclude any database records that were focused solely on an OECD country. However, a small number of references (7 out of 910 records; 0.8%) about looked-after minors from non-OECD countries who now live in OECD countries were excluded [31–37]. This is because only the geographic subject headings for the non-OECD countries had been assigned in the database records. For this reason, we advise that the draft filters should be used with caution for topics that focus on both OECD and non-OECD countries, such as international adoption or migration.
We screened approximately 10% of excluded MEDLINE and Embase database records for each guideline to determine whether OECD country references had been excluded by the draft filters by mistake; it is therefore possible that some of the unscreened database records may have included OECD country references. In addition, only the lead author screened the references, and it is possible that alternative selection choices could have been made if the records had been screened by all three authors.
A further limitation is the potential time required to update the geographic search filters to reflect changes in OECD country memberships, MeSH and Emtree OECD and non-OECD country terms, and changes to the names of the countries. However, as the filters comprise subject headings, updating the filters should be a straightforward task.
The novel draft NICE OECD countries geographic search filters for MEDLINE and Embase look promising. The draft filters retain most of the evidence about OECD countries and could potentially save time for guideline development when OECD country evidence is required. However, they should be used with caution for topics that focus on both OECD and non-OECD countries.
We plan to validate the final versions of the filters in the next phase of this study. When complete, the NICE OECD countries geographic search filters will be the first validated filters to be composed of subject headings and make exclusive use of the NOT Boolean operator with the aim of excluding irrelevant evidence to retain relevant evidence.
Data associated with this article (Appendixes 1–7) are available at https://osf.io/9a7ug/.
1. Organisation for Economic Co-operation and Development. Organisation for Economic Co-operation and Development website [Internet]. Paris: Members and partners. http://www.oecd.org/about/members-and-partners/ [2020; cited 8 Dec 2020].
2. Trade Union Advisory Committee (TUAC) to the OECD. OECD Membership and the Values of the Organisation [Internet]. Paris: Trade Union Advisory Committee (TUAC) to the OECD [2018; cited 8 Dec 2020] https://tuac.org/news/oecd-membership-and-the-values-of-the-organisation/.
3. National Institute for Health and Care Excellence. National Institute for Health and Care Excellence website [Internet]. London: National Institute for Health and Care Excellence [2020; cited 8 Dec 2020] https://www.nice.org.uk/.
4. National Institute for Health and Care Excellence. Chapter 5 Identifying the evidence: Literature searching and evidence submission. In: National Institute for Health and Care Excellence (Ed.), Developing NICE guidelines: The manual (PMG20) [Internet]. London: National Institute for Health and Care Excellence [2018; cited 8 Dec 2020] https://www.nice.org.uk/process/pmg20/chapter/identifying-the-evidence-literature-searching-and-evidence-submission.
5. National Institute for Health and Care Excellence. NG33 Tuberculosis [Internet]. London: National Institute for Health and Care Excellence [2019; cited 8 Dec 2020] https://www.nice.org.uk/guidance/ng33.
6. National Institute for Health and Care Excellence. NG77 Cataracts in adults: management [Internet]. London: National Institute for Health and Care Excellence [2017; cited 30 Nov 2020] https://www.nice.org.uk/guidance/ng77.
7. National Institute for Health and Care Excellence. NG13 Workplace health: management practices [Internet]. London: National Institute for Health and Care Excellence [2015; cited 8 Dec 2020] https://www.nice.org.uk/guidance/ng13.
8. National Institute for Health and Care Excellence. PH55 Oral health: local authorities and partners [Internet]. London: National Institute for Health and Care Excellence [2014; cited 8 Dec 2020] https://www.nice.org.uk/guidance/ph55.
9. Glanville J, Bayliss S, Booth A, Dundar Y, Fernandes H, Fleeman ND, Foster L, Fraser C, Fry-Smith A, Golder S, Lefebvre C, Miller C, Paisley S, Payne L, Price A, Welch K. So many filters, so little time: The development of a search filter appraisal checklist. J Med Libr Assoc. 2008 Oct;96(4):356–361. DOI: http://dx.doi.org/http://dx.doi.org/10.3163/1536-5050.96.4.011
.
10. Jenkins M. Evaluation of methodological search filters: A review. Health Info Libr J. 2004 Aug;21(3):148-163. DOI: http://dx.doi.org/https://doi.org/10.1111/j.1471-1842.2004.00511.x.
11. Glanville J, Lefebvre C, Wright K. The InterTASC Information Specialists’ Sub?Group Search Filter Resource [Internet]. York: University of York [2020; cited 8 Dec 2020] https://sites.google.com/a/york.ac.uk/issg-search-filters-resource/home.
12. Pienaar E, Grobler L, Busgeeth K, Eisinga A, Siegfried N. Developing a geographic search filter to identify randomised controlled trials in
Africa: Finding the optimal balance between sensitivity and precision. Health Info Libr J. 2011 Mar;28(3):210–215. DOI: http://dx.doi.org/https://doi.org/10.1111/j.1471-1842.2011.00936.x.
13. Valderas J, Mendivil J, Parada A, Losada?Yáñez M, Alonso J. Development of a geographic filter for PubMed to identify studies performed in Spain. Revista Española de Cardiología. 2006; 59(12):1244-1251. DOI: http://dx.doi.org/https://doi.org/10.1016/S1885-5857(07)60080-2.
14. Ayiku L, Levay P, Hudson T, Craven J, Barrett E, Finnegan A, Adams R. The MEDLINE UK filter: development and validation of a geographic search filter to retrieve research about the UK from OVID MEDLINE. Health Info Libr J. 2017 Jul;34(3):200-216. DOI: https://onlinelibrary.wiley.com/doi/full/10.1111/hir.12187
15. Ayiku L, Levay P, Hudson T, Craven J, Finnegan A, Adams R, Barrett E. The Embase UK filter: validation of a geographic search filter to retrieve research about the UK from OVID Embase. Health Info Libr J. 2019 Mar;36(2):121-133. DOI: https://onlinelibrary.wiley.com/doi/full/10.1111/hir.12252
16. Ayiku L, Levay P, Hudson T, Finnegan A. The NICE UK geographic search filters for MEDLINE and Embase (Ovid): Post-development study to further evaluate precision and number-needed-to-read when retrieving UK evidence. Res Synth Methods. 2020 Sept;11(5):669-677. DOI: https://onlinelibrary.wiley.com/doi/abs/10.1002/jrsm.1431.
17. National Institute for Health and Care Excellence. NG106 Chronic heart failure in adults: diagnosis and management [Internet]. London: National Institute for Health and Care Excellence [2018; cited 8 Dec 2020] https://www.nice.org.uk/guidance/ng106.
18. National Institute for Health and Care Excellence. NG97 Dementia: assessment, management and support for people living with dementia and their carers [Internet]. London: National Institute for Health and Care Excellence [2018; cited 8 Dec 2020] https://www.nice.org.uk/guidance/ng97.
19. National Institute for Health and Care Excellence (2020). NG150 Supporting adult carers [Internet]. London: National Institute for Health and Care Excellence [2020; cited 8 Dec 2020] https://www.nice.org.uk/guidance/ng150.
20. Cantrell A, Croot E, Johnson M, Wong R, Chambers D, Baxter SK, Booth A. Access to primary and community health-care services for people 16 years and over with intellectual disabilities: a mapping and targeted systematic review. NIHR Health Services and Delivery Research. 2020;8(5). ISSN 2050-4349 NBK553283 https://www.ncbi.nlm.nih.gov/books/NBK553283/.
21. Public Health England. The older adults’ NHS and social care return on investment tool: Technical report [Internet]. London: Public Health England [2020; cited 8 Dec 2020] https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/860616/Older_Adults_NHS_and_Social_Care_ROI_Tool_-_Technical_Report__2_.pdf.
22. British Thoracic Society. Literature review: the economic costs of lung disease and the cost effectiveness of policy and service interventions [Internet]. London: British Thoracic Society [2017; cited 8 Dec 2020] <http://allcatsrgrey.org.uk/wp/download/respiratory_diseases/download.pdf>.
23. Association Pour L’Advancement Des Science Et Des Techniques. Pays de l’OCDE (OECD countries) [Internet]. Quebec: Association Pour L’Advancement Des Science Et Des Techniques [2018; cited 8 Dec 2020] http://extranet.santecom.qc.ca/wiki/!biblio3s/doku.php?id=concepts:pays-de-l-ocde.
24. Dickersin K, Scherer R, Lefebvre C. Identifying relevant studies for systematic reviews. BMJ. 1994 Nov;309(6964):1286-91. DOI: http://dx.doi.org/10.1136/bmj.309.6964.1286.
25. Lefebvre C, Glanville J, Briscoe S, Littlewood A, Marshall C, Metzendorf M-I, Noel-Storr A, Rader T, Shokraneh F, Thomas J, Wieland LS. Technical Supplement to Chapter 4: Searching for and selecting studies. In: Higgins JPT, Thomas J, Chandler J, Cumpston MS, Li T, Page MJ, Welch VA (eds). Cochrane Handbook for Systematic Reviews of Interventions Version 6 [Internet]. London: Cochrane [2019; cited 8 Dec 2020] www.training.cochrane.org/handbook.
26. Encyclopaedia Britannica. French Guiana [Internet]. Chicago: Encyclopaedia Britannica [2020; cited 8 Dec 2020] https://www.britannica.com/place/French-Guiana.
27. Encyclopaedia Britannica. Gibraltar [Internet]. Chicago: Encyclopaedia Britannica [2020; cited 8 Dec 2020] https://www.britannica.com/place/Gibraltar.
28. National Institute for Health and Care Excellence. Indoor air quality at home [Internet]. London: National Institute for Health and Care Excellence [2020; cited 8 Dec 2020] https://www.nice.org.uk/guidance/ng149.
29. National Institute for Health and Care Excellence. Looked-after children and young people (in development) [Internet]. London. National Institute for Health and Care Excellence [due 2021; cited 8 Dec 2020] https://www.nice.org.uk/guidance/indevelopment/gid-ng10121.
30. National Institute for Health and Care Excellence. Social, emotional and mental wellbeing in primary and secondary education (in development) [Internet]. National Institute for Health and Care Excellence: London [due 2022; cited 8 Dec 2020] https://www.nice.org.uk/guidance/indevelopment/gid-ng10125.
31. King K, Browning JC, Metry DW, Prestigiacomo J, Scollard D, Schutze GE, Stryjewska B, Schwarzwald H. Leprosy and international adoption: a case report and review of diagnostic and treatment
dilemmas. J Pediatr Infect Dis; 2009 Apr;28(4):322-5. DOI: http://dx.doi.org/https://doi.org/10.1097/inf.0b013e31818de21e.
32. Tan TX. Developmental delays at arrival, early intervention enrollment, and adopted Chinese
girls’ academic performance and internalizing problems in adolescence. J Genet Psychol. 2014 Jun;175(34):318-31 http://dx.doi.org/https://doi.org/10.1080/00221325.2014.913547.
33. Fuglestad AJ, Kroupina MG, Johnson DE, Georgieff MK. Micronutrient status and neurodevelopment in internationally adopted children. Acta Paediatr; 2016 Oct;105(2):e67-e76. DOI: http://dx.doi.org/https://doi.org/10.1111/apa.13234.
34. Raabe VN, Sautter C, Chesney M, Eckerle JK, Howard CR, John CC. Hepatitis A screening for internationally adopted children from hepatitis A endemic
countries. Clin Pediatr. 2014 Oct;53(1):31-37. DOI: http://dx.doi.org/https://doi.org/10.1177/0009922813505903.
35. Roman M, Palacios J, Moreno C, Lopez A. Attachment representations in internationally adopted children. Attach Human Dev. 2012 Oct;14(6):585-600. DOI: http://dx.doi.org/https://doi.org/10.1080/14616734.2012.727257.
36. Williams B, Boullier M, Cricks Z, Ward A, Naidoo R, Williams A, Robinson K, Eisen S, Cohen J. Screening for infection in unaccompanied asylum-seeking children and young people. Arch Dis Child. 2020 Feb;318077. DOI: http://dx.doi.org/https://doi.org/10.1136/archdischild-2019-318077.
37. Buonsenso D, Graffeo R, Scarlato L, Acampora A, Grotti G, Scerlato L, Pata D, Colonna AT, Salerno G, Colussi L, Masucci L, Valentini P. Intestinal Parasitic Infections in Internationally Adopted Children: A 10-Year Retrospective
Study. Pediatr Infect Dis J. 2019 Oct;38(10):983-989. DOI: http://dx.doi.org/https://doi.org/10.1097/inf.0000000000002399.
38. Lefebvre C, Glanville J, Briscoe S, Littlewood A, Marshall C, Metzendorf M, Noel?Storr A, Rader T, Shokraneh F, Thomas JL, Wieland S on behalf of the Cochrane Information Retrieval Methods Group. Chapter 4: Searching for and selecting studies. Higgins JPT, Thomas J, Chandler J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA. (Eds.), Cochrane Handbook for Systematic Reviews of Interventions Version 6 [Internet]. London: Cochrane [2019; cited 30 Nov 2020] https://onlinelibrary.wiley.com/doi/abs/10.1002/9781119536604.ch4.
39. Sampson M, Zhang L, Morrison A, Barrowman NJ, Clifford TJ, Platt RW, Klassen TP, Moher D. An alternative to the hand searching gold standard: validating methodological search
filters using relative recall. BMC Med Res Methodol. 2006 Jul;6(1):33. DOI: http://dx.doi.org/https://doi.org/10.1186/1471-2288-6-33.
40. Macmillan dictionary. The BRIC countries [Internet]. London: Macmillan [2020; cited 30 Nov 2020] https://www.macmillandictionary.com/dictionary/british/the-bric-countries.
41. The World Bank Group. High Income [Internet]. Washington: The World Bank Group: Washington [2020; cited 30 Novr 2020] https://data.worldbank.org/income-level/high-income?view=chart.
42. Ayiku L, Craven J, Hudson T, Levay P. How to Develop a Validated Geographic Search Filter: Five Key Steps. EBLIP. 2020 Mar; 15(1): 170-178. DOI: http://dx.doi.org/https://doi.org/10.18438/eblip29633.
Lynda Ayiku, 1 lynda.ayiku@nice.org.uk, Information Specialist, Information Services team, National Institute for Health and Care Excellence (NICE), United Kingdom
Paul Levay, 2 paul.levay@nice.org.uk, Information Specialist, Information Services National Institute for Health and Care Excellence (NICE), United Kingdom
Thomas Hudson, 3 thomas.hudson@nice.org.uk, Information Specialist, Information Services, National Institute for Health and Care Excellence (NICE), United Kingdom
Copyright © 2021 Lynda Ayiku, Paul Levay, Thomas Hudson
This work is licensed under a Creative Commons Attribution 4.0 International License.
Journal of the Medical Library Association, VOLUME 109, NUMBER 2, April 2021