Exploring librarians’ practices when teaching advanced searching for knowledge synthesis: results from an online survey

Authors

DOI:

https://doi.org/10.5195/jmla.2024.1870

Keywords:

Evidence Synthesis, teaching strategies, Literature Searching

Abstract

Objective: There is little research available regarding the instructional practices of librarians who support students completing knowledge synthesis projects. This study addresses this research gap by identifying the topics taught, approaches, and resources that academic health sciences librarians employ when teaching students how to conduct comprehensive searches for knowledge synthesis projects in group settings.

Methods: This study applies an exploratory-descriptive design using online survey data collection. The final survey instrument included 31 open, closed, and frequency-style questions.

Results: The survey received responses from 114 participants, 74 of whom met the target population. Some key results include shared motivations to teach in groups, including student learning and curriculum requirements, as well as popular types of instruction such as single session seminars, and teaching techniques, such as lectures and live demos.

Conclusion: This research demonstrates the scope and coverage of librarian-led training in the knowledge synthesis research landscape. Although searching related topics such as Boolean logic were the most frequent, librarians report teaching throughout the review process like methods and reporting. Live demos and lectures were the most reported approaches to teaching, whereas gamification or student-driven learning were used rarely. Our results suggest that librarian’s application of formal pedagogical approaches while teaching knowledge synthesis may be under-utilized, as most respondents did not report using any formal instructional framework.

References

Pickering C, Grignon J, Steven R, Guitart D, Byrne J. Publishing not perishing: how research students transition from novice to knowledgeable using systematic quantitative literature reviews [Internet]. Stud High Educ. 2015 [cited 30 Aug 2023];40(10):1756–69. DOI: 10.1080/03075079.2014.914907. https://www.tandfonline.com/doi/full/10.1080/03075079.2014.914907.

Christian R, Palokas M. Systematic review methodology in graduate nursing education. JBI Database System Rev Implement Rep [Internet]. 2018 Mar [cited 30 Aug 2023];16(3):587–8. DOI: 10.11124/JBISRIR-2017-003704. https://www.ncbi.nlm.nih.gov/pubmed/29521855.

Swart C. Psychology students’ perceptions of the extent to which group-based systematic review methodology at honours level prepared them for further postgraduate studies. University of the Western Cape. 2016.

Puljak L, Sapunar D. Acceptance of a systematic review as a thesis: survey of biomedical doctoral programs in Europe. Syst Rev [Internet]. 2017 [cited 30 Aug 2023];6(1):253. DOI: 10.1186/s13643-017-0653-x. https://www.ncbi.nlm.nih.gov/pubmed/29233170.

Olsson C, Ringnér A, Borglin G. Including systematic reviews in PhD programmes and candidatures in nursing–‘Hobson’s choice’? Nurse Educ Pract [Internet]. 2014 [cited 30 Aug 2023];14(2):102–5. DOI: 10.1016/j.nepr.2014.01.005. https://www.ncbi.nlm.nih.gov/pubmed/24480093.

ten Ham-Baloyi W, Jordan P. Systematic review as a research method in postgraduate nursing education. Heal sa gesondheid [Internet]. 2016 [cited 30 Aug 2023];21(1):120–8. DOI: https://doi.org/10.4102/hsag.v21i0.942. https://hsag.co.za/index.php/hsag/article/view/942.

Wissinger CL. Is there a place for undergraduate and graduate students in the systematic review process? J Med Libr Assoc [Internet]. 2018 Jan [cited 30 Aug 2023];106(2):248–50. DOI: 10.5195/JMLA.2018.387. http://jmla.pitt.edu/ojs/jmla/article/view/387.

Boland A, Cherry MG (M. G, Dickson R (Rumona). Doing a systematic review : a student’s guide. London: SAGE; 2014.

Parker RMN, Boulos LM, Visintini S, Ritchie K, Hayden J. Environmental scan and evaluation of best practices for online systematic review resources. J Med Libr Assoc [Internet]. 2018 Apr [cited 2019 Nov 25];106(2):208–18. DOI: 10.5195/jmla.2018.241. <https://www.ncbi.nlm.nih.gov/pubmed/29632443>

Mi M. Leveraging research synthesis for promoting and expanding library services and educational programs. J Acad Librariansh [Internet]. 2016 [cited 30 Aug 2023];42(2):151–3. DOI: 10.1016/j.acalib.2015.12.012. <https://www.sciencedirect.com/science/article/pii/S0099133315003079>

Spencer AJ, Eldredge JD. Roles for librarians in systematic reviews: a scoping review. J Med Libr Assoc [Internet]. 2018 Jan 1 [cited 30 Aug 2023];106(1):46–56. DOI: 10.5195/jmla.2018.82. https://www.ncbi.nlm.nih.gov/pubmed/29339933.

Sikora L, Bass M. Sharpening the other side of the dual edged systematic review sword: Expecting more from our users. J Can Health Libr Assoc [Internet]. 2018 [cited 30 Aug 2023];89–104. http://hdl.handle.net/10393/37808.

Premji Z, Hayden KA, Rutherford S. Teaching knowledge synthesis methodologies in a higher education setting: a scoping review of face-to-face instructional programs. Evid Based Libr Inf Pract [Internet]. 2021 [cited 30 Aug 2023];16(2):111–44. DOI: https://doi.org/10.18438/eblip29895. https://journals.library.ualberta.ca/eblip/index.php/EBLIP/article/view/29895.

Hirt J, Nordhausen T, Meichlinger J, Braun V, Zeller A, & Meyer G. Educational interventions to improve literature searching skills in the health sciences: a scoping review. J Med Libr Assoc [Internet]. 2020 Oct [cited 2023 Sep 05];108(4):534–546. DOI: https://doi.org/10.5195/jmla.2020.954. http://www.ncbi.nlm.nih.gov/pubmed/29632443.

Campbell SMS, Kung JYC, Dennett L. A curriculum for an introductory systematic review searching workshop for researchers. J Can Heal Libr Assoc [Internet]. 2016 Jan 20 [cited 30 Aug 2023];37(4):2–5. DOI: 10.5596/c16-003. https://journals.library.ualberta.ca/jchla/index.php/jchla/article/download/25595/20280.

Lenton E, Fuller K. Explaining the method behind our madness: 3-part series on comprehensive searches for knowledge syntheses. J Can Heal Libr Assoc [Internet]. 2019 [cited 30 Aug 2023];40(1):18-22. DOI: 10.29173/jchla29391. https://journals.library.ualberta.ca/jchla/index.php/jchla/article/view/29391.

Fuller K, Gray M, Bradley-Ridout G, Nekolaichuk E. Flipping it online: re-imagining teaching search skills for knowledge syntheses. J Can Health Libr Assoc [Internet]. 2021 [cited 2023 Sep 05];42(2):100–9. DOI: 10.29173/jchla29492 https://journals.library.ualberta.ca/jchla/index.php/jchla/article/view/29492.

McGowan BS, Reed JB, Kinkus Yatcilla J. Graduate student confidence following a for-credit systematic review course pilot. J Med Libr Assoc [Internet]. 2021 Jul 20 [cited 2022 Aug 8];109(2):323-9. DOI: 10.5195/jmla.2021.1073. http://jmla.pitt.edu/ojs/jmla/article/view/1073.

Poole K. A flipped classroom approach to teaching search techniques for systematic reviews to encourage active learning. J Inf Lit. 2021;15(1):68–83. DOI: 10.11645/15.1.2847.

Dalton M. How individual consultations with a librarian can support systematic reviews in the social sciences. J Inf Lit. 2019 Dec 2;13(2):163–72. DOI: 10.11645/13.2.2621.

Swanberg SM, Dennison CC, Farrell A, Machel V, Marton C, O’Brien KK, et al. Instructional methods used by health sciences librarians to teach evidence-based practice (EBP): a systematic review. J Med Libr Assoc [Internet]. 2016 Jul [cited 2023 Sep 05];104(3):197–208. DOI: 10.3163/1536-5050.104.3.004. https://www.ncbi.nlm.nih.gov/pubmed/27366120.

Erlinger A. Outcomes assessment in undergraduate information literacy instruction: a systematic review. Coll Res Libr [Internet]. 2018 [cited 2023 Sep 05];79(4):442–79. DOI: 10.5860/crl.79.4.442. https://crl.acrl.org/index.php/crl/article/view/16600.

Garg A, Turtle KM. Effectiveness of training health professionals in literature search skills using electronic health databases—a critical appraisal. Heal Inf Libr J [Internet]. 2003 [cited 2023 Sep 05];20(1):33–41. DOI: 10.1046/j.1471-1842.2003.00416.x. https://www.ncbi.nlm.nih.gov/pubmed/12641528.

Pell J. Teaching systematic searching methods to public health graduate students: repeated library instruction sessions correlate with better assignment scores. Evid Based Libr Inf Pract [Internet]. 2017 Jun [cited 2023 Sep 05];12(2):106–13. DOI: 10.18438/B8707K. https://journals.library.ualberta.ca/eblip/index.php/EBLIP/article/view/28502.

Fournier K, Sikora L. Individualized research consultations in academic libraries: a scoping review of practice and evaluation methods. Evid Based Libr Inf Pract [Internet]. 2015 Dec [cited 2023 Sep 05];10(4):247–67. DOI: https://doi.org/10.18438/B8ZC7W. https://journals.library.ualberta.ca/eblip/index.php/EBLIP/article/view/25324.

Sikora L, Fournier K, Rebner J. Exploring the impact of individualized research consultations using pre and posttesting in an academic library: a mixed methods study. Evid Based Libr Inf Pract [Internet]. 2019 [cited 2023 Sep 05]; 14(1):2–21. DOI: https://doi.org/10.18438/eblip29500. https://journals.library.ualberta.ca/eblip/index.php/EBLIP/article/view/29500.

Rowe W. Positionality. In: The SAGE Encyclopedia of Action Research. Thousand Oaks, CA: SAGE Publications, Ltd.; 2014. p. 627–8.

Dillman DA, Smyth JD, Christian LM. Internet, phone, mail, and mixed-mode surveys: the tailored design method. 4th ed. Hoboken, New Jersey: John Wiley & Sons; 2014.

Grimshaw J. A guide to knowledge synthesis [Internet]. Canadian Institutes of Health Research; [rev. 08 Apr 2010, cited 2023 Sep 26]. https://cihr-irsc.gc.ca/e/41382.html.

Vaughn P & Turner C. Decoding via Coding: Analyzing Qualitative Text Data Through Thematic Coding and Survey Methodologies, Journal of Library Administration, 2016 56:1, 41-51.

Hayden A, Premji Z. Scaffolded, Virtual Systematic Review Workshop Series. In: Scull A, editor. Virtual Services in the Health Sciences Library: A Handbook [Internet]. Lanham, MD: Rowman & Littlefield; 2022. p. 20. Available from: https://dal.novanet.ca/permalink/01NOVA_DAL/1nek75v/alma9970582053907190.

Charbonneau DH, Vardell E. Health sciences librarian research and instruction services in pandemic information environments. J Acad Librariansh. 2022 Jul;48(4):102553. DOI: 10.1016/j.acalib.2022.102553. https://linkinghub.elsevier.com/retrieve/pii/S0099133322000696.

Johnson-Barlow EM, Lehnen C. A scoping review of the application of systematic instructional design and instructional design models by academic librarians. The Journal of Academic Librarianship [Internet]. 2021 Sep [cited 2024 Feb 8];47(5):102382. Available from: https://linkinghub.elsevier.com/retrieve/pii/S0099133321000732.

Saib MO, Rajkoomar M, Naicker N, Olugbara CT. Digital pedagogies for librarians in higher education: a systematic review of the literature. IDD [Internet]. 2023 Jan 6 [cited 2023 Apr 4];51(1):13–25. Available from: https://www.emerald.com/insight/content/doi/10.1108/IDD-06-2021-0066/full/html.

Quaiattini A, Kiester L. Development of a new workshop on demystifying systematic reviews. J Can Health Libr Assoc [Internet]. 2019 [cited 2023 Sep 05];40(2):85–92. https://journals.library.ualberta.ca/jchla/index.php/jchla/article/view/29414.

Cook DB. Is the Library One-Shot Effective? A Meta-Analytic Study. CRL [Internet]. 2022 [cited 2023 Nov 13];83(5): 739–50. DOI: https://doi.org/10.5860/crl.83.5.739 https://crl.acrl.org/index.php/crl/article/view/25578.

Townsend WA, Anderson PF, Ginier EC, MacEachern MP, Saylor KM, Shipman BL, et al. A competency framework for librarians involved in systematic reviews. J Med Libr Assoc [Internet]. 2017 Jul [cited 2023 Sep 05];105(3):268–75. DOI: 10.5195/jmla.2017.189. https://www.ncbi.nlm.nih.gov/pubmed/28670216.

Foster MJ, Halling TD, Pepper C. Systematic reviews training for librarians: planning, developing, and evaluating. J EAHIL [Internet]. 2018 [cited 2023 Sep 05];14(1):4-8. https://oaktrust.library.tamu.edu/handle/1969.1/169681.

Folb BL, Klem ML, Youk AO, Dahm JJ, He M, Ketchum AM, et al. Continuing education for systematic reviews: a prospective longitudinal assessment of a workshop for librarians. J Med Libr Assoc [Internet]. 2020 Jan 2 [cited 2023 Sep 05];108(1):34-46. DOI: 10.5195/jmla.2020.492. http://jmla.pitt.edu/ojs/jmla/article/view/492.

Conte ML, MacEachern MP, Mani NS, Townsend WA, Smith JE, Masters C, et al. Flipping the classroom to teach systematic reviews: the development of a continuing education course for librarians. J Med Libr Assoc. 2015;103(2):69-73. DOI: 10.3163/1536-5050.103.2.002. https://www.ncbi.nlm.nih.gov/pubmed/25918484.

Bailey E, Kelly D. Developing a measure of search expertise. In: Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval. 2016. p. 237–40.

Brennan K, Kelly D, Zhang Y. Factor analysis of a search self-efficacy scale. In: Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval. 2016. p. 241–4.

Smith CL. Domain-independent search expertise: a description of procedural knowledge gained during guided instruction. J Assoc Inf Sci Technol [Internet]. 2015 [cited 2023 Sep 05];66(7):1388–405. DOI: 10.1002/asi.23272. https://asistdl.onlinelibrary.wiley.com/doi/full/10.1002/asi.23272.

Smith CL, Roseberry MI. Professional education in expert search: a content model. J Educ Libr Inf Sci. 2013;54(4):255–69.

Kiss TL, O’Malley M, Hendrix TJ. Self-Efficacy-Based Training for Research Literature Appraisal: A Competency for Evidence-Based Practice. Journal for Nurses in Staff Development (JNSD). 2010 Jul;26(4):170–7.

Downloads

Published

2024-07-29

Issue

Section

Original Investigation