Information seeking and evaluation: a multi-institutional survey of veterinary students
DOI:
https://doi.org/10.5195/jmla.2019.674Keywords:
Information Literacy, Critical Appraisal, Reading, Veterinary Students, Competency-Based AssessmentAbstract
Objective: To practice evidence-based medicine, clinicians must be competent in information literacy (IL). Few studies acknowledge the critical role that reading strategies play in IL instruction and assessment of health professional students. The purpose of this study was to understand the information-seeking and evaluation behaviors of doctor of veterinary medicine (DVM) students in regard to scientific papers.
Methods: The authors studied DVM student behaviors across eight programs in North America using a web-based survey of closed- and open-ended questions about finding and evaluating scientific papers, including a task to read a linked scientific paper and answer questions about it.
Results: A total of 226 individuals responded to the survey. The sections of a scientific paper that were most commonly read were the abstract, introduction, and conclusions. Students who reported reading a higher proportion of scientific papers were more likely to feel confident in their abilities to interpret them. A third of respondents answered open-ended questions after the paper reading task. Respondents felt the least amount of confidence with one of the final steps of evidence-based medicine, that of interpreting the significance of the paper to apply it in veterinary medicine.
Conclusions: DVM students may lack the skills needed to evaluate scientific literature and need more practice and feedback in evaluating and interpreting scientific papers. Librarians who support DVM students can (1) help DVM students to efficiently evaluate scientific literature, (2) seek training opportunities in alternative modes of teaching and learning IL skills, and (3) partner with veterinary faculty and clinicians to provide students with practice and feedback in information evaluation.References
American Library Association. Presidential Committee on Information Literacy: final report [Internet]. The Association [cited 26 Jun 2019]. <http://www.ala.org/acrl/publications/whitepapers/presidential>.
American Veterinary Medical Association. COE accreditation policies and procedures: requirements [Internet]. The Association; 2017 [cited 26 Jun 2019]. <https://www.avma.org/ProfessionalDevelopment/Education/Accreditation/Colleges/Pages/coe-pp-requirements-of-accredited-college.aspx>.
Munn J, Small J. What is the best way to develop information literacy and academic skills of first year health science students? a systematic review. Evid Based Libr Inf Pract. 2017 Aug;12(3):56–94.
Morley SK, Hendrix IC. “Information Survival Skills”: a medical school elective. J Med Libr Assoc. 2012 Oct;100(4):297–302. DOI: http://dx.doi.org/10.3163/1536-5050.100.4.012.
Clark C, Catts R. Information skills survey: its application to a medical course. Evid Based Libr Inf Pract. 2007 Oct;2(3):3–26.
Schweikhard AJ, Hoberecht T, Peterson A, Randall K. The impact of library tutorials on the information literacy skills of occupational therapy and physical therapy students in an evidence-based practice course: a rubric assessment. Med Ref Serv Q. 2018 Jan;37(1):43–59.
Taylor R, Reeves B, Ewings P, Binns S, Keast J, Mears R. A systematic review of the effectiveness of critical appraisal skills training for clinicians. Med Educ. 2000 Feb;34(2):120–5.
Weiner SA, Stephens G, Nour AYM. Information-seeking behaviors of first-semester veterinary students: a preliminary report. J Vet Med Educ. 2011;38(1):21–32.
Elnoor OS, Hundal JS, Chahal US, Kansal SK. Assessment of postgraduate veterinary students’ information literacy competencies and attitude towards e-learning. Indian J Econ Dev. 2017 Jun;13(2):339–44.
Dinkelman AL, Viera AR, Bickett-Weddle DA. The role of veterinary medical librarians in teaching information literacy. J Vet Med Educ. 2011 Summer;38(2):141–9.
Shurtz S, Fajt V, Heyns EP, Norton HF, Weingart S. Teaching evidence-based veterinary medicine in the US and Canada. J Vet Med Educ. 2017 Winter;44(4):660–8.
Shenton AK. Reading in information behaviour and information literacy frameworks. Collect Curation. 2018;37(2):60–4.
Ambrosino RJ, Brading PL, Noval LK. Reading: a potential source of academic difficulty in medical school. J Read Behav. 1974;4:367–73.
Hendrix CM, Thompson IK, Mann CJ. A survey of reading, writing, and oral communication skills in North American veterinary medical colleges. J Vet Med Educ. 2001 Spring;28(1):34–40.
Liu Z. Reading behavior in the digital environment. J Doc. 2005;61(6):700–12.
Ahmadi N, McKenzie ME, Maclean A, Brown CJ, Mastracci T, McLeod RS. Teaching evidence based medicine to surgery residents - is journal club the best format? a systematic review of the literature. J Surg Educ. 2012 Jan;69(1):91–100.
Buchberger B, Mattivi JT, Schwenke C, Katzer C, Huppertz H, Wasem J. Critical appraisal of RCTs by 3rd year undergraduates after short courses in EBM compared to expert appraisal. Ger Med Sci J Med Educ. 2018;35(2):1–17.
Ebbert JO, Montori VM, Schultz HJ. The journal club in postgraduate medical education: a systematic review. Med Teach. 2012;23(5):455–61.
Harris J, Kearley K, Heneghan C, Meats E, Roberts N, Perera R, Kearley-Shiers K. Are journal clubs effective in supporting evidence-based decision making? a systematic review. BEME guide no. 16. Med Teach. 2010;33(1):9–23.
Lee AG, Boldt HC, Golnik KC, Arnold AC, Oetting TA, Beaver HA, Olson RJ, Carter K. Using the journal club to teach and assess competence in practice-based learning and improvement: a literature review and recommendation for implementation. Surv Ophthalmol. 2005 Nov;50(6):542–8.
Holmes NG, Wieman CE, Bonn DA. Teaching critical thinking. Proc Natl Acad Sci. 2015 Sep 8;112(36):11199–204.
Burrows S, Ginn DS, Love N, Williams TL. A strategy for curriculum integration of information skills instruction. Bull Med Libr Assoc. 1989 Jul;77(3):245–51.
McClurg C, Powelson S, Lang E, Aghajafari F, Edworthy S. Evaluating effectiveness of small group information literacy instruction for undergraduate medical education students using a pre- and post-survey study design. Health Inf Libr J. 2015 Jun;32(2):120–30.
Cullen R, Clark M, Esson R. Evidence-based information-seeking skills of junior doctors entering the workforce: an evaluation of the impact of information literacy training during pre-clinical years: information-seeking skills of junior doctors. Health Inf Libr J. 2011 Jun;28(2):119–29.
Friedberg M, Mahanaimi D, Lev-Zion R, Sidi A, Glick S. Reading habits of third-year medical students during an integrated endocrinology course. Med Teach. 1998;20(2):133–7.
Haught PA, Walls RT. Adult learners: new norms on the Nelson-Denny Reading Test for healthcare professionals. Read Psychol. 2002;23(3):217–38.
Klatt EC, Klatt CA. How much is too much reading for medical students? assigned reading and reading rates at one medical school. Acad Med. 2011 Sep;86(9):1079–83.
Davies E, Eldermire E. Differences in veterinary student perceptions about scientific reading and information literacy [Internet]. Calgary, AB, Canada: Veterinary Educator Collaborative; 2016 [cited 26 Jun 2019]. <https://vet.ucalgary.ca/vec/node/68>.
Gummery E, Cobb KA, Mossop LH, Cobb MA. Student perceptions of veterinary anatomy practical classes: a longitudinal study. J Vet Med Educ. 2018 Summer;45(2):163–76.
Molgaard LK, Hodgson JL, Bok HGJ, Chaney KP, Ilkiw JE, Matthew SM, May SA, Read EK, Rush BR, Salisbury SK. Competency-based veterinary education: part 2 - entrustable professional activities [Internet]. Washington, DC: Association of American Veterinary Medical Colleges Working Group on Competency-Based Veterinary Education; 2018 [cited 26 Jun 2019]. <http://aavmc.org/cbve>.
Qualtrics [Internet]. Qualtrics [cited 23 Oct 2018]. <https://www.qualtrics.com/>.
Eldermire ERB, Davies E. Reading behavior of veterinary students: how big (or small) is their picture? Presented at: MLA ’16; Toronto, ON, Canada; May 2016.
Duvivier RJ, van Dalen J, Muijtjens AM, Moulaert VR, van der Vleuten CP, Scherpbier AJ. The role of deliberate practice in the acquisition of clinical skills. BMC Med Educ. 2011 Dec 6;11:101.
Fetters MD, Curry LA, Creswell JW. Achieving integration in mixed methods designs—principles and practices. Health Serv Res. 2013 Dec;48(6 pt 2):2134–56.
Merriam S. Qualitative research in practice. San Francisco, CA: Jossey-Bass; 2002.
Strauss A, Corbin J. Basics of qualitative research: grounded theory procedures and techniques. Newbury Park, CA: Sage; 1990.
Association of American Veterinary Medical Colleges. Annual data report 2016–2017 [Internet]. Washington, DC: The Association; Feb 2017 [cited 14 Dec 2018]. <http://www.aavmc.org/data/files/data/2017%20aavmc%20public%20data-%20final.pdf>.
Greenhill LM. Demand for veterinary education: the veterinary applicant pool [Internet]. Association of American Veterinary Medical Colleges; 2015 [cited 12 Nov 2018]. <http://www.aavmc.org/assets/site_18/files/data/2015%20demand%20for%20veterinary%20education.pdf>.
Krottmaier H. Stop reading (useless parts)! In: From information to knowledge: proceedings of the 7th ICCC/IFIP International Conference on Electronic Publishing [Internet]. Minho, Portugal; 2003. p. 189–97. (Available from: <https://elpub.architexturez.net/doc/oai-elpub-id-0327>. [cited 26 Jun 2019].)
Nielsen TD, Dean RS, Massey A, Brennan ML. Survey of the UK veterinary profession 2: sources of information used by veterinarians. Vet Rec. 2015 Aug 15;177(7):172.
Jelsness-Jørgensen LP. Does a 3-week critical research appraisal course affect how students perceive their appraisal skills and the relevance of research for clinical practice? a repeated cross-sectional survey. Nurse Educ Today. 2015 Jan;35(1):e1–5.
Phelps S, Hyde L, Wolf JP. The intersection: where evidence based nursing and information literacy meet. Cambridge, MA : Chandos Publishing, an imprint of Elsevier; 2018.
Arlt SP, Haimerl P, Heuwieser W. Training evidence-based veterinary medicine by collaborative development of critically appraised topics. J Vet Med Educ. 2012 Summer;39(2):111–8. http://dx.doi.org/10.3138/jvme.1111.112R.
Hardin LE, Robertson S. Learning evidence-based veterinary medicine through development of a critically appraised topic. J Vet Med Educ. 2006 Fall;33(3):474–8.
Greene A. Writing science in plain English. Chicago, IL: University of Chicago Press; 2013.
Trevejo RT. A small animal clinician’s guide to critical appraisal of the evidence in scientific literature. Vet Clin North Am Small Anim Pract. 2007 May;37(3):463–75.
Weightman AL, Farnell DJJ, Morris D, Strange H, Hallam G. A systematic review of information literacy programs in higher education: effects of face-to-face, online, and blended formats on student skills and views. Evid Based Libr Inf Pract. 2017 Aug;12(3):20–55.
Molteni VE, Chan EK. Student confidence/overconfidence in the research process. J Acad Librariansh. 2015;41:2–8.
Swartz B, Ratcliff A, Ivanitskaya L. Correlation of attitudes and beliefs with actual abilities of speech-language pathology students regarding aspects of information literacy. Contemp Issues Commun Sci Disord. 2015;42:215–25.
Schilling K. The efficacy of eLearning for information-retrieval skills in medical education. In: Beldhuis H, ed. Proceedings of the 11th European Conference on E-Learning. Academic Conferences & Publishing International; 2012. p. 515–22.
Reisbig AMJ, Hafen M, White MB, Rush BR. Improving response rates: introducing an anonymous longitudinal survey research protocol for veterinary medical students. J Vet Med Educ. 2007 Spring;34(2):194–201.
