Video killed the multiple-choice quiz: capturing pharmacy students’ literature searching skills using a screencast video assignment
DOI:
https://doi.org/10.5195/jmla.2021.1270Keywords:
screencast videos, competency-based assignment, pharmacy students, drug informationAbstract
Background: In a flipped, required first-year drug information course, students were taught the systematic approach to answering drug information questions, commonly utilized resources, and literature searching. As co-coordinator, a librarian taught three weeks of the course focused on mobile applications, development of literature searching skills, and practicing in PubMed. Course assignments were redesigned in 2019 based on assessment best practices and replaced weekly multiple-choice quizzes used in prior iterations of the course.
Case Presentation: Following two weeks of literature searching instruction, students were assigned a drug information question that would serve as the impetus for the search they conducted. Students (n=66) had one week to practice and record a screencast video of their search in PubMed. Students narrated their video with an explanation of the actions being performed and were assessed using a twenty-point rubric created by the course coordinator and librarian. The librarian also created general feedback videos for each question by recording screencasts while performing the literature searches and clarifying troublesome aspects for students. The librarian spent about twenty-four hours grading and six hours writing scripts, recording, and editing feedback videos.
Conclusion: Most students performed well on the assignment and few experienced technical difficulties. Instructors will use this assignment and feedback method in the future. Screencast videos proved an innovative way to assess student knowledge and to provide feedback on literature searching assignments. This method is transferrable to any medical education setting and could be used across all health professions to improve information literacy skills.
References
Biggs JB. Aligning teaching and assessing to course objectives. Teaching and Learning in Higher Education: New Trends and Innovations. 2003 Apr.
Branch RM. Design. In: Instructional design: the ADDIE approach. Boston, MA: Springer; 2009. p. 58–81.
Crespo RM, Najjar J, Derntl M, Leony D, Neumann S, Oberhuemer P, Totschnig M, Simon B, Gutierrez I, Kloos CD. Aligning assessment with learning outcomes in outcome-based education. Presented at: IEEE EDUCON 2010 Conference; Madrid, Spain; April 14–16, 2010. p. 1239–46.
Sewagegn AA. Learning objective and assessment linkage: its contribution to meaningful student learning. Univers J Edu Res. 2020 Nov;8(11):5044–52. DOI: https://doi.org/10.13189/ujer.2020.081104.
Pape-Zambito DA, Mostrom AM. Improving teaching through triadic course alignment. J Microbiol Biol Educ. 2019 Jan;19(3):1642. DOI: https://doi.org/10.1128/jmbe.v19i3.1642.
Guerrero-Roldán AE, Noguera I. A model for aligning assessment with competences and learning activities in online courses. Internet Higher Educ. 2018 Jul;38:36–46. DOI: https://doi.org/10.1016/j.iheduc.2018.04.005.
Shepard LA. The role of assessment in a learning culture. Educ Res. 2000 Oct;29(7):4–14. DOI: https://doi.org/10.3102/0013189X029007004.
Wiggins G, McTighe J. Backward design. In: Understanding by design. 2nd ed. Alexandria, VA: Association for Supervision and Curriculum Development (ASCD); 2005. p. 13–34.
Brown GTL, Abdulnabi HHA. Evaluating the quality of higher education instructor-constructed multiple-choice tests: impact on student grades. Front Educ. 2017 Jun;2. DOI: https://doi.org/10.3389/feduc.2017.00024.
Watanabe AS, McCart G, Shimomura S, Kayser S. Systematic approach to drug information requests. Am J Health Syst Pharm. 1975 Dec;32(12):1282–5.
Sheehan AH, Jordan JK. Formulating an effective response: a structured approach. In: Malone PM, Malone MJ, Park SK, eds. Drug information: a guide for pharmacists. 6th ed. United States: McGraw-Hill; 2018.
Brown-Sica M, Sobel K, Pan D. Learning for all: teaching students, faculty, and staff with screencasting. Public Services Quarterly. 2009 May;5(2):81–97. DOI: https://doi.org/10.1080/15228950902805282.
Baker A. Students’ preferences regarding four characteristics of information literacy screencasts. Journal of Library & Information Services in Distance Learning. 2014 Jan;8(1-2):67–80. DOI: https://doi.org/10.1080/1533290X.2014.916247.
Bailey J. Informal screencasting: results of a customer‐satisfaction survey with a convenience sample. New Library World. 2012 Jan;113(1-2):7–26. DOI: https://doi.org/10.1108/03074801211199013.
Ergood A, Padron K, Rebar L. Making library screencast tutorials: factors and processes. Internet Reference Services Quarterly. 2012 Apr;17(2):95–107. DOI: https://doi.org/10.1080/10875301.2012.725705.
Mestre LS. Student preference for tutorial design: a usability study. Ref Serv Rev. 2012 May;40(2):258–76. DOI: https://doi.org/10.1108/00907321211228318.
Murphy J, Liew CL. Reflecting the science of instruction? Screencasting in Australian and New Zealand academic libraries: a content analysis. The Journal of Academic Librarianship. 2016 May;42(3):259–72. DOI: https://doi.org/10.1016/j.acalib.2015.12.010.
Visser N. Did we captivate them? Perceptions of second-year students about the library’s information literacy online tutorials. Mousaion. 2013;31(2):78–91.
Gamtso CW, Halpin PA. Tailoring library instruction for non-science majors taking hybrid and online science classes: student perceptions of information literacy in the virtual environment. Public Services Quarterly. 2018 Apr;14(2):99–118. DOI: https://doi.org/10.1080/15228959.2017.1372729.
Jacklin ML, Robinson K. Evolution of various library instruction strategies: using student feedback to create and enhance online active learning assignments. Partnership: The Canadian Journal of Library & Information Practice & Research. 2013 Jun;8(1):1–21. DOI: https://doi.org/10.21083/partnership.v8i1.2499.
Kuban AJ, Mulligan LM. Screencasts and standards: connecting an introductory journalism research course with information literacy. Commun Teach. 2014 Jul;28(3):188–95. DOI: https://doi.org/10.1080/17404622.2014.911335.
Wakefield J, Tyler J, Dyson LE, Frawley JK. Implications of student‐generated screencasts on final examination performance. Account Finance. 2019 Jun;59(2):1415–46. DOI: https://doi.org/10.1111/acfi.12256.
Frawley JK, Dyson LE, Wakefield J, Tyler J. Supporting graduate attribute development in introductory accounting with student-generated screencasts. International Journal of Mobile and Blended Learning. 2016 Jul;8(3):65–82. DOI: https://doi.org/10.4018/IJMBL.2016070105.
Sudhakar A, Tyler J, Wakefield J. Enhancing student experience and performance through peer-assisted learning. Issues in Accounting Education. 2016 Aug;31(3):321–36. DOI: https://doi.org/10.2308/iace-51249.
Ranellucci J, Bergey BW. Using motivation design principles to teach screencasting in online teacher education courses. Journal of Technology and Teacher Education. 2020 Jan; 28(2):393–401.
Galligan L, Hobohm C, Mathematics Education Research Group of Australasia. Students using digital technologies to produce screencasts that support learning in mathematics. Presented at: The Annual Meeting of the Mathematics Education Research Group of Australia (MERGA); Victoria, Australia; 2013.
Bush JC. Using screencasting to give feedback for academic writing. Innovation in Language Learning and Teaching. 2020 Nov;1–14. DOI: https://doi.org/10.1080/17501229.2020.1840571.
Cunningham KJ. Student perceptions and use of technology-mediated text and screencast feedback in esl writing. Comput Compos. 2019 Jun;52:222–41. DOI: https://doi.org/10.1016/j.compcom.2019.02.003.
Phillips M, Ryan T, Henderson M. A cross-disciplinary evaluation of digitally recorded feedback in higher education. Presented at: ASCILITE 2017, the 34th International Conference of Innovation, Practice and Research in the Use of Educational Technologies in Tertiary Education; Toowoomba; Australia; December 4–6, 2019.
Teoh L, Marriott P. Delivering screen-cast feedback on assessments to large cohorts. Presented at: IADIS International Conference e-Learning 2011, Part of the IADIS Multi Conference on Computer Science and Information Systems; Rome, Italy; July 20–23, 2011.
Wood D, Bruner JS, Ross G. The role of tutoring in problem solving. J Child Psychol & Psychiat. 1976 Apr;17(2):89–100. DOI: https://doi.org/10.1111/j.1469-7610.1976.tb00381.x.
