MLA Research Training Institute (RTI) 2018 and 2019: participant research confidence and program effectiveness
DOI:
https://doi.org/10.5195/jmla.2024.1915Keywords:
research confidence, research process, health sciences librarians, research training, librarian education, librarian research, evidence-based library and information practice (EBLIP)Abstract
Objective: The article reports on an assessment of the effectiveness of the MLA Research Training Institute (RTI) for the years 2018 and 2019. The RTI is a year-long continuing education research methods training and support program for health sciences librarians. The study focuses on assessing RTI participants' research confidence after program completion and compares these results with their perceptions of workshop/program performance and learning outcomes. In addition, the authors discuss how the findings were applied to inform and improve the program.
Methods: The study used a 26-item questionnaire, RTI Research Confidence Questionnaire, to gather information on participants’ self-reported research confidence before the workshop, immediately after the workshop, and one year after the workshop to determine statistically significant differences. Differences in research confidence were identified by using three nonparametric statistical tests. Additional workshop and program surveys were used to corroborate the research confidence findings.
Results: Post-workshop and one-year-after-workshop research confidence ratings were significantly higher than pre-workshop levels for years 1 and 2. A comparison of median ratings between years 1 and 2 showed significant increases in research confidence for nine items in year 2. Participants’ positive perceptions of workshop/program effectiveness and learning outcomes corroborated these findings.
Conclusion: Overall assessment findings indicated that RTI training helped participants understand, use, and apply research skills to conduct research. Findings also revealed that participants’ heightened research confidence persisted at least 12 months postintervention. The RTI Research Confidence Questionnaire proved effective for rigorously assessing and improving the RTI program. This study enhances the currently limited evidence on evidence-based approaches for assessing and improving research instruction for librarians.
References
Medical Library Association. Using scientific evidence to improve information practice: the research policy statement of the Medical Library Association [Internet]. The Association; 1995. [cited 6 Sep 2024.] https://www.mlanet.org/wp-content/uploads/2024/09/2948_7500_1995_mla_research_policy_statement.pdf.
Koufogiannakis DA, Brettle Alison. Eds. Being Evidence Based in Library and Information Practice. Chicago, IL: ALA Neal-Schuman; 2016. p.10.
Medical Library Association. The research imperative: the research policy statement of the Medical Library Association: research policy statement recommendations [Internet]. The Association; 2007. [cited 6 Sep 2024.] https://www.mlanet.org/wp-content/uploads/2024/09/2007_mla_research_imperative_full.pdf
Grefsheim SF, Rankin JA, Perry GJ, McKibbon A. Affirming our commitment to research: the Medical Library Association's research policy statement: the process and findings. J Med Libr Assoc. 2008 Apr;96(2):114–20. DOI: 10.3163/1536-5050.96.2.114.
Marshall JG. Linking research to practice: the rise of evidence-based health sciences librarianship. J Med Libr Assoc. 2014 Jan;102(1):14–21. DOI: http://dx.doi.org/10.3163/1536-5050.102.1.005.
Eldredge JD. Evidence-based librarianship: An overview. Bull Med Libr Assn. 2000 Oct; 88(4):289-302. (Available from: https://dx.doi.org/10.29173/lirg639 https://www.ncbi.nlm.nih.gov/pmc/articles/PMC35250/. [cited 6 Sep 2024].)
Booth A, Brice A. (eds). Evidence-based practice for information professionals: A handbook. London: Facet Publishing; 2004.
Thorpe C. Announcing and advocating: The missing step in the EBLIP model. EBLIP. 15 Dec 2021;16(4);118-125. DOI: https://doi.org/10.18438/eblip30044.
LaFitte D, Brettle A. The evolving model of EBLIP in research and practice. In: Wiley CW, Click AB Houlihan M. (eds). Everyday evidence-practice in academic libraries: Case studies and reflections. Chicago IL: Association of College and Research Libraries; 2023. p.1-10.
Plutchak TS. Building a body of evidence. J Med Libr Assoc. 2005 Apr; 93(2), 193–195. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1082934/.
Gore SA, Nordberg JM, Palmer LA, and Piorun ME. Trends in health sciences library and information science research: an analysis of research publications in the Bulletin of the Medical Library Association and Journal of the Medical Library Association from 1991 to 2007. J Med Libr Assoc. 2009 Jul; 97(3): 203–211. DOI: https://dx.doi.org/10.3163/1536-5050.97.3.009.
Funk ME. Our words, our story: a textual analysis of articles published in the Bulletin of the Medical Library Association/Journal of the Medical Library Association from 1961 to 2010. J Med Libr Assoc. 2013 Jan;101(1):12–20. DOI: http://dx.doi.org/10.3163/1536-5050.101.1.003.
Lessick S, Perryman C, Billman BL, Alpi KM, De Groote SL, Babin TD Jr. Research engagement of health sciences librarians: a survey of research-related activities and attitudes. J Med Libr Assoc. 2016 Apr;104(2):166–73. DOI: http://dx.doi.org/10.3163/1536-5050.104.2.015
Eldredge, J. Evidence-based librarianship: A commentary for HYPOTHESIS. Hypothesis. 1997 Fall; 11(3):4-7. (Available from: https://journals.indianapolis.iu.edu/index.php/hypothesis/issue/view/1589/575. [cited 6 Sep 2024]).
Sollenberger JF, Holloway RG. The evolving role and value of libraries and librarians in healthcare. JAMA. 2013 Sep 25;310(12):1231-2. DOI: http://dx.doi.org/10.1001/jama.2013.277050.
Brettle A, Maden M, Payne C. The impact of clinical librarian services on patients and health care organisations. Health Info Libr J. 2016 Jun;33(2):100-20. DOI: https://doi.org/10.1111/hir.12136
Brian R, Orlov N, Werner D, Martin SK, Arora VM, Alkureishi M. Evaluating the impact of clinical librarians on clinical questions during inpatient rounds. J Med Libr Assoc. 2018 Apr;106(2):175-183. DOI: https://doi.org/10.5195/jmla.2018.254.
Taylor MV, Stephenson PL. Demonstrating Value in Federal Medical Center Libraries. Med Ref Serv Q. 2018 Oct-Dec;37(4):403-412. DOI: https://doi.org/10.1080/02763869.2018.1514914
Siemensma G, Clayworth C, Pitman M. Impact of a Hospital Library Service at a Regional Health Service in Australia. J Hosp Librariansh 2022;22(4):271-283. DOI: 10.1080/15323269.2022.2124796
Divall, P., James, C., Heaton, M. and Brettle, A. (2022), UK survey demonstrates a wide range of impacts attributable to clinical librarian services. Health Info Libr J. 2022 Jun; 39(2):116-131. DOI: https://doi.org/10.1111/hir.12389
Shannon C, Freeman JL, MacEachern M, Rana GK, Smith C, Smith J, Song J. The impact of libraries and informationists on patient and population care: a mixed-methods study. J Med Libr Assoc. 2024 Jan; 112(1): 5-12. DOI: https://doi.org/10.5195/jmla.2024.1520
Tahmasebi M, Adibi P, Zare-Farashbandi F, Papi A, Rahimi A. The educational role of clinical informationist on improving clinical education among medical students: Based on Kirkpatrick model. J Educ Health Promot. 2020 Feb 28;9:28. DOI: 10.4103/jehp.jehp_439_19.
Rethlefsen ML, Farrell AM, Osterhaus Trzasko LC, Brigham TJ. Librarian co-authors correlated with higher quality reported search strategies in general internal medicine systematic reviews. J Clin Epidemiol. 2015 Jun;68(6):617-26. DOI: 10.1016/j.jclinepi.2014.11.025.
Koffel JB (2015) Use of recommended search strategies in systematic reviews and the impact of librarian involvement: A cross-sectional survey of recent authors. PLoS ONE 2015 May 4;10(5): e0125931. DOI: https://doi.org/10.1371/journal.pone.0125931.
Meert D, Torabi N, Costella J. Impact of librarians on reporting of the literature searching component of pediatric systematic reviews. J Med Libr Assoc. 2016 Oct;104(4):267-277. DOI: https://doi.org/10.18438/eblip29601.
Aamodt M, Huurdeman H, Strømme H. Librarian co-authored systematic reviews are associated with lower risk of bias compared to systematic reviews with acknowledgment of librarians or no participation by librarians. Evid Based Libr Inform Pract 2019;14(4):103–127. DOI: 10.18438/eblip29601.
Saleh AA, Huebner. Characteristics and impact of librarian co-authored systematic reviews: A bibliometric analysis. medRxiv 2020.02.14.20023119. DOI: https://doi.org/10.1101/2020.02.14.20023119.
Koufogiannakis D, Slater L, Crumley E. A Content Analysis of Librarianship Research. J Info Sci. 2004 Jun; 30(3), 227-239. DOI: https://doi.org/10.1177/0165551504044668.
Eldredge JD, Marshall JG, Brettle A, Holmes HN, Haglund L, Wallace R. Health Libraries, 121-132. In: Koufogiannakis DA, Brettle Alison. Eds. Being Evidence Based in Library and Information Practice. Chicago, IL: ALA Neal-Schuman; 2016.
Koufogiannakis D, and Crumley E. (2006). Research in librarianship: issues to consider. Libr Hi Technol. 2006 Jul 1; 24(3):324-340. DOI: https://doi.org/10.1108/07378830610692109
Starr, S. Survey research: we can do better. J Med Libr Assoc. 2012 Jan; 100(1): 1–2. DOI: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3257493/.
Cooper ID. Let’s get a stronger evidence base for our decisions. J Med Libr Assoc. 2016 Oct; 104(4):259-261. DOI: https://doi.org/10.5195/jmla.2016.144.
VanScoy A, Fontana C. How reference and information service is studied: Research approaches and methods. Libr Inform Sci Res. 2016 Apr;38(2)94-100. DOI: https://doi.org/10.1016/j.lisr.2016.04.002.
Starr, S. Survey research: we can do better. J Med Libr Assoc. 2012 Jan; 100(1): 1–2. DOI: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3257493/.
Funk ME. Our words, our story: a textual analysis of articles published in the Bulletin of the Medical Library Association/Journal of the Medical Library Association from 1961 to 2010. J Med Libr Assoc. 2013 Jan;101(1):12–20. DOI: http://dx.doi.org/10.3163/1536-5050.101.1.003.
Cooper ID. Let’s get a stronger evidence base for our decisions. J Med Libr Assoc. 2016 Oct; 104(4):259-261. DOI: https://doi.org/10.5195/jmla.2016.144.
Hinrichs RJ, Ramirez M, Ameen M. The publication fate of abstracts presented at the Medical Library Association conferences. J Med Libr Assoc. 2021 Oct 1;109(4):590-598. DOI: https://doi.org/10.5195/jmla.2021.1220.
Harvey SA, Wandersee JR. Publication rate of abstracts of papers and posters presented at Medical Library Association annual meetings. J Med Libr Assoc. 2010 Jul;98(3):250-5. DOI: 10.3163/1536-5050.98.3.014.
Alpi KM, Fenske R. Previous research shows Medical Library Association award winner publication rate. J Med Libr Assoc. 2011 Jan;99(1):3. DOI: 10.3163/1536-5050.99.1.002.
Shaw CE, Szwajcer AL. Publication rate of presentation abstracts presented at the Canadian Health Libraries Association (CHLA/ABSC) annual meetings from 2004-2009. Perform Meas Metr. 2016;17(3):252–62. DOI: https://doi.org/10.1108/PMM-07-2016-0034.
Booth A. Barriers and facilitators to evidence-based library and information practice an international perspective. Perspect Int Libr. 2011;1. DOI:10.5339/pil.2011.1
Eldredge JD, Phillips HE, Kroth PJ. Real-time peer review: an innovative feature to an evidence-based practice conference. Med Ref Serv Q. 2013 32(4):412-423. DOI: https://doi.org/10.1080/02763869.2013.837690.
Kennedy MR, Brancolini KR. Academic Librarian Research: A Survey of Attitudes, Involvement, and Perceived Capabilities. Coll Res Libr. 2012 Sep;73(5):431-448. DOI: https://doi.org/10.5860/crl-276.
Spring H, Doherty P, Boyes C, Wilshaw K. Research engagement in health librarianship: Outcomes of a focus group. Libr Infor Sc Res. 2014 Oct;36(3-4):142-153. DOI: https://doi.org/10.1016/j.lisr.2014.06.004.
Myers BA, Rodriguez B. How do early career health sciences information professionals gain competencies? J Med Libr Assoc. 2016 Jul;104(3):215-20. DOI: 10.3163/1536-5050.104.3.006.
Koufogiannakis D. Determinants of evidence use in academic librarian decision making. Coll Res Libr. 2015 Jan;76(1):100–14. DOI: https://doi.org/10.5860/crl.76.1.100.
Luo L. Fusing research into practice: The role of research methods education. Libr Inform Sc Res. 2011 Jul;33(3):191-201. DOI: https://doi.org/10.1016/j.lisr.2010.12.001.
Luo L, Kennedy M, Brancolini L. Institute for Research Design in Librarianship: Impact on information literacy research and practice. In: Kurbanoglu S, et al. Information literacy: Key to an inclusive society [Internet]. Springer, Cham; 2016. p. 439–46. (Communications in Computer and Information Science, 676). DOI: https://dx.doi.org/10.1007/978-3-319-52162-6_44.
Kennedy MR, Brancolini KR. Academic librarian research: An update to a survey of attitudes, involvement, and perceived capabilities. Coll Res Libr. 2018 Sep;79(6):822. DOI:https://doi.org/10.5860/crl.79.6.822.
Fennwald J. Research productivity among librarians: Factors leading to publications at Penn State. Coll Res Libr. 2008;69(2):104-116. DOI: https://doi.org/10.5860/crl.69.2.104.
Hoffmann K, Berg SA, Koufogiannakis D. Examining success: identifying factors that contribute to research productivity across librarianship and other disciplines. Libr Inform Res. 2014;38(119):13–28. DOI: https://dx.doi.org/10.29173/lirg639.
Hoffmann K, Berg S, Koufogiannakis D. Understanding factors that encourage research productivity in academic librarians. Evid Based Libr Inf Pract. 2017;12(4):102-128. DOI: https://doi.org/10.18438/B8G66F.
Ackerman E, Hunter J, Wilkinson ZT. The availability and effectiveness of research supports for early career academic librarians J Acad Libr. 2018;44(5):553-68. DOI: https://doi.org/10.1016/j.acalib.2018.06.001.
Hoffmann K, Berg SA, Brancolini KR, Kennedy MR. Complex and varied: factors related to the research productivity of academic librarians in the United States. Coll Res Libr. 2023;84(3):392-427. DOI: https://doi.org/10.5860/crl.84.3.392.
Medical Library Association. Platform for change: the educational policy statement of the Medical Library Association [Internet]. The Association, 1996. [cited 6 Sep 2024.] https://www.mlanet.org/wp-content/uploads/2024/07/MLA-Education-Policy-Statement-Platform_for_change-1996.pdf.
Medical Library Association. The educational policy statement of the Medical Library Association: competencies for lifelong learning and professional success [Internet]. The Association, 2007. [cited 6 Sep 2024.] https://www.mlanet.org/wp-content/uploads/2024/07/MLA-Professional-Competencies-2007-Full-Report.pdf.
Medical Library Association. MLA competencies for lifelong learning and professional success. [Internet]. The Association, 2017. [cited 6 Sep 2024.] https://www.mlanet.org/wp-content/uploads/2024/07/MLA-Professional-Competencies-2017-Full-Report.pdf.
Medical Library Association. Research Training Institute for Health Sciences Librarians: Building research capacity and community engagement in health librarianship. Chicago, IL: The Association, 2017. Laura Bush 21st Century Librarian Program. Grant No. :RE-95-17-0025-17. p.2. (Available from: URL: https://www.imls.gov/grants/awarded/re-95-17-0025-17. [cited 31 May 2024.])
Jacobs HLM, Berg SA. By librarians, for librarians: Building a strengths-based institute to develop librarians’ research culture in Canadian academic libraries. J Acad Libr. 2013 May;39(3):227-231. DOI: https://doi.org/10.1016/j.acalib.2013.02.003.
Brancolini KR, Kennedy MR. 9 A model research methods training program Implications for the Curriculum. In: Matusiak KK, Bright KM, Schachter. (eds). Bridging research and library practice: global perspectives on education and training. Berlin/Boston: De Gruyter Saur. 2024. 121-133. DOI: https://doi.org/10.1515/9783110772593-011.
Research Institute for Public Libraries: Overview. [Internet]. Available from: https://www.ripleffect.org [cited 31 May 2024.]
Lessick S, Dudden RF, Gore SA, Kloda L, LaFitte DK, Langman M, MacEachern M, Marshall JS, Perryman C. Proposal to Establish an MLA Research Training Institute. Chicago (IL): Research Imperative Task Force, Medical Library Association; May 13, 2016. p.7. (Available from: https://osf.io/fcqtv/ [cited 2024 May 22.])
Medical Library Association. Research Training Institute: RTI assessment findings [Internet]. Chicago, IL: The Association [cited 18 Sep 2024.] https://www.mlanet.org/professional-development/research/research-training-institute/rti-assessment-findings/.
Livinƫi R, Gunnesch-Luca G, Iliescu D. (2021). Research self-efficacy: A meta-analysis. Educ Psychol. 2021;56(3):215–242. DOI: https://doi.org/10.1080/00461520.2021.1886103.
Brancolini KR, Kennedy MR. The development and use of a research self-efficacy scale to assess the effectiveness of a research training program for academic librarians. Libr Info Res. 2017;41(124): 44-84. DOI: http://dx.doi.org/10.29173/lirg760.
Bandura A. Self-efficacy. In: Ramachandran VS. (ed). Encyclopedia of Human Behavior. Vol.4. New York, NY: Academic Press; 1994. 71-81.
Bright KM. Research Confidence of Liaison Librarians Providing Faculty Research Support. In Matusiak KK, Bright KM, Schachter. (eds). Bridging research and library practice: global perspectives on education and training. Berlin/Boston: De Gruyter Saur; 2024. p.197-210. https://www.degruyter.com/document/doi/10.1515/9783110772593-017/html.
Downloads
Additional Files
Published
Issue
Section
License
Copyright (c) 2024 Susan Lessick, MLS, MA, AHIP, FMLA, Jodi L. Philbrick, PhD, MSLS, AHIP, Lorie Kloda, MLIS, PhD
This work is licensed under a Creative Commons Attribution 4.0 International License.
