UpToDate versus DynaMed: a cross-sectional study comparing the speed and accuracy of two point-of-care information tools
DOI:
https://doi.org/10.5195/jmla.2021.1176Keywords:
point of care tools, UpToDate, DynaMedAbstract
Objective: To compare the accuracy, time to answer, user confidence, and user satisfaction between UpToDate and DynaMed (formerly DynaMed Plus), which are two popular point-of-care information tools.
Methods: A crossover study was conducted with medical residents in obstetrics and gynecology and family medicine at the University of Toronto in order to compare the speed and accuracy with which they retrieved answers to clinical questions using UpToDate and DynaMed. Experiments took place between February 2017 and December 2019. Following a short tutorial on how to use each tool and completion of a background survey, participants attempted to find answers to two clinical questions in each tool. Time to answer each question, the chosen answer, confidence score, and satisfaction score were recorded for each clinical question.
Results: A total of 57 residents took part in the experiment, including 32 from family medicine and 25 from obstetrics and gynecology. Accuracy in clinical answers was equal between UpToDate (average 1.35 out of 2) and DynaMed (average 1.36 out of 2). However, time to answer was 2.5 minutes faster in UpToDate compared to DynaMed. Participants were also more confident and satisfied with their answers in UpToDate compared to DynaMed.
Conclusions: Despite a preference for UpToDate and a higher confidence in responses, the accuracy of clinical answers in UpToDate was equal to those in DynaMed. Previous exposure to UpToDate likely played a major role in participants’ preferences. More research in this area is recommended.
References
Green ML, Ruff TR. Why do residents fail to answer their clinical questions? A qualitative study of barriers to practicing evidence-based medicine. Acad Med. 2005;80(2):176–82. DOI: https://doi.org/10.1097/00001888-200502000-00016.
Isaac T, Zheng J, Jha A. Use of UpToDate and outcomes in US hospitals. J Hosp Med. 2012;7(2):85–90. DOI: https://doi.org/10.1002/jhm.944.
Schwartz K, Northrup J, Israel N, Crowell K, Lauder N, Neale AV. Use of on-line evidence-based resources at the point of care. Fam Med. 2003;35(4):251–56.
Maggio LA, Aakre CA, Del Fiol G, Shellum J, Cook DA. Impact of clinicians' use of electronic knowledge resources on clinical and learning outcomes: systematic review and meta-analysis. J Med Internet Res. 2019;21(7):e13315. DOI: https://doi.org/10.2196/13315.
Beck JB, Tieder JS. Electronic resources preferred by pediatric hospitalists for clinical care. J Med Libr Assoc. 2015;103(4):177–83. DOI: https://dx.doi.org/10.3163%2F1536-5050.103.4.003.
Hoogendam A, Stalenhoef AFH, de Vries Robbé P, Overbeke AJPM. Answers to questions posed during daily patient care are more likely to be answered by UpToDate than PubMed. J Med Internet Res. 2008;10(4):e29. DOI: https://doi.org/10.2196/jmir.1012.
Kronenfeld MR, Bay RC, Coombs W. Survey of user preferences from a comparative trial of UpToDate and ClinicalKey. J Med Libr Assoc. 2013;101(2):151–4. DOI: https://dx.doi.org/10.3163%2F1536-5050.101.2.011.
Sayyah Ensan L, Faghankhani M, Javanbakht A, Ahmadi SF, Baradaran HR. To compare PubMed Clinical Queries and UpToDate in teaching information mastery to clinical residents: a crossover randomized controlled trial. PLoS ONE. 2011;6(8):e23487. DOI: https://doi.org/10.1371/journal.pone.0023487.
Walden RR, Woodward NJ, Wallace RL. Reevaluating point-of-care resources: community engagement in difficult collection choices. Med Ref Serv Q. 2019;38(1):22–30.
Amber KT, Dhiman G, Goodman KW. Conflict of interest in online point-of-care clinical support websites. J Med Ethics. 2014;40(8):578–580. DOI: http://dx.doi.org/10.1136/medethics-2013-101625.
Kwag KH, González-Lorenzo M, Banzi R, Bonovas S, Moja L. Providing doctors with high-quality information: an updated evaluation of web-based point-of-care information summaries. J Med Internet Res. 2016;18(1):e15. DOI: https://doi.org/10.2196/jmir.5234.
Si F, Ding G, Wei D, Li J, Li X, Chen Y, Yang K. Comparison and analysis on four evidence-based medicine databases. Chin J Evid Based Med. 2013;13(5):612–5. DOI: 10.7507/1672-2531.20130106.
American College of Obstetricians Gynecologists. PROLOG obstetrics. 7th ed. Washington, DC: American College of Obstetricians and Gynecologists; 2013.
American College of Obstetricians Gynecologists. PROLOG gynecology and surgery. 7th ed. Washington, D.C.: American College of Obstetricians and Gynecologists; 2014.
Masters P, American College of Physicians, issuing body. MKSAP 18: Medical knowledge self-assessment program. Philadelphia, PA: American College of Physicians; 2017.
Random.org [Internet]. Dublin, Ireland: Randomness and Integrity Services; c2021. Integer sets. Available from: <https://www.random.org/integer-sets/>.
StataCorp. 2020. Stata Statistical Software: Release 16. College Station, Texas: StataCorp.
Graber MA, Randles BD, Ely JW, Monnahan J. Answering clinical questions in the ED. Am J EMerge Med. 2008;26(2):144–147. DOI: https://doi.org/10.1016/j.ajem.2007.03.031.
