Vol. 152 No. 4344 (2022)
Entrustable professional activities for residency in general internal medicine: a systematic review:
- Bastien Valding
- Matteo Monti
- Noëlle Junod Perron
- Sonia Frick
- Cécile Jaques
- Mathieu Nendaz
- David Gachoud
CONTEXT: Entrustable Professional Activities (EPAs) are observable tasks that are regular parts of a physician’s daily clinical work. Before being permitted to accomplish these tasks independently, trainees must gain their supervisors’ trust. Defining the list of EPAs that should be mastered by the end of a residency is critical to setting clear expectations about autonomous practice.
OBJECTIVE: To collect all the lists of EPAs defined for residencies in general internal medicine and synthesise them into a reference work useful for developing new lists of EPAs or improving existing ones.
METHOD: This systematic review searched five databases and relevant grey literature using keywords related to EPAs and postgraduate education, from 2005, when the first article on EPAs was published, to April 2022. Inclusion criteria were the availability of an EPAs list and a focus on general internal medicine. Two reviewers independently selected the studies, extracted data and performed a quality assessment using QATSDD and AACODS tools. Mean values and inter-rater reliability were calculated.
RESULTS: The review yielded 3292 records, with 16 articles meeting the inclusion criteria, mostly from North America. Synthesising their 16 lists generated 395 EPAs. The reviewers then inductively categoried those EPAs, 308 of which fell into 6 domains, 14 themes and 24 subthemes. The domains were: (1) care and management of the general adult population (n = 103 EPAs); (2) care and management of patients with specific needs (n = 67); (3) care coordination and communication (n = 52); (4) management and leadership (N = 21); (5) healthcare quality, education, and research (n = 41); and (6) miscellaneous (n = 24). The remaining 87 EPAs were disease-specific and did not fit into this categorisation.
CONCLUSIONS: Categorising EPAs created a unique synthesis of the existing lists of EPAs for educating residents in general internal medicine. This synthesis could be used as a reference for anyone tasked with developing new lists of EPAs or improving existing ones.
- Schumacher DJ, Turner DA. Entrustable Professional Activities: Reflecting on Where We Are to Define a Path for the Next Decade. Acad Med. 2021 Jul;96(7S 7s):S1–5. https://doi.org/10.1097/acm.0000000000004097 https://doi.org/10.1097/ACM.0000000000004097
- ten Cate O. Entrustability of professional activities and competency-based training. Med Educ. 2005 Dec;39(12):1176–7. https://doi.org/10.1111/j.1365-2929.2005.02341.x
- Shorey S, Lau TC, Lau ST, Ang E. Entrustable professional activities in health care education: a scoping review. Med Educ. 2019 Aug;53(8):766–77. https://doi.org/10.1111/medu.13879
- Ten Cate O, Chen HC, Hoff RG, Peters H, Bok H, van der Schaaf M. Curriculum development for the workplace using Entrustable Professional Activities (EPAs): AMEE Guide No. 99. Med Teach. 2015;37(11):983–1002. https://doi.org/10.3109/0142159X.2015.1060308 10.3109/0142159X.2015.1060308 https://doi.org/10.3109/0142159X.2015.1060308
- ten Cate O, Scheele F. Competency-based postgraduate training: can we bridge the gap between theory and clinical practice? Acad Med. 2007 Jun;82(6):542–7. https://doi.org/10.1097/ACM.0b013e31805559c7
- Holmboe ES, Sherbino J, Long DM, Swing SR, Frank JR. The role of assessment in competency-based medical education. Med Teach. 2010;32(8):676–82. https://doi.org/10.3109/0142159x.2010.500704 https://doi.org/10.3109/0142159X.2010.500704
- Ten Cate O. Nuts and bolts of entrustable professional activities. J Grad Med Educ. 2013 Mar;5(1):157–8. https://doi.org/10.4300/JGME-D-12-00380.1
- ten Cate O, Young JQ. The patient handover as an entrustable professional activity: adding meaning in teaching and practice. Bmj Quality & Safety. 2012;21:9-12. doi: https://doi.org/10.1136/bmjqs-2012-001213. PubMed PMID: WOS:000311419400003.
- Carraccio C, Englander R, Holmboe ES, Kogan JR. Driving Care Quality: Aligning Trainee Assessment and Supervision Through Practical Application of Entrustable Professional Activities, Competencies, and Milestones. Acad Med. 2016 Feb;91(2):199–203. https://doi.org/10.1097/ACM.0000000000000985
- Ten Cate O, Hart D, Ankel F, Busari J, Englander R, Glasgow N, et al.; International Competency-Based Medical Education Collaborators. Entrustment Decision Making in Clinical Training. Acad Med. 2016 Feb;91(2):191–8. https://doi.org/10.1097/ACM.0000000000001044
- Chen HC, van den Broek WE, ten Cate O. The case for use of entrustable professional activities in undergraduate medical education. Acad Med. 2015 Apr;90(4):431–6. https://doi.org/10.1097/ACM.0000000000000586
- Ten Cate O, Chen HC. The ingredients of a rich entrustment decision. Med Teach. 2020 Dec;42(12):1413–20. https://doi.org/10.1080/0142159x.2020.1817348 https://doi.org/10.1080/0142159X.2020.1817348
- Taylor DR, Park YS, Smith CA, Karpinski J, Coke W, Tekian A. Creating Entrustable Professional Activities to Assess Internal Medicine Residents in Training: A Mixed-Methods Approach. Ann Intern Med. 2018 May;168(10):724–9. https://doi.org/10.7326/M17-1680
- Tanner FC, Brooks N, Fox KF, Gonçalves L, Kearney P, Michalis L, et al.; ESC Scientific Document Group. ESC Core Curriculum for the Cardiologist. Eur Heart J. 2020 Oct;41(38):3605–92. https://doi.org/10.1093/eurheartj/ehaa641
- Leipzig RM, Sauvigné K, Granville LJ, Harper GM, Kirk LM, Levine SA, et al. What is a geriatrician? American Geriatrics Society and Association of Directors of Geriatric Academic Programs end-of-training entrustable professional activities for geriatric medicine. J Am Geriatr Soc. 2014 May;62(5):924–9. https://doi.org/10.1111/jgs.12825
- Kerth JL, van Treel L, Bosse HM. The Use of Entrustable Professional Activities in Pediatric Postgraduate Medical Education: A Systematic Review. Acad Pediatr. 2021; https://doi.org/10.1016/j.acap.2021.07.007
- Hart D, Franzen D, Beeson M, Bhat R, Kulkarni M, Thibodeau L, et al. Integration of Entrustable Professional Activities with the Milestones for Emergency Medicine Residents. West J Emerg Med. 2019 Jan;20(1):35–42. https://doi.org/10.5811/westjem.2018.11.38912
- de Graaf J, Bolk M, Dijkstra A, van der Horst M, Hoff RG, Ten Cate O. The Implementation of Entrustable Professional Activities in Postgraduate Medical Education in the Netherlands: Rationale, Process, and Current Status. Acad Med. 2021 Jul;96(7S 7s):S29–35. https://doi.org/10.1097/acm.0000000000004110 https://doi.org/10.1097/ACM.0000000000004110
- Moll-Khosrawi P, Ganzhorn A, Zollner C, Schulte-Uentrop L. Development and validation of a postgraduate anaesthesiology core curriculum based on Entrustable Professional Activities: a Delphi study. GMS J Med Educ. 2020;37(5):Doc52. Epub 2020/09/29. doi: https://doi.org/10.3205/zma001345. PubMed PMID: 32984511; PubMed Central PMCID: PMCPMC7499458.
- O’Dowd E, Lydon S, O’Connor P, Madden C, Byrne D. A systematic review of 7 years of research on entrustable professional activities in graduate medical education, 2011-2018. Med Educ. 2019 Mar;53(3):234–49. https://doi.org/10.1111/medu.13792
- Moher D, Liberati A, Tetzlaff J, Altman DG; PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J Clin Epidemiol. 2009 Oct;62(10):1006–12. https://doi.org/10.1016/j.jclinepi.2009.06.005
- Friedman RH, Pozen JT, Rosencrans AL, Eisenberg JM, Gertman PM. General internal medicine units in academic medical centers: their emergence and functions. Ann Intern Med. 1982 Feb;96(2):233–8. https://doi.org/10.7326/0003-4819-96-2-233
- Kramer MH, Akalin E, Alvarez de Mon Soto M, Bitterman H, Ferreira F, Higgens C, et al.; Working Group on Professional Issues in Internal Medicine. Internal medicine in Europe: how to cope with the future? an official EFIM strategy document. Eur J Intern Med. 2010 Jun;21(3):173–5. https://doi.org/10.1016/j.ejim.2010.03.007
- Internal Medicine vs. Family Medicine: American College of Physicians; [cited 2020 07.09.2020]. Available from: https://www.acponline.org/about-acp/about-internal-medicine/career-paths/medical-student-career-path/internal-medicine-vs-family-medicine
- Ghali WA, Greenberg PB, Mejia R, Otaki J, Cornuz J. International perspectives on general internal medicine and the case for “globalization” of a discipline. J Gen Intern Med. 2006 Feb;21(2):197–200. https://doi.org/10.1111/j.1525-1497.2005.00289.x
- ten Cate O, Young JQ. The patient handover as an entrustable professional activity: adding meaning in teaching and practice. BMJ Qual Saf. 2012 Dec;21 Suppl 1:i9–12. https://doi.org/10.1136/bmjqs-2012-001213
- Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan-a web and mobile app for systematic reviews. Syst Rev. 2016;5(1):210. Epub 2016/12/07. doi: https://doi.org/10.1186/s13643-016-0384-4. PubMed PMID: 27919275; PubMed Central PMCID: PMCPMC5139140.
- Sirriyeh R, Lawton R, Gardner P, Armitage G. Reviewing studies with diverse designs: the development and evaluation of a new tool. J Eval Clin Pract. 2012 Aug;18(4):746–52. https://doi.org/10.1111/j.1365-2753.2011.01662.x
- Pinilla S, Lenouvel E, Strik W, Kloppel S, Nissen C, Huwendiek S. Entrustable Professional Activities in Psychiatry: A Systematic Review. Acad Psychiatry. 2019; https://doi.org/10.1007/s40596-019- 01142-7 https://doi.org/10.1007/s40596-019-01142-7
- Tyndall J, University F. The AACODS checklist designed to enable evaluation and critical appraisal of grey literature 2010. Available from: https://dspace.flinders.edu.au/xmlui/bitstream/handle/2328/3326/AACODS_Checklist.pdf;jsessionid=A10 EBD54545A54357AA2DB8BA7694851?sequence=4.
- Koo TK, Li MY. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J Chiropr Med. 2017;16(4):346-. doi: https://doi.org/10.1016/j.jcm.2017.10.001. PubMed PMID: WOS:000426972000011.
- Caverzagie KJ, Cooney TG, Hemmer PA, Berkowitz L. The development of entrustable professional activities for internal medicine residency training: a report from the Education Redesign Committee of the Alliance for Academic Internal Medicine. Acad Med. 2015 Apr;90(4):479–84. https://doi.org/10.1097/ACM.0000000000000564
- Chang A, Bowen JL, Buranosky RA, Frankel RM, Ghosh N, Rosenblum MJ, et al. Transforming primary care training--patient-centered medical home entrustable professional activities for internal medicine residents. J Gen Intern Med. 2013;28(6):801-9. Epub 2012/09/22. doi: https://doi.org/10.1007/s11606-012- 2193-3. PubMed PMID: 22997002; PubMed Central PMCID: PMCPMC3663955. https://doi.org/10.1007/s11606-012-2193-3
- Hauer KE, Kohlwes J, Cornett P, Hollander H, Ten Cate O, Ranji SR, et al. Identifying entrustable professional activities in internal medicine training. J Grad Med Educ. 2013;5(1):54-9. Epub 2014/01/10. doi: https://doi.org/10.4300/JGME-D-12-00060.1. PubMed PMID: 24404227; PubMed Central PMCID: PMCPMC3613318.
- Quraishi S, Wade W, Black D. Development of a GMC aligned curriculum for internal medicine including a qualitative study of the acceptability of ‘capabilities in practice’ as a curriculum model. Future Healthc J. 2019 Oct;6(3):196–203. https://doi.org/10.7861/fhj.2018-0016
- Schultz K, Griffiths J, Lacasse M. The Application of Entrustable Professional Activities to Inform Competency Decisions in a Family Medicine Residency Program. Acad Med. 2015 Jul;90(7):888–97. https://doi.org/10.1097/ACM.0000000000000671
- Shah R, Melvin L. Cavalcanti RBJCJoGIM. EPAs for the Ambulatory Internist in Translation: Findings from a Canadian Multi-Center Survey. 2019;14(3):9–15.
- Shaughnessy AF, Sparks J, Cohen-Osher M, Goodell KH, Sawin GL, Gravel J, Jr. Entrustable professional activities in family medicine. J Grad Med Educ. 2013;5(1):112-8. Epub 2014/01/10. doi: https://doi.org/10.4300/JGME-D-12-00034.1. PubMed PMID: 24404237; PubMed Central PMCID: PMCPMC3613294.
- Soran C, Laponis R, Summerville S, Thompson V, Eastburn A, O’Sullivan P, et al. Identifying Entrustable Professional Activities for Internal Medicine Residents in Ambulatory Continuity Practice. J Gen Intern Med. 2019; https://doi.org/10.1007/s11606-019-05430-8
- Valentine N, Wignes J, Benson J, Clota S, Schuwirth LW. Entrustable professional activities for workplace assessment of general practice trainees. Med J Aust. 2019 May;210(8):354–9. https://doi.org/10.5694/mja2.50130
- Association of Family Medicine Residency Directors. Entrustable Professional Activities (EPAs) for family medicine : Overview. 2015 [Accessed 2020 May 18] Available from: https://www.afmrd.org/d/do/P1887
- University of Calgary. Department of Family Medicine Residency Program Entrustable Professional Activities (“EPA’s) 2017 June [Accessed 2020 January 10]. Available from: https://www.calgaryfamilymedicine.ca/residency/index.php/program-info/curriculum?id=354
- Saltis T, Starling C, Regan C. Using trust in assessment A trial of Entrustable Professional Activities (EPA’s) in GP Training. 2015.
- University of Calgary - Departement of Family Medicine - Competency Framework. University of Manitoba. Rady Faculty of Health Sciences; 2018 June [Accessed 2020 January 10]. Available from: http://umanitoba.ca/faculties/health_sciences/medicine/units/family_medicine/media/Competency_Framework_2018-19.pdf
- Royal College of Physicians and Surgeons of Canada. Entrustable Professional Activities for General Internal Medicine. 2019.
- Dehghani Poudeh M, Mohammadi A, Mojtahedzadeh R, Yamani N. Entrustability levels of general internal medicine residents. BMC Med Educ. 2021;21(1):185. PubMed PMID: 33766005; PubMed Central PMCID: PMCPMC7995576. https://doi.org/10.1186/s12909-021-02624-9
- Michaud PA, Jucker-Kupper P, The P; The Profiles Working Group. The “Profiles” document: a modern revision of the objectives of undergraduate medical studies in Switzerland. Swiss Med Wkly. 2016 Feb;146(0506):w14270. https://doi.org/10.4414/smw.2016.14270
- Soran C, Laponis R, Summerville S, Thompson V, Eastburn A, O'Sullivan P, et al. Identifying Entrustable Professional Activities for Internal Medicine Residents in Ambulatory Continuity Practice. J Gen Intern Med. 2020;35(6):1917-9. Epub 2019/10/23. doi: https://doi.org/10.1007/s11606-019-05430-8. PubMed PMID: 31637647; PubMed Central PMCID: PMCPMC7280367.
- Taylor DR, Park YS, Egan R, Chan MK, Karpinski J, Touchie C, et al. EQual, a Novel Rubric to Evaluate Entrustable Professional Activities for Quality and Structure. Academic Medicine. 2017;92(11S Association of American Medical Colleges Learn Serve Lead: Proceedings of the 56th Annual Research in Medical Education Sessions):S110-S7. PubMed PMID: 29065031. https://doi.org/10.1097/ACM.0000000000001908