##common.pageHeaderLogo.altText##

Original article

Vol. 154 No. 5 (2024)

A multi-method approach to drafting candidate entrustable professional activities for a general internal medicine residency programme

Cite this as:
Swiss Med Wkly. 2024;154:3592
Published
27.05.2024

Summary

INTRODUCTION: Entrustable professional activities (EPAs) are units of concrete daily clinical tasks that trainee physicians should be able to handle with increasing autonomy during their postgraduate training. EPAs are gaining international recognition as an essential component of competency-based medical training programmes. The process of developing EPAs for a nationwide training programme is complex and requires an in-depth understanding of EPAs as a concept and good knowledge of appropriate development processes. This article provides a detailed description of the methodology and results of a multi-step approach for developing a list of candidate EPAs for Switzerland’s postgraduate training programme in general internal medicine (GIM).

METHODS: We took a multi-step approach including a systematic review of international literature, four national focus groups, a national consensus process using a RAND appropriateness method, and a quality check of the selected candidate EPAs using EQual criteria.

RESULTS: These steps generated a final list of 247 candidate EPAs in general internal medicine that were submitted for the national consensus process. After two rounds of rating, experts agreed on the appropriateness for general internal medicine postgraduate training of 225 candidate EPAs. Twenty-two were deemed inappropriate, and disagreement persisted only for two EPAs.

DISCUSSION: This multi-step programme is one of the few describing in detail the process of developing a list of EPAs and providing evidence of validity at each step. The clinical breadth of our candidate EPAs, together with the detailed description of our methodology, could serve as a useful starting point from which medical education specialists or clinicians could develop or revise applicable lists of EPAs, particularly for postgraduate training programmes in either general internal medicine or family medicine.

References

  1. Frank JR, Snell LS, Cate OT, Holmboe ES, Carraccio C, Swing SR, et al. Competency-based medical education: theory to practice. Med Teach. 2010;32(8):638–45. 10.3109/0142159X.2010.501190
  2. Sabatino, F., Training of health care professionals must change, says Pew Commission director. Hospitals, 1991. 65(4): p. 50, 52.
  3. Frank JR, Mungroo R, Ahmad Y, Wang M, De Rossi S, Horsley T. Toward a definition of competency-based education in medicine: a systematic review of published definitions. Med Teach. 2010;32(8):631–7. 10.3109/0142159X.2010.500898
  4. Taylor DR, Park YS, Smith CA, Karpinski J, Coke W, Tekian A. Creating Entrustable Professional Activities to Assess Internal Medicine Residents in Training: A Mixed-Methods Approach. Ann Intern Med. 2018 May;168(10):724–9. 10.7326/M17-1680
  5. Witteles RM, Verghese A. Accreditation Council for Graduate Medical Education (ACGME) Milestones-Time for a Revolt? JAMA Intern Med. 2016 Nov;176(11):1599–600. 10.1001/jamainternmed.2016.5552
  6. Ten Cate O, Scheele F. Competency-based postgraduate training: can we bridge the gap between theory and clinical practice? Acad Med. 2007 Jun;82(6):542–7. 10.1097/ACM.0b013e31805559c7
  7. Holmboe ES, Sherbino J, Long DM, Swing SR, Frank JR. The role of assessment in competency-based medical education. Med Teach. 2010;32(8):676–82. 10.3109/0142159X.2010.500704
  8. Ten Cate O. Nuts and bolts of entrustable professional activities. J Grad Med Educ. 2013 Mar;5(1):157–8. 10.4300/JGME-D-12-00380.1
  9. Ten Cate O, Taylor DR. The recommended description of an entrustable professional activity: AMEE Guide No. 140. Med Teach. 2021 Oct;43(10):1106–14. 10.1080/0142159X.2020.1838465
  10. Ten Cate O, Young JQ. The patient handover as an entrustable professional activity: adding meaning in teaching and practice. BMJ Qual Saf. 2012 Dec;21 Suppl 1:i9–12. 10.1136/bmjqs-2012-001213
  11. Carraccio C, Englander R, Holmboe ES, Kogan JR. Driving Care Quality: Aligning Trainee Assessment and Supervision Through Practical Application of Entrustable Professional Activities, Competencies, and Milestones. Acad Med. 2016 Feb;91(2):199–203. 10.1097/ACM.0000000000000985
  12. Schumacher DJ, Turner DA. Entrustable Professional Activities: Reflecting on Where We Are to Define a Path for the Next Decade. Acad Med. 2021 Jul;96 7S:S1–5. 10.1097/ACM.0000000000004097
  13. Ten Cate O. Entrustability of professional activities and competency-based training. Med Educ. 2005 Dec;39(12):1176–7. 10.1111/j.1365-2929.2005.02341.x
  14. Shorey S, Lau TC, Lau ST, Ang E. Entrustable professional activities in health care education: a scoping review. Med Educ. 2019 Aug;53(8):766–77. 10.1111/medu.13879
  15. Ten Cate O, Young JQ. The patient handover as an entrustable professional activity: adding meaning in teaching and practice. BMJ Qual Saf. 2012 Dec;21 Suppl 1:i9–12. 10.1136/bmjqs-2012-001213
  16. Carraccio C, Englander R, Gilhooly J, Mink R, Hofkosh D, Barone MA, et al. Building a Framework of Entrustable Professional Activities, Supported by Competencies and Milestones, to Bridge the Educational Continuum. Acad Med. 2017 Mar;92(3):324–30. 10.1097/acm.0000000000001141 10.1097/ACM.0000000000001141
  17. de Graaf J, Bolk M, Dijkstra A, van der Horst M, Hoff RG, Ten Cate O. The Implementation of Entrustable Professional Activities in Postgraduate Medical Education in the Netherlands: Rationale, Process, and Current Status. Acad Med. 2021 Jul;96 7S:S29–35. 10.1097/acm.0000000000004110 10.1097/ACM.0000000000004110
  18. Wagner LM, Dolansky MA, Englander R. Entrustable professional activities for quality and patient safety. Nurs Outlook. 2018;66(3):237–43. 10.1016/j.outlook.2017.11.001
  19. Hauer KE, Boscardin C, Fulton TB, Lucey C, Oza S, Teherani A. Using a Curricular Vision to Define Entrustable Professional Activities for Medical Student Assessment. J Gen Intern Med. 2015 Sep;30(9):1344–8. 10.1007/s11606-015-3264-z
  20. Hennus MP, Jarrett JB, Taylor DR, Ten Cate O. Twelve tips to develop entrustable professional activities. Med Teach. 2023 Jul;45(7):701–7. 10.1080/0142159X.2023.2197137
  21. Training IS. Programme de formation postgraduée du 1er janvier 2022- Specialiste en Médecine Interne Générale. 2022 [cited 2022 23 december]; Available from: https://www.siwf.ch/files/pdf7/aim_version_internet_f.pdf
  22. Humphrey-Murto S, Varpio L, Gonsalves C, Wood TJ. Using consensus group methods such as Delphi and Nominal Group in medical education research. Med Teach. 2017 Jan;39(1):14–9. 10.1080/0142159X.2017.1245856
  23. Taylor DR, et al. EQual, a Novel Rubric to Evaluate Entrustable Professional Activities for Quality and Structure. Acad Med, 2017. 92(11S Association of American Medical Colleges Learn Serve Lead: Proceedings of the 56th Annual Research in Medical Education Sessions): p. S110-S117 DOI: 10.1097/ACM.0000000000001908
  24. Valding B, Monti M, Junod Perron N, Frick S, Jaques C, Nendaz M, et al. Entrustable professional activities for residency in general internal medicine: a systematic review. Swiss Med Wkly. 2022 Nov;152(4344):40002. 10.57187/smw.2022.40002
  25. P., D., Conversation Analysis. 2006: Sage Publishing Ltd.
  26. Fitch K, et al. The RAND/UCLA appropriateness method user’s manual. Rand Corp Santa Monica CA; 2001.
  27. Black N, Murphy M, Lamping D, McKee M, Sanderson C, Askham J, et al. Consensus development methods: a review of best practice in creating clinical guidelines. J Health Serv Res Policy. 1999 Oct;4(4):236–48. 10.1177/135581969900400410
  28. McMillan SS, King M, Tully MP. How to use the nominal group and Delphi techniques. Int J Clin Pharm. 2016 Jun;38(3):655–62. 10.1007/s11096-016-0257-x
  29. Taylor D, Park YS, Smith C, Cate OT, Tekian A. Constructing Approaches to Entrustable Professional Activity Development that Deliver Valid Descriptions of Professional Practice. Teach Learn Med. 2021;33(1):89–97. 10.1080/10401334.2020.1784740
  30. Ten Cate O, Chen HC, Hoff RG, Peters H, Bok H, van der Schaaf M. Curriculum development for the workplace using Entrustable Professional Activities (EPAs): AMEE Guide No. 99. Med Teach. 2015;37(11):983–1002. 10.3109/0142159X.2015.1060308
  31. Young JQ, Hasser C, Hung EK, Kusz M, O’Sullivan PS, Stewart C, et al. Developing End-of-Training Entrustable Professional Activities for Psychiatry: Results and Methodological Lessons. Acad Med. 2018 Jul;93(7):1048–54. 10.1097/acm.0000000000002058 10.1097/ACM.0000000000002058
  32. Marceau M, Gallagher F, Young M, St-Onge C. Validity as a social imperative for assessment in health professions education: a concept analysis. Med Educ. 2018 Jun;52(6):641–53. 10.1111/medu.13574
  33. Waggoner J, Carline JD, Durning SJ. Is There a Consensus on Consensus Methodology? Descriptions and Recommendations for Future Consensus Research. Acad Med. 2016 May;91(5):663–8. 10.1097/acm.0000000000001092 10.1097/ACM.0000000000001092
  34. Touchie C, De Champlain A, Pugh D, Downing S, Bordage G. Supervising incoming first-year residents: faculty expectations versus residents’ experiences. Med Educ. 2014 Sep;48(9):921–9. 10.1111/medu.12503
  35. Tanner FC, Brooks N, Fox KF, Gonçalves L, Kearney P, Michalis L, et al.; ESC Scientific Document Group. ESC Core Curriculum for the Cardiologist. Eur Heart J. 2020 Oct;41(38):3605–92. 10.1093/eurheartj/ehaa641
  36. Hauer KE, Ten Cate O, Boscardin C, Irby DM, Iobst W, O’Sullivan PS. Understanding trust as an essential element of trainee supervision and learning in the workplace. Adv Health Sci Educ Theory Pract. 2014 Aug;19(3):435–56. 10.1007/s10459-013-9474-4
  37. Sterkenburg A, Barach P, Kalkman C, Gielen M, ten Cate O. When do supervising physicians decide to entrust residents with unsupervised tasks? Acad Med. 2010 Sep;85(9):1408–17. 10.1097/ACM.0b013e3181eab0ec