Objective structured teaching examination (OSTE)
an underused tool developed to assess clinical teaching skills. A narrative review of the literature
Palavras-chave:
Education, medical, Educational measurement, Professional competenceResumo
BACKGROUND: There are plenty of options for evaluating medical students and medical residents’ clinical skills. Objective structured clinical evaluations (OSCEs) have emerged as a powerful and reliable tool for assessing multiple cognition domains of clinical expertise. In the same way as OSCEs have emerged to assess clinical skills, objective structured teaching evaluations (OSTEs) have come to light as promising and unbiased interventions for evaluating the act of clinical teaching. DESIGN AND SETTING: Narrative review developed at Universidade Federal de Uberlândia, Brazil. METHODS: We searched the literature regarding OSTEs using the MEDLINE (via PubMed) and LILACS (via Biblioteca Virtual em Saude) databases. The SciELO library was also searched for Brazilian papers. Sys-tematic reviews, reviews and randomized controlled trials specifically assessing how OSTEs performed in relation to development of academic staff and medical residents were then selected. RESULTS: Our search retrieved 178 papers, of which 40 were considered eligible for intensive review. Most of the studies selected reported positive effects from OSTE activities. However, there was little quantitative data to gauge the impact of OSTEs on improvement of teaching skills. CONCLUSIONS: Considering that OSCEs have become a widely used tool for assessing medical students’ and residents’ clinical skills, it is high time to incorporate OSTEs for evaluating teaching skills in Brazil. En-couraging data to support implementation of this assessment tool in this country is available from abroad. The net benefit from this would possibly encompass medical students, residents and academic staff, through bringing awareness about the importance of excelling in teaching skills.
Downloads
Referências
Goe L, Croft A. Methods of Evaluating Teacher Effectiveness. Research-to-Practice Brief. National Comprehensive Center for Teacher Quality. 2009. Available from: https://files.eric.ed.gov/fulltext/ED543666.pdf. Accessed in 2018 (Aug 17).
Stecher B, Garet M, Hamilton L, et al. Improving Teaching Effectiveness: Implementation: The Intensive Partnerships for Effective Teaching Through 2013-2014 Santa Monica, CA: RAND Corporation; 2016. Available from: https://www.rand.org/content/dam/rand/pubs/research_reports/RR1200/RR1295/RAND_RR1295.pdf. Accessed in 2018 (Aug 17).
Barrows HS, Abrahamson S. The programmed patient: a technique for appraising student performance in clinical neurology. J Med Educ. 1964;39:802-5. PMID: 14180699.
Simpson DE, Lawrence SL, Krogull SR. Using standardized ambulatory teaching situations for faculty development. Teach Learn Med: An International Journal. 1992;4(1):58-61. doi: 10.1080/10401339209539534.
Orlander JD, Bor DH, Strunin L. A structured clinical feedback exercise as a learning-to-teach practicum for medical residents. Acad Med. 1994;69(1):18-20. PMID: 8285990.
Lesky LG, Wilkerson L. Using” standardized students” to teach a learner-centered approach to ambulatory precepting. Acad Med. 1994;69(12):955-7. PMID: 7999182; doi: 10.1097/00001888-199412000-000004.
Prislin MD, Fitzpatrick C, Giglio M, Lie D, Radecki S. Initial experience with a multi-station objective structured teaching skills evaluation. Acad Med. 1998;73(10):1116-8. PMID: 9795632; doi: 10.1097/00001888-199810000-00024.
Wamsley M, Julian K, Morrison E, Zabar S. Workshop F06: Introduction to the Objective Structured Teaching Evaluation(OSTE): A Novel Tool for Evaluating Teaching Skills; 2006.
Krajic Kachur E. Multiple station exams and teaching exercises (MSEs) for teaching about teaching. In: Scherpbier AJJA, van der Vleuten CPM, Rethans JJ, van der Steeg AFW, editors. Advances in Medical Education. Dordrecht: Springer; 1997. p. 226-7. ISBN: 978-94-011-4886-3.
Dunnington GL, DaRosa D. A prospective randomized trial of a residents-as-teachers training program. Acad Med. 1998;73(6):696-700. PMID: 9653409; doi: 10.1097/00001888-199806000-00017.
Schol S. A Multiple‐station Test of the Teaching Skills of General Practice Preceptors in Flanders, Belgium. Acad Med. 2001;76(2):176-80. PMID: 11158840; doi: 10.1097/00001888-200102000-00018.
Gelula MH, Yudkowsky R. Microteaching and standardized students support faculty development for clinical teaching. Acad Med. 2002;77(9):941. PMID: 12228115; doi: 10.1097/00001888-200209000-00048.
Morrison EH, Boker JR, Hollingshead J, et al. Reliability and validity of an objective structured teaching examination for generalist resident teachers. Acad Med. 2002;77(10 Suppl):S29-S32. PMID: 12377697.
Stone S, Mazor K, Devaney-O’Neil S, et al. Development and implementation of an objective structured teaching exercise (OSTE) to evaluate improvement in feedback skills following a faculty development workshop. Teach Learn Med. 2003;15(1):7-13. PMID: 12632702; doi: 10.1207/S15328015TLM1501_03.
Morrison EH, Rucker L, Boker JR, et al. A pilot randomized, controlled trial of a longitudinal residents-as-teachers curriculum. Acad Med. 2003;78(7):722-9. PMID: 12857695.
Boillat M, Bethune C, Ohle E, Razack S, Steinert Y. Twelve tips for using the objective structured teaching exercise for faculty development. Med Teach. 2012;34(4):269-73. PMID: 22455695; doi: 10.3109/0142159X.2011.599891.
Sturpe DA, Schaivone KA. A primer for objective structured teaching exercises. Am J Pharm Educ. 2014;78(5):104. PMID: 24954944; doi: 10.5688/ajpe785104.
Zabar S, Hanley K, Stevens DL, et al. Measuring the competence of residents as teachers. J Gen Intern Med. 2004;19(5 pt 2):530-3. PMID: 15109318; doi: 10.11/j.1525-1497.200430219.x.
Gaba ND, Blatt B, Macri CJ, Greenberg L. Improving teaching skills in obstetrics and gynecology residents: evaluation of a residents-as-teachers program. Am J Obstet Gynecol. 2007;196(1):87.e1-7. PMID: 17240248; doi: 10.1016/j.ajog.2006.09.037.
McSparron JI, Ricotta DN, Moskowitz A, et al. The PrOSTE: identifying key components of effective procedural teaching. Ann Am Thorac Soc. 2015;12(2):230-4. PMID: 25564926; doi: 10.1513/annalsATS.201406-237BC.
Cerrone SA, Adelman P, Akbar S, Yacht AC, Fornari A. Using Objective Structured Teaching Encounters (OSTEs) to prepare chief residents to be emotionally intelligent leaders. Med Educ Online. 2017;22(1):1320186. PMID: 28460596. doi: 10.1080/10872981.2017.1320186.
Morrison EH, Rucker L, Boker JR, et al. The effect of a 13-hour curriculum to improve residents’ teaching skills: a randomized trial. Ann Intern Med. 2004;141(4):257-63. PMID: 15313741; doi: 10.7326/0003-4819-141-4-200408170-00005.
Zackoff M, Jerardi K, Unaka N, Sucharew H, Klein M. An observed structured teaching evaluation demonstrates the impact of a resident-as-teacher curriculum on teaching competency. Hosp Pediatr. 2015;5(6):342-7. PMID: 26034166; doi: 10.1542/hpeds.2014-0134.
Steinert Y, Mann K, Centeno A, et al. A systematic review of faculty development initiatives designed to improve teaching effectiveness in medical education: BEME Guide No. 8. Med Teach. 2006;28(6):497-526. PMID: 17074699; doi: 10.1080/01421590600902976.
McAndrew M, Eidtson WH, Pierre GC, Gillespie CC. Creating an objective structured teaching examination to evaluate a dental faculty development program. J Dent Educ. 2012;76(4):461-71. PMID: 22473558.
McCutcheon LR, Whitcomb K, Cox CD, et al. Interprofessional objective structured teaching exercise (iOSTE) to train preceptors. Curr Pharm Teach Learn. 2017;9(4):605-15. PMID: 29233433; doi; 10.1016/j. ctpl.2017.03.023.
Fluit CR, Bolhuis S, Grol R, Laan R, Wensing M. Assessing the quality of clinical teachers: a systematic review of content and quality of questionnaires for assessing clinical teachers. J Gen Intern Med. 2010;25(12):1337-45. PMID: 20703952; doi: 10.1007/s11606-010-1458-y.
Williams BC, Litzelman DK, Babbott SF, Lubitz RM, Hofer TP. Validation of a global measure of faculty’s clinical teaching performance. Acad Med. 2002;77(2):177-80. PMID: 11841985.
Lombarts M, Arah O, Busch O, Heineman M. Using the SETQ system to evaluate and improve teaching qualities of clinical teachers. Ned Tijdschr Geneeskd. 2010;154:A1222. PMID: 20170574.
Irby DM. Teaching and learning in ambulatory care settings: a thematic review of the literature. Acad Med. 1995;70(10):898-931. PMID: 7575922; doi: 10.1097/00001888-199510000-00014.
Wamsley MA, Julian KA, Vener MH, Morrison EH. Using an objective structured teaching evaluation for faculty development. Med Educ. 2005;39(11):1160-1. PMID: 16262834; doi:10.1111/j.1365-2929.2005.02287.x.
Decker S, Fey M, Sideras S, et al. Standards of best practice: Simulation standard VI: The debriefing process. Clinical Simulation in Nursing.2013;9(6):S26-S9. doi: 10.1016/j.ecns.2013.04.008.
Trowbridge RL, Snydman LK, Skolfield J, Hafler J, Bing-You RG. A systematic review of the use and effectiveness of the Objective Structured Teaching Encounter. Med Teach. 2011;33(11):893-903. PMID: 22022900; doi: 10.3109/0142159X.2011.577463.
Quirk M, Mazor K, Haley H-L, et al. Reliability and validity of checklists and global ratings by standardized students, trained raters, and faculty raters in an objective structured teaching environment. Teach Learn Med. 2005;17(3):202-8. PMID: 16042515; doi: 10.1207/s15328015tlm1703_2.
Neher JO, Gordon KC, Meyer B, Stevens N. A five-step “microskills” model of clinical teaching. J Am Board Fam Pract. 1992;5(4):419-24. PMID: 1496899; doi: 10.3122/jabfm.5.4.419.
Tucker PD, Stronge JH. Linking teacher evaluation and student learning: ASCD; 2005. ISBN-13: 978-1416600329; ISBN-10: 1416600329.
Kirkpatrick D. Evaluation, Training Programs: the four levels, San Francisco: Berrett-Koehler Publishers. learning transfer. International Journal of Training and Development. 1994;6(1):36-48. Available from: https://www.bkconnection.com/static/Evaluating_Training_Programs_EXCERPT.pdf. Accessed in 2018 (Aug 17).
Downloads
Publicado
Como Citar
Edição
Seção
Licença
Este trabalho está licenciado sob uma licença Creative Commons Attribution 4.0 International License.
