Erratum to: Constructing a validity argument for the Objective Structured Assessment of Technical Skills (OSATS): a systematic review of validity evidence

作者: Rose Hatala , David A. Cook , Ryan Brydges , Richard Hawkins

DOI: 10.1007/S10459-015-9636-7

关键词:

摘要: In order to construct and evaluate the validity argument for Objective Structured Assessment of Technical Skills (OSATS), based on Kane’s framework, we conducted a systematic review. We searched MEDLINE, EMBASE, CINAHL, PsycINFO, ERIC, Web Science, Scopus, selected reference lists through February 2013. Working in duplicate, original research articles any language evaluating OSATS as an assessment tool health professional. iteratively collaboratively extracted evidence from included varied uses OSATS. Twenty-nine met inclusion criteria, all focussed surgical technical skills assessment. identified three intended OSATS, namely formative feedback, high-stakes program evaluation. Following four inferences were examined (scoring, generalization, extrapolation, decision). For feedback assessment, there was reasonable scoring extrapolation. However, dearth generalization aside inter-rater reliability data absence linking multi-station scores performance real clinical settings. evaluation, supported by extrapolation evidence. There complete lack regarding implications decisions scores. general, use feedback. Research provide support is required if be used higher-stakes

参考文章(59)
Michael Chinn, Peter Nielsen, Barbara A Goff, Amy VanBlaricom, Lynn Mandel, Comparison of objective, structured assessment of technical skills with a virtual reality hysteroscopy trainer and standard latex hysteroscopy model. Journal of Reproductive Medicine. ,vol. 52, pp. 407- 412 ,(2007)
Michael T. Kane, Validating the Interpretations and Uses of Test Scores Journal of Educational Measurement. ,vol. 50, pp. 1- 73 ,(2013) , 10.1111/JEDM.12000
Richard Reznick, Glenn Regehr, Helen MacRae, Jenepher Martin, Wendy McCulloch, Testing technical skill via an innovative “bench station” examination American Journal of Surgery. ,vol. 173, pp. 226- 230 ,(1997) , 10.1016/S0002-9610(97)89597-9
J Eric Jelovsek, Nathan Kow, Gouri B Diwadkar, Tools for the direct observation and assessment of psychomotor skills in medical trainees: a systematic review Medical Education. ,vol. 47, pp. 650- 673 ,(2013) , 10.1111/MEDU.12220
G Ault, R Reznick, H MacRae, W Leadbetter, D DaRosa, R Joehl, J Peters, Glenn Regehr, Exporting a technical skills evaluation technology to other sites. American Journal of Surgery. ,vol. 182, pp. 254- 256 ,(2001) , 10.1016/S0002-9610(01)00700-0
David B. Swanson, Cees P.M. van der Vleuten, Assessment of Clinical Skills With Standardized Patients: State of the Art Revisited Teaching and Learning in Medicine. ,vol. 25, ,(2013) , 10.1080/10401334.2013.842916
D. Dath, G. Regehr, D. Birch, C. Schlachta, E. Poulin, J. Mamazza, R. Reznick, H. M. MacRae, Toward reliable operative assessment: the reliability and feasibility of videotaped assessment of laparoscopic technical skills. Surgical Endoscopy and Other Interventional Techniques. ,vol. 18, pp. 1800- 1804 ,(2004) , 10.1007/S00464-003-8157-2
Richard E. Hawkins, Melissa J. Margolis, Steven J. Durning, John J. Norcini, Constructing a validity argument for the mini-Clinical Evaluation Exercise: a review of the research. Academic Medicine. ,vol. 85, pp. 1453- 1461 ,(2010) , 10.1097/ACM.0B013E3181EAC3E6
Sean J. Hislop, Jeffrey H. Hsu, Craig R. Narins, Bryce T. Gillespie, Raj A. Jain, David W. Schippert, Anthony L. Almudevar, Karl A. Illig, Simulator assessment of innate endovascular aptitude versus empirically correct performance. Journal of Vascular Surgery. ,vol. 43, pp. 47- 55 ,(2006) , 10.1016/J.JVS.2005.09.035
Eva Kassab, Jimmy Kyaw Tun, Sonal Arora, Dominic King, Kamran Ahmed, Danilo Miskovic, Alexandra Cope, Bhamini Vadhwana, Fernando Bello, Nick Sevdalis, Roger Kneebone, "Blowing up the barriers" in surgical training: exploring and validating the concept of distributed simulation. Annals of Surgery. ,vol. 254, pp. 1059- 1065 ,(2011) , 10.1097/SLA.0B013E318228944A