Objective structured assessment of technical skills and checklist scales reliability compared for high stakes assessments.
作者： Anthony G. Gallagher , Gerald C. O'Sullivan , Gerald Leonard , Brendan P. Bunting , Kieran J. McGlade
DOI: 10.1111/J.1445-2197.2012.06236.X
关键词: Technical skills 、 Competence assessment 、 Cronbach's alpha 、 Medical education 、 Likert scale 、 Medicine 、 Inter-rater reliability 、 Reliability (statistics) 、 Checklist 、 Surgical training
摘要: Background: The establishment of assessment reliability at the level individual trainee is an important attribute methodologies, particularly for doctors who have been failed. This issue particular importance process competence in USA, UK, Australia and New Zealand. Methods: We use data from 19 applicants higher surgical training 2008 Royal College Surgeons Ireland to compare: (i) objective structured technical skills (OSATS) method; (ii) a procedure-specific checklist assess excision sebaceous cyst task by two experienced senior surgeons. Results: overall interrater (IRR) OSATS as determined correlation coefficient was 0.507 (P < 0.03) 0.67 with alpha, considerably below accepted 0.8 IRR. checklist’s IRR 0.89. Individually, only five (26%) assessments reached contrast 18 (95%) assessments. Discussion: propose binary procedure-based checklists more reliable instruments robust reproducibility.
sci-hub.se 参考文章(20)
Alan E. Kazdin, Behavior modification in applied settings ,(1975)
Carol-Anne E. Moulton, Adam Dubrowski, Helen MacRae, Brent Graham, Ethan Grober, Richard Reznick, Teaching surgical skills: what kind of practice makes perfect?: a randomized, controlled trial. Annals of Surgery. ,vol. 244, pp. 400- 409 ,(2006) , 10.1097/01.SLA.0000234808.85789.6A
Gunnar Ahlberg, Lars Enochsson, Anthony G Gallagher, Leif Hedman, Christian Hogman, David A McClusky III, Stig Ramel, C Daniel Smith, Dag Arvidsson, None, Proficiency-based virtual reality training significantly reduces the error rate for residents during their first 10 laparoscopic cholecystectomies. American Journal of Surgery. ,vol. 193, pp. 797- 804 ,(2007) , 10.1016/J.AMJSURG.2006.06.050
Dimitri J Anastakis, Glenn Regehr, Richard K Reznick, Michael Cusimano, John Murnaghan, Mitchell Brown, Carol Hutchison, Assessment of technical skills transfer from the bench training model to the human model American Journal of Surgery. ,vol. 177, pp. 167- 170 ,(1999) , 10.1016/S0002-9610(98)00327-4
Kent R Van Sickle, E Matt Ritter, Mercedeh Baghai, Adam E Goldenberg, Ih-Ping Huang, Anthony G Gallagher, C Daniel Smith, None, Prospective, Randomized, Double-Blind Trial of Curriculum-Based Training for Intracorporeal Suturing and Knot Tying Journal of the American College of Surgeons. ,vol. 207, pp. 560- 568 ,(2008) , 10.1016/J.JAMCOLLSURG.2008.05.007
Anthony G. Gallagher, Paul Neary, Peter Gillen, Brian Lane, Anthony Whelan, William A Tanner, Oscar Traynor, NOVEL METHOD FOR ASSESSMENT AND SELECTION OF TRAINEES FOR HIGHER SURGICAL TRAINING IN GENERAL SURGERY ANZ Journal of Surgery. ,vol. 78, pp. 282- 290 ,(2008) , 10.1111/J.1445-2197.2008.04439.X
Christian R Larsen, Jette L Soerensen, Teodor P Grantcharov, Torur Dalsgaard, Lars Schouenborg, Christian Ottosen, Torben V Schroeder, Bent S Ottesen, Effect of virtual reality training on laparoscopic surgery: randomised controlled trial BMJ. ,vol. 338, pp. 1253- 1256 ,(2009) , 10.1136/BMJ.B1802
Melissa Bateson, Paul Martin, None, Measuring Behaviour: An Introductory Guide ,(1986)
Julian Hance, Rajesh Aggarwal, Rex Stanbridge, Christopher Blauth, Yaron Munz, Ara Darzi, John Pepper, Objective assessment of technical skills in cardiac surgery European Journal of Cardio-Thoracic Surgery. ,vol. 28, pp. 157- 162 ,(2005) , 10.1016/J.EJCTS.2005.03.012
Sean M. Carroll, A.M. Kennedy, Oscar Traynor, Anthony G. Gallagher, Objective assessment of surgical performance and its impact on a national selection programme of candidates for higher surgical training in plastic surgery. Journal of Plastic Reconstructive and Aesthetic Surgery. ,vol. 62, pp. 1543- 1549 ,(2009) , 10.1016/J.BJPS.2008.06.054