Reliability of a procedural checklist as a high-stakes measurement of advanced technical skill.

作者: Sarah E. Peyré , Christian G. Peyré , Jeffrey A. Hagen , Maura E. Sullivan

DOI: 10.1016/J.AMJSURG.2009.10.003

关键词: Fleiss' kappaKappaSurgeryMedicineAdvanced stageTechnical skillsPhysical therapyReliability (statistics)Nissen fundoplicationClinical competenceChecklist

摘要: Abstract Background The purpose of this study was to determine the reliability a previously validated laparoscopic Nissen fundoplication procedural checklist as measurement advanced technical skill. Methods Five surgeons, using 65-step checklist, independently evaluated 2 video recordings expert surgeon operative performances fundoplication. Results were analyzed for percent agreement and Fleiss kappa correlation each operation combined whole. Sixty-four 65 steps had 80% or higher both case A B when considered overall. coefficients (kappa = .95) .96) overall (operative + B) .95). Conclusion percentage all 3 analyses indicate high degree (>.80) that would support use instrument high-stakes assessment

参考文章(16)
Nasir I. Bhatti, Charles W. Cummings, Viewpoint: Competency in Surgical Residency Training: Defining and Raising the Bar Academic Medicine. ,vol. 82, pp. 569- 573 ,(2007) , 10.1097/ACM.0B013E3180555BFB
Jennine L. Larson, Reed G. Williams, Janet Ketchum, Margaret L. Boehler, Gary L. Dunnington, Feasibility, reliability and validity of an operative performance rating system for evaluating surgery residents Surgery. ,vol. 138, pp. 640- 649 ,(2005) , 10.1016/J.SURG.2005.07.017
Richard Reznick, Glenn Regehr, Helen MacRae, Jenepher Martin, Wendy McCulloch, Testing technical skill via an innovative “bench station” examination American Journal of Surgery. ,vol. 173, pp. 226- 230 ,(1997) , 10.1016/S0002-9610(97)89597-9
Sarah E. Peyre, Christian G. Peyre, Jeffrey A. Hagen, Maura E. Sullivan, John C. Lipham, Steven R. DeMeester, Jeffrey H. Peters, Tom R. DeMeester, Laparoscopic Nissen fundoplication assessment: task analysis as a model for the development of a procedural checklist Surgical Endoscopy. ,vol. 23, pp. 1227- 1232 ,(2009) , 10.1007/S00464-008-0214-4
G Ault, R Reznick, H MacRae, W Leadbetter, D DaRosa, R Joehl, J Peters, Glenn Regehr, Exporting a technical skills evaluation technology to other sites. American Journal of Surgery. ,vol. 182, pp. 254- 256 ,(2001) , 10.1016/S0002-9610(01)00700-0
Joseph L. Fleiss, Measuring nominal scale agreement among many raters. Psychological Bulletin. ,vol. 76, pp. 378- 382 ,(1971) , 10.1037/H0031619
Mohsen Tavakol, Mohammad Ali Mohagheghi, Reg Dennick, Assessing the Skills of Surgical Residents Using Simulation Journal of Surgical Education. ,vol. 65, pp. 77- 83 ,(2008) , 10.1016/J.JSURG.2007.11.003
Rajesh Aggarwal, Teodor Grantcharov, Krishna Moorthy, Thor Milland, Ara Darzi, Toward feasible, valid, and reliable video-based assessments of technical surgical skills in the operating room. Annals of Surgery. ,vol. 247, pp. 372- 379 ,(2008) , 10.1097/SLA.0B013E318160B371
J. D. Beard, S. Choksy, S. Khan, , Assessment of operative competence during carotid endarterectomy. British Journal of Surgery. ,vol. 94, pp. 726- 730 ,(2007) , 10.1002/BJS.5689
Simon Bann, Mansoor Khan, Vivek Datta, Ara Darzi, Surgical skill is predicted by the ability to detect errors. American Journal of Surgery. ,vol. 189, pp. 412- 415 ,(2005) , 10.1016/J.AMJSURG.2004.07.040