Gastrointestinal Endoscopy Competency Assessment Tool: reliability and validity evidence.

作者: Catharine M. Walsh , Simon C. Ling , Nitin Khanna , Samir C. Grover , Jeffrey J. Yu

DOI: 10.1016/J.GIE.2014.11.030

关键词: Concurrent validityIntraclass correlationPhysical therapyReliability (statistics)ColonoscopyChecklistMedicineInter-rater reliabilityPhysical examinationObservational studySurgery

摘要: Background Rigorously developed and validated direct observational assessment tools are required to support competency-based colonoscopy training facilitate skill acquisition, optimize learning, ensure readiness for unsupervised practice. Objective To examine reliability validity evidence of the Gastrointestinal Endoscopy Competency Assessment Tool (GiECAT) use within clinical setting. Design Prospective, observational, multicenter validation study. Sixty-one endoscopists performing 116 colonoscopies were assessed using GiECAT, which consists a 7-item global rating scale (GRS) 19-item checklist (CL). A second rater procedures determine interrater by intraclass correlation coefficients (ICCs). Endoscopists' first procedure scores compared test-retest ICCs. Discriminative was examined comparing novice, intermediate, experienced endoscopists' scores. Concurrent measured correlating with experience, cecal terminal ileal intubation rates, physician assessment. Setting total performed 33 novice ( 1000 previous procedures) from 6 Canadian hospitals. Main Outcome Measurements Interrater reliability, discriminative, concurrent validity. Results high (total: ICC = 0.85; GRS: CL: 0.81). Test-retest excellent 0.91; 0.93; 0.80). Significant differences in GiECAT among novice, noted P Limitations Nonblinded assessments. Conclusion This study provides supporting assessing performance live

参考文章(33)
Leslie Gross Portney, Mary P. Watkins, Foundations of Clinical Research: Applications to Practice ,(2015)
J Eric Jelovsek, Nathan Kow, Gouri B Diwadkar, Tools for the direct observation and assessment of psychomotor skills in medical trainees: a systematic review Medical Education. ,vol. 47, pp. 650- 673 ,(2013) , 10.1111/MEDU.12220
Joseph P. Weir, Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. Journal of Strength and Conditioning Research. ,vol. 19, pp. 231- 240 ,(2005) , 10.1519/15184.1
P. D. van Hove, G. J. M. Tuijthof, E. G. G. Verdaasdonk, L. P. S. Stassen, J. Dankelman, Objective assessment of technical surgical skills British Journal of Surgery. ,vol. 97, pp. 972- 987 ,(2010) , 10.1002/BJS.7115
G E Miller, The assessment of clinical skills/competence/performance Academic Medicine. ,vol. 65, pp. S63- 7 ,(1990) , 10.1097/00001888-199009000-00045
Stephen N. Haynes, David C. S. Richard, Edward S. Kubany, Content validity in psychological assessment: A functional approach to concepts and methods. Psychological Assessment. ,vol. 7, pp. 238- 247 ,(1995) , 10.1037/1040-3590.7.3.238
Kevin W Eva, Brian D Hodges, Scylla or Charybdis? Can we navigate between objectification and judgement in assessment? Medical Education. ,vol. 46, pp. 914- 919 ,(2012) , 10.1111/J.1365-2923.2012.04310.X
Susan R. Swing, Stephen G. Clyman, Eric S. Holmboe, Reed G. Williams, Advancing Resident Assessment in Graduate Medical Education Journal of Graduate Medical Education. ,vol. 1, pp. 278- 286 ,(2009) , 10.4300/JGME-D-09-00010.1
David A. Cook, Benjamin Zendejas, Stanley J. Hamstra, Rose Hatala, Ryan Brydges, What counts as validity evidence? Examples and prevalence in a systematic review of simulation-based assessment Advances in Health Sciences Education. ,vol. 19, pp. 233- 250 ,(2014) , 10.1007/S10459-013-9458-4
Catharine M. Walsh, Simon C. Ling, Nitin Khanna, Mary Anne Cooper, Samir C. Grover, Gary May, Thomas D. Walters, Linda Rabeneck, Richard Reznick, Heather Carnahan, Gastrointestinal Endoscopy Competency Assessment Tool: development of a procedure-specific assessment tool for colonoscopy Gastrointestinal Endoscopy. ,vol. 79, pp. 798- 807.e5 ,(2014) , 10.1016/J.GIE.2013.10.035