Development and validation of the Skills Assessment in Microsurgery for Brain Aneurysms (SAMBA) instrument for predicting proficiency in aneurysm surgery.

作者: Marcelo Magaldi Ribeiro de Oliveira , Taise Mosso Ramos , Carlos Eduardo Ferrarez , Carla Jorge Machado , Pollyana Helena Vieira Costa

DOI: 10.3171/2018.7.JNS173007

关键词:

摘要: OBJECTIVE Surgical performance evaluation was first described with the OSATS (Objective Structured Assessment of Technical Skills) and modified for aneurysm microsurgery simulation OSAACS Aneurysm Clipping Skills). These methods rely on subjective opinions evaluators, however, there is a lack objective proficiency in microsurgical treatment brain aneurysms. The authors present new instrument, Skill Microsurgery Brain Aneurysms (SAMBA) scale, which can be used similarly model unruptured middle cerebral artery (MCA) aneurysms to predict surgical performance; also report its validation. METHODS SAMBA scale created by consensus among 5 vascular neurosurgeons from 2 different neurosurgical departments. results were analyzed using descriptive statistics, Cronbach's alpha indexes, multivariate ANOVA analyses (p < 0.05). RESULTS Expert, intermediate-level, novice surgeons scored, respectively, an average 33.9, 27.1, 16.4 points real surgery 33.3, 27.3, 19.4 simulation. interrater reliability index 0.995 0.996 simulated surgery; intrarater 0.983 (Cronbach's alpha). In both settings, scores achieved members each group (expert, intermediate level, novice) significantly 0.001). Scores more diverse (coefficient variation = 12.4). CONCLUSIONS Predictive validation placenta has been previously reported, but adds scoring system verify ability this complex operation, stratifying points. as interface between learning practicing, it applied safe controlled environment, such provided model, similar obtained surgery, predicting performance.

参考文章(18)
Marcelo Magaldi Ribeiro de Oliveira, Arthur Nicolato, Marcilea Santos, Joao Victor Godinho, Rafael Brito, Alexandre Alvarenga, Ana Luiza Valle Martins, André Prosdocimi, Felipe Padovani Trivelato, Abdulrahman J. Sabbagh, Augusto Barbosa Reis, Rolando Del Maestro, Face, content, and construct validity of human placenta as a haptic training tool in neurointerventional surgery Journal of Neurosurgery. ,vol. 124, pp. 1238- 1244 ,(2016) , 10.3171/2015.1.JNS141583
Leann Terry, Ken Kelley, Sample size planning for composite reliability coefficients: Accuracy in parameter estimation via narrow confidence intervals British Journal of Mathematical and Statistical Psychology. ,vol. 65, pp. 371- 401 ,(2012) , 10.1111/J.2044-8317.2011.02030.X
Salah G. Aoun, Tarek Y. El Ahmadieh, Najib E. El Tecle, Marc R. Daou, Joseph G. Adel, Christine S. Park, H. Hunt Batjer, Bernard R. Bendok, A pilot study to assess the construct and face validity of the Northwestern Objective Microanastomosis Assessment Tool Journal of Neurosurgery. ,vol. 123, pp. 103- 109 ,(2015) , 10.3171/2014.12.JNS131814
Jaime Gasco, Thomas J. Holbrook, Achal Patel, Adrian Smith, David Paulson, Alan Muns, Sohum Desai, Marc Moisi, Yong-Fan Kuo, Bart Macdonald, Juan Ortega-Barnett, Joel T. Patterson, Neurosurgery Simulation in Residency Training: Feasibility, Cost, and Educational Benefit Neurosurgery. ,vol. 73, pp. 39- 45 ,(2013) , 10.1227/NEU.0000000000000102
Jonathan S Ilgen, Irene W Y Ma, Rose Hatala, David A Cook, A systematic review of validity evidence for checklists versus global rating scales in simulation‐based assessment Medical Education. ,vol. 49, pp. 161- 173 ,(2015) , 10.1111/MEDU.12621
Mary L. McHugh, Multiple comparison analysis testing in ANOVA Biochemia Medica. ,vol. 21, pp. 203- 209 ,(2011) , 10.11613/BM.2011.029
X. Fan, B. Thompson, Confidence intervals about score reliability coefficients, please: An EPM guidelines editorial. Educational and Psychological Measurement. ,vol. 61, pp. 517- 531 ,(2001) , 10.1177/00131640121971365
J. A. Martin, G. Regehr, R. Reznick, H. Macrae, J. Murnaghan, C. Hutchison, M. Brown, Objective structured assessment of technical skill (OSATS) for surgical residents. British Journal of Surgery. ,vol. 84, pp. 273- 278 ,(1997) , 10.1046/J.1365-2168.1997.02502.X
Mads Emil Jacobsen, Morten Jon Andersen, Claus Ol Hansen, Lars Konge, Testing basic competency in knee arthroscopy using a virtual reality simulator: exploring validity and reliability. Journal of Bone and Joint Surgery, American Volume. ,vol. 97, pp. 775- 781 ,(2015) , 10.2106/JBJS.N.00747