A Comparison of Visual Rating Scales and Simulated Virtual Reality Metrics in Neurosurgical Training: A Generalizability Theory Study.

作者: Alexander Winkler-Schwartz , Ibrahim Marwa , Khalid Bajunaid , Muhammad Mullah , Fahad E. Alotaibi

DOI: 10.1016/J.WNEU.2019.03.059

关键词: Scale (ratio)Generalizability theoryMedicineRating scaleCritical appraisalPatient safetyPhysical medicine and rehabilitationPsychomotor learningReliability (statistics)Virtual reality

摘要: Background Adequate assessment and feedback remains a cornerstone of psychomotor skills acquisition, particularly within neurosurgery where the consequence adverse operative events is significant. However, critical appraisal reliability visual rating scales in lacking. Therefore, we sought to design study compare with simulated metrics neurosurgical virtual reality task. Methods Neurosurgical faculty rated anonymized participant video recordings removal brain tumors using scale made up seven composite elements. Scale was evaluated generalizability theory, subcomponents were compared Pearson correlation analysis. Results Four staff neurosurgeons 16 medical student applicants. Overall internal consistency 0.73 0.90, respectively. Reliability 0.71 achieved two raters. Individual participants, raters, items accounted for 27%, 11%, 0.6% data variability. The hemostasis component related greatest number metrics, whereas respect no-go zones tissue correlated none. Metrics relating instrument force patient safety (brain volume removed blood loss) captured by fewest components. Conclusions To our knowledge, this first comparing participant's ratings performance. Given capture less well force, quantity removed, loss, suggest adopting hybrid educational approach an environment, supplemented sessions uncover potentially problematic surgical technique.

参考文章(19)
Moshe Feldman, Elizabeth H. Lazzara, Allison A. Vanderbilt, Deborah DiazGranados, Rater Training to Support High-Stakes Simulation-Based Assessments Journal of Continuing Education in The Health Professions. ,vol. 32, pp. 279- 286 ,(2012) , 10.1002/CHP.21156
Hamed Azarnoush, Gmaan Alzhrani, Alexander Winkler-Schwartz, Fahad Alotaibi, Nicholas Gelinas-Phaneuf, Valérie Pazos, Nusrat Choudhury, Jawad Fares, Robert DiRaddo, Rolando F. Del Maestro, Neurosurgical virtual reality simulation metrics to assess psychomotor skills during brain tumor resection computer assisted radiology and surgery. ,vol. 10, pp. 603- 618 ,(2015) , 10.1007/S11548-014-1091-Z
Rajesh Aggarwal, Teodor Grantcharov, Krishna Moorthy, Thor Milland, Ara Darzi, Toward feasible, valid, and reliable video-based assessments of technical surgical skills in the operating room. Annals of Surgery. ,vol. 247, pp. 372- 379 ,(2008) , 10.1097/SLA.0B013E318160B371
Fahad E Alotaibi, Gmaan A AlZhrani, Muhammad AS Mullah, Abdulrahman J Sabbagh, Hamed Azarnoush, Alexander Winkler-Schwartz, Rolando F Del Maestro, Assessing Bimanual Performance in Brain Tumor Resection With NeuroTouch, a Virtual Reality Simulator Neurosurgery. ,vol. 11, pp. 89- 98 ,(2015) , 10.1227/NEU.0000000000000631
Gmaan AlZhrani, Fahad Alotaibi, Hamed Azarnoush, Alexander Winkler-Schwartz, Abdulrahman Sabbagh, Khalid Bajunaid, Susanne P. Lajoie, Rolando F. Del Maestro, Proficiency Performance Benchmarks for Removal of Simulated Brain Tumors Using a Virtual Reality Simulator NeuroTouch Journal of Surgical Education. ,vol. 72, pp. 685- 696 ,(2015) , 10.1016/J.JSURG.2014.12.014
Nicholas Gélinas-Phaneuf, Nusrat Choudhury, Ahmed R. Al-Habib, Anne Cabral, Etienne Nadeau, Vincent Mora, Valerie Pazos, Patricia Debergue, Robert DiRaddo, Rolando F. Del Maestro, Assessing performance in brain tumor resection using a novel virtual reality simulator International Journal of Computer Assisted Radiology and Surgery. ,vol. 9, pp. 1- 9 ,(2014) , 10.1007/S11548-013-0905-8
Caroline Hadley, Sandi K. Lam, Valentina Briceño, Thomas G. Luerssen, Andrew Jea, Use of a formal assessment instrument for evaluation of resident operative skills in pediatric neurosurgery. Journal of Neurosurgery. ,vol. 16, pp. 497- 504 ,(2015) , 10.3171/2015.1.PEDS14511
Christopher A. Sarkiss, Steven Philemond, James Lee, Stanislaw Sobotka, Terrell D. Holloway, Maximillian M. Moore, Anthony B. Costa, Errol L. Gordon, Joshua B. Bederson, Neurosurgical Skills Assessment: Measuring Technical Proficiency in Neurosurgery Residents Through Intraoperative Video Evaluations World Neurosurgery. ,vol. 89, pp. 1- 8 ,(2016) , 10.1016/J.WNEU.2015.12.052