Optimal policy determination in sequential systemic and locoregional therapy of oropharyngeal squamous carcinomas: A patient-physician digital twin dyad with deep Q-learning for treatment selection.

作者: Elisa Tardini , Xinhua Zhang , Canahuate G , Andrew Wentzel , Abdallah SR Mohamed

DOI: 10.1101/2021.04.07.21255092

关键词: Matching (statistics)DysphagiaCancerOncologySurvival rateInternal medicineHead and neck cancerMedicineText miningPrimary tumorCohort

摘要: Abstract Purpose Currently, selection of patients for sequential vs. concurrent chemotherapy/radiation regimens lacks evidentiary support, and it is based on locally-optimal decisions each step. We aim to optimize the multi-step treatment head neck cancer predict multiple patient survival toxicity outcomes, we develop, apply, evaluate a first application deep-Q-learning (DQL) simulation this problem. Patients methods The decision DQL digital twin patient’s were created, trained evaluated dataset 536 oropharyngeal squamous cell carcinoma (OPC) with goal of, respectively, determining optimal respect metrics, predicting outcomes patient. models subset 402 (split randomly) separate set 134 patients. Training evaluation dyad was completed in August 2020. includes 3-step complete relevant history cohort treated at MD Anderson Cancer Center between 2005 2013, radiomics analysis performed segmented primary tumor volumes. Results On validation set, 87.09% mean 90.85% median accuracy outcome prediction, matching clinicians’ improving (predicted) rate by +3.73% (95% CI: [-0.75%, +8.96%]), dysphagia +0.75% (CI: [-4.48%, +6.72%]) when following decisions. Conclusion Given prediction predicted improvement medically yielded approach, patient-physician dynamic problem has potential aiding physicians course assessing its outcomes.

参考文章(30)
Erica E. M. Moodie, Bibhas Chakraborty, Michael S. Kramer, Q-learning for estimating optimal dynamic treatment rules from observational data. Canadian Journal of Statistics-revue Canadienne De Statistique. ,vol. 40, pp. 629- 645 ,(2012) , 10.1002/CJS.11162
Bruce E. Brockstein, Mark B. Agulnik, Bharat B. Mittal, Furhan Yunus, Sandeep Samant, Luis E. Raez, Ranee Mehra, Priya Kumar, Frank Ondrey, Patrice Marchand, Bettina Braegas, Tanguy Y. Seiwert, Victoria M. Villaflor, Daniel J. Haraf, Everett E. Vokes, Ezra E.W. Cohen, Theodore G. Karrison, Masha Kocherginsky, Jeffrey Mueller, Robyn Egan, Chao H. Huang, Phase III Randomized Trial of Induction Chemotherapy in Patients With N2 or N3 Locally Advanced Head and Neck Cancer Journal of Clinical Oncology. ,vol. 32, pp. 2735- 2743 ,(2014) , 10.1200/JCO.2013.54.6309
David J. Adelstein, John A. Ridge, Maura L. Gillison, Anil K. Chaturvedi, Gypsyamber D'Souza, Patti E. Gravitt, William Westra, Amanda Psyrri, W. Martin Kast, Laura A. Koutsky, Anna Giuliano, Steven Krosnick, Andy Trotti, David E. Schuller, Arlene Forastiere, Claudio Dansky Ullmann, Head and neck squamous cell cancer and the human papillomavirus: summary of a National Cancer Institute State of the Science Meeting, November 9-10, 2008, Washington, D.C. Head and Neck-journal for The Sciences and Specialties of The Head and Neck. ,vol. 31, pp. 1393- 1422 ,(2009) , 10.1002/HED.21269
Inbal Nahum-Shani, Min Qian, Daniel Almirall, William E. Pelham, Beth Gnagy, Gregory A. Fabiano, James G. Waxmonsky, Jihnhee Yu, Susan A. Murphy, Q-learning: A data analysis method for constructing adaptive interventions. Psychological Methods. ,vol. 17, pp. 478- 494 ,(2012) , 10.1037/A0029373
Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A Rusu, Joel Veness, Marc G Bellemare, Alex Graves, Martin Riedmiller, Andreas K Fidjeland, Georg Ostrovski, Stig Petersen, Charles Beattie, Amir Sadik, Ioannis Antonoglou, Helen King, Dharshan Kumaran, Daan Wierstra, Shane Legg, Demis Hassabis, None, Human-level control through deep reinforcement learning Nature. ,vol. 518, pp. 529- 533 ,(2015) , 10.1038/NATURE14236
Robert Haddad, Anne O'Neill, Guilherme Rabinowits, Roy Tishler, Fadlo Khuri, Douglas Adkins, Joseph Clark, Nicholas Sarlis, Jochen Lorch, Jonathan J Beitler, Sewanti Limaye, Sarah Riley, Marshall Posner, Induction chemotherapy followed by concurrent chemoradiotherapy (sequential chemoradiotherapy) versus concurrent chemoradiotherapy alone in locally advanced head and neck cancer (PARADIGM): a randomised phase 3 trial. Lancet Oncology. ,vol. 14, pp. 257- 264 ,(2013) , 10.1016/S1470-2045(13)70011-1
Laura A. Koutsky, W. Martin Kast, Patti E. Gravitt, Andy Trotti, David J. Adelstein, John A. Ridge, William Westra, Steven Krosnick, David E. Schuller, Anna Giuliano, Anil K. Chaturvedi, Arlene Forastiere, H. Lee, Maura L. Gillison, Amanda Psyrri, Claudio Dansky Ullmann, HEAD AND NECK SQUAMOUS CELL CANCER AND THE HUMAN PAPILLOMAVIRUS: SUMMARY OF A NATIONAL CANCER INSTITUTE STATE OF THE SCIENCE MEETING, ,(2009)
Chintan Parmar, Patrick Grossmann, Derek Rietveld, Michelle M. Rietbergen, Philippe Lambin, Hugo J. W. L. Aerts, Radiomic Machine-Learning Classifiers for Prognostic Biomarkers of Head and Neck Cancer Frontiers in Oncology. ,vol. 5, pp. 272- 272 ,(2015) , 10.3389/FONC.2015.00272
Chintan Parmar, Ralph TH Leijenaar, Patrick Grossmann, Emmanuel Rios Velazquez, Johan Bussink, Derek Rietveld, Michelle M Rietbergen, Benjamin Haibe-Kains, Philippe Lambin, Hugo JWL Aerts, Radiomic feature clusters and Prognostic Signatures specific for Lung and Head & Neck cancer Scientific Reports. ,vol. 5, pp. 11044- 11044 ,(2015) , 10.1038/SREP11044
Andrew J Wong, Aasheesh Kanwar, Abdallah S Mohamed, Clifton D Fuller, None, Radiomics in head and neck cancer: from exploration to application Translational cancer research. ,vol. 5, pp. 371- 382 ,(2016) , 10.21037/TCR.2016.07.18