Towards enhanced hierarchical attention networks in ICD-9 tagging of clinical notes

作者: Mary Jane C. Samonte , Bobby D. Gerardo , Ruji P. Medina

DOI: 10.1145/3162957.3163030

关键词:

摘要: Text is an important element in document classification many natural language applications. Natural processing (NLP) today's computational advancement that provides significant modern uses of text documents such as efficient information retrieval. In this paper, we describe the theoretical framework predicting ICD-9 codes through tagging clinical notes using our improved deep learning called EnHANs. This proposed model improvement covers combination word and topic embedding, well adding character-level representation a hierarchical attention neural networks. paper also present use sigmoid activation function last layer enhanced network order to arrive with multi-label, multi-class prediction codes.

参考文章(30)
Phil Blunsom, Stephen Pulman, Karl Moritz Hermann, Lei Yu, Deep learning for answer sentence selection arXiv: Computation and Language. ,(2014)
Yoon Kim, Convolutional Neural Networks for Sentence Classification empirical methods in natural language processing. pp. 1746- 1751 ,(2014) , 10.3115/V1/D14-1181
Thang Luong, Hieu Pham, Christopher D. Manning, Effective Approaches to Attention-based Neural Machine Translation empirical methods in natural language processing. pp. 1412- 1421 ,(2015) , 10.18653/V1/D15-1166
Çaglar Gülçehre, Yoshua Bengio, Yoshua Bengio, Yoshua Bengio, KyungHyun Cho, Junyoung Chung, Empirical evaluation of gated recurrent neural networks on sequence modeling arXiv: Neural and Evolutionary Computing. ,(2014)
Yan Huang, Wei Wang, Liang Wang, Tieniu Tan, None, Multi-task deep neural network for multi-label learning 2013 IEEE International Conference on Image Processing. pp. 2897- 2900 ,(2013) , 10.1109/ICIP.2013.6738596
Adler Perotte, Rimma Pivovarov, Karthik Natarajan, Nicole Weiskopf, Frank Wood, Noémie Elhadad, None, Diagnosis code assignment: models and evaluation metrics Journal of the American Medical Informatics Association. ,vol. 21, pp. 231- 237 ,(2014) , 10.1136/AMIAJNL-2013-002159
Min-Ling Zhang, Zhi-Hua Zhou, A Review On Multi-Label Learning Algorithms IEEE Transactions on Knowledge and Data Engineering. ,vol. 26, pp. 1819- 1837 ,(2014) , 10.1109/TKDE.2013.39
Maryam M Najafabadi, Flavio Villanustre, Taghi M Khoshgoftaar, Naeem Seliya, Randall Wald, Edin Muharemagic, Deep learning applications and challenges in big data analytics Journal of Big Data. ,vol. 2, pp. 1- 21 ,(2015) , 10.1186/S40537-014-0007-7
Nal Kalchbrenner, Edward Grefenstette, Phil Blunsom, A Convolutional Neural Network for Modelling Sentences Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). pp. 655- 665 ,(2014) , 10.3115/V1/P14-1062
Yitao Zhang, A Hierarchical Approach to Encoding Medical Concepts for Clinical Notes meeting of the association for computational linguistics. pp. 67- 72 ,(2008) , 10.3115/1564154.1564168