Challenges and applications of large language models

作者: Jean Kaddour , Joshua Harris , Maximilian Mozes , Herbie Bradley , Roberta Raileanu

DOI:

关键词:

摘要: Large Language Models (LLMs) went from non-existent to ubiquitous in the machine learning discourse within a few years. Due to the fast pace of the field, it is difficult to identify the remaining challenges and already fruitful application areas. In this paper, we aim to establish a systematic set of open problems and application successes so that ML researchers can comprehend the field's current state more quickly and become productive.

参考文章(4)
Zhibin Gou, Zhihong Shao, Yeyun Gong, Yelong Shen, Yujiu Yang, Nan Duan, Weizhu Chen, Critic: Large language models can self-correct with tool-interactive critiquing
Partha Pratim Ray, ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope Internet of Things and Cyber-Physical Systems. ,vol. 3, pp. 121- 154 ,(2023)
Sadhika Malladi, Tianyu Gao, Eshaan Nichani, Alex Damian, Jason D Lee, Danqi Chen, Sanjeev Arora, Fine-Tuning Language Models with Just Forward Passes NeurIPS 2023. ,(2023)
Edouard Grave, Armand Joulin, Angela Fan, Reducing Transformer Depth on Demand with Structured Dropout arXiv: Learning. ,(2019)