The role of evaluation in AI and law: an examination of its different forms in the AI and law journal

作者: Jack G. Conrad , John Zeleznikow

DOI: 10.1145/2746090.2746116

关键词:

摘要: This paper explores the presence and forms of evaluation in articles published journal Artificial Intelligence Law for ten-year period from 2005 through 2014. It represents a meta-level study some most significant works produced by AI community, this case nearly 140 research journal. also compares its findings to previous work conducted on appearing Proceedings International Conference (ICAIL). In addition, highlights harnessing performance as one their chief scientific tools means which they use it. extends argument why is essential formal reports such those As two earlier topic, it pursues answers questions: how good system, algorithm or proposal?, reliable approach technique?, and, ultimately, does method work? The investigates role reports, underscoring that performance-based 'ethic' signifies level maturity rigor within community. examines recent publications address same critical issue broader field Intelligence.

参考文章(22)
Henry Prakken, Modelling reasoning about evidence in legal procedure international conference on artificial intelligence and law. pp. 119- 128 ,(2001) , 10.1145/383535.383550
Anil S. Jadhav, Rajendra M. Sonar, Framework for evaluation and selection of the software packages: A hybrid knowledge based system approach Journal of Systems and Software. ,vol. 84, pp. 1394- 1407 ,(2011) , 10.1016/J.JSS.2011.03.034
Qiang Lu, Jack G. Conrad, Khalid Al-Kofahi, William Keenan, Legal document clustering with built-in topic segmentation Proceedings of the 20th ACM international conference on Information and knowledge management - CIKM '11. pp. 383- 392 ,(2011) , 10.1145/2063576.2063636
Martin Caminada, Leila Amgoud, On the evaluation of argumentation formalisms Artificial Intelligence. ,vol. 171, pp. 286- 310 ,(2007) , 10.1016/J.ARTINT.2007.02.003
Maria Jean J. Hall, Richard Hall, John Zeleznikow, A process for evaluating legal knowledge-based systems based upon the context criteria contingency-guidelines framework international conference on artificial intelligence and law. pp. 274- 283 ,(2003) , 10.1145/1047788.1047843
Tommaso Fornaciari, Massimo Poesio, Automatic deception detection in Italian court cases Artificial Intelligence and Law. ,vol. 21, pp. 303- 340 ,(2013) , 10.1007/S10506-013-9140-4
Kevin D. Ashley, Stefanie Brüninghaus, Automatically classifying case texts and predicting outcomes Artificial Intelligence and Law. ,vol. 17, pp. 125- 165 ,(2009) , 10.1007/S10506-009-9077-9
R. E. Susskind, Expert systems in law: out of the research laboratory and into the marketplace international conference on artificial intelligence and law. pp. 1- 8 ,(1987) , 10.1145/41735.41736
Sindhu Joseph, Henry Prakken, Coherence-driven argumentation to norm consensus Proceedings of the 12th International Conference on Artificial Intelligence and Law - ICAIL '09. pp. 58- 67 ,(2009) , 10.1145/1568234.1568242
F. J. Bex, H. Prakken, B. Verheij, Formalising argumentative story-based analysis of evidence international conference on artificial intelligence and law. pp. 1- 10 ,(2007) , 10.1145/1276318.1276320