TunedIT.org: System for Automated Evaluation of Algorithms in Repeatable Experiments

作者: Marcin Wojnarski , Sebastian Stawicki , Piotr Wojnarowski

DOI: 10.1007/978-3-642-13529-3_4

关键词:

摘要: In this paper we present TUNEDIT system which facilitates evaluation and comparison of machine-learning algorithms. is composed three complementary interconnected components: TunedTester, Repository Knowledge Base. TunedTester a stand-alone Java application that runs automated tests (experiments) database algorithms, datasets procedures used by TunedTester for setting up test. Base test results. are accessible through website. open free use any researcher. Every registered user can upload new resources to Repository, run experiments with send results browse all collected results, generated either himself or others. As special functionality, built upon the framework tests, provides platform organization on-line interactive competitions problems. This functionality may be used, instance, teachers launch contests their students instead traditional assignment tasks; organizers data-mining conferences scientific community, in association conference.

参考文章(7)
R. M. Neal, Assessing Relevance determination methods using DELVE NATO advanced study institute on generalization in neural networks and machine learning. pp. 97- 129 ,(1998)
Marcin Wojnarski, Debellor: A Data Mining Platform with Stream Architecture Transactions on Rough Sets IX. ,vol. 9, pp. 405- 427 ,(2008) , 10.1007/978-3-540-89876-4_22
C. L. Blake, UCI Repository of machine learning databases www.ics.uci.edu/〜mlearn/MLRepository.html. ,(1998)
Gunnar Rätsch, Bernhard Schölkopf, Leon Bottou, Alexander Smola, Sören Sonnenburg, Klaus-Robert Müller, Samy Bengio, Yann LeCun, Jason Weston, Robert Williamson, Carl Edward Rasmussen, Geoffrey Holmes, Mikio L. Braun, Fernando Pereira, Pascal Vincent, Cheng Soon Ong, The Need for Open Source Software in Machine Learning Journal of Machine Learning Research. ,vol. 8, pp. 2443- 2466 ,(2007) , 10.5555/1314498.1314577
Jacek M. Zurada, Janusz Wojtusiak, Fahmida Chowdhury, James E. Gentle, Cedric J. Jeannot, Maciej A. Mazurowski, Computational intelligence virtual community: Framework and implementation issues international joint conference on neural network. pp. 3153- 3157 ,(2008) , 10.1109/IJCNN.2008.4634244
Hendrik Blockeel, Joaquin Vanschoren, Experiment Databases: Towards an Improved Experimental Methodology in Machine Learning european conference on principles of data mining and knowledge discovery. ,vol. 4702, pp. 6- 17 ,(2007) , 10.1007/978-3-540-74976-9_5
R Tibshirani, GE Hinton, Z Ghahramani, M Revow, R Kustra, RM Neal, CE Rasmussen, D Van Camp, The delve manual University of Toronto: Department of Computer Science. ,(1996)