Classifying under computational resource constraints: anytime classification using probabilistic estimators

作者: Ying Yang , Geoff Webb , Kevin Korb , Kai Ming Ting

DOI: 10.1007/S10994-007-5020-Z

关键词:

摘要: In many online applications of machine learning, the computational resources available for classification will vary from time to time. Most techniques are designed operate within constraints minimum expected and fail utilize further when they available. We propose a novel anytime algorithm, averaged probabilistic estimators (AAPE), which is capable delivering strong prediction accuracy with little CPU utilizing additional increase accuracy. The idea run an ordered sequence very efficient Bayesian (single improvement steps) until runs out. Theoretical studies empirical validations reveal that by properly identifying, ordering, invoking ensembling single steps, AAPE able accomplish accurate whenever it interrupted. It also output class probability estimates beyond simple 0/1-loss classifications, as well adeptly handle incremental learning.

参考文章(36)
Eric J. Horvitz, Reasoning under varying and uncertain resource constraints national conference on artificial intelligence. pp. 111- 116 ,(1988)
Joe Suzuki, Learning Bayesian Belief Networks Based on the MDL Principle : An Efficient Algorithm Using the Branch and Bound Technique IEICE Transactions on Information and Systems. ,vol. 82, pp. 356- 367 ,(1999)
Mehran Sahami, Learning limited dependence Bayesian classifiers knowledge discovery and data mining. pp. 335- 338 ,(1996)
John J Grefenstette, Connie Loggia Ramsey, An Approach to Anytime Learning international conference on machine learning. pp. 189- 195 ,(1992) , 10.1016/B978-1-55860-247-2.50029-2
Eun Bae Kong, Thomas G. Dietterich, Error-Correcting Output Coding Corrects Bias and Variance Machine Learning Proceedings 1995. pp. 313- 321 ,(1995) , 10.1016/B978-1-55860-377-6.50046-3
Ron Kohavi, David Wolpert, Bias plus variance decomposition for zero-one loss functions international conference on machine learning. pp. 275- 283 ,(1996)
A. Arnt, S. Zilberstein, Attribute measurement policies for time and cost sensitive classification international conference on data mining. pp. 323- 326 ,(2004) , 10.1109/ICDM.2004.10051
Janez Demšar, Statistical Comparisons of Classifiers over Multiple Data Sets Journal of Machine Learning Research. ,vol. 7, pp. 1- 30 ,(2006)
Mark A. Hall, Ian H. Witten, Eibe Frank, Data Mining: Practical Machine Learning Tools and Techniques ,(1999)