Generalized additive Bayesian network classifiers

作者: Changshui Zhang , Yimin Zhang , Jianguo Li , Tao Wang

DOI:

关键词:

摘要: Bayesian network classifiers (BNC) have received considerable attention in machine learning field. Some special structure BNCs been proposed and demonstrate promise performance. However, recent researches show that BNs may lead to a non-negligible posterior problem, i.e, there might be many structures similar scores. In this paper, we propose generalized additive classifiers, which transfers the problem models (GAM) problem. We first generate series of very simple BNs, put them framework GAM, then adopt gradient-based algorithm learn combining parameters, thus construct more powerful classifier. On large suite benchmark data sets, approach outperforms traditional BNCs, such as naive Bayes, TAN, etc, achieves comparable or better performance comparison boosted classifiers.

参考文章(28)
Michael J. Pazzani, Eamonn J. Keogh, Learning augmented Bayesian classifiers: A comparison of distribution-based and classification-based approaches. international conference on artificial intelligence and statistics. ,(1999)
Mehran Sahami, Learning limited dependence Bayesian classifiers knowledge discovery and data mining. pp. 335- 338 ,(1996)
Bojan Cestnik, Estimating probabilities: a crucial task in machine learning european conference on artificial intelligence. pp. 147- 149 ,(1990)
Christopher M. Bishop, Neural networks for pattern recognition ,(1995)
Richard A Olshen, Charles J Stone, Leo Breiman, Jerome H Friedman, Classification and regression trees ,(1983)
Kevin Thompson, Pat Langley, and Wayne Iba, An analysis of Bayesian classifiers national conference on artificial intelligence. pp. 223- 228 ,(1992)
Jerome H. Friedman, Greedy function approximation: A gradient boosting machine. Annals of Statistics. ,vol. 29, pp. 1189- 1232 ,(2001) , 10.1214/AOS/1013203451
James Dougherty, Ron Kohavi, Mehran Sahami, Supervised and Unsupervised Discretization of Continuous Features Machine Learning Proceedings 1995. pp. 194- 202 ,(1995) , 10.1016/B978-1-55860-377-6.50032-3
David Maxwell Chickering, David Heckerman, Bo Thiesson, Christopher Meek, Learning mixtures of DAG models uncertainty in artificial intelligence. pp. 504- 513 ,(1998)
Nir Friedman, Dan Geiger, Moises Goldszmidt, Bayesian Network Classifiers Machine Learning. ,vol. 29, pp. 131- 163 ,(1997) , 10.1023/A:1007465528199