Finite mixture model of bounded semi-naive Bayesian networks classifier

作者: Kaizhu Huang , Irwin King , Michael R. Lyu

DOI: 10.1007/3-540-44989-2_15

关键词: Machine learningNaive Bayes classifierBounded functionStatistical modelMixture modelBayesian networkComputer scienceAlgorithmCombinatorial optimizationArtificial intelligenceConditional independenceClassifier (UML)Time complexity

摘要: The Semi-Naive Bayesian network (SNB) classifier, a probabilistic model with an assumption of conditional independence among the combined attributes, shows good performance in classification tasks. However, traditional SNBs can only combine two attributes into attribute. This inflexibility together its strong independency may generate inaccurate distributions for some datasets and thus greatly restrict SNBs. In this paper we develop Bounded (B-SNB) based on direct combinatorial optimization. Our join any number within given bound maintains polynomial time cost at same time. improvement expands expressive ability SNB provide potentials to increase accuracy Further, aiming relax SNB, then propose algorithm extend B-SNB finite mixture structure, named Mixture (MBSNB). We give theoretical derivations, outline algorithm, analysis set experiments demonstrate usefulness MBSNB novel better comparison than other types classifiers paper.

参考文章(29)
Tim Niblett, Constructing Decision Trees in Noisy Domains. EWSL. pp. 67- 78 ,(1987)
Nathan Srebro, Maximum Likelihood Bounded Tree-Width Markov Networks uncertainty in artificial intelligence. pp. 504- 511 ,(2001)
H. J. Lenz, Doug Fisher, Learning from Data: Artificial Intelligence and Statistics V Springer-Verlag New York, Inc.. ,(1996)
Michael J. Pazzani, Searching for Dependencies in Bayesian Classifiers Learning from Data. pp. 239- 248 ,(1996) , 10.1007/978-1-4612-2404-4_23
David Maxwell Chickering, Learning Bayesian Networks is NP-Complete Learning from Data. pp. 121- 130 ,(1996) , 10.1007/978-1-4612-2404-4_12
Kaizhu Huang, I. King, M.R. Lyu, Learning maximum likelihood semi-naive Bayesian network classifier systems, man and cybernetics. ,vol. 3, pp. 6- ,(2002) , 10.1109/ICSMC.2002.1176058
Andreas Stolcke, Stephen Omohundro, Inducing Probabilistic Grammars by Bayesian Model Merging international colloquium on grammatical inference. pp. 106- 118 ,(1994) , 10.1007/3-540-58473-0_141
Ron Kohavi, Dan Sommerfield, Barry G. Becker, Improving simple Bayes ECML. ,(1997)
Igor Kononenko, Semi-naive bayesian classifier Lecture Notes in Computer Science. pp. 206- 219 ,(1991) , 10.1007/BFB0017015
Gal Elidan, Nir Friedman, Learning the dimensionality of hidden variables uncertainty in artificial intelligence. pp. 144- 151 ,(2001)