A statistical approach to decision tree modeling

作者: Michael I. Jordan

DOI: 10.1145/180139.175372

关键词: Artificial intelligenceIncremental decision treeMathematicsMachine learningLogistic model treeDecision treeTree (data structure)Decision tree learningData miningDecision tree modelOrder statistic treeID3 algorithm

摘要: A statistical approach to decision tree modeling is described. In this approach, each in the modeled parametrically as process by which an output generated from input and a sequence of decisions. The resulting model yields likelihood measure goodness fit, allowing ML MAP estimation techniques be utilized. An efficient algorithm presented estimate parameters tree. selection problem several alternative proposals are considered. hidden Markov version described for data sequences that have temporal dependencies.

参考文章(15)
Peter McCullagh, John Ashworth Nelder, Generalized Linear Models ,(1983)
Richard A Olshen, Charles J Stone, Leo Breiman, Jerome H Friedman, Classification and regression trees ,(1983)
J. Ross Quinlan, Ronald L. Rivest, Inferring decision trees using the minimum description length principle Information & Computation. ,vol. 80, pp. 227- 248 ,(1989) , 10.1016/0890-5401(89)90010-2
Michael I Jordan, Lei Xu, None, Convergence results for the EM approach to mixtures of experts architectures Neural Networks. ,vol. 8, pp. 1409- 1431 ,(1995) , 10.1016/0893-6080(95)00014-3
Michael I Jordan, Robert A Jacobs, None, Hierarchical mixtures of experts and the EM algorithm Neural Computation. ,vol. 6, pp. 181- 214 ,(1994) , 10.1162/NECO.1994.6.2.181
Norman Richard Draper, Harry Smith, Applied Regression Analysis ,(1966)
A. P. Dempster, N. M. Laird, D. B. Rubin, Maximum Likelihood from Incomplete Data Via theEMAlgorithm Journal of the Royal Statistical Society: Series B (Methodological). ,vol. 39, pp. 1- 22 ,(1977) , 10.1111/J.2517-6161.1977.TB01600.X
Leonard E. Baum, Ted Petrie, George Soules, Norman Weiss, A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains Annals of Mathematical Statistics. ,vol. 41, pp. 164- 171 ,(1970) , 10.1214/AOMS/1177697196
Paul E. Utgoff, Carla E. Brodley, An incremental method for finding multivariate splits for decision trees international conference on machine learning. pp. 58- 65 ,(1990) , 10.1016/B978-1-55860-141-3.50011-0