Regularized linear fuzzy clustering and probabilistic PCA mixture models

作者: K. Honda , H. Ichihashi

DOI: 10.1109/TFUZZ.2004.840104

关键词:

摘要: Fuzzy c-means (FCM)-type fuzzy clustering approaches are closely related to Gaussian mixture models (GMMs) and EM-like algorithms have been used in FCM with regularized objective functions. Especially, regularization by Kullback-Leibler information (KLFCM) is a counterpart of GMMs. In this paper, we propose apply probabilistic principal component analysis (PCA) linear following discussion on the relationship between local PCA clustering. Although proposed method kind constrained model KLFCM, algorithm includes c-varieties (FCV) as special case, can be regarded modified FCV K-L information. Numerical experiments demonstrate that more flexible than maximum likelihood useful for capturing substructures properly.

参考文章(31)
Gilles Celeux, Gérard Govaert, Fuzzy Clustering and Mixture Models Physica, Heidelberg. pp. 154- 159 ,(1994) , 10.1007/978-3-642-52463-9_15
Christopher M. Bishop, Neural networks for pattern recognition ,(1995)
Robert M. Peters, Stanley A. Shanies, John C. Peters, Fuzzy Cluster Analysis : A New Method to Predict Future Cardiac Events in Patients With Positive Stress Tests Japanese Circulation Journal-english Edition. ,vol. 62, pp. 750- 754 ,(1998) , 10.1253/JCJ.62.750
Donald Gustafson, William Kessel, Fuzzy clustering with a fuzzy covariance matrix conference on decision and control. ,vol. 17, pp. 761- 766 ,(1978) , 10.1109/CDC.1978.268028
Katsuhiro Honda, Hidetomo Ichihashi, Component-wise robust linear fuzzy clustering for collaborative filtering International Journal of Approximate Reasoning. ,vol. 37, pp. 127- 144 ,(2004) , 10.1016/J.IJAR.2004.02.001
Richard J. Hathaway, Another interpretation of the EM algorithm for mixture distributions Statistics & Probability Letters. ,vol. 4, pp. 53- 56 ,(1986) , 10.1016/0167-7152(86)90016-7
K. Fukunaga, D.R. Olsen, An Algorithm for Finding Intrinsic Dimensionality of Data IEEE Transactions on Computers. ,vol. C-20, pp. 176- 183 ,(1971) , 10.1109/T-C.1971.223208
James M. Keller, Michael R. Gray, James A. Givens, A fuzzy K-nearest neighbor algorithm systems man and cybernetics. ,vol. 15, pp. 580- 585 ,(1985) , 10.1109/TSMC.1985.6313426
Michel Ménard, Vincent Courboulay, Pierre-André Dardignac, Possibilistic and probabilistic fuzzy clustering: unification within the framework of the non-extensive thermostatistics Pattern Recognition. ,vol. 36, pp. 1325- 1342 ,(2003) , 10.1016/S0031-3203(02)00049-3
A. P. Dempster, N. M. Laird, D. B. Rubin, Maximum Likelihood from Incomplete Data Via theEMAlgorithm Journal of the Royal Statistical Society: Series B (Methodological). ,vol. 39, pp. 1- 22 ,(1977) , 10.1111/J.2517-6161.1977.TB01600.X