On the learnability and usage of acyclic probabilistic finite automata

作者: Dana Ron , Yoram Singer , Naftali Tishby

DOI: 10.1145/225298.225302

关键词:

摘要: We propose and analyze a distribution learning algorithm for subclass ofacyclic probalistic finite automata(APFA). This is characterized by certain distinguishability property of the automata's states. Though hardness results are known distributions generated general APFAs, we prove that our can efficiently learn APFAs consider. In particular, show KL-divergence between target source hypothesis be made arbitrarily small with high confidence in polynomial time. present two applications algorithm. first, how to model cursively written letters. The resulting models part complete cursive handwriting recognition system. second application demonstrate used build multiple-pronunciation spoken words. evaluate APFA-based pronunciation on labeled speech data. good performance (in terms log-likelihood obtained test data) achieved little time needed suggests might powerful alternative commonly probabilistic models.

参考文章(22)
395 pages. PLAMONDON, R., SUEN, C.Y., SIMNER, M. 1989, Computer recognition and human production of handwriting World Scientific. ,(1989) , 10.1142/0658
G. PLAMONDON, R., LEEDHAM, Computer processing of handwriting WORLD SCIENTIFIC. ,(1990) , 10.1142/1226
Rafael C. Carrasco, Jose Oncina, Learning Stochastic Regular Grammars by Means of a State Merging Method international colloquium on grammatical inference. pp. 139- 152 ,(1994) , 10.1007/3-540-58473-0_144
I︠a︡. M. Barzdinʹ, B. A. Trakhtenbrot, Finite automata : behavior and synthesis North-Holland Pub. Co , American Elsevier. ,(1973)
Avrim Blum, Merrick Furst, Michael Kearns, Richard J. Lipton, Cryptographic Primitives Based on Hard Learning Problems international cryptology conference. pp. 278- 291 ,(1993) , 10.1007/3-540-48329-2_24
M.D. Riley, A statistical model for generating pronunciation networks international conference on acoustics, speech, and signal processing. pp. 737- 740 ,(1991) , 10.1109/ICASSP.1991.150446
Manfred K. Warmuth, Naoki Abe, On the computational complexity of approximating distributions by probabilistic automata conference on learning theory. ,vol. 9, pp. 205- 260 ,(1990) , 10.5555/92571.92587
Leonard E. Baum, Ted Petrie, Statistical Inference for Probabilistic Functions of Finite State Markov Chains Annals of Mathematical Statistics. ,vol. 37, pp. 1554- 1563 ,(1966) , 10.1214/AOMS/1177699147
Yoav Freund, Michael Kearns, Dana Ron, Ronitt Rubinfeld, Robert E. Schapire, Linda Sellie, Efficient learning of typical finite automata from random walks Proceedings of the twenty-fifth annual ACM symposium on Theory of computing - STOC '93. pp. 315- 324 ,(1993) , 10.1145/167088.167191