Estimating random variables from random sparse observations

作者: Montanari Andrea

DOI: 10.1002/ETT.1289

关键词:

摘要: Let X 1 ,...., n be a collection of iid discrete random variables, and Y m set noisy observations such variables. Assume each observation to function subset the i s, consider conditional distribution given observations, namely μ (x ) = P{X x |Y} (a posteriori probability). We establish general decoupling principle among as well relation between , fixed points associated density evolution operator. These results hold asymptotically in large system limit, provided average number variables an depends on is bounded. discuss relevance our result applications, ranging from sparse graph codes multi-user detection, group testing.

参考文章(43)
Dongning Guo, Chih Chun Wang, Belief propagation is asymptotically equivalent to MAP estimation for sparse linear systems allerton conference on communication, control, and computing. pp. 926- 935 ,(2006)
Giuseppe Caire, Shlomo Shamai, Sergio Verdú, Noiseless data compression with low-density parity-check codes Advances in Network Information Theory. pp. 263- 284 ,(2004)
Tom Richardson, Ruediger Urbanke, Modern Coding Theory Cambridge University Press. ,(2008) , 10.1017/CBO9780511791338
Tatsuto Murayama, Statistical Mechanics of Linear Compression Codes in Network Communication arXiv: Disordered Systems and Neural Networks. ,(2001)
Robert Dorfman, The Detection of Defective Members of Large Populations Annals of Mathematical Statistics. ,vol. 14, pp. 436- 440 ,(1943) , 10.1214/AOMS/1177731363
Cristian Estan, George Varghese, New directions in traffic measurement and accounting Proceedings of the First ACM SIGCOMM Workshop on Internet Measurement - IMW '01. ,vol. 32, pp. 323- 336 ,(2001) , 10.1145/505202.505212
Pramod Viswanath, David Tse, Fundamentals of Wireless Communication ,(2005)
Cristian Estan, George Varghese, New directions in traffic measurement and accounting ACM Transactions on Computer Systems. ,vol. 21, pp. 270- 313 ,(2003) , 10.1145/859716.859719
E. Berlekamp, R. McEliece, H. van Tilborg, On the inherent intractability of certain coding problems (Corresp.) IEEE Transactions on Information Theory. ,vol. 24, pp. 384- 386 ,(1978) , 10.1109/TIT.1978.1055873
Edwin Hewitt, Leonard J. Savage, Symmetric measures on Cartesian products Transactions of the American Mathematical Society. ,vol. 80, pp. 470- 501 ,(1955) , 10.1090/S0002-9947-1955-0076206-8