On the rate of learning in distributed hypothesis testing

作者: Anusha Lalitha , Tara Javidi

DOI: 10.1109/ALLERTON.2015.7446979

关键词:

摘要: This paper considers a problem of distributed hypothesis testing and cooperative learning. Individual nodes in network receive noisy local (private) observations whose distribution is parameterized by discrete parameter (hypotheses). The conditional distributions are known locally at the nodes, but true parameter/hypothesis not known. We consider social (“non-Bayesian”) learning rule from previous literature, which first perform Bayesian update their belief (distribution estimate) based on observation, communicate these updates to neighbors, then “non-Bayesian” linear consensus using log-beliefs neighbors. For this rule, we know that under mild assumptions, any node incorrect converges zero exponentially fast, exponential rate characterized structure divergences between observations' distributions. Tight bounds probability deviating nominal aperiodic networks derived. shown hold for all satisfy bounded moment condition.

参考文章(12)
Ali Jadbabaie, Pooya Molavi, Alireza Tahbaz-Salehi, Information Heterogeneity and the Speed of Learning in Social Networks Social Science Research Network. ,(2013) , 10.2139/SSRN.2266979
Jeffrey S. Rosenthal, Convergence Rates for Markov Chains SIAM Review. ,vol. 37, pp. 387- 405 ,(1995) , 10.1137/1037083
V. Saligrama, M. Alanyali, O. Savas, Distributed Detection in Sensor Networks With Packet Losses and Finite Capacity Links IEEE Transactions on Signal Processing. ,vol. 54, pp. 4118- 4132 ,(2006) , 10.1109/TSP.2006.880227
M. Alanyali, S. Venkatesh, O. Savas, S. Aeron, Distributed Bayesian hypothesis testing in sensor networks american control conference. ,vol. 6, pp. 5369- 5374 ,(2004) , 10.23919/ACC.2004.1384706
Kamiar Rahnama Rad, Alireza Tahbaz-Salehi, Distributed parameter estimation in networks 49th IEEE Conference on Decision and Control (CDC). pp. 5050- 5055 ,(2010) , 10.1109/CDC.2010.5717946
Rashedur Rahman, Murat Alanyali, Venkatesh Saligrama, Distributed Tracking in Multihop Sensor Networks With Communication Delays IEEE Transactions on Signal Processing. ,vol. 55, pp. 4656- 4668 ,(2007) , 10.1109/TSP.2007.896272
Ali Jadbabaie, Pooya Molavi, Alvaro Sandroni, Alireza Tahbaz-Salehi, Non-Bayesian social learning Games and Economic Behavior. ,vol. 76, pp. 210- 225 ,(2012) , 10.1016/J.GEB.2012.06.001
Reza Olfati-Saber, Jeff S. Shamma, Emilio Frazzoli, Elisa Franco, Belief consensus and distributed hypothesis testing in sensor networks Lecture Notes in Control and Information Sciences. pp. 169- 182 ,(2006)
Anusha Lalitha, Anand Sarwate, Tara Javidi, Social learning and distributed hypothesis testing international symposium on information theory. pp. 551- 555 ,(2014) , 10.1109/ISIT.2014.6874893
Shahin Shahrampour, Alexander Rakhlin, Ali Jadbabaie, Distributed Detection: Finite-Time Analysis and Impact of Network Topology IEEE Transactions on Automatic Control. ,vol. 61, pp. 3256- 3268 ,(2016) , 10.1109/TAC.2015.2506903