Distributed Statistical Machine Learning in Adversarial Settings: Byzantine Gradient Descent
作者： Yudong Chen , Lili Su , Jiaming Xu
关键词:
摘要: … In this paper, based on the geometric median of means of the gradients, we propose a simple variant of the classical gradient descent method. We show that our method can tolerate q …
arxiv.org
acm.org
sci-hub.se 参考文章(25)
Dimitri P. Bertsekas, Network Optimization: Continuous and Discrete Models ,(1998)
Foster J Provost, Daniel N Hennessy, None, Scaling up: distributed machine learning with cooperation national conference on artificial intelligence. pp. 74- 79 ,(1996)
Jyrki Möttönen, Klaus Nordhausen, Hannu Oja, Asymptotic theory of the spatial median Institute of Mathematical Statistics. pp. 182- 193 ,(2010) , 10.1214/10-IMSCOLL718
Martin Wainwright, Yuchen Zhang, John Duchi, Divide and conquer kernel ridge regression: a distributed algorithm with minimax optimal rates Journal of Machine Learning Research. ,vol. 16, pp. 3299- 3340 ,(2015)
Huan Xu, Jiashi Feng, Shie Mannor, Distributed Robust Learning arXiv: Machine Learning. ,(2014)
Mike Speciner, Radia Perlman, Charlie Kaufman, Network Security: Private Communication in a Public World ,(1995)
P. Milasevic, G. R. Ducharme, Uniqueness of the spatial median Annals of Statistics. ,vol. 15, pp. 1332- 1333 ,(1987) , 10.1214/AOS/1176350511
Yucheng Low, Danny Bickson, Joseph Gonzalez, Carlos Guestrin, Aapo Kyrola, Joseph M. Hellerstein, Distributed GraphLab Proceedings of the VLDB Endowment. ,vol. 5, pp. 716- 727 ,(2012) , 10.14778/2212351.2212354
Martin J. Wainwright, Michael I. Jordan, John C. Duchi, Local Privacy and Minimax Bounds: Sharp Rates for Probability Estimation arXiv: Statistics Theory. ,(2013)
Martin J. Wainwright, Yuchen Zhang, John C. Duchi, Communication-efficient algorithms for statistical optimization Journal of Machine Learning Research. ,vol. 14, pp. 3321- 3363 ,(2013) , 10.5555/2567709.2567769