Dynamic Sampling and Selective Masking for Communication-Efficient Federated Learning
作者： Anwar Walid , Xue Li , Shaoxiong Ji , Wenqi Jiang
DOI:
关键词:
摘要: … We propose dynamic sampling with a high sampling rate … federated learning by involving more clients for model aggregation at the very beginning. Once a more generalized federated …
harvard.edu
arxiv.org参考文章(34)
Karen Simonyan, Andrew Zisserman, Very Deep Convolutional Networks for Large-Scale Image Recognition computer vision and pattern recognition. ,(2014)
Diego Peteiro-Barral, Bertha Guijarro-Berdiñas, A survey of methods for distributed machine learning Progress in Artificial Intelligence. ,vol. 2, pp. 1- 11 ,(2013) , 10.1007/S13748-012-0035-5
Sepp Hochreiter, Jürgen Schmidhuber, Long short-term memory Neural Computation. ,vol. 9, pp. 1735- 1780 ,(1997) , 10.1162/NECO.1997.9.8.1735
Y. Lecun, L. Bottou, Y. Bengio, P. Haffner, Gradient-based learning applied to document recognition Proceedings of the IEEE. ,vol. 86, pp. 2278- 2324 ,(1998) , 10.1109/5.726791
Alex J Smola, David G Andersen, Kai Yu, Mu Li, Communication Efficient Distributed Machine Learning with the Parameter Server neural information processing systems. ,vol. 27, pp. 19- 27 ,(2014)
Kyunghyun Cho, Bart van Merrienboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, Yoshua Bengio, Learning Phrase Representations using RNN Encoder--Decoder for Statistical Machine Translation empirical methods in natural language processing. pp. 1724- 1734 ,(2014) , 10.3115/V1/D14-1179
Eunice Kim, Jung-Ah Lee, Yongjun Sung, Sejung Marina Choi, Predicting selfie-posting behavior on social networking sites Computers in Human Behavior. ,vol. 62, pp. 116- 123 ,(2016) , 10.1016/J.CHB.2016.03.078
Martin Abadi, Andy Chu, Ian Goodfellow, H Brendan McMahan, Ilya Mironov, Kunal Talwar, Li Zhang, None, Deep Learning with Differential Privacy computer and communications security. pp. 308- 318 ,(2016) , 10.1145/2976749.2978318
Stephen Merity, Richard Socher, Caiming Xiong, James Bradbury, Pointer Sentinel Mixture Models arXiv: Computation and Language. ,(2016)
Jakub Konečný, Ananda Theertha Suresh, Dave Bacon, Felix X. Yu, Peter Richtarik, H. Brendan McMahan, Federated Learning: Strategies for Improving Communication Efficiency arXiv: Learning. ,(2016)