{ATP}: In-network Aggregation for Multi-tenant Learning

Raghav Bhaskar, Ragesh Jaiswal, Sidharth Telang, Congestion lower bounds for secure in-network aggregation wireless network security. pp. 197- 204 ,(2012) , 10.1145/2185448.2185474

Dorian C. Arnold, Barton P. Miller, Scalable failure recovery for high-performance data aggregation international parallel and distributed processing symposium. pp. 1- 11 ,(2010) , 10.1109/IPDPS.2010.5470432

Keqiang He, Eric Rozner, Kanak Agarwal, Wes Felter, John Carter, Aditya Akella, Presto: Edge-based Load Balancing for Fast Datacenter Networks acm special interest group on data communication. ,vol. 45, pp. 465- 478 ,(2015) , 10.1145/2785956.2787507

Jeffrey Dean, Greg Corrado, Rajat Monga, Kai Chen, Matthieu Devin, Mark Mao, Marc'aurelio Ranzato, Andrew Senior, Paul Tucker, Ke Yang, Quoc Le, Andrew Ng, None, Large Scale Distributed Deep Networks neural information processing systems. ,vol. 25, pp. 1223- 1231 ,(2012)

Gilad Shainer, Alexander Shpiner, Oded Wertheim, Mike Dubman, Gil Bloch, Pak Lui, Eitan Zahavi, Dror Goldenerg, Alex Margolin, Vladimir Koushnir, Sasha Kotchubievsky, Tamir Ronen, Hal Rosenstock, Lion Levi, Devendar Bureddy, Richard L. Graham, Scalable hierarchical aggregation protocol (SHArP): a hardware architecture for efficient data reduction 2016 First International Workshop on Communication Optimizations in HPC (COMHPC). pp. 1- 10 ,(2016) , 10.5555/3018058.3018059

Eyal Cidon, Sean Choi, Sachin Katti, Nick McKeown, AppSwitch: Application-layer Load Balancing within a Software Switch Proceedings of the First Asia-Pacific Workshop on Networking. pp. 64- 70 ,(2017) , 10.1145/3106989.3106998

Luca Antiga, Sam Gross, Soumith Chintala, Alban Desmaison, Adam Paszke, Zeming Lin, Adam Lerer, Edward Yang, Gregory Chanan, Zachary DeVito, Automatic differentiation in PyTorch ,(2017)

Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova, BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding north american chapter of the association for computational linguistics. pp. 4171- 4186 ,(2018) , 10.18653/V1/N19-1423

Orhan Firat, Jiquan Ngiam, HyoukJoong Lee, Dehao Chen, Ankur Bapna, Yanping Huang, Mia Xu Chen, Youlong Cheng, Quoc V. Le, Zhifeng Chen, Yonghui Wu, GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism neural information processing systems. ,vol. 32, pp. 103- 112 ,(2019)

Anuj Kalia, David G. Andersen, Michael Kaminsky, Datacenter RPCs can be general and fast networked systems design and implementation. pp. 1- 16 ,(2019)