MG-WFBP: Efficient Data Communication for Distributed Synchronous SGD Algorithms

Keyphrases

• Backpropagation 100%
• Data Communication 100%
• Wait-free 100%
• Synchronous SGD 100%
• SPGD Algorithm 100%
• Merged-gradient 100%
• Deep Neural Network 66%
• Optimization Problem 33%
• Computational Power 33%
• Caffe 33%
• System Scalability 33%
• Cluster Computing 33%
• Network Communication 33%
• Back Propagation Algorithm 33%
• Communication Time 33%
• 10 GbE 33%
• Communication Tasks 33%
• Power Network 33%
• Small Data 33%
• Multi-GPU 33%
• Deep Learning System 33%
• Stochastic Gradient Descent 33%
• Iteration Times 33%
• Short Communication 33%
• Cluster of Nodes 33%
• Trace-driven Simulation 33%

Computer Science

• Data Communication 100%
• Deep Neural Network 100%
• Experimental Result 50%
• Graphics Processing Unit 50%
• Deep Learning Method 50%
• Communication Network 50%
• Optimization Problem 50%
• Computational Power 50%
• Open Source 50%
• Learning Platform 50%
• Backpropagation Algorithm 50%
• Iteration Time 50%
• Limiting Factor 50%
• Gradient Descent 50%
• Computer Cluster 50%