rahul003 commented on a change in pull request #8762: Gradient compression faq URL: https://github.com/apache/incubator-mxnet/pull/8762#discussion_r152454543
########## File path: docs/faq/gradient_compression.md ########## @@ -0,0 +1,95 @@ +# Gradient Compression + +Gradient Compression reduces communication bandwidth to make distributed training with GPUs more scalable and efficient without significant loss in convergence rate or accuracy. + + +## Benefits + +**Increased Speed** + +For tasks like acoustic modeling in speech recognition (like in Alexa), the gradient compression capability is observed to speedup training by about 2 times, depending on the size of the model and the network bandwidth of the instance. Bigger models see larger speedup with gradient compression. Review comment: Probably keep it generic here, people wouldn't know the type of models used in Alexa. Let's say 'For architectures with fully connected components ... ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
