apeforest opened a new pull request #16735: Use single-bit for mask in dropout 
operator
URL: https://github.com/apache/incubator-mxnet/pull/16735
 
 
   ## Description ##
   Use single bit in mask for dropout to reduce memory.
   This PR fixes https://github.com/apache/incubator-mxnet/issues/15968
   
   The current implementation does not yet support param axes. It therefore 
will not pass all unit tests. It is used for benchmarking BERT model for now. I 
will add support for axes param before merging it to master.
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

Reply via email to