szha commented on issue #13896: Cudnn dropout
URL: https://github.com/apache/incubator-mxnet/pull/13896#issuecomment-468144518
@roywei by default cudnn_off is turned on. You need to turn it off to
benefit from cudnn dropout.
szha commented on issue #13896: Cudnn dropout
URL: https://github.com/apache/incubator-mxnet/pull/13896#issuecomment-460385634
Thanks for the review, @eric-haibin-lin @TaoLv.
@pengzhao-intel @ptrendx @DickJC123 I'm holding onto updating the PR until
you get a chance to review this PR
szha commented on issue #13896: Cudnn dropout
URL: https://github.com/apache/incubator-mxnet/pull/13896#issuecomment-458445531
As of 7f76582 the speed-up still depends on the size of the input because of
set descriptor overhead. I'm currently looking into adding a runtime resource
manager
