cjolivier01 commented on issue #9366: Refactor dropout operator to use ParallelRandom generator and also react deterministically when seeding URL: https://github.com/apache/incubator-mxnet/pull/9366#issuecomment-357107778 MKL seems to be quite a bit faster, tryinbg to see how to reenable it and still be deterministic (it was not before) ================== = MKL ================== Timing: 50 iterations of 10 calls, shape = [1,1,28,28] = 784 items Dropout Operator CPU: Timing [Forward] 3.777 ms, avg: 0.007554 ms X 500 passes Timing: 50 iterations of 10 calls, shape = [1,3,28,28] = 2,352 items Dropout Operator CPU: Timing [Forward] 4.078 ms, avg: 0.008156 ms X 500 passes Timing: 50 iterations of 10 calls, shape = [50,1,18,32] = 28,800 items Dropout Operator CPU: Timing [Forward] 7.403 ms, avg: 0.014806 ms X 500 passes Timing: 50 iterations of 10 calls, shape = [50,3,18,32] = 86,400 items Dropout Operator CPU: Timing [Forward] 17.654 ms, avg: 0.035308 ms X 500 passes Timing: 50 iterations of 10 calls, shape = [20,3,128,128] = 983,040 items Dropout Operator CPU: Timing [Forward] 202.224 ms, avg: 0.404448 ms X 500 passes ================== = ParellelRandom Resource ================== Timing: 50 iterations of 10 calls, shape = [1,1,28,28] = 784 items Dropout Operator CPU: Timing [Forward] 15.212 ms, avg: 0.030424 ms X 500 passes Timing: 50 iterations of 10 calls, shape = [1,3,28,28] = 2,352 items Dropout Operator CPU: Timing [Forward] 31.348 ms, avg: 0.062696 ms X 500 passes Timing: 50 iterations of 10 calls, shape = [50,1,18,32] = 28,800 items Dropout Operator CPU: Timing [Forward] 390.813 ms, avg: 0.781626 ms X 500 passes Timing: 50 iterations of 10 calls, shape = [50,3,18,32] = 86,400 items Dropout Operator CPU: Timing [Forward] 1365.62 ms, avg: 2.73123 ms X 500 passes Timing: 50 iterations of 10 calls, shape = [20,3,128,128] = 983,040 items Dropout Operator CPU: Timing [Forward] 15731.5 ms, avg: 31.4629 ms X 500 passes
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
