[GitHub] [incubator-mxnet] zixuanweeei commented on issue #17479: Bug in RNN and LSTM with multiple layers for mxnet-mkl
zixuanweeei commented on issue #17479: Bug in RNN and LSTM with multiple layers for mxnet-mkl URL: https://github.com/apache/incubator-mxnet/issues/17479#issuecomment-580550738 @pengzhao-intel @TaoLv This problem happens on the codebase with the old MKL-DNN version (< v1.0). After aa1074dc1704d3732ab205c43d48083ef8c69680, we brought the refactor of rnn operators into MXNet, which could give the correct result. I also tested with b5d07e30321da47d604b99048c1b57c03ec819b0 (1 commit before aa1074dc1704d3732ab205c43d48083ef8c69680), turning out to have the wrong result. For now, we can fix it on v1.5.x branch only. Shall we? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-mxnet] zixuanweeei commented on issue #17479: Bug in RNN and LSTM with multiple layers for mxnet-mkl
zixuanweeei commented on issue #17479: Bug in RNN and LSTM with multiple layers for mxnet-mkl URL: https://github.com/apache/incubator-mxnet/issues/17479#issuecomment-580539589 > I compiled the mxnet master with mkldnn. And the output results are correct now. Thanks for trying out the master. Yes, I can confirm that the nightly build `1.6.0b20191023` has the problem. Would you mind using the latest build? Or please tell us if there is any incompatible usage in your application. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-mxnet] zixuanweeei commented on issue #17479: Bug in RNN and LSTM with multiple layers for mxnet-mkl
zixuanweeei commented on issue #17479: Bug in RNN and LSTM with multiple layers for mxnet-mkl URL: https://github.com/apache/incubator-mxnet/issues/17479#issuecomment-580277044 Hi @icemelon9 , thanks for reporting this issue. I have a test on v1.6x branch (commit-id 6eec9da) for 3-layer LSTM. The differences between the results of those two releases are less than 1e-5. Could you give a try on v1.6.x? It would be highly appreciated. Further investigation of v1.5.x is in progress. I will confirm the result later. Sorry for the inconvenience. > mxnet: make -j USE_MKLDNN=0 USE_BLAS=mkl USE_INTEL_PATH=/opt/intel USE_OPENMP=1 USE_OPENCV=0 ``` [[[ 0.11122619 0.18695417 0.0360560.18501873 0.00461666 0.19519787 0.11368521 0.22313197 0.16217268 0.19069287]] [[ 0.05666452 0.09940925 0.02025517 0.0998227 -0.00323086 0.10185727 0.05466421 0.12510833 0.09242072 0.10603023]] [[ 0.03004576 0.05036608 0.01141703 0.05086566 -0.00455239 0.05140195 0.02738635 0.06676298 0.05007396 0.05527211]]] [[[ 0.05855561 0.0166911 -0.02148632 0.02531915 -0.04765372 -0.00133875 -0.00242618 0.07877947 0.00234905 0.03731738]] [[ 0.00935058 0.02891479 0.01008102 0.04661271 0.01876344 -0.00332517 -0.00967842 0.03273115 0.02256259 0.02182308]] [[ 0.03004576 0.05036608 0.01141703 0.05086566 -0.00455239 0.05140195 0.02738635 0.06676298 0.05007396 0.05527211]]] ``` > mxnet-mkl: make -j USE_MKLDNN=1 USE_BLAS=mkl USE_INTEL_PATH=/opt/intel USE_OPENMP=1 USE_OPENCV=0 ``` [[[ 0.1112262 0.18695419 0.0360560.18501873 0.00461666 0.19519788 0.11368521 0.22313201 0.16217265 0.19069287]] [[ 0.05666453 0.09940924 0.02025516 0.09982269 -0.00323086 0.10185728 0.05466421 0.12510836 0.0924207 0.10603023]] [[ 0.03004576 0.05036609 0.01141703 0.05086566 -0.00455239 0.05140197 0.02738635 0.0667630.05007394 0.05527212]]] [[[ 0.05855562 0.01669111 -0.02148631 0.02531913 -0.04765372 -0.00133875 -0.00242618 0.07877947 0.00234905 0.03731737]] [[ 0.00935059 0.02891479 0.01008102 0.04661271 0.01876344 -0.00332517 -0.00967842 0.03273115 0.02256259 0.02182308]] [[ 0.03004576 0.05036609 0.01141703 0.05086566 -0.00455239 0.05140197 0.02738635 0.0667630.05007394 0.05527212]]] ``` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
