[GitHub] rahul003 commented on issue #11842: Strange results from fp16 benchmarks on Alexnet on CIFAR10

rahul003 commented on issue #11842: Strange results from fp16 benchmarks on Alexnet on CIFAR10 URL: https://github.com/apache/incubator-mxnet/issues/11842#issuecomment-414862495 Great! This is an automated message from the A

[GitHub] rahul003 commented on issue #11842: Strange results from fp16 benchmarks on Alexnet on CIFAR10

rahul003 commented on issue #11842: Strange results from fp16 benchmarks on Alexnet on CIFAR10 URL: https://github.com/apache/incubator-mxnet/issues/11842#issuecomment-413995610 @mklissa Did you notice a speedup with a single GPU as well? Maybe it has improved now. With multi GPU I di

[GitHub] rahul003 commented on issue #11842: Strange results from fp16 benchmarks on Alexnet on CIFAR10

rahul003 commented on issue #11842: Strange results from fp16 benchmarks on Alexnet on CIFAR10 URL: https://github.com/apache/incubator-mxnet/issues/11842#issuecomment-409763085 For CIFAR I had observed similar performance. Here's a related thread with my observations and logs of n

[GitHub] rahul003 commented on issue #11842: Strange results from fp16 benchmarks on Alexnet on CIFAR10

rahul003 commented on issue #11842: Strange results from fp16 benchmarks on Alexnet on CIFAR10 URL: https://github.com/apache/incubator-mxnet/issues/11842#issuecomment-406748913 Please review the performance section of the tutorial you [linked](https://mxnet.incubator.apache.org/faq/float

[GitHub] rahul003 commented on issue #11842: Strange results from fp16 benchmarks on Alexnet on CIFAR10

rahul003 commented on issue #11842: Strange results from fp16 benchmarks on Alexnet on CIFAR10 URL: https://github.com/apache/incubator-mxnet/issues/11842#issuecomment-406748642 Hi Ray, Cifar doesn't lend itself well for fp16 computation. Nvidia Tensor Cores essentially perform