It will be more convenient for setting FAZ to true by default. The only concern is that if it affects the training accuracy (suppose very limited).
We have encountered several performance issues with denormal computation in the past but only happen in the user's debugging mode by randomly generated numbers. Thus, I am not sure if this issue will be happening in real cases. Let's wait for a while for the inputs from other members :) -- You are receiving this because you are subscribed to this thread. Reply to this email directly or view it on GitHub: https://github.com/apache/incubator-mxnet/issues/19361#issuecomment-712596251
