ptrendx commented on issue #18697: URL: https://github.com/apache/incubator-mxnet/issues/18697#issuecomment-657777556
It is not just about performance though - AMP changes numerics of the model, so I don't believe it would be great user experience if they got the model to where they liked it, hybridized it and suddenly got different answer. One way of solving this I guess could be similar to what happens with the storage type (but just on the input side), where the input would be cast before the operator. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org