sxjscience commented on issue #7942: Adam optimizer consistent with paper URL: https://github.com/apache/incubator-mxnet/pull/7942#issuecomment-331819232 @formath I see. I've checked again different versions of the Adam paper and find the rho in the v2 and v3 versions: https://arxiv.org/pdf/1412.6980v2.pdf, https://arxiv.org/pdf/1412.6980v2.pdf. However, it's removed in the latest arxiv version (v9), https://arxiv.org/pdf/1412.6980v9.pdf . Does other packages support this parameter? @piiswrong, do you think we still need to add it? Another choice is to add the FTML optimizer, which should work better than Adam in this scenario. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
With regards, Apache Git Services
