DickJC123 commented on issue #20374: URL: https://github.com/apache/incubator-mxnet/issues/20374#issuecomment-868014011
I developed a work-around for myself for the tests/python/train/test_autograd.py test: - If the cpu type is AMD, set OMP_NUM_THREADS=min(32, nproc) - If the cpu type is AMD **and** there's only one cpu socket, omit the portion of the test that references mx.cpu(1) These rules get the test to pass in a reasonable time on the machines I have access to. I'm reluctant to make a PR of these changes, since clearly our upstream CI does not exercise the failure mode. Also, this does not represent a proper tuning of openmp on the AMD arch. Perhaps someone with a greater stake in training on AMD cpus can pick up this issue and run with it? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
