chrishkchris edited a comment on issue #468: Distributted module URL: https://github.com/apache/incubator-singa/pull/468#issuecomment-503007595 I have run the example code of resnet50 test in the directory examples/autograd/resnet_dist.py using 4 AWS instances of p2.x8large (totally 32 GPUs of the model K80). The program was finished with no error returned. The dependencies used: nccl 2.4.7 mpich 3.3 The command of the test was: /<path_to_mpi>/mpiexec --hostfile <path_to_file> python3 ./incubator-singa/examples/autograd/resnet_dist.py The GPU utilization for node 4 was: ![gpu utilization](https://user-images.githubusercontent.com/38325429/59667326-1c512c00-91e9-11e9-9925-7803263d8b17.png)
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services