Can you give more insight into your infrastructure? Just to be sure it's not an issue with your infra. Which version mxnet? What instance type? How many GPUs? etc
Is this a model specific issue? Have you tried basic mnist/resnet/other popular models with Horovod? Has it worked well for those models? --- [Visit Topic](https://discuss.mxnet.io/t/very-slow-initialisation-of-gpu-distributed-training/6357/2) or reply to this email to respond. You are receiving this because you enabled mailing list mode. To unsubscribe from these emails, [click here](https://discuss.mxnet.io/email/unsubscribe/ecda0c238539f539b148311cb59d719558c009e69ab5a255f7091e687748f1fc).
