I have access to a HPC cluster with hundreds of nodes with thousands cores. I found there are many deep learning framework can train using multiple gpu in a single node. very few frameworks can train in multiple nodes using gpu. Is there any framework can train with MPI? I can't install long run service like zookeeper or spark in the cluster.
- is it possible to use MPI HPC cluster in singa? Li Li
