Hi all, I am wondering if there is any stable support to run distributed TensorFlow atop YARN at the moment. I found this blog post from Hortonworks. It seems this it is possible starting YARN 3.1.0.https://hortonworks.com/blog/distributed-tensorflow-assembly-hadoop-yarn/
Also I found some more recent JIRAs:https://issues.apache.org/jira/browse/YARN-8220 https://issues.apache.org/jira/browse/YARN-8135 which suggests to use something called submarine. However, I could not find any proper documentation or instructions to use any of these. Can someone help me with this? Otherwise, it is any better support to run any other machine learning framework with YARN? Thank you in advance,- Robert