Jerry,
Thanks for your comment.
On Mon, Sep 4, 2017 at 10:43 AM, Saisai Shao wrote:
> I think spark.yarn.am.port is not used any more, so you don't need to
> consider this.
>
> If you're running Spark on YARN, I think some YARN RM port to submit
> applications should
I think spark.yarn.am.port is not used any more, so you don't need to
consider this.
If you're running Spark on YARN, I think some YARN RM port to submit
applications should also be reachable via firewall, as well as HDFS port to
upload resources.
Also in the Spark side, executors will be
Hi,
In case we run Spark on Yarn in client mode, we have firewall for
Hadoop cluster,
and the client node is outside firewall, I think I have to open some ports
that Application Master uses.
I think the ports is specified by "spark.yarn.am.port" as document says.