I don't think my driver program which is running on my local machine can
connect to worker/executor machine because spark UI lists private ip's for
worker machine but I can connect to master from the driver because of this
setting export SPARK_PUBLIC_DNS="52.44.36.224". really not sure how to fix
Hi Guys,
I am running my driver program on my local machine and my spark cluster is on
AWS. The big question is I don't know what are the right settings to get around
this public and private ip thing on AWS? my spark-env.sh currently has the the
following lines
export
