Hi Akshay
Thanks for the response please find below the answers to your questions.
1. We are running Spark in cluster mode the cluster manager being Spark's
standalone cluster manager.
2. All the ports are open and we preconfigure on what ports the
communication should happen and modify firewall
Hi Akshay
Thanks for the response please find below the answers to your questions.
1. We are running Spark in cluster mode the cluster manager being Spark's
standalone cluster manager.
2. All the ports are open and we preconfigure on what ports the
communication should happen and modify firewall
Hi Akshay
Thanks for the response please find below the answers to your questions.
1. We are running Spark in cluster mode the cluster manager being Spark's
standalone cluster manager.
2. All the ports are open and we preconfigure on what ports the
communication should happen and modify firewall
Hi Lokesh,
Please provide further information to help identify the issue.
1) Are you running in a standalone mode or cluster mode? If cluster, then
is a spark master/slave or YARN/Mesos?
2) Have you tried checking if all ports between your master and the machine
with IP 192.168.43.167 are
Hi All
We are running Spark version 2.4.0 and we run few Spark streaming jobs
listening on Kafka topics. We receive an average of 10-20 msgs per second.
And the Spark master has been going down after 1-2 hours of it running.
Exception is given below:
Along with that spark executors also get
