Re: NoNodeAvailableException (None of the configured nodes are available) error when trying to push data to Elastic from a Spark job

2017-02-07 Thread Jacek Laskowski
Hi, I may have seen this issue already... What's the cluster manager? How do you spark-submit? Jacek On 7 Feb 2017 7:44 p.m., "dgoldenberg" wrote: Hi, Any reason why we might be getting this error? The code seems to work fine in the non-distributed mode but the

NoNodeAvailableException (None of the configured nodes are available) error when trying to push data to Elastic from a Spark job

2017-02-07 Thread dgoldenberg
Hi, Any reason why we might be getting this error? The code seems to work fine in the non-distributed mode but the same code when run from a Spark job is not able to get to Elastic. Spark version: 2.0.1 built for Hadoop 2.4, Scala 2.11 Elastic version: 2.3.1 I've verified the Elastic hosts and

Re: NoNodeAvailableException (None of the configured nodes are available) error when trying to push data to Elastic from a Spark job

2017-02-04 Thread Jacek Laskowski
Hi, I'd say the error says it all : Caused by: NoNodeAvailableException[None of the configured nodes are available: [{#transport#-1}{XX.XXX.XXX.XX}{XX.XXX.XXX.XX:9300}]] Jacek On 3 Feb 2017 7:58 p.m., "Anastasios Zouzias" wrote: Hi there, Are you sure that the cluster

Re: NoNodeAvailableException (None of the configured nodes are available) error when trying to push data to Elastic from a Spark job

2017-02-03 Thread Anastasios Zouzias
Hi there, Are you sure that the cluster nodes where the executors run have network connectivity to the elastic cluster? Speaking of which, why don't you use: https://github.com/elastic/elasticsearch-hadoop#apache-spark ? Cheers, Anastasios On Fri, Feb 3, 2017 at 7:10 PM, Dmitry Goldenberg

NoNodeAvailableException (None of the configured nodes are available) error when trying to push data to Elastic from a Spark job

2017-02-03 Thread Dmitry Goldenberg
Hi, Any reason why we might be getting this error? The code seems to work fine in the non-distributed mode but the same code when run from a Spark job is not able to get to Elastic. Spark version: 2.0.1 built for Hadoop 2.4, Scala 2.11 Elastic version: 2.3.1 I've verified the Elastic hosts and