Re: Spark job stops after a while.

I'm using 1.5.0 of Spark confirmed. Less this jar file:/opt/centralLogs/lib/spark-catalyst_2.10-1.5.1.jar. I'm going to keep looking for,, Thank you!. 2016-01-21 16:29 GMT+01:00 Ted Yu : > Maybe this is related (fixed in 1.5.3): > SPARK-11195 Exception thrown on executor

Re: Spark job stops after a while.

Looks like jar containing EsHadoopIllegalArgumentException class wasn't in the classpath. Can you double check ? Which Spark version are you using ? Cheers On Thu, Jan 21, 2016 at 6:50 AM, Guillermo Ortiz wrote: > I'm runing a Spark Streaming process and it stops in a

Spark job stops after a while.

I'm runing a Spark Streaming process and it stops in a while. It makes some process an insert the result in ElasticSeach with its library. After a while the process fail. I have been checking the logs and I have seen this error 2016-01-21 14:57:54,388

Re: Spark job stops after a while.

Maybe this is related (fixed in 1.5.3): SPARK-11195 Exception thrown on executor throws ClassNotFoundException on driver FYI On Thu, Jan 21, 2016 at 7:10 AM, Guillermo Ortiz wrote: > I'm using CDH 5.5.1 with Spark 1.5.x (I think that it's 1.5.2). > > I know that the

Re: Spark job stops after a while.

I'm using CDH 5.5.1 with Spark 1.5.x (I think that it's 1.5.2). I know that the library is here: cloud-user@ose10kafkaelk:/opt/centralLogs/lib$ jar tf elasticsearch-hadoop-2.2.0-beta1.jar | grep EsHadoopIllegalArgumentException org/elasticsearch/hadoop/EsHadoopIllegalArgumentException.class I

Re: Spark job stops after a while.

I think that it's that bug, because the error is the same.. thanks a lot. 2016-01-21 16:46 GMT+01:00 Guillermo Ortiz : > I'm using 1.5.0 of Spark confirmed. Less this > jar file:/opt/centralLogs/lib/spark-catalyst_2.10-1.5.1.jar. > > I'm going to keep looking for,, Thank