Re: Spark session dies in about 2 days: HDFS_DELEGATION_TOKEN token can'tbe found

Mine is the same scenario. I get the HDFS_DELEGATION_TOKEN issue exactly after the 7 days of the spark job started and it then gets killed. Even I'm also looking for the solution. Regards, Nik. On Fri, Mar 11, 2016 at 8:10 PM, Ruslan Dautkhanov wrote: > [image: Boxbe]

Re: Spark Token Expired Exception

; On Wed, Jan 6, 2016 at 12:16 PM, Nikhil Gs <gsnikhil1432...@gmail.com> > wrote: > >> Hello Team, >> >> >> Thank you for your time in advance. >> >> >> Below are the log lines of my spark job which is used for consuming the >> messages fro

Spark Token Expired Exception

Hello Team, Thank you for your time in advance. Below are the log lines of my spark job which is used for consuming the messages from Kafka Instance and its loading to Hbase. I have noticed the below Warn lines and later it resulted to errors. But I noticed that, exactly after 7 days the token

Re: Spark Job is getting killed after certain hours

e Loughran <ste...@hortonworks.com> wrote: > > On 17 Nov 2015, at 02:00, Nikhil Gs <gsnikhil1432...@gmail.com> wrote: > > Hello Team, > > Below is the error which we are facing in our cluster after 14 hours of > starting the spark submit job. Not able to understa

Spark Job is getting killed after certain hours

Hello Team, Below is the error which we are facing in our cluster after 14 hours of starting the spark submit job. Not able to understand the issue and why its facing the below error after certain time. If any of you have faced the same scenario or if you have any idea then please guide us. To

Kafka and Spark combination

Has anyone worked with Kafka in a scenario where the Streaming data from the Kafka consumer is picked by Spark (Java) functionality and directly placed in Hbase. Regards, Gs.

Re: Kafka streaming "at least once" semantics

Hello Everyone, Has anyone worked with Kafka in a scenario where the Streaming data from the Kafka consumer is picked by Spark (Java) functionality and directly placed in Hbase. Please let me know, we are completely new to this scenario. That will be very helpful. Regards, GS. Regards, Nik.