Re: Checkpoint of DStream joined with RDD

2016-03-30 Thread Lubomir Nerad
, Ted Yu wrote: This is the line where NPE came from: if (conf.get(SCAN) != null) { So Configuration instance was null. On Fri, Mar 18, 2016 at 9:58 AM, Lubomir Nerad <lubomir.ne...@oracle.com <mailto:lubomir.ne...@oracle.com>> wrote: The HBase version is 1.0.1.1. Than

Re: Checkpoint of DStream joined with RDD

2016-03-19 Thread Lubomir Nerad
) ? Thanks On Fri, Mar 18, 2016 at 8:05 AM, Lubomir Nerad <lubomir.ne...@oracle.com <mailto:lubomir.ne...@oracle.com>> wrote: Hi, I tried to replicate the example of joining DStream with lookup RDD from http://spark.apache.org/docs/latest/streaming-programmin

Checkpoint of DStream joined with RDD

2016-03-19 Thread Lubomir Nerad
Hi, I tried to replicate the example of joining DStream with lookup RDD from http://spark.apache.org/docs/latest/streaming-programming-guide.html#transform-operation. It works fine, but when I enable checkpointing for the StreamingContext and let the application to recover from a previously