Spark not handling Null

2016-04-11 Thread saurabh guru
Trying to run following causes a NullPointer Exception. While I thought Spark should have been able to handle Null, apparently it is not able to. What could I return in place of null? What other ways could I approach this?? There are at times, I would want to just skip parsing and proceed to next r

Re: Spark not handling Null

2016-04-11 Thread Akhil Das
Surround it with a try..catch where its complaining about the null pointer to avoid the job being failed. What is happening here is like you are returning null and the following operation is working on null which causes the job to fail. Thanks Best Regards On Mon, Apr 11, 2016 at 12:51 PM, saurab