Spark streaming 1.6.0-RC4 NullPointerException using mapWithState

2015-12-29 Thread Jan Uyttenhove
138655 ms 15/12/29 11:56:12 INFO executor.Executor: Executor killed task 1.0 in stage 3.0 (TID 25) 15/12/29 11:56:12 INFO spark.MapOutputTrackerMaster: Size of output statuses for shuffle 2 is 153 bytes 15/12/29 11:56:12 INFO spark.MapOutputTrackerMaster: Size of output statuses for shuffle 1 is

Re: Spark streaming 1.6.0-RC4 NullPointerException using mapWithState

2015-12-31 Thread Jan Uyttenhove
This implies that parentStateMap was null. > But it seems parentStateMap is properly assigned in readObject(). > > Jan: > Which serializer did you use ? > > Thanks > > On Tue, Dec 29, 2015 at 3:42 AM, Jan Uyttenhove wrote: > >> Hi guys, >> >> I upgrad