Re: ClassCastException for SerializedLamba

2019-03-30 Thread Koert Kuipers
i found jira that seems related: https://issues.apache.org/jira/browse/SPARK-25047 On Fri, Mar 29, 2019 at 4:01 PM Koert Kuipers wrote: > hi all, > we are switching from scala 2.11 to 2.12 with a spark 2.4.1 release > candidate and so far this has been going pretty smoothly. > > however we do

ClassCastException for SerializedLamba

2019-03-29 Thread Koert Kuipers
hi all, we are switching from scala 2.11 to 2.12 with a spark 2.4.1 release candidate and so far this has been going pretty smoothly. however we do see some new serialization errors related to Function1, Function2, etc. they look like this: ClassCastException: cannot assign instance of