i found jira that seems related:
https://issues.apache.org/jira/browse/SPARK-25047
On Fri, Mar 29, 2019 at 4:01 PM Koert Kuipers wrote:
> hi all,
> we are switching from scala 2.11 to 2.12 with a spark 2.4.1 release
> candidate and so far this has been going pretty smoothly.
>
> however we do
hi all,
we are switching from scala 2.11 to 2.12 with a spark 2.4.1 release
candidate and so far this has been going pretty smoothly.
however we do see some new serialization errors related to Function1,
Function2, etc.
they look like this:
ClassCastException: cannot assign instance of