Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22179
https://github.com/EsotericSoftware/kryo/releases/tag/kryo-parent-4.0.0
This has a number of breaking changes. However, Spark actually doesn't use
kryo itself, and excludes it. It uses kryo-shaded, via chill. chill otherwise
has almost no changes from 0.8 to 0.9 except to accommodate Kryo 4. Therefore
the update shouldn't actually force downstream apps to use a different kryo,
which is most of the potential problem here.
The changes in serialized format should not be visible outside Spark, if I
am not mistaken. It controls serialization within Spark components and this
isn't compatible across versions anyway.
I'm inclined to merge this for 2.4 as it resolves a number of issues users
are hitting.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
