GitHub user squito opened a pull request:
https://github.com/apache/spark/pull/19313
[SPARK-21928][CORE] Set classloader on SerializerManager's private kryo
## What changes were proposed in this pull request?
We have to make sure that SerializerManager's private instance of
kryo also uses the right classloader, regardless of the current thread
classloader. In particular, this fixes serde during remote cache
fetches, as those occur in netty threads.
## How was this patch tested?
Manual tests & existing suite via jenkins. I haven't been able to
reproduce this is in a unit test, because when a remote RDD partition can be
fetched, there is a warning message and then the partition is just recomputed
locally. I manually verified the warning message is no longer present.
(cherry picked from commit b75bd1777496ce0354458bf85603a8087a6a0ff8)
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/squito/spark SPARK-21928_2.1
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/19313.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #19313
----
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
