-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31452/
-----------------------------------------------------------
(Updated Feb. 26, 2015, 9:38 p.m.)
Review request for hive, Brock Noland and Xuefu Zhang.
Changes
-------
Instead of using spark.kryo.classesToRegister, we register those used classes,
per Xuefu's suggestion.
Bugs: HIVE-9781
https://issues.apache.org/jira/browse/HIVE-9781
Repository: hive-git
Description
-------
Now, Spark RSC can use setting spark.kryo.classesToRegister. Reference checking
is still needed since there are loops.
Diffs (updated)
-----
ql/src/java/org/apache/hadoop/hive/ql/exec/spark/KryoSerializer.java 76a4fd1
ql/src/java/org/apache/hadoop/hive/ql/exec/spark/RemoteHiveSparkClient.java
f1d65ea
Diff: https://reviews.apache.org/r/31452/diff/
Testing
-------
Tested it on a yarn cluster with spark.kryo.classesToRegister set.
Thanks,
Jimmy Xiang
