Hi all,

It was found in PIG-4693 (https://issues.apache.org/jira/browse/PIG-4693)
that Pig is currently dependent on Kryo 2.22. However, Spark depends on
2.21. The two versions are not completely compatible. We tried several ways
to solve the problem but unfortunately none worked. This is mainly because
Spark doesn't give user an opportunity to provide their own kryo library
(SPARK-10910). Please refer to the full discussions in PIG-4693.

It seems that Pig brought in kryo dependency for ORC. I'm wondering if
there is any specific reasons for kryo 2.22 and if not, whether we can
downgrade the dependency to 2.21 instead. Our initial test shows that kryo
2.21 works just fine for ORC. This obviously solve our problem as well.

Your input to this is greatly appreciated.

Thanks,
Xuefu

Reply via email to