[
https://issues.apache.org/jira/browse/SPARK-20000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224358#comment-16224358
]
Xin Lu edited comment on SPARK-20000 at 10/30/17 4:12 AM:
----------------------------------------------------------
I checked the dependencies and it looks like lz4-java already updated to 1.4.0:
https://github.com/apache/spark/blob/master/pom.xml#L538
lz4 1.4.0 was released august 2nd and looks like it included the patch above.
This is probably resolvable now.
This should be a dupe of this issue which will be fixed in 2.3.0:
https://github.com/apache/spark/commit/b78cf13bf05f0eadd7ae97df84b6e1505dc5ff9f
[SPARK-21276][CORE] Update lz4-java to the latest (v1.4.0)
was (Author: xynny):
I checked the dependencies and it looks like lz4-java already updated to 1.4.0:
https://github.com/apache/spark/blob/master/pom.xml#L538
lz4 1.4.0 was released august 2nd and looks like it included the patch above.
This is probably resolvable now.
This should be a dupe of this:
https://github.com/apache/spark/commit/b78cf13bf05f0eadd7ae97df84b6e1505dc5ff9f
[SPARK-21276][CORE] Update lz4-java to the latest (v1.4.0)
> Spark Hive tests aborted due to lz4-java on ppc64le
> ---------------------------------------------------
>
> Key: SPARK-20000
> URL: https://issues.apache.org/jira/browse/SPARK-20000
> Project: Spark
> Issue Type: Improvement
> Components: Tests
> Affects Versions: 2.2.0
> Environment: Ubuntu 14.04 ppc64le
> $ java -version
> openjdk version "1.8.0_111"
> OpenJDK Runtime Environment (build 1.8.0_111-8u111-b14-3~14.04.1-b14)
> OpenJDK 64-Bit Server VM (build 25.111-b14, mixed mode)
> Reporter: Sonia Garudi
> Priority: Minor
> Labels: ppc64le
> Attachments: hs_err_pid.log
>
>
> The tests are getting aborted in Spark Hive project with the following error :
> {code:borderStyle=solid}
> #
> # A fatal error has been detected by the Java Runtime Environment:
> #
> # SIGSEGV (0xb) at pc=0x00003fff94dbf114, pid=6160, tid=0x00003fff6efef1a0
> #
> # JRE version: OpenJDK Runtime Environment (8.0_111-b14) (build
> 1.8.0_111-8u111-b14-3~14.04.1-b14)
> # Java VM: OpenJDK 64-Bit Server VM (25.111-b14 mixed mode linux-ppc64
> compressed oops)
> # Problematic frame:
> # V [libjvm.so+0x56f114]
> {code}
> In the thread log file, I found the following traces :
> Event: 3669.042 Thread 0x00003fff89976800 Exception <a
> 'java/lang/NoClassDefFoundError': Could not initialize class
> net.jpountz.lz4.LZ4JNI> (0x000000079fcda3b8) thrown at
> [/build/openjdk-8-fVIxxI/openjdk-8-8u111-b14/src/hotspot/src/share/vm/oops/instanceKlass.cpp,
> line 890]
> This error is due to the lz4-java (version 1.3.0), which doesn’t have support
> for ppc64le.PFA the thread log file.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
