[
https://issues.apache.org/jira/browse/SPARK-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544359#comment-14544359
]
Patrick Wendell commented on SPARK-7063:
----------------------------------------
[~srowen] so I think maybe we can pull this into master now, given that we'll
drop 1.6 in Spark 1.5 (?)
> Update lz4 for Java 7 to avoid: when lz4 compression is used, it causes core
> dump
> ---------------------------------------------------------------------------------
>
> Key: SPARK-7063
> URL: https://issues.apache.org/jira/browse/SPARK-7063
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 1.3.1
> Environment: IBM JDK
> Reporter: Jenny MA
> Priority: Minor
>
> this issue is initially noticed by using IBM JDK, below please find the stack
> track of this issue, caused by violating the rule in critical section.
> #0 0x000000314340f3cb in raise () from
> /service/pmrs/45638/20/lib64/libpthread.so.0
> #1 0x00007f795b0323be in j9dump_create () from
> /service/pmrs/45638/20/opt/ibm/biginsights/jdk/jre/lib/amd64/compressedrefs/libj9prt27.so
> #2 0x00007f795a88ba2a in doSystemDump () from
> /service/pmrs/45638/20/opt/ibm/biginsights/jdk/jre/lib/amd64/compressedrefs/libj9dmp27.so
> #3 0x00007f795b0405d5 in j9sig_protect () from
> /service/pmrs/45638/20/opt/ibm/biginsights/jdk/jre/lib/amd64/compressedrefs/libj9prt27.so
> #4 0x00007f795a88a1fd in runDumpFunction () from
> /service/pmrs/45638/20/opt/ibm/biginsights/jdk/jre/lib/amd64/compressedrefs/libj9dmp27.so
> #5 0x00007f795a88dbab in runDumpAgent () from
> /service/pmrs/45638/20/opt/ibm/biginsights/jdk/jre/lib/amd64/compressedrefs/libj9dmp27.so
> #6 0x00007f795a8a1c49 in triggerDumpAgents () from
> /service/pmrs/45638/20/opt/ibm/biginsights/jdk/jre/lib/amd64/compressedrefs/libj9dmp27.so
> #7 0x00007f795a4518fe in doTracePoint () from
> /service/pmrs/45638/20/opt/ibm/biginsights/jdk/jre/lib/amd64/compressedrefs/libj9trc27.so
> #8 0x00007f795a45210e in j9Trace () from
> /service/pmrs/45638/20/opt/ibm/biginsights/jdk/jre/lib/amd64/compressedrefs/libj9trc27.so
> #9 0x00007f79590e46e1 in
> MM_StandardAccessBarrier::jniReleasePrimitiveArrayCritical(J9VMThread*,
> _jarray*, void*, int) ()
> from
> /service/pmrs/45638/20/opt/ibm/biginsights/jdk/jre/lib/amd64/compressedrefs/libj9gc27.so
> #10 0x00007f7938bc397c in
> Java_net_jpountz_lz4_LZ4JNI_LZ4_1compress_1limitedOutput () from
> /service/pmrs/45638/20/tmp/liblz4-java7155003924599399415.so
> #11 0x00007f795b707149 in VMprJavaSendNative () from
> /service/pmrs/45638/20/opt/ibm/biginsights/jdk/jre/lib/amd64/compressedrefs/libj9vm27.so
> #12 0x0000000000000000 in ?? ()
> this is an issue introduced by a bug in net.jpountz.lz4.lz4-1.2.0.jar, and
> fixed in 1.3.0 version. Sun JDK /Open JDK doesn't complain this issue, but
> this issue will trigger assertion failure when IBM JDK is used. here is the
> link to the fix
> https://github.com/jpountz/lz4-java/commit/07229aa2f788229ab4f50379308297f428e3d2d2
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
