[ https://issues.apache.org/jira/browse/SPARK-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14219378#comment-14219378 ]
hoelog commented on SPARK-4511: ------------------------------- similar problem. the prebuild sparks have the snappy 1.0.5 which needs GLIBCXX_3.4.9. https://issues.apache.org/jira/browse/SPARK-4354 the servers which have lower GLIBCXX can't run the spark's executors. > snappy-1.0.5.3 needs GLIBCXX_3.4.9 > ---------------------------------- > > Key: SPARK-4511 > URL: https://issues.apache.org/jira/browse/SPARK-4511 > Project: Spark > Issue Type: Question > Affects Versions: 1.1.0 > Environment: Linux 2.6.18-371.12.1.el5 #1 SMP Wed Sep 3 16:22:34 EDT > 2014 x86_64 x86_64 x86_64 GNU/Linux > Reporter: hoelog > > executors failed with *Could not initialize class org.xerial.snappy.Snappy* > or *[FAILED_TO_LOAD_NATIVE_LIBRARY] null* errors. > I got a error message * /usr/lib64/libstdc++.so.6: version `GLIBCXX_3.4.9' > not found* when running the snappy's example code with spark's > *lib_managed/bundles/snappy-java-1.0.5.3.jar*. > how to fix it? shoud I upgrade glibc? > {code:title=snappy test code} > String input = "Hello snappy-java! Snappy-java is a JNI-based wrapper of " > + "Snappy, a fast compresser/decompresser."; > byte[] compressed = Snappy.compress(input.getBytes("UTF-8")); > byte[] uncompressed = Snappy.uncompress(compressed); > String result = new String(uncompressed, "UTF-8"); > System.out.println(result); > {code} > {panel:title=glibcxx error msg} > Caused by: java.lang.UnsatisfiedLinkError: > /tmp/snappy-1.0.5.3-94bdd15d-6841-4730-9815-4bdf7b745734-libsnappyjava.so: > /usr/lib64/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by > /tmp/snappy-1.0.5.3-94bdd15d-6841-4730-9815-4bdf7b745734-libsnappyjava.so) > at java.lang.ClassLoader$NativeLibrary.load(Native Method) > at java.lang.ClassLoader.loadLibrary1(ClassLoader.java:1965) > at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1890) > at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1851) > at java.lang.Runtime.load0(Runtime.java:795) > at java.lang.System.load(System.java:1062) > at > org.xerial.snappy.SnappyNativeLoader.load(SnappyNativeLoader.java:39) > ... 8 more > Exception in thread "main" org.xerial.snappy.SnappyError: > [FAILED_TO_LOAD_NATIVE_LIBRARY] null > at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:236) > at org.xerial.snappy.Snappy.<clinit>(Snappy.java:48) > at Snap.main(Snap.java:8) > {panel} > {panel:title=fail msg} > org.xerial.snappy.SnappyError: [FAILED_TO_LOAD_NATIVE_LIBRARY] null > org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:236) > org.xerial.snappy.Snappy.<clinit>(Snappy.java:48) > > org.xerial.snappy.SnappyInputStream.hasNextChunk(SnappyInputStream.java:351) > > org.xerial.snappy.SnappyInputStream.rawRead(SnappyInputStream.java:159) > org.xerial.snappy.SnappyInputStream.read(SnappyInputStream.java:142) > > java.io.ObjectInputStream$PeekInputStream.read(ObjectInputStream.java:2310) > > java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2323) > > java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:2794) > java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:801) > java.io.ObjectInputStream.<init>(ObjectInputStream.java:299) > > org.apache.spark.serializer.JavaDeserializationStream$$anon$1.<init>(JavaSerializer.scala:57) > {panel} > {panel:title=fail msg} > java.lang.NoClassDefFoundError: Could not initialize class > org.xerial.snappy.Snappy > > org.xerial.snappy.SnappyInputStream.hasNextChunk(SnappyInputStream.java:351) > > org.xerial.snappy.SnappyInputStream.rawRead(SnappyInputStream.java:159) > org.xerial.snappy.SnappyInputStream.read(SnappyInputStream.java:142) > > java.io.ObjectInputStream$PeekInputStream.read(ObjectInputStream.java:2310) > > java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2323) > > java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:2794) > java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:801) > java.io.ObjectInputStream.<init>(ObjectInputStream.java:299) > > org.apache.spark.serializer.JavaDeserializationStream$$anon$1.<init>(JavaSerializer.scala:57) > {panel} -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org