[
https://issues.apache.org/jira/browse/OOZIE-3639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17425481#comment-17425481
]
Dénes Bodó commented on OOZIE-3639:
-----------------------------------
Hey [~mgrigorov]
Thanks for reporting it. Oozie on ARM64 is quite new to me. Dev and test
environment are only x86_64 ones so if you are working on ARM64 environment
then please share your fix. What device do you actually have? Apple M1?
Raspberry PI? Other?
I am not sure if we have such environment to test on but if the changes you
propose to fix build and test on ARM64 do not cause regression then those
changes are very welcome.
Thanks,
Denes
> Build failure on Linux ARM64
> ----------------------------
>
> Key: OOZIE-3639
> URL: https://issues.apache.org/jira/browse/OOZIE-3639
> Project: Oozie
> Issue Type: Bug
> Components: build
> Affects Versions: 5.2.1
> Reporter: Martin Tzvetanov Grigorov
> Priority: Major
>
> Trying to build Apache Oozie on Linux ARM64 fails due:
> # An old version of snappy-java library (transitive dependency of Apache
> Spark):
> {code:java}
> [ERROR] testMain(org.apache.oozie.action.hadoop.TestSparkMain) Time elapsed:
> 3.512 s <<< ERROR!
> java.lang.IllegalArgumentException: org.xerial.snappy.SnappyError:
> [FAILED_TO_LOAD_NATIVE_LIBRARY] no native library is found for os.name=Linux
> and os.arch=aarch64
> at
> org.apache.spark.io.SnappyCompressionCodec$.liftedTree1$1(CompressionCodec.scala:171)
> at
> org.apache.spark.io.SnappyCompressionCodec$.org$apache$spark$io$SnappyCompressionCodec$$version$lzycompute(CompressionCodec.scala:168)
> at
> org.apache.spark.io.SnappyCompressionCodec$.org$apache$spark$io$SnappyCompressionCodec$$version(CompressionCodec.scala:168)
> at
> org.apache.spark.io.SnappyCompressionCodec.<init>(CompressionCodec.scala:152)
> ...
> Caused by: org.xerial.snappy.SnappyError: [FAILED_TO_LOAD_NATIVE_LIBRARY] no
> native library is found for os.name=Linux and os.arch=aarch64
> at
> org.xerial.snappy.SnappyLoader.findNativeLibrary(SnappyLoader.java:331)
> at
> org.xerial.snappy.SnappyLoader.loadNativeLibrary(SnappyLoader.java:171)
> at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:152)
> at org.xerial.snappy.Snappy.<clinit>(Snappy.java:46)
> at
> org.apache.spark.io.SnappyCompressionCodec$.liftedTree1$1(CompressionCodec.scala:169)
> ... 80 more{code}
> Adding a dependency management for snappy-java to use
> org.xerial.snappy:snappy-java:1.1.8.4 fixes it!
> 2. Test failure in TestPyspark:
> {code:java}
> [ERROR] testPyspark(org.apache.oozie.action.hadoop.TestPyspark) Time
> elapsed: 59.513 s <<< FAILURE!
> junit.framework.ComparisonFailure: expected:<[SUCCEED]ED> but
> was:<[FAILED/KILL]ED>
> at junit.framework.Assert.assertEquals(Assert.java:100)
> at junit.framework.Assert.assertEquals(Assert.java:107)
> at junit.framework.TestCase.assertEquals(TestCase.java:260)
> at
> org.apache.oozie.action.hadoop.TestPyspark.testPysparkHelper(TestPyspark.java:107)
> at
> org.apache.oozie.action.hadoop.TestPyspark.testPyspark(TestPyspark.java:85)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> ... {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
