[
https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16933014#comment-16933014
]
huangtianhua commented on SPARK-29106:
--------------------------------------
The other important thing is about the leveldbjni
[https://github.com/fusesource/leveldbjni,|https://github.com/fusesource/leveldbjni/issues/80]
spark depends on leveldbjni-all-1.8
[https://mvnrepository.com/artifact/org.fusesource.leveldbjni/leveldbjni-all/1.8],
we can see there is no arm64 supporting. So we build an arm64 supporting
release of leveldbjni see
[https://mvnrepository.com/artifact/org.openlabtesting.leveldbjni/leveldbjni-all/1.8],
but we can't modified the spark pom.xml directly with something like
'property'/'profile' to choose correct jar package on arm or x86 platform,
because spark depends on some hadoop packages like hadoop-hdfs, the packages
depend on leveldbjni-all-1.8 too, unless hadoop release with new arm supporting
leveldbjni jar. Now we download the leveldbjni-al-1.8 of openlabtesting and
'mvn install' to use it when arm testing for spark.
> Add jenkins arm test for spark
> ------------------------------
>
> Key: SPARK-29106
> URL: https://issues.apache.org/jira/browse/SPARK-29106
> Project: Spark
> Issue Type: Test
> Components: Tests
> Affects Versions: 3.0.0
> Reporter: huangtianhua
> Priority: Minor
>
> Add arm test jobs to amplab jenkins. OpenLab will offer arm instances to
> amplab to support arm test for spark.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
