[
https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
huangtianhua updated SPARK-29106:
---------------------------------
Description:
Add arm test jobs to amplab jenkins for spark.
Till now we made two arm test periodic jobs for spark in OpenLab, one is based
on master with hadoop 2.7(similar with QA test of amplab jenkins), other one is
based on a new branch which we made on date 09-09, see
[http://status.openlabtesting.org/builds/job/spark-master-unit-test-hadoop-2.7-arm64]
and
[http://status.openlabtesting.org/builds/job/spark-unchanged-branch-unit-test-hadoop-2.7-arm64.|http://status.openlabtesting.org/builds/job/spark-unchanged-branch-unit-test-hadoop-2.7-arm64]
We only have to care about the first one when integrate arm test with amplab
jenkins.
About the k8s test on arm, we have took test it, see
[https://github.com/theopenlab/spark/pull/17], maybe we can integrate it later.
And we plan test on other stable branches too, and we can integrate them to
amplab when they are ready.
We have offered an arm instance and sent the infos to shane knapp, thanks shane
to add the first arm job to amplab jenkins :)
ps: the issues found and fixed list:
SPARK-28770
[https://github.com/apache/spark/pull/25673]
SPARK-28519
[https://github.com/apache/spark/pull/25279]
SPARK-28433
[https://github.com/apache/spark/pull/25186]
was:
Add arm test jobs to amplab jenkins for spark.
Till now we made two arm test periodic jobs for spark in OpenLab, one is based
on master with hadoop 2.7(similar with QA test of amplab jenkins), other one is
based on a new branch which we made on date 09-09, see
[http://status.openlabtesting.org/builds/job/spark-master-unit-test-hadoop-2.7-arm64]
and
[http://status.openlabtesting.org/builds/job/spark-unchanged-branch-unit-test-hadoop-2.7-arm64.|http://status.openlabtesting.org/builds/job/spark-unchanged-branch-unit-test-hadoop-2.7-arm64]
We only have to care about the first one when integrate arm test with amplab
jenkins.
About the k8s test on arm, we have took test it, see
[https://github.com/theopenlab/spark/pull/17], maybe we can integrate it later.
And we plan test on other stable branches too, and we can integrate them to
amplab when they are ready.
We have offered an arm instance and sent the infos to shane knapp, thanks shane
to add the first arm job to amplab jenkins :)
ps: the issues found and fixed list:
SPARK-28770
[https://github.com/apache/spark/pull/25673]
SPARK-28519
[https://github.com/apache/spark/pull/25279]
SPARK-28433
[https://github.com/apache/spark/pull/25186]
> Add jenkins arm test for spark
> ------------------------------
>
> Key: SPARK-29106
> URL: https://issues.apache.org/jira/browse/SPARK-29106
> Project: Spark
> Issue Type: Test
> Components: Tests
> Affects Versions: 3.0.0
> Reporter: huangtianhua
> Priority: Minor
>
> Add arm test jobs to amplab jenkins for spark.
> Till now we made two arm test periodic jobs for spark in OpenLab, one is
> based on master with hadoop 2.7(similar with QA test of amplab jenkins),
> other one is based on a new branch which we made on date 09-09, see
> [http://status.openlabtesting.org/builds/job/spark-master-unit-test-hadoop-2.7-arm64]
> and
> [http://status.openlabtesting.org/builds/job/spark-unchanged-branch-unit-test-hadoop-2.7-arm64.|http://status.openlabtesting.org/builds/job/spark-unchanged-branch-unit-test-hadoop-2.7-arm64]
> We only have to care about the first one when integrate arm test with amplab
> jenkins.
> About the k8s test on arm, we have took test it, see
> [https://github.com/theopenlab/spark/pull/17], maybe we can integrate it
> later. And we plan test on other stable branches too, and we can integrate
> them to amplab when they are ready.
> We have offered an arm instance and sent the infos to shane knapp, thanks
> shane to add the first arm job to amplab jenkins :)
> ps: the issues found and fixed list:
> SPARK-28770
> [https://github.com/apache/spark/pull/25673]
>
> SPARK-28519
> [https://github.com/apache/spark/pull/25279]
>
> SPARK-28433
> [https://github.com/apache/spark/pull/25186]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
