GitHub user Leemoonsoo opened a pull request:
https://github.com/apache/zeppelin/pull/2162
[ZEPPELIN-2286] Some test matrix on Travis often exceeds time limits (50min)
### What is this PR for?
This PR optimize CI test matrix while keeping the same test coverage.
from
1. RAT (1~2min)
2. All modules with -Pbuild-distr flag, spark 2.1 and scala 2.11 (40~50min)
3. All modules with -Pbuild-distr flag, spark 2.0 and scala 2.11 (40~50min)
4. spark 1.6 and scala 2.10 (7~9min)
5. spark 1.6 and scala 2.11 (7~8min)
7. Selenium (20~23min)
8. python2 (6~7min)
9. python3 (6 ~7min)
Total. 128 ~156min
to
1. RAT (1~2min)
2. Core modules without interpreters (14~15min)
3. All interpreters except for spark, livy (9~11min)
4. Spark 2.1 and scala 2.11, livy (7~9min)
5. Spark 2.0 and scala 2.11 (7~8min)
6. Spark 1.6 and scala 2.10 (7~8min)
7. Spark 1.6 and scala 2.11 (7~8min)
8. Selenium (20~23min)
9. python2 (6~7min)
10. python3 (6 ~7min)
Total. (84 ~98min)
### What type of PR is it?
Improvement
### Todos
* [x] - Optimize CI test matrix
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-2286
### How should this be tested?
CI green
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/Leemoonsoo/zeppelin split_ci_metrics
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/zeppelin/pull/2162.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2162
----
commit eef5008464d87de98a2b31e4c8d4dcfd5b178de8
Author: Lee moon soo <[email protected]>
Date: 2017-03-19T17:16:59Z
Move out spark and livy test to separate test metrics
commit 609153bd784460cb87c7ac6fcb1d513210852aba
Author: Lee moon soo <[email protected]>
Date: 2017-03-19T17:21:22Z
Prevent download spark distribution when unnecessary
commit cb44e707d61fddd54e067c07658e29d423249f5f
Author: Lee moon soo <[email protected]>
Date: 2017-03-19T18:04:31Z
Define scala.binary.version
commit 4f2ef765963259ac123a150cdd1399aec91b7927
Author: Lee moon soo <[email protected]>
Date: 2017-03-19T18:46:48Z
set fork count 1
commit e6f59958263c846a7c95bfc33cc42a1942d34d63
Author: Lee moon soo <[email protected]>
Date: 2017-03-19T19:20:07Z
try set scala.version
commit 944711d65be7242ea6deeaeec07dce9709ebc867
Author: Lee moon soo <[email protected]>
Date: 2017-03-19T19:28:06Z
configure surefire plugin for zeppelin-server
commit efc044edcc168039ca2bcb2de1afba752a018c89
Author: Lee moon soo <[email protected]>
Date: 2017-03-19T20:23:16Z
assume spark interpreter may not exists in certain test metrics
commit 29f6629e4e4e96295afd0012e58ef05d637b3334
Author: Lee moon soo <[email protected]>
Date: 2017-03-19T20:46:27Z
include root pom in -pl
commit a31162d89404eaa98c50f3a234f86ddc9c6fc549
Author: Lee moon soo <[email protected]>
Date: 2017-03-19T21:16:14Z
Revert "assume spark interpreter may not exists in certain test metrics"
This reverts commit efc044edcc168039ca2bcb2de1afba752a018c89.
commit f9b6da5d02a1748f215b0fc66268d2989086eb79
Author: Lee moon soo <[email protected]>
Date: 2017-03-19T21:28:24Z
exclude interpreters does not reqruied by zeppelin-server integration test
commit 20c3155be7b1add66fb6451c8b311e4043504fa8
Author: Lee moon soo <[email protected]>
Date: 2017-03-19T21:33:44Z
try differnt way set global env
commit e1f28e644b0d8a9441a86eaea52aeba118f620a3
Author: Lee moon soo <[email protected]>
Date: 2017-03-19T21:38:09Z
try differnt way pass params
commit 114cea6e6cec7b45166d074659b70c39e8da35f3
Author: Lee moon soo <[email protected]>
Date: 2017-03-19T22:07:00Z
add test profile that test interpretes
commit 3c2f55fbd27dff50079a6db47e703b17a7b3eb90
Author: Lee moon soo <[email protected]>
Date: 2017-03-19T22:09:57Z
fix travis.yml
commit 293d0e19add9011954cda29ee6ba6782d71c67fd
Author: Lee moon soo <[email protected]>
Date: 2017-03-19T22:12:47Z
add missing env
commit 9fdc8817f051ca6171e59d246e9eb0f03966cbf8
Author: Lee moon soo <[email protected]>
Date: 2017-03-19T22:18:50Z
fix option
commit 9db2c7139cf832c566e46a9309c7e579a925ffd8
Author: Lee moon soo <[email protected]>
Date: 2017-03-19T22:35:56Z
fix profiles
commit da5706d6a416e997c68bd71f78f6f05861233ee5
Author: Lee moon soo <[email protected]>
Date: 2017-03-19T23:18:37Z
exclude spark test from core module test
commit b02adc828110f4dfeda2abb4deda832898d84c59
Author: Lee moon soo <[email protected]>
Date: 2017-03-19T23:55:53Z
other way to exclude spark from core module test
commit 5179f88d1e870ccab0e903fd3b921c5706e451c7
Author: Lee moon soo <[email protected]>
Date: 2017-03-20T01:14:50Z
set livy 0.3 explicitly
commit 8af7f38f75fe1d15600a6878025d2d464a4af61c
Author: Lee moon soo <[email protected]>
Date: 2017-03-20T01:20:51Z
try exclude test in different way
commit f11b4f12dc3a4c572c1054cc4fcc98648d4d7f00
Author: Lee moon soo <[email protected]>
Date: 2017-03-20T01:39:05Z
add -DfailIfNoTests=false
commit 410899ad548015b7ef9589ce47a6eecde1c3310f
Author: Lee moon soo <[email protected]>
Date: 2017-03-20T02:58:19Z
remove explicit LIVY_VER
commit 61acecf4d216bba37d5224e028512027de689759
Author: Lee moon soo <[email protected]>
Date: 2017-03-20T03:04:07Z
Livy 0.2 test does not work
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
