GitHub user HyukjinKwon opened a pull request:
https://github.com/apache/spark/pull/19722
[WIP][SPARK-21693][R][ML] Reduce max iterations in Linear SVM test in R to
speed up AppVeyor build
## What changes were proposed in this pull request?
This PR proposes to reduce max iteration in Linear SVM test in SparkR. This
particular test elapsed roughly 5 mins and 20+mins on Windows.
The root cause is, it triggers 2500ish jobs by the default 100 iterations.
In Linux, `daemon.R` is forked but on Windows, another process is launched,
which is extremely slow.
So, given my observation, there are many processes are ran on Windows,
which makes the differences of elapsed time.
After reducing the max iteration, the total jobs in this single test is
reduced to 550ish.
## How was this patch tested?
Manually tested.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/HyukjinKwon/spark SPARK-21693-test
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/19722.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #19722
----
commit c359644d8d52ceddbbdd0e62bdcf85f95787850d
Author: hyukjinkwon <gurwls...@gmail.com>
Date: 2017-11-11T13:13:21Z
Reduce max iterations in Linear SVM test in R to speed up AppVeyor build
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
