[6/7] spark git commit: [SPARK-20877][SPARKR] refactor tests to basic tests only for CRAN

2017-06-11 Thread felixcheung
http://git-wip-us.apache.org/repos/asf/spark/blob/0b0be47e/R/pkg/inst/tests/testthat/test_mllib_regression.R -- diff --git a/R/pkg/inst/tests/testthat/test_mllib_regression.R b/R/pkg/inst/tests/testthat/test_mllib_regression.R

[4/7] spark git commit: [SPARK-20877][SPARKR] refactor tests to basic tests only for CRAN

2017-06-11 Thread felixcheung
http://git-wip-us.apache.org/repos/asf/spark/blob/0b0be47e/R/pkg/inst/tests/testthat/test_streaming.R -- diff --git a/R/pkg/inst/tests/testthat/test_streaming.R b/R/pkg/inst/tests/testthat/test_streaming.R deleted file mode

[4/7] spark git commit: [SPARK-20877][SPARKR] refactor tests to basic tests only for CRAN

2017-06-11 Thread felixcheung
http://git-wip-us.apache.org/repos/asf/spark/blob/dc4c3518/R/pkg/inst/tests/testthat/test_streaming.R -- diff --git a/R/pkg/inst/tests/testthat/test_streaming.R b/R/pkg/inst/tests/testthat/test_streaming.R deleted file mode

[5/7] spark git commit: [SPARK-20877][SPARKR] refactor tests to basic tests only for CRAN

2017-06-11 Thread felixcheung
http://git-wip-us.apache.org/repos/asf/spark/blob/0b0be47e/R/pkg/inst/tests/testthat/test_sparkSQL.R -- diff --git a/R/pkg/inst/tests/testthat/test_sparkSQL.R b/R/pkg/inst/tests/testthat/test_sparkSQL.R deleted file mode 100644

[1/7] spark git commit: [SPARK-20877][SPARKR] refactor tests to basic tests only for CRAN

2017-06-11 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.2 815a0820b -> 0b0be47e7 http://git-wip-us.apache.org/repos/asf/spark/blob/0b0be47e/R/pkg/tests/fulltests/test_streaming.R -- diff --git

[5/7] spark git commit: [SPARK-20877][SPARKR] refactor tests to basic tests only for CRAN

2017-06-11 Thread felixcheung
http://git-wip-us.apache.org/repos/asf/spark/blob/dc4c3518/R/pkg/inst/tests/testthat/test_sparkSQL.R -- diff --git a/R/pkg/inst/tests/testthat/test_sparkSQL.R b/R/pkg/inst/tests/testthat/test_sparkSQL.R deleted file mode 100644

[7/7] spark git commit: [SPARK-20877][SPARKR] refactor tests to basic tests only for CRAN

2017-06-11 Thread felixcheung
not run them) ## How was this patch tested? - [x] unit tests, Jenkins - [x] AppVeyor - [x] make a source package, install it, `R CMD check` it - verify the full tests are not installed or run Author: Felix Cheung <felixcheun...@hotmail.com> Closes #18264 from felixcheung/rtestset. Project

[2/7] spark git commit: [SPARK-20877][SPARKR] refactor tests to basic tests only for CRAN

2017-06-11 Thread felixcheung
http://git-wip-us.apache.org/repos/asf/spark/blob/0b0be47e/R/pkg/tests/fulltests/test_sparkSQL.R -- diff --git a/R/pkg/tests/fulltests/test_sparkSQL.R b/R/pkg/tests/fulltests/test_sparkSQL.R new file mode 100644 index

[7/7] spark git commit: [SPARK-20877][SPARKR] refactor tests to basic tests only for CRAN

2017-06-11 Thread felixcheung
not run them) ## How was this patch tested? - [x] unit tests, Jenkins - [x] AppVeyor - [x] make a source package, install it, `R CMD check` it - verify the full tests are not installed or run Author: Felix Cheung <felixcheun...@hotmail.com> Closes #18264 from felixcheung/rtestset. (cherry

[6/7] spark git commit: [SPARK-20877][SPARKR] refactor tests to basic tests only for CRAN

2017-06-11 Thread felixcheung
http://git-wip-us.apache.org/repos/asf/spark/blob/dc4c3518/R/pkg/inst/tests/testthat/test_mllib_regression.R -- diff --git a/R/pkg/inst/tests/testthat/test_mllib_regression.R b/R/pkg/inst/tests/testthat/test_mllib_regression.R

spark git commit: [SPARK-20877][SPARKR][FOLLOWUP] clean up after test move

2017-06-11 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.2 0b0be47e7 -> 26003de55 [SPARK-20877][SPARKR][FOLLOWUP] clean up after test move clean up after big test move unit tests, jenkins Author: Felix Cheung <felixcheun...@hotmail.com> Closes #18267 from felixcheung/rtestset2.

spark git commit: [SPARK-20877][SPARKR][FOLLOWUP] clean up after test move

2017-06-11 Thread felixcheung
ung <felixcheun...@hotmail.com> Closes #18267 from felixcheung/rtestset2. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/9f4ff955 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/9f4ff955 Diff: http://git-wip-us.a

spark git commit: [SPARK-20015][SPARKR][SS][DOC][EXAMPLE] Document R Structured Streaming (experimental) in R vignettes and R & SS programming guide, R example

2017-05-04 Thread felixcheung
ide - R example Also disable spark.als in vignettes for now since it's failing (SPARK-20402) manually Author: Felix Cheung <felixcheun...@hotmail.com> Closes #17814 from felixcheung/rdocss. (cherry picked from commit b8302ccd02265f9d7a7895c7b033441fa2d8ffd1) Signed-off-by: Felix Che

spark git commit: [SPARK-20571][SPARKR][SS] Flaky Structured Streaming tests

2017-05-04 Thread felixcheung
ely the flakiness from processing delay when Jenkins is hard to account for. This isn't an actual public API supported ## How was this patch tested? unit tests Author: Felix Cheung <felixcheun...@hotmail.com> Closes #17857 from felixcheung/rsstestrelia. Project: http://git-wip-us.a

spark git commit: [SPARK-20571][SPARKR][SS] Flaky Structured Streaming tests

2017-05-04 Thread felixcheung
elp but ultimately the flakiness from processing delay when Jenkins is hard to account for. This isn't an actual public API supported ## How was this patch tested? unit tests Author: Felix Cheung <felixcheun...@hotmail.com> Closes #17857 from felixcheung/rsstestrelia. (cherry picked fr

spark git commit: [SPARK-20585][SPARKR] R generic hint support

2017-05-04 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.2 6c5c594b7 -> 3f5c54812 [SPARK-20585][SPARKR] R generic hint support Adds support for generic hints on `SparkDataFrame` Unit tests, `check-cran.sh` Author: zero323 Closes #17851 from

spark git commit: [SPARK-20585][SPARKR] R generic hint support

2017-05-04 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master b8302ccd0 -> 9c36aa279 [SPARK-20585][SPARKR] R generic hint support ## What changes were proposed in this pull request? Adds support for generic hints on `SparkDataFrame` ## How was this patch tested? Unit tests, `check-cran.sh`

spark git commit: [SPARK-20544][SPARKR] R wrapper for input_file_name

2017-05-04 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 9c36aa279 -> f21897fc1 [SPARK-20544][SPARKR] R wrapper for input_file_name ## What changes were proposed in this pull request? Adds wrapper for `o.a.s.sql.functions.input_file_name` ## How was this patch tested? Existing unit tests,

spark git commit: [SPARK-20015][SPARKR][SS][DOC][EXAMPLE] Document R Structured Streaming (experimental) in R vignettes and R & SS programming guide, R example

2017-05-04 Thread felixcheung
gnettes - R programming guide - SS programming guide - R example Also disable spark.als in vignettes for now since it's failing (SPARK-20402) ## How was this patch tested? manually Author: Felix Cheung <felixcheun...@hotmail.com> Closes #17814 from felixcheung/rdocss. Project: h

spark git commit: [SPARKR][DOC] fix typo in vignettes

2017-05-08 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.2 6c5b7e106 -> d8a5a0d34 [SPARKR][DOC] fix typo in vignettes ## What changes were proposed in this pull request? Fix typo in vignettes Author: Wayne Zhang Closes #17884 from actuaryzhang/typo. (cherry picked

spark git commit: [SPARKR][DOC] fix typo in vignettes

2017-05-08 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 42cc6d13e -> 2fdaeb52b [SPARKR][DOC] fix typo in vignettes ## What changes were proposed in this pull request? Fix typo in vignettes Author: Wayne Zhang Closes #17884 from actuaryzhang/typo. Project:

spark git commit: [SPARK-20550][SPARKR] R wrapper for Dataset.alias

2017-05-07 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 500436b43 -> 1f73d3589 [SPARK-20550][SPARKR] R wrapper for Dataset.alias ## What changes were proposed in this pull request? - Add SparkR wrapper for `Dataset.alias`. - Adjust roxygen annotations for `functions.alias` (including example

spark git commit: [SPARK-20543][SPARKR][FOLLOWUP] Don't skip tests on AppVeyor

2017-05-07 Thread felixcheung
ung <felixcheun...@hotmail.com> Closes #17878 from felixcheung/appveyorrcran. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/7087e011 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/7087e011 Diff: http://git-wip-us.apache.

spark git commit: [SPARK-20543][SPARKR][FOLLOWUP] Don't skip tests on AppVeyor

2017-05-07 Thread felixcheung
ung <felixcheun...@hotmail.com> Closes #17878 from felixcheung/appveyorrcran. (cherry picked from commit 7087e01194964a1aad0b45bdb41506a17100eacf) Signed-off-by: Felix Cheung <felixche...@apache.org> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apach

spark git commit: [SPARK-20626][SPARKR] address date test warning with timezone on windows

2017-05-08 Thread felixcheung
lix Cheung <felixcheun...@hotmail.com> Closes #17892 from felixcheung/rtimestamptest. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c24bdaab Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/c24bdaab Diff: http:

spark git commit: [SPARK-20626][SPARKR] address date test warning with timezone on windows

2017-05-08 Thread felixcheung
hor: Felix Cheung <felixcheun...@hotmail.com> Closes #17892 from felixcheung/rtimestamptest. (cherry picked from commit c24bdaab5a234d18b273544cefc44cc4005bf8fc) Signed-off-by: Felix Cheung <felixche...@apache.org> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [SPARK-20490][SPARKR] Add R wrappers for eqNullSafe and ! / not

2017-04-30 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 6613046c8 -> 80e9cf1b5 [SPARK-20490][SPARKR] Add R wrappers for eqNullSafe and ! / not ## What changes were proposed in this pull request? - Add null-safe equality operator `%<=>%` (sames as `o.a.s.sql.Column.eqNullSafe`,

spark git commit: [SPARK-20541][SPARKR][SS] support awaitTermination without timeout

2017-05-01 Thread felixcheung
eed this for 2.2 ## How was this patch tested? manually, unit test Author: Felix Cheung <felixcheun...@hotmail.com> Closes #17815 from felixcheung/rssawaitinfinite. (cherry picked from commit a355b667a3718d9c5d48a0781e836bf5418ab842) Signed-off-by: Felix Cheung <felixche...@apache.or

spark git commit: [SPARK-20541][SPARKR][SS] support awaitTermination without timeout

2017-05-01 Thread felixcheung
eed this for 2.2 ## How was this patch tested? manually, unit test Author: Felix Cheung <felixcheun...@hotmail.com> Closes #17815 from felixcheung/rssawaitinfinite. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/a355

spark git commit: [SPARK-20535][SPARKR] R wrappers for explode_outer and posexplode_outer

2017-04-30 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 1ee494d08 -> ae3df4e98 [SPARK-20535][SPARKR] R wrappers for explode_outer and posexplode_outer ## What changes were proposed in this pull request? Ad R wrappers for - `o.a.s.sql.functions.explode_outer` -

spark git commit: [MINOR][DOCS][PYTHON] Adding missing boolean type for replacement value in fillna

2017-04-30 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master ae3df4e98 -> 6613046c8 [MINOR][DOCS][PYTHON] Adding missing boolean type for replacement value in fillna ## What changes were proposed in this pull request? Currently pyspark Dataframe.fillna API supports boolean type when we pass dict,

spark git commit: [MINOR][DOCS][PYTHON] Adding missing boolean type for replacement value in fillna

2017-04-30 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.2 c5beabcbd -> 994d9da90 [MINOR][DOCS][PYTHON] Adding missing boolean type for replacement value in fillna ## What changes were proposed in this pull request? Currently pyspark Dataframe.fillna API supports boolean type when we pass

spark git commit: [SPARK-20192][SPARKR][DOC] SparkR migration guide to 2.2.0

2017-05-01 Thread felixcheung
ung <felixcheun...@hotmail.com> Closes #17816 from felixcheung/r22relnote. (cherry picked from commit d20a976e8918ca8d607af452301e8014fe14e64a) Signed-off-by: Felix Cheung <felixche...@apache.org> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/

spark git commit: [SPARK-20192][SPARKR][DOC] SparkR migration guide to 2.2.0

2017-05-01 Thread felixcheung
xcheun...@hotmail.com> Closes #17816 from felixcheung/r22relnote. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d20a976e Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/d20a976e Diff: http://git-wip-us.apache.org/

spark git commit: [SPARK-20532][SPARKR] Implement grouping and grouping_id

2017-05-01 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master d20a976e8 -> 90d77e971 [SPARK-20532][SPARKR] Implement grouping and grouping_id ## What changes were proposed in this pull request? Adds R wrappers for: - `o.a.s.sql.functions.grouping` as `o.a.s.sql.functions.is_grouping` (to avoid

spark git commit: [SPARK-20613] Remove excess quotes in Windows executable

2017-05-05 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.2 dbb54a7b3 -> 1fa3c86a7 [SPARK-20613] Remove excess quotes in Windows executable ## What changes were proposed in this pull request? Quotes are already added to the RUNNER variable on line 54. There is no need to put quotes on line

spark git commit: [SPARK-20613] Remove excess quotes in Windows executable

2017-05-05 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 9064f1b04 -> b9ad2d191 [SPARK-20613] Remove excess quotes in Windows executable ## What changes were proposed in this pull request? Quotes are already added to the RUNNER variable on line 54. There is no need to put quotes on line 67. If

spark git commit: [SPARK-20613] Remove excess quotes in Windows executable

2017-05-05 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.1 179f5370e -> 2a7f5dae5 [SPARK-20613] Remove excess quotes in Windows executable ## What changes were proposed in this pull request? Quotes are already added to the RUNNER variable on line 54. There is no need to put quotes on line

spark git commit: [SPARK-20208][DOCS][FOLLOW-UP] Add FP-Growth to SparkR programming guide

2017-05-05 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.2 1d9b7a74a -> 423a78625 [SPARK-20208][DOCS][FOLLOW-UP] Add FP-Growth to SparkR programming guide ## What changes were proposed in this pull request? Add `spark.fpGrowth` to SparkR programming guide. ## How was this patch tested?

spark git commit: [SPARK-20614][PROJECT INFRA] Use the same log4j configuration with Jenkins in AppVeyor

2017-05-05 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 5d75b14bf -> b433acae7 [SPARK-20614][PROJECT INFRA] Use the same log4j configuration with Jenkins in AppVeyor ## What changes were proposed in this pull request? Currently, there are flooding logs in AppVeyor (in the console). This has

spark git commit: [SPARK-20490][SPARKR][DOC] add family tag for not function

2017-05-02 Thread felixcheung
il.com> Closes #17828 from felixcheung/rnotfamily. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/13f47dc5 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/13f47dc5 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff

spark git commit: [SPARK-20543][SPARKR] skip tests when running on CRAN

2017-05-03 Thread felixcheung
ing, hivecontext) - tests on error conditions - tests won't likely change/break ## How was this patch tested? unit tests, `R CMD check --as-cran`, `R CMD check` Author: Felix Cheung <felixcheun...@hotmail.com> Closes #17817 from felixcheung/rskiptest. Project: http://git-wip-us.apache.org/repos/

spark git commit: [SPARK-20544][SPARKR] skip tests when running on CRAN

2017-05-03 Thread felixcheung
n't likely change/break unit tests, `R CMD check --as-cran`, `R CMD check` Author: Felix Cheung <felixcheun...@hotmail.com> Closes #17817 from felixcheung/rskiptest. (cherry picked from commit fc472bddd1d9c6a28e57e31496c0166777af597e) Signed-off-by: Felix Cheung <felixche...@apache.org>

spark git commit: [SPARK-20736][PYTHON] PySpark StringIndexer supports StringOrderType

2017-05-21 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 9d6661c82 -> 0f2f56c37 [SPARK-20736][PYTHON] PySpark StringIndexer supports StringOrderType ## What changes were proposed in this pull request? PySpark StringIndexer supports StringOrderType added in #17879. Author: Wayne Zhang

spark git commit: [SPARK-20889][SPARKR] Grouped documentation for MATH column methods

2017-06-28 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 2d686a19e -> e793bf248 [SPARK-20889][SPARKR] Grouped documentation for MATH column methods ## What changes were proposed in this pull request? Grouped documentation for math column methods. Author: actuaryzhang

spark git commit: [SPARK-21128][R][BACKPORT-2.2] Remove both "spark-warehouse" and "metastore_db" before listing files in R tests

2017-09-08 Thread felixcheung
...... ..

spark git commit: [SPARK-21801][SPARKR][TEST] unit test randomly fail with randomforest

2017-08-29 Thread felixcheung
ins, appveyor, lots more jenkins Author: Felix Cheung <felixcheun...@hotmail.com> Closes #19018 from felixcheung/rrftest. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/6077e3ef Tree: http://git-wip-us.apache.org/repos/asf/s

[3/9] spark git commit: [SPARKR][BACKPORT-2.1] backporting package and test changes

2017-09-10 Thread felixcheung
http://git-wip-us.apache.org/repos/asf/spark/blob/ae4e8ae4/R/pkg/tests/fulltests/test_shuffle.R -- diff --git a/R/pkg/tests/fulltests/test_shuffle.R b/R/pkg/tests/fulltests/test_shuffle.R new file mode 100644 index

[1/9] spark git commit: [SPARKR][BACKPORT-2.1] backporting package and test changes

2017-09-10 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.1 6a8a726f3 -> ae4e8ae41 http://git-wip-us.apache.org/repos/asf/spark/blob/ae4e8ae4/R/pkg/tests/fulltests/test_take.R -- diff --git a/R/pkg/tests/fulltests/test_take.R

[6/9] spark git commit: [SPARKR][BACKPORT-2.1] backporting package and test changes

2017-09-10 Thread felixcheung
http://git-wip-us.apache.org/repos/asf/spark/blob/ae4e8ae4/R/pkg/inst/tests/testthat/test_sparkSQL.R -- diff --git a/R/pkg/inst/tests/testthat/test_sparkSQL.R b/R/pkg/inst/tests/testthat/test_sparkSQL.R deleted file mode 100644

[2/9] spark git commit: [SPARKR][BACKPORT-2.1] backporting package and test changes

2017-09-10 Thread felixcheung
http://git-wip-us.apache.org/repos/asf/spark/blob/ae4e8ae4/R/pkg/tests/fulltests/test_sparkSQL.R -- diff --git a/R/pkg/tests/fulltests/test_sparkSQL.R b/R/pkg/tests/fulltests/test_sparkSQL.R new file mode 100644 index

[8/9] spark git commit: [SPARKR][BACKPORT-2.1] backporting package and test changes

2017-09-10 Thread felixcheung
http://git-wip-us.apache.org/repos/asf/spark/blob/ae4e8ae4/R/pkg/inst/tests/testthat/test_mllib.R -- diff --git a/R/pkg/inst/tests/testthat/test_mllib.R b/R/pkg/inst/tests/testthat/test_mllib.R deleted file mode 100644 index

[4/9] spark git commit: [SPARKR][BACKPORT-2.1] backporting package and test changes

2017-09-10 Thread felixcheung
http://git-wip-us.apache.org/repos/asf/spark/blob/ae4e8ae4/R/pkg/tests/fulltests/test_mllib.R -- diff --git a/R/pkg/tests/fulltests/test_mllib.R b/R/pkg/tests/fulltests/test_mllib.R new file mode 100644 index 000..8fe3a87 ---

[5/9] spark git commit: [SPARKR][BACKPORT-2.1] backporting package and test changes

2017-09-10 Thread felixcheung
http://git-wip-us.apache.org/repos/asf/spark/blob/ae4e8ae4/R/pkg/inst/tests/testthat/test_take.R -- diff --git a/R/pkg/inst/tests/testthat/test_take.R b/R/pkg/inst/tests/testthat/test_take.R deleted file mode 100644 index

[7/9] spark git commit: [SPARKR][BACKPORT-2.1] backporting package and test changes

2017-09-10 Thread felixcheung
http://git-wip-us.apache.org/repos/asf/spark/blob/ae4e8ae4/R/pkg/inst/tests/testthat/test_shuffle.R -- diff --git a/R/pkg/inst/tests/testthat/test_shuffle.R b/R/pkg/inst/tests/testthat/test_shuffle.R deleted file mode 100644

[9/9] spark git commit: [SPARKR][BACKPORT-2.1] backporting package and test changes

2017-09-10 Thread felixcheung
m> Author: Wayne Zhang <actuaryzh...@uber.com> Closes #19165 from felixcheung/rbackportpkg21. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ae4e8ae4 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/ae4e8ae

spark git commit: [SPARK-21801][SPARKR][TEST] set random seed for predictable test

2017-09-06 Thread felixcheung
lix Cheung <felixcheun...@hotmail.com> Closes #19111 from felixcheung/rranseed. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/36b48ee6 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/36b48ee6 Diff: http:

spark git commit: [SPARK-21584][SQL][SPARKR] Update R method for summary to call new implementation

2017-08-22 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 751f51336 -> 5c9b30172 [SPARK-21584][SQL][SPARKR] Update R method for summary to call new implementation ## What changes were proposed in this pull request? SPARK-21100 introduced a new `summary` method to the Scala/Java Dataset API

spark git commit: [SPARK-21805][SPARKR] Disable R vignettes code on Windows

2017-08-23 Thread felixcheung
.0.tar.gz-86a066c7576f46794930ad114e5cff7c/SparkR.Rcheck/00check.log Author: Felix Cheung <felixcheun...@hotmail.com> Closes #19016 from felixcheung/rvigwind. (cherry picked from commit 43cbfad9992624d89bbb3209d1f5b765c7947bb9) Signed-off-by: Felix Cheung <felixche...@apache.org> Pr

spark git commit: [SPARK-21805][SPARKR] Disable R vignettes code on Windows

2017-08-23 Thread felixcheung
.0.tar.gz-86a066c7576f46794930ad114e5cff7c/SparkR.Rcheck/00check.log Author: Felix Cheung <felixcheun...@hotmail.com> Closes #19016 from felixcheung/rvigwind. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/43cbfad9 Tree:

spark git commit: [SPARK-22442][SQL][BRANCH-2.2] ScalaReflection should produce correct field names for special characters

2017-11-12 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.2 8acd02f42 -> f73637798 [SPARK-22442][SQL][BRANCH-2.2] ScalaReflection should produce correct field names for special characters ## What changes were proposed in this pull request? For a class with field name of special characters,

[2/2] spark git commit: fix typo

2017-11-24 Thread felixcheung
fix typo Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c3b5df22 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/c3b5df22 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/c3b5df22 Branch:

[1/2] spark git commit: [SPARK-22495] Fix setup of SPARK_HOME variable on Windows

2017-11-24 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.2 ad57141f9 -> c3b5df22a [SPARK-22495] Fix setup of SPARK_HOME variable on Windows ## What changes were proposed in this pull request? This is a cherry pick of the original PR 19370 onto branch-2.2 as suggested in

[2/2] spark git commit: Preparing development version 2.2.2-SNAPSHOT

2017-11-24 Thread felixcheung
Preparing development version 2.2.2-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/455cea62 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/455cea62 Diff:

[1/2] spark git commit: Preparing Spark release v2.2.1-rc2

2017-11-24 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.2 c3b5df22a -> 455cea622 Preparing Spark release v2.2.1-rc2 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/e30e2698 Tree:

[spark] Git Push Summary

2017-11-24 Thread felixcheung
Repository: spark Updated Tags: refs/tags/v2.2.1-rc2 [created] e30e2698a - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

svn commit: r23279 - in /dev/spark/spark-2.2.1-rc2-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _site/api/java/org/apache/

2017-11-24 Thread felixcheung
Author: felixcheung Date: Sat Nov 25 03:01:04 2017 New Revision: 23279 Log: Apache Spark spark-2.2.1-rc2 docs [This commit notification would consist of 1388 parts, which exceeds the limit of 50 ones, so it was shortened to the summary

svn commit: r23278 - /dev/spark/spark-2.2.1-rc2-bin/

2017-11-24 Thread felixcheung
Author: felixcheung Date: Sat Nov 25 02:44:26 2017 New Revision: 23278 Log: Apache Spark spark-2.2.1-rc2 Added: dev/spark/spark-2.2.1-rc2-bin/ dev/spark/spark-2.2.1-rc2-bin/SparkR_2.2.1.tar.gz (with props) dev/spark/spark-2.2.1-rc2-bin/SparkR_2.2.1.tar.gz.asc dev/spark/spark

spark git commit: [SPARK-22344][SPARKR] clean up install dir if running test as source package

2017-11-10 Thread felixcheung
tested? manually by building package Jenkins, AppVeyor Author: Felix Cheung <felixcheun...@hotmail.com> Closes #19657 from felixcheung/rinstalldir. (cherry picked from commit b70aa9e08b4476746e912c2c2a8b7bdd102305e8) Signed-off-by: Felix Cheung <felixche...@apache.org> Project: http://gi

svn commit: r23090 - in /dev/spark: ./ spark-2.2.1-rc1-bin/ spark-2.2.1-rc1-docs/ spark-2.2.1-rc1-docs/_site/ spark-2.2.1-rc1-docs/_site/api/ spark-2.2.1-rc1-docs/_site/api/R/ spark-2.2.1-rc1-docs/_si

2017-11-13 Thread felixcheung
Author: felixcheung Date: Tue Nov 14 04:30:04 2017 New Revision: 23090 Log: Apache Spark spark-2.2.1-rc1 [This commit notification would consist of 1388 parts, which exceeds the limit of 50 ones, so it was shortened to the summary

[spark] Git Push Summary

2017-11-13 Thread felixcheung
Repository: spark Updated Tags: refs/tags/v2.2.1-rc1 [deleted] 124b9a106 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[2/2] spark git commit: Preparing development version 2.2.2-SNAPSHOT

2017-11-13 Thread felixcheung
Preparing development version 2.2.2-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/b1f8c84e Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/b1f8c84e Diff:

[spark] Git Push Summary

2017-11-13 Thread felixcheung
Repository: spark Updated Tags: refs/tags/v2.2.1-rc1 [created] 124b9a106 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[1/2] spark git commit: Preparing Spark release v2.2.1-rc1

2017-11-13 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.2 c68b4c54f -> b1f8c84ef Preparing Spark release v2.2.1-rc1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/124b9a10 Tree:

[spark] Git Push Summary [forced push!] [Forced Update!]

2017-11-13 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.2 b1f8c84ef -> c68b4c54f (forced update) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[2/2] spark git commit: Preparing development version 2.2.2-SNAPSHOT

2017-11-13 Thread felixcheung
Preparing development version 2.2.2-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/af0b1855 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/af0b1855 Diff:

[1/2] spark git commit: Preparing Spark release v2.2.1-rc1

2017-11-13 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.2 c68b4c54f -> af0b1855f Preparing Spark release v2.2.1-rc1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/41116ab7 Tree:

[spark] Git Push Summary

2017-11-13 Thread felixcheung
Repository: spark Updated Tags: refs/tags/v2.2.1-rc1 [created] 41116ab7f - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-19606][BUILD][BACKPORT-2.2][MESOS] fix mesos break

2017-11-12 Thread felixcheung
xcheun...@hotmail.com> Closes #19732 from felixcheung/fixmesosdriverconstraint. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/2a04cfaa Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/2a04cfaa Diff: http:

spark git commit: [SPARK-19606][MESOS] Support constraints in spark-dispatcher

2017-11-12 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 21a7bfd5c -> b3f9dbf48 [SPARK-19606][MESOS] Support constraints in spark-dispatcher ## What changes were proposed in this pull request? A discussed in SPARK-19606, the addition of a new config property named

spark git commit: [SPARK-19606][MESOS] Support constraints in spark-dispatcher

2017-11-12 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.2 4ef0bef9e -> f6ee3d90d [SPARK-19606][MESOS] Support constraints in spark-dispatcher A discussed in SPARK-19606, the addition of a new config property named "spark.mesos.constraints.driver" for constraining drivers running on a Mesos

spark git commit: [SPARK-21693][R][ML] Reduce max iterations in Linear SVM test in R to speed up AppVeyor build

2017-11-12 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 9bf696dbe -> 3d90b2cb3 [SPARK-21693][R][ML] Reduce max iterations in Linear SVM test in R to speed up AppVeyor build ## What changes were proposed in this pull request? This PR proposes to reduce max iteration in Linear SVM test in

spark git commit: [SPARK-22327][SPARKR][TEST][BACKPORT-2.2] check for version warning

2017-11-07 Thread felixcheung
ted? manually Jenkins, AppVeyor Author: Felix Cheung <felixcheun...@hotmail.com> Closes #19619 from felixcheung/rcranversioncheck22. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/5c9035bb Tree: http://git-wip-us.a

spark git commit: [SPARK-22327][SPARKR][TEST][BACKPORT-2.1] check for version warning

2017-11-07 Thread felixcheung
ted? manually Jenkins, AppVeyor Author: Felix Cheung <felixcheun...@hotmail.com> Closes #19620 from felixcheung/rcranversioncheck21. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ca19271c Tree: http://git-wip-us.a

spark git commit: [SPARK-22281][SPARKR] Handle R method breaking signature changes

2017-11-07 Thread felixcheung
e are changing to call dynamically. ## How was this patch tested? Manually. - [x] check documentation output - yes - [x] check help `?attach` `?glm` - yes - [x] check on other platforms, r-hub, on r-devel etc.. Author: Felix Cheung <felixcheun...@hotmail.com> Closes #19557 from felixcheung/rattachglm

spark git commit: [SPARK-22281][SPARKR] Handle R method breaking signature changes

2017-11-07 Thread felixcheung
e are changing to call dynamically. ## How was this patch tested? Manually. - [x] check documentation output - yes - [x] check help `?attach` `?glm` - yes - [x] check on other platforms, r-hub, on r-devel etc.. Author: Felix Cheung <felixcheun...@hotmail.com> Closes #19557 from felixcheun

[spark] Git Push Summary

2017-12-06 Thread felixcheung
Repository: spark Updated Tags: refs/tags/v2.2.1 [created] e30e2698a - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-22327][SPARKR][TEST] check for version warning

2017-10-30 Thread felixcheung
ins, AppVeyor Author: Felix Cheung <felixcheun...@hotmail.com> Closes #19549 from felixcheung/rcranversioncheck. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ded3ed97 Tree: http://git-wip-us.apache.org/repos/asf/s

spark git commit: [SPARK-22327][SPARKR][TEST][BACKPORT-2.0] check for version warning

2017-10-30 Thread felixcheung
as this patch tested? manually Jenkins, AppVeyor Author: Felix Cheung <felixcheun...@hotmail.com> Closes #19550 from felixcheung/rcranversioncheck20. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/076c2f6a T

spark git commit: [SPARK-23780][R] Failed to use googleVis library with new SparkR

2018-05-14 Thread felixcheung
ted? manual test, unit tests Author: Felix Cheung <felixcheun...@hotmail.com> Closes #21315 from felixcheung/googvis. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/9059f1ee Tree: http://git-wip-us.apache.org/repos/asf/s

spark git commit: [SPARK-23780][R] Failed to use googleVis library with new SparkR

2018-05-14 Thread felixcheung
ted? manual test, unit tests Author: Felix Cheung <felixcheun...@hotmail.com> Closes #21315 from felixcheung/googvis. (cherry picked from commit 9059f1ee6ae13c8636c9b7fdbb708a349256fb8e) Signed-off-by: Felix Cheung <felixche...@apache.org> Project: http://git-wip-us.apache.org/repos

spark git commit: [R][BACKPORT-2.2] backport lint fix

2018-05-15 Thread felixcheung
es #21325 from felixcheung/rlintfix22. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/8c223b65 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/8c223b65 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/8c223b65 Bra

spark git commit: [SPARK-24331][SPARKR][SQL] Adding arrays_overlap, array_repeat, map_entries to SparkR

2018-05-30 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master f48938800 -> a4be981c0 [SPARK-24331][SPARKR][SQL] Adding arrays_overlap, array_repeat, map_entries to SparkR ## What changes were proposed in this pull request? The PR adds functions `arrays_overlap`, `array_repeat`, `map_entries` to

spark git commit: [SPARK-23668][K8S] Added missing config property in running-on-kubernetes.md

2018-06-02 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 8ef167a5f -> a36c1a6bb [SPARK-23668][K8S] Added missing config property in running-on-kubernetes.md ## What changes were proposed in this pull request? PR https://github.com/apache/spark/pull/20811 introduced a new Spark configuration

spark git commit: [SPARK-22920][SPARKR] sql functions for current_date, current_timestamp, rtrim/ltrim/trim with trimString

2017-12-29 Thread felixcheung
ual, unit tests Author: Felix Cheung <felixcheun...@hotmail.com> Closes #20105 from felixcheung/rsqlfuncs. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/66a7d6b3 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree

spark git commit: [SPARK-22889][SPARKR] Set overwrite=T when install SparkR in tests

2017-12-23 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.2 7a97943f2 -> 41f705a57 [SPARK-22889][SPARKR] Set overwrite=T when install SparkR in tests ## What changes were proposed in this pull request? Since all CRAN checks go through the same machine, if there is an older partial download or

spark git commit: [SPARK-22889][SPARKR] Set overwrite=T when install SparkR in tests

2017-12-23 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master aeb45df66 -> 1219d7a43 [SPARK-22889][SPARKR] Set overwrite=T when install SparkR in tests ## What changes were proposed in this pull request? Since all CRAN checks go through the same machine, if there is an older partial download or

spark git commit: [SPARK-21292][DOCS] refreshtable example

2018-01-08 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.3 fd46a276c -> 911a4dbe7 [SPARK-21292][DOCS] refreshtable example ## What changes were proposed in this pull request? doc update Author: Felix Cheung <felixcheun...@hotmail.com> Closes #20198 from felixcheung/rrefreshdoc.

spark git commit: [SPARK-21293][SPARKR][DOCS] structured streaming doc update

2018-01-08 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.3 911a4dbe7 -> a23c07ecb [SPARK-21293][SPARKR][DOCS] structured streaming doc update ## What changes were proposed in this pull request? doc update Author: Felix Cheung <felixcheun...@hotmail.com> Closes #20197 from felixcheu

spark git commit: [SPARK-21292][DOCS] refreshtable example

2018-01-08 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master f20131dd3 -> 8486ad419 [SPARK-21292][DOCS] refreshtable example ## What changes were proposed in this pull request? doc update Author: Felix Cheung <felixcheun...@hotmail.com> Closes #20198 from felixcheung/rrefreshdoc. Proj

<    1   2   3   4   >