spark git commit: [SPARKR] Require Java 8 for SparkR

2018-05-11 Thread shivaram
How was this patch tested? Tested on a Mac and Windows machine Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Closes #21278 from shivaram/sparkr-skip-solaris. (cherry picked from commit f27a035daf705766d3445e5c6a99867c11c552b0) Signed-off-by: Shivaram Venkataraman <shiva...@cs.

spark git commit: [SPARKR] Require Java 8 for SparkR

2018-05-11 Thread shivaram
How was this patch tested? Tested on a Mac and Windows machine Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Closes #21278 from shivaram/sparkr-skip-solaris. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/f27a

spark-website git commit: Redirect mean.html to column_aggregate_functions

2018-03-02 Thread shivaram
mit: 2c2f85561cc6a5e50d8bd9bda50f287542a0a3d4 Parents: 5885a07 Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Authored: Fri Mar 2 15:03:57 2018 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Fri Mar 2 15:03:57 2018 -0800 -

spark git commit: [SPARK-22315][SPARKR] Warn if SparkR package version doesn't match SparkContext

2017-11-06 Thread shivaram
e.g., 2.1.3 with 2.1.2 etc.) ## How was this patch tested? Manually by changing the `DESCRIPTION` file Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Closes #19624 from shivaram/sparkr-version-check. (cherry picked from commit 65a8bf6036fe41a53b4b1e4298fa35d7fa4e9970) Signed-off-by:

spark git commit: [SPARK-22315][SPARKR] Warn if SparkR package version doesn't match SparkContext

2017-11-06 Thread shivaram
1.3 with 2.1.2 etc.) ## How was this patch tested? Manually by changing the `DESCRIPTION` file Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Closes #19624 from shivaram/sparkr-version-check. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.a

spark git commit: [SPARK-22344][SPARKR] Set java.io.tmpdir for SparkR tests

2017-10-29 Thread shivaram
les from being left behind in `/tmp` Tested manually on a clean EC2 machine Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Closes #19589 from shivaram/sparkr-tmpdir-clean. (cherry picked from commit 1fe27612d7bcb8b6478a36bc16ddd4802e4ee2fc) Signed-off-by: Shivaram Venkataram

spark git commit: [SPARK-22344][SPARKR] Set java.io.tmpdir for SparkR tests

2017-10-29 Thread shivaram
les from being left behind in `/tmp` ## How was this patch tested? Tested manually on a clean EC2 machine Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Closes #19589 from shivaram/sparkr-tmpdir-clean. (cherry picked from commit 1fe27612d7bcb8b6478a36bc16ddd4802e4ee2fc) S

spark git commit: [SPARK-22344][SPARKR] Set java.io.tmpdir for SparkR tests

2017-10-29 Thread shivaram
rom being left behind in `/tmp` ## How was this patch tested? Tested manually on a clean EC2 machine Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Closes #19589 from shivaram/sparkr-tmpdir-clean. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http:

spark git commit: [SPARK-20877][SPARKR][WIP] add timestamps to test runs

2017-05-30 Thread shivaram
(cherry picked from commit 382fefd1879e4670f3e9e8841ec243e3eb11c578) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/3cad66e5 Tree: http://git-wip-us.apach

spark git commit: [SPARK-20877][SPARKR][WIP] add timestamps to test runs

2017-05-30 Thread shivaram
pache.org/repos/asf/spark/diff/382fefd1 Branch: refs/heads/master Commit: 382fefd1879e4670f3e9e8841ec243e3eb11c578 Parents: 1f5dddf Author: Felix Cheung <felixcheun...@hotmail.com> Authored: Tue May 30 22:33:29 2017 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Commit

spark git commit: [SPARK-19237][SPARKR][CORE] On Windows spark-submit should handle when java is not installed

2017-03-21 Thread shivaram
; Closes #16596 from felixcheung/rcheckjava. (cherry picked from commit a8877bdbba6df105740f909bc87a13cdd4440757) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/

spark git commit: [SPARK-19237][SPARKR][CORE] On Windows spark-submit should handle when java is not installed

2017-03-21 Thread shivaram
b Branch: refs/heads/master Commit: a8877bdbba6df105740f909bc87a13cdd4440757 Parents: 7dbc162 Author: Felix Cheung <felixcheun...@hotmail.com> Authored: Tue Mar 21 14:24:41 2017 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Tue Mar 2

spark git commit: [SPARK-19387][SPARKR] Tests do not run with SparkR source package in CRAN check

2017-02-14 Thread shivaram
6ca3 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/a3626ca3 Branch: refs/heads/master Commit: a3626ca333e6e1881e2f09ccae0fa8fa7243223e Parents: ab9872d Author: Felix Cheung <felixcheun...@hotmail.com> Authored: Tue Feb 14 13:51:27 2017 -0800 Committer: Shivaram Venkataraman <shiva...

spark git commit: [SPARK-19387][SPARKR] Tests do not run with SparkR source package in CRAN check

2017-02-14 Thread shivaram
.tar.gz ``` Author: Felix Cheung <felixcheun...@hotmail.com> Closes #16720 from felixcheung/rcranchecktest. (cherry picked from commit a3626ca333e6e1881e2f09ccae0fa8fa7243223e) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.or

spark git commit: [SPARK-19324][SPARKR] Spark VJM stdout output is getting dropped in SparkR

2017-01-27 Thread shivaram
xamples with calls of `println` in Scala/JVM side, that are getting dropped. ## How was this patch tested? manual Author: Felix Cheung <felixcheun...@hotmail.com> Closes #16670 from felixcheung/rjvmstdout. (cherry picked from commit a7ab6f9a8fdfb927f0bcefdc87a92cc82fac4223) Signed-off-by: Shi

spark git commit: [SPARK-19324][SPARKR] Spark VJM stdout output is getting dropped in SparkR

2017-01-27 Thread shivaram
ache.org/repos/asf/spark/commit/a7ab6f9a Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/a7ab6f9a Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/a7ab6f9a Branch: refs/heads/master Commit: a7ab6f9a8fdfb927f0bcefdc87a92cc82fac4223 Parents: 385d738 Author: Felix Cheung <felixcheun...

spark git commit: [SPARK-19232][SPARKR] Update Spark distribution download cache location on Windows

2017-01-16 Thread shivaram
picked from commit a115a54399cd4bedb1a5086943a88af6339fbe85) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/97589050 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/9758

spark git commit: [SPARK-19232][SPARKR] Update Spark distribution download cache location on Windows

2017-01-16 Thread shivaram
nts: 12c8c21 Author: Felix Cheung <felixcheun...@hotmail.com> Authored: Mon Jan 16 09:35:52 2017 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Mon Jan 16 09:35:52 2017 -0800 -- R/pkg/R/instal

spark git commit: [SPARK-19221][PROJECT INFRA][R] Add winutils binaries to the path in AppVeyor tests for Hadoop libraries to call native codes properly

2017-01-14 Thread shivaram
repos/asf/spark/tree/b6a7aa4f Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/b6a7aa4f Branch: refs/heads/master Commit: b6a7aa4f770634e6db7244e88f8b6273fb9b6d1e Parents: ad0dada Author: hyukjinkwon <gurwls...@gmail.com> Authored: Sat Jan 14 08:31:07 2017 -0800 Committer: Shivar

spark git commit: [SPARK-18335][SPARKR] createDataFrame to support numPartitions parameter

2017-01-13 Thread shivaram
How was this patch tested? manual, unit tests Author: Felix Cheung <felixcheun...@hotmail.com> Closes #16512 from felixcheung/rnumpart. (cherry picked from commit b0e8eb6d3e9e80fa62625a5b9382d93af77250db) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project:

spark git commit: [SPARK-18335][SPARKR] createDataFrame to support numPartitions parameter

2017-01-13 Thread shivaram
repos/asf/spark/tree/b0e8eb6d Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/b0e8eb6d Branch: refs/heads/master Commit: b0e8eb6d3e9e80fa62625a5b9382d93af77250db Parents: 285a779 Author: Felix Cheung <felixcheun...@hotmail.com> Authored: Fri Jan 13 10:08:14 2017 -0800 Committer: Shivar

spark git commit: [SPARK-19130][SPARKR] Support setting literal value as column implicitly

2017-01-11 Thread shivaram
ch tested? unit tests Author: Felix Cheung <felixcheun...@hotmail.com> Closes #16510 from felixcheung/rlitcol. (cherry picked from commit d749c06677c2fd38377f1c00f542da122b8d) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org

spark git commit: [SPARK-19130][SPARKR] Support setting literal value as column implicitly

2017-01-11 Thread shivaram
e/d749c066 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/d749c066 Branch: refs/heads/master Commit: d749c06677c2fd38377f1c00f542da122b8d Parents: 4239a10 Author: Felix Cheung <felixcheun...@hotmail.com> Authored: Wed Jan 11 08:29:09 2017 -0800 Committer: Shivara

spark git commit: [SPARK-18895][TESTS] Fix resource-closing-related and path-related test failures in identified ones on Windows

2016-12-16 Thread shivaram
51 Branch: refs/heads/master Commit: 2bc1c95154d071d53c9ef2e9e404eaf50ceb4675 Parents: 4faa8a3 Author: hyukjinkwon <gurwls...@gmail.com> Authored: Fri Dec 16 21:32:24 2016 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu>

spark git commit: [SPARK-18897][SPARKR] Fix SparkR SQL Test to drop test table

2016-12-16 Thread shivaram
. (cherry picked from commit 1169db44bc1d51e68feb6ba2552520b2d660c2c0) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/1935bf44 Tree: http://git-wip-us.apache.org/repos/asf/spark

spark git commit: [SPARK-18897][SPARKR] Fix SparkR SQL Test to drop test table

2016-12-16 Thread shivaram
20b2d660c2c0 Parents: ed84cd0 Author: Dongjoon Hyun <dongj...@apache.org> Authored: Fri Dec 16 11:30:21 2016 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Fri Dec 16 11:30:21 2016 -0800 --

spark git commit: [MINOR] Handle fact that mv is different on linux, mac

2016-12-15 Thread shivaram
rce and destinations are the same. Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Closes #16302 from shivaram/sparkr-no-mv-fix. (cherry picked from commit 5a44f18a2a114bdd37b6714d81f88cb68148f0c9) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project:

spark git commit: [MINOR] Handle fact that mv is different on linux, mac

2016-12-15 Thread shivaram
rce and destinations are the same. Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Closes #16302 from shivaram/sparkr-no-mv-fix. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/5a44f18a Tree: http://git-wip-us.apache.

spark git commit: [SPARK-18849][ML][SPARKR][DOC] vignettes final check update

2016-12-14 Thread shivaram
om commit 7d858bc5ce870a28a559f4e81dcfc54cbd128cb7) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/2a8de2e1 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/2a8de2e1 Diff:

spark git commit: [SPARK-18849][ML][SPARKR][DOC] vignettes final check update

2016-12-14 Thread shivaram
e4 Author: Felix Cheung <felixcheun...@hotmail.com> Authored: Wed Dec 14 21:51:52 2016 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Wed Dec 14 21:51:52 2016 -0800 -- R/pkg/vignettes/spar

spark git commit: [SPARK-18875][SPARKR][DOCS] Fix R API doc generation by adding `DESCRIPTION` file

2016-12-14 Thread shivaram
How was this patch tested? Manual. ```bash cd docs SKIP_SCALADOC=1 jekyll build ``` Author: Dongjoon Hyun <dongj...@apache.org> Closes #16292 from dongjoon-hyun/SPARK-18875. (cherry picked from commit ec0eae486331c3977505d261676b77a33c334216) Signed-off-by: Shivaram Venkataraman <shiva...@cs.

spark git commit: [SPARK-18875][SPARKR][DOCS] Fix R API doc generation by adding `DESCRIPTION` file

2016-12-14 Thread shivaram
How was this patch tested? Manual. ```bash cd docs SKIP_SCALADOC=1 jekyll build ``` Author: Dongjoon Hyun <dongj...@apache.org> Closes #16292 from dongjoon-hyun/SPARK-18875. (cherry picked from commit ec0eae486331c3977505d261676b77a33c334216) Signed-off-by: Shivaram Venkataraman <shiva...@cs.

spark git commit: [SPARK-18875][SPARKR][DOCS] Fix R API doc generation by adding `DESCRIPTION` file

2016-12-14 Thread shivaram
4 21:29:20 2016 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Wed Dec 14 21:29:20 2016 -0800 -- docs/_plugins/copy_api_dirs.rb | 3 +++ 1 file

spark git commit: [SPARK-18810][SPARKR] SparkR install.spark does not work for RCs, snapshots

2016-12-12 Thread shivaram
er Commit: 8a51cfdcad5f8397558ed2e245eb03650f37ce66 Parents: 90abfd1 Author: Felix Cheung <felixcheun...@hotmail.com> Authored: Mon Dec 12 14:40:41 2016 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Mon Dec 1

spark git commit: [SPARK-18810][SPARKR] SparkR install.spark does not work for RCs, snapshots

2016-12-12 Thread shivaram
nstallurl. (cherry picked from commit 8a51cfdcad5f8397558ed2e245eb03650f37ce66) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/1aeb7f42 Tree: http://git-wi

spark git commit: [SPARK-18807][SPARKR] Should suppress output print for calls to JVM methods with void return values

2016-12-09 Thread shivaram
w was this patch tested? manually - I didn't find a expect_*() method in testthat for this Author: Felix Cheung <felixcheun...@hotmail.com> Closes #16237 from felixcheung/rinvis. (cherry picked from commit 3e11d5bfef2f05bd6d42c4d6188eae6d63c963ef) Signed-off-by: Shivaram Venkataraman <

spark git commit: [SPARK-18807][SPARKR] Should suppress output print for calls to JVM methods with void return values

2016-12-09 Thread shivaram
ri Dec 9 19:06:05 2016 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Fri Dec 9 19:06:05 2016 -0800 -- R/pkg/R/SQLContext.R | 7 --- R/pkg/R/context.R

spark git commit: [MINOR][SPARKR] Fix SparkR regex in copy command

2016-12-09 Thread shivaram
1.1-SNAPSHOT-2016_12_08_22_38-e8f351f-bin mput: SparkR-*: no files found ``` Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Closes #16231 from shivaram/typo-sparkr-build. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spa

spark git commit: [MINOR][SPARKR] Fix SparkR regex in copy command

2016-12-09 Thread shivaram
1.1-SNAPSHOT-2016_12_08_22_38-e8f351f-bin mput: SparkR-*: no files found ``` Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Closes #16231 from shivaram/typo-sparkr-build. (cherry picked from commit be5fc6ef72c7eb586b184b0f42ac50ef32843208) Signed-off-by: Shivaram Venkataram

spark git commit: Copy pyspark and SparkR packages to latest release dir too

2016-12-08 Thread shivaram
com/apache/spark/pull/16226#discussion_r91664822) Author: Felix Cheung <felixcheun...@hotmail.com> Closes #16227 from felixcheung/pyrftp. (cherry picked from commit c074c96dc57bf18b28fafdcac0c768d75c642cba) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project:

spark git commit: Copy pyspark and SparkR packages to latest release dir too

2016-12-08 Thread shivaram
org/repos/asf/spark/tree/c074c96d Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/c074c96d Branch: refs/heads/master Commit: c074c96dc57bf18b28fafdcac0c768d75c642cba Parents: 934035a Author: Felix Cheung <felixcheun...@hotmail.com> Authored: Thu Dec 8 22:52:34 2016 -0800 Comm

spark git commit: Copy the SparkR source package with LFTP

2016-12-08 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-2.1 4ceed95b4 -> e8f351f9a Copy the SparkR source package with LFTP This PR adds a line in release-build.sh to copy the SparkR source archive using LFTP Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Closes #1

spark git commit: Copy the SparkR source package with LFTP

2016-12-08 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 9338aa4f8 -> 934035ae7 Copy the SparkR source package with LFTP This PR adds a line in release-build.sh to copy the SparkR source archive using LFTP Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Closes #16226 from

spark git commit: [SPARKR][PYSPARK] Fix R source package name to match Spark version. Remove pip tar.gz from distribution

2016-12-08 Thread shivaram
`cp` in release-build.sh works correctly. Issue discussed in https://github.com/apache/spark/pull/16014#issuecomment-265867125 Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Closes #16221 from shivaram/fix-sparkr-release-build-name. (cherry picked fr

spark git commit: [SPARKR][PYSPARK] Fix R source package name to match Spark version. Remove pip tar.gz from distribution

2016-12-08 Thread shivaram
ase-build.sh works correctly. Issue discussed in https://github.com/apache/spark/pull/16014#issuecomment-265867125 Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Closes #16221 from shivaram/fix-sparkr-release-build-name. Project: http://git-wip-us.apache.org/repos/asf/spark/re

spark git commit: [SPARK-18590][SPARKR] Change the R source build to Hadoop 2.6

2016-12-08 Thread shivaram
ich leads to an error as discussed in https://github.com/apache/spark/pull/16014#issuecomment-265843991 Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Closes #16218 from shivaram/fix-sparkr-release-build. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http:

spark git commit: [SPARK-18590][SPARKR] Change the R source build to Hadoop 2.6

2016-12-08 Thread shivaram
ich leads to an error as discussed in https://github.com/apache/spark/pull/16014#issuecomment-265843991 Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Closes #16218 from shivaram/fix-sparkr-release-build. (cherry picked from commit 202fcd21ce01393fa6dfaa1c2126e18e9b85ee96) S

spark git commit: [SPARK-18590][SPARKR] build R source package when making distribution

2016-12-08 Thread shivaram
ely fast. Building vignettes takes a while though. Manually, CI. Author: Felix Cheung <felixcheun...@hotmail.com> Closes #16014 from felixcheung/rdist. (cherry picked from commit c3d3a9d0e85b834abef87069e4edd27db87fc607) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu>

spark git commit: [SPARK-18590][SPARKR] build R source package when making distribution

2016-12-08 Thread shivaram
: 3c68944 Author: Felix Cheung <felixcheun...@hotmail.com> Authored: Thu Dec 8 11:29:31 2016 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Thu Dec 8 11:29:31 2016 -0800

spark git commit: [MINOR][DOC] Use SparkR `TRUE` value and add default values for `StructField` in SQL Guide.

2016-12-05 Thread shivaram
(cherry picked from commit 410b7898661f77e748564aaee6a5ab7747ce34ad) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/afd2321b Tree: http://git-wip-us.apache.org/

spark git commit: [MINOR][DOC] Use SparkR `TRUE` value and add default values for `StructField` in SQL Guide.

2016-12-05 Thread shivaram
77e748564aaee6a5ab7747ce34ad Parents: eb8dd68 Author: Dongjoon Hyun <dongj...@apache.org> Authored: Mon Dec 5 10:36:13 2016 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Mon Dec 5 10:36:13 2016 -0800

spark git commit: [SPARK-18643][SPARKR] SparkR hangs at session start when installed as a package without Spark

2016-12-04 Thread shivaram
(cherry picked from commit b019b3a8ac49336e657f5e093fa2fba77f8d12d2) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c13c2939 Tree: http://git-wip-us.apach

spark git commit: [SPARK-18643][SPARKR] SparkR hangs at session start when installed as a package without Spark

2016-12-04 Thread shivaram
er Commit: b019b3a8ac49336e657f5e093fa2fba77f8d12d2 Parents: d9eb4c7 Author: Felix Cheung <felixcheun...@hotmail.com> Authored: Sun Dec 4 20:25:11 2016 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Sun Dec

spark git commit: [SPARK-18264][SPARKR] build vignettes with package, update vignettes for CRAN release build and add info on release

2016-11-11 Thread shivaram
[image](https://cloud.githubusercontent.com/assets/8969467/20040490/a40f4d42-a40d-11e6-8c91-af00ddcbdad9.png) Also add information on how to run build/release to CRAN later. ## How was this patch tested? manually, unit tests shivaram We need this for branch-2.1 Author: Felix Cheung <f

spark git commit: [SPARK-18264][SPARKR] build vignettes with package, update vignettes for CRAN release build and add info on release

2016-11-11 Thread shivaram
[image](https://cloud.githubusercontent.com/assets/8969467/20040490/a40f4d42-a40d-11e6-8c91-af00ddcbdad9.png) Also add information on how to run build/release to CRAN later. ## How was this patch tested? manually, unit tests shivaram We need this for branch-2.1 Author: Felix Cheung <f

spark git commit: [SPARKR][DOC] minor formatting and output cleanup for R vignettes

2016-10-04 Thread shivaram
il.com> Closes #15340 from felixcheung/vignettes. (cherry picked from commit 068c198e956346b90968a4d74edb7bc820c4be28) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/a

spark git commit: [SPARKR][DOC] minor formatting and output cleanup for R vignettes

2016-10-04 Thread shivaram
repos/asf/spark/tree/068c198e Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/068c198e Branch: refs/heads/master Commit: 068c198e956346b90968a4d74edb7bc820c4be28 Parents: c17f971 Author: Felix Cheung <felixcheun...@hotmail.com> Authored: Tue Oct 4 09:22:26 2016 -0700 Committer: Shivar

spark git commit: [SPARK-17317][SPARKR] Add SparkR vignette to branch 2.0

2016-09-15 Thread shivaram
ugh the functionality provided by SparkR. ## How was this patch tested? R unit test. Author: junyangq <qianjuny...@gmail.com> Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Author: Junyang Qian <junya...@databricks.com> Closes #15100 from junyangq/SPARKR-vignette-2.0. Pr

spark git commit: [SPARK-17317][SPARKR] Add SparkR vignette

2016-09-13 Thread shivaram
ded by SparkR. ## How was this patch tested? Manual test. Author: junyangq <qianjuny...@gmail.com> Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Author: Junyang Qian <junya...@databricks.com> Closes #14980 from junyangq/SPARKR-vignette. Project: http://git-wip-us.apach

spark git commit: [SPARK-17200][PROJECT INFRA][BUILD][SPARKR] Automate building and testing on Windows (currently SparkR only)

2016-09-08 Thread shivaram
: f0d21b7 Author: hyukjinkwon <gurwls...@gmail.com> Authored: Thu Sep 8 08:26:59 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Thu Sep 8 08:26:59 2016 -0700 -- appveyor.yml

spark git commit: [SPARK-17442][SPARKR] Additional arguments in write.df are not passed to data source

2016-09-08 Thread shivaram
How was this patch tested? unit tests falaki shivaram Author: Felix Cheung <felixcheun...@hotmail.com> Closes #15010 from felixcheung/testreadoptions. (cherry picked from commit f0d21b7f90cdcce353ab6fc279b9cc376e46e536) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project:

spark git commit: [SPARK-17442][SPARKR] Additional arguments in write.df are not passed to data source

2016-09-08 Thread shivaram
tch tested? unit tests falaki shivaram Author: Felix Cheung <felixcheun...@hotmail.com> Closes #15010 from felixcheung/testreadoptions. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/f0d21b7f Tree: http://git-wip-us.a

spark git commit: [SPARK-17339][CORE][BRANCH-2.0] Do not use path to get a filesystem in hadoopFile and newHadoopFile APIs

2016-09-07 Thread shivaram
2c Author: hyukjinkwon <gurwls...@gmail.com> Authored: Wed Sep 7 21:22:32 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Wed Sep 7 21:22:32 2016 -0700 -- core/src/main/scala/org/apache/spa

spark git commit: [SPARK-16785] R dapply doesn't return array or raw columns

2016-09-07 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-2.0 796577b43 -> ee6301a88 [SPARK-16785] R dapply doesn't return array or raw columns Fixed bug in `dapplyCollect` by changing the `compute` function of `worker.R` to explicitly handle raw (binary) vectors. cc shivaram Unit te

spark git commit: [SPARK-16785] R dapply doesn't return array or raw columns

2016-09-07 Thread shivaram
raw (binary) vectors. cc shivaram ## How was this patch tested? Unit tests Author: Clark Fitzgerald <clarkfi...@gmail.com> Closes #14783 from clarkfitzg/SPARK-16785. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit

spark git commit: [SPARK-15091][SPARKR] Fix warnings and a failure in SparkR test cases with testthat version 1.0.1

2016-09-05 Thread shivaram
Sun Rui <sunrui2...@gmail.com> Closes #12867 from sun-rui/SPARK-15091. (cherry picked from commit 8b6491fc0b49b4e363887ae4b452ba69fe0290d5) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wi

spark git commit: [SPARK-16829][SPARKR] sparkR sc.setLogLevel doesn't work

2016-09-03 Thread shivaram
wip-us.apache.org/repos/asf/spark/tree/e9b58e9e Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/e9b58e9e Branch: refs/heads/master Commit: e9b58e9ef89a9118b6d5a466d10db8e30d61f850 Parents: abb2f92 Author: wm...@hotmail.com <wm...@hotmail.com> Authored: Sat Sep 3 13:52:55 2016 -0700

spark git commit: [SPARKR][MINOR] Fix docs for sparkR.session and count

2016-09-02 Thread shivaram
ks.com> Closes #14942 from junyangq/fixSparkRSessionDoc. (cherry picked from commit d2fde6b72c4aede2e7edb4a7e6653fb1e7b19924) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/

spark git commit: [SPARKR][MINOR] Fix docs for sparkR.session and count

2016-09-02 Thread shivaram
park/diff/d2fde6b7 Branch: refs/heads/master Commit: d2fde6b72c4aede2e7edb4a7e6653fb1e7b19924 Parents: e6132a6 Author: Junyang Qian <junya...@databricks.com> Authored: Fri Sep 2 21:11:57 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Fri Sep

spark git commit: [SPARKR][DOC] regexp_extract should doc that it returns empty string when match fails

2016-09-02 Thread shivaram
324 ## How was this patch tested? manual check Author: Felix Cheung <felixcheun...@hotmail.com> Closes #14934 from felixcheung/regexpextractdoc. (cherry picked from commit 419eefd811a4e29a73bc309157f150751e478db5) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project:

spark git commit: [SPARKR][DOC] regexp_extract should doc that it returns empty string when match fails

2016-09-02 Thread shivaram
pache.org/repos/asf/spark/tree/419eefd8 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/419eefd8 Branch: refs/heads/master Commit: 419eefd811a4e29a73bc309157f150751e478db5 Parents: 812333e Author: Felix Cheung <felixcheun...@hotmail.com> Authored: Fri Sep 2 10:28:37 2016 -0700 Comm

spark git commit: [SPARK-17376][SPARKR] Spark version should be available in R

2016-09-02 Thread shivaram
w was this patch tested? manual, unit tests Author: Felix Cheung <felixcheun...@hotmail.com> Closes #14935 from felixcheung/rsparksessionversion. (cherry picked from commit 812333e4336113e44d2c9473bcba1cee4a989d2c) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu&g

spark git commit: [SPARK-17376][SPARKR] Spark version should be available in R

2016-09-02 Thread shivaram
ip-us.apache.org/repos/asf/spark/tree/812333e4 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/812333e4 Branch: refs/heads/master Commit: 812333e4336113e44d2c9473bcba1cee4a989d2c Parents: ea66228 Author: Felix Cheung <felixcheun...@hotmail.com> Authored: Fri Sep 2 10:12:10 20

spark git commit: [SPARK-17241][SPARKR][MLLIB] SparkR spark.glm should have configurable regularization parameter

2016-08-31 Thread shivaram
er Commit: 7a5000f39ef4f195696836f8a4e8ab4ff5c14dd2 Parents: d008638 Author: Xin Ren <iamsh...@126.com> Authored: Wed Aug 31 21:39:31 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Wed Aug 3

spark git commit: [SPARKR][MINOR] Fix windowPartitionBy example

2016-08-31 Thread shivaram
est. Author: Junyang Qian <junya...@databricks.com> Closes #14903 from junyangq/SPARKR-FixWindowPartitionByDoc. (cherry picked from commit d008638fbedc857c1adc1dff399d427b8bae848e) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/

spark git commit: [SPARKR][MINOR] Fix windowPartitionBy example

2016-08-31 Thread shivaram
/d008638f Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/d008638f Branch: refs/heads/master Commit: d008638fbedc857c1adc1dff399d427b8bae848e Parents: 2f9c273 Author: Junyang Qian <junya...@databricks.com> Authored: Wed Aug 31 21:28:53 2016 -0700 Committer: Shivaram Venk

spark git commit: [SPARK-16581][SPARKR] Fix JVM API tests in SparkR

2016-08-31 Thread shivaram
n R unit tests with testthat 1.0 Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Closes #14904 from shivaram/sparkr-jvm-tests-fix. (cherry picked from commit 2f9c27364ea00473933213700edb93b63b55b313) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project:

spark git commit: [SPARK-16581][SPARKR] Fix JVM API tests in SparkR

2016-08-31 Thread shivaram
nit tests with testthat 1.0 Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Closes #14904 from shivaram/sparkr-jvm-tests-fix. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/2f9c2736 Tree: http://git-wip-us.a

spark git commit: [SPARK-17326][SPARKR] Fix tests with HiveContext in SparkR not to be skipped always

2016-08-31 Thread shivaram
/45-test123 - After: https://ci.appveyor.com/project/HyukjinKwon/spark/build/46-test123 Author: hyukjinkwon <gurwls...@gmail.com> Closes #14889 from HyukjinKwon/SPARK-17326. (cherry picked from commit 50bb142332d1147861def692bf63f0055ecb8576) Signed-off-by: Shivaram Venkataram

spark git commit: [SPARK-17326][SPARKR] Fix tests with HiveContext in SparkR not to be skipped always

2016-08-31 Thread shivaram
1 14:02:21 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Wed Aug 31 14:02:21 2016 -0700 -- R/pkg/inst/tests/testthat/test_sparkSQL.R | 2 +- 1 file changed, 1 ins

spark git commit: [MINOR][SPARKR] Verbose build comment in WINDOWS.md rather than promoting default build without Hive

2016-08-31 Thread shivaram
os/asf/spark/tree/9953442a Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/9953442a Branch: refs/heads/master Commit: 9953442aca5a1528a6b85fa8713a56d36c9a199f Parents: 12fd0cd Author: hyukjinkwon <gurwls...@gmail.com> Authored: Wed Aug 31 09:06:23 2016 -0700 Committer: Shivaram V

spark git commit: [SPARK-16581][SPARKR] Make JVM backend calling functions public

2016-08-29 Thread shivaram
ver JVM ## How was this patch tested? (Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests) Unit tests, CRAN checks Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Closes #14775 from shivaram/sparkr-java-api. (cherry picked fr

spark git commit: [SPARK-16581][SPARKR] Make JVM backend calling functions public

2016-08-29 Thread shivaram
JVM ## How was this patch tested? (Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests) Unit tests, CRAN checks Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Closes #14775 from shivaram/sparkr-java-api. Project: http://git-wip-us.a

spark git commit: [SPARKR][BUILD] ignore cran-check.out under R folder

2016-08-25 Thread shivaram
il.com> Closes #14774 from wangmiao1981/ignore. (cherry picked from commit 9958ac0ce2b9e451d400604767bef2fe12a3399d) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/a

spark git commit: [SPARK-16577][SPARKR] Add CRAN documentation checks to run-tests.sh

2016-08-22 Thread shivaram
nge adds CRAN documentation checks to be run as a part of `R/run-tests.sh` . As this script is also used by Jenkins this means that we will get documentation checks on every PR going forward. (If this patch involves UI changes, please attach a screenshot; otherwise, remove this) Author: Shiva

spark git commit: [SPARK-16577][SPARKR] Add CRAN documentation checks to run-tests.sh

2016-08-22 Thread shivaram
dds CRAN documentation checks to be run as a part of `R/run-tests.sh` . As this script is also used by Jenkins this means that we will get documentation checks on every PR going forward. (If this patch involves UI changes, please attach a screenshot; otherwise, remove this) Author: Shiva

spark git commit: [SPARK-16508][SPARKR] doc updates and more CRAN check fixes

2016-08-22 Thread shivaram
itr junyangq Author: Felix Cheung <felixcheun...@hotmail.com> Closes #14734 from felixcheung/rdoccleanup. (cherry picked from commit 71afeeea4ec8e67edc95b5d504c557c88a2598b9) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/sp

spark git commit: [SPARKR][MINOR] Add Xiangrui and Felix to maintainers

2016-08-22 Thread shivaram
ion. ## How was this patch tested? (Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests) (If this patch involves UI changes, please attach a screenshot; otherwise, remove this) Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Closes #14758 from

spark git commit: [SPARKR][MINOR] Add Xiangrui and Felix to maintainers

2016-08-22 Thread shivaram
How was this patch tested? (Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests) (If this patch involves UI changes, please attach a screenshot; otherwise, remove this) Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Closes #14758 from

spark git commit: [SPARKR][MINOR] Fix Cache Folder Path in Windows

2016-08-22 Thread shivaram
igned-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/79195982 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/79195982 Diff: http://git-wip-us.apache.org/repos

spark git commit: [SPARKR][MINOR] Fix Cache Folder Path in Windows

2016-08-22 Thread shivaram
an <junya...@databricks.com> Authored: Mon Aug 22 10:03:48 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Mon Aug 22 10:03:48 2016 -0700 -- R/pkg/R/install.R | 2 +- 1 file changed, 1 ins

spark git commit: [SPARK-16508][SPARKR] Fix CRAN undocumented/duplicated arguments warnings.

2016-08-21 Thread shivaram
Closes #14705 from junyangq/SPARK-16508-master. (cherry picked from commit 01401e965b58f7e8ab615764a452d7d18f1d4bf0) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/c

spark git commit: [MINOR][SPARKR] R API documentation for "coltypes" is confusing

2016-08-18 Thread shivaram
rom keypointt/rExample. (cherry picked from commit 1203c8415cd11540f79a235e66a2f241ca6c71e4) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/176af17a Tree:

spark git commit: [SPARK-16519][SPARKR] Handle SparkR RDD generics that create warnings in R CMD check

2016-08-16 Thread shivaram
ons (hence the problem) so after the renames we need to add new generics, for now. unit tests Author: Felix Cheung <felixcheun...@hotmail.com> Closes #14626 from felixcheung/rrddfunctions. (cherry picked from commit c34b546d674ce186f13db97977bc281cfedf) Signed-off-by: Shivaram Venkataram

spark git commit: [SPARK-16519][SPARKR] Handle SparkR RDD generics that create warnings in R CMD check

2016-08-16 Thread shivaram
er Commit: c34b546d674ce186f13db97977bc281cfedf Parents: d37ea3c Author: Felix Cheung <felixcheun...@hotmail.com> Authored: Tue Aug 16 11:19:18 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Tue Aug 16 11:19:18 2016 -0700

spark git commit: [MINOR][SPARKR] spark.glm weightCol should in the signature.

2016-08-16 Thread shivaram
/d37ea3c0 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/d37ea3c0 Branch: refs/heads/master Commit: d37ea3c09c054f2cc1305b2520ff46b2c0e58704 Parents: 12a89e5 Author: Yanbo Liang <yblia...@gmail.com> Authored: Tue Aug 16 10:52:35 2016 -0700 Committer: Shivaram Venkataraman <shiva.

spark git commit: [SPARK-16508][SPARKR] Split docs for arrange and orderBy methods

2016-08-15 Thread shivaram
er Commit: 564fe614c11deb657e0ac9e6b75e65370c48b7fe Parents: 3d8bfe7 Author: Junyang Qian <junya...@databricks.com> Authored: Mon Aug 15 11:03:03 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Mon Aug 1

spark git commit: [SPARK-16579][SPARKR] add install.spark function

2016-08-10 Thread shivaram
- can install spark when not found in `SPARK_HOME` Manual tests, running the check-cran.sh script added in #14173. Author: Junyang Qian <junya...@databricks.com> Closes #14258 from junyangq/SPARK-16579. (cherry picked from commit 214ba66a030bc3a718c567a742b0db44bf911d61) Signed-o

spark git commit: [SPARK-16579][SPARKR] add install.spark function

2016-08-10 Thread shivaram
s/master Commit: 214ba66a030bc3a718c567a742b0db44bf911d61 Parents: d4a9122 Author: Junyang Qian <junya...@databricks.com> Authored: Wed Aug 10 11:18:23 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Wed Aug 10 11:18:23 2016 -0700 --

spark git commit: [SPARK-16710][SPARKR][ML] spark.glm should support weightCol

2016-08-10 Thread shivaram
er Commit: d4a9122430d6c3aeaaee32aa09d314016ff6ddc7 Parents: 19af298 Author: Yanbo Liang <yblia...@gmail.com> Authored: Wed Aug 10 10:53:48 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Wed Aug 1

  1   2   3   4   5   >