spark git commit: [SPARK-10903][SPARKR] R - Simplify SQLContext method signatures and use a singleton

2016-05-26 Thread shivaram
0) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/9cf34727 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/9cf34727 Diff: http://git-wip-us.apach

spark git commit: [SPARK-15439][SPARKR] Failed to run unit test in SparkR

2016-05-25 Thread shivaram
17d9478c889d206a4556a697b5d629e7) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/bcad1d13 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/bcad1d13 Di

spark git commit: [SPARK-15439][SPARKR] Failed to run unit test in SparkR

2016-05-25 Thread shivaram
29e7 Parents: 06ed1fa Author: wm...@hotmail.com <wm...@hotmail.com> Authored: Wed May 25 21:08:03 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Wed May 25 21:08:03 2016 -0700 -- R/pkg/R/DataFr

spark git commit: [SPARK-12071][DOC] Document the behaviour of NA in R

2016-05-24 Thread shivaram
n R to `null`. ## How was this patch tested? Document update, no tests. Author: Krishna Kalyan <krishnakaly...@gmail.com> Closes #13268 from krishnakalyan3/spark-12071-1. (cherry picked from commit 9082b7968ad952e05fc6f4feb499febef6aa45a7) Signed-off-by: Shivaram Venkataraman <shiva...@cs.

spark git commit: [SPARK-12071][DOC] Document the behaviour of NA in R

2016-05-24 Thread shivaram
May 24 22:21:52 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Tue May 24 22:21:52 2016 -0700 -- docs/sparkr.md | 1 + 1 file

spark git commit: [SPARK-15412][PYSPARK][SPARKR][DOCS] Improve linear isotonic regression pydoc & doc build insturctions

2016-05-24 Thread shivaram
524e68a9cbe4db1 Parents: c9c1c0e Author: Holden Karau <hol...@us.ibm.com> Authored: Tue May 24 22:20:00 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Tue May 24 22:20:00 2016 -0700 -- d

spark git commit: [SPARK-15412][PYSPARK][SPARKR][DOCS] Improve linear isotonic regression pydoc & doc build insturctions

2016-05-24 Thread shivaram
erry picked from commit cd9f16906cabd012b7676eb0f524e68a9cbe4db1) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/402995e5 Tree: http://git-wip-us.apache.org/repos/asf/spark/t

spark git commit: [MINOR][SPARKR][DOC] Add a description for running unit tests in Windows

2016-05-23 Thread shivaram
tch tested? On a bare machine (Window 7, 32bits), this was manually built and tested. Author: hyukjinkwon <gurwls...@gmail.com> Closes #13217 from HyukjinKwon/minor-r-doc. (cherry picked from commit a8e97d17b91684e68290d9f18a43622232aa94e7) Signed-off-by: Shivaram Venkataram

spark git commit: [MINOR][SPARKR][DOC] Add a description for running unit tests in Windows

2016-05-23 Thread shivaram
3 17:20:29 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Mon May 23 17:20:29 2016 -0700 -- R/README.md | 8 +++- R/WINDOWS.md | 20 2 files changed, 27 inse

spark git commit: [SPARK-15202][SPARKR] add dapplyCollect() method for DataFrame in SparkR.

2016-05-12 Thread shivaram
c) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/54c04aa5 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/54c04aa5 Diff: http://git-wip-us.apache.org/

spark git commit: [SPARK-15202][SPARKR] add dapplyCollect() method for DataFrame in SparkR.

2016-05-12 Thread shivaram
<sunrui2...@gmail.com> Authored: Thu May 12 17:50:55 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Thu May 12 17:50:55 2016 -0700 -- R/pkg/NAMESPACE | 1 +

spark git commit: [SPARK-12479][SPARKR] sparkR collect on GroupedData throws R error "missing value where TRUE/FALSE needed"

2016-05-08 Thread shivaram
RK-12479. (cherry picked from commit 454ba4d67e782369627dfe60261e6648a27b91a0) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/cf156e61 Tree: http://git-wi

spark git commit: [SPARK-12479][SPARKR] sparkR collect on GroupedData throws R error "missing value where TRUE/FALSE needed"

2016-05-08 Thread shivaram
refs/heads/master Commit: 454ba4d67e782369627dfe60261e6648a27b91a0 Parents: 6e268b9 Author: Sun Rui <sunrui2...@gmail.com> Authored: Sun May 8 00:17:36 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Sun May 8 00:17:36 2016 -0700 --

spark git commit: [SPARK-11395][SPARKR] Support over and window specification in SparkR.

2016-05-05 Thread shivaram
pec objects. 3. Implement over() of Column class. Author: Sun Rui <rui@intel.com> Author: Sun Rui <sunrui2...@gmail.com> Closes #10094 from sun-rui/SPARK-11395. (cherry picked from commit 157a49aa410dc1870cd171148d317084c5a90d23) Signed-off-by: Shivaram Venkataraman <shiva.

spark git commit: [SPARK-15091][SPARKR] Fix warnings and a failure in SparkR test cases with testthat version 1.0.1

2016-05-03 Thread shivaram
hat version 1.0.1 ## How was this patch tested? SparkR unit test cases. Author: Sun Rui <sunrui2...@gmail.com> Closes #12867 from sun-rui/SPARK-15091. (cherry picked from commit 8b6491fc0b49b4e363887ae4b452ba69fe0290d5) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu>

spark git commit: [SPARK-15091][SPARKR] Fix warnings and a failure in SparkR test cases with testthat version 1.0.1

2016-05-03 Thread shivaram
//git-wip-us.apache.org/repos/asf/spark/tree/8b6491fc Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/8b6491fc Branch: refs/heads/master Commit: 8b6491fc0b49b4e363887ae4b452ba69fe0290d5 Parents: d26f7cb Author: Sun Rui <sunrui2...@gmail.com> Authored: Tue May 3 09:29:49 2016 -0700 Comm

spark git commit: [SPARK-12919][SPARKR] Implement dapply() on DataFrame in SparkR.

2016-04-29 Thread shivaram
/asf/spark/diff/4ae9fe09 Branch: refs/heads/master Commit: 4ae9fe091c2cb8388c581093d62d3deaef40993e Parents: d78fbcc Author: Sun Rui <rui@intel.com> Authored: Fri Apr 29 16:41:07 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Fri

spark git commit: [SPARK-12235][SPARKR] Enhance mutate() to support replace existing columns.

2016-04-28 Thread shivaram
er Commit: 9e785079b6ed4ea691c3c14c762a7f73fb6254bf Parents: 23256be Author: Sun Rui <rui@intel.com> Authored: Thu Apr 28 09:33:58 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Thu Apr 28 09:33:58 2016 -0700 --

spark git commit: [SPARK-13436][SPARKR] Added parameter drop to subsetting operator [

2016-04-27 Thread shivaram
repos/asf/spark/diff/e4bfb4aa Branch: refs/heads/master Commit: e4bfb4aa7382cb9c5e4eb7e2211551d5da716a61 Parents: 3757511 Author: Oscar D. Lara Yejas <odlar...@oscars-mbp.usca.ibm.com> Authored: Wed Apr 27 15:47:54 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs

spark git commit: [SPARK-13734][SPARKR] Added histogram function

2016-04-26 Thread shivaram
ee/0c99c23b Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/0c99c23b Branch: refs/heads/master Commit: 0c99c23b7d9f0c3538cd2b062d551411712a2bcc Parents: 75879ac Author: Oscar D. Lara Yejas <odlar...@oscars-mbp.usca.ibm.com> Authored: Tue Apr 26 15:34:30 2016 -0700 Commi

spark git commit: [SPARK-14883][DOCS] Fix wrong R examples and make them up-to-date

2016-04-24 Thread shivaram
Parents: 35319d3 Author: Dongjoon Hyun <dongj...@apache.org> Authored: Sun Apr 24 22:10:27 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Sun Apr 24 22:10:27 2016 -0700 -- R/pkg/R/

spark git commit: [SPARK-14594][SPARKR] check execution return status code

2016-04-23 Thread shivaram
2 Branch: refs/heads/master Commit: 39d3bc62a7ba16c646bed8d524cf9b929374a790 Parents: 6acc72a Author: felixcheung <felixcheun...@hotmail.com> Authored: Sat Apr 23 11:08:19 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Sat Apr 2

spark git commit: [SPARK-13178] RRDD faces with concurrency issue in case of rdd.zip(rdd).count().

2016-04-22 Thread shivaram
Rui <rui@intel.com> Authored: Fri Apr 22 11:19:52 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Fri Apr 22 11:19:52 2016 -0700 -- R/pkg/inst/tests/testthat/test_mllib.R | 2

spark git commit: [SPARK-12224][SPARKR] R support for JDBC source

2016-04-19 Thread shivaram
mail.com> Closes #10480 from felixcheung/rreadjdbc. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ecd877e8 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/ecd877e8 Diff: http://git-wip-us.a

spark git commit: [SPARK-13812][SPARKR] Fix SparkR lint-r test errors.

2016-03-13 Thread shivaram
pache.org/repos/asf/spark/tree/c7e68c39 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/c7e68c39 Branch: refs/heads/master Commit: c7e68c3968357268f705dee1477c448472c21547 Parents: 515e4af Author: Sun Rui <rui@intel.com> Authored: Sun Mar 13 14:30:44 2016 -0700 Committer: Shivar

spark git commit: [SPARK-13389][SPARKR] SparkR support first/last with ignore NAs

2016-03-10 Thread shivaram
Repository: spark Updated Branches: refs/heads/master c3a6269ca -> 4d535d1f1 [SPARK-13389][SPARKR] SparkR support first/last with ignore NAs ## What changes were proposed in this pull request? SparkR support first/last with ignore NAs cc sun-rui felixcheung shivaram ##

spark git commit: [SPARK-13327][SPARKR] Added parameter validations for colnames<-

2016-03-10 Thread shivaram
Closes #11220 from olarayej/SPARK-13312-3. (cherry picked from commit 416e71af4d26e67afb715ea1d625341cdea4873d) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/co

spark git commit: [SPARK-13327][SPARKR] Added parameter validations for colnames<-

2016-03-10 Thread shivaram
Branch: refs/heads/master Commit: 416e71af4d26e67afb715ea1d625341cdea4873d Parents: 88fa866 Author: Oscar D. Lara Yejas <odlar...@oscars-mbp.attlocal.net> Authored: Thu Mar 10 17:10:23 2016 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed:

spark git commit: [SPARK-12629][SPARKR] Fixes for DataFrame saveAsTable method

2016-02-02 Thread shivaram
nks! Author: Narine Kokhlikyan <narine.kokhlik...@gmail.com> Closes #10580 from NarineK/sparkrSavaAsRable. (cherry picked from commit 8a88e121283472c26e70563a4e04c109e9b183b3) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos

spark git commit: [SPARK-12903][SPARKR] Add covar_samp and covar_pop for SparkR

2016-01-26 Thread shivaram
ion at stats.R which masks ```stats::cov``` already, but may bring to breaking API change. cc sun-rui felixcheung shivaram Author: Yanbo Liang <yblia...@gmail.com> Closes #10829 from yanboliang/spark-12903. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.a

spark git commit: [SPARK-12629][SPARKR] Fixes for DataFrame saveAsTable method

2016-01-22 Thread shivaram
e121 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/8a88e121 Branch: refs/heads/master Commit: 8a88e121283472c26e70563a4e04c109e9b183b3 Parents: e13c147 Author: Narine Kokhlikyan <narine.kokhlik...@gmail.com> Authored: Fri Jan 22 10:35:02 2016 -0800 Committer: Shivaram Venk

spark git commit: [SPARK-12204][SPARKR] Implement drop method for DataFrame in SparkR.

2016-01-20 Thread shivaram
: Sun Rui <rui@intel.com> Authored: Wed Jan 20 21:08:15 2016 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Wed Jan 20 21:08:15 2016 -0800 -- R/pkg/NAMESPACE

spark git commit: [SPARK-12910] Fixes : R version for installing sparkR

2016-01-20 Thread shivaram
hor: Shubhanshu Mishra <smish...@illinois.edu> Authored: Wed Jan 20 18:06:06 2016 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Wed Jan 20 18:06:06 2016 -0800 -- R/README.md | 10 ++

spark git commit: [SPARK-12337][SPARKR] Implement dropDuplicates() method of DataFrame in SparkR.

2016-01-19 Thread shivaram
a6 Author: Sun Rui <rui@intel.com> Authored: Tue Jan 19 16:37:18 2016 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Tue Jan 19 16:37:18 2016 -0800 -- R/pkg/NAMESPACE

spark git commit: [SPARK-12168][SPARKR] Add automated tests for conflicted function in R

2016-01-19 Thread shivaram
rg/repos/asf/spark/tree/37fefa66 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/37fefa66 Branch: refs/heads/master Commit: 37fefa66cbd61bc592aba42b0ed3aefc0cf3abb0 Parents: 3e84ef0 Author: felixcheung <felixcheun...@hotmail.com> Authored: Tue Jan 19 16:33:48 2016 -0800 Committer: Shi

spark git commit: [SPARK-12232][SPARKR] New R API for read.table to avoid name conflict

2016-01-19 Thread shivaram
Repository: spark Updated Branches: refs/heads/master beda90142 -> 488bbb216 [SPARK-12232][SPARKR] New R API for read.table to avoid name conflict shivaram sorry it took longer to fix some conflicts, this is the change to add an alias for `table` Author: felixcheung <feli

spark git commit: [SPARK-12862][SPARKR] Jenkins does not run R tests

2016-01-17 Thread shivaram
Repository: spark Updated Branches: refs/heads/master cede7b2a1 -> 92502703f [SPARK-12862][SPARKR] Jenkins does not run R tests Slight correction: I'm leaving sparkR as-is (ie. R file not supported) and fixed only run-tests.sh as shivaram described. I also assume we are going to cover

spark git commit: [SPARK-11031][SPARKR] Method str() on a DataFrame

2016-01-15 Thread shivaram
he.org/repos/asf/spark/tree/ba4a6419 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/ba4a6419 Branch: refs/heads/master Commit: ba4a641902f95c5a9b3a6bebcaa56039eca2720d Parents: 96fb894 Author: Oscar D. Lara Yejas <odlar...@oscars-mbp.usca.ibm.com> Authored: Fri Jan 15 07:37:54 2016 -0800

spark git commit: [SPARK-11031][SPARKR] Method str() on a DataFrame

2016-01-15 Thread shivaram
<oscar.lara.ye...@us.ibm.com> Author: Oscar D. Lara Yejas <odlar...@oscars-mbp.attlocal.net> Closes #9613 from olarayej/SPARK-11031. (cherry picked from commit ba4a641902f95c5a9b3a6bebcaa56039eca2720d) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http:

spark git commit: [SPARK-12645][SPARKR] SparkR support hash function

2016-01-08 Thread shivaram
er Commit: 3d77cffec093bed4d330969f1a996f3358b9a772 Parents: 95cd5d9 Author: Yanbo Liang <yblia...@gmail.com> Authored: Sat Jan 9 12:29:51 2016 +0530 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Sat Jan 9 12:29:51 2016 +0530 --

spark git commit: [SPARK-12645][SPARKR] SparkR support hash function

2016-01-08 Thread shivaram
cked from commit 3d77cffec093bed4d330969f1a996f3358b9a772) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/8b5f2304 Tree: http://git-wip-us.apache.org/repos

spark git commit: [SPARK-12393][SPARKR] Add read.text and write.text for SparkR

2016-01-05 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-1.6 bf3dca2df -> c3135d021 [SPARK-12393][SPARKR] Add read.text and write.text for SparkR Add ```read.text``` and ```write.text``` for SparkR. cc sun-rui felixcheung shivaram Author: Yanbo Liang <yblia...@gmail.com> Closes #1

spark git commit: [SPARK-12393][SPARKR] Add read.text and write.text for SparkR

2016-01-05 Thread shivaram
Repository: spark Updated Branches: refs/heads/master b3ba1be3b -> d1fea4136 [SPARK-12393][SPARKR] Add read.text and write.text for SparkR Add ```read.text``` and ```write.text``` for SparkR. cc sun-rui felixcheung shivaram Author: Yanbo Liang <yblia...@gmail.com> Closes #1

spark git commit: [SPARKR][DOC] minor doc update for version in migration guide

2016-01-04 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-1.6 8ac919809 -> 8950482ee [SPARKR][DOC] minor doc update for version in migration guide checked that the change is in Spark 1.6.0. shivaram Author: felixcheung <felixcheun...@hotmail.com> Closes #10574 from felixcheung/rwri

spark git commit: [SPARK-12327][SPARKR] fix code for lintr warning for commented code

2016-01-03 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 6c5bbd628 -> c3d505602 [SPARK-12327][SPARKR] fix code for lintr warning for commented code shivaram Author: felixcheung <felixcheun...@hotmail.com> Closes #10408 from felixcheung/rcodecomment. Project: http://git-wip-us.a

spark git commit: [SPARK-12327][SPARKR] fix code for lintr warning for commented code

2016-01-03 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-1.6 cd86075b5 -> 4e9dd1698 [SPARK-12327][SPARKR] fix code for lintr warning for commented code shivaram Author: felixcheung <felixcheun...@hotmail.com> Closes #10408 from felixcheung/rcodecomment. (cherry picked fr

spark git commit: [SPARK-12526][SPARKR] ifelse`, `when`, `otherwise` unable to take Column as value

2015-12-28 Thread shivaram
/repos/asf/spark/tree/d80cc90b Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/d80cc90b Branch: refs/heads/master Commit: d80cc90b5545cff82cd9b340f12d01eafc9ca524 Parents: 73862a1 Author: Forest Fang <forest.f...@outlook.com> Authored: Tue Dec 29 12:45:24 2015 +0530 Committer: Shivaram Venkataram

spark git commit: [SPARK-12526][SPARKR] ifelse`, `when`, `otherwise` unable to take Column as value

2015-12-28 Thread shivaram
r: Test failures Execution halted ``` Author: Forest Fang <forest.f...@outlook.com> Closes #10481 from saurfang/spark-12526. (cherry picked from commit d80cc90b5545cff82cd9b340f12d01eafc9ca524) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-

spark git commit: [SPARK-10500][SPARKR] sparkr.zip cannot be created if /R/lib is unwritable

2015-12-18 Thread shivaram
lt;rui@intel.com> Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Closes #10372 from sun-rui/SPARK-10500-branch-1.5. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d2f71c27 Tree: http://git-wip-us.apach

spark git commit: [SPARK-12310][SPARKR] Add write.json and write.parquet for SparkR

2015-12-16 Thread shivaram
il.com> Closes #10281 from yanboliang/spark-12310. (cherry picked from commit 22f6cd86fc2e2d6f6ad2c3aae416732c46ebf1b1) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/a

spark git commit: [SPARK-12310][SPARKR] Add write.json and write.parquet for SparkR

2015-12-16 Thread shivaram
/22f6cd86 Branch: refs/heads/master Commit: 22f6cd86fc2e2d6f6ad2c3aae416732c46ebf1b1 Parents: 2eb5af5 Author: Yanbo Liang <yblia...@gmail.com> Authored: Wed Dec 16 10:34:30 2015 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Wed Dec 1

spark git commit: [SPARK-12318][SPARKR] Save mode in SparkR should be error by default

2015-12-16 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 54c512ba9 -> 2eb5af5f0 [SPARK-12318][SPARKR] Save mode in SparkR should be error by default shivaram Please help review. Author: Jeff Zhang <zjf...@apache.org> Closes #10290 from zjffdu/SPARK-12318. Project: http:

spark git commit: [SPARK-12318][SPARKR] Save mode in SparkR should be error by default

2015-12-16 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-1.6 16edd933d -> f81512729 [SPARK-12318][SPARKR] Save mode in SparkR should be error by default shivaram Please help review. Author: Jeff Zhang <zjf...@apache.org> Closes #10290 from zjffdu/SPARK-12318. (cherry picked fr

spark git commit: [SPARK-12327] Disable commented code lintr temporarily

2015-12-14 Thread shivaram
Repository: spark Updated Branches: refs/heads/master b51a4cdff -> fb3778de6 [SPARK-12327] Disable commented code lintr temporarily cc yhuai felixcheung shaneknapp Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Closes #10300 from shivaram/comment-lintr-disable. Proj

spark git commit: [SPARK-12327] Disable commented code lintr temporarily

2015-12-14 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-1.6 c0f0f6cb0 -> 352a0c80f [SPARK-12327] Disable commented code lintr temporarily cc yhuai felixcheung shaneknapp Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Closes #10300 from shivaram/comment-lintr-disable. (cher

spark git commit: [SPARK-12158][SPARKR][SQL] Fix 'sample' functions that break R unit test cases

2015-12-11 Thread shivaram
ile <gatorsm...@gmail.com> Closes #10160 from gatorsmile/sampleR. (cherry picked from commit 1e3526c2d3de723225024fedd45753b556e18fc6) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.a

spark git commit: [SPARK-12158][SPARKR][SQL] Fix 'sample' functions that break R unit test cases

2015-12-11 Thread shivaram
repos/asf/spark/diff/1e3526c2 Branch: refs/heads/master Commit: 1e3526c2d3de723225024fedd45753b556e18fc6 Parents: 1e799d6 Author: gatorsmile <gatorsm...@gmail.com> Authored: Fri Dec 11 20:55:16 2015 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Fri Dec 1

spark git commit: [SPARK-12146][SPARKR] SparkR jsonFile should support multiple input files

2015-12-11 Thread shivaram
L.R, but still keep jsonFile test case. * If this PR is accepted, we should also make almost the same change for ```parquetFile```. cc felixcheung sun-rui shivaram Author: Yanbo Liang <yblia...@gmail.com> Closes #10145 from yanboliang/spark-12146. Project: http://git-wip-us.apache.org/repos/

spark git commit: [SPARK-12146][SPARKR] SparkR jsonFile should support multiple input files

2015-12-11 Thread shivaram
L.R, but still keep jsonFile test case. * If this PR is accepted, we should also make almost the same change for ```parquetFile```. cc felixcheung sun-rui shivaram Author: Yanbo Liang <yblia...@gmail.com> Closes #10145 from yanboliang/spark-12146. (cherry picked fr

spark git commit: [SPARK-12198][SPARKR] SparkR support read.parquet and deprecate parquetFile

2015-12-10 Thread shivaram
pache.org/repos/asf/spark/diff/eeb58722 Branch: refs/heads/master Commit: eeb58722ad73441eeb5f35f864be3c5392cfd426 Parents: db51652 Author: Yanbo Liang <yblia...@gmail.com> Authored: Thu Dec 10 09:44:53 2015 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Thu

spark git commit: [SPARK-12234][SPARKR] Fix ```subset``` function error when only set ```select``` argument

2015-12-10 Thread shivaram
tps://issues.apache.org/jira/browse/SPARK-12234) about the error and how to reproduce it. cc sun-rui felixcheung shivaram Author: Yanbo Liang <yblia...@gmail.com> Closes #10217 from yanboliang/spark-12234. (cherry picked from commit d9d354ed40eec56b3f03d32f4e2629d367b1bf02) Signed-off-by: Shivaram Ven

spark git commit: [SPARK-12198][SPARKR] SparkR support read.parquet and deprecate parquetFile

2015-12-10 Thread shivaram
hor: Yanbo Liang <yblia...@gmail.com> Closes #10191 from yanboliang/spark-12198. (cherry picked from commit eeb58722ad73441eeb5f35f864be3c5392cfd426) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [SPARK-12234][SPARKR] Fix ```subset``` function error when only set ```select``` argument

2015-12-10 Thread shivaram
org/jira/browse/SPARK-12234) about the error and how to reproduce it. cc sun-rui felixcheung shivaram Author: Yanbo Liang <yblia...@gmail.com> Closes #10217 from yanboliang/spark-12234. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/

[2/4] spark git commit: [SPARK-12034][SPARKR] Eliminate warnings in SparkR test cases.

2015-12-07 Thread shivaram
http://git-wip-us.apache.org/repos/asf/spark/blob/39d677c8/R/pkg/inst/tests/testthat/test_binaryFile.R -- diff --git a/R/pkg/inst/tests/testthat/test_binaryFile.R b/R/pkg/inst/tests/testthat/test_binaryFile.R new file mode 100644

[4/4] spark git commit: [SPARK-12034][SPARKR] Eliminate warnings in SparkR test cases.

2015-12-07 Thread shivaram
Commit: 39d677c8f1ee7ebd7e142bec0415cf8f90ac84b6 Parents: 9cde7d5 Author: Sun Rui <rui@intel.com> Authored: Mon Dec 7 10:38:17 2015 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Mon Dec 7 10:38:17 2015 -0800 ---

[3/4] spark git commit: [SPARK-12034][SPARKR] Eliminate warnings in SparkR test cases.

2015-12-07 Thread shivaram
http://git-wip-us.apache.org/repos/asf/spark/blob/39d677c8/R/pkg/inst/tests/test_sparkSQL.R -- diff --git a/R/pkg/inst/tests/test_sparkSQL.R b/R/pkg/inst/tests/test_sparkSQL.R deleted file mode 100644 index 6ef03ae..000 ---

[1/4] spark git commit: [SPARK-12034][SPARKR] Eliminate warnings in SparkR test cases.

2015-12-07 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 9cde7d5fa -> 39d677c8f http://git-wip-us.apache.org/repos/asf/spark/blob/39d677c8/R/pkg/inst/tests/testthat/test_sparkSQL.R -- diff --git

[2/4] spark git commit: [SPARK-12034][SPARKR] Eliminate warnings in SparkR test cases.

2015-12-07 Thread shivaram
http://git-wip-us.apache.org/repos/asf/spark/blob/3f230f7b/R/pkg/inst/tests/testthat/test_binaryFile.R -- diff --git a/R/pkg/inst/tests/testthat/test_binaryFile.R b/R/pkg/inst/tests/testthat/test_binaryFile.R new file mode 100644

[1/4] spark git commit: [SPARK-12034][SPARKR] Eliminate warnings in SparkR test cases.

2015-12-07 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-1.6 c54b698ec -> 3f230f7b3 http://git-wip-us.apache.org/repos/asf/spark/blob/3f230f7b/R/pkg/inst/tests/testthat/test_sparkSQL.R -- diff --git

spark git commit: [SPARK-12044][SPARKR] Fix usage of isnan, isNaN

2015-12-05 Thread shivaram
ace ```DataFrame.isNaN``` with ```DataFrame.isnan``` at SparkR side. Because ```DataFrame.isNaN``` has been deprecated and will be removed at Spark 2.0. 3, Add ```isnull``` to ```DataFrame``` for SparkR. ```DataFrame``` should has two related functions: ```isnan, isnull```. cc shivaram sun-rui felixcheung Aut

spark git commit: [SPARK-11774][SPARKR] Implement struct(), encode(), decode() functions in SparkR.

2015-12-05 Thread shivaram
: 7da6748 Author: Sun Rui <rui@intel.com> Authored: Sat Dec 5 15:49:51 2015 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Sat Dec 5 15:49:51 2015 -0800 -- R/pkg/NAMESPACE

spark git commit: [SPARK-11774][SPARKR] Implement struct(), encode(), decode() functions in SparkR.

2015-12-05 Thread shivaram
om commit c8d0e160dadf3b23c5caa379ba9ad5547794eaa0) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/57d16403 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/57d16403 Diff:

spark git commit: [SPARK-11715][SPARKR] Add R support corr for Column Aggregration

2015-12-05 Thread shivaram
cked from commit 895b6c474735d7e0a38283f92292daa5c35875ee) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/664694b2 Tree: http://git-wip-us.apache.org/repos

spark git commit: [SPARK-11715][SPARKR] Add R support corr for Column Aggregration

2015-12-05 Thread shivaram
er Commit: 895b6c474735d7e0a38283f92292daa5c35875ee Parents: c8d0e16 Author: felixcheung <felixcheun...@hotmail.com> Authored: Sat Dec 5 16:00:12 2015 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Sat Dec 5 16:00:12 2015 -0800 --

spark git commit: [SPARK-12115][SPARKR] Change numPartitions() to getNumPartitions() to be consistent with Scala/Python

2015-12-05 Thread shivaram
can not catch up with 1.6 release, it will be breaking change for 1.7 that we also need to explain in release note. cc sun-rui felixcheung shivaram Author: Yanbo Liang <yblia...@gmail.com> Closes #10123 from yanboliang/spark-12115. (cherry picked fr

spark git commit: [SPARK-12115][SPARKR] Change numPartitions() to getNumPartitions() to be consistent with Scala/Python

2015-12-05 Thread shivaram
can not catch up with 1.6 release, it will be breaking change for 1.7 that we also need to explain in release note. cc sun-rui felixcheung shivaram Author: Yanbo Liang <yblia...@gmail.com> Closes #10123 from yanboliang/spark-12115. Project: http://git-wip-us.apache.org/repos/asf/spark/re

spark git commit: [SPARK-12104][SPARKR] collect() does not handle multiple columns with same name.

2015-12-03 Thread shivaram
: b6e9963 Author: Sun Rui <rui@intel.com> Authored: Thu Dec 3 21:11:10 2015 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Thu Dec 3 21:11:10 2015 -0800 -- R/pkg/R/DataFrame.R

spark git commit: [SPARK-12104][SPARKR] collect() does not handle multiple columns with same name.

2015-12-03 Thread shivaram
om commit 5011f264fb53705c528250bd055acbc2eca2baaa) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/2d7c4f6a Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/2d7c4f6a Diff:

spark git commit: [SPARK-12116][SPARKR][DOCS] document how to workaround function name conflicts with dplyr

2015-12-03 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-1.6 84cbed17e -> f7ae62c45 [SPARK-12116][SPARKR][DOCS] document how to workaround function name conflicts with dplyr shivaram Author: felixcheung <felixcheun...@hotmail.com> Closes #10119 from felixcheung/rdocdplyrmasked.

spark git commit: [SPARK-12116][SPARKR][DOCS] document how to workaround function name conflicts with dplyr

2015-12-03 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 95b3cf125 -> 43c575cb1 [SPARK-12116][SPARKR][DOCS] document how to workaround function name conflicts with dplyr shivaram Author: felixcheung <felixcheun...@hotmail.com> Closes #10119 from felixcheung/rdocdplyrmasked. Proj

spark git commit: [SPARK-12107][EC2] Update spark-ec2 versions

2015-12-03 Thread shivaram
0b175b2ab) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/9d698fc5 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/9d698fc5 Diff: http://git-wip-us.apach

spark git commit: [SPARK-12107][EC2] Update spark-ec2 versions

2015-12-03 Thread shivaram
s Chammas <nicholas.cham...@gmail.com> Authored: Thu Dec 3 11:59:10 2015 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Thu Dec 3 11:59:10 2015 -0800 -- ec2/spark_ec2.py | 12 +-

spark git commit: [SPARK-12019][SPARKR] Support character vector for sparkR.init(), check param and fix doc

2015-12-03 Thread shivaram
e Branch: refs/heads/master Commit: 2213441e5e0fba01e05826257604aa427cdf2598 Parents: a02d472 Author: felixcheung <felixcheun...@hotmail.com> Authored: Thu Dec 3 13:25:20 2015 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Thu Dec

spark git commit: [SPARK-12019][SPARKR] Support character vector for sparkR.init(), check param and fix doc

2015-12-03 Thread shivaram
es #10034 from felixcheung/sparkrinitdoc. (cherry picked from commit 2213441e5e0fba01e05826257604aa427cdf2598) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commi

spark git commit: Set SPARK_EC2_VERSION to 1.5.2

2015-12-01 Thread shivaram
Pivovarov <apivova...@gmail.com> Authored: Tue Dec 1 01:17:49 2015 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Tue Dec 1 01:17:49 2015 -0800 -- ec2/spark_ec2.py | 2 +- 1 file changed, 1 ins

spark git commit: [SPARK-11781][SPARKR] SparkR has problem in inferring type of raw type.

2015-11-29 Thread shivaram
: Sun Rui <rui@intel.com> Authored: Sun Nov 29 11:08:26 2015 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Sun Nov 29 11:08:26 2015 -0800 -- R/pkg/R/DataFram

spark git commit: [SPARK-11781][SPARKR] SparkR has problem in inferring type of raw type.

2015-11-29 Thread shivaram
om commit cc7a1bc9370b163f51230e5ca4be612d133a5086) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/5601d8fd Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/5601d8fd Diff: http://git-wi

spark git commit: [SPARK-9319][SPARKR] Add support for setting column names, types

2015-11-28 Thread shivaram
with PR 8984 (coltypes). Clicked the wrong thing, crewed up the PR. Recreated it here. Was #9218 shivaram sun-rui Author: felixcheung <felixcheun...@hotmail.com> Closes #9654 from felixcheung/colnamescoltypes. (cherry picked from commit c793d2d9a1ccc203fc103eb0636958fe8d71f471) Signe

spark git commit: [SPARK-9319][SPARKR] Add support for setting column names, types

2015-11-28 Thread shivaram
with PR 8984 (coltypes). Clicked the wrong thing, crewed up the PR. Recreated it here. Was #9218 shivaram sun-rui Author: felixcheung <felixcheun...@hotmail.com> Closes #9654 from felixcheung/colnamescoltypes. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.ap

spark git commit: [SPARK-12029][SPARKR] Improve column functions signature, param check, tests, fix doc and add examples

2015-11-28 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-1.6 2ecc0f243 -> 2503a4350 [SPARK-12029][SPARKR] Improve column functions signature, param check, tests, fix doc and add examples shivaram sun-rui Author: felixcheung <felixcheun...@hotmail.com> Closes #10019 from fe

spark git commit: [SPARK-12029][SPARKR] Improve column functions signature, param check, tests, fix doc and add examples

2015-11-28 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 149cd692e -> 28e46ab46 [SPARK-12029][SPARKR] Improve column functions signature, param check, tests, fix doc and add examples shivaram sun-rui Author: felixcheung <felixcheun...@hotmail.com> Closes #10019 from felixcheung/rfun

spark git commit: [SPARK-12025][SPARKR] Rename some window rank function names for SparkR

2015-11-27 Thread shivaram
ore 1.6 release, otherwise we will make breaking API change. cc shivaram sun-rui Author: Yanbo Liang <yblia...@gmail.com> Closes #10016 from yanboliang/SPARK-12025. (cherry picked from commit ba02f6cb5a40511cefa511d410be93c035d43f23) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berke

spark git commit: [SPARK-11756][SPARKR] Fix use of aliases - SparkR can not output help information for SparkR:::summary correctly

2015-11-20 Thread shivaram
i/R/count.html) Also changing some rdname for dplyr-like variant for better R user visibility in R doc, eg. rbind, summary, mutate, summarize shivaram yanboliang Author: felixcheung <felixcheun...@hotmail.com> Closes #9750 from felixcheung/rdocaliases. Project: http://git-wip-us.apache.org/repos/

spark git commit: [SPARK-11756][SPARKR] Fix use of aliases - SparkR can not output help information for SparkR:::summary correctly

2015-11-20 Thread shivaram
i/R/count.html) Also changing some rdname for dplyr-like variant for better R user visibility in R doc, eg. rbind, summary, mutate, summarize shivaram yanboliang Author: felixcheung <felixcheun...@hotmail.com> Closes #9750 from felixcheung/rdocaliases. (cherry picked fr

spark git commit: [SPARK-11773][SPARKR] Implement collection functions in SparkR.

2015-11-18 Thread shivaram
1188ada8f) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/8ac518c1 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/8ac518c1 Diff: http://git-wip-us.a

spark git commit: [SPARK-11773][SPARKR] Implement collection functions in SparkR.

2015-11-18 Thread shivaram
Rui <rui@intel.com> Authored: Wed Nov 18 08:41:45 2015 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Wed Nov 18 08:41:45 2015 -0800 -- R/pkg/NAMESPACE | 2 +

spark git commit: [SPARK-11281][SPARKR] Add tests covering the issue.

2015-11-18 Thread shivaram
086). Author: zero323 <matthew.szymkiew...@gmail.com> Closes #9743 from zero323/SPARK-11281-tests. (cherry picked from commit a97d6f3a5861e9f2bbe36957e3b39f835f3e214c) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/re

spark git commit: [SPARK-11339][SPARKR] Document the list of functions in R base package that are masked by functions with same name in SparkR

2015-11-18 Thread shivaram
thor: felixcheung <felixcheun...@hotmail.com> Closes #9785 from felixcheung/rmasked. (cherry picked from commit 1a93323c5bab18ed7e55bf6f7b13aae88cb9721c) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: htt

spark git commit: [SPARK-11339][SPARKR] Document the list of functions in R base package that are masked by functions with same name in SparkR

2015-11-18 Thread shivaram
-us.apache.org/repos/asf/spark/diff/1a93323c Branch: refs/heads/master Commit: 1a93323c5bab18ed7e55bf6f7b13aae88cb9721c Parents: d02d5b9 Author: felixcheung <felixcheun...@hotmail.com> Authored: Wed Nov 18 23:32:49 2015 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.ed

spark git commit: [SPARK-11755][R] SparkR should export "predict"

2015-11-17 Thread shivaram
@gmail.com> Authored: Tue Nov 17 22:13:15 2015 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Tue Nov 17 22:13:15 2015 -0800 -- R/pkg/R/generics.R | 4

<    1   2   3   4   5   >