spark git commit: [SPARKR][DOCS] fix broken url in doc

2016-07-25 Thread shivaram
786213920.png) ## How was this patch tested? manual test Author: Felix Cheung <felixcheun...@hotmail.com> Closes #14329 from felixcheung/rdoclinkfix. (cherry picked from commit b73defdd790cb823a4f9958ca89cec06fd198051) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu>

spark git commit: [SPARKR][DOCS] fix broken url in doc

2016-07-25 Thread shivaram
t-wip-us.apache.org/repos/asf/spark/tree/b73defdd Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/b73defdd Branch: refs/heads/master Commit: b73defdd790cb823a4f9958ca89cec06fd198051 Parents: 7ea6d28 Author: Felix Cheung <felixcheun...@hotmail.com> Authored: Mon Jul 25 11:25:41 2016

spark git commit: [SPARK-10683][SPARK-16510][SPARKR] Move SparkR include jar test to SparkSubmitSuite

2016-07-19 Thread shivaram
ses a dynamically compiled jar. This helps us remove the binary jar from the R package and solves both the CRAN warnings and the lack of source being available for this jar. ## How was this patch tested? SparkR unit tests, SparkSubmitSuite, check-cran.sh Author: Shivaram Venkataraman <

spark git commit: [SPARK-10683][SPARK-16510][SPARKR] Move SparkR include jar test to SparkSubmitSuite

2016-07-19 Thread shivaram
ses a dynamically compiled jar. This helps us remove the binary jar from the R package and solves both the CRAN warnings and the lack of source being available for this jar. ## How was this patch tested? SparkR unit tests, SparkSubmitSuite, check-cran.sh Author: Shivaram Venkataraman <

spark git commit: [SPARKR][DOCS] minor code sample update in R programming guide

2016-07-18 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-2.0 33d92f7f3 -> 7889585cc [SPARKR][DOCS] minor code sample update in R programming guide ## What changes were proposed in this pull request? Fix code style from ad hoc review of RC4 doc ## How was this patch tested? manual shiva

spark git commit: [SPARKR][DOCS] minor code sample update in R programming guide

2016-07-18 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 96e9afaae -> 75f0efe74 [SPARKR][DOCS] minor code sample update in R programming guide ## What changes were proposed in this pull request? Fix code style from ad hoc review of RC4 doc ## How was this patch tested? manual shiva

spark git commit: [SPARK-16055][SPARKR] warning added while using sparkPackages with spark-submit

2016-07-18 Thread shivaram
er Commit: 8ea3f4eaec65ee4277f9943063fcc9488d3fa924 Parents: a529fc9 Author: krishnakalyan3 <krishnakaly...@gmail.com> Authored: Mon Jul 18 09:46:23 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Mon Jul 1

spark git commit: [SPARK-16055][SPARKR] warning added while using sparkPackages with spark-submit

2016-07-18 Thread shivaram
(cherry picked from commit 8ea3f4eaec65ee4277f9943063fcc9488d3fa924) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/085f3cc8 Tree: http://git-wip-us.apach

spark git commit: [SPARK-16027][SPARKR] Fix R tests SparkSession init/stop

2016-07-17 Thread shivaram
ted? unit tests shivaram Author: Felix Cheung <felixcheun...@hotmail.com> Closes #14177 from felixcheung/rsessiontest. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d27fe9ba Tree: http://git-wip-us.apache.org/repos/

[2/2] spark git commit: [SPARK-16507][SPARKR] Add a CRAN checker, fix Rd aliases

2016-07-16 Thread shivaram
fixes ## How was this patch tested? SparkR unit tests, running the above mentioned script Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Closes #14173 from shivaram/sparkr-cran-changes. (cherry picked from commit c33e4b0d96d424568963c7e716c20f02949c72d1) Signed-off-by: Sh

[1/2] spark git commit: [SPARK-16507][SPARKR] Add a CRAN checker, fix Rd aliases

2016-07-16 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 416730483 -> c33e4b0d9 http://git-wip-us.apache.org/repos/asf/spark/blob/c33e4b0d/R/pkg/R/generics.R -- diff --git a/R/pkg/R/generics.R b/R/pkg/R/generics.R index

[1/2] spark git commit: [SPARK-16507][SPARKR] Add a CRAN checker, fix Rd aliases

2016-07-16 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-2.0 8c2ec443b -> c527e9ed4 http://git-wip-us.apache.org/repos/asf/spark/blob/c527e9ed/R/pkg/R/generics.R -- diff --git a/R/pkg/R/generics.R b/R/pkg/R/generics.R index

[2/2] spark git commit: [SPARK-16507][SPARKR] Add a CRAN checker, fix Rd aliases

2016-07-16 Thread shivaram
fixes ## How was this patch tested? SparkR unit tests, running the above mentioned script Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Closes #14173 from shivaram/sparkr-cran-changes. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apac

spark git commit: [SPARK-16112][SPARKR] Programming guide for gapply/gapplyCollect

2016-07-16 Thread shivaram
5 Parents: 5ec0d69 Author: Narine Kokhlikyan <nar...@slice.com> Authored: Sat Jul 16 16:56:16 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Sat Jul 16 16:56:16 2016 -0700 --

spark git commit: [SPARK-16112][SPARKR] Programming guide for gapply/gapplyCollect

2016-07-16 Thread shivaram
om commit 416730483643a0a92dbd6ae4ad07e80ceb3c5285) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/8c2ec443 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/8c2e

spark git commit: [SPARK-16538][SPARKR] Add more tests for namespace call to SparkSession functions

2016-07-15 Thread shivaram
ark 2.0.1 or 2.1.0. ## How was this patch tested? unit tests shivaram dongjoon-hyun Author: Felix Cheung <felixcheun...@hotmail.com> Closes #14206 from felixcheung/rroutetests. (cherry picked from commit 611a8ca5895357059f1e7c035d946e0718b26a5a) Signed-off-by: Shivaram Venkataram

spark git commit: [SPARK-16538][SPARKR] Add more tests for namespace call to SparkSession functions

2016-07-15 Thread shivaram
0.1 or 2.1.0. ## How was this patch tested? unit tests shivaram dongjoon-hyun Author: Felix Cheung <felixcheun...@hotmail.com> Closes #14206 from felixcheung/rroutetests. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spa

spark git commit: [SPARK-16538][SPARKR] fix R call with namespace operator on SparkSession functions

2016-07-14 Thread shivaram
rkR::createDataFrame` ## How was this patch tested? manual, unit tests shivaram Author: Felix Cheung <felixcheun...@hotmail.com> Closes #14195 from felixcheung/rroutedefault. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit

spark git commit: [SPARK-16538][SPARKR] fix R call with namespace operator on SparkSession functions

2016-07-14 Thread shivaram
rkR::createDataFrame` ## How was this patch tested? manual, unit tests shivaram Author: Felix Cheung <felixcheun...@hotmail.com> Closes #14195 from felixcheung/rroutedefault. (cherry picked from commit 12005c88fb24168d57b577cff73eddcd9d8963fc) Signed-off-by: Shivaram Venkataram

spark git commit: [SPARK-16509][SPARKR] Rename window.partitionBy and window.orderBy to windowPartitionBy and windowOrderBy.

2016-07-14 Thread shivaram
red: Thu Jul 14 09:38:42 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Thu Jul 14 09:38:42 2016 -0700 -- R/pkg/NAMESPACE | 4 +- R/pkg/R/WindowSpec.R

spark git commit: [SPARKR][DOCS][MINOR] R programming guide to include csv data source example

2016-07-13 Thread shivaram
nce to "sparkR.init" ## How was this patch tested? manual shivaram Author: Felix Cheung <felixcheun...@hotmail.com> Closes #14178 from felixcheung/rcsvprogrammingguide. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/c

spark git commit: [SPARKR][MINOR] R examples and test updates

2016-07-13 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 51a6706b1 -> b4baf086c [SPARKR][MINOR] R examples and test updates ## What changes were proposed in this pull request? Minor example updates ## How was this patch tested? manual shivaram Author: Felix Cheung <felixcheun...@hotma

spark git commit: [SPARKR][MINOR] R examples and test updates

2016-07-13 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-2.0 86adc5cfb -> 18255a934 [SPARKR][MINOR] R examples and test updates ## What changes were proposed in this pull request? Minor example updates ## How was this patch tested? manual shivaram Author: Felix Cheung <feli

spark git commit: [SPARK-16144][SPARKR] update R API doc for mllib

2016-07-11 Thread shivaram
from commit 7f38b9d5f469b2550bc481cbf9adb9acc3779712) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/cb463b6d Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/cb463b6d Di

spark git commit: [SPARK-16144][SPARKR] update R API doc for mllib

2016-07-11 Thread shivaram
d031b Author: Felix Cheung <felixcheun...@hotmail.com> Authored: Mon Jul 11 14:34:48 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Mon Jul 11 14:34:48 2016 -0700 -- R/pkg/R/gen

spark git commit: [SPARKR][DOC] SparkR ML user guides update for 2.0

2016-07-11 Thread shivaram
eck the generated docs. Author: Yanbo Liang <yblia...@gmail.com> Closes #14011 from yanboliang/r-user-guide-update. (cherry picked from commit 2ad031be67c7a0f0c4895c084c891330a9ec935e) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/

spark git commit: [SPARKR][DOC] SparkR ML user guides update for 2.0

2016-07-11 Thread shivaram
/2ad031be Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/2ad031be Branch: refs/heads/master Commit: 2ad031be67c7a0f0c4895c084c891330a9ec935e Parents: 840853e Author: Yanbo Liang <yblia...@gmail.com> Authored: Mon Jul 11 14:31:11 2016 -0700 Committer: Shivaram Venkataraman <shiva.

spark git commit: [SPARK-16425][R] `describe()` should not fail with non-numeric columns

2016-07-07 Thread shivaram
commit 6aa7d09f4e126f42e41085dec169c813379ed354) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/73c764a0 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree

spark git commit: [SPARK-16425][R] `describe()` should not fail with non-numeric columns

2016-07-07 Thread shivaram
9c813379ed354 Parents: f4767bc Author: Dongjoon Hyun <dongj...@apache.org> Authored: Thu Jul 7 17:47:29 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Thu Jul 7 17:47:29 2016 -0700 -- R/pkg

spark git commit: [SPARK-16310][SPARKR] R na.string-like default for csv source

2016-07-07 Thread shivaram
tat.ethz.ch/R-manual/R-devel/library/utils/html/read.table.html na.strings = "NA" An user passing a csv file with NA value should get the same behavior with SparkR read.df(... source = "csv") (couldn't open JIRA, will do that later) ## How was this patch tested? unit test

spark git commit: [SPARK-16310][SPARKR] R na.string-like default for csv source

2016-07-07 Thread shivaram
meter. https://stat.ethz.ch/R-manual/R-devel/library/utils/html/read.table.html na.strings = "NA" An user passing a csv file with NA value should get the same behavior with SparkR read.df(... source = "csv") (couldn't open JIRA, will do that later) ## How was this patch tested? un

spark git commit: [SPARK-16233][R][TEST] ORC test should be enabled only when HiveContext is available.

2016-07-01 Thread shivaram
ONE === Tests passed. ``` Author: Dongjoon Hyun <dongj...@apache.org> Closes #14019 from dongjoon-hyun/SPARK-16233. (cherry picked from commit d17e5f2f123eecd5a7a1d87f5ce75a0fc44552b4) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wi

spark git commit: [SPARK-16233][R][TEST] ORC test should be enabled only when HiveContext is available.

2016-07-01 Thread shivaram
asf/spark/tree/d17e5f2f Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/d17e5f2f Branch: refs/heads/master Commit: d17e5f2f123eecd5a7a1d87f5ce75a0fc44552b4 Parents: d601894 Author: Dongjoon Hyun <dongj...@apache.org> Authored: Fri Jul 1 15:35:19 2016 -0700 Committer: Shivaram Venk

spark git commit: [SPARK-16299][SPARKR] Capture errors from R workers in daemon.R to avoid deletion of R session temporary directory.

2016-07-01 Thread shivaram
om commit e4fa58c43ce2bf8d76bffb0d9dc1132f8d0eae6a) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d6588115 Tree: http://git-wip-us.apache.org/repos/asf/spark/tre

spark git commit: [SPARK-16299][SPARKR] Capture errors from R workers in daemon.R to avoid deletion of R session temporary directory.

2016-07-01 Thread shivaram
f8d0eae6a Parents: 26afb4c Author: Sun Rui <sunrui2...@gmail.com> Authored: Fri Jul 1 14:37:03 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Fri Jul 1 14:37:03 2016 -0700 -- R/pkg/inst/work

spark git commit: [SPARK-16012][SPARKR] Implement gapplyCollect which will apply a R function on each group similar to gapply and collect the result back to R data.frame

2016-07-01 Thread shivaram
tch tested? Added test cases for gapplyCollect similar to dapplyCollect Author: Narine Kokhlikyan <nar...@slice.com> Closes #13760 from NarineK/gapplyCollect. (cherry picked from commit 26afb4ce4099e7942f8db1ead3817ed8fbf71ce3) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.ed

spark git commit: [SPARK-16012][SPARKR] Implement gapplyCollect which will apply a R function on each group similar to gapply and collect the result back to R data.frame

2016-07-01 Thread shivaram
-0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Fri Jul 1 13:55:13 2016 -0700 -- R/pkg/NAMESPACE | 1 + R/pkg/R/DataFrame.R | 111 +

spark git commit: [SPARKR] add csv tests

2016-06-28 Thread shivaram
il.com> Closes #13904 from felixcheung/rcsv. (cherry picked from commit 823518c2b5259c8a954431467639198c808c9198) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/

spark git commit: [SPARKR] add csv tests

2016-06-28 Thread shivaram
2 Branch: refs/heads/master Commit: 823518c2b5259c8a954431467639198c808c9198 Parents: 5545b79 Author: Felix Cheung <felixcheun...@hotmail.com> Authored: Tue Jun 28 17:08:28 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Tue Jun 2

spark git commit: [MINOR][SPARKR] update sparkR DataFrame.R comment

2016-06-28 Thread shivaram
Author: WeichenXu <weichenxu...@outlook.com> Closes #13946 from WeichenXu123/sparkR_comment_update_sparkSession. (cherry picked from commit d59ba8e30751bbf91d49f5530b8242a12bbfb569) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/re

spark git commit: [MINOR][SPARKR] update sparkR DataFrame.R comment

2016-06-28 Thread shivaram
59ba8e3 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/d59ba8e3 Branch: refs/heads/master Commit: d59ba8e30751bbf91d49f5530b8242a12bbfb569 Parents: 26252f7 Author: WeichenXu <weichenxu...@outlook.com> Authored: Tue Jun 28 12:12:20 2016 -0700 Committer: Shivaram Venkataraman <shi

spark git commit: [SPARK-16184][SPARKR] conf API for SparkSession

2016-06-26 Thread shivaram
xcheun...@hotmail.com> Closes #13885 from felixcheung/rconf. (cherry picked from commit 30b182bcc088aef161585211c517f473b9ee6632) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/r

spark git commit: [SPARK-16184][SPARKR] conf API for SparkSession

2016-06-26 Thread shivaram
spark/diff/30b182bc Branch: refs/heads/master Commit: 30b182bcc088aef161585211c517f473b9ee6632 Parents: e877415 Author: Felix Cheung <felixcheun...@hotmail.com> Authored: Sun Jun 26 13:10:43 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Sun Jun 26

spark git commit: [SPARK-16088][SPARKR] update setJobGroup, cancelJobGroup, clearJobGroup

2016-06-23 Thread shivaram
t;felixcheun...@hotmail.com> Authored: Thu Jun 23 09:45:01 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Thu Jun 23 09:45:01 2016 -0700 -- R/pkg/R/DataFrame.R | 1

spark git commit: [SPARK-16088][SPARKR] update setJobGroup, cancelJobGroup, clearJobGroup

2016-06-23 Thread shivaram
igned-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/9f18c8f3 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/9f18c8f3 Diff: http://git-wip-us.apache.org/repos

spark git commit: [SPARK-16096][SPARKR] add union and deprecate unionAll

2016-06-21 Thread shivaram
efs/heads/master Commit: dbfdae4e41a900de01b48639d6554d32edbb2e0b Parents: 918c919 Author: Felix Cheung <felixcheun...@hotmail.com> Authored: Tue Jun 21 13:36:50 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Tue Jun 2

spark git commit: [SPARK-16096][SPARKR] add union and deprecate unionAll

2016-06-21 Thread shivaram
3805 from felixcheung/runion. (cherry picked from commit dbfdae4e41a900de01b48639d6554d32edbb2e0b) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/aeda9a15 T

spark git commit: [SPARK-16109][SPARKR][DOC] R more doc fixes

2016-06-21 Thread shivaram
put html Author: Felix Cheung <felixcheun...@hotmail.com> Closes #13803 from felixcheung/rdocrd. (cherry picked from commit 57746295e6fb705f8393a00ab1cc570ddb7da44e) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/sp

spark git commit: [SPARK-16109][SPARKR][DOC] R more doc fixes

2016-06-21 Thread shivaram
iff: http://git-wip-us.apache.org/repos/asf/spark/diff/57746295 Branch: refs/heads/master Commit: 57746295e6fb705f8393a00ab1cc570ddb7da44e Parents: 2d6919b Author: Felix Cheung <felixcheun...@hotmail.com> Authored: Tue Jun 21 11:01:42 2016 -0700 Committer: Shivaram Venkataraman <shiva.

spark git commit: [SPARK-15319][SPARKR][DOCS] Fix SparkR doc layout for corr and other DataFrame stats functions

2016-06-21 Thread shivaram
ion is on which function. ## How was this patch tested? Build doc Author: Felix Cheung <felixcheun...@hotmail.com> Author: felixcheung <felixcheun...@hotmail.com> Closes #13109 from felixcheung/rstatdoc. (cherry picked from commit 843a1eba8ec9d5a7beac0c74b54d24cb3c41b45a) Signed-o

spark git commit: [SPARK-15319][SPARKR][DOCS] Fix SparkR doc layout for corr and other DataFrame stats functions

2016-06-21 Thread shivaram
eun...@hotmail.com> Authored: Tue Jun 21 00:19:09 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Tue Jun 21 00:19:09 2016 -0700 -- R/pkg/R/generics.R | 8 --

spark git commit: [SPARKR][DOCS] R code doc cleanup

2016-06-21 Thread shivaram
ues to be cleaned up. ## How was this patch tested? manual tests Author: Felix Cheung <felixcheun...@hotmail.com> Closes #13798 from felixcheung/rdocseealso. (cherry picked from commit 09f4ceaeb0a99874f774e09d868fdf907ecf256f) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.ed

spark git commit: [SPARKR][DOCS] R code doc cleanup

2016-06-21 Thread shivaram
1:08 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Mon Jun 20 23:51:08 2016 -0700 -- R/pkg/R/DataFrame.R | 39 ++- R/pkg/R/SQLContext.R | 6 +++--- R/pk

spark git commit: [SPARK-15294][R] Add `pivot` to SparkR

2016-06-20 Thread shivaram
9ad7344ee) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/10c476fc Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/10c476fc Diff: http://git-wip-us.a

spark git commit: [SPARK-15294][R] Add `pivot` to SparkR

2016-06-20 Thread shivaram
Dongjoon Hyun <dongj...@apache.org> Authored: Mon Jun 20 21:09:39 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Mon Jun 20 21:09:39 2016 -0700 -- R/pkg/NAMESPACE

spark git commit: remove duplicated docs in dapply

2016-06-20 Thread shivaram
cked from commit e2b7eba87cdf67fa737c32f5f6ca075445ff28cb) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/f5731769 Tree: http://git-wip-us.apache.org/repos

spark git commit: remove duplicated docs in dapply

2016-06-20 Thread shivaram
er Commit: e2b7eba87cdf67fa737c32f5f6ca075445ff28cb Parents: a42bf55 Author: Narine Kokhlikyan <nar...@slice.com> Authored: Mon Jun 20 19:36:51 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Mon Jun 20 19:36:51 2016 -0700 --

[1/2] spark git commit: [SPARK-14995][R] Add `since` tag in Roxygen documentation for SparkR API methods

2016-06-20 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-2.0 f90b2ea1d -> 54aef1c14 http://git-wip-us.apache.org/repos/asf/spark/blob/54aef1c1/R/pkg/R/mllib.R -- diff --git a/R/pkg/R/mllib.R b/R/pkg/R/mllib.R index

[1/2] spark git commit: [SPARK-14995][R] Add `since` tag in Roxygen documentation for SparkR API methods

2016-06-20 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 92514232e -> d0eddb80e http://git-wip-us.apache.org/repos/asf/spark/blob/d0eddb80/R/pkg/R/mllib.R -- diff --git a/R/pkg/R/mllib.R b/R/pkg/R/mllib.R index 2127dae..d6ff2aa

[2/2] spark git commit: [SPARK-14995][R] Add `since` tag in Roxygen documentation for SparkR API methods

2016-06-20 Thread shivaram
/ ## How was this patch tested? Manual. Author: Dongjoon Hyun <dongj...@apache.org> Closes #13734 from dongjoon-hyun/SPARK-14995. (cherry picked from commit d0eddb80eca04e4f5f8af3b5143096cf67200277) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: ht

[2/2] spark git commit: [SPARK-14995][R] Add `since` tag in Roxygen documentation for SparkR API methods

2016-06-20 Thread shivaram
/repos/asf/spark/tree/d0eddb80 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/d0eddb80 Branch: refs/heads/master Commit: d0eddb80eca04e4f5f8af3b5143096cf67200277 Parents: 9251423 Author: Dongjoon Hyun <dongj...@apache.org> Authored: Mon Jun 20 14:24:41 2016 -0700 Committer: Shivaram

spark git commit: [SPARK-15159][SPARKR] SparkSession roxygen2 doc, programming guide, example updates

2016-06-20 Thread shivaram
tch tested? manual checks shivaram Author: Felix Cheung <felixcheun...@hotmail.com> Closes #13751 from felixcheung/rsparksessiondoc. (cherry picked from commit 359c2e827d5682249c009e83379a5ee8e5aa4e89) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project:

spark git commit: [SPARK-15159][SPARKR] SparkSession roxygen2 doc, programming guide, example updates

2016-06-20 Thread shivaram
ted? manual checks shivaram Author: Felix Cheung <felixcheun...@hotmail.com> Closes #13751 from felixcheung/rsparksessiondoc. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/359c2e82 Tree: http://git-wip-us.apache.org/

spark git commit: [SPARK-16053][R] Add `spark_partition_id` in SparkR

2016-06-20 Thread shivaram
nkins tests (including new testcase). Author: Dongjoon Hyun <dongj...@apache.org> Closes #13768 from dongjoon-hyun/SPARK-16053. (cherry picked from commit b0f2fb5b9729b38744bf784f2072f5ee52314f87) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-

spark git commit: [SPARK-16053][R] Add `spark_partition_id` in SparkR

2016-06-20 Thread shivaram
pos/asf/spark/tree/b0f2fb5b Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/b0f2fb5b Branch: refs/heads/master Commit: b0f2fb5b9729b38744bf784f2072f5ee52314f87 Parents: aee1420 Author: Dongjoon Hyun <dongj...@apache.org> Authored: Mon Jun 20 13:41:03 2016 -0700 Committer: Shivaram

spark git commit: [SPARKR] fix R roxygen2 doc for count on GroupedData

2016-06-20 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-2.0 d2c94e6a4 -> dfa920204 [SPARKR] fix R roxygen2 doc for count on GroupedData ## What changes were proposed in this pull request? fix code doc ## How was this patch tested? manual shivaram Author: Felix Cheung <feli

spark git commit: [SPARKR] fix R roxygen2 doc for count on GroupedData

2016-06-20 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 46d98e0a1 -> aee1420ec [SPARKR] fix R roxygen2 doc for count on GroupedData ## What changes were proposed in this pull request? fix code doc ## How was this patch tested? manual shivaram Author: Felix Cheung <felixcheun...@hotma

spark git commit: [SPARK-16028][SPARKR] spark.lapply can work with active context

2016-06-20 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-2.0 ead872e49 -> d2c94e6a4 [SPARK-16028][SPARKR] spark.lapply can work with active context ## What changes were proposed in this pull request? spark.lapply and setLogLevel ## How was this patch tested? unit test shivaram thunte

spark git commit: [SPARK-16028][SPARKR] spark.lapply can work with active context

2016-06-20 Thread shivaram
Repository: spark Updated Branches: refs/heads/master c44bf137c -> 46d98e0a1 [SPARK-16028][SPARKR] spark.lapply can work with active context ## What changes were proposed in this pull request? spark.lapply and setLogLevel ## How was this patch tested? unit test shivaram thunterdb Aut

spark git commit: [SPARK-16051][R] Add `read.orc/write.orc` to SparkR

2016-06-20 Thread shivaram
repos/asf/spark/tree/c44bf137 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/c44bf137 Branch: refs/heads/master Commit: c44bf137c7ca649e0c504229eb3e6ff7955e9a53 Parents: 36e812d Author: Dongjoon Hyun <dongj...@apache.org> Authored: Mon Jun 20 11:30:26 2016 -0700 Committer: Shivaram Venk

spark git commit: [SPARK-16051][R] Add `read.orc/write.orc` to SparkR

2016-06-20 Thread shivaram
ass the Jenkins tests (with new testcases). Author: Dongjoon Hyun <dongj...@apache.org> Closes #13763 from dongjoon-hyun/SPARK-16051. (cherry picked from commit c44bf137c7ca649e0c504229eb3e6ff7955e9a53) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wi

spark git commit: [SPARK-16029][SPARKR] SparkR add dropTempView and deprecate dropTempTable

2016-06-20 Thread shivaram
nit tests shivaram liancheng Author: Felix Cheung <felixcheun...@hotmail.com> Closes #13753 from felixcheung/rdroptempview. (cherry picked from commit 36e812d4b695566437c6bac991ef06a0f81fb1c5) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.a

spark git commit: [SPARK-16029][SPARKR] SparkR add dropTempView and deprecate dropTempTable

2016-06-20 Thread shivaram
sts shivaram liancheng Author: Felix Cheung <felixcheun...@hotmail.com> Closes #13753 from felixcheung/rdroptempview. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/36e812d4 Tree: http://git-wip-us.apache.org/repos/

spark git commit: [SPARK-16059][R] Add `monotonically_increasing_id` function in SparkR

2016-06-20 Thread shivaram
2a586156bc4eb48e255749774f20) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/bb80d1c2 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/bb80d1c2 Diff:

spark git commit: [SPARK-16059][R] Add `monotonically_increasing_id` function in SparkR

2016-06-20 Thread shivaram
ts: 5cfabec Author: Dongjoon Hyun <dongj...@apache.org> Authored: Mon Jun 20 11:12:41 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Mon Jun 20 11:12:41 2016 -0700 -- R/pkg/NAMESPACE

spark git commit: [SPARK-15159][SPARKR] SparkR SparkSession API

2016-06-17 Thread shivaram
s - [ ] Separate PR - update all roxygen2 doc coding example - [ ] Separate PR - update SparkR programming guide ## How was this patch tested? unit tests, manual tests shivaram sun-rui rxin Author: Felix Cheung <felixcheun...@hotmail.com> Author: felixcheung <felixcheun...@

spark git commit: [SPARK-16005][R] Add `randomSplit` to SparkR

2016-06-17 Thread shivaram
/7d65a0db Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/7d65a0db Branch: refs/heads/master Commit: 7d65a0db4a231882200513836f2720f59b35f364 Parents: ef3cc4f Author: Dongjoon Hyun <dongj...@apache.org> Authored: Fri Jun 17 16:07:33 2016 -0700 Committer: Shivaram Venkataraman <shiva.

spark git commit: [SPARK-16005][R] Add `randomSplit` to SparkR

2016-06-17 Thread shivaram
sts (with new testcase.) Author: Dongjoon Hyun <dongj...@apache.org> Closes #13721 from dongjoon-hyun/SPARK-16005. (cherry picked from commit 7d65a0db4a231882200513836f2720f59b35f364) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/

spark git commit: [SPARK-15925][SPARKR] R DataFrame add back registerTempTable, add tests

2016-06-17 Thread shivaram
nit tests shivaram liancheng Author: Felix Cheung <felixcheun...@hotmail.com> Closes #13722 from felixcheung/rregistertemptable. (cherry picked from commit ef3cc4fc096e831823d62af4fd2a12ae88d434b4) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wi

spark git commit: [SPARK-15925][SPARKR] R DataFrame add back registerTempTable, add tests

2016-06-17 Thread shivaram
nit tests shivaram liancheng Author: Felix Cheung <felixcheun...@hotmail.com> Closes #13722 from felixcheung/rregistertemptable. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ef3cc4fc Tree: http://git-wip-us.apache.org/

spark git commit: [SPARK-15908][R] Add varargs-type dropDuplicates() function in SparkR

2016-06-16 Thread shivaram
un <dongj...@apache.org> Authored: Thu Jun 16 20:35:17 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Thu Jun 16 20:35:17 2016 -0700 -- R/pkg/R/DataFrame.R

spark git commit: [SPARK-15996][R] Fix R examples by removing deprecated functions

2016-06-16 Thread shivaram
PARK-15996. (cherry picked from commit a865f6e05297f6121bb2fde717860f9edeed263e) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/0a2291cd Tree: http://git-wip-us.apache.org/repos/asf/spark/tre

spark git commit: [SPARK-15996][R] Fix R examples by removing deprecated functions

2016-06-16 Thread shivaram
d263e Parents: 9ea0d5e Author: Dongjoon Hyun <dongj...@apache.org> Authored: Thu Jun 16 12:46:25 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Thu Jun 16 12:46:25 2016 -0700 -

spark git commit: [SPARK-12922][SPARKR][WIP] Implement gapply() on DataFrame in SparkR

2016-06-15 Thread shivaram
n 3. Compute average by a group Author: Narine Kokhlikyan <narine.kokhlik...@gmail.com> Author: NarineK <narine.kokhlik...@us.ibm.com> Closes #12836 from NarineK/gapply2. (cherry picked from commit 7c6c6926376c93acc42dd56a399d816f4838f28c) Signed-off-by: Shivaram Venkataraman <shiva.

spark git commit: [SPARK-12922][SPARKR][WIP] Implement gapply() on DataFrame in SparkR

2016-06-15 Thread shivaram
: Wed Jun 15 21:42:05 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Wed Jun 15 21:42:05 2016 -0700 -- R/pkg/NAMESPACE | 1 + R/pkg/R/DataFrame.R

spark git commit: [SPARK-15637][SPARK-15931][SPARKR] Fix R masked functions checks

2016-06-15 Thread shivaram
tch tested? unit tests shivaram Author: Felix Cheung <felixcheun...@hotmail.com> Closes #13636 from felixcheung/rendswith. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d30b7e66 Tree: http://git-wip-us.apache.org/

spark git commit: [SPARK-15637][SPARK-15931][SPARKR] Fix R masked functions checks

2016-06-15 Thread shivaram
How was this patch tested? unit tests shivaram Author: Felix Cheung <felixcheun...@hotmail.com> Closes #13636 from felixcheung/rendswith. (cherry picked from commit d30b7e6696e20f1014c7f26aadbc051da0fac578) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wi

spark git commit: [SPARK-15925][SQL][SPARKR] Replaces registerTempTable with createOrReplaceTempView

2016-06-13 Thread shivaram
iew` as a follow-up task of #12945. ## How was this patch tested? Existing SparkR tests. Author: Cheng Lian <l...@databricks.com> Closes #13644 from liancheng/spark-15925-temp-view-for-r. (cherry picked from commit ced8d669b359d6465c3bf476af0f68cc4db04a25) Signed-off-by: Shivaram Venkataram

spark git commit: [SPARK-15925][SQL][SPARKR] Replaces registerTempTable with createOrReplaceTempView

2016-06-13 Thread shivaram
Jun 13 15:46:50 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Mon Jun 13 15:46:50 2016 -0700 -- R/pkg/NAMESPACE | 2 +- R/pkg/R/DataFrame.R

spark git commit: [SPARK-15766][SPARKR] R should export is.nan

2016-06-10 Thread shivaram
pache.org/repos/asf/spark/tree/2c8f40ce Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/2c8f40ce Branch: refs/heads/master Commit: 2c8f40cea113b597fbaf1cdd80a5b8bdd66155fb Parents: 2413fce Author: wm...@hotmail.com <wm...@hotmail.com> Authored: Fri Jun 10 12:46:22 2016 -0700 Comm

spark git commit: [SPARK-15684][SPARKR] Not mask startsWith and endsWith in R

2016-06-07 Thread shivaram
gmiao1981/start. (cherry picked from commit 3ec4461c46e2959f4c640df0292cfcacfe0f727f) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ead3bbda Tree:

spark git commit: [SPARK-15684][SPARKR] Not mask startsWith and endsWith in R

2016-06-07 Thread shivaram
er Commit: 3ec4461c46e2959f4c640df0292cfcacfe0f727f Parents: 1e2c931 Author: wm...@hotmail.com <wm...@hotmail.com> Authored: Tue Jun 7 09:13:18 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Tue Jun

spark git commit: [MINOR][R][DOC] Fix R documentation generation instruction.

2016-06-05 Thread shivaram
k R/DOCUMENTATION.md from R/README.md - turn on some code syntax highlight in R/README.md ## How was this patch tested? local test Author: Kai Jiang <jiang...@gmail.com> Closes #13488 from vectorijk/R-Readme. (cherry picked from commit 8a9110510c9e4cbbcb0dede62cb4b9dd1c6bc8cc) Signed-off-by:

spark git commit: [MINOR][R][DOC] Fix R documentation generation instruction.

2016-06-05 Thread shivaram
thored: Sun Jun 5 13:03:02 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Sun Jun 5 13:03:02 2016 -0700 -- R/DOCUMENTATION.md | 12 ++-- R/README.md| 30 ++

spark git commit: [SPARK-15637][SPARKR] fix R tests on R 3.2.2

2016-05-28 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-2.0 2c1b6b58d -> a2f68ded2 [SPARK-15637][SPARKR] fix R tests on R 3.2.2 ## What changes were proposed in this pull request? Change version check in R tests ## How was this patch tested? R tests shivaram Author: felixcheung <feli

spark git commit: [SPARK-15637][SPARKR] fix R tests on R 3.2.2

2016-05-28 Thread shivaram
Repository: spark Updated Branches: refs/heads/master b4c32c495 -> 74c1b79f3 [SPARK-15637][SPARKR] fix R tests on R 3.2.2 ## What changes were proposed in this pull request? Change version check in R tests ## How was this patch tested? R tests shivaram Author: felixcheung <feli

spark git commit: [SPARK-10903] followup - update API doc for SqlContext

2016-05-26 Thread shivaram
add to the programming guide migration section. ## How was this patch tested? SparkR tests Author: felixcheung <felixcheun...@hotmail.com> Closes #13340 from felixcheung/sqlcontextdoc. (cherry picked from commit c82883239eadc4615a3aba907cd4633cb7aed26e) Signed-off-by: Shivaram Venkataraman <shiva...@cs.

spark git commit: [SPARK-10903] followup - update API doc for SqlContext

2016-05-26 Thread shivaram
6 21:42:36 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Thu May 26 21:42:36 2016 -0700 -- R/pkg/R/DataFrame.R | 141 +++ R/pkg/R/jobj.R

spark git commit: [SPARK-8603][SPARKR] Use shell() instead of system2() for SparkR on Windows

2016-05-26 Thread shivaram
or: Prakash PC <prakash.chi...@gmail.com> Closes #13165 from HyukjinKwon/pr/7025. (cherry picked from commit 1c403733b89258e57daf7b8b0a2011981ad7ed8a) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit

spark git commit: [SPARK-8603][SPARKR] Use shell() instead of system2() for SparkR on Windows

2016-05-26 Thread shivaram
wip-us.apache.org/repos/asf/spark/diff/1c403733 Branch: refs/heads/master Commit: 1c403733b89258e57daf7b8b0a2011981ad7ed8a Parents: 3fca635 Author: hyukjinkwon <gurwls...@gmail.com> Authored: Thu May 26 20:55:06 2016 -0700 Committer: Shivaram Venkatar

<    1   2   3   4   5   >