spark git commit: [SPARK-16027][SPARKR] Fix R tests SparkSession init/stop

2016-07-17 Thread shivaram
ted? unit tests shivaram Author: Felix Cheung Closes #14177 from felixcheung/rsessiontest. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d27fe9ba Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/d27fe9ba Diff: h

spark git commit: [SPARK-16055][SPARKR] warning added while using sparkPackages with spark-submit

2016-07-18 Thread shivaram
mit 8ea3f4eaec65ee4277f9943063fcc9488d3fa924) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/085f3cc8 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/085f3cc8 Diff: http://git-

spark git commit: [SPARK-16055][SPARKR] warning added while using sparkPackages with spark-submit

2016-07-18 Thread shivaram
924 Parents: a529fc9 Author: krishnakalyan3 Authored: Mon Jul 18 09:46:23 2016 -0700 Committer: Shivaram Venkataraman Committed: Mon Jul 18 09:46:23 2016 -0700 -- R/pkg/R/sparkR.R | 4 1 file changed, 4 inserti

spark git commit: [SPARKR][DOCS] minor code sample update in R programming guide

2016-07-18 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 96e9afaae -> 75f0efe74 [SPARKR][DOCS] minor code sample update in R programming guide ## What changes were proposed in this pull request? Fix code style from ad hoc review of RC4 doc ## How was this patch tested? manual shiva

spark git commit: [SPARKR][DOCS] minor code sample update in R programming guide

2016-07-18 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-2.0 33d92f7f3 -> 7889585cc [SPARKR][DOCS] minor code sample update in R programming guide ## What changes were proposed in this pull request? Fix code style from ad hoc review of RC4 doc ## How was this patch tested? manual shiva

spark git commit: [SPARK-10683][SPARK-16510][SPARKR] Move SparkR include jar test to SparkSubmitSuite

2016-07-19 Thread shivaram
s a dynamically compiled jar. This helps us remove the binary jar from the R package and solves both the CRAN warnings and the lack of source being available for this jar. ## How was this patch tested? SparkR unit tests, SparkSubmitSuite, check-cran.sh Author: Shivaram Venkataraman Closes #14

spark git commit: [SPARK-10683][SPARK-16510][SPARKR] Move SparkR include jar test to SparkSubmitSuite

2016-07-19 Thread shivaram
ses a dynamically compiled jar. This helps us remove the binary jar from the R package and solves both the CRAN warnings and the lack of source being available for this jar. ## How was this patch tested? SparkR unit tests, SparkSubmitSuite, check-cran.sh Author: Shivaram Venkataraman Clo

spark git commit: [SPARKR][DOCS] fix broken url in doc

2016-07-25 Thread shivaram
sf/spark/tree/b73defdd Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/b73defdd Branch: refs/heads/master Commit: b73defdd790cb823a4f9958ca89cec06fd198051 Parents: 7ea6d28 Author: Felix Cheung Authored: Mon Jul 25 11:25:41 2016 -0700 Committer: Shivaram Venkataraman Committed: Mon Jul 25 11:25:

spark git commit: [SPARKR][DOCS] fix broken url in doc

2016-07-25 Thread shivaram
786213920.png) ## How was this patch tested? manual test Author: Felix Cheung Closes #14329 from felixcheung/rdoclinkfix. (cherry picked from commit b73defdd790cb823a4f9958ca89cec06fd198051) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commi

spark git commit: [SPARK-16710][SPARKR][ML] spark.glm should support weightCol

2016-08-10 Thread shivaram
mit: d4a9122430d6c3aeaaee32aa09d314016ff6ddc7 Parents: 19af298 Author: Yanbo Liang Authored: Wed Aug 10 10:53:48 2016 -0700 Committer: Shivaram Venkataraman Committed: Wed Aug 10 10:53:48 2016 -0700 -- R/pkg/R/mlli

spark git commit: [SPARK-16579][SPARKR] add install.spark function

2016-08-10 Thread shivaram
1 Parents: d4a9122 Author: Junyang Qian Authored: Wed Aug 10 11:18:23 2016 -0700 Committer: Shivaram Venkataraman Committed: Wed Aug 10 11:18:23 2016 -0700 -- R/check-cran.sh | 2 +- R/pkg/DE

spark git commit: [SPARK-16579][SPARKR] add install.spark function

2016-08-10 Thread shivaram
- can install spark when not found in `SPARK_HOME` Manual tests, running the check-cran.sh script added in #14173. Author: Junyang Qian Closes #14258 from junyangq/SPARK-16579. (cherry picked from commit 214ba66a030bc3a718c567a742b0db44bf911d61) Signed-off-by: Shivaram Venkataraman Proj

spark git commit: [SPARK-16508][SPARKR] Split docs for arrange and orderBy methods

2016-08-15 Thread shivaram
mit: 564fe614c11deb657e0ac9e6b75e65370c48b7fe Parents: 3d8bfe7 Author: Junyang Qian Authored: Mon Aug 15 11:03:03 2016 -0700 Committer: Shivaram Venkataraman Committed: Mon Aug 15 11:03:03 2016 -0700 -- .gitignore | 1 + R/pkg/R/DataFrame.R |

spark git commit: [SPARK-16508][SPARKR] Split docs for arrange and orderBy methods

2016-08-15 Thread shivaram
een shot 2016-08-06 at 6 40 02 pm](https://cloud.githubusercontent.com/assets/15318264/17459967/51e650ec-5c05-11e6-8698-0f037f5199ff.png) Author: Junyang Qian Closes #14522 from junyangq/SPARK-16508-0. (cherry picked from commit 564fe614c11deb657e0ac9e6b75e65370c48b7fe) Signed-off-by: Shiva

spark git commit: [MINOR][SPARKR] spark.glm weightCol should in the signature.

2016-08-16 Thread shivaram
wip-us.apache.org/repos/asf/spark/diff/d37ea3c0 Branch: refs/heads/master Commit: d37ea3c09c054f2cc1305b2520ff46b2c0e58704 Parents: 12a89e5 Author: Yanbo Liang Authored: Tue Aug 16 10:52:35 2016 -0700 Committer: Shivaram Venkataraman Committed: Tue Aug 16 10:52:35 2016 -0

spark git commit: [SPARK-16519][SPARKR] Handle SparkR RDD generics that create warnings in R CMD check

2016-08-16 Thread shivaram
hor: Felix Cheung Authored: Tue Aug 16 11:19:18 2016 -0700 Committer: Shivaram Venkataraman Committed: Tue Aug 16 11:19:18 2016 -0700 -- R/pkg/R/RDD.R | 100 +-- R/pkg/R/SQLContex

spark git commit: [SPARK-16519][SPARKR] Handle SparkR RDD generics that create warnings in R CMD check

2016-08-16 Thread shivaram
ons (hence the problem) so after the renames we need to add new generics, for now. unit tests Author: Felix Cheung Closes #14626 from felixcheung/rrddfunctions. (cherry picked from commit c34b546d674ce186f13db97977bc281cfedf) Signed-off-by: Shivaram Venkataraman Project: http://git-

spark git commit: [MINOR][SPARKR] R API documentation for "coltypes" is confusing

2016-08-18 Thread shivaram
mple. (cherry picked from commit 1203c8415cd11540f79a235e66a2f241ca6c71e4) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/176af17a Tree: http://git-wip-us.apache.org/repos/asf/spark/t

spark git commit: [SPARK-16508][SPARKR] Fix CRAN undocumented/duplicated arguments warnings.

2016-08-21 Thread shivaram
-16508-master. (cherry picked from commit 01401e965b58f7e8ab615764a452d7d18f1d4bf0) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/02978961 Tree: http://git-wip-us.apache.org/repos/asf/spark/

spark git commit: [SPARKR][MINOR] Fix Cache Folder Path in Windows

2016-08-22 Thread shivaram
700 Committer: Shivaram Venkataraman Committed: Mon Aug 22 10:03:48 2016 -0700 -- R/pkg/R/install.R | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -- h

spark git commit: [SPARKR][MINOR] Fix Cache Folder Path in Windows

2016-08-22 Thread shivaram
uld be `LOCALAPPDATA` rather than `%LOCALAPPDATA%`. ## How was this patch tested? Manual test in Windows 7. Author: Junyang Qian Closes #14743 from junyangq/SPARKR-FixWindowsInstall. (cherry picked from commit 209e1b3c0683a9106428e269e5041980b6cc327f) Signed-off-by: Shivaram Venkatara

spark git commit: [SPARKR][MINOR] Add Xiangrui and Felix to maintainers

2016-08-22 Thread shivaram
How was this patch tested? (Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests) (If this patch involves UI changes, please attach a screenshot; otherwise, remove this) Author: Shivaram Venkataraman Closes #14758 from shivaram/sparkr-maintainers. Proj

spark git commit: [SPARKR][MINOR] Add Xiangrui and Felix to maintainers

2016-08-22 Thread shivaram
ion. ## How was this patch tested? (Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests) (If this patch involves UI changes, please attach a screenshot; otherwise, remove this) Author: Shivaram Venkataraman Closes #14758 from shivaram/sparkr-maintain

spark git commit: [SPARK-16508][SPARKR] doc updates and more CRAN check fixes

2016-08-22 Thread shivaram
itr junyangq Author: Felix Cheung Closes #14734 from felixcheung/rdoccleanup. (cherry picked from commit 71afeeea4ec8e67edc95b5d504c557c88a2598b9) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/com

spark git commit: [SPARK-16577][SPARKR] Add CRAN documentation checks to run-tests.sh

2016-08-22 Thread shivaram
dds CRAN documentation checks to be run as a part of `R/run-tests.sh` . As this script is also used by Jenkins this means that we will get documentation checks on every PR going forward. (If this patch involves UI changes, please attach a screenshot; otherwise, remove this) Author: Shiva

spark git commit: [SPARK-16577][SPARKR] Add CRAN documentation checks to run-tests.sh

2016-08-22 Thread shivaram
nge adds CRAN documentation checks to be run as a part of `R/run-tests.sh` . As this script is also used by Jenkins this means that we will get documentation checks on every PR going forward. (If this patch involves UI changes, please attach a screenshot; otherwise, remove this) Author: Shiva

spark git commit: [SPARKR][BUILD] ignore cran-check.out under R folder

2016-08-25 Thread shivaram
ads/master Commit: 9958ac0ce2b9e451d400604767bef2fe12a3399d Parents: f209310 Author: wm...@hotmail.com Authored: Thu Aug 25 12:11:27 2016 -0700 Committer: Shivaram Venkataraman Committed: Thu Aug 25 12:11:27 2016 -0700 -- .gitign

spark git commit: [SPARKR][BUILD] ignore cran-check.out under R folder

2016-08-25 Thread shivaram
rom wangmiao1981/ignore. (cherry picked from commit 9958ac0ce2b9e451d400604767bef2fe12a3399d) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/b3a44306 Tree: http://git-wip-us.apache.org/re

spark git commit: [SPARK-16581][SPARKR] Make JVM backend calling functions public

2016-08-29 Thread shivaram
JVM ## How was this patch tested? (Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests) Unit tests, CRAN checks Author: Shivaram Venkataraman Closes #14775 from shivaram/sparkr-java-api. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Com

spark git commit: [SPARK-16581][SPARKR] Make JVM backend calling functions public

2016-08-29 Thread shivaram
ver JVM ## How was this patch tested? (Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests) Unit tests, CRAN checks Author: Shivaram Venkataraman Closes #14775 from shivaram/sparkr-java-api. (cherry picked from com

spark git commit: [MINOR][SPARKR] Verbose build comment in WINDOWS.md rather than promoting default build without Hive

2016-08-31 Thread shivaram
53442a Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/9953442a Branch: refs/heads/master Commit: 9953442aca5a1528a6b85fa8713a56d36c9a199f Parents: 12fd0cd Author: hyukjinkwon Authored: Wed Aug 31 09:06:23 2016 -0700 Committer: Shivaram Venkataraman Committed: Wed Aug 31 09:06:23

spark git commit: [SPARK-17326][SPARKR] Fix tests with HiveContext in SparkR not to be skipped always

2016-08-31 Thread shivaram
wip-us.apache.org/repos/asf/spark/tree/50bb1423 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/50bb1423 Branch: refs/heads/master Commit: 50bb142332d1147861def692bf63f0055ecb8576 Parents: 5d84c7f Author: hyukjinkwon Authored: Wed Aug 31 14:02:21 2016 -0700 Committer: Shivaram Venkatara

spark git commit: [SPARK-17326][SPARKR] Fix tests with HiveContext in SparkR not to be skipped always

2016-08-31 Thread shivaram
/45-test123 - After: https://ci.appveyor.com/project/HyukjinKwon/spark/build/46-test123 Author: hyukjinkwon Closes #14889 from HyukjinKwon/SPARK-17326. (cherry picked from commit 50bb142332d1147861def692bf63f0055ecb8576) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.

spark git commit: [SPARK-16581][SPARKR] Fix JVM API tests in SparkR

2016-08-31 Thread shivaram
n R unit tests with testthat 1.0 Author: Shivaram Venkataraman Closes #14904 from shivaram/sparkr-jvm-tests-fix. (cherry picked from commit 2f9c27364ea00473933213700edb93b63b55b313) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-

spark git commit: [SPARK-16581][SPARKR] Fix JVM API tests in SparkR

2016-08-31 Thread shivaram
nit tests with testthat 1.0 Author: Shivaram Venkataraman Closes #14904 from shivaram/sparkr-jvm-tests-fix. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/2f9c2736 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/2f9c2

spark git commit: [SPARKR][MINOR] Fix windowPartitionBy example

2016-08-31 Thread shivaram
wip-us.apache.org/repos/asf/spark/diff/d008638f Branch: refs/heads/master Commit: d008638fbedc857c1adc1dff399d427b8bae848e Parents: 2f9c273 Author: Junyang Qian Authored: Wed Aug 31 21:28:53 2016 -0700 Committer: Shivaram Venkataraman Committed: Wed Aug 31 21:28:53 2016 -0

spark git commit: [SPARKR][MINOR] Fix windowPartitionBy example

2016-08-31 Thread shivaram
est. Author: Junyang Qian Closes #14903 from junyangq/SPARKR-FixWindowPartitionByDoc. (cherry picked from commit d008638fbedc857c1adc1dff399d427b8bae848e) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/

spark git commit: [SPARK-17241][SPARKR][MLLIB] SparkR spark.glm should have configurable regularization parameter

2016-08-31 Thread shivaram
mit: 7a5000f39ef4f195696836f8a4e8ab4ff5c14dd2 Parents: d008638 Author: Xin Ren Authored: Wed Aug 31 21:39:31 2016 -0700 Committer: Shivaram Venkataraman Committed: Wed Aug 31 21:39:31 2016 -0700 -- R/pkg/R/mllib.R |

spark git commit: [SPARK-17376][SPARKR] Spark version should be available in R

2016-09-02 Thread shivaram
ee/812333e4 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/812333e4 Branch: refs/heads/master Commit: 812333e4336113e44d2c9473bcba1cee4a989d2c Parents: ea66228 Author: Felix Cheung Authored: Fri Sep 2 10:12:10 2016 -0700 Committer: Shivaram Venkataraman Committed: Fri Sep 2 10:

spark git commit: [SPARK-17376][SPARKR] Spark version should be available in R

2016-09-02 Thread shivaram
w was this patch tested? manual, unit tests Author: Felix Cheung Closes #14935 from felixcheung/rsparksessionversion. (cherry picked from commit 812333e4336113e44d2c9473bcba1cee4a989d2c) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit

spark git commit: [SPARKR][DOC] regexp_extract should doc that it returns empty string when match fails

2016-09-02 Thread shivaram
ree/419eefd8 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/419eefd8 Branch: refs/heads/master Commit: 419eefd811a4e29a73bc309157f150751e478db5 Parents: 812333e Author: Felix Cheung Authored: Fri Sep 2 10:28:37 2016 -0700 Committer: Shivaram Venkataraman Committed: Fri Sep 2 10:28:37 2016 -0

spark git commit: [SPARKR][DOC] regexp_extract should doc that it returns empty string when match fails

2016-09-02 Thread shivaram
324 ## How was this patch tested? manual check Author: Felix Cheung Closes #14934 from felixcheung/regexpextractdoc. (cherry picked from commit 419eefd811a4e29a73bc309157f150751e478db5) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://

spark git commit: [SPARKR][MINOR] Fix docs for sparkR.session and count

2016-09-02 Thread shivaram
fs/heads/master Commit: d2fde6b72c4aede2e7edb4a7e6653fb1e7b19924 Parents: e6132a6 Author: Junyang Qian Authored: Fri Sep 2 21:11:57 2016 -0700 Committer: Shivaram Venkataraman Committed: Fri Sep 2 21:11:57 2016 -0700 --

spark git commit: [SPARKR][MINOR] Fix docs for sparkR.session and count

2016-09-02 Thread shivaram
942 from junyangq/fixSparkRSessionDoc. (cherry picked from commit d2fde6b72c4aede2e7edb4a7e6653fb1e7b19924) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/12a2e2a5 Tree: http://git-wip-us.ap

spark git commit: [SPARK-16829][SPARKR] sparkR sc.setLogLevel doesn't work

2016-09-03 Thread shivaram
apache.org/repos/asf/spark/tree/e9b58e9e Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/e9b58e9e Branch: refs/heads/master Commit: e9b58e9ef89a9118b6d5a466d10db8e30d61f850 Parents: abb2f92 Author: wm...@hotmail.com Authored: Sat Sep 3 13:52:55 2016 -0700 Committer: Sh

spark git commit: [SPARK-15091][SPARKR] Fix warnings and a failure in SparkR test cases with testthat version 1.0.1

2016-09-05 Thread shivaram
Sun Rui Closes #12867 from sun-rui/SPARK-15091. (cherry picked from commit 8b6491fc0b49b4e363887ae4b452ba69fe0290d5) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/21be94b1 Tree: h

spark git commit: [SPARK-16785] R dapply doesn't return array or raw columns

2016-09-06 Thread shivaram
ndle raw (binary) vectors. cc shivaram ## How was this patch tested? Unit tests Author: Clark Fitzgerald Closes #14783 from clarkfitzg/SPARK-16785. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/9fccde4f Tree: http:/

spark git commit: [SPARK-16785] R dapply doesn't return array or raw columns

2016-09-06 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-2.0 796577b43 -> ee6301a88 [SPARK-16785] R dapply doesn't return array or raw columns Fixed bug in `dapplyCollect` by changing the `compute` function of `worker.R` to explicitly handle raw (binary) vectors. cc shivaram Un

spark git commit: [SPARK-17339][CORE][BRANCH-2.0] Do not use path to get a filesystem in hadoopFile and newHadoopFile APIs

2016-09-07 Thread shivaram
red: Wed Sep 7 21:22:32 2016 -0700 Committer: Shivaram Venkataraman Committed: Wed Sep 7 21:22:32 2016 -0700 -- core/src/main/scala/org/apache/spark/SparkContext.scala | 4 ++-- 1 file changed, 2 insertions(+), 2 deleti

spark git commit: [SPARK-17442][SPARKR] Additional arguments in write.df are not passed to data source

2016-09-08 Thread shivaram
tch tested? unit tests falaki shivaram Author: Felix Cheung Closes #15010 from felixcheung/testreadoptions. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/f0d21b7f Tree: http://git-wip-us.apache.org/repos/asf/spark/t

spark git commit: [SPARK-17442][SPARKR] Additional arguments in write.df are not passed to data source

2016-09-08 Thread shivaram
his patch tested? unit tests falaki shivaram Author: Felix Cheung Closes #15010 from felixcheung/testreadoptions. (cherry picked from commit f0d21b7f90cdcce353ab6fc279b9cc376e46e536) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://

spark git commit: [SPARK-17200][PROJECT INFRA][BUILD][SPARKR] Automate building and testing on Windows (currently SparkR only)

2016-09-08 Thread shivaram
won Authored: Thu Sep 8 08:26:59 2016 -0700 Committer: Shivaram Venkataraman Committed: Thu Sep 8 08:26:59 2016 -0700 -- appveyor.yml | 56 ++ dev/appveyor-guide.md |

spark git commit: [SPARK-16445][MLLIB][SPARKR] Fix @return description for sparkR mlp summary() method

2016-09-10 Thread shivaram
ark/tree/71b7d42f Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/71b7d42f Branch: refs/heads/master Commit: 71b7d42f5fa8d3a891ce831eedb308d1f407dd7e Parents: 6ea5055 Author: Xin Ren Authored: Sat Sep 10 09:52:53 2016 -0700 Committer: Shivaram Venkataraman Committed: Sat Sep 10 09:52:53 20

spark git commit: [SPARK-17317][SPARKR] Add SparkR vignette

2016-09-13 Thread shivaram
by SparkR. ## How was this patch tested? Manual test. Author: junyangq Author: Shivaram Venkataraman Author: Junyang Qian Closes #14980 from junyangq/SPARKR-vignette. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/a454a

spark git commit: [SPARK-18335][SPARKR] createDataFrame to support numPartitions parameter

2017-01-13 Thread shivaram
iff: http://git-wip-us.apache.org/repos/asf/spark/diff/b0e8eb6d Branch: refs/heads/master Commit: b0e8eb6d3e9e80fa62625a5b9382d93af77250db Parents: 285a779 Author: Felix Cheung Authored: Fri Jan 13 10:08:14 2017 -0800 Committer: Shivaram Venkataraman Committed: Fri Jan 13 10:08:14 2017 -0

spark git commit: [SPARK-18335][SPARKR] createDataFrame to support numPartitions parameter

2017-01-13 Thread shivaram
was this patch tested? manual, unit tests Author: Felix Cheung Closes #16512 from felixcheung/rnumpart. (cherry picked from commit b0e8eb6d3e9e80fa62625a5b9382d93af77250db) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-

spark git commit: [SPARK-19221][PROJECT INFRA][R] Add winutils binaries to the path in AppVeyor tests for Hadoop libraries to call native codes properly

2017-01-14 Thread shivaram
a4f Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/b6a7aa4f Branch: refs/heads/master Commit: b6a7aa4f770634e6db7244e88f8b6273fb9b6d1e Parents: ad0dada Author: hyukjinkwon Authored: Sat Jan 14 08:31:07 2017 -0800 Committer: Shivaram Venkataraman Committed: Sat Jan 14 08:31:07 2017 -0

spark git commit: [SPARK-19232][SPARKR] Update Spark distribution download cache location on Windows

2017-01-16 Thread shivaram
Authored: Mon Jan 16 09:35:52 2017 -0800 Committer: Shivaram Venkataraman Committed: Mon Jan 16 09:35:52 2017 -0800 -- R/pkg/R/install.R | 4 ++-- 1 file changed, 2 insertions(+)

spark git commit: [SPARK-19232][SPARKR] Update Spark distribution download cache location on Windows

2017-01-16 Thread shivaram
Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/97589050 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/97589050 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/97589050 Branc

spark git commit: [SPARK-19324][SPARKR] Spark VJM stdout output is getting dropped in SparkR

2017-01-27 Thread shivaram
a7ab6f9a Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/a7ab6f9a Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/a7ab6f9a Branch: refs/heads/master Commit: a7ab6f9a8fdfb927f0bcefdc87a92cc82fac4223 Parents: 385d738 Author: Felix Cheung Authored: Fri Jan 27 12:41

spark git commit: [SPARK-19324][SPARKR] Spark VJM stdout output is getting dropped in SparkR

2017-01-27 Thread shivaram
examples with calls of `println` in Scala/JVM side, that are getting dropped. ## How was this patch tested? manual Author: Felix Cheung Closes #16670 from felixcheung/rjvmstdout. (cherry picked from commit a7ab6f9a8fdfb927f0bcefdc87a92cc82fac4223) Signed-off-by: Shivaram Venkataraman Proje

spark git commit: [SPARK-19387][SPARKR] Tests do not run with SparkR source package in CRAN check

2017-02-14 Thread shivaram
.tar.gz ``` Author: Felix Cheung Closes #16720 from felixcheung/rcranchecktest. (cherry picked from commit a3626ca333e6e1881e2f09ccae0fa8fa7243223e) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark

spark git commit: [SPARK-19387][SPARKR] Tests do not run with SparkR source package in CRAN check

2017-02-14 Thread shivaram
org/repos/asf/spark/diff/a3626ca3 Branch: refs/heads/master Commit: a3626ca333e6e1881e2f09ccae0fa8fa7243223e Parents: ab9872d Author: Felix Cheung Authored: Tue Feb 14 13:51:27 2017 -0800 Committer: Shivaram Venkataraman Committe

spark git commit: [SPARK-19237][SPARKR][CORE] On Windows spark-submit should handle when java is not installed

2017-03-21 Thread shivaram
r Commit: a8877bdbba6df105740f909bc87a13cdd4440757 Parents: 7dbc162 Author: Felix Cheung Authored: Tue Mar 21 14:24:41 2017 -0700 Committer: Shivaram Venkataraman Committed: Tue Mar 21 14:24:41 2017 -0700 -- R/pkg/inst/tests/

spark git commit: [SPARK-19237][SPARKR][CORE] On Windows spark-submit should handle when java is not installed

2017-03-21 Thread shivaram
ixcheung/rcheckjava. (cherry picked from commit a8877bdbba6df105740f909bc87a13cdd4440757) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/5c18b6c3 Tree: http://git-wip-us.apache.org/repos/a

spark git commit: [SPARK-10971][SPARKR] RRunner should allow setting path to Rscript.

2015-10-23 Thread shivaram
os/asf/spark/commit/2462dbcc Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/2462dbcc Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/2462dbcc Branch: refs/heads/master Commit: 2462dbcce89d657bca17ae311c99c2a4bee4a5fa Parents: 4725cb9 Author: Sun Rui Authored: Fri Oct 23 21:38:

spark git commit: [SPARK-10971][SPARKR] RRunner should allow setting path to Rscript.

2015-10-23 Thread shivaram
e/spark/blob/master/core/src/main/scala/org/apache/spark/deploy/PythonRunner.scala#L41) to determine the python executable for a python script. Author: Sun Rui Closes #9179 from sun-rui/SPARK-10971. (cherry picked from commit 2462dbcce89d657bca17ae311c99c2a4bee4a5fa) Signed-off-by: Shivaram Ve

spark git commit: [SPARK-11294][SPARKR] Improve R doc for read.df, write.df, saveAsTable

2015-10-23 Thread shivaram
ral text issues: ![image](https://cloud.githubusercontent.com/assets/8969467/10708590/1303a44e-79c3-11e5-854f-3a2e16854cd7.png) - text collapsed into a single paragraph - text truncated at 2 places, eg. "overwrite: Existing data is expected to be overwritten by the contents of error:" shi

spark git commit: [SPARK-11294][SPARKR] Improve R doc for read.df, write.df, saveAsTable

2015-10-23 Thread shivaram
ral text issues: ![image](https://cloud.githubusercontent.com/assets/8969467/10708590/1303a44e-79c3-11e5-854f-3a2e16854cd7.png) - text collapsed into a single paragraph - text truncated at 2 places, eg. "overwrite: Existing data is expected to be overwritten by the contents of error:&qu

spark git commit: [SPARK-10979][SPARKR] Sparkrmerge: Add merge to DataFrame with R signature

2015-10-26 Thread shivaram
ark/diff/3689beb9 Branch: refs/heads/master Commit: 3689beb98b6a6db61e35049fdb57b0cd6aad8019 Parents: 616be29 Author: Narine Kokhlikyan Authored: Mon Oct 26 15:12:25 2015 -0700 Committer: Shivaram Venkataraman Committed: Mon Oct 26 15:12:25 2015 -0

spark git commit: [SPARK-11258] Converting a Spark DataFrame into an R data.frame is slow / requires a lot of memory

2015-10-26 Thread shivaram
wip-us.apache.org/repos/asf/spark/diff/b60aab8a Branch: refs/heads/master Commit: b60aab8a95e2a35a1d4023a9d0a0d9724e4164f9 Parents: 3689beb Author: Frank Rosner Authored: Mon Oct 26 15:46:59 2015 -0700 Committer: Shivaram Venkataraman Committed: Mon Oct 26 15:46:59 2015 -0

spark git commit: [SPARK-11209][SPARKR] Add window functions into SparkR [step 1].

2015-10-26 Thread shivaram
20:58:18 2015 -0700 Committer: Shivaram Venkataraman Committed: Mon Oct 26 20:58:18 2015 -0700 -- R/pkg/NAMESPACE | 4 + R/pkg/R/functions.R | 98

spark git commit: [SPARK-11409][SPARKR] Enable url link in R doc for Persist

2015-10-29 Thread shivaram
png) shivaram Author: felixcheung Closes #9363 from felixcheung/rpersistdoc. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d89be0bf Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/d89be0bf Diff: http://git-

spark git commit: [SPARK-11414][SPARKR] Forgot to update usage of 'spark.sparkr.r.command' in RRDD in the PR for SPARK-10971.

2015-10-30 Thread shivaram
14925 Parents: 0451b00 Author: Sun Rui Authored: Fri Oct 30 10:51:11 2015 -0700 Committer: Shivaram Venkataraman Committed: Fri Oct 30 10:51:11 2015 -0700 -- core/src/main/scala/org/apache/spark/api/r/RRDD.scala | 7 ++- 1 fi

spark git commit: [SPARK-11210][SPARKR] Add window functions into SparkR [step 2].

2015-10-30 Thread shivaram
10:56:06 2015 -0700 Committer: Shivaram Venkataraman Committed: Fri Oct 30 10:56:06 2015 -0700 -- R/pkg/NAMESPACE | 4 ++ R/pkg/R/functions.R | 92 +++ R/pk

spark git commit: [SPARK-11340][SPARKR] Support setting driver properties when starting Spark from R programmatically or from RStudio

2015-10-30 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 729f983e6 -> bb5a2af03 [SPARK-11340][SPARKR] Support setting driver properties when starting Spark from R programmatically or from RStudio Mapping spark.driver.memory from sparkEnvir to spark-submit commandline arguments. shiva

spark git commit: [SPARK-11407][SPARKR] Add doc for running from RStudio

2015-11-03 Thread shivaram
dea) shivaram Author: felixcheung Closes #9401 from felixcheung/rstudioprogrammingguide. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/a9676cc7 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/a9676cc7 Diff: http://git-

spark git commit: [DOC] Missing link to R DataFrame API doc

2015-11-03 Thread shivaram
red: Tue Nov 3 16:38:22 2015 -0800 Committer: Shivaram Venkataraman Committed: Tue Nov 3 16:38:22 2015 -0800 -- R/pkg/R/DataFrame.R | 105 ++--- docs/sql-programming-guide.md | 2 +- 2 fi

spark git commit: [SPARK-11260][SPARKR] with() function support

2015-11-05 Thread shivaram
v 5 14:47:38 2015 -0800 Committer: Shivaram Venkataraman Committed: Thu Nov 5 14:47:38 2015 -0800 -- R/pkg/NAMESPACE | 1 + R/pkg/R/DataFrame.R | 30 -- R/pkg/R/generic

spark git commit: [SPARK-11260][SPARKR] with() function support

2015-11-05 Thread shivaram
-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/975ae4e6 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/975ae4e6 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/975ae4e6 Branch: refs/he

spark git commit: [SPARK-9865][SPARKR] Flaky SparkR test: test_sparkSQL.R: sample on a DataFrame

2015-11-09 Thread shivaram
asf/spark/diff/cd174882 Branch: refs/heads/master Commit: cd174882a5a211298d6e173fe989d567d08ebc0d Parents: 404a28f Author: felixcheung Authored: Mon Nov 9 10:26:09 2015 -0800 Committer: Shivaram Venkataraman Committed: Mon Nov 9 10:26:09 2015 -0

spark git commit: [SPARK-9865][SPARKR] Flaky SparkR test: test_sparkSQL.R: sample on a DataFrame

2015-11-09 Thread shivaram
eak } } ``` Author: felixcheung Closes #9549 from felixcheung/rsample. (cherry picked from commit cd174882a5a211298d6e173fe989d567d08ebc0d) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/7b4d7

spark git commit: [SPARK-11587][SPARKR] Fix the summary generic to match base R

2015-11-09 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 1431319e5 -> c4e19b381 [SPARK-11587][SPARKR] Fix the summary generic to match base R The signature is summary(object, ...) as defined in https://stat.ethz.ch/R-manual/R-devel/library/base/html/summary.html Author: Shivaram Venkatara

spark git commit: [SPARK-11587][SPARKR] Fix the summary generic to match base R

2015-11-09 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-1.6 d6f4b56a6 -> a5651f0a5 [SPARK-11587][SPARKR] Fix the summary generic to match base R The signature is summary(object, ...) as defined in https://stat.ethz.ch/R-manual/R-devel/library/base/html/summary.html Author: Shiva

spark git commit: [SPARK-10863][SPARKR] Method coltypes() (New version)

2015-11-10 Thread shivaram
ARK-10863_NEW14. (cherry picked from commit 47735cdc2a878cfdbe76316d3ff8314a45dabf54) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d2405cb5 Tree: http://git-wip-us.apache.org/repos/asf/spark/t

spark git commit: [SPARK-10863][SPARKR] Method coltypes() (New version)

2015-11-10 Thread shivaram
mit: 47735cdc2a878cfdbe76316d3ff8314a45dabf54 Parents: e0701c7 Author: Oscar D. Lara Yejas Authored: Tue Nov 10 11:07:57 2015 -0800 Committer: Shivaram Venkataraman Committed: Tue Nov 10 11:07:57 2015 -0800 -- R/pkg/DESCRIPT

[1/2] spark git commit: [SPARK-11263][SPARKR] lintr Throws Warnings on Commented Code in Documentation

2015-11-12 Thread shivaram
Repository: spark Updated Branches: refs/heads/master e71c07557 -> ed04846e1 http://git-wip-us.apache.org/repos/asf/spark/blob/ed04846e/R/pkg/R/context.R -- diff --git a/R/pkg/R/context.R b/R/pkg/R/context.R index 720990e..471b

[2/2] spark git commit: [SPARK-11263][SPARKR] lintr Throws Warnings on Commented Code in Documentation

2015-11-12 Thread shivaram
rents: e71c075 Author: felixcheung Authored: Thu Nov 12 20:02:49 2015 -0800 Committer: Shivaram Venkataraman Committed: Thu Nov 12 20:02:49 2015 -0800 -- R/pkg/R/DataFrame.R| 232 +++---

[1/2] spark git commit: [SPARK-11263][SPARKR] lintr Throws Warnings on Commented Code in Documentation

2015-11-12 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-1.6 874cd29f2 -> ea9f7c580 http://git-wip-us.apache.org/repos/asf/spark/blob/ea9f7c58/R/pkg/R/context.R -- diff --git a/R/pkg/R/context.R b/R/pkg/R/context.R index 720990e..

[2/2] spark git commit: [SPARK-11263][SPARKR] lintr Throws Warnings on Commented Code in Documentation

2015-11-12 Thread shivaram
bdab247c0e1fe2a47b99155c82) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ea9f7c58 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/ea9f7c58 Diff: http://git-wip-us.apache.org/rep

spark git commit: [SPARK-11717] Ignore R session and history files from git

2015-11-12 Thread shivaram
wip-us.apache.org/repos/asf/spark/tree/2035ed39 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/2035ed39 Branch: refs/heads/master Commit: 2035ed392e0a9c18ff9c176a7b0f0097ed1276df Parents: ed04846 Author: Lewuathe Authored: Thu Nov 12 20:09:42 2015 -0800 Committer: Shivaram Venkataraman Committed:

spark git commit: [SPARK-11086][SPARKR] Use dropFactors column-wise instead of nested loop when createDataFrame

2015-11-15 Thread shivaram
323 Authored: Sun Nov 15 19:15:27 2015 -0800 Committer: Shivaram Venkataraman Committed: Sun Nov 15 19:15:27 2015 -0800 -- R/pkg/R/SQLContext.R | 54 +-- R/pkg/inst/tests/test_sparkSQL.R |

spark git commit: [SPARK-11086][SPARKR] Use dropFactors column-wise instead of nested loop when createDataFrame

2015-11-15 Thread shivaram
a8b) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d981bfcc Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/d981bfcc Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/d981b

spark git commit: [SPARK-10500][SPARKR] sparkr.zip cannot be created if /R/lib is unwritable

2015-11-15 Thread shivaram
another PR. Various R files are updated to accept multiple lib paths (one is for SparkR package, the other is for other R packages) so that these package can be accessed in R. Author: Sun Rui Closes #9390 from sun-rui/SPARK-10500. (cherry picked from commit 835a79d78ee879a3c36dde85e5b3591243bf3

spark git commit: [SPARK-10500][SPARKR] sparkr.zip cannot be created if /R/lib is unwritable

2015-11-15 Thread shivaram
Authored: Sun Nov 15 19:29:09 2015 -0800 Committer: Shivaram Venkataraman Committed: Sun Nov 15 19:29:09 2015 -0800 -- R/install-dev.bat | 6 +++ R/install-dev.sh

spark git commit: [SPARK-11755][R] SparkR should export "predict"

2015-11-17 Thread shivaram
orks/R.framework/Versions/3.2/Resources/library Choose one 1: Make predictions from a model {SparkR} 2: Model Predictions {stats} ``` Author: Yanbo Liang Closes #9732 from yanboliang/spark-11755. (cherry picked from commit 8fb775ba874dd0488667bf299a7b49760062dc00) Signed-off-by: Shivaram Venkataraman

spark git commit: [SPARK-11755][R] SparkR should export "predict"

2015-11-17 Thread shivaram
-0800 Committer: Shivaram Venkataraman Committed: Tue Nov 17 22:13:15 2015 -0800 -- R/pkg/R/generics.R | 4 1 file changed, 4 insertions(+) -- http://git-w

spark git commit: [SPARK-11281][SPARKR] Add tests covering the issue.

2015-11-18 Thread shivaram
asf/spark/diff/a97d6f3a Branch: refs/heads/master Commit: a97d6f3a5861e9f2bbe36957e3b39f835f3e214c Parents: 3a6807f Author: zero323 Authored: Wed Nov 18 08:32:03 2015 -0800 Committer: Shivaram Venkataraman Committed: Wed Nov 18 08:32:03 2015 -0

spark git commit: [SPARK-11281][SPARKR] Add tests covering the issue.

2015-11-18 Thread shivaram
086). Author: zero323 Closes #9743 from zero323/SPARK-11281-tests. (cherry picked from commit a97d6f3a5861e9f2bbe36957e3b39f835f3e214c) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/99c2e

spark git commit: [SPARK-11773][SPARKR] Implement collection functions in SparkR.

2015-11-18 Thread shivaram
08:41:45 2015 -0800 Committer: Shivaram Venkataraman Committed: Wed Nov 18 08:41:45 2015 -0800 -- R/pkg/NAMESPACE | 2 + R/pkg/R/DataFrame.R | 2 +- R/pkg/R/functions.R |

<    1   2   3   4   5   6   >