spark git commit: [SPARK-11755][R] SparkR should export "predict"

2015-11-17 Thread shivaram
orks/R.framework/Versions/3.2/Resources/library Choose one 1: Make predictions from a model {SparkR} 2: Model Predictions {stats} ``` Author: Yanbo Liang <yblia...@gmail.com> Closes #9732 from yanboliang/spark-11755. (cherry picked from commit 8fb775ba874dd0488667bf299a7b49760062dc00) S

spark git commit: [SPARK-11086][SPARKR] Use dropFactors column-wise instead of nested loop when createDataFrame

2015-11-15 Thread shivaram
b Parents: 72c1d68 Author: zero323 <matthew.szymkiew...@gmail.com> Authored: Sun Nov 15 19:15:27 2015 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Sun Nov 15 19:15:27 2015 -0800 --

spark git commit: [SPARK-11086][SPARKR] Use dropFactors column-wise instead of nested loop when createDataFrame

2015-11-15 Thread shivaram
om commit d7d9fa0b8750166f8b74f9bc321df26908683a8b) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d981bfcc Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/d981

spark git commit: [SPARK-10500][SPARKR] sparkr.zip cannot be created if /R/lib is unwritable

2015-11-15 Thread shivaram
879a3c36dde85e5b3591243bf3957) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/b56aaa9b Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/b56aaa9b Diff: htt

spark git commit: [SPARK-10500][SPARKR] sparkr.zip cannot be created if /R/lib is unwritable

2015-11-15 Thread shivaram
d7d9fa0 Author: Sun Rui <rui@intel.com> Authored: Sun Nov 15 19:29:09 2015 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Sun Nov 15 19:29:09 2015 -0800 -- R/install-dev.bat

[1/2] spark git commit: [SPARK-11263][SPARKR] lintr Throws Warnings on Commented Code in Documentation

2015-11-12 Thread shivaram
Repository: spark Updated Branches: refs/heads/master e71c07557 -> ed04846e1 http://git-wip-us.apache.org/repos/asf/spark/blob/ed04846e/R/pkg/R/context.R -- diff --git a/R/pkg/R/context.R b/R/pkg/R/context.R index

[2/2] spark git commit: [SPARK-11263][SPARKR] lintr Throws Warnings on Commented Code in Documentation

2015-11-12 Thread shivaram
e1fe2a47b99155c82 Parents: e71c075 Author: felixcheung <felixcheun...@hotmail.com> Authored: Thu Nov 12 20:02:49 2015 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Thu Nov 12 20:02:49 2015 -0800

[1/2] spark git commit: [SPARK-11263][SPARKR] lintr Throws Warnings on Commented Code in Documentation

2015-11-12 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-1.6 874cd29f2 -> ea9f7c580 http://git-wip-us.apache.org/repos/asf/spark/blob/ea9f7c58/R/pkg/R/context.R -- diff --git a/R/pkg/R/context.R b/R/pkg/R/context.R index

[2/2] spark git commit: [SPARK-11263][SPARKR] lintr Throws Warnings on Commented Code in Documentation

2015-11-12 Thread shivaram
cherry picked from commit ed04846e144db5bdab247c0e1fe2a47b99155c82) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ea9f7c58 Tree: http://git-wip-us.apache.org/repos/asf/spark/tre

spark git commit: [SPARK-11717] Ignore R session and history files from git

2015-11-12 Thread shivaram
-0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Thu Nov 12 20:09:42 2015 -0800 -- .gitignore | 4 1 file changed, 4 insertions(+) --

spark git commit: [SPARK-10863][SPARKR] Method coltypes() (New version)

2015-11-10 Thread shivaram
9579 from olarayej/SPARK-10863_NEW14. (cherry picked from commit 47735cdc2a878cfdbe76316d3ff8314a45dabf54) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commi

spark git commit: [SPARK-10863][SPARKR] Method coltypes() (New version)

2015-11-10 Thread shivaram
nch: refs/heads/master Commit: 47735cdc2a878cfdbe76316d3ff8314a45dabf54 Parents: e0701c7 Author: Oscar D. Lara Yejas <olara...@mail.usf.edu> Authored: Tue Nov 10 11:07:57 2015 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Tue Nov 1

spark git commit: [SPARK-11587][SPARKR] Fix the summary generic to match base R

2015-11-09 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 1431319e5 -> c4e19b381 [SPARK-11587][SPARKR] Fix the summary generic to match base R The signature is summary(object, ...) as defined in https://stat.ethz.ch/R-manual/R-devel/library/base/html/summary.html Author: Shivaram Venkatara

spark git commit: [SPARK-11587][SPARKR] Fix the summary generic to match base R

2015-11-09 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-1.6 d6f4b56a6 -> a5651f0a5 [SPARK-11587][SPARKR] Fix the summary generic to match base R The signature is summary(object, ...) as defined in https://stat.ethz.ch/R-manual/R-devel/library/base/html/summary.html Author: Shiva

spark git commit: [SPARK-9865][SPARKR] Flaky SparkR test: test_sparkSQL.R: sample on a DataFrame

2015-11-09 Thread shivaram
eak } } ``` Author: felixcheung <felixcheun...@hotmail.com> Closes #9549 from felixcheung/rsample. (cherry picked from commit cd174882a5a211298d6e173fe989d567d08ebc0d) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Com

spark git commit: [SPARK-9865][SPARKR] Flaky SparkR test: test_sparkSQL.R: sample on a DataFrame

2015-11-09 Thread shivaram
//git-wip-us.apache.org/repos/asf/spark/diff/cd174882 Branch: refs/heads/master Commit: cd174882a5a211298d6e173fe989d567d08ebc0d Parents: 404a28f Author: felixcheung <felixcheun...@hotmail.com> Authored: Mon Nov 9 10:26:09 2015 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.e

spark git commit: [SPARK-11260][SPARKR] with() function support

2015-11-05 Thread shivaram
65ad3ad3122bcc0 Parents: 8a5314e Author: adrian555 <wzhu...@us.ibm.com> Authored: Thu Nov 5 14:47:38 2015 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Thu Nov 5 14:47:38 2015 -0800

spark git commit: [SPARK-11407][SPARKR] Add doc for running from RStudio

2015-11-03 Thread shivaram
dea) shivaram Author: felixcheung <felixcheun...@hotmail.com> Closes #9401 from felixcheung/rstudioprogrammingguide. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/a9676cc7 Tree: http://git-wip-us.apache.org/repos/asf/s

spark git commit: [DOC] Missing link to R DataFrame API doc

2015-11-03 Thread shivaram
bea621b Parents: 5051262 Author: lewuathe <lewua...@me.com> Authored: Tue Nov 3 16:38:22 2015 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Tue Nov 3 16:38:22 2015 -0800 -- R/pkg/R/

spark git commit: [SPARK-11340][SPARKR] Support setting driver properties when starting Spark from R programmatically or from RStudio

2015-10-30 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 729f983e6 -> bb5a2af03 [SPARK-11340][SPARKR] Support setting driver properties when starting Spark from R programmatically or from RStudio Mapping spark.driver.memory from sparkEnvir to spark-submit commandline arguments. shiva

spark git commit: [SPARK-11414][SPARKR] Forgot to update usage of 'spark.sparkr.r.command' in RRDD in the PR for SPARK-10971.

2015-10-30 Thread shivaram
er Commit: fab710a9171932f01ac81d100db8523dbd314925 Parents: 0451b00 Author: Sun Rui <rui@intel.com> Authored: Fri Oct 30 10:51:11 2015 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Fri Oct 30 10:51:11 2015 -0700 -- co

spark git commit: [SPARK-10979][SPARKR] Sparkrmerge: Add merge to DataFrame with R signature

2015-10-26 Thread shivaram
//git-wip-us.apache.org/repos/asf/spark/diff/3689beb9 Branch: refs/heads/master Commit: 3689beb98b6a6db61e35049fdb57b0cd6aad8019 Parents: 616be29 Author: Narine Kokhlikyan <narine.kokhlik...@gmail.com> Authored: Mon Oct 26 15:12:25 2015 -0700 Committer: Shivaram Venkataraman <shiva.

spark git commit: [SPARK-11258] Converting a Spark DataFrame into an R data.frame is slow / requires a lot of memory

2015-10-26 Thread shivaram
iff: http://git-wip-us.apache.org/repos/asf/spark/diff/b60aab8a Branch: refs/heads/master Commit: b60aab8a95e2a35a1d4023a9d0a0d9724e4164f9 Parents: 3689beb Author: Frank Rosner <fr...@fam-rosner.de> Authored: Mon Oct 26 15:46:59 2015 -0700 Committer: Shivaram Venkataraman <shiva.

spark git commit: [SPARK-11209][SPARKR] Add window functions into SparkR [step 1].

2015-10-26 Thread shivaram
Rui <rui@intel.com> Authored: Mon Oct 26 20:58:18 2015 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Mon Oct 26 20:58:18 2015 -0700 -- R/pkg/NAMESPACE

spark git commit: [SPARK-11294][SPARKR] Improve R doc for read.df, write.df, saveAsTable

2015-10-23 Thread shivaram
ral text issues: ![image](https://cloud.githubusercontent.com/assets/8969467/10708590/1303a44e-79c3-11e5-854f-3a2e16854cd7.png) - text collapsed into a single paragraph - text truncated at 2 places, eg. "overwrite: Existing data is expected to be overwritten by the contents of error:&qu

spark git commit: [SPARK-10971][SPARKR] RRunner should allow setting path to Rscript.

2015-10-23 Thread shivaram
e/spark/blob/master/core/src/main/scala/org/apache/spark/deploy/PythonRunner.scala#L41) to determine the python executable for a python script. Author: Sun Rui <rui@intel.com> Closes #9179 from sun-rui/SPARK-10971. (cherry picked from commit 2462dbcce89d657bca17ae311c99c2a4bee4a5fa) Sign

spark git commit: [SPARK-10971][SPARKR] RRunner should allow setting path to Rscript.

2015-10-23 Thread shivaram
@intel.com> Authored: Fri Oct 23 21:38:04 2015 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Fri Oct 23 21:38:04 2015 -0700 -- .../scala/org/apache/spark/deploy/RRun

spark git commit: [SPARK-11294][SPARKR] Improve R doc for read.df, write.df, saveAsTable

2015-10-23 Thread shivaram
ral text issues: ![image](https://cloud.githubusercontent.com/assets/8969467/10708590/1303a44e-79c3-11e5-854f-3a2e16854cd7.png) - text collapsed into a single paragraph - text truncated at 2 places, eg. "overwrite: Existing data is expected to be overwritten by the contents of error:" shi

spark git commit: [SPARK-11221][SPARKR] fix R doc for lit and add examples

2015-10-20 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 135ade905 -> 1107bd958 [SPARK-11221][SPARKR] fix R doc for lit and add examples Currently the documentation for `lit` is inconsistent with doc format, references "Scala symbol" and has no example. Fixing that. shi

spark git commit: [SPARK-10981] [SPARKR] SparkR Join improvements

2015-10-13 Thread shivaram
ache.org/repos/asf/spark/tree/8b328857 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/8b328857 Branch: refs/heads/master Commit: 8b32885704502ab2a715cf5142d7517181074428 Parents: ce3f9a8 Author: Monica Liu <liu.monic...@gmail.com> Authored: Tue Oct 13 22:24:52 2015 -0700 Committer: Shivaram

spark git commit: [SPARK-10996] [SPARKR] Implement sampleBy() in DataFrameStatFunctions.

2015-10-13 Thread shivaram
: Sun Rui <rui@intel.com> Authored: Tue Oct 13 22:31:23 2015 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Tue Oct 13 22:31:23 2015 -0700 -- R/pkg/NAMESPACE | 3 ++-

spark git commit: [SPARK-10051] [SPARKR] Support collecting data of StructType in DataFrame

2015-10-13 Thread shivaram
/asf/spark/tree/5e3868ba Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/5e3868ba Branch: refs/heads/master Commit: 5e3868ba139f5f0b3a33361c6b884594a3ab6421 Parents: d0cc79c Author: Sun Rui <rui@intel.com> Authored: Tue Oct 13 10:02:21 2015 -0700 Committer: Shivaram Venkataraman &

spark git commit: [SPARK-10913] [SPARKR] attach() function support

2015-10-13 Thread shivaram
s/master Commit: f7f28ee7a513c262d52cf433d25fbf06df9bd1f1 Parents: 1e0aba9 Author: Adrian Zhuang <adrian...@users.noreply.github.com> Authored: Tue Oct 13 10:21:07 2015 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Tue

spark git commit: [SPARK-10079] [SPARKR] Make 'column' and 'col' functions be S4 functions.

2015-10-10 Thread shivaram
4ce4 Author: Sun Rui <rui@intel.com> Authored: Fri Oct 9 23:05:38 2015 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Fri Oct 9 23:05:38 2015 -0700 -- R/pkg/NAMESPACE

spark git commit: [SPARK-10905] [SPARKR] Export freqItems() for DataFrameStatFunctions

2015-10-09 Thread shivaram
6:40 2015 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Fri Oct 9 09:36:40 2015 -0700 -- R/pkg/NAMESPACE | 1 + R/pkg/R/generics.R | 4 R/pkg/R/stats.R

spark git commit: [SPARK-10836] [SPARKR] Added sort(x, decreasing, col, ... ) method to DataFrame

2015-10-08 Thread shivaram
d9d Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/e8f90d9d Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/e8f90d9d Branch: refs/heads/master Commit: e8f90d9dda3f87fef01c683462eac67aad750f60 Parents: 56a9692 Author: Narine Kokhlikyan <narine.kokhlik...@gmail.com> Authored: Thu

spark git commit: [SPARK-10904] [SPARKR] Fix to support `select(df, c("col1", "col2"))`

2015-10-03 Thread shivaram
http://git-wip-us.apache.org/repos/asf/spark/diff/721e8b5f Branch: refs/heads/master Commit: 721e8b5f35b230ff426c1757a9bdc1399fb19afa Parents: ae6570e Author: felixcheung <felixcheun...@hotmail.com> Authored: Sat Oct 3 22:42:36 2015 -0700 Committer: Shivaram Venkataraman <shiva...

spark git commit: [SPARK-10904] [SPARKR] Fix to support `select(df, c("col1", "col2"))`

2015-10-03 Thread shivaram
JVM with. Author: felixcheung <felixcheun...@hotmail.com> Closes #8961 from felixcheung/rselect. (cherry picked from commit 721e8b5f35b230ff426c1757a9bdc1399fb19afa) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Comm

spark git commit: [SPARK-10760] [SPARKR] SparkR glm: the documentation in examples - family argument is missing

2015-09-25 Thread shivaram
aster Commit: 6fcee906d2afb5d5c3c49e0a669637a87e82b910 Parents: 9223388 Author: Narine Kokhlikyan <narine.kokhlik...@gmail.com> Authored: Fri Sep 25 11:55:08 2015 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Fri Se

spark git commit: [SPARK-9710] [TEST] Fix RPackageUtilsSuite when R is not available.

2015-09-23 Thread shivaram
lt;van...@cloudera.com> Closes #8008 from vanzin/SPARK-9710 and squashes the following commits: df72d8c [Marcelo Vanzin] [SPARK-9710] [test] Fix RPackageUtilsSuite when R is not available. (cherry picked from commit 0f3366a4c740147a7a7519922642912e2dd238f8) Signed-off-by: Shivaram Venkataram

svn commit: r1703900 [4/8] - /spark/site/docs/1.5.0/api/R/

2015-09-18 Thread shivaram
Added: spark/site/docs/1.5.0/api/R/greatest.html URL: http://svn.apache.org/viewvc/spark/site/docs/1.5.0/api/R/greatest.html?rev=1703900=auto == --- spark/site/docs/1.5.0/api/R/greatest.html (added) +++

svn commit: r1703900 [1/8] - /spark/site/docs/1.5.0/api/R/

2015-09-18 Thread shivaram
Author: shivaram Date: Fri Sep 18 16:25:35 2015 New Revision: 1703900 URL: http://svn.apache.org/viewvc?rev=1703900=rev Log: Add 1.5.0 R API docs back Added: spark/site/docs/1.5.0/api/R/ spark/site/docs/1.5.0/api/R/00Index.html spark/site/docs/1.5.0/api/R/00frame_toc.html spark

svn commit: r1703900 [5/8] - /spark/site/docs/1.5.0/api/R/

2015-09-18 Thread shivaram
Added: spark/site/docs/1.5.0/api/R/log2.html URL: http://svn.apache.org/viewvc/spark/site/docs/1.5.0/api/R/log2.html?rev=1703900=auto == --- spark/site/docs/1.5.0/api/R/log2.html (added) +++

svn commit: r1703900 [3/8] - /spark/site/docs/1.5.0/api/R/

2015-09-18 Thread shivaram
Added: spark/site/docs/1.5.0/api/R/createExternalTable.html URL: http://svn.apache.org/viewvc/spark/site/docs/1.5.0/api/R/createExternalTable.html?rev=1703900=auto == ---

svn commit: r1703900 [6/8] - /spark/site/docs/1.5.0/api/R/

2015-09-18 Thread shivaram
Added: spark/site/docs/1.5.0/api/R/randn.html URL: http://svn.apache.org/viewvc/spark/site/docs/1.5.0/api/R/randn.html?rev=1703900=auto == --- spark/site/docs/1.5.0/api/R/randn.html (added) +++

spark git commit: [SPARK-10050] [SPARKR] Support collecting data of MapType in DataFrame.

2015-09-16 Thread shivaram
/896edb51 Branch: refs/heads/master Commit: 896edb51ab7a88bbb31259e565311a9be6f2ca6d Parents: 5dbaf3d Author: Sun Rui <rui@intel.com> Authored: Wed Sep 16 13:20:39 2015 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Wed Sep 1

spark git commit: [SPARK-10049] [SPARKR] Support collecting data of ArraryType in DataFrame.

2015-09-10 Thread shivaram
/45e3be5c Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/45e3be5c Branch: refs/heads/master Commit: 45e3be5c138d983f40f619735d60bf7eb78c9bf0 Parents: d88abb7 Author: Sun Rui <rui@intel.com> Authored: Thu Sep 10 12:21:13 2015 -0700 Committer: Shivaram Venkataraman <shiva.

spark git commit: Add 1.5 to master branch EC2 scripts

2015-09-10 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 3db72554b -> 420475771 Add 1.5 to master branch EC2 scripts This change brings it to par with `branch-1.5` (and 1.5.0 release) Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Closes #8704 from shivaram/ec2-1.5-update.

spark git commit: [SPARK-8951] [SPARKR] support Unicode characters in collect()

2015-09-03 Thread shivaram
-0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Thu Sep 3 13:38:26 2015 -0700 -- R/pkg/R/deserialize.R | 6 +++-- R/pkg/R/serialize.R | 2

spark git commit: [SPARK-10328] [SPARKR] Fix generic for na.omit

2015-08-28 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-1.5 bcb8fa849 - 9b7f8f293 [SPARK-10328] [SPARKR] Fix generic for na.omit S3 function is at https://stat.ethz.ch/R-manual/R-patched/library/stats/html/na.fail.html Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Author: Shivaram

spark git commit: [SPARK-10328] [SPARKR] Fix generic for na.omit

2015-08-28 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 7583681e6 - 2f99c3727 [SPARK-10328] [SPARKR] Fix generic for na.omit S3 function is at https://stat.ethz.ch/R-manual/R-patched/library/stats/html/na.fail.html Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Author: Shivaram

spark git commit: [SPARK-9803] [SPARKR] Add subset and transform + tests

2015-08-28 Thread shivaram
/2a4e00ca Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/2a4e00ca Branch: refs/heads/master Commit: 2a4e00ca4d4e7a148b4ff8ce0ad1c6d517cee55f Parents: bb7f352 Author: felixcheung felixcheun...@hotmail.com Authored: Fri Aug 28 18:35:01 2015 -0700 Committer: Shivaram Venkataraman shiva

spark git commit: [SPARK-8952] [SPARKR] - Wrap normalizePath calls with suppressWarnings

2015-08-28 Thread shivaram
lrese...@apache.org Closes #8343 from lresende/SPARK-8952. (cherry picked from commit 499e8e154bdcc9d7b2f685b159e0ddb4eae48fe4) Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf

spark git commit: [SPARK-8952] [SPARKR] - Wrap normalizePath calls with suppressWarnings

2015-08-28 Thread shivaram
/spark/diff/499e8e15 Branch: refs/heads/master Commit: 499e8e154bdcc9d7b2f685b159e0ddb4eae48fe4 Parents: e2a8430 Author: Luciano Resende lrese...@apache.org Authored: Fri Aug 28 09:13:21 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Fri Aug 28 09:13:21 2015 -0700

spark git commit: [SPARK-8505] [SPARKR] Add settings to kick `lint-r` from `./dev/run-test.py`

2015-08-27 Thread shivaram
into `dev/run-test.py`. Could you review it when you have time? shivaram I modified `dev/lint-r` and `dev/lint-r.R` to install lintr package into a local directory(`R/lib/`) and to exit with a lint status. Could you review it? - [[SPARK-8505] Add settings to kick `lint-r` from `./dev/run-test.py` - ASF

spark git commit: [SPARK-9316] [SPARKR] Add support for filtering using `[` (synonym for filter / select)

2015-08-26 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 321d77596 - 75d4773aa [SPARK-9316] [SPARKR] Add support for filtering using `[` (synonym for filter / select) Add support for ``` df[df$name == Smith, c(1,2)] df[df$age %in% c(19, 30), 1:2] ``` shivaram Author: felixcheung

spark git commit: [SPARK-9316] [SPARKR] Add support for filtering using `[` (synonym for filter / select)

2015-08-26 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-1.5 21a10a86d - 5220db9e3 [SPARK-9316] [SPARKR] Add support for filtering using `[` (synonym for filter / select) Add support for ``` df[df$name == Smith, c(1,2)] df[df$age %in% c(19, 30), 1:2] ``` shivaram Author: felixcheung

spark git commit: [MINOR] [SPARKR] Fix some validation problems in SparkR

2015-08-26 Thread shivaram
Repository: spark Updated Branches: refs/heads/master ad7f0f160 - 773ca037a [MINOR] [SPARKR] Fix some validation problems in SparkR Getting rid of some validation problems in SparkR https://github.com/apache/spark/pull/7883 cc shivaram ``` inst/tests/test_Serde.R:26:1: style: Trailing

spark git commit: [SPARK-10308] [SPARKR] Add %in% to the exported namespace

2015-08-26 Thread shivaram
Repository: spark Updated Branches: refs/heads/master d41d6c482 - ad7f0f160 [SPARK-10308] [SPARKR] Add %in% to the exported namespace I also checked all the other functions defined in column.R, functions.R and DataFrame.R and everything else looked fine. cc yu-iskw Author: Shivaram

spark git commit: [SPARK-10308] [SPARKR] Add %in% to the exported namespace

2015-08-26 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-1.5 0bdb80057 - cef707d21 [SPARK-10308] [SPARKR] Add %in% to the exported namespace I also checked all the other functions defined in column.R, functions.R and DataFrame.R and everything else looked fine. cc yu-iskw Author: Shivaram

spark git commit: [SPARK-10219] [SPARKR] Fix varargsToEnv and add test case

2015-08-26 Thread shivaram
Repository: spark Updated Branches: refs/heads/master ce97834dc - e936cf808 [SPARK-10219] [SPARKR] Fix varargsToEnv and add test case cc sun-rui davies Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Closes #8475 from shivaram/varargs-fix. Project: http://git-wip-us.apache.org

spark git commit: [SPARK-10219] [SPARKR] Fix varargsToEnv and add test case

2015-08-26 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-1.5 04c85a8ec - 165be9ad1 [SPARK-10219] [SPARKR] Fix varargsToEnv and add test case cc sun-rui davies Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Closes #8475 from shivaram/varargs-fix. (cherry picked from commit

spark git commit: [SPARK-10048] [SPARKR] Support arbitrary nested Java array in serde.

2015-08-25 Thread shivaram
-us.apache.org/repos/asf/spark/tree/71a138cd Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/71a138cd Branch: refs/heads/master Commit: 71a138cd0e0a14e8426f97877e3b52a562bbd02c Parents: 16a2be1 Author: Sun Rui rui@intel.com Authored: Tue Aug 25 13:14:10 2015 -0700 Committer: Shivaram Venkataraman

spark git commit: [SPARK-10118] [SPARKR] [DOCS] Improve SparkR API docs for 1.5 release

2015-08-24 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 2bf338c62 - 6511bf559 [SPARK-10118] [SPARKR] [DOCS] Improve SparkR API docs for 1.5 release cc: shivaram ## Summary - Modify `tdname` of expression functions. i.e. `ascii`: `rdname functions` = `rdname ascii` - Replace the dynamical

spark git commit: [SPARK-10118] [SPARKR] [DOCS] Improve SparkR API docs for 1.5 release

2015-08-24 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-1.5 228e429eb - ec5d09c0f [SPARK-10118] [SPARKR] [DOCS] Improve SparkR API docs for 1.5 release cc: shivaram ## Summary - Modify `tdname` of expression functions. i.e. `ascii`: `rdname functions` = `rdname ascii` - Replace the dynamical

spark git commit: [SPARK-9982] [SPARKR] SparkR DataFrame fail to return data of Decimal type

2015-08-20 Thread shivaram
39e91fe2fd43044cc734d55625a3c03284b69f09) Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/a7027e6d Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/a7027e6d Diff: http://git-wip

spark git commit: [SPARK-9982] [SPARKR] SparkR DataFrame fail to return data of Decimal type

2015-08-20 Thread shivaram
: Alex Shkurenko ashkure...@enova.com Authored: Thu Aug 20 10:16:38 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Thu Aug 20 10:16:38 2015 -0700 -- core/src/main/scala/org/apache/spark/api/r

spark git commit: [SPARK-9856] [SPARKR] Add expression functions into SparkR whose params are complicated

2015-08-19 Thread shivaram
: 2fcb9cb9552dac1d78dcca5d4d5032b4fa6c985c Parents: f3e1779 Author: Yu ISHIKAWA yuu.ishik...@gmail.com Authored: Wed Aug 19 10:41:14 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Wed Aug 19 10:41:14 2015 -0700 -- R/pkg/NAMESPACE

spark git commit: [SPARK-9856] [SPARKR] Add expression functions into SparkR whose params are complicated

2015-08-19 Thread shivaram
commit 2fcb9cb9552dac1d78dcca5d4d5032b4fa6c985c) Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/a8e88081 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/a8e88081

spark git commit: [SPARK-10106] [SPARKR] Add `ifelse` Column function to SparkR

2015-08-19 Thread shivaram
/spark/diff/d898c33f Branch: refs/heads/master Commit: d898c33f774b9a3db2fb6aa8f0cb2c2ac6004b58 Parents: 28a9846 Author: Yu ISHIKAWA yuu.ishik...@gmail.com Authored: Wed Aug 19 12:39:37 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Wed Aug 19 12:39:37 2015 -0700

spark git commit: [SPARK-10106] [SPARKR] Add `ifelse` Column function to SparkR

2015-08-19 Thread shivaram
yuu.ishik...@gmail.com Closes #8303 from yu-iskw/SPARK-10106. (cherry picked from commit d898c33f774b9a3db2fb6aa8f0cb2c2ac6004b58) Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf

spark git commit: [SPARKR] [MINOR] Get rid of a long line warning

2015-08-18 Thread shivaram
-by: Shivaram Venkataraman shiva...@cs.berkeley.edu Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/0a1385e3 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/0a1385e3 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff

spark git commit: [SPARKR] [MINOR] Get rid of a long line warning

2015-08-18 Thread shivaram
...@gmail.com Authored: Tue Aug 18 19:18:05 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Tue Aug 18 19:18:05 2015 -0700 -- R/pkg/R/functions.R | 4 +++- 1 file changed, 3 insertions(+), 1 deletion

spark git commit: [SPARK-10075] [SPARKR] Add `when` expressino function in SparkR

2015-08-18 Thread shivaram
doesn't support a feature like method chaining, `otherwise(when(condition, value), value)` style is a little annoying for me. If `%otherwise%` looks strange for shivaram, I can remove it. What do you think? ### JIRA [[SPARK-10075] Add `when` expressino function in SparkR - ASF JIRA](https

spark git commit: [SPARK-10075] [SPARKR] Add `when` expressino function in SparkR

2015-08-18 Thread shivaram
doesn't support a feature like method chaining, `otherwise(when(condition, value), value)` style is a little annoying for me. If `%otherwise%` looks strange for shivaram, I can remove it. What do you think? ### JIRA [[SPARK-10075] Add `when` expressino function in SparkR - ASF JIRA](https

spark git commit: Bump SparkR version string to 1.5.0

2015-08-18 Thread shivaram
Repository: spark Updated Branches: refs/heads/master badf7fa65 - 04e0fea79 Bump SparkR version string to 1.5.0 This patch is against master, but we need to apply it to 1.5 branch as well. cc shivaram and rxin Author: Hossein hoss...@databricks.com Closes #8291 from falaki

spark git commit: Bump SparkR version string to 1.5.0

2015-08-18 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-1.5 4ee225af8 - 9b42e2404 Bump SparkR version string to 1.5.0 This patch is against master, but we need to apply it to 1.5 branch as well. cc shivaram and rxin Author: Hossein hoss...@databricks.com Closes #8291 from falaki

spark git commit: [SPARK-10007] [SPARKR] Update `NAMESPACE` file in SparkR for simple parameters functions

2015-08-18 Thread shivaram
/1968276a Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/1968276a Branch: refs/heads/master Commit: 1968276af0f681fe51328b7dd795bd21724a5441 Parents: 5723d26 Author: Yuu ISHIKAWA yuu.ishik...@gmail.com Authored: Tue Aug 18 09:10:59 2015 -0700 Committer: Shivaram Venkataraman shiva

spark git commit: [SPARK-10007] [SPARKR] Update `NAMESPACE` file in SparkR for simple parameters functions

2015-08-18 Thread shivaram
://issues.apache.org/jira/browse/SPARK-10007) Author: Yuu ISHIKAWA yuu.ishik...@gmail.com Closes #8277 from yu-iskw/SPARK-10007. (cherry picked from commit 1968276af0f681fe51328b7dd795bd21724a5441) Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu Project: http://git-wip-us.apache.org/repos/asf

spark git commit: [SPARK-8844] [SPARKR] head/collect is broken in SparkR.

2015-08-16 Thread shivaram
: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Sun Aug 16 00:30:02 2015 -0700 -- R/pkg/R/deserialize.R| 16 ++-- R/pkg/inst/tests/test_sparkSQL.R | 20 2 files changed, 30

spark git commit: [SPARK-8844] [SPARKR] head/collect is broken in SparkR.

2015-08-16 Thread shivaram
) { does not take into consideration the case where numRows = 0. Will add unit test case. Author: Sun Rui rui@intel.com Closes #7419 from sun-rui/SPARK-8844. (cherry picked from commit 5f9ce738fe6bab3f0caffad0df1d3876178cf469) Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu

spark git commit: [SPARK-9855] [SPARKR] Add expression functions into SparkR whose params are simple

2015-08-12 Thread shivaram
yuu.ishik...@gmail.com Authored: Wed Aug 12 18:33:27 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Wed Aug 12 18:33:27 2015 -0700 -- R/pkg/DESCRIPTION| 1 + R/pkg/R/column.R

spark git commit: [SPARK-9855] [SPARKR] Add expression functions into SparkR whose params are simple

2015-08-12 Thread shivaram
) Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ca39c9e9 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/ca39c9e9 Diff: http://git-wip-us.apache.org/repos/asf

spark git commit: [SPARK-9916] [BUILD] [SPARKR] removed left-over sparkr.zip copy/create commands from codebase

2015-08-12 Thread shivaram
Repository: spark Updated Branches: refs/heads/master d7053bea9 - 2fb4901b7 [SPARK-9916] [BUILD] [SPARKR] removed left-over sparkr.zip copy/create commands from codebase sparkr.zip is now built by SparkSubmit on a need-to-build basis. cc shivaram Author: Burak Yavuz brk...@gmail.com

spark git commit: [SPARK-9916] [BUILD] [SPARKR] removed left-over sparkr.zip copy/create commands from codebase

2015-08-12 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-1.5 af470a757 - 3d1b9f007 [SPARK-9916] [BUILD] [SPARKR] removed left-over sparkr.zip copy/create commands from codebase sparkr.zip is now built by SparkSubmit on a need-to-build basis. cc shivaram Author: Burak Yavuz brk...@gmail.com

spark git commit: [SPARK-9710] [TEST] Fix RPackageUtilsSuite when R is not available.

2015-08-10 Thread shivaram
Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Mon Aug 10 10:10:40 2015 -0700 -- core/src/main/scala/org/apache/spark/api/r/RUtils.scala | 8 ++-- 1 file changed, 6 insertions(+), 2 deletions

spark git commit: [SPARK-9562] Change reference to amplab/spark-ec2 from mesos/

2015-08-04 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-1.5 d875368ed - aa8390dfc [SPARK-9562] Change reference to amplab/spark-ec2 from mesos/ cc srowen pwendell nchammas Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Closes #7899 from shivaram/spark-ec2-move and squashes

spark git commit: [SPARK-9562] Change reference to amplab/spark-ec2 from mesos/

2015-08-04 Thread shivaram
Repository: spark Updated Branches: refs/heads/master b5034c9c5 - 6a0f8b994 [SPARK-9562] Change reference to amplab/spark-ec2 from mesos/ cc srowen pwendell nchammas Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Closes #7899 from shivaram/spark-ec2-move and squashes the following

spark git commit: [SPARK-8313] R Spark packages support

2015-08-04 Thread shivaram
Repository: spark Updated Branches: refs/heads/master a7fe48f68 - c9a4c36d0 [SPARK-8313] R Spark packages support shivaram cafreeman Could you please help me in testing this out? Exposing and running `rPackageBuilder` from inside the shell works, but for some reason, I can't get it to work

spark git commit: [SPARK-8313] R Spark packages support

2015-08-04 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-1.5 02a6333d2 - 11d231159 [SPARK-8313] R Spark packages support shivaram cafreeman Could you please help me in testing this out? Exposing and running `rPackageBuilder` from inside the shell works, but for some reason, I can't get

spark git commit: [SPARK-9318] [SPARK-9320] [SPARKR] Aliases for merge and summary functions on DataFrames

2015-07-31 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 8cb415a4b - 712f5b7a9 [SPARK-9318] [SPARK-9320] [SPARKR] Aliases for merge and summary functions on DataFrames This PR adds synonyms for ```merge``` and ```summary``` in SparkR DataFrame API. cc shivaram Author: Hossein hoss

spark git commit: [SPARK-9053] [SPARKR] Fix spaces around parens, infix operators etc.

2015-07-31 Thread shivaram
-us.apache.org/repos/asf/spark/diff/fc0e57e5 Branch: refs/heads/master Commit: fc0e57e5aba82a3f227fef05a843283e2ec893fc Parents: 6bba750 Author: Yu ISHIKAWA yuu.ishik...@gmail.com Authored: Fri Jul 31 09:33:38 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Fri Jul 31

spark git commit: [SPARK-9510] [SPARKR] Remaining SparkR style fixes

2015-07-31 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 6e5fd613e - 82f47b811 [SPARK-9510] [SPARKR] Remaining SparkR style fixes With the change in this patch, I get no more warnings from `./dev/lint-r` in my machine Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Closes #7834 from

spark git commit: [SPARK-9324] [SPARK-9322] [SPARK-9321] [SPARKR] Some aliases for R-like functions in DataFrames

2015-07-31 Thread shivaram
Authored: Fri Jul 31 14:07:41 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Fri Jul 31 14:08:18 2015 -0700 -- R/pkg/NAMESPACE | 6 +++ R/pkg/R/DataFrame.R | 90

spark git commit: [SPARK-8742] [SPARKR] Improve SparkR error messages for DataFrame API

2015-07-30 Thread shivaram
), the message of the cause is sent back through the RPC and the R client reads it and returns it back to user. cc shivaram Author: Hossein hoss...@databricks.com Closes #7742 from falaki/SPARK-8742 and squashes the following commits: 4f643c9 [Hossein] Not logging exceptions in RBackendHandler 4a8005c

spark git commit: [SPARK-9248] [SPARKR] Closing curly-braces should always be on their own line

2015-07-30 Thread shivaram
/7492a33f Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/7492a33f Branch: refs/heads/master Commit: 7492a33fdd074446c30c657d771a69932a00246d Parents: 81464f2 Author: Yuu ISHIKAWA yuu.ishik...@gmail.com Authored: Thu Jul 30 10:00:27 2015 -0700 Committer: Shivaram Venkataraman shiva

spark git commit: [SPARK-9437] [CORE] avoid overflow in SizeEstimator

2015-07-30 Thread shivaram
/spark/tree/06b6a074 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/06b6a074 Branch: refs/heads/master Commit: 06b6a074fb224b3fe23922bdc89fc5f7c2ffaaf6 Parents: 520ec0f Author: Imran Rashid iras...@cloudera.com Authored: Thu Jul 30 10:46:26 2015 -0700 Committer: Shivaram Venkataraman shiva

spark git commit: Use vector-friendly comparison for packages argument.

2015-07-28 Thread shivaram
/spark/diff/61432340 Branch: refs/heads/master Commit: 614323406225a3522ee601935ce3052449614145 Parents: 35ef853 Author: trestletech jeff.al...@trestletechnology.net Authored: Tue Jul 28 10:45:19 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Tue Jul 28 10:45:19 2015

spark git commit: Use vector-friendly comparison for packages argument.

2015-07-28 Thread shivaram
[trestletech] Use vector-friendly comparison for packages argument. (cherry picked from commit 614323406225a3522ee601935ce3052449614145) Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos

spark git commit: [SPARK-9249] [SPARKR] local variable assigned but may not be used

2015-07-24 Thread shivaram
ISHIKAWA yuu.ishik...@gmail.com Authored: Fri Jul 24 09:10:11 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Fri Jul 24 09:10:57 2015 -0700 -- R/pkg/R/deserialize.R | 4 ++-- R/pkg/R/sparkR.R | 3

<    1   2   3   4   5   >