git commit: Fixing typo in als.py

: 98944a9734389cd4400516a1eb3afa5376f44927 Parents: 6f701ff Author: Evan Sparks evan.spa...@gmail.com Authored: Thu May 8 13:07:30 2014 -0700 Committer: Shivaram Venkataraman shiva...@eecs.berkeley.edu Committed: Thu May 8 16:49:33 2014 -0700

git commit: Fixing typo in als.py

: 5c5e7d5809d337ce41a7a90eb9201e12803aba48 Parents: c3f8b78 Author: Evan Sparks evan.spa...@gmail.com Authored: Thu May 8 13:07:30 2014 -0700 Committer: Shivaram Venkataraman shiva...@eecs.berkeley.edu Committed: Thu May 8 13:07:30 2014 -0700 -- examples

git commit: [SPARK-2950] Add gc time and shuffle write time to JobLogger

but are currently missed from the JobLogger output. This patch adds these two fields. ~~Since this is a small change, I didn't create a JIRA. Let me know if I should do that.~~ cc kayousterhout Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Closes #1869 from shivaram/job-logger and squashes

git commit: [EC2] Factor out Mesos spark-ec2 branch

Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/2aca97c7 Branch: refs/heads/master Commit: 2aca97c7cfdefea8b6f9dbb88951e9acdfd606d9 Parents: 76386e1 Author: Nicholas Chammas nicholas.cham...@gmail.com Authored: Mon Nov 3 09:02:35 2014 -0800 Committer: Shivaram Venkataraman shiva

git commit: [SPARK-4137] [EC2] Don't change working dir on user

Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Wed Nov 5 20:45:35 2014 -0800 -- ec2/spark-ec2| 8 ++-- ec2/spark_ec2.py | 12 +++- 2 files changed, 17 insertions(+), 3 deletions

git commit: [SPARK-4137] [EC2] Don't change working dir on user

deploy.generic path absolutely bcdf6a5 [Nicholas Chammas] fix typo 77871a2 [Nicholas Chammas] add clarifying comment ce071fc [Nicholas Chammas] don't change working dir (cherry picked from commit db45f5ad0368760dbeaa618a04f66ae9b2bed656) Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu

spark git commit: [Minor][SparkR] Minor refactor and removes redundancy related to cleanClosure.

: 0ba3fdd5992cf09bd38303ebff34d2ed19e5e09b Parents: b45059d Author: hlin09 hlin0...@gmail.com Authored: Mon Apr 13 20:43:24 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Mon Apr 13 20:43:24 2015 -0700 -- R/pkg/R/RDD.R | 16

spark git commit: [SPARK-6818] [SPARKR] Support column deletion in SparkR DataFrame API.

/diff/73db132b Branch: refs/heads/master Commit: 73db132bf503341c7a5cf9409351c282a8464175 Parents: 6220d93 Author: Sun Rui rui@intel.com Authored: Thu Apr 23 16:08:14 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Thu Apr 23 16:08:14 2015 -0700

spark git commit: [SPARK-7033] [SPARKR] Clean usage of split. Use partition instead where applicable.

/spark/tree/ebb77b2a Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/ebb77b2a Branch: refs/heads/master Commit: ebb77b2aff085e71906b5de9d266ded89051af82 Parents: 6e57d57 Author: Sun Rui rui@intel.com Authored: Fri Apr 24 11:00:19 2015 -0700 Committer: Shivaram Venkataraman shiva

spark git commit: [SPARK-6852] [SPARKR] Accept numeric as numPartitions in SparkR.

-us.apache.org/repos/asf/spark/tree/caf0136e Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/caf0136e Branch: refs/heads/master Commit: caf0136ec5838cf5bf61f39a5b3474a505a6ae11 Parents: ebb77b2 Author: Sun Rui rui@intel.com Authored: Fri Apr 24 12:52:07 2015 -0700 Committer: Shivaram Venkataraman

spark git commit: [SPARK-6856] [R] Make RDD information more useful in SparkR

: 7078f6028bf012235c664b02ec3541cbb0a248a7 Parents: 998aac2 Author: Jeff Harrison jeffrharri...@gmail.com Authored: Mon Apr 27 13:38:25 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Mon Apr 27 13:38:25 2015 -0700

spark git commit: [SPARK-6991] [SPARKR] Adds support for zipPartitions.

/ca9f4ebb Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/ca9f4ebb Branch: refs/heads/master Commit: ca9f4ebb8e510e521bf4df0331375ddb385fb9d2 Parents: ef82bdd Author: hlin09 hlin0...@gmail.com Authored: Mon Apr 27 15:04:37 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu

[2/2] spark git commit: [SPARK-6824] Fill the docs for DataFrame API in SparkR

/asf/spark/diff/008a60dd Branch: refs/heads/master Commit: 008a60dd371e76819d8e08ab638cac7b3a48c9fc Parents: 65afd3c Author: hqzizania qian.hu...@intel.com Authored: Fri May 8 11:25:04 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Fri May 8 11:25:04 2015 -0700

[1/2] spark git commit: [SPARK-6824] Fill the docs for DataFrame API in SparkR

Repository: spark Updated Branches: refs/heads/branch-1.4 75fed0ca4 - 4f01f5b56 http://git-wip-us.apache.org/repos/asf/spark/blob/4f01f5b5/R/pkg/R/generics.R -- diff --git a/R/pkg/R/generics.R b/R/pkg/R/generics.R index

[1/2] spark git commit: [SPARK-6824] Fill the docs for DataFrame API in SparkR

Repository: spark Updated Branches: refs/heads/master 65afd3ce8 - 008a60dd3 http://git-wip-us.apache.org/repos/asf/spark/blob/008a60dd/R/pkg/R/generics.R -- diff --git a/R/pkg/R/generics.R b/R/pkg/R/generics.R index

[2/2] spark git commit: [SPARK-6824] Fill the docs for DataFrame API in SparkR

[hqzizania] remove the RDD docs from being built as a part of roxygen (cherry picked from commit 008a60dd371e76819d8e08ab638cac7b3a48c9fc) Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos

spark git commit: updated ec2 instance types

/asf/spark/tree/1c78f686 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/1c78f686 Branch: refs/heads/master Commit: 1c78f6866ebbcfb41d9875bfa3c0b9fa23b188bf Parents: 35c9599 Author: Brendan Collins bcoll...@blueraster.com Authored: Fri May 8 15:59:34 2015 -0700 Committer: Shivaram Venkataraman

spark git commit: [SPARK-7226] [SPARKR] Support math functions in R DataFrame

/50da9e89 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/50da9e89 Branch: refs/heads/master Commit: 50da9e89161faa0ecdc1feb3ffee6c822a742034 Parents: 9b6cf28 Author: qhuang qian.hu...@intel.com Authored: Fri May 15 14:06:16 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu

spark git commit: [SPARK-7226] [SPARKR] Support math functions in R DataFrame

2a7d121 [qhuang] use a function name more familiar to R users 07aa72e [qhuang] Support math functions in R DataFrame (cherry picked from commit 50da9e89161faa0ecdc1feb3ffee6c822a742034) Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu Project: http://git-wip-us.apache.org/repos/asf

spark git commit: [SPARK-6855] [SPARKR] Set R includes to get the right collate order.

Repository: spark Updated Branches: refs/heads/master ef3fb801a - 55f553a97 [SPARK-6855] [SPARKR] Set R includes to get the right collate order. This prevents tools like devtools::document creating invalid collate orders Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Closes #5462

spark git commit: [SPARK-6807] [SparkR] Merge recent SparkR-pkg changes

and StructField. Author: cafreeman cfree...@alteryx.com Author: Davies Liu dav...@databricks.com Author: Zongheng Yang zonghen...@gmail.com Author: Shivaram Venkataraman shivaram.venkatara...@gmail.com Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Author: Sun Rui rui@intel.com Closes #5436

spark git commit: [SPARK-6850] [SparkR] use one partition when we need to compare the whole result

/diff/68ecdb7f Branch: refs/heads/master Commit: 68ecdb7f99ae30f7c04c33a47ab7f59a3836f2a4 Parents: 4740d6a Author: Davies Liu dav...@databricks.com Authored: Fri Apr 10 15:35:45 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Fri Apr 10 15:35:45 2015 -0700

[5/7] spark git commit: [SPARK-5654] Integrate SparkR

+#' @aliases take,RDD,numeric-method +setMethod(take, + signature(x = RDD, num = numeric), + function(x, num) { +resList - list() +index - -1 +jrdd - getJRDD(x) +numPartitions - numPartitions(x) + +# TODO(shivaram): Collect more

[7/7] spark git commit: [SPARK-5654] Integrate SparkR

improvements Shivaram Venkataraman (shivaram) - RDD API, JVM Backend, Worker Internals Zongheng Yang (concretevitamin) - RDD API, Pipelined RDDs, Examples and EC2 guide Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Author: Shivaram Venkataraman shivaram.venkatara...@gmail.com Author: Zongheng Yang

[6/7] spark git commit: [SPARK-5654] Integrate SparkR

http://git-wip-us.apache.org/repos/asf/spark/blob/2fe0a1aa/R/pkg/NAMESPACE -- diff --git a/R/pkg/NAMESPACE b/R/pkg/NAMESPACE new file mode 100644 index 000..a354cdc --- /dev/null +++ b/R/pkg/NAMESPACE @@ -0,0 +1,182 @@

[4/7] spark git commit: [SPARK-5654] Integrate SparkR

http://git-wip-us.apache.org/repos/asf/spark/blob/2fe0a1aa/R/pkg/R/context.R -- diff --git a/R/pkg/R/context.R b/R/pkg/R/context.R new file mode 100644 index 000..2fc0bb2 --- /dev/null +++ b/R/pkg/R/context.R @@ -0,0 +1,225 @@

[1/7] spark git commit: [SPARK-5654] Integrate SparkR

Repository: spark Updated Branches: refs/heads/master 1b2aab8d5 - 2fe0a1aae http://git-wip-us.apache.org/repos/asf/spark/blob/2fe0a1aa/core/src/main/scala/org/apache/spark/api/r/SerDe.scala -- diff --git

spark git commit: [SPARK-6246] [EC2] fixed support for more than 100 nodes

May 19 16:45:52 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Tue May 19 16:45:52 2015 -0700 -- ec2/spark_ec2.py | 6 +- 1 file changed, 5 insertions(+), 1 deletion

spark git commit: [MINOR] Add 1.3, 1.3.1 to master branch EC2 scripts

Repository: spark Updated Branches: refs/heads/master ba4f8ca0d - 1a7b9ce80 [MINOR] Add 1.3, 1.3.1 to master branch EC2 scripts cc pwendell P.S: I can't believe this was outdated all along ? Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Closes #6215 from shivaram/update-ec2-map

spark git commit: [MINOR] Add 1.3, 1.3.1 to master branch EC2 scripts

Repository: spark Updated Branches: refs/heads/branch-1.4 671a6bca5 - 0ed376afa [MINOR] Add 1.3, 1.3.1 to master branch EC2 scripts cc pwendell P.S: I can't believe this was outdated all along ? Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Closes #6215 from shivaram/update-ec2

spark git commit: [SPARK-8063] [SPARKR] Spark master URL conflict between MASTER env variable and --master command line option.

/repos/asf/spark/tree/708c63bb Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/708c63bb Branch: refs/heads/master Commit: 708c63bbbe9580eb774fe47e23ef61338103afda Parents: d2a86eb Author: Sun Rui rui@intel.com Authored: Wed Jun 3 11:56:35 2015 -0700 Committer: Shivaram Venkataraman shiva

spark git commit: [SPARK-8063] [SPARKR] Spark master URL conflict between MASTER env variable and --master command line option.

commits: 51ca48b [Sun Rui] [SPARK-8063][SPARKR] Spark master URL conflict between MASTER env variable and --master command line option. (cherry picked from commit 708c63bbbe9580eb774fe47e23ef61338103afda) Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu Project: http://git-wip

spark git commit: [SPARK-8084] [SPARKR] Make SparkR scripts fail on error

Repository: spark Updated Branches: refs/heads/branch-1.4 16748694b - c2c129073 [SPARK-8084] [SPARKR] Make SparkR scripts fail on error cc shaneknapp pwendell JoshRosen Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Closes #6623 from shivaram/SPARK-8084 and squashes the following

spark git commit: [SPARK-8084] [SPARKR] Make SparkR scripts fail on error

Repository: spark Updated Branches: refs/heads/master 51898b515 - 0576c3c4f [SPARK-8084] [SPARKR] Make SparkR scripts fail on error cc shaneknapp pwendell JoshRosen Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Closes #6623 from shivaram/SPARK-8084 and squashes the following

spark git commit: [SPARK-6820] [SPARKR] Convert NAs to null type in SparkR DataFrames

/repos/asf/spark/diff/a5c52c1a Branch: refs/heads/master Commit: a5c52c1a3488b69bec19e460d2d1fdb0c9ada58d Parents: 82870d5 Author: hqzizania qian.hu...@intel.com Authored: Mon Jun 8 21:40:12 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Mon Jun 8 21:40:12 2015 -0700

spark git commit: [SPARK-8085] [SPARKR] Support user-specified schema in read.df

Repository: spark Updated Branches: refs/heads/branch-1.4 0ef2e9d35 - 3e3151e75 [SPARK-8085] [SPARKR] Support user-specified schema in read.df cc davies sun-rui Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Closes #6620 from shivaram/sparkr-read-schema and squashes the following

spark git commit: [SPARK-8027] [SPARKR] Move man pages creation to install-dev.sh

Related to discussion in #6567 cc pwendell srowen -- Let me know if this looks better Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Closes #6593 from shivaram/sparkr-pom-cleanup and squashes the following commits: b282241 [Shivaram Venkataraman] Remove sparkr-docs from release script

spark git commit: [SPARK-8027] [SPARKR] Move man pages creation to install-dev.sh

to discussion in #6567 cc pwendell srowen -- Let me know if this looks better Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Closes #6593 from shivaram/sparkr-pom-cleanup and squashes the following commits: b282241 [Shivaram Venkataraman] Remove sparkr-docs from release script as well

spark git commit: [SPARK-8482] Added M4 instances to the list.

Authored: Mon Jun 22 11:45:31 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Mon Jun 22 11:45:31 2015 -0700 -- ec2/spark_ec2.py | 16 ++-- 1 file changed, 14 insertions(+), 2 deletions

spark git commit: [SPARK-8537] [SPARKR] Add a validation rule about the curly braces in SparkR to `.lintr`

Author: Yu ISHIKAWA yuu.ishik...@gmail.com Authored: Mon Jun 22 14:35:38 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Mon Jun 22 14:35:38 2015 -0700 -- R/pkg/.lintr | 2 +- 1 file changed, 1

spark git commit: [SPARK-8111] [SPARKR] SparkR shell should display Spark logo and version banner on startup.

-Pro.local Authored: Tue Jun 23 12:47:55 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Tue Jun 23 12:47:55 2015 -0700 -- R/pkg/inst/profile/shell.R | 16 +++- 1 file changed, 15

spark git commit: [SPARK-8452] [SPARKR] expose jobGroup API in SparkR

as the first argument. There does not seem to be a good way to test these in R. cc shivaram and davies Author: Hossein hoss...@databricks.com Closes #6889 from falaki/SPARK-8452 and squashes the following commits: 9ce9f1e [Hossein] Added basic tests to verify methods can be called and won't throw errors

spark git commit: [SPARK-8637] [SPARKR] [HOTFIX] Fix packages argument, sparkSubmitBinName

Repository: spark Updated Branches: refs/heads/branch-1.4 13802163d - 6abb4fc8a [SPARK-8637] [SPARKR] [HOTFIX] Fix packages argument, sparkSubmitBinName cc cafreeman Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Closes #7022 from shivaram/sparkr-init-hotfix and squashes

spark git commit: [SPARK-8637] [SPARKR] [HOTFIX] Fix packages argument, sparkSubmitBinName

Repository: spark Updated Branches: refs/heads/master 2519dcc33 - c392a9efa [SPARK-8637] [SPARKR] [HOTFIX] Fix packages argument, sparkSubmitBinName cc cafreeman Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Closes #7022 from shivaram/sparkr-init-hotfix and squashes the following

spark git commit: [SPARK-8429] [EC2] Add ability to set additional tags

: 42a1f716fa35533507784be5e9117a984a03e62d Parents: 0818fde Author: Stefano Parmesan s.parme...@gmail.com Authored: Mon Jun 22 11:43:10 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Mon Jun 22 11:43:10 2015 -0700 -- ec2

spark git commit: [SPARK-8548] [SPARKR] Remove the trailing whitespaces from the SparkR files

files (cherry picked from commit 44fa7df64daa55bd6eb1f2c219a9701b34e1c2a3) Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/25017948 Tree: http://git-wip-us.apache.org

spark git commit: [SPARK-8548] [SPARKR] Remove the trailing whitespaces from the SparkR files

: 44fa7df64daa55bd6eb1f2c219a9701b34e1c2a3 Parents: c4d2343 Author: Yu ISHIKAWA yuu.ishik...@gmail.com Authored: Mon Jun 22 20:55:38 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Mon Jun 22 20:55:38 2015 -0700

spark git commit: [SPARK-8662] SparkR Update SparkSQL Test

: 78b31a2a630c2178987322d0221aeea183ec565f Parents: 6abb4fc Author: cafreeman cfree...@alteryx.com Authored: Fri Jun 26 10:07:35 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Fri Jun 26 10:07:35 2015 -0700 -- R/pkg/inst/tests

spark git commit: [SPARK-8662] SparkR Update SparkSQL Test

78b31a2a630c2178987322d0221aeea183ec565f) Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/a56516fc Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/a56516fc Diff: http

spark git commit: [SPARK-8495] [SPARKR] Add a `.lintr` file to validate the SparkR files and the `lint-r` script

Repository: spark Updated Branches: refs/heads/master 7a3c424ec - 004f57374 [SPARK-8495] [SPARKR] Add a `.lintr` file to validate the SparkR files and the `lint-r` script Thank Shivaram Venkataraman for your support. This is a prototype script to validate the R files. Author: Yu ISHIKAWA

spark git commit: [SPARK-8576] Add spark-ec2 options to set IAM roles and instance-initiated shutdown behavior

: 31f48e5af887a9ccc9cea0218c36bf52bbf49d24 Parents: bba6699 Author: Nicholas Chammas nicholas.cham...@gmail.com Authored: Wed Jun 24 11:20:51 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Wed Jun 24 11:20:51 2015 -0700 -- ec2

spark git commit: [SPARK-8506] Add pakages to R context created through init.

/diff/43e66192 Branch: refs/heads/master Commit: 43e66192f45a23f7232116e9f664158862df5015 Parents: 1173483 Author: Holden Karau hol...@pigscanfly.ca Authored: Wed Jun 24 11:55:20 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Wed Jun 24 11:55:20 2015 -0700

spark git commit: [SPARK-8506] Add pakages to R context created through init.

] refactor for testing c818556 [Holden Karau] Add pakages to R (cherry picked from commit 43e66192f45a23f7232116e9f664158862df5015) Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf

spark git commit: [SPARK-8607] SparkR -- jars not being added to application classpath correctly

://issues.apache.org/jira/browse/SPARK-5185). cc shivaram Author: cafreeman cfree...@alteryx.com Closes #7001 from cafreeman/branch-1.4 and squashes the following commits: 8f81194 [cafreeman] Add missing license 31aedcf [cafreeman] Refactor test to call an external R script 2c22073 [cafreeman] Merge branch

spark git commit: [SPARK-8607] SparkR -- jars not being added to application classpath correctly

://issues.apache.org/jira/browse/SPARK-5185). cc shivaram Author: cafreeman cfree...@alteryx.com Closes #7001 from cafreeman/branch-1.4 and squashes the following commits: 8f81194 [cafreeman] Add missing license 31aedcf [cafreeman] Refactor test to call an external R script 2c22073 [cafreeman] Merge branch

svn commit: r1684946 - in /spark: releases/_posts/2015-06-11-spark-release-1-4-0.md site/releases/spark-release-1-4-0.html

Author: shivaram Date: Thu Jun 11 16:59:48 2015 New Revision: 1684946 URL: http://svn.apache.org/r1684946 Log: Add some more SparkR contributors Modified: spark/releases/_posts/2015-06-11-spark-release-1-4-0.md spark/site/releases/spark-release-1-4-0.html Modified: spark/releases/_posts

spark git commit: [SPARK-8310] [EC2] Updates the master branch EC2 versions

Repository: spark Updated Branches: refs/heads/master 1191c3efc - c8d551d54 [SPARK-8310] [EC2] Updates the master branch EC2 versions Will send another PR for `branch-1.4` Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Closes #6764 from shivaram/SPARK-8310 and squashes the following

spark git commit: [SPARK-8350] [R] Log R unit test output to unit-tests.log

, REPL) use. 1. We should be consistent 2. I don't want to reconfigure Jenkins to accept a different file shivaram Author: andrewor14 and...@databricks.com Author: Andrew Or and...@databricks.com Closes #6807 from andrewor14/r-logs and squashes the following commits: 96005d2 [andrewor14] Nest

svn commit: r1685612 - /spark/site/index.html

Author: shivaram Date: Mon Jun 15 16:05:17 2015 New Revision: 1685612 URL: http://svn.apache.org/r1685612 Log: Add html for R update Modified: spark/site/index.html Modified: spark/site/index.html URL: http://svn.apache.org/viewvc/spark/site/index.html?rev=1685612r1=1685611r2=1685612view

svn commit: r1685610 - /spark/index.md

Author: shivaram Date: Mon Jun 15 16:04:31 2015 New Revision: 1685610 URL: http://svn.apache.org/r1685610 Log: Add R to list of supported languages Modified: spark/index.md Modified: spark/index.md URL: http://svn.apache.org/viewvc/spark/index.md?rev=1685610r1=1685609r2=1685610view=diff

spark git commit: [SPARK-8322] [EC2] Added spark 1.4.0 into the VALID_SPARK_VERSIONS and…

Authored: Fri Jun 12 10:28:30 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Fri Jun 12 10:28:30 2015 -0700 -- ec2/spark_ec2.py | 3 ++- 1 file changed, 2 insertions(+), 1 deletion

spark git commit: [SPARK-7227] [SPARKR] Support fillna / dropna in R DataFrame.

to readMap(). Add alias na.omit() for dropna(). 41cf725 [Sun Rui] [SPARK-7227][SPARKR] Support fillna / dropna in R DataFrame. (cherry picked from commit 46576ab303e50c54c3bd464f8939953efe644574) Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu Project: http://git-wip-us.apache.org

spark git commit: [SPARK-7227] [SPARKR] Support fillna / dropna in R DataFrame.

/spark/tree/46576ab3 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/46576ab3 Branch: refs/heads/master Commit: 46576ab303e50c54c3bd464f8939953efe644574 Parents: 866652c Author: Sun Rui rui@intel.com Authored: Sun May 31 15:01:21 2015 -0700 Committer: Shivaram Venkataraman shiva

spark git commit: [SPARK-8028] [SPARKR] Use addJar instead of setJars in SparkR

Repository: spark Updated Branches: refs/heads/branch-1.4 f5a9833f3 - cbfb682ab [SPARK-8028] [SPARKR] Use addJar instead of setJars in SparkR This prevents the spark.jars from being cleared while using `--packages` or `--jars` cc pwendell davies brkyvz Author: Shivaram Venkataraman shiva

spark git commit: [SPARK-8028] [SPARKR] Use addJar instead of setJars in SparkR

Repository: spark Updated Branches: refs/heads/master 15d7c90ae - 6b44278ef [SPARK-8028] [SPARKR] Use addJar instead of setJars in SparkR This prevents the spark.jars from being cleared while using `--packages` or `--jars` cc pwendell davies brkyvz Author: Shivaram Venkataraman shiva

spark git commit: [SPARK-8027] [SPARKR] Add maven profile to build R package docs

for building the release. Let me know if you need help with that. Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Closes #6567 from shivaram/SPARK-8027 and squashes the following commits: 8dc8ecf [Shivaram Venkataraman] Add maven profile to build R package docs Also use that profile in create

spark git commit: [SPARK-8027] [SPARKR] Add maven profile to build R package docs

for building the release. Let me know if you need help with that. Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Closes #6567 from shivaram/SPARK-8027 and squashes the following commits: 8dc8ecf [Shivaram Venkataraman] Add maven profile to build R package docs Also use that profile

spark git commit: [SPARK-7714] [SPARKR] SparkR tests should use more specific expectations than expect_true

@intel.com Authored: Wed Jul 1 09:50:12 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Wed Jul 1 09:50:12 2015 -0700 -- R/pkg/inst/tests/test_binaryFile.R | 2 +- R/pkg/inst/tests

spark git commit: [SPARK-8596] [EC2] Added port for Rstudio

. Warmerdam vincentwarmer...@gmail.com Authored: Sun Jun 28 13:33:33 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Sun Jun 28 13:33:33 2015 -0700 -- ec2/spark_ec2.py | 2 ++ 1 file changed, 2 insertions

spark git commit: [SPARK-8549] [SPARKR] Fix the line length of SparkR

-0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Sun Jul 5 20:50:02 2015 -0700 -- R/pkg/R/generics.R | 3 ++- R/pkg/R/pairRDD.R | 12 ++-- R/pkg/R/sparkR.R

spark git commit: [HOTFIX] Copy SparkR lib if it exists in make-distribution

Repository: spark Updated Branches: refs/heads/branch-1.4 8d6d8a538 - fbc4480d9 [HOTFIX] Copy SparkR lib if it exists in make-distribution This is to fix an issue reported in #6373 where the `cp` would fail if `-Psparkr` was not used in the build cc dragos pwendell Author: Shivaram

spark git commit: [HOTFIX] Copy SparkR lib if it exists in make-distribution

Repository: spark Updated Branches: refs/heads/master 2b7e63585 - b231baa24 [HOTFIX] Copy SparkR lib if it exists in make-distribution This is to fix an issue reported in #6373 where the `cp` would fail if `-Psparkr` was not used in the build cc dragos pwendell Author: Shivaram

spark git commit: [SPARK-6811] Copy SparkR lib in make-distribution.sh

(CentOS), Windows VM and vice-versa (built on Linux run on Mac) I will also test this with YARN soon and update this PR. Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Closes #6373 from shivaram/sparkr-binary and squashes the following commits: ae41b5c [Shivaram Venkataraman] Remove native

spark git commit: [SPARK-6811] Copy SparkR lib in make-distribution.sh

(CentOS), Windows VM and vice-versa (built on Linux run on Mac) I will also test this with YARN soon and update this PR. Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Closes #6373 from shivaram/sparkr-binary and squashes the following commits: ae41b5c [Shivaram Venkataraman] Remove

spark git commit: [SPARK-6806] [SPARKR] [DOCS] Fill in SparkR examples in programming guide

Repository: spark Updated Branches: refs/heads/branch-1.4 b928db4fe - c636b87dc [SPARK-6806] [SPARKR] [DOCS] Fill in SparkR examples in programming guide sqlCtx - sqlContext You can check the docs by: ``` $ cd docs $ SKIP_SCALADOC=1 jekyll serve ``` cc shivaram Author: Davies Liu dav

spark git commit: [SPARK-6806] [SPARKR] [DOCS] Fill in SparkR examples in programming guide

Repository: spark Updated Branches: refs/heads/master 4583cf4be - 7af3818c6 [SPARK-6806] [SPARKR] [DOCS] Fill in SparkR examples in programming guide sqlCtx - sqlContext You can check the docs by: ``` $ cd docs $ SKIP_SCALADOC=1 jekyll serve ``` cc shivaram Author: Davies Liu dav

spark git commit: [SPARK-8821] [EC2] Switched to binary mode for file reading

to binary mode (cherry picked from commit 83a621a5a8f8a2991c4cfa687279589e5c623d46) Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/70beb808 Tree: http://git-wip

spark git commit: [SPARK-8821] [EC2] Switched to binary mode for file reading

/branch-1.4 Commit: 83a621a5a8f8a2991c4cfa687279589e5c623d46 Parents: bf8b47d Author: Simon Hafner hafnersi...@gmail.com Authored: Tue Jul 7 09:42:59 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Tue Jul 7 09:42:59 2015 -0700

spark git commit: [SPARK-9318] [SPARK-9320] [SPARKR] Aliases for merge and summary functions on DataFrames

Repository: spark Updated Branches: refs/heads/master 8cb415a4b - 712f5b7a9 [SPARK-9318] [SPARK-9320] [SPARKR] Aliases for merge and summary functions on DataFrames This PR adds synonyms for ```merge``` and ```summary``` in SparkR DataFrame API. cc shivaram Author: Hossein hoss

spark git commit: [SPARK-9855] [SPARKR] Add expression functions into SparkR whose params are simple

yuu.ishik...@gmail.com Authored: Wed Aug 12 18:33:27 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Wed Aug 12 18:33:27 2015 -0700 -- R/pkg/DESCRIPTION| 1 + R/pkg/R/column.R

spark git commit: [SPARK-9855] [SPARKR] Add expression functions into SparkR whose params are simple

) Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ca39c9e9 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/ca39c9e9 Diff: http://git-wip-us.apache.org/repos/asf

spark git commit: [SPARK-9916] [BUILD] [SPARKR] removed left-over sparkr.zip copy/create commands from codebase

Repository: spark Updated Branches: refs/heads/master d7053bea9 - 2fb4901b7 [SPARK-9916] [BUILD] [SPARKR] removed left-over sparkr.zip copy/create commands from codebase sparkr.zip is now built by SparkSubmit on a need-to-build basis. cc shivaram Author: Burak Yavuz brk...@gmail.com

spark git commit: [SPARK-9916] [BUILD] [SPARKR] removed left-over sparkr.zip copy/create commands from codebase

Repository: spark Updated Branches: refs/heads/branch-1.5 af470a757 - 3d1b9f007 [SPARK-9916] [BUILD] [SPARKR] removed left-over sparkr.zip copy/create commands from codebase sparkr.zip is now built by SparkSubmit on a need-to-build basis. cc shivaram Author: Burak Yavuz brk...@gmail.com

spark git commit: [SPARK-8844] [SPARKR] head/collect is broken in SparkR.

: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Sun Aug 16 00:30:02 2015 -0700 -- R/pkg/R/deserialize.R| 16 ++-- R/pkg/inst/tests/test_sparkSQL.R | 20 2 files changed, 30

spark git commit: [SPARK-8844] [SPARKR] head/collect is broken in SparkR.

) { does not take into consideration the case where numRows = 0. Will add unit test case. Author: Sun Rui rui@intel.com Closes #7419 from sun-rui/SPARK-8844. (cherry picked from commit 5f9ce738fe6bab3f0caffad0df1d3876178cf469) Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu

spark git commit: [SPARK-9856] [SPARKR] Add expression functions into SparkR whose params are complicated

: 2fcb9cb9552dac1d78dcca5d4d5032b4fa6c985c Parents: f3e1779 Author: Yu ISHIKAWA yuu.ishik...@gmail.com Authored: Wed Aug 19 10:41:14 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Wed Aug 19 10:41:14 2015 -0700 -- R/pkg/NAMESPACE

spark git commit: [SPARK-9856] [SPARKR] Add expression functions into SparkR whose params are complicated

commit 2fcb9cb9552dac1d78dcca5d4d5032b4fa6c985c) Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/a8e88081 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/a8e88081

spark git commit: [SPARK-10106] [SPARKR] Add `ifelse` Column function to SparkR

/spark/diff/d898c33f Branch: refs/heads/master Commit: d898c33f774b9a3db2fb6aa8f0cb2c2ac6004b58 Parents: 28a9846 Author: Yu ISHIKAWA yuu.ishik...@gmail.com Authored: Wed Aug 19 12:39:37 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Wed Aug 19 12:39:37 2015 -0700

spark git commit: [SPARK-10106] [SPARKR] Add `ifelse` Column function to SparkR

yuu.ishik...@gmail.com Closes #8303 from yu-iskw/SPARK-10106. (cherry picked from commit d898c33f774b9a3db2fb6aa8f0cb2c2ac6004b58) Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf

spark git commit: [SPARKR] [MINOR] Get rid of a long line warning

-by: Shivaram Venkataraman shiva...@cs.berkeley.edu Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/0a1385e3 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/0a1385e3 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff

spark git commit: [SPARKR] [MINOR] Get rid of a long line warning

...@gmail.com Authored: Tue Aug 18 19:18:05 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Tue Aug 18 19:18:05 2015 -0700 -- R/pkg/R/functions.R | 4 +++- 1 file changed, 3 insertions(+), 1 deletion

spark git commit: [SPARK-10075] [SPARKR] Add `when` expressino function in SparkR

doesn't support a feature like method chaining, `otherwise(when(condition, value), value)` style is a little annoying for me. If `%otherwise%` looks strange for shivaram, I can remove it. What do you think? ### JIRA [[SPARK-10075] Add `when` expressino function in SparkR - ASF JIRA](https

spark git commit: [SPARK-10075] [SPARKR] Add `when` expressino function in SparkR

doesn't support a feature like method chaining, `otherwise(when(condition, value), value)` style is a little annoying for me. If `%otherwise%` looks strange for shivaram, I can remove it. What do you think? ### JIRA [[SPARK-10075] Add `when` expressino function in SparkR - ASF JIRA](https

spark git commit: [SPARK-9982] [SPARKR] SparkR DataFrame fail to return data of Decimal type

39e91fe2fd43044cc734d55625a3c03284b69f09) Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/a7027e6d Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/a7027e6d Diff: http://git-wip

spark git commit: [SPARK-9982] [SPARKR] SparkR DataFrame fail to return data of Decimal type

: Alex Shkurenko ashkure...@enova.com Authored: Thu Aug 20 10:16:38 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Thu Aug 20 10:16:38 2015 -0700 -- core/src/main/scala/org/apache/spark/api/r

spark git commit: Bump SparkR version string to 1.5.0

Repository: spark Updated Branches: refs/heads/master badf7fa65 - 04e0fea79 Bump SparkR version string to 1.5.0 This patch is against master, but we need to apply it to 1.5 branch as well. cc shivaram and rxin Author: Hossein hoss...@databricks.com Closes #8291 from falaki

spark git commit: Bump SparkR version string to 1.5.0

Repository: spark Updated Branches: refs/heads/branch-1.5 4ee225af8 - 9b42e2404 Bump SparkR version string to 1.5.0 This patch is against master, but we need to apply it to 1.5 branch as well. cc shivaram and rxin Author: Hossein hoss...@databricks.com Closes #8291 from falaki

spark git commit: [SPARK-10007] [SPARKR] Update `NAMESPACE` file in SparkR for simple parameters functions

/1968276a Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/1968276a Branch: refs/heads/master Commit: 1968276af0f681fe51328b7dd795bd21724a5441 Parents: 5723d26 Author: Yuu ISHIKAWA yuu.ishik...@gmail.com Authored: Tue Aug 18 09:10:59 2015 -0700 Committer: Shivaram Venkataraman shiva

spark git commit: [SPARK-10007] [SPARKR] Update `NAMESPACE` file in SparkR for simple parameters functions

://issues.apache.org/jira/browse/SPARK-10007) Author: Yuu ISHIKAWA yuu.ishik...@gmail.com Closes #8277 from yu-iskw/SPARK-10007. (cherry picked from commit 1968276af0f681fe51328b7dd795bd21724a5441) Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu Project: http://git-wip-us.apache.org/repos/asf

spark git commit: [SPARK-9053] [SPARKR] Fix spaces around parens, infix operators etc.

-us.apache.org/repos/asf/spark/diff/fc0e57e5 Branch: refs/heads/master Commit: fc0e57e5aba82a3f227fef05a843283e2ec893fc Parents: 6bba750 Author: Yu ISHIKAWA yuu.ishik...@gmail.com Authored: Fri Jul 31 09:33:38 2015 -0700 Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu Committed: Fri Jul 31

  1   2   3   4   5   >