-by: Shivaram Venkataraman
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/8ac518c1
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/8ac518c1
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/8ac518c1
Branch: refs/he
t-wip-us.apache.org/repos/asf/spark/diff/1a93323c
Branch: refs/heads/master
Commit: 1a93323c5bab18ed7e55bf6f7b13aae88cb9721c
Parents: d02d5b9
Author: felixcheung
Authored: Wed Nov 18 23:32:49 2015 -0800
Committer: Shivaram Venkataraman
Committed: Wed Nov 18 23:32:49 2015 -0800
--
-8d4d-11e5-94b0-dda9696b6fdd.png)
Author: felixcheung
Closes #9785 from felixcheung/rmasked.
(cherry picked from commit 1a93323c5bab18ed7e55bf6f7b13aae88cb9721c)
Signed-off-by: Shivaram Venkataraman
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.o
i/R/count.html)
Also changing some rdname for dplyr-like variant for better R user visibility
in R doc, eg. rbind, summary, mutate, summarize
shivaram yanboliang
Author: felixcheung
Closes #9750 from felixcheung/rdocaliases.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://
i/R/count.html)
Also changing some rdname for dplyr-like variant for better R user visibility
in R doc, eg. rbind, summary, mutate, summarize
shivaram yanboliang
Author: felixcheung
Closes #9750 from felixcheung/rdocaliases.
(cherry picked from commit a6239d587c638691f52eca3eee905c53fbf35a12)
Sig
e before 1.6 release, otherwise we will make
breaking API change.
cc shivaram sun-rui
Author: Yanbo Liang
Closes #10016 from yanboliang/SPARK-12025.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ba02f6cb
Tree: http://git-wip-us.
e before 1.6 release, otherwise we will make
breaking API change.
cc shivaram sun-rui
Author: Yanbo Liang
Closes #10016 from yanboliang/SPARK-12025.
(cherry picked from commit ba02f6cb5a40511cefa511d410be93c035d43f23)
Signed-off-by: Shivaram Venkataraman
Project: http://git-wip-us.apache.org/
Repository: spark
Updated Branches:
refs/heads/master 149cd692e -> 28e46ab46
[SPARK-12029][SPARKR] Improve column functions signature, param check, tests,
fix doc and add examples
shivaram sun-rui
Author: felixcheung
Closes #10019 from felixcheung/rfunctionsdoc.
Project: http://git-
Repository: spark
Updated Branches:
refs/heads/branch-1.6 2ecc0f243 -> 2503a4350
[SPARK-12029][SPARKR] Improve column functions signature, param check, tests,
fix doc and add examples
shivaram sun-rui
Author: felixcheung
Closes #10019 from felixcheung/rfunctionsdoc.
(cherry picked f
with PR 8984 (coltypes). Clicked the wrong thing, crewed up the PR.
Recreated it here. Was #9218
shivaram sun-rui
Author: felixcheung
Closes #9654 from felixcheung/colnamescoltypes.
(cherry picked from commit c793d2d9a1ccc203fc103eb0636958fe8d71f471)
Signed-off-by: Shivaram Venkataraman
Project
with PR 8984 (coltypes). Clicked the wrong thing, crewed up the PR.
Recreated it here. Was #9218
shivaram sun-rui
Author: felixcheung
Closes #9654 from felixcheung/colnamescoltypes.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c
Nov 29 11:08:26 2015 -0800
Committer: Shivaram Venkataraman
Committed: Sun Nov 29 11:08:26 2015 -0800
--
R/pkg/R/DataFrame.R | 34 ++--
R/pkg/R/SQLContext.R | 2 +-
R/pk
-by: Shivaram Venkataraman
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/5601d8fd
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/5601d8fd
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/5601d8fd
Branch: r
:17:49 2015 -0800
Committer: Shivaram Venkataraman
Committed: Tue Dec 1 01:17:49 2015 -0800
--
ec2/spark_ec2.py | 2 +-
1 file changed, 1 insertion(+), 1 delet
f/spark/diff/008a60dd
Branch: refs/heads/master
Commit: 008a60dd371e76819d8e08ab638cac7b3a48c9fc
Parents: 65afd3c
Author: hqzizania
Authored: Fri May 8 11:25:04 2015 -0700
Committer: Shivaram Venkataraman
Committed: Fri May 8 11:25:04 2015 -0700
--
Repository: spark
Updated Branches:
refs/heads/master 65afd3ce8 -> 008a60dd3
http://git-wip-us.apache.org/repos/asf/spark/blob/008a60dd/R/pkg/R/generics.R
--
diff --git a/R/pkg/R/generics.R b/R/pkg/R/generics.R
index 5838955..3
Repository: spark
Updated Branches:
refs/heads/branch-1.4 75fed0ca4 -> 4f01f5b56
http://git-wip-us.apache.org/repos/asf/spark/blob/4f01f5b5/R/pkg/R/generics.R
--
diff --git a/R/pkg/R/generics.R b/R/pkg/R/generics.R
index 583895
nia] remove the RDD docs from being built as a part of roxygen
(cherry picked from commit 008a60dd371e76819d8e08ab638cac7b3a48c9fc)
Signed-off-by: Shivaram Venkataraman
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/4f01f5b5
tree/1c78f686
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/1c78f686
Branch: refs/heads/master
Commit: 1c78f6866ebbcfb41d9875bfa3c0b9fa23b188bf
Parents: 35c9599
Author: Brendan Collins
Authored: Fri May 8 15:59:34 2015 -0700
Committer: Shivaram Venkataraman
Committed: Fri May 8 15:59:
ed whitespace
85c6236 [Brendan Collins] vertically aligned whitespace
1657c26 [Brendan Collins] updated ec2 instance types
(cherry picked from commit 1c78f6866ebbcfb41d9875bfa3c0b9fa23b188bf)
Signed-off-by: Shivaram Venkataraman
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: h
for it
cc sun-rui rxin
Author: Shivaram Venkataraman
Closes #6005 from shivaram/sparkr-df-api and squashes the following commits:
5e0716a [Shivaram Venkataraman] Fix some roxygen bugs
1254953 [Shivaram Venkataraman] Merge branch 'master' of
https://github.com/apache/spark into spa
sue for it
cc sun-rui rxin
Author: Shivaram Venkataraman
Closes #6005 from shivaram/sparkr-df-api and squashes the following commits:
5e0716a [Shivaram Venkataraman] Fix some roxygen bugs
1254953 [Shivaram Venkataraman] Merge branch 'master' of
https://github.com/apache/spark into spa
at
http://stackoverflow.com/questions/30057702/sparkr-filterrdd-and-flatmap-not-working
cc concretevitamin
Author: Shivaram Venkataraman
Closes #6035 from shivaram/sparkr-show-bug and squashes the following commits:
d70145c [Shivaram Venkataraman] Fix RDD's show method to use getJRDD Fixes the
at
http://stackoverflow.com/questions/30057702/sparkr-filterrdd-and-flatmap-not-working
cc concretevitamin
Author: Shivaram Venkataraman
Closes #6035 from shivaram/sparkr-show-bug and squashes the following commits:
d70145c [Shivaram Venkataraman] Fix RDD's show method to use getJRDD Fixes the
bu
ree: http://git-wip-us.apache.org/repos/asf/spark/tree/b94a9337
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/b94a9337
Branch: refs/heads/master
Commit: b94a93371cf219a88edee7677d22f1eaefc1ea5b
Parents: 028ad4b
Author: Joshi
Authored: Mon May 11 21:02:34 2015 -0700
Committer: Shiva
e02 [Joshi] Spark-7435[R]: updated patch for review comments
62becc1 [Joshi] SPARK-7435: Update to DataFrame
e3677c9 [Rekha Joshi] Merge pull request #1 from apache/master
(cherry picked from commit b94a93371cf219a88edee7677d22f1eaefc1ea5b)
Signed-off-by: Shivaram Venkataraman
Project: http://
mit: df9b94a57cbd0e028228059d215b446d59d25ba8
Parents: 208b902
Author: Sun Rui
Authored: Tue May 12 23:52:30 2015 -0700
Committer: Shivaram Venkataraman
Committed: Tue May 12 23:52:30 2015 -0700
--
R/pkg/NAMESPACE | 6 --
R/pkg/R/DataFram
mit df9b94a57cbd0e028228059d215b446d59d25ba8)
Signed-off-by: Shivaram Venkataraman
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/b18f1c61
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/b18f1c61
Diff: http://git-
ip.
Author: linweizhong
Closes #6053 from Sephiroth-Lin/spark-7526 and squashes the following commits:
5303af7 [linweizhong] bind to localhost rather than wildcard ip
(cherry picked from commit 98195c3031fe60683bb25840f135458d5d0e52c5)
Signed-off-by: Shivaram Venkataraman
Project: http://
ree: http://git-wip-us.apache.org/repos/asf/spark/tree/98195c30
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/98195c30
Branch: refs/heads/master
Commit: 98195c3031fe60683bb25840f135458d5d0e52c5
Parents: df9b94a
Author: linweizhong
Authored: Tue May 12 23:55:44 2015 -0700
Committer: Shiva
ttp://git-wip-us.apache.org/repos/asf/spark/diff/50da9e89
Branch: refs/heads/master
Commit: 50da9e89161faa0ecdc1feb3ffee6c822a742034
Parents: 9b6cf28
Author: qhuang
Authored: Fri May 15 14:06:16 2015 -0700
Committer: Shivaram Venkataraman
Committed: Fri May 15 14:06:16 2015 -0
use a function name more familiar to R users
07aa72e [qhuang] Support math functions in R DataFrame
(cherry picked from commit 50da9e89161faa0ecdc1feb3ffee6c822a742034)
Signed-off-by: Shivaram Venkataraman
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-
Repository: spark
Updated Branches:
refs/heads/master ba4f8ca0d -> 1a7b9ce80
[MINOR] Add 1.3, 1.3.1 to master branch EC2 scripts
cc pwendell
P.S: I can't believe this was outdated all along ?
Author: Shivaram Venkataraman
Closes #6215 from shivaram/update-ec2-map and squa
Repository: spark
Updated Branches:
refs/heads/branch-1.4 671a6bca5 -> 0ed376afa
[MINOR] Add 1.3, 1.3.1 to master branch EC2 scripts
cc pwendell
P.S: I can't believe this was outdated all along ?
Author: Shivaram Venkataraman
Closes #6215 from shivaram/update-ec2-map and squa
t/2bc5e061
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/2bc5e061
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/2bc5e061
Branch: refs/heads/master
Commit: 2bc5e0616d878b09daa8e31a7a1fdb7127bca079
Parents: bcb1ff8
Author: alyaxey
Authored: Tue May 19 16:45:52 2015 -0700
Committer:
Repository: spark
Updated Branches:
refs/heads/master 4583cf4be -> 7af3818c6
[SPARK-6806] [SPARKR] [DOCS] Fill in SparkR examples in programming guide
sqlCtx -> sqlContext
You can check the docs by:
```
$ cd docs
$ SKIP_SCALADOC=1 jekyll serve
```
cc shivaram
Author: Davies Liu
Repository: spark
Updated Branches:
refs/heads/branch-1.4 b928db4fe -> c636b87dc
[SPARK-6806] [SPARKR] [DOCS] Fill in SparkR examples in programming guide
sqlCtx -> sqlContext
You can check the docs by:
```
$ cd docs
$ SKIP_SCALADOC=1 jekyll serve
```
cc shivaram
Author: Davi
nux (CentOS), Windows VM and
vice-versa (built on Linux run on Mac)
I will also test this with YARN soon and update this PR.
Author: Shivaram Venkataraman
Closes #6373 from shivaram/sparkr-binary and squashes the following commits:
ae41b5c [Shivaram Venkataraman] Remove native libraries from Spa
nux (CentOS), Windows VM and
vice-versa (built on Linux run on Mac)
I will also test this with YARN soon and update this PR.
Author: Shivaram Venkataraman
Closes #6373 from shivaram/sparkr-binary and squashes the following commits:
ae41b5c [Shivaram Venkataraman] Remove native libraries f
Repository: spark
Updated Branches:
refs/heads/master 2b7e63585 -> b231baa24
[HOTFIX] Copy SparkR lib if it exists in make-distribution
This is to fix an issue reported in #6373 where the `cp` would fail if
`-Psparkr` was not used in the build
cc dragos pwendell
Author: Shiva
Repository: spark
Updated Branches:
refs/heads/branch-1.4 8d6d8a538 -> fbc4480d9
[HOTFIX] Copy SparkR lib if it exists in make-distribution
This is to fix an issue reported in #6373 where the `cp` would fail if
`-Psparkr` was not used in the build
cc dragos pwendell
Author: Shiva
Add alias na.omit() for
dropna().
41cf725 [Sun Rui] [SPARK-7227][SPARKR] Support fillna / dropna in R DataFrame.
(cherry picked from commit 46576ab303e50c54c3bd464f8939953efe644574)
Signed-off-by: Shivaram Venkataraman
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://
ab3
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/46576ab3
Branch: refs/heads/master
Commit: 46576ab303e50c54c3bd464f8939953efe644574
Parents: 866652c
Author: Sun Rui
Authored: Sun May 31 15:01:21 2015 -0700
Committer: Shivaram Venkataraman
Committed: Sun May 31 15:01:59 2015 -0
Repository: spark
Updated Branches:
refs/heads/branch-1.4 f5a9833f3 -> cbfb682ab
[SPARK-8028] [SPARKR] Use addJar instead of setJars in SparkR
This prevents the spark.jars from being cleared while using `--packages` or
`--jars`
cc pwendell davies brkyvz
Author: Shivaram Venkatara
Repository: spark
Updated Branches:
refs/heads/master 15d7c90ae -> 6b44278ef
[SPARK-8028] [SPARKR] Use addJar instead of setJars in SparkR
This prevents the spark.jars from being cleared while using `--packages` or
`--jars`
cc pwendell davies brkyvz
Author: Shivaram Venkataraman
Clo
for building the release. Let me know if you
need help with that.
Author: Shivaram Venkataraman
Closes #6567 from shivaram/SPARK-8027 and squashes the following commits:
8dc8ecf [Shivaram Venkataraman] Add maven profile to build R package docs Also
use that profile in create-release.sh
Proj
sed for building the release. Let me know if you
need help with that.
Author: Shivaram Venkataraman
Closes #6567 from shivaram/SPARK-8027 and squashes the following commits:
8dc8ecf [Shivaram Venkataraman] Add maven profile to build R package docs Also
use that profile in create-release.sh
(che
ree/708c63bb
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/708c63bb
Branch: refs/heads/master
Commit: 708c63bbbe9580eb774fe47e23ef61338103afda
Parents: d2a86eb
Author: Sun Rui
Authored: Wed Jun 3 11:56:35 2015 -0700
Committer: Shivaram Venkataraman
Committed: Wed Jun 3 11:56:35 2015 -0
48b [Sun Rui] [SPARK-8063][SPARKR] Spark master URL conflict between MASTER
env variable and --master command line option.
(cherry picked from commit 708c63bbbe9580eb774fe47e23ef61338103afda)
Signed-off-by: Shivaram Venkataraman
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: h
but are
currently missed from the JobLogger output. This patch adds these two fields.
~~Since this is a small change, I didn't create a JIRA. Let me know if I should
do that.~~
cc kayousterhout
Author: Shivaram Venkataraman
Closes #1869 from shivaram/job-logger and squashes the following
b7f
Branch: refs/heads/master
Commit: 68ecdb7f99ae30f7c04c33a47ab7f59a3836f2a4
Parents: 4740d6a
Author: Davies Liu
Authored: Fri Apr 10 15:35:45 2015 -0700
Committer: Shivaram Venkataraman
Committed: Fri Apr 10 15:35:45 2015 -0700
--
m element of an RDD.
+#'
+#' @param x The RDD to get the maximum element from
+#' @examples
+#'\dontrun{
+#' sc <- sparkR.init()
+#' rdd <- parallelize(sc, 1:10)
+#' maximum(rdd) # 10
+#'}
+#' @rdname maximum
+#' @aliases maximum,RDD
+setMethod("
uffle improvements
Shivaram Venkataraman (shivaram) - RDD API, JVM Backend, Worker Internals
Zongheng Yang (concretevitamin) - RDD API, Pipelined RDDs, Examples and EC2
guide
Author: Shivaram Venkataraman
Author: Shivaram Venkataraman
Author: Zongheng Yang
Author: cafreeman
Author: Shivaram Venkata
http://git-wip-us.apache.org/repos/asf/spark/blob/2fe0a1aa/R/pkg/R/utils.R
--
diff --git a/R/pkg/R/utils.R b/R/pkg/R/utils.R
new file mode 100644
index 000..c337fb0
--- /dev/null
+++ b/R/pkg/R/utils.R
@@ -0,0 +1,467 @@
+#
+# Li
http://git-wip-us.apache.org/repos/asf/spark/blob/2fe0a1aa/R/pkg/NAMESPACE
--
diff --git a/R/pkg/NAMESPACE b/R/pkg/NAMESPACE
new file mode 100644
index 000..a354cdc
--- /dev/null
+++ b/R/pkg/NAMESPACE
@@ -0,0 +1,182 @@
+#export
http://git-wip-us.apache.org/repos/asf/spark/blob/2fe0a1aa/R/pkg/R/context.R
--
diff --git a/R/pkg/R/context.R b/R/pkg/R/context.R
new file mode 100644
index 000..2fc0bb2
--- /dev/null
+++ b/R/pkg/R/context.R
@@ -0,0 +1,225 @@
http://git-wip-us.apache.org/repos/asf/spark/blob/2fe0a1aa/R/pkg/inst/tests/test_sparkSQL.R
--
diff --git a/R/pkg/inst/tests/test_sparkSQL.R b/R/pkg/inst/tests/test_sparkSQL.R
new file mode 100644
index 000..cf5cf6d
--- /dev/nu
Repository: spark
Updated Branches:
refs/heads/master 1b2aab8d5 -> 2fe0a1aae
http://git-wip-us.apache.org/repos/asf/spark/blob/2fe0a1aa/core/src/main/scala/org/apache/spark/api/r/SerDe.scala
--
diff --git a/core/src/main/scala/
efs/heads/master
Commit: d7f2c198678d1f5ffc1c6da3a6fb189b0a4ef070
Parents: c4ab255
Author: hlin09
Authored: Mon Apr 13 16:53:50 2015 -0700
Committer: Shivaram Venkataraman
Committed: Mon Apr 13 16:53:50 2015 -0700
--
R/pkg/R/RD
Repository: spark
Updated Branches:
refs/heads/master 95b3cf125 -> 43c575cb1
[SPARK-12116][SPARKR][DOCS] document how to workaround function name conflicts
with dplyr
shivaram
Author: felixcheung
Closes #10119 from felixcheung/rdocdplyrmasked.
Project: http://git-wip-us.apache.org/re
Repository: spark
Updated Branches:
refs/heads/branch-1.6 84cbed17e -> f7ae62c45
[SPARK-12116][SPARKR][DOCS] document how to workaround function name conflicts
with dplyr
shivaram
Author: felixcheung
Closes #10119 from felixcheung/rdocdplyrmasked.
(cherry picked from com
s
Authored: Thu Dec 3 11:59:10 2015 -0800
Committer: Shivaram Venkataraman
Committed: Thu Dec 3 11:59:10 2015 -0800
--
ec2/spark_ec2.py | 12 +---
1 file changed,
ly purpose
it'll serve.
cc marmbrus - We should include this in 1.6-RC2 if there is one. I can open a
second PR against branch-1.6 if necessary.
Author: Nicholas Chammas
Closes #10109 from nchammas/spark-ec2-versions.
(cherry picked from commit ad7cea6f776a39801d6bb5bb829d1800b175b
mit: 2213441e5e0fba01e05826257604aa427cdf2598
Parents: a02d472
Author: felixcheung
Authored: Thu Dec 3 13:25:20 2015 -0800
Committer: Shivaram Venkataraman
Committed: Thu Dec 3 13:25:20 2015 -0800
--
R/pkg/R/client.R|
ung/sparkrinitdoc.
(cherry picked from commit 2213441e5e0fba01e05826257604aa427cdf2598)
Signed-off-by: Shivaram Venkataraman
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/355bd72e
Tree: http://git-wip-us.apache.org/repos/asf/spark/t
Rui
Authored: Thu Dec 3 21:11:10 2015 -0800
Committer: Shivaram Venkataraman
Committed: Thu Dec 3 21:11:10 2015 -0800
--
R/pkg/R/DataFrame.R | 8
R/pkg/inst/tests/test_sparkSQL.R | 6 ++
2 files changed,
aaa)
Signed-off-by: Shivaram Venkataraman
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/2d7c4f6a
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/2d7c4f6a
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/2d7c4
aa0)
Signed-off-by: Shivaram Venkataraman
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/57d16403
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/57d16403
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/57d16
Rui
Authored: Sat Dec 5 15:49:51 2015 -0800
Committer: Shivaram Venkataraman
Committed: Sat Dec 5 15:49:51 2015 -0800
--
R/pkg/NAMESPACE | 3 ++
R/pkg/R/functions.R | 59 +++
mit 895b6c474735d7e0a38283f92292daa5c35875ee)
Signed-off-by: Shivaram Venkataraman
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/664694b2
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/664694b2
Diff: http://git-wip-us.apache.org/repos/
nts: c8d0e16
Author: felixcheung
Authored: Sat Dec 5 16:00:12 2015 -0800
Committer: Shivaram Venkataraman
Committed: Sat Dec 5 16:00:12 2015 -0800
--
R/pkg/R/functions.R | 15 +++
R/pkg/R/generic
not catch up with 1.6 release, it will be breaking change
for 1.7 that we also need to explain in release note.
cc sun-rui felixcheung shivaram
Author: Yanbo Liang
Closes #10123 from yanboliang/spark-12115.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-
can not catch up with 1.6 release, it will be breaking change
for 1.7 that we also need to explain in release note.
cc sun-rui felixcheung shivaram
Author: Yanbo Liang
Closes #10123 from yanboliang/spark-12115.
(cherry picked from commit 6979edf4e1a93caafa8d286692097dd377d7616d)
Signed-off
ace ```DataFrame.isNaN``` with ```DataFrame.isnan``` at SparkR side.
Because ```DataFrame.isNaN``` has been deprecated and will be removed at Spark
2.0.
3, Add ```isnull``` to ```DataFrame``` for SparkR. ```DataFrame``` should
has two related functions: ```isnan, isnull```.
cc shivaram sun-rui felixcheung
Aut
NaN``` with ```DataFrame.isnan``` at SparkR side.
Because ```DataFrame.isNaN``` has been deprecated and will be removed at Spark
2.0.
3, Add ```isnull``` to ```DataFrame``` for SparkR. ```DataFrame``` should
has two related functions: ```isnan, isnull```.
cc shivaram sun-rui felixcheung
Aut
http://git-wip-us.apache.org/repos/asf/spark/blob/3f230f7b/R/pkg/inst/tests/test_sparkSQL.R
--
diff --git a/R/pkg/inst/tests/test_sparkSQL.R b/R/pkg/inst/tests/test_sparkSQL.R
deleted file mode 100644
index 6ef03ae..000
--- a/R
(cherry picked from commit 39d677c8f1ee7ebd7e142bec0415cf8f90ac84b6)
Signed-off-by: Shivaram Venkataraman
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/3f230f7b
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/3f230f7b
http://git-wip-us.apache.org/repos/asf/spark/blob/39d677c8/R/pkg/inst/tests/testthat/test_binaryFile.R
--
diff --git a/R/pkg/inst/tests/testthat/test_binaryFile.R
b/R/pkg/inst/tests/testthat/test_binaryFile.R
new file mode 100644
/heads/master
Commit: 39d677c8f1ee7ebd7e142bec0415cf8f90ac84b6
Parents: 9cde7d5
Author: Sun Rui
Authored: Mon Dec 7 10:38:17 2015 -0800
Committer: Shivaram Venkataraman
Committed: Mon Dec 7 10:38:17 2015 -0800
--
R/pkg/inst/tests/jarTest.R
http://git-wip-us.apache.org/repos/asf/spark/blob/39d677c8/R/pkg/inst/tests/test_sparkSQL.R
--
diff --git a/R/pkg/inst/tests/test_sparkSQL.R b/R/pkg/inst/tests/test_sparkSQL.R
deleted file mode 100644
index 6ef03ae..000
--- a/R
Repository: spark
Updated Branches:
refs/heads/branch-1.6 c54b698ec -> 3f230f7b3
http://git-wip-us.apache.org/repos/asf/spark/blob/3f230f7b/R/pkg/inst/tests/testthat/test_sparkSQL.R
--
diff --git a/R/pkg/inst/tests/testthat/tes
Repository: spark
Updated Branches:
refs/heads/master 9cde7d5fa -> 39d677c8f
http://git-wip-us.apache.org/repos/asf/spark/blob/39d677c8/R/pkg/inst/tests/testthat/test_sparkSQL.R
--
diff --git a/R/pkg/inst/tests/testthat/test_sp
http://git-wip-us.apache.org/repos/asf/spark/blob/3f230f7b/R/pkg/inst/tests/testthat/test_binaryFile.R
--
diff --git a/R/pkg/inst/tests/testthat/test_binaryFile.R
b/R/pkg/inst/tests/testthat/test_binaryFile.R
new file mode 100644
iff/eeb58722
Branch: refs/heads/master
Commit: eeb58722ad73441eeb5f35f864be3c5392cfd426
Parents: db51652
Author: Yanbo Liang
Authored: Thu Dec 10 09:44:53 2015 -0800
Committer: Shivaram Venkataraman
Committed: Thu Dec 10 09:44:53 2015 -0
hor: Yanbo Liang
Closes #10191 from yanboliang/spark-12198.
(cherry picked from commit eeb58722ad73441eeb5f35f864be3c5392cfd426)
Signed-off-by: Shivaram Venkataraman
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/b7b9f772
T
org/jira/browse/SPARK-12234) about
the error and how to reproduce it.
cc sun-rui felixcheung shivaram
Author: Yanbo Liang
Closes #10217 from yanboliang/spark-12234.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d9d354ed
T
tps://issues.apache.org/jira/browse/SPARK-12234) about
the error and how to reproduce it.
cc sun-rui felixcheung shivaram
Author: Yanbo Liang
Closes #10217 from yanboliang/spark-12234.
(cherry picked from commit d9d354ed40eec56b3f03d32f4e2629d367b1bf02)
Signed-off-by: Shivaram Venkataraman
Project: http://
but still
keep jsonFile test case.
* If this PR is accepted, we should also make almost the same change for
```parquetFile```.
cc felixcheung sun-rui shivaram
Author: Yanbo Liang
Closes #10145 from yanboliang/spark-12146.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: h
L.R, but still
keep jsonFile test case.
* If this PR is accepted, we should also make almost the same change for
```parquetFile```.
cc felixcheung sun-rui shivaram
Author: Yanbo Liang
Closes #10145 from yanboliang/spark-12146.
(cherry picked from commit 0fb9825556dbbcc98d7eafe9ddea8676301e0
ull
Author: gatorsmile
Closes #10160 from gatorsmile/sampleR.
(cherry picked from commit 1e3526c2d3de723225024fedd45753b556e18fc6)
Signed-off-by: Shivaram Venkataraman
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/47461f
asf/spark/diff/1e3526c2
Branch: refs/heads/master
Commit: 1e3526c2d3de723225024fedd45753b556e18fc6
Parents: 1e799d6
Author: gatorsmile
Authored: Fri Dec 11 20:55:16 2015 -0800
Committer: Shivaram Venkataraman
Committed: Fri Dec 11 20:55:16 2015 -0800
--
Repository: spark
Updated Branches:
refs/heads/master b51a4cdff -> fb3778de6
[SPARK-12327] Disable commented code lintr temporarily
cc yhuai felixcheung shaneknapp
Author: Shivaram Venkataraman
Closes #10300 from shivaram/comment-lintr-disable.
Project: http://git-wip-us.apache.org/re
Repository: spark
Updated Branches:
refs/heads/branch-1.6 c0f0f6cb0 -> 352a0c80f
[SPARK-12327] Disable commented code lintr temporarily
cc yhuai felixcheung shaneknapp
Author: Shivaram Venkataraman
Closes #10300 from shivaram/comment-lintr-disable.
(cherry picked from com
Repository: spark
Updated Branches:
refs/heads/master 54c512ba9 -> 2eb5af5f0
[SPARK-12318][SPARKR] Save mode in SparkR should be error by default
shivaram Please help review.
Author: Jeff Zhang
Closes #10290 from zjffdu/SPARK-12318.
Project: http://git-wip-us.apache.org/repos/asf/sp
rom yanboliang/spark-12310.
(cherry picked from commit 22f6cd86fc2e2d6f6ad2c3aae416732c46ebf1b1)
Signed-off-by: Shivaram Venkataraman
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ac0e2ea7
Tree: http://git-wip-us.apache.org/repos/
ter
Commit: 22f6cd86fc2e2d6f6ad2c3aae416732c46ebf1b1
Parents: 2eb5af5
Author: Yanbo Liang
Authored: Wed Dec 16 10:34:30 2015 -0800
Committer: Shivaram Venkataraman
Committed: Wed Dec 16 10:34:30 2015 -0800
--
R/pkg/NAMESP
Repository: spark
Updated Branches:
refs/heads/branch-1.6 16edd933d -> f81512729
[SPARK-12318][SPARKR] Save mode in SparkR should be error by default
shivaram Please help review.
Author: Jeff Zhang
Closes #10290 from zjffdu/SPARK-12318.
(cherry picked from com
hor: Shivaram Venkataraman
Closes #10372 from sun-rui/SPARK-10500-branch-1.5.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d2f71c27
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/d2f71c27
Diff: http://git-
t-wip-us.apache.org/repos/asf/spark/tree/d80cc90b
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/d80cc90b
Branch: refs/heads/master
Commit: d80cc90b5545cff82cd9b340f12d01eafc9ca524
Parents: 73862a1
Author: Forest Fang
Authored: T
elect(df, when(df$a > 1 & df$b > 2, lit(1
Error: Test failures
Execution halted
```
Author: Forest Fang
Closes #10481 from saurfang/spark-12526.
(cherry picked from commit d80cc90b5545cff82cd9b340f12d01eafc9ca524)
Signed-off-by: Shivaram Venkataraman
Project: http://git-wip-us.apache
301 - 400 of 550 matches
Mail list logo
