Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22829
**[Test build #98031 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98031/testReport)**
for PR 22829 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22838
**[Test build #98050 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98050/testReport)**
for PR 22838 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22838
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22838
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22838
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/4503/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22838
**[Test build #98049 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98049/testReport)**
for PR 22838 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22838
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/4503/
---
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/22838
@srowen I think now we are aligned.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/22829
ok seems this to be closed. I will copy it to the other PR.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22838
**[Test build #98048 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98048/testReport)**
for PR 22838 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22838
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22838
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98048/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22838
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/4502/
---
Github user erikerlandson commented on a diff in the pull request:
https://github.com/apache/spark/pull/22820#discussion_r228321586
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/KubernetesUtils.scala
---
@@ -157,7 +157,10 @@ private[spark]
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22838
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22838
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user erikerlandson commented on a diff in the pull request:
https://github.com/apache/spark/pull/22820#discussion_r228321407
--- Diff: docs/running-on-kubernetes.md ---
@@ -45,7 +45,8 @@ logs and remains in "completed" state in the Kubernetes
API until it's eventuall
Github user arunmahadevan commented on a diff in the pull request:
https://github.com/apache/spark/pull/22598#discussion_r228321793
--- Diff:
core/src/main/scala/org/apache/spark/deploy/security/HadoopDelegationTokenManager.scala
---
@@ -66,7 +66,8 @@ private[spark] class
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22029
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22029
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98027/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22029
**[Test build #98027 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98027/testReport)**
for PR 22029 at commit
Github user dbtsai commented on the issue:
https://github.com/apache/spark/pull/22839
Thanks @dongjoon-hyun This LGTM!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user arunmahadevan commented on a diff in the pull request:
https://github.com/apache/spark/pull/22598#discussion_r228320944
--- Diff:
core/src/main/scala/org/apache/spark/internal/config/package.scala ---
@@ -647,4 +647,42 @@ package object config {
.stringConf
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22752
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/22752
Merging to master / 2.4 (will run a couple of tests on 2.4 before merging
there).
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22827
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98029/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22827
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22838
**[Test build #98048 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98048/testReport)**
for PR 22838 at commit
Github user ifilonenko commented on the issue:
https://github.com/apache/spark/pull/22608
@vanzin as per our conversation offline, that is exactly what my current
refactor is doing. I will push an update really soon. Thanks for the
recommendation!
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22827
**[Test build #98029 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98029/testReport)**
for PR 22827 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22838
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/4502/
---
Github user peter-toth commented on the issue:
https://github.com/apache/spark/pull/22804
Thanks @dongjoon-hyun , @wangyum for the review.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user skonto commented on a diff in the pull request:
https://github.com/apache/spark/pull/22838#discussion_r228318094
--- Diff: pom.xml ---
@@ -2654,6 +2654,16 @@
kubernetes
+
+resource-managers/kubernetes/core
+
Github user skonto commented on a diff in the pull request:
https://github.com/apache/spark/pull/22838#discussion_r228317925
--- Diff: pom.xml ---
@@ -2654,6 +2654,16 @@
kubernetes
+
+resource-managers/kubernetes/core
+
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22839
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98046/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22839
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22839
**[Test build #98046 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98046/testReport)**
for PR 22839 at commit
Github user skonto commented on a diff in the pull request:
https://github.com/apache/spark/pull/22838#discussion_r228316721
--- Diff: pom.xml ---
@@ -2654,6 +2654,16 @@
kubernetes
+
+resource-managers/kubernetes/core
+
Github user srowen closed the pull request at:
https://github.com/apache/spark/pull/22829
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/22838#discussion_r228311880
--- Diff: pom.xml ---
@@ -2654,6 +2654,16 @@
kubernetes
+
+resource-managers/kubernetes/core
+
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/22838#discussion_r228316418
--- Diff: pom.xml ---
@@ -2654,6 +2654,16 @@
kubernetes
+
+resource-managers/kubernetes/core
+
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22798
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/22798
Merging to master / 2.4.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user skonto commented on a diff in the pull request:
https://github.com/apache/spark/pull/22838#discussion_r228314627
--- Diff: pom.xml ---
@@ -2654,6 +2654,16 @@
kubernetes
+
+resource-managers/kubernetes/core
+
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22839
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22839
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22838
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/4500/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22838
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22838
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/22608
I haven't reviewed this (and I do have concerns about using an external
image in the long term), just wanted to perhaps give some ideas for the future.
Livy does integration tests using some
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22812
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22812
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98026/
Test PASSed.
---
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/22838#discussion_r228313490
--- Diff: pom.xml ---
@@ -2654,6 +2654,16 @@
kubernetes
+
+resource-managers/kubernetes/core
+
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22812
**[Test build #98026 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98026/testReport)**
for PR 22812 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22838
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/4500/
---
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22804
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user erikerlandson commented on the issue:
https://github.com/apache/spark/pull/22838
LGTM - the k8s integration tests are off by default, can be run via
`-P...`, and are passwing via Jenkins
---
-
To
Github user squito commented on the issue:
https://github.com/apache/spark/pull/22818
Actually there are quite a few more uses, even of `Int.MaxValue`, which I
find suspicious, but for the moment I only wanted to touch the cases I
understood better. For example,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22838
**[Test build #98047 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98047/testReport)**
for PR 22838 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22839
**[Test build #98046 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98046/testReport)**
for PR 22839 at commit
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/22839#discussion_r228307486
--- Diff: docs/sql-data-sources-load-save-functions.md ---
@@ -82,6 +82,49 @@ To load a CSV file you can use:
+The extra options
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22838
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/4499/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22838
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22838
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/22839#discussion_r228307138
--- Diff: examples/src/main/r/RSparkSQLExample.R ---
@@ -114,10 +114,14 @@ write.df(namesAndAges, "namesAndAges.parquet",
"parquet")
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22838
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/4499/
---
GitHub user dongjoon-hyun opened a pull request:
https://github.com/apache/spark/pull/22839
[SPARK-25656][SQL][DOC][EXAMPLE][BRANCH-2.4] Add a doc and examples about
extra data source options
## What changes were proposed in this pull request?
Our current doc does not
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22815
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22815
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98025/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22815
**[Test build #98025 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98025/testReport)**
for PR 22815 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22838
**[Test build #98045 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98045/testReport)**
for PR 22838 at commit
Github user arunmahadevan commented on the issue:
https://github.com/apache/spark/pull/22824
It may be enough to do the check just once than repeating similar checks
for inner, leftOuter and rightOuter. For example have a single check before the
`joinType match {` clause.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22838
**[Test build #98044 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98044/testReport)**
for PR 22838 at commit
Github user devaraj-kavali commented on the issue:
https://github.com/apache/spark/pull/22752
@vanzin can you check the updated changes, thanks
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/22838
@srowen pls review.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
GitHub user skonto opened a pull request:
https://github.com/apache/spark/pull/22838
[SPARK-25835][K8s] fix issues with k8s tests
## What changes were proposed in this pull request?
- Fixes the scala version propagation issue.
- Disables the tests under the k8s profile,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22837
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22837
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22829
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22829
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/4497/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22829
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22829
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/4497/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22790
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98036/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22790
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22790
**[Test build #98036 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98036/testReport)**
for PR 22790 at commit
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/22823#discussion_r228295120
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala
---
@@ -910,12 +910,14 @@ class
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22837
**[Test build #98043 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98043/testReport)**
for PR 22837 at commit
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22827
@gatorsmile . Could you put `[BRANCH-2.4]` into PR title?
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22820
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22820
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22820
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/4496/
---
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/22837#discussion_r228293689
--- Diff: sql/core/src/test/resources/sql-tests/results/datetime.sql.out ---
@@ -82,9 +82,10 @@ struct
1 2
2 3
+
-- !query
GitHub user dongjoon-hyun opened a pull request:
https://github.com/apache/spark/pull/22837
[MINOR][TEST] Fix datetime.sql.out
## What changes were proposed in this pull request?
`datetime.sql.out` is a generated golden file, but it's a little bit broken
during manual
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22820
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/4496/
---
Github user bsikander commented on the issue:
https://github.com/apache/spark/pull/21816
Thank you.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user peter-toth commented on the issue:
https://github.com/apache/spark/pull/22817
@gatorsmile , I looked into this and it seems if we use `mapChildren` in
`ResolveReferences` then `UnresolvedExtractValue` should define 2 children.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22829
**[Test build #98042 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98042/testReport)**
for PR 22829 at commit
Github user peter-toth commented on a diff in the pull request:
https://github.com/apache/spark/pull/22817#discussion_r228285647
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/unresolved.scala
---
@@ -407,7 +407,10 @@ case class
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22830
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22830
**[Test build #98039 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98039/testReport)**
for PR 22830 at commit
301 - 400 of 775 matches
Mail list logo
