Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22830
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98039/
Test FAILed.
---
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/22829#discussion_r228285511
--- Diff: pom.xml ---
@@ -2656,7 +2656,8 @@
kubernetes
resource-managers/kubernetes/core
-
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22830
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22830
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22820
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22820
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22820
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/4494/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22823
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98022/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22823
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22823
**[Test build #98022 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98022/testReport)**
for PR 22823 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22820
**[Test build #98041 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98041/testReport)**
for PR 22820 at commit
Github user ifilonenko commented on the issue:
https://github.com/apache/spark/pull/22820
In reference to manifests that need to be updated in
`dev/deps/spark-deps-hadoop-2.7` and `dev/deps/spark-deps-hadoop-3.1`. This
most recent commit should fix
---
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/22829#discussion_r228281269
--- Diff: pom.xml ---
@@ -2656,7 +2656,8 @@
kubernetes
resource-managers/kubernetes/core
-
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22820
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/4494/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22817
**[Test build #98040 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98040/testReport)**
for PR 22817 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22830
**[Test build #98039 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98039/testReport)**
for PR 22830 at commit
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/22805#discussion_r228278972
--- Diff: resource-managers/kubernetes/integration-tests/README.md ---
@@ -41,12 +71,127 @@ The Spark code to test is handed to the integration
test system
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/22805#discussion_r228280345
--- Diff:
resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/backend/cloud/KubeConfigBackend.scala
---
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/22805#discussion_r228279841
--- Diff:
resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/backend/cloud/KubeConfigBackend.scala
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22825
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98021/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22825
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22825
**[Test build #98021 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98021/testReport)**
for PR 22825 at commit
Github user mgaido91 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22790#discussion_r228279627
--- Diff:
mllib/src/main/scala/org/apache/spark/mllib/clustering/BisectingKMeansModel.scala
---
@@ -109,7 +109,7 @@ class BisectingKMeansModel
GitHub user mgaido91 opened a pull request:
https://github.com/apache/spark/pull/22830
[SPARK-25838][ML] Remove formatVersion from Saveable
## What changes were proposed in this pull request?
`Saveable` interface introduces `formatVersion` which is protected and it
is used
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22817
**[Test build #98038 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98038/testReport)**
for PR 22817 at commit
Github user liyinan926 commented on the issue:
https://github.com/apache/spark/pull/22805
@rvesse I want to take back my comment on bumping the version of the
fabric8 client in the same PR. Based on the discussion so far, it seems more
appropriate to do that in a separate PR, like in
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22820
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22820
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98037/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22820
**[Test build #98037 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98037/testReport)**
for PR 22820 at commit
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/22805#discussion_r228278587
--- Diff: resource-managers/kubernetes/integration-tests/README.md ---
@@ -13,15 +13,45 @@ The simplest way to run the integration tests is to
install and
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22820
**[Test build #98037 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98037/testReport)**
for PR 22820 at commit
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/22818
Thanks, would it be also possible to double-check `Integer.MAX_VALUE` if
you have not checked yet?
---
-
To unsubscribe, e-mail:
Github user mgaido91 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22790#discussion_r228276018
--- Diff:
mllib/src/main/scala/org/apache/spark/mllib/clustering/BisectingKMeansModel.scala
---
@@ -109,7 +109,7 @@ class BisectingKMeansModel
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22823
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98018/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22823
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22812
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22812
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98020/
Test PASSed.
---
Github user huaxingao commented on a diff in the pull request:
https://github.com/apache/spark/pull/22790#discussion_r228274470
--- Diff:
mllib/src/main/scala/org/apache/spark/mllib/clustering/BisectingKMeansModel.scala
---
@@ -109,7 +109,7 @@ class BisectingKMeansModel
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22823
**[Test build #98018 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98018/testReport)**
for PR 22823 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22812
**[Test build #98020 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98020/testReport)**
for PR 22812 at commit
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/22790
LGTM
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user ifilonenko commented on a diff in the pull request:
https://github.com/apache/spark/pull/22820#discussion_r228269911
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/KubernetesUtils.scala
---
@@ -157,7 +157,10 @@ private[spark]
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/22827#discussion_r228269628
--- Diff:
sql/core/src/test/resources/sql-tests/inputs/higher-order-functions.sql ---
@@ -60,8 +60,3 @@ select zip_with(array('a', 'b', 'c'),
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22809
**[Test build #98035 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98035/testReport)**
for PR 22809 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22790
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22790
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22790
**[Test build #98036 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98036/testReport)**
for PR 22790 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22809
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22809
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/22827#discussion_r228267525
--- Diff:
sql/core/src/test/resources/sql-tests/inputs/higher-order-functions.sql ---
@@ -60,8 +60,3 @@ select zip_with(array('a', 'b', 'c'), array('d',
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/22827#discussion_r228267271
--- Diff:
sql/core/src/test/resources/sql-tests/inputs/higher-order-functions.sql ---
@@ -60,8 +60,3 @@ select zip_with(array('a', 'b', 'c'),
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/22827
@dongjoon-hyun I think that can be kept.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22827
**[Test build #98034 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98034/testReport)**
for PR 22827 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22827
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22827
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22827
Also, please remove `public static final int WORD_SIZE = 8;` in
UnsafeRow.java. It's added by `map_entries`.
-
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22809
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22809
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22816
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22816
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22829
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22829
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/4488/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22829
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22829
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/4488/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22809
**[Test build #98033 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98033/testReport)**
for PR 22809 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22816
**[Test build #98032 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98032/testReport)**
for PR 22816 at commit
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/22827#discussion_r228263430
--- Diff:
sql/core/src/test/resources/sql-tests/inputs/higher-order-functions.sql ---
@@ -65,21 +65,3 @@ create or replace temporary view nested as
Github user mgaido91 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22029#discussion_r228262819
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala
---
@@ -202,7 +209,11 @@ case class InSubquery(values:
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/22816#discussion_r228262084
--- Diff:
core/src/main/scala/org/apache/spark/api/python/PythonRunner.scala ---
@@ -114,7 +114,7 @@ private[spark] abstract class BasePythonRunner[IN,
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22828
Oh, I'm closing this in favor of https://github.com/apache/spark/pull/22827.
---
-
To unsubscribe, e-mail:
Github user dongjoon-hyun closed the pull request at:
https://github.com/apache/spark/pull/22828
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22821
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98017/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22821
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22821
**[Test build #98017 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98017/testReport)**
for PR 22821 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22829
**[Test build #98031 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98031/testReport)**
for PR 22829 at commit
GitHub user srowen opened a pull request:
https://github.com/apache/spark/pull/22829
[SPARK-25836][BUILD][K8S] For now disable kubernetes-integration-tests
## What changes were proposed in this pull request?
For now make building and running kubernetes-integration-tests
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22828
To run the Jenkins faster, I create a standalone PR instead of making a PR
to #22821 .
---
-
To unsubscribe, e-mail:
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/22828#discussion_r228259220
--- Diff:
sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeRow.java
---
@@ -61,8 +61,6 @@
*/
public final class
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22828
**[Test build #98030 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98030/testReport)**
for PR 22828 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22828
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22828
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22805#discussion_r228256148
--- Diff:
resource-managers/kubernetes/integration-tests/scripts/setup-integration-test-env.sh
---
@@ -71,19 +71,36 @@ if [[ $IMAGE_TAG == "N/A" ]];
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22805#discussion_r228258489
--- Diff:
resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/backend/IntegrationTestBackend.scala
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22805#discussion_r228257003
--- Diff:
resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/Utils.scala
---
@@ -27,4 +27,36 @@
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/22828#discussion_r228258092
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/FunctionRegistry.scala
---
@@ -433,13 +432,9 @@ object FunctionRegistry
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/22828#discussion_r228257902
--- Diff: python/pyspark/sql/functions.py ---
@@ -2540,26 +2540,6 @@ def map_values(col):
return
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/22828#discussion_r228257685
--- Diff: R/pkg/NAMESPACE ---
@@ -313,7 +313,6 @@ exportMethods("%<=>%",
"lower",
"lpad",
GitHub user dongjoon-hyun opened a pull request:
https://github.com/apache/spark/pull/22828
[SPARK-25832][SQL] remove newly added map related functions
## What changes were proposed in this pull request?
This aims to supercede https://github.com/apache/spark/pull/22821 .
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/22827
@felixcheung @mengxr The last commit
https://github.com/apache/spark/pull/22827/commits/f1f3d0b09527d28fd8a1f1a2c8e2358c10da175b
is for R related revert. Please take a look
---
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/22827
@cloud-fan @dongjoon-hyun @rxin @felixcheung
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22827
**[Test build #98029 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98029/testReport)**
for PR 22827 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22827
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22827
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user gatorsmile opened a pull request:
https://github.com/apache/spark/pull/22827
[SPARK-25832][SQL] Revert newly added map related functions
## What changes were proposed in this pull request?
- Revert [SPARK-23935][SQL] Adding map_entries function:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22814
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98028/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22814
**[Test build #98028 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98028/testReport)**
for PR 22814 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22814
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user rvesse commented on the issue:
https://github.com/apache/spark/pull/22805
Ran successfully against one of our dev K8S clusters today:
