This is an automated email from the ASF dual-hosted git repository.
vanzin pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 2d0b7cf [SPARK-26742][K8S] Update Kubernetes-Client version to 4.1.2
2d0b7cf is described below
commit 2d0b7cfe441e6bd6024f977fa0c667e2155dc466
Author: Jiaxin Shan <seedjeff...@gmail.com>
AuthorDate: Wed Mar 13 15:04:27 2019 -0700
[SPARK-26742][K8S] Update Kubernetes-Client version to 4.1.2
## What changes were proposed in this pull request?
https://github.com/apache/spark/pull/23814 was reverted because of Jenkins
integration tests failure. After minikube upgrade, Kubernetes client SDK v1.4.2
work with kubernetes v1.13. We can bring this change back.
Reference:
[Bump Kubernetes Client Version to
4.1.2](https://issues.apache.org/jira/browse/SPARK-26742)
[Original PR against master](https://github.com/apache/spark/pull/23814)
[Kubernetes client upgrade for Spark
2.4](https://github.com/apache/spark/pull/23993)
## How was this patch tested?
(Please explain how this patch was tested. E.g. unit tests, integration
tests, manual tests)
(If this patch involves UI changes, please attach a screenshot; otherwise,
remove this)
Unit Tests:
```
All tests passed.
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary for Spark Project Parent POM 3.0.0-SNAPSHOT:
[INFO]
[INFO] Spark Project Parent POM ........................... SUCCESS [
2.343 s]
[INFO] Spark Project Tags ................................. SUCCESS [
2.039 s]
[INFO] Spark Project Sketch ............................... SUCCESS [
12.714 s]
[INFO] Spark Project Local DB ............................. SUCCESS [
2.185 s]
[INFO] Spark Project Networking ........................... SUCCESS [
38.154 s]
[INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [
7.989 s]
[INFO] Spark Project Unsafe ............................... SUCCESS [
2.297 s]
[INFO] Spark Project Launcher ............................. SUCCESS [
2.813 s]
[INFO] Spark Project Core ................................. SUCCESS [38:03
min]
[INFO] Spark Project ML Local Library ..................... SUCCESS [
3.848 s]
[INFO] Spark Project GraphX ............................... SUCCESS [
56.084 s]
[INFO] Spark Project Streaming ............................ SUCCESS [04:58
min]
[INFO] Spark Project Catalyst ............................. SUCCESS [06:39
min]
[INFO] Spark Project SQL .................................. SUCCESS [37:12
min]
[INFO] Spark Project ML Library ........................... SUCCESS [18:59
min]
[INFO] Spark Project Tools ................................ SUCCESS [
0.767 s]
[INFO] Spark Project Hive ................................. SUCCESS [33:45
min]
[INFO] Spark Project REPL ................................. SUCCESS [01:14
min]
[INFO] Spark Project Assembly ............................. SUCCESS [
1.444 s]
[INFO] Spark Integration for Kafka 0.10 ................... SUCCESS [01:12
min]
[INFO] Kafka 0.10+ Token Provider for Streaming ........... SUCCESS [
6.719 s]
[INFO] Kafka 0.10+ Source for Structured Streaming ........ SUCCESS [07:00
min]
[INFO] Spark Project Examples ............................. SUCCESS [
21.805 s]
[INFO] Spark Integration for Kafka 0.10 Assembly .......... SUCCESS [
0.906 s]
[INFO] Spark Avro ......................................... SUCCESS [
50.486 s]
[INFO]
------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 02:32 h
[INFO] Finished at: 2019-03-07T08:39:34Z
[INFO]
------------------------------------------------------------------------
```
Please review http://spark.apache.org/contributing.html before opening a
pull request.
Closes #24002 from Jeffwan/update_k8s_sdk_master.
Authored-by: Jiaxin Shan <seedjeff...@gmail.com>
Signed-off-by: Marcelo Vanzin <van...@cloudera.com>
---
dev/deps/spark-deps-hadoop-2.7 | 7 ++++---
dev/deps/spark-deps-hadoop-3.1 | 7 ++++---
resource-managers/kubernetes/core/pom.xml | 2 +-
resource-managers/kubernetes/integration-tests/pom.xml | 2 +-
4 files changed, 10 insertions(+), 8 deletions(-)
diff --git a/dev/deps/spark-deps-hadoop-2.7 b/dev/deps/spark-deps-hadoop-2.7
index 232596c..877abae 100644
--- a/dev/deps/spark-deps-hadoop-2.7
+++ b/dev/deps/spark-deps-hadoop-2.7
@@ -133,13 +133,14 @@ jta-1.1.jar
jtransforms-2.4.0.jar
jul-to-slf4j-1.7.16.jar
kryo-shaded-4.0.2.jar
-kubernetes-client-4.1.0.jar
-kubernetes-model-4.1.0.jar
+kubernetes-client-4.1.2.jar
+kubernetes-model-4.1.2.jar
+kubernetes-model-common-4.1.2.jar
leveldbjni-all-1.8.jar
libfb303-0.9.3.jar
libthrift-0.12.0.jar
log4j-1.2.17.jar
-logging-interceptor-3.9.1.jar
+logging-interceptor-3.12.0.jar
lz4-java-1.5.0.jar
machinist_2.12-0.6.1.jar
macro-compat_2.12-1.1.1.jar
diff --git a/dev/deps/spark-deps-hadoop-3.1 b/dev/deps/spark-deps-hadoop-3.1
index bc77e35..e35690e 100644
--- a/dev/deps/spark-deps-hadoop-3.1
+++ b/dev/deps/spark-deps-hadoop-3.1
@@ -147,13 +147,14 @@ kerby-pkix-1.0.1.jar
kerby-util-1.0.1.jar
kerby-xdr-1.0.1.jar
kryo-shaded-4.0.2.jar
-kubernetes-client-4.1.0.jar
-kubernetes-model-4.1.0.jar
+kubernetes-client-4.1.2.jar
+kubernetes-model-4.1.2.jar
+kubernetes-model-common-4.1.2.jar
leveldbjni-all-1.8.jar
libfb303-0.9.3.jar
libthrift-0.12.0.jar
log4j-1.2.17.jar
-logging-interceptor-3.9.1.jar
+logging-interceptor-3.12.0.jar
lz4-java-1.5.0.jar
machinist_2.12-0.6.1.jar
macro-compat_2.12-1.1.1.jar
diff --git a/resource-managers/kubernetes/core/pom.xml
b/resource-managers/kubernetes/core/pom.xml
index 8d594ee..23106cb 100644
--- a/resource-managers/kubernetes/core/pom.xml
+++ b/resource-managers/kubernetes/core/pom.xml
@@ -29,7 +29,7 @@
<name>Spark Project Kubernetes</name>
<properties>
<sbt.project.name>kubernetes</sbt.project.name>
- <kubernetes.client.version>4.1.0</kubernetes.client.version>
+ <kubernetes.client.version>4.1.2</kubernetes.client.version>
</properties>
<dependencies>
diff --git a/resource-managers/kubernetes/integration-tests/pom.xml
b/resource-managers/kubernetes/integration-tests/pom.xml
index f16b536..91ef0e2 100644
--- a/resource-managers/kubernetes/integration-tests/pom.xml
+++ b/resource-managers/kubernetes/integration-tests/pom.xml
@@ -29,7 +29,7 @@
<download-maven-plugin.version>1.3.0</download-maven-plugin.version>
<exec-maven-plugin.version>1.4.0</exec-maven-plugin.version>
<extraScalaTestArgs></extraScalaTestArgs>
- <kubernetes-client.version>4.1.0</kubernetes-client.version>
+ <kubernetes-client.version>4.1.2</kubernetes-client.version>
<scala-maven-plugin.version>3.2.2</scala-maven-plugin.version>
<scalatest-maven-plugin.version>1.0</scalatest-maven-plugin.version>
<sbt.project.name>kubernetes-integration-tests</sbt.project.name>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
