[jira] [Commented] (SPARK-28444) Bump Kubernetes Client Version to 4.3.0
[ https://issues.apache.org/jira/browse/SPARK-28444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16888975#comment-16888975 ] Patrick Winter commented on SPARK-28444: I agree. I will be on holiday for the next few weeks, but will keep you updated once we found out more. Thanks for your help! > Bump Kubernetes Client Version to 4.3.0 > --- > > Key: SPARK-28444 > URL: https://issues.apache.org/jira/browse/SPARK-28444 > Project: Spark > Issue Type: Dependency upgrade > Components: Kubernetes >Affects Versions: 3.0.0, 2.4.3 >Reporter: Patrick Winter >Priority: Major > > Spark is currently using the Kubernetes client version 4.1.2. This client > does not support the current Kubernetes version 1.14, as can be seen on the > [compatibility > matrix|[https://github.com/fabric8io/kubernetes-client#compatibility-matrix]]. > Therefore the Kubernetes client should be bumped up to version 4.3.0. -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-28444) Bump Kubernetes Client Version to 4.3.0
[ https://issues.apache.org/jira/browse/SPARK-28444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16888965#comment-16888965 ] Patrick Winter commented on SPARK-28444: Using the Kubernetes client in a standalone application works both with version 4.1.2 and 4.3.0. We used the same credentials as for Spark. > Bump Kubernetes Client Version to 4.3.0 > --- > > Key: SPARK-28444 > URL: https://issues.apache.org/jira/browse/SPARK-28444 > Project: Spark > Issue Type: Dependency upgrade > Components: Kubernetes >Affects Versions: 3.0.0, 2.4.3 >Reporter: Patrick Winter >Priority: Major > > Spark is currently using the Kubernetes client version 4.1.2. This client > does not support the current Kubernetes version 1.14, as can be seen on the > [compatibility > matrix|[https://github.com/fabric8io/kubernetes-client#compatibility-matrix]]. > Therefore the Kubernetes client should be bumped up to version 4.3.0. -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-28444) Bump Kubernetes Client Version to 4.3.0
[ https://issues.apache.org/jira/browse/SPARK-28444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1653#comment-1653 ] Patrick Winter commented on SPARK-28444: We have been hitting this one previously, but are now already using a user account (.kube/config) on the submit machine, so this does not seem to be the issue. > Bump Kubernetes Client Version to 4.3.0 > --- > > Key: SPARK-28444 > URL: https://issues.apache.org/jira/browse/SPARK-28444 > Project: Spark > Issue Type: Dependency upgrade > Components: Kubernetes >Affects Versions: 3.0.0, 2.4.3 >Reporter: Patrick Winter >Priority: Major > > Spark is currently using the Kubernetes client version 4.1.2. This client > does not support the current Kubernetes version 1.14, as can be seen on the > [compatibility > matrix|[https://github.com/fabric8io/kubernetes-client#compatibility-matrix]]. > Therefore the Kubernetes client should be bumped up to version 4.3.0. -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-28444) Bump Kubernetes Client Version to 4.3.0
[ https://issues.apache.org/jira/browse/SPARK-28444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1633#comment-1633 ] Patrick Winter commented on SPARK-28444: Running spark-submit does unfortunately not give much more information: Exception in thread "main" io.fabric8.kubernetes.client.KubernetesClientException at io.fabric8.kubernetes.client.dsl.internal.WatchConnectionManager$2.onFailure(WatchConnectionManager.java:201) at okhttp3.internal.ws.RealWebSocket.failWebSocket(RealWebSocket.java:543) at okhttp3.internal.ws.RealWebSocket$2.onResponse(RealWebSocket.java:185) at okhttp3.RealCall$AsyncCall.execute(RealCall.java:141) at okhttp3.internal.NamedRunnable.run(NamedRunnable.java:32) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 19/07/19 12:43:20 INFO ShutdownHookManager: Shutdown hook called 19/07/19 12:43:20 INFO ShutdownHookManager: Deleting directory /tmp/spark-54cf5aa1-7a66-4bb4-8d88-96ac7d2076e2 Running the jar directly we get a little more: 19/07/19 12:45:27 INFO SparkContext: Running Spark version 2.4.2 19/07/19 12:45:27 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 19/07/19 12:45:27 INFO SparkContext: Submitted application: bigdataAnalyticsPoC 19/07/19 12:45:28 INFO SecurityManager: Changing view acls to: root 19/07/19 12:45:28 INFO SecurityManager: Changing modify acls to: root 19/07/19 12:45:28 INFO SecurityManager: Changing view acls groups to: 19/07/19 12:45:28 INFO SecurityManager: Changing modify acls groups to: 19/07/19 12:45:28 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(root); groups with view permissions: Set(); users with modify permissions: Set(root); groups with modify permissions: Set() 19/07/19 12:45:28 INFO Utils: Successfully started service 'sparkDriver' on port 40288. 19/07/19 12:45:28 INFO SparkEnv: Registering MapOutputTracker 19/07/19 12:45:28 INFO SparkEnv: Registering BlockManagerMaster 19/07/19 12:45:28 INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information 19/07/19 12:45:28 INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up 19/07/19 12:45:28 INFO DiskBlockManager: Created local directory at /tmp/blockmgr-f46c28fd-5c19-441e-9f62-c7d392e2c29a 19/07/19 12:45:28 INFO MemoryStore: MemoryStore started with capacity 2.1 GB 19/07/19 12:45:28 INFO SparkEnv: Registering OutputCommitCoordinator 19/07/19 12:45:28 INFO Utils: Successfully started service 'SparkUI' on port 4040. 19/07/19 12:45:28 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://spark-submit-client-849vj:4040 19/07/19 12:45:29 INFO ExecutorPodsAllocator: Going to request 2 executors from Kubernetes. 19/07/19 12:45:29 WARN WatchConnectionManager: Exec Failure: HTTP 403, Status: 403 - null java.net.ProtocolException: Expected HTTP 101 response but was '403 Forbidden' at okhttp3.internal.ws.RealWebSocket.checkResponse(RealWebSocket.java:216) at okhttp3.internal.ws.RealWebSocket$2.onResponse(RealWebSocket.java:183) at okhttp3.RealCall$AsyncCall.execute(RealCall.java:141) at okhttp3.internal.NamedRunnable.run(NamedRunnable.java:32) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 19/07/19 12:45:29 WARN ExecutorPodsWatchSnapshotSource: Kubernetes client has been closed (this is expected if the application is shutting down.) 19/07/19 12:45:30 ERROR SparkContext: Error initializing SparkContext. io.fabric8.kubernetes.client.KubernetesClientException at io.fabric8.kubernetes.client.dsl.internal.WatchConnectionManager$2.onFailure(WatchConnectionManager.java:201) at okhttp3.internal.ws.RealWebSocket.failWebSocket(RealWebSocket.java:543) at okhttp3.internal.ws.RealWebSocket$2.onResponse(RealWebSocket.java:185) at okhttp3.RealCall$AsyncCall.execute(RealCall.java:141) at okhttp3.internal.NamedRunnable.run(NamedRunnable.java:32) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 19/07/19 12:45:30 INFO SparkUI: Stopped Spark web UI at http://spark-submit-client-849vj:4040 19/07/19 12:45:30 INFO KubernetesClusterSchedulerBackend: Shutting down all executors 19/07/19 12:45:30 INFO KubernetesClusterSchedulerBackend$KubernetesDriverEndpoint: Asking each executor to shut down 19/07/19 12:45:30 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped! 19/07/19 12:45:
[jira] [Commented] (SPARK-28444) Bump Kubernetes Client Version to 4.3.0
[ https://issues.apache.org/jira/browse/SPARK-28444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16888616#comment-16888616 ] Patrick Winter commented on SPARK-28444: Our company recently upgraded Kubernetes to 1.14 and since then Spark can't create PODs anymore, throwing a KubernetesClientException instead. > Bump Kubernetes Client Version to 4.3.0 > --- > > Key: SPARK-28444 > URL: https://issues.apache.org/jira/browse/SPARK-28444 > Project: Spark > Issue Type: Dependency upgrade > Components: Kubernetes >Affects Versions: 3.0.0, 2.4.3 >Reporter: Patrick Winter >Priority: Major > > Spark is currently using the Kubernetes client version 4.1.2. This client > does not support the current Kubernetes version 1.14, as can be seen on the > [compatibility > matrix|[https://github.com/fabric8io/kubernetes-client#compatibility-matrix]]. > Therefore the Kubernetes client should be bumped up to version 4.3.0. -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-28444) Bump Kubernetes Client Version to 4.3.0
Patrick Winter created SPARK-28444: -- Summary: Bump Kubernetes Client Version to 4.3.0 Key: SPARK-28444 URL: https://issues.apache.org/jira/browse/SPARK-28444 Project: Spark Issue Type: Dependency upgrade Components: Kubernetes Affects Versions: 2.4.3, 3.0.0 Reporter: Patrick Winter Spark is currently using the Kubernetes client version 4.1.2. This client does not support the current Kubernetes version 1.14, as can be seen on the [compatibility matrix|[https://github.com/fabric8io/kubernetes-client#compatibility-matrix]]. Therefore the Kubernetes client should be bumped up to version 4.3.0. -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
