GitHub user rvesse opened a pull request: https://github.com/apache/spark/pull/22805
[WIP][SPARK-25809][K8S][TEST] New K8S integration testing backends ## What changes were proposed in this pull request? Currently K8S integration tests are hardcoded to use a `minikube` based backend. `minikube` is VM based so can be resource hungry and also doesn't cope well with certain networking setups (for example using Cisco AnyConnect software VPN `minikube` is unusable as it detects its own IP incorrectly). This PR Adds a new K8S integration testing backend that allows for using the Kubernetes support in [Docker for Desktop](https://blog.docker.com/2018/07/kubernetes-is-now-available-in-docker-desktop-stable-channel/). This is WIP towards generalising to be able to run the integration tests against an arbitrary Kubernetes cluster. To Do: - [ ] General Kubernetes cluster backend - [ ] Documentation on Kubernetes integration testing ## How was this patch tested? Ran integration tests with Docker for Desktop and all passed: ![screen shot 2018-10-23 at 14 19 56](https://user-images.githubusercontent.com/2104864/47363460-c5816a00-d6ce-11e8-9c15-56b34698e797.png) Suggested Reviewers: @ifilonenko @srowen You can merge this pull request into a Git repository by running: $ git pull https://github.com/rvesse/spark SPARK-25809 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/22805.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #22805 ---- commit ea3cfd670ec7a7fbb5bfe2b4df56afd67900df9b Author: Rob Vesse <rvesse@...> Date: 2018-10-23T13:11:16Z [SPARK-25809][K8S] Docker for desktop K8S integration backend Adds a new K8S integration testing backend that allows for using the Kubernetes support in Docker for Desktop ---- --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org