Re: [k8s][jenkins] spark dev tool docs now have k8s+minikube instructions!

2019-03-29 Thread Felix Cheung
Definitely the part on the PR. Thanks!



From: shane knapp 
Sent: Thursday, March 28, 2019 11:19 AM
To: dev; Stavros Kontopoulos
Subject: [k8s][jenkins] spark dev tool docs now have k8s+minikube instructions!

https://spark.apache.org/developer-tools.html

search for "Testing K8S".

this is pretty much how i build and test PRs locally...  the commands there are 
lifted straight from the k8s integration test jenkins build, so they might 
require a little tweaking to better suit your laptop/server.

k8s is great (except when it's not), and it's really quite easy to get set up 
(except when it's not).  stackoverflow is your friend, and the minikube slack 
was really useful.

some of this is a little hacky (running the mount process in the background, 
for example), but there's a lot of development on minikube right now...  the 
k8s project understands the importance of minikube and has dedicated 
engineering resources involved.

and finally, if you have a suggesting for the docs, open a PR!  they are always 
welcome!

shane

ps- and a special thanks to @Stavros 
Kontopoulos<mailto:stavros.kontopou...@lightbend.com> and the PR from hell for 
throwing me in the deep end of k8s.  :)
--
Shane Knapp
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu


[k8s][jenkins] spark dev tool docs now have k8s+minikube instructions!

2019-03-28 Thread shane knapp
https://spark.apache.org/developer-tools.html

search for "Testing K8S".

this is pretty much how i build and test PRs locally...  the commands there
are lifted straight from the k8s integration test jenkins build, so they
might require a little tweaking to better suit your laptop/server.

k8s is great (except when it's not), and it's really quite easy to get set
up (except when it's not).  stackoverflow is your friend, and the minikube
slack was really useful.

some of this is a little hacky (running the mount process in the
background, for example), but there's a lot of development on minikube
right now...  the k8s project understands the importance of minikube and
has dedicated engineering resources involved.

and finally, if you have a suggesting for the docs, open a PR!  they are
always welcome!

shane

ps- and a special thanks to @Stavros Kontopoulos
 and the PR from hell for throwing me in
the deep end of k8s.  :)
-- 
Shane Knapp
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu