Thank you for your comments Imran.
Regarding integration tests,
What you inferred from the documentation is correct -
Integration tests do not require any prior setup or a Kubernetes cluster to
run. Minikube is a single binary that brings up a one-node cluster and
exposes the full Kubernetes
Speaking to integration testing: the integration tests can either attach to
an existing cluster, or they can spin up their own minikube cluster to run
themselves against.
Spark-on-kube can definitely operate without the RSS, as long as spark can
find the files it needs using some other
Overall this looks like a good proposal. I do have some concerns which I'd
like to discuss -- please understand I'm taking a "devil's advocate" stance
here for discussion, not that I'm giving a -1.
My primary concern is about testing and maintenance. My concerns might be
addressed if the doc
