vanzin commented on issue #26493: [SPARK-29574][K8S] Add SPARK_DIST_CLASSPATH to the executor class path URL: https://github.com/apache/spark/pull/26493#issuecomment-554526940 I don't see any code in the k8s backend that's actually propagating `SPARK_DIST_CLASSPATH` to the pods. That's generally propagated e.g. from `spark-env.sh` when you use YARN. Although I can see how that's a bit different on k8s (since the pod and launch node may be really different). Anyway, it seems that at the very least `hadoop-provided.md` needs to be updated for this case, since the instructions there don't work for k8s as far as I can tell.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
