[ https://issues.apache.org/jira/browse/SPARK-29882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Marcelo Masiero Vanzin resolved SPARK-29882. -------------------------------------------- Fix Version/s: (was: 2.4.4) Target Version/s: (was: 2.4.4) Resolution: Duplicate > SPARK on Kubernetes is Broken for SPARK with no Hadoop release > -------------------------------------------------------------- > > Key: SPARK-29882 > URL: https://issues.apache.org/jira/browse/SPARK-29882 > Project: Spark > Issue Type: Bug > Components: Kubernetes > Affects Versions: 2.4.4 > Environment: h3. How was this patch tested? > Kubernetes 1.14, Spark 2.4.4, Hadoop 3.2.1. Adding $SPARK_DIST_CLASSPATH to > {{-cp }} param of entrypoint.sh enables launching the executors correctly. > Reporter: Shahin Shakeri > Priority: Major > > h3. What changes were proposed in this pull request? > Include {{$SPARK_DIST_CLASSPATH}} in class path when launching > {{CoarseGrainedExecutorBackend}} on Kubernetes executors using the provided > {{entrypoint.sh}} > h3. Why are the changes needed? > For user provided Hadoop (3.2.1 in this example) {{$SPARK_DIST_CLASSPATH}} > contains the required jars. > h3. Does this PR introduce any user-facing change? > no > -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org