[ https://issues.apache.org/jira/browse/SPARK-25537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Venkat Sambath updated SPARK-25537: ----------------------------------- Description: spark.pyspark.driver.python, spark.pyspark.python when set in code doesnt get picked up by driver or executor. It gets picked up only when set through --conf or when set in spark-defaults.conf. Can we add a line which states it is illegal to set these in application as we do for spark.driver.extraJavaOptions in the doc https://spark.apache.org/docs/latest/configuration.html#application-properties (was: spark.pyspark.driver.python, spark.pyspark.python when set in code doesnt get picked up by driver. Can we add a line which states it is illegal to set these in application as we do for spark.driver.extraJavaOptions ) > spark.pyspark.driver.python when set in code doesnt work > -------------------------------------------------------- > > Key: SPARK-25537 > URL: https://issues.apache.org/jira/browse/SPARK-25537 > Project: Spark > Issue Type: Documentation > Components: Spark Core > Affects Versions: 2.3.0 > Reporter: Venkat Sambath > Priority: Minor > > spark.pyspark.driver.python, spark.pyspark.python when set in code doesnt get > picked up by driver or executor. It gets picked up only when set through > --conf or when set in spark-defaults.conf. Can we add a line which states it > is illegal to set these in application as we do for > spark.driver.extraJavaOptions in the doc > https://spark.apache.org/docs/latest/configuration.html#application-properties -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org