Michal Vince created ZEPPELIN-5760:
--------------------------------------
Summary: properties are not propagated correctly to spark in k8s
Key: ZEPPELIN-5760
URL: https://issues.apache.org/jira/browse/ZEPPELIN-5760
Project: Zeppelin
Issue Type: Bug
Reporter: Michal Vince
As stated in [spark
configuration|https://spark.apache.org/docs/latest/configuration.html#dynamically-loading-spark-properties]
{noformat}
Spark properties mainly can be divided into two kinds: one is related to
deploy, like “spark.driver.memory”, “spark.executor.instances”, this kind of
properties may not be affected when setting programmatically through SparkConf
in runtime, or the behavior is depending on which cluster manager and deploy
mode you choose, so it would be suggested to set through configuration file or
spark-submit command line options...
{noformat}
some configurations are ignored when set via SparkConf including
{{{}spark.jars.packages{}}}, {{spark.driver.extraJavaOptions}} and others when
running spark in K8s
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
