in my spark-defaults.conf I have: spark.files file1.zip, file2.py spark.master spark://master.domain.com:7077
If I execute: bin/pyspark I can see it adding the files correctly. However if I execute bin/spark-submit test.py where test.py relies on the file1.zip, I get and error. If I i instead execute bin/spark-submit --py-files file1.zip test.py It works as expected. How do I get spark-submit to import the spark-defaults.conf file or what should I start checking to figure out why one works and the other doesn't? Thanks, -Axel
