>From spark-submit -h:
--files FILES Comma-separated list of files to be
placed in the working
directory of each executor. File paths of
these files
in executors can be accessed via
SparkFiles.get(fileName).
On Sun, Mar
I am submitting a script to spark-submit and passing it a file using
--files property. Later on I need to read it in a worker.
I don't understand what API I should use to do that. I figured I'd try just:
with open('myfile'):
but this did not work.
I am able to pass the file using the addFile
