Hi,

Suppose I have a command and I pass the --files arg as below:

bin/spark-submit --class com.test.HelloWorld --master yarn-cluster
--num-executors 8 --driver-memory 512m --executor-memory 2048m
--executor-cores 4 --queue public * --files $HOME/myfile.txt*  --name
test_1 ~/test_code-1.0-SNAPSHOT.jar

Can anyone tell me how do I access this file in my executors?
Basically I want to read this file to get some configs. I tries to read
from my HDFS Home dir but that doesnt work.

Thanks,
Udit

Reply via email to