Hi, Suppose I have a command and I pass the --files arg as below:
bin/spark-submit --class com.test.HelloWorld --master yarn-cluster --num-executors 8 --driver-memory 512m --executor-memory 2048m --executor-cores 4 --queue public * --files $HOME/myfile.txt* --name test_1 ~/test_code-1.0-SNAPSHOT.jar Can anyone tell me how do I access this file in my executors? Basically I want to read this file to get some configs. I tries to read from my HDFS Home dir but that doesnt work. Thanks, Udit