spark-submit doesnt handle being symlinks currently: $ spark-submit /usr/local/bin/spark-submit: line 44: /usr/local/bin/spark-class: No such file or directory /usr/local/bin/spark-submit: line 44: exec: /usr/local/bin/spark-class: cannot execute: No such file or directory
to fix i changed the line that sets SPARK_HOME to: export SPARK_HOME="$(script=`readlink $0`;cd `dirname $script`/..; pwd)" i have seen people resolve multiple symlinks in a for loop kind of structure, but thats beyond my bash abilities
