Hi Randy and Gino,
The issue is that standalone-cluster mode is not officially supported.
Please use standalone-client mode instead, i.e. specify --deploy-mode
client in spark-submit, or simply leave out this config because it defaults
to client mode.
Unfortunately, this is not currently
Andrew,
Thanks for your answer. It validates our finding. Unfortunately, client mode
assumes that I'm running in a privilege node. What I mean by privilege is a
node that has net access to all the workers and vice versa. This is a big
assumption to make and unreasonable in certain
my programer runs in standalone model, the commond line is likeļ¼
/opt/spark-1.0.0/bin/spark-submit \
--verbose \
--class $class_name --master spark://master:7077 \
--driver-memory 15G \
--driver-cores 2 \
--deploy-mode cluster \