Re: Query on entrypoint.sh Kubernetes spark

2021-01-21 Thread Jacek Laskowski
Hi, I'm a beginner in Spark on Kubernetes so bear with me and watch out for possible mistakes :) The key to understand entrypoint.sh and -deploy-mode client is to think about the environment where the script is executed in. That's k8s already where the Docker image is brought to life as a

Query on entrypoint.sh Kubernetes spark

2021-01-21 Thread Sachit Murarka
Hi All, To run spark on kubernetes . I see following lines in entrypoint.sh script available case "$1" in driver) shift 1 CMD=( "$SPARK_HOME/bin/spark-submit" --conf "spark.driver.bindAddress=$SPARK_DRIVER_BIND_ADDRESS" --deploy-mode client Could you pls suggest Why