You might want to run spark-submit with option --deploy-mode cluster
On Thursday, July 30, 2015 7:24 PM, Marcelo Vanzin van...@cloudera.com
wrote:
Can you share the part of the code in your script where you create the
SparkContext instance?
On Thu, Jul 30, 2015 at 7:19 PM,
...@hortonworks.com
wrote:
If you run it on yarn with kerberos setup. You authenticate yourself by kinit
before launching the job.
Thanks.
Zhan Zhang
On Jul 28, 2015, at 8:51 PM, Anh Hong hongnhat...@yahoo.com.INVALID wrote:
Hi,I'd like to remotely run spark-submit from a local machine
Hi,I'd like to remotely run spark-submit from a local machine to submit a job
to spark cluster (cluster mode).
What method do I use to authenticate myself to the cluster? Like how to pass
user id or password or private key to the cluster
Any help is appreciated.
Hi,
I'm using spark-submit cluster mode to submit a job from local to spark
cluster. There are input files, output files, and job log files that I need to
transfer in and out between local machine and spark cluster.Any recommendation
methods to use file transferring. Is there any future
