Re: spark-submit config via file

2017-03-27 Thread Thakrar, Jayesh
Zhang <java8...@hotmail.com>, ", Roy" <rp...@njit.edu>, user <user@spark.apache.org> Subject: Re: spark-submit config via file You should try adding your NN host and port in the URL. On Mon, Mar 27, 2017 at 11:03 AM, Saisai Shao <sai.sai.s...@gmail.com<mailto:sai.sai.s...@g

Re: spark-submit config via file

2017-03-27 Thread Sandeep Nemuri
master")).set(xxx, properties.get("xxx")) >> >> Your error is your environment problem. >> >> Yong >> -- >> *From:* , Roy <rp...@njit.edu> >> *Sent:* Friday, March 24, 2017 7:38 AM >> *To:* use

Re: spark-submit config via file

2017-03-27 Thread Saisai Shao
operties.get("xxx")) > > Your error is your environment problem. > > Yong > -- > *From:* , Roy <rp...@njit.edu> > *Sent:* Friday, March 24, 2017 7:38 AM > *To:* user > *Subject:* spark-submit config via file > > H

Re: spark-submit config via file

2017-03-24 Thread Yong Zhang
erties.get("xxx")) Your error is your environment problem. Yong From: , Roy <rp...@njit.edu> Sent: Friday, March 24, 2017 7:38 AM To: user Subject: spark-submit config via file Hi, I am trying to deploy spark job by using spark-submit which has b

spark-submit config via file

2017-03-24 Thread , Roy
Hi, I am trying to deploy spark job by using spark-submit which has bunch of parameters like spark-submit --class StreamingEventWriterDriver --master yarn --deploy-mode cluster --executor-memory 3072m --executor-cores 4 --files streaming.conf spark_streaming_2.11-assembly-1.0-SNAPSHOT.jar -conf