Can I see current values of all configs. Similar to configuration in Hadoop world from ui ?
Sent from my iPhone > On 09-Apr-2015, at 11:07 pm, Marcelo Vanzin <van...@cloudera.com> wrote: > > Set spark.yarn.maxAppAttempts=1 if you don't want retries. > >> On Thu, Apr 9, 2015 at 10:31 AM, ÐΞ€ρ@Ҝ (๏̯͡๏) <deepuj...@gmail.com> wrote: >> Hello, >> I have a spark job with 5 stages. After it runs 3rd stage, the console shows >> >> >> 15/04/09 10:25:57 INFO yarn.Client: Application report for >> application_1427705526386_127168 (state: RUNNING) >> 15/04/09 10:25:58 INFO yarn.Client: Application report for >> application_1427705526386_127168 (state: RUNNING) >> 15/04/09 10:25:59 INFO yarn.Client: Application report for >> application_1427705526386_127168 (state: ACCEPTED) >> 15/04/09 10:25:59 INFO yarn.Client: >> client token: N/A >> diagnostics: N/A >> ApplicationMaster host: N/A >> ApplicationMaster RPC port: -1 >> queue: hdmi-express >> start time: 1428598679223 >> final status: UNDEFINED >> tracking URL: >> https://apollo-phx-rm-1.vip.ebay.com:50030/proxy/application_1427705526386_127168/ >> user: dvasthimal >> 15/04/09 10:26:00 INFO yarn.Client: Application report for >> application_1427705526386_127168 (state: ACCEPTED) >> 15/04/09 10:26:01 INFO yarn.Client: Application report for >> application_1427705526386_127168 (state: ACCEPTED) >> >> and then running again. This looks as if the stage failed and Spark >> restarted the job from beginning. If thats not the case, when i click the >> spark UI web page, it does not show already completed stages and instead >> goes back to running stage #1. Is there some setting to turn this behavior >> off ? >> >> -- >> Deepak > > > > -- > Marcelo --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
