Re: Logging in RDD mapToPair of Java Spark application

2017-07-30 Thread ayan guha
completed or is not enabled. > > Any other way to see my logs? > > Thanks > > John > > > > > -- > *From:* ayan guha > *Sent:* Sunday, July 30, 2017 10:34 PM > *To:* John Zeng; Riccardo Ferrari > > *Cc:* User > *Subject:*

Re: Logging in RDD mapToPair of Java Spark application

2017-07-30 Thread John Zeng
Subject: Re: Logging in RDD mapToPair of Java Spark application Hi As you are using yarn log aggregation, yarn moves all the logs to hdfs after the application completes. You can use following command to get the logs: yarn logs -applicationId On Mon, 31 Jul 2017 at 3:17 am, John Zeng

Re: Logging in RDD mapToPair of Java Spark application

2017-07-30 Thread ayan guha
tainer-logs/application_1501197841826_0013 > > I believe Spark moves these logs to a different place. But where are they? > > Thanks > > John > > > > > -------------- > *From:* Riccardo Ferrari > *Sent:* Saturday, July 29, 2017 8:18 PM >

Re: Logging in RDD mapToPair of Java Spark application

2017-07-30 Thread John Zeng
rent place. But where are they? Thanks John From: Riccardo Ferrari Sent: Saturday, July 29, 2017 8:18 PM To: johnzengspark Cc: User Subject: Re: Logging in RDD mapToPair of Java Spark application Hi John, The reason you don't see the second sysout lin

Re: Logging in RDD mapToPair of Java Spark application

2017-07-29 Thread Riccardo Ferrari
ed. The only issue for me is why the second > logging > is not in JobTracker UI. > > Appreciate your help. > > Thanks > > John > > > > -- > View this message in context: http://apache-spark-user-list. > 1001560.n3.nabble.com/Logging-in-RDD-mapToPair-of-Java- > Spark-application-tp29007.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > - > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > >

Logging in RDD mapToPair of Java Spark application

2017-07-29 Thread johnzengspark
logging line were executed. The only issue for me is why the second logging is not in JobTracker UI. Appreciate your help. Thanks John -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Logging-in-RDD-mapToPair-of-Java-Sp