completed or is not enabled.
>
> Any other way to see my logs?
>
> Thanks
>
> John
>
>
>
>
> --
> *From:* ayan guha
> *Sent:* Sunday, July 30, 2017 10:34 PM
> *To:* John Zeng; Riccardo Ferrari
>
> *Cc:* User
> *Subject:*
Subject: Re: Logging in RDD mapToPair of Java Spark application
Hi
As you are using yarn log aggregation, yarn moves all the logs to hdfs after
the application completes.
You can use following command to get the logs:
yarn logs -applicationId
On Mon, 31 Jul 2017 at 3:17 am, John Zeng
tainer-logs/application_1501197841826_0013
>
> I believe Spark moves these logs to a different place. But where are they?
>
> Thanks
>
> John
>
>
>
>
> ------------------
> *From:* Riccardo Ferrari
> *Sent:* Saturday, July 29, 2017 8:18 PM
>
rent place. But where are they?
Thanks
John
From: Riccardo Ferrari
Sent: Saturday, July 29, 2017 8:18 PM
To: johnzengspark
Cc: User
Subject: Re: Logging in RDD mapToPair of Java Spark application
Hi John,
The reason you don't see the second sysout lin
Hi John,
The reason you don't see the second sysout line is because is executed on a
different JVM (ie. Driver vs Executor). the second sysout line should be
available through the executor logs. Check the Executors tab.
There are alternative approaches to manage log centralization however it
real
