Guys any idea about where Livy keeps job execution logs (Spark driver
> logs) ?
>
> I saw a couple of lines here :
>
> https://github.com/apache/incubator-livy/blob/master/server/src/main/scala/org/apache/livy/server/batch/BatchSession.scala#L90
If you are using YARN the driver logs are always available at YARN resource
manager.
You can also see the logs from /sessions/{sessionid}/logs
Thanks,
Meisam
On Sun, Jun 24, 2018 at 1:37 PM Abbass wrote:
> Guys any idea about where Livy keeps job execution logs (Spark driver
> logs) ?
Guys any idea about where Livy keeps job execution logs (Spark driver
logs) ?
I saw a couple of lines here :
https://github.com/apache/incubator-livy/blob/master/server/src/main/scala/org/apache/livy/server/batch/BatchSession.scala#L90
to redirect stdout & stderr somewhere.
Is there anywa