RE: Tez log location?

2015-05-21 Thread Bikas Saha
Perhaps we should consider creating a TEE in the AM and always do SimpleHistoryLogging? From: Jianfeng (Jeff) Zhang [mailto:jzh...@hortonworks.com] Sent: Thursday, May 21, 2015 5:33 PM To: user@tez.apache.org Subject: Re: Tez log location? In that case you are using SimpleHistoryLoggingService

Re: Tez log location?

2015-05-21 Thread Jianfeng (Jeff) Zhang
mailto:xiaoy...@microsoft.com>> Reply-To: "user@tez.apache.org<mailto:user@tez.apache.org>" mailto:user@tez.apache.org>> Date: Friday, May 22, 2015 at 7:14 AM To: "user@tez.apache.org<mailto:user@tez.apache.org>" mailto:user@tez.apache.org>> S

Re: Tez log location?

2015-05-21 Thread Hitesh Shah
There is some history logging done that can be enabled via the SimpleHistoryLogger. This activates by default if ATS logger is not enabled. This is not fully compatible with the ATS data and also as it is mostly experimental, it may not have all the data. To use it, you can configure the “tez.h

Tez log location?

2015-05-21 Thread Xiaoyong Zhu
Hi, I am wondering if I didn't configure YARN ATS integration, where would be the tez log (I mean the data available in /ws/v1/timeline/TEZ_DAG_ID if there is an integration happening) go to HDFS? Is there a configuration for that? Thanks! Xiaoyong