Tez TimelineServer

2014-11-11 Thread Dharmesh Kakadia
Hi, I am trying to get Tez job statistics through TmielineServer API. I have set up build Tez 0.5.1 and I am able to run tez jobs but no data is being pushed to the TimelineServer. THe web interface shows nothing. Here is what I added to the yarn-site.xml yarn.timeline-service.enabled

Re: Tez TimelineServer

2014-11-11 Thread Dharmesh Kakadia
have set "tez.history.logging.service.class" to > "org.apache.tez.dag.history.logging.ats.ATSHistoryLoggingService" ? > > ~Rajesh.B > > On Tue, Nov 11, 2014 at 5:55 AM, Dharmesh Kakadia > wrote: > >> Hi, >> >> I am trying to get Tez job statistics through TmielineServer

Re: Tez TimelineServer

2014-11-11 Thread Dharmesh Kakadia
r from > client its an invalid address. > > also in tez-site you will need to set the > tez.history.logging.service.class property to > org.apache.tez.dag.history.logging.ats.ATSHistoryLoggingService > > > On 11/11/14 7:40 PM, Dharmesh Kakadia wrote: > > I had not set th

Re: Tez TimelineServer

2014-11-11 Thread Dharmesh Kakadia
and...@hortonworks.com> wrote: > Apologies for the confusion. What I meant was the server address cannot be > 0.0.0.0 it should be some IP address the client can reach to. > On Nov 11, 2014 8:32 PM, "Dharmesh Kakadia" wrote: > >> Hi Prakash, >> >> I have the "yar

Re: Tez TimelineServer

2014-11-11 Thread Dharmesh Kakadia
sh > > > On Nov 11, 2014, at 7:41 AM, Dharmesh Kakadia wrote: > > > Both timelineserver and tez was running on the same machine, so I doubt > that could be problem. > > Anyway, I set the server address to be the hostname and still nothing on > TLS. > > > &g

Re: Tez TimelineServer

2014-11-12 Thread Dharmesh Kakadia
, Dharmesh On Tue, Nov 11, 2014 at 9:51 PM, Jonathan Eagles wrote: > Great, Dharmesh. Make sure to include the web address you are trying > to browse (for example localhost:8188/ws/v1/timeline/TEZ_DAG_ID). That > will help in debugging. > > Jon > > On Tue, Nov 11, 2014 at 10:17

Re: Tez TimelineServer

2014-11-13 Thread Dharmesh Kakadia
to bind to. > > I believe the yarn distributed shell application may have some support of > sending data to ATS. > > A question that should have been asked earlier - what version of Tez are > you running? > > — Hitesh > > On Nov 12, 2014, at 9:30 PM, Dharmesh

Re: Tez TimelineServer

2014-11-13 Thread Dharmesh Kakadia
: dag_1414391213387_0105_1, type: TEZ_DAG_ID }, JSON-style content: {"events": ... Thanks, Dharmesh On Thu, Nov 13, 2014 at 3:01 PM, Dharmesh Kakadia wrote: > Thanks Hitesh. I didn't realize that "yarn.timeline-service.webapp.address" > is also a client side

Re: Tez TimelineServer

2014-11-13 Thread Dharmesh Kakadia
ll dags > http://localhost:8188/ws/v1/timeline/TEZ_DAG_ID/dag_1414391213387_0105_1 > for the specific dag > > > On Thu, Nov 13, 2014 at 3:52 PM, Dharmesh Kakadia > wrote: > >> Found that this is fixed in Yarn 2.6 ( >> https://issues.apache.org/jira/browse/YARN-

Getting DAG Id from Hive on tez

2015-09-14 Thread Dharmesh Kakadia
Hi, I am running Hive on Tez, with timeline server. We have a pre-hook in hive to maintain the statistics of what jobs ran by whom and how much resource it tool etc. that we had been using it with Hive-MR. Now I am trying to port this pre-hook to work with Hive on Tez. I plan to using timelin

RE: Getting DAG Id from Hive on tez

2015-09-15 Thread Dharmesh Kakadia
:45 PM, Dharmesh Kakadia wrote: > Hi, > > I am running Hive on Tez, with timeline server. We have a pre-hook in hive to > maintain the statistics of what jobs ran by whom and how much resource it tool etc. that we had been using it with Hive-MR. Now I am trying to port this pre-hook to

Hive+Tez staging dir and scratch dir

2016-10-31 Thread Dharmesh Kakadia
Hi, I am trying to understand meaning and relation between following configurations when running Hive on Tez. hive.exec.stagingdir tez.staging-dir hive.exec.scratchdir Thanks, Dharmesh

Re: Hive+Tez staging dir and scratch dir

2016-11-01 Thread Dharmesh Kakadia
the actual usage of the hive staging dir and scratch dir, I suggest > trying out the user@hive mailing list. > > thanks > — Hitesh > > > > On Oct 31, 2016, at 2:41 PM, Dharmesh Kakadia > wrote: > > > > Hi, > > > > I am tryin