Re: Tez UI in Pig

2016-04-05 Thread Sreenath Somarajapuram
Hi, The jira is https://issues.apache.org/jira/browse/TEZ-2712 Thanks, Sreenath On 4/5/16, 11:43 PM, "Hitesh Shah" wrote: >Hi Kurt, > >The Tez UI as documented should work with any version beyond 0.5.2 if the >history logging is configured to use YARN timeline. As for scopes, some >bits of th

RE: Re: why only need to configure "the client node hadoop classpath"?

2016-04-05 Thread Bikas Saha
Maria, Are you just trying to understand the code or planning to make some customization to this? If the latter, then please open a jira for that. Would be good to understand your scenario. Thanks Bikas From: Siddharth Seth [mailto:ss...@apache.org] Sent: Tuesday, April 5, 2016 10

Re: Tez UI in Pig

2016-04-05 Thread Hitesh Shah
Hi Kurt, The Tez UI as documented should work with any version beyond 0.5.2 if the history logging is configured to use YARN timeline. As for scopes, some bits of the vertex description are currently not displayed in the UI though I am not sure if Pig has integrated with that API yet. Dependin

Tez UI in Pig

2016-04-05 Thread Kurt Muehlner
I have a question about the availability of the Tez web UI in Pig on Tez. The Pig ‘Performance and Efficiency’ doc states, "Tez specific GUI is not available yet, there is no GUI to track task progress. However, log message is available in GUI.” What does this mean, precisely? We have not dep

Re: Re: why only need to configure "the client node hadoop classpath"?

2016-04-05 Thread Siddharth Seth
Yes. It depends upon the YARN distributed cache. The relevant jars (tez.lib.uris, tez.aux.uris) are localized on each node using YARN local resources (distributed cache). Configs are constructed on the client node and then written out to HDFS, and localized again via the distributed cache. If you'r

Re:Re: why only need to configure "the client node hadoop classpath"?

2016-04-05 Thread Maria
Much thanks for your quick reply. Siddharth~ :) OK, I got it. But another question arises:How can it propagate the libraries and configuration to other nodes? Does it depends on hadoop distributed cache? I still can not find the code logic. :( At 2016-04-05 10:27:55, "Siddharth Seth" wrote: