Re: Getting dot files for DAGs

2015-10-01 Thread James Pirz
Thanks for suggesting, I never used Tez UI before, and learned about it yesterday. I am trying to find out how I can enable/use it. Apparently it needs some changes in the binary that I am using (I had built the binary for tez 0.7 almost 2 months ago). On Wed, Sep 30, 2015 at 10:27 PM, Jörn

Re: Getting dot files for DAGs

2015-10-01 Thread Hitesh Shah
I don’t believe the binary should need changing at all unless you need enhancements from recent commits. It should just be setting up the UI and configuring Tez for using YARN Timeline. The instructions that you can follow: http://tez.apache.org/tez-ui.html

Getting dot files for DAGs

2015-09-30 Thread James Pirz
I am using Tez 0.7.0 on Hadopp 2.6 to run Hive queries. I am interested in checking DAGs for my queries visually, and I realized that I can do that by graphviz once I can get "dot" files of my DAGs. My issue is I can not find those files, they are not in the log directory of Yarn or Hadoop or

Re: Getting dot files for DAGs

2015-09-30 Thread Jianfeng (Jeff) Zhang
" <u...@tez.apache.org<mailto:u...@tez.apache.org>> Date: Thursday, October 1, 2015 at 8:29 AM To: "u...@tez.apache.org<mailto:u...@tez.apache.org>" <u...@tez.apache.org<mailto:u...@tez.apache.org>> Cc: "user@hive.apache.org<mailto:user@hive.apache.org

Re: Getting dot files for DAGs

2015-09-30 Thread Hitesh Shah
The .dot file is generated into the Tez Application Master’s container log dir. Firstly, you need to figure out the yarn application in which the query/Tez DAG ran. Once you have the applicationId, you can use one of these 2 approaches: 1) Go to the YARN ResourceManager UI, find the

Re: Getting dot files for DAGs

2015-09-30 Thread James Pirz
Thanks. I could locate them in the proper container's log directory and visualize them. I was at the wrong node, assuming that they would be available on any of the node, but they are really dumped in one of the nodes. On Wed, Sep 30, 2015 at 7:00 PM, Hitesh Shah wrote: >

Re: Getting dot files for DAGs

2015-09-30 Thread Russell Jurney
In tryiegggmbgfzbbvtcsvvedq. On Thursday, October 1, 2015, Jörn Franke wrote: > Why not use tez ui? > > Le jeu. 1 oct. 2015 à 2:29, James Pirz > a écrit : > >> I am using Tez 0.7.0 on Hadopp

Re: Getting dot files for DAGs

2015-09-30 Thread Jörn Franke
Why not use tez ui? Le jeu. 1 oct. 2015 à 2:29, James Pirz a écrit : > I am using Tez 0.7.0 on Hadopp 2.6 to run Hive queries. > I am interested in checking DAGs for my queries visually, and I realized > that I can do that by graphviz once I can get "dot" files of my DAGs.