RE: tez dot file location?

2015-02-07 Thread Xiaoyong Zhu
Thanks for the explaination! I have found the dot files:) Xiaoyong -Original Message- From: Hitesh Shah [mailto:hit...@apache.org] Sent: Sunday, February 8, 2015 2:44 AM To: user@tez.apache.org Subject: Re: tez dot file location? To clarify, it will be in one of the log-dirs ( not the w

reducers counters

2015-02-07 Thread Grandl Robert
Guys, I was trying to figure out some counters from the job history files. For reducers, I am trying to find, which reducer is writing to HDFS(i.e. last reducers in the job's chain of vertices). For Map vertices, they have an HDFS: BYTES_WRITTEN, HDFS: BYTES_READ counters which makes sense. Ho

Re: tez dot file location?

2015-02-07 Thread Hitesh Shah
To clarify, it will be in one of the log-dirs ( not the working dir ) of the AM’s container. If you can access the AM logs from the RM UI, you can try out using “http://people.apache.org/~gopalv/dagviz/“ When using “bin/yarn logs -applicationId ”, look for the files of container_…._01 wh