Re: How to measure the execution time of query on Hive on Tez

2017-10-12 Thread Prasanth Jayachandran
Hi There are couple of tables that you are seeing, the top one is Query Execution Summary and next one is Task Execution Summary. At the end of your query execution, you should see something like "Time taken: xx.xx seconds” in hive CLI or beeline. This represents the overall time the query too

RE: How to measure the execution time of query on Hive on Tez

2017-10-12 Thread Zhang, Liyun
Hi all: Maybe in last mail the attached picture is not shown. I re-described my question here. I saw following statistics about the runtime when running query. The Run DAG is 318s. But it is not the sum of DURATION of all VERTICES((59549+4069+3055+3055+1004+1006+132736+34248+11077+1003+439+

RE: How to measure the execution time of query on Hive on Tez

2017-10-12 Thread Zhang, Liyun
Hi all: I know that some map tasks can be executed parallel, for example, Map1 and Map10 are running together like, so maybe we can not sum the DURATION of every tasks as execution time. 15:07:18,917 INFO [e1890b6a-a9fe-4e0d-8bd7-167603079db1 main] monitoring.RenderStrategy$LogToFileFunction: