> Here Reducers are still running  (marked in red) and DAG finished (marked in 
> green) successfully.    Also I looked at the timestamp of logs  and something 
> weird happening.    

There are 20 second gap which is unexplained for - the status won't print the 
vertex details if the tasks have already finished.

It is entirely possible your Hive client had a GC pause, while the DAG finished 
running without a log update.

09:57 -> 29:38

To verify this, you should enable

set hive.tez.exec.print.summary=true;

So that it prints a log line after the DAG finishes.

Cheers,
Gopal







Reply via email to