Johan Gustavsson created HIVE-24637:
---------------------------------------
Summary: Reduce Tez progress logs
Key: HIVE-24637
URL: https://issues.apache.org/jira/browse/HIVE-24637
Project: Hive
Issue Type: Improvement
Components: Clients
Affects Versions: 3.1.2, 2.4.0, 4.0.0
Reporter: Johan Gustavsson
Assignee: Johan Gustavsson
In case of hive on MR we can configure how often the progress log is updated in
the client side with the parameter
[https://github.com/apache/hive/blob/master/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java#L2041-L2050]
while in case of Hive on Tez this value is hard coded here
[https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/tez/monitoring/RenderStrategy.java#L42].
The default value in Tez is also significantly shorter than that of MR (6 VS 3
S) meaning for longer queries the client log can get very long.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
