[ https://issues.apache.org/jira/browse/HIVE-22409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961733#comment-16961733 ]
Syed Shameerur Rahman edited comment on HIVE-22409 at 10/29/19 7:03 AM: ------------------------------------------------------------------------ Yes, Large number of open file could be a problem. Routing appender PurgePolicy can handle that to an extend. was (Author: srahman): Yes, Large number of open file could be a problem. Routing appender PurgePolicy can solve that to an extend. > Logging: Implement QueryID Based Hive Logging > --------------------------------------------- > > Key: HIVE-22409 > URL: https://issues.apache.org/jira/browse/HIVE-22409 > Project: Hive > Issue Type: Improvement > Components: Logging > Reporter: Syed Shameerur Rahman > Assignee: Syed Shameerur Rahman > Priority: Minor > > Currently all the hive logs are logged in > ${sys:hive.log.dir}/${sys:hive.log.file} which is basically a single log > file. Over the time it becomes tedious to search for logs since multiple hive > query logs are logged into single log file. > Hence we propose a queryID based hive logging where logs of different queries > are logged into a separate log file based on their queryID. > CC [~prasanth_j] [~gopalv] [~sseth] -- This message was sent by Atlassian Jira (v8.3.4#803005)