[
https://issues.apache.org/jira/browse/HIVE-16109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15895427#comment-15895427
]
Vihang Karajgaonkar edited comment on HIVE-16109 at 3/4/17 2:23 AM:
--------------------------------------------------------------------
Attaching the patch to fix the test. We don't really need to change the debug
message in TxnHandler to log lockInfo to trace. Currently the log file
generated is 80 MB and the runtime of the test is ~110 sec. Both the disk space
and runtime are reasonable.
was (Author: vihangk1):
Attaching the patch to fix the test. We don't really need to change the debug
message in TxnManager to log lockInfo to trace. Currently the log file
generated is 80 MB and the runtime of the test is ~110 sec. Both the disk space
and runtime are reasonable.
> TestDbTxnManager generates a huge hive.log
> ------------------------------------------
>
> Key: HIVE-16109
> URL: https://issues.apache.org/jira/browse/HIVE-16109
> Project: Hive
> Issue Type: Bug
> Reporter: Vihang Karajgaonkar
> Assignee: Vihang Karajgaonkar
> Attachments: HIVE-16109.01.patch
>
>
> Pre-commit jobs are failing currently due to out of disk space. The issue is
> happening due to huge size of hive.log when TestDbTxnManager test fails or
> times-out. When this test fails or times-out Ptest tries to persist these
> logs for debugging. Since this test has been timing out frequently, this
> accumulates a lot of these log files and eventually Ptest server runs of disk
> space. Each run of TestDbTxnManager is generating ~30 GB of hive.log. I tried
> to run it locally and it quickly reached 7 GB until I had to cancel it.
> The issue seems to be coming from this code block in TxnHandler.java
> {noformat}
> if(LOG.isDebugEnabled()) {
> LOG.debug("Locks to check(full): ");
> for(LockInfo info : locks) {
> LOG.debug(" " + info);
> }
> }
> {noformat}
> We should either change it trace or change the log mode of this test to INFO
> so that it generates smaller log files.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
