[ https://issues.apache.org/jira/browse/HDFS-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
kanaka kumar avvaru updated HDFS-8771: -------------------------------------- Status: Patch Available (was: Open) Attached a patch to handle the {{purgeLogsOlderThan}} calls at {{JournalNode}} in a separate single threaded executor service so that edits are not blocked for the purge log completion. > If IPCLoggerChannel#purgeLogsOlderThan takes too long, Namenode could not > send another RPC calls to Journalnodes > ---------------------------------------------------------------------------------------------------------------- > > Key: HDFS-8771 > URL: https://issues.apache.org/jira/browse/HDFS-8771 > Project: Hadoop HDFS > Issue Type: Bug > Reporter: Takuya Fukudome > Assignee: kanaka kumar avvaru > Attachments: HDFS-8771-01.patch > > > In our cluster, edits has became huge(about 50GB) accidentally and our > Jounalnodes' disks were busy, therefore {{purgeLogsOlderThan}} took more than > 30secs. If {{IPCLoggerChannel#purgeLogsOlderThan}} takes too much time, > Namenode couldn't send other RPC calls to Journalnodes because > {{o.a.h.hdfs.qjournal.client.IPCLoggerChannel}}'s executor is single thread. > It will cause namenode shutting down. > I think IPCLoggerChannel#purgeLogsOlderThan should not block other RPC calls > like sendEdits. -- This message was sent by Atlassian JIRA (v6.3.4#6332)