Kihwal Lee created HDFS-5070:
--------------------------------

             Summary: Do not initialize the replications queues in the middle 
of block report processing
                 Key: HDFS-5070
                 URL: https://issues.apache.org/jira/browse/HDFS-5070
             Project: Hadoop HDFS
          Issue Type: Bug
          Components: namenode
    Affects Versions: 0.23.9, 2.1.0-beta
            Reporter: Kihwal Lee


While processing an initial block report in the start-up safe mode, namenode 
can reach the safe block threshold in the middle of processing the report. This 
is noticed when checkMode() is called and it causes the replication queues to 
be initialized. 

The safe mode monitor will try to check and leave the safe mode, but can be far 
behind the write lock, if the initialization takes long (e.g. large number of 
blocks) and more block reports come in and get queued before it.  In this state 
(replication queue initialized but still in startup safe mode), block report 
processing can take a long time. In one instance, 4 block report processing 
took 13 minutes.



--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to