[
https://issues.apache.org/jira/browse/HADOOP-2525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12559535#action_12559535
]
stack commented on HADOOP-2525:
-------------------------------
Had same issue on the pset cluster last night:
{code}
2008-01-16 08:28:03,204 INFO org.apache.hadoop.hbase.HMaster: process
shutdown of server XX.XX.XX.116:60020: logSplit: true, rootChecked: false,
rootRescanned: true, numberOfMetaRegions: 1, onlineMetaRegions.size(): 0
2008-01-16 08:28:03,204 INFO org.apache.hadoop.hbase.HMaster: process
shutdown of server 208.76.45..116:60020: logSplit: true, rootChecked: false,
rootRescanned: true, numberOfMetaRegions: 1, onlineMetaRegions.size(): 0
...
{code}
At the same time, all the regionservers are in a loop writing this into their
logs:
{code}
2008-01-16 08:27:45,871 INFO org.apache.hadoop.ipc.RPC: Problem connecting
to server: XX.XX.XX.233:60000
2008-01-16 08:27:48,300 INFO org.apache.hadoop.hbase.HRegionServer: Starting
shutdown thread.
2008-01-16 08:27:48,300 INFO org.apache.hadoop.hbase.HRegionServer: Shutdown
thread complete
2008-01-16 08:27:49,825 DEBUG org.apache.hadoop.hbase.HRegionServer: Telling
master we are up
2008-01-16 08:28:49,868 INFO org.apache.hadoop.ipc.RPC: Problem connecting
to server: XX.XX.XX.233:60000
{code}
> Same 2 lines repeated 11 million times in HMaster log upon HMaster shutdown
> ---------------------------------------------------------------------------
>
> Key: HADOOP-2525
> URL: https://issues.apache.org/jira/browse/HADOOP-2525
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/hbase
> Affects Versions: 0.15.0
> Environment: CentOS 5
> Reporter: Chris Kline
> Assignee: stack
> Priority: Minor
>
> Background: We ran out of disk space on HMaster before this issue occurred.
> The sequence of events were:
> 1. Ran out of disk space
> 2. Freed up 10 GB of disk space
> 3. Shut down HBase
> We had the following 2 lines repeated over 11 million times in the span of 10
> minutes:
> 2007-12-24 08:50:41,851 INFO org.apache.hadoop.hbase.HMaster: process
> shutdown of server 10.100.11.64:60020: logSplit: true, rootChecked: false,
> rootRescanned: false, numberOfMetaRegions: 1, onlineMetaRegions.size(): 0
> 2007-12-24 08:50:43,980 DEBUG org.apache.hadoop.hbase.HMaster: Main
> processing loop: ProcessServerShutdown of 10.100.11.64:60020
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
