[ 
https://issues.apache.org/jira/browse/HBASE-7698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13569817#comment-13569817
 ] 

Jimmy Xiang commented on HBASE-7698:
------------------------------------

Ram, should we set transitionToFailedOpen to true inside the 
tryTransitionFromOpeningToFailedOpen method?

I have seen some other errors related to Filesystem being closed while shutdown 
the mini cluster (or some nodes).
Is it possible to make sure Filesystem is not closed before all others are 
closed/shutdown?
                
> race between RS shutdown thread and openregionhandler causes region to get 
> stuck
> --------------------------------------------------------------------------------
>
>                 Key: HBASE-7698
>                 URL: https://issues.apache.org/jira/browse/HBASE-7698
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>         Attachments: HBASE-7698.patch
>
>
> 2013-01-22 17:59:03,237 INFO  [Shutdown of 
> org.apache.hadoop.hbase.fs.HFileSystem@5984cf08] 
> hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(186): Hook closing 
> fs=org.apache.hadoop.hbase.fs.HFileSystem@5984cf08
> ...
> 2013-01-22 17:59:03,411 DEBUG 
> [RS_OPEN_REGION-10.11.2.92,50661,1358906192942-0] regionserver.HRegion(1001): 
> Closing 
> IntegrationTestRebalanceAndKillServersTargeted,66666660,1358906196709.0200b366bc37c5afd1185f7d487c7dfb.:
>  disabling compactions & flushes
> 2013-01-22 17:59:03,411 DEBUG 
> [RS_OPEN_REGION-10.11.2.92,50661,1358906192942-0] regionserver.HRegion(1023): 
> Updates disabled for region 
> IntegrationTestRebalanceAndKillServersTargeted,66666660,1358906196709.0200b366bc37c5afd1185f7d487c7dfb.
> 2013-01-22 17:59:03,415 ERROR 
> [RS_OPEN_REGION-10.11.2.92,50661,1358906192942-0] executor.EventHandler(205): 
> Caught throwable while processing event M_RS_OPEN_REGION
> java.io.IOException: java.io.IOException: java.io.IOException: Filesystem 
> closed
>       at 
> org.apache.hadoop.hbase.regionserver.HRegion.doClose(HRegion.java:1058)
>       at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:974)
>       at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:945)
>       at 
> org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.cleanupFailedOpen(OpenRegionHandler.java:459)
>       at 
> org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:143)
>       at 
> org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:202)
>       at 
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>       at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>       at java.lang.Thread.run(Thread.java:680)
> tryTransitionFromOpeningToFailedOpen or transitionToOpened below is never 
> called and region can get stuck.
> As an added benefit, the meta is already written by that time.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to