[
https://issues.apache.org/jira/browse/HBASE-8889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13865688#comment-13865688
]
Andrew Purtell commented on HBASE-8889:
---------------------------------------
The code may be incorrect as indicated, but isn't there a larger issue also?
Above, a file under compaction has a missing block. Blocks don't normally go
missing in the test, so missing blocks suggest file deletion. And further above
there is a warning about a missing file in another case. Might want to
investigate why/how files can be pulled out from underneath compaction.
> TestIOFencing#testFencingAroundCompaction occasionally fails
> ------------------------------------------------------------
>
> Key: HBASE-8889
> URL: https://issues.apache.org/jira/browse/HBASE-8889
> Project: HBase
> Issue Type: Test
> Reporter: Ted Yu
> Priority: Minor
> Attachments: TestIOFencing.tar.gz
>
>
> From
> https://builds.apache.org/job/PreCommit-HBASE-Build/6232//testReport/org.apache.hadoop.hbase/TestIOFencing/testFencingAroundCompaction/
> :
> {code}
> java.lang.AssertionError: Timed out waiting for new server to open region
> at org.junit.Assert.fail(Assert.java:88)
> at org.junit.Assert.assertTrue(Assert.java:41)
> at org.apache.hadoop.hbase.TestIOFencing.doTest(TestIOFencing.java:269)
> at
> org.apache.hadoop.hbase.TestIOFencing.testFencingAroundCompaction(TestIOFencing.java:205)
> {code}
> {code}
> 2013-07-06 23:13:53,120 INFO [pool-1-thread-1] hbase.TestIOFencing(266):
> Waiting for the new server to pick up the region
> tabletest,,1373152125442.6e62d3b24ea23160931362b60359ff03.
> 2013-07-06 23:13:54,120 INFO [pool-1-thread-1] hbase.TestIOFencing(266):
> Waiting for the new server to pick up the region
> tabletest,,1373152125442.6e62d3b24ea23160931362b60359ff03.
> 2013-07-06 23:13:55,121 DEBUG [pool-1-thread-1]
> hbase.TestIOFencing$CompactionBlockerRegion(102): allowing compactions
> 2013-07-06 23:13:55,121 INFO [pool-1-thread-1]
> hbase.HBaseTestingUtility(911): Shutting down minicluster
> 2013-07-06 23:13:55,121 DEBUG [pool-1-thread-1] util.JVMClusterUtil(237):
> Shutting down HBase Cluster
> 2013-07-06 23:13:55,121 INFO
> [RS:0;asf002:39065-smallCompactions-1373152134716] regionserver.HStore(951):
> Starting compaction of 2 file(s) in family of
> tabletest,,1373152125442.6e62d3b24ea23160931362b60359ff03. into
> tmpdir=hdfs://localhost:50140/user/jenkins/hbase/tabletest/6e62d3b24ea23160931362b60359ff03/.tmp,
> totalSize=108.4k
> ...
> 2013-07-06 23:13:55,155 INFO [RS:0;asf002:39065]
> regionserver.HRegionServer(2476): Received CLOSE for the region:
> 6e62d3b24ea23160931362b60359ff03 ,which we are already trying to CLOSE
> 2013-07-06 23:13:55,157 WARN [RS:0;asf002:39065]
> regionserver.HRegionServer(2414): Failed to close
> tabletest,,1373152125442.6e62d3b24ea23160931362b60359ff03. - ignoring and
> continuing
> org.apache.hadoop.hbase.exceptions.NotServingRegionException: The region
> 6e62d3b24ea23160931362b60359ff03 was already closing. New CLOSE request is
> ignored.
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.closeRegion(HRegionServer.java:2479)
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.closeRegionIgnoreErrors(HRegionServer.java:2409)
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.closeUserRegions(HRegionServer.java:2011)
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:903)
> at
> org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.runRegionServer(MiniHBaseCluster.java:158)
> at
> org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.access$000(MiniHBaseCluster.java:110)
> at
> org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer$1.run(MiniHBaseCluster.java:142)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:337)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1131)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.util.Methods.call(Methods.java:41)
> at org.apache.hadoop.hbase.security.User.call(User.java:420)
> at org.apache.hadoop.hbase.security.User.access$300(User.java:51)
> at
> org.apache.hadoop.hbase.security.User$SecureHadoopUser.runAs(User.java:260)
> at
> org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.run(MiniHBaseCluster.java:140)
> {code}
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
