[ https://issues.apache.org/jira/browse/HBASE-12791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268802#comment-14268802 ]
Hadoop QA commented on HBASE-12791: ----------------------------------- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12690707/HBASE-12791_v4.patch against master branch at commit 645fbd7d87450b31b67b1e535cdb9c1cf50ffd16. ATTACHMENT ID: 12690707 {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 6 new or modified tests. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:red}-1 checkstyle{color}. The applied patch generated 2085 checkstyle errors (more than the master's current 2084 errors). {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 lineLengths{color}. The patch does not introduce lines longer than 100 {color:green}+1 site{color}. The mvn site goal succeeds with this patch. {color:red}-1 core tests{color}. The patch failed these unit tests: Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/12355//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12355//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12355//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12355//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12355//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12355//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12355//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12355//artifact/patchprocess/newPatchFindbugsWarningshbase-rest.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12355//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12355//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12355//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12355//artifact/patchprocess/newPatchFindbugsWarningshbase-annotations.html Checkstyle Errors: https://builds.apache.org/job/PreCommit-HBASE-Build/12355//artifact/patchprocess/checkstyle-aggregate.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/12355//console This message is automatically generated. > HBase does not attempt to clean up an aborted split when the regionserver > shutting down > --------------------------------------------------------------------------------------- > > Key: HBASE-12791 > URL: https://issues.apache.org/jira/browse/HBASE-12791 > Project: HBase > Issue Type: Bug > Components: regionserver > Affects Versions: 0.98.0 > Reporter: Rajeshbabu Chintaguntla > Assignee: Rajeshbabu Chintaguntla > Priority: Critical > Fix For: 2.0.0, 0.98.10, 1.0.1 > > Attachments: HBASE-12791.patch, HBASE-12791_98.patch, > HBASE-12791_branch1.patch, HBASE-12791_v2.patch, HBASE-12791_v3.patch, > HBASE-12791_v4.patch > > > HBase not cleaning the daughter region directories from HDFS if region > server shut down after creating the daughter region directories during the > split. > Here the logs. > -> RS shutdown after creating the daughter regions. > {code} > 2014-12-31 09:05:41,406 DEBUG [regionserver60020-splits-1419996941385] > zookeeper.ZKAssign: regionserver:60020-0x14a9701e53100d1, > quorum=localhost:2181, baseZNode=/hbase Transitioned node > 80c665138d4fa32da4d792d8ed13206f from RS_ZK_REQUEST_REGION_SPLIT to > RS_ZK_REQUEST_REGION_SPLIT > 2014-12-31 09:05:41,514 DEBUG [regionserver60020-splits-1419996941385] > regionserver.HRegion: Closing > t,,1419996880699.80c665138d4fa32da4d792d8ed13206f.: disabling compactions & > flushes > 2014-12-31 09:05:41,514 DEBUG [regionserver60020-splits-1419996941385] > regionserver.HRegion: Updates disabled for region > t,,1419996880699.80c665138d4fa32da4d792d8ed13206f. > 2014-12-31 09:05:41,516 INFO > [StoreCloserThread-t,,1419996880699.80c665138d4fa32da4d792d8ed13206f.-1] > regionserver.HStore: Closed f > 2014-12-31 09:05:41,518 INFO [regionserver60020-splits-1419996941385] > regionserver.HRegion: Closed > t,,1419996880699.80c665138d4fa32da4d792d8ed13206f. > 2014-12-31 09:05:49,922 DEBUG [regionserver60020-splits-1419996941385] > regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl > for table t dd9731ee43b104da565257ca1539aa8c > 2014-12-31 09:05:49,922 DEBUG [regionserver60020-splits-1419996941385] > regionserver.HRegion: Instantiated > t,,1419996941401.dd9731ee43b104da565257ca1539aa8c. > 2014-12-31 09:05:49,929 DEBUG [regionserver60020-splits-1419996941385] > regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl > for table t 2e40a44511c0e187d357d651f13a1dab > 2014-12-31 09:05:49,929 DEBUG [regionserver60020-splits-1419996941385] > regionserver.HRegion: Instantiated > t,row2,1419996941401.2e40a44511c0e187d357d651f13a1dab. > Wed Dec 31 09:06:30 IST 2014 Terminating regionserver > 2014-12-31 09:06:30,465 INFO [Thread-8] regionserver.ShutdownHook: Shutdown > hook starting; hbase.shutdown.hook=true; > fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@42d2282e > {code} > -> Skipping rollback if RS stopped or stopping so we end up in dirty daughter > regions in HDFS. > {code} > 2014-12-31 09:07:49,547 INFO [regionserver60020-splits-1419996941385] > regionserver.SplitRequest: Skip rollback/cleanup of failed split of > t,,1419996880699.80c665138d4fa32da4d792d8ed13206f. because server is stopped > java.io.InterruptedIOException: Interrupted after 0 tries on 350 > at > org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:156) > {code} > Because of this hbck always showing inconsistencies. > {code} > ERROR: Region { meta => null, hdfs => > hdfs://localhost:9000/hbase/data/default/t/2e40a44511c0e187d357d651f13a1dab, > deployed => } on HDFS, but not listed in hbase:meta or deployed on any > region server > ERROR: Region { meta => null, hdfs => > hdfs://localhost:9000/hbase/data/default/t/dd9731ee43b104da565257ca1539aa8c, > deployed => } on HDFS, but not listed in hbase:meta or deployed on any > region server > {code} > If we try to repair then we end up in overlap regions in hbase:meta. and both > daughter regions and parent are online. -- This message was sent by Atlassian JIRA (v6.3.4#6332)