[jira] [Commented] (HBASE-10349) Table became unusable when master balanced its region after table was dropped
[ https://issues.apache.org/jira/browse/HBASE-10349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13875787#comment-13875787 ] Hudson commented on HBASE-10349: SUCCESS: Integrated in HBase-TRUNK-on-Hadoop-1.1 #58 (See [https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-1.1/58/]) HBASE-10349 Table became unusable when master balanced its region after table was dropped (jxiang: rev 1559311) * /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java * /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/master/RegionStates.java * /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/DeleteTableHandler.java * /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestAssignmentManager.java * /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestAssignmentManagerOnCluster.java > Table became unusable when master balanced its region after table was dropped > - > > Key: HBASE-10349 > URL: https://issues.apache.org/jira/browse/HBASE-10349 > Project: HBase > Issue Type: Bug >Affects Versions: 0.98.0 >Reporter: Ted Yu >Assignee: Jimmy Xiang > Fix For: 0.98.0, 0.96.2, 0.99.0 > > Attachments: > 10349-hadoop-hdfs-namenode-hor11n14.gq1.ygridcore.net.zip, 10349-output.log, > 10349-v1.txt, 10349-v2.txt, HBASE-10349-meta-test-and-debug.patch, > hbase-10349.patch, hbase-10349_v2.patch, > hbase-hbase-master-hor15n05.gq1.ygridcore.net.log.tar.gz > > > 0.98 was used. > This was sequence of events: > create 'tablethree_mod' > snapshot 'tablethree_mod', 'snapshot_tablethree_mod' > disable 'tablethree_mod' > 2014-01-15 09:34:51,749 restore_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:35:07,210 enable 'tablethree_mod' > 2014-01-15 09:35:46,134 delete_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:41:42,210 disable 'tablethree_mod' > 2014-01-15 09:41:43,610 drop 'tablethree_mod' > create 'tablethree_mod' > For the last table creation request: > {code} > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'create 'tablethree_mod', > {NAME => 'f1', VERSIONS => 3} > , > {NAME => 'f2', VERSIONS => 3} > , > {NAME => 'f3', VERSIONS => 3} > ' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'exists 'tablethree_mod'' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '0', 'f1:q1', 'value-0', 10' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '1', 'f1:q1', 'value-1', 20' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '2', 'f2:q2', 'value-2', 30' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '3', 'f3:q3', 'value-3', 40' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '4', 'f3:q3', 'value-4', 50' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO|Done writing commands to > file. Will execute them now. > 2014-01-15 10:03:53,000|beaver.machine|INFO|RUNNING: /usr/lib/hbase/bin/hbase > shell /grid/0/tmp/hwqe/artifacts/tmp-471142 > 2014-01-15 10:03:55,878|beaver.machine|INFO|2014-01-15 10:03:55,878 INFO > [main] Configuration.deprecation: hadoop.native.lib is deprecated. Instead, > use io.native.lib.available > 2014-01-15 10:03:57,283|beaver.machine|INFO|2014-01-15 10:03:57,283 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,669|beaver.machine|INFO|2014-01-15 10:03:57,669 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,720|beaver.machine|INFO|2014-01-15 10:03:57,720 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,997|beaver.machine|INFO| > 2014-01-15 10:03:57,997|beaver.machine|INFO|ERROR: Table already exists: > tablethree_mod! > 2014-01-15 10:03:57,997|beaver.machine|INFO| > {code} > This was an intermittent issue after using Snapshots, a table is not properly > dropped / and not able to properly re-create with the same name. And a > HRegion is empty or null Error occurs. (When you try to drop the table it > says it does not exist, and when you try to create the table it says that it > does already exist). > {code} > 2014-01-15 10:04:02,462|beaver.machine|INFO|ERROR: HRegionInfo was null or > empty in hbase:meta, row=keyvalues= > {tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:seqnumDuringOpen/1389778905355/Put/vlen=8/mvcc=0, > > tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:server/1389778905355/Put/vlen=32/mvcc=0, > > tablethree_mo
[jira] [Commented] (HBASE-10349) Table became unusable when master balanced its region after table was dropped
[ https://issues.apache.org/jira/browse/HBASE-10349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13875638#comment-13875638 ] Hudson commented on HBASE-10349: FAILURE: Integrated in hbase-0.96-hadoop2 #179 (See [https://builds.apache.org/job/hbase-0.96-hadoop2/179/]) HBASE-10349 Table became unusable when master balanced its region after table was dropped (jxiang: rev 1559313) * /hbase/branches/0.96/hbase-server/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java * /hbase/branches/0.96/hbase-server/src/main/java/org/apache/hadoop/hbase/master/RegionStates.java * /hbase/branches/0.96/hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/DeleteTableHandler.java * /hbase/branches/0.96/hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestAssignmentManager.java * /hbase/branches/0.96/hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestAssignmentManagerOnCluster.java > Table became unusable when master balanced its region after table was dropped > - > > Key: HBASE-10349 > URL: https://issues.apache.org/jira/browse/HBASE-10349 > Project: HBase > Issue Type: Bug >Affects Versions: 0.98.0 >Reporter: Ted Yu >Assignee: Jimmy Xiang > Fix For: 0.98.0, 0.96.2, 0.99.0 > > Attachments: > 10349-hadoop-hdfs-namenode-hor11n14.gq1.ygridcore.net.zip, 10349-output.log, > 10349-v1.txt, 10349-v2.txt, HBASE-10349-meta-test-and-debug.patch, > hbase-10349.patch, hbase-10349_v2.patch, > hbase-hbase-master-hor15n05.gq1.ygridcore.net.log.tar.gz > > > 0.98 was used. > This was sequence of events: > create 'tablethree_mod' > snapshot 'tablethree_mod', 'snapshot_tablethree_mod' > disable 'tablethree_mod' > 2014-01-15 09:34:51,749 restore_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:35:07,210 enable 'tablethree_mod' > 2014-01-15 09:35:46,134 delete_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:41:42,210 disable 'tablethree_mod' > 2014-01-15 09:41:43,610 drop 'tablethree_mod' > create 'tablethree_mod' > For the last table creation request: > {code} > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'create 'tablethree_mod', > {NAME => 'f1', VERSIONS => 3} > , > {NAME => 'f2', VERSIONS => 3} > , > {NAME => 'f3', VERSIONS => 3} > ' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'exists 'tablethree_mod'' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '0', 'f1:q1', 'value-0', 10' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '1', 'f1:q1', 'value-1', 20' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '2', 'f2:q2', 'value-2', 30' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '3', 'f3:q3', 'value-3', 40' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '4', 'f3:q3', 'value-4', 50' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO|Done writing commands to > file. Will execute them now. > 2014-01-15 10:03:53,000|beaver.machine|INFO|RUNNING: /usr/lib/hbase/bin/hbase > shell /grid/0/tmp/hwqe/artifacts/tmp-471142 > 2014-01-15 10:03:55,878|beaver.machine|INFO|2014-01-15 10:03:55,878 INFO > [main] Configuration.deprecation: hadoop.native.lib is deprecated. Instead, > use io.native.lib.available > 2014-01-15 10:03:57,283|beaver.machine|INFO|2014-01-15 10:03:57,283 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,669|beaver.machine|INFO|2014-01-15 10:03:57,669 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,720|beaver.machine|INFO|2014-01-15 10:03:57,720 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,997|beaver.machine|INFO| > 2014-01-15 10:03:57,997|beaver.machine|INFO|ERROR: Table already exists: > tablethree_mod! > 2014-01-15 10:03:57,997|beaver.machine|INFO| > {code} > This was an intermittent issue after using Snapshots, a table is not properly > dropped / and not able to properly re-create with the same name. And a > HRegion is empty or null Error occurs. (When you try to drop the table it > says it does not exist, and when you try to create the table it says that it > does already exist). > {code} > 2014-01-15 10:04:02,462|beaver.machine|INFO|ERROR: HRegionInfo was null or > empty in hbase:meta, row=keyvalues= > {tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:seqnumDuringOpen/1389778905355/Put/vlen=8/mvcc=0, > > tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:server/1389778905355/Put/vlen=32
[jira] [Commented] (HBASE-10349) Table became unusable when master balanced its region after table was dropped
[ https://issues.apache.org/jira/browse/HBASE-10349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13875577#comment-13875577 ] Hudson commented on HBASE-10349: FAILURE: Integrated in HBase-0.98-on-Hadoop-1.1 #85 (See [https://builds.apache.org/job/HBase-0.98-on-Hadoop-1.1/85/]) HBASE-10349 Table became unusable when master balanced its region after table was dropped (jxiang: rev 1559312) * /hbase/branches/0.98/hbase-server/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java * /hbase/branches/0.98/hbase-server/src/main/java/org/apache/hadoop/hbase/master/RegionStates.java * /hbase/branches/0.98/hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/DeleteTableHandler.java * /hbase/branches/0.98/hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestAssignmentManager.java * /hbase/branches/0.98/hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestAssignmentManagerOnCluster.java > Table became unusable when master balanced its region after table was dropped > - > > Key: HBASE-10349 > URL: https://issues.apache.org/jira/browse/HBASE-10349 > Project: HBase > Issue Type: Bug >Affects Versions: 0.98.0 >Reporter: Ted Yu >Assignee: Jimmy Xiang > Fix For: 0.98.0, 0.96.2, 0.99.0 > > Attachments: > 10349-hadoop-hdfs-namenode-hor11n14.gq1.ygridcore.net.zip, 10349-output.log, > 10349-v1.txt, 10349-v2.txt, HBASE-10349-meta-test-and-debug.patch, > hbase-10349.patch, hbase-10349_v2.patch, > hbase-hbase-master-hor15n05.gq1.ygridcore.net.log.tar.gz > > > 0.98 was used. > This was sequence of events: > create 'tablethree_mod' > snapshot 'tablethree_mod', 'snapshot_tablethree_mod' > disable 'tablethree_mod' > 2014-01-15 09:34:51,749 restore_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:35:07,210 enable 'tablethree_mod' > 2014-01-15 09:35:46,134 delete_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:41:42,210 disable 'tablethree_mod' > 2014-01-15 09:41:43,610 drop 'tablethree_mod' > create 'tablethree_mod' > For the last table creation request: > {code} > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'create 'tablethree_mod', > {NAME => 'f1', VERSIONS => 3} > , > {NAME => 'f2', VERSIONS => 3} > , > {NAME => 'f3', VERSIONS => 3} > ' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'exists 'tablethree_mod'' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '0', 'f1:q1', 'value-0', 10' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '1', 'f1:q1', 'value-1', 20' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '2', 'f2:q2', 'value-2', 30' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '3', 'f3:q3', 'value-3', 40' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '4', 'f3:q3', 'value-4', 50' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO|Done writing commands to > file. Will execute them now. > 2014-01-15 10:03:53,000|beaver.machine|INFO|RUNNING: /usr/lib/hbase/bin/hbase > shell /grid/0/tmp/hwqe/artifacts/tmp-471142 > 2014-01-15 10:03:55,878|beaver.machine|INFO|2014-01-15 10:03:55,878 INFO > [main] Configuration.deprecation: hadoop.native.lib is deprecated. Instead, > use io.native.lib.available > 2014-01-15 10:03:57,283|beaver.machine|INFO|2014-01-15 10:03:57,283 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,669|beaver.machine|INFO|2014-01-15 10:03:57,669 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,720|beaver.machine|INFO|2014-01-15 10:03:57,720 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,997|beaver.machine|INFO| > 2014-01-15 10:03:57,997|beaver.machine|INFO|ERROR: Table already exists: > tablethree_mod! > 2014-01-15 10:03:57,997|beaver.machine|INFO| > {code} > This was an intermittent issue after using Snapshots, a table is not properly > dropped / and not able to properly re-create with the same name. And a > HRegion is empty or null Error occurs. (When you try to drop the table it > says it does not exist, and when you try to create the table it says that it > does already exist). > {code} > 2014-01-15 10:04:02,462|beaver.machine|INFO|ERROR: HRegionInfo was null or > empty in hbase:meta, row=keyvalues= > {tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:seqnumDuringOpen/1389778905355/Put/vlen=8/mvcc=0, > > tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:server/1389778905355/P
[jira] [Commented] (HBASE-10349) Table became unusable when master balanced its region after table was dropped
[ https://issues.apache.org/jira/browse/HBASE-10349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13875566#comment-13875566 ] Hudson commented on HBASE-10349: FAILURE: Integrated in HBase-TRUNK #4834 (See [https://builds.apache.org/job/HBase-TRUNK/4834/]) HBASE-10349 Table became unusable when master balanced its region after table was dropped (jxiang: rev 1559311) * /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java * /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/master/RegionStates.java * /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/DeleteTableHandler.java * /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestAssignmentManager.java * /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestAssignmentManagerOnCluster.java > Table became unusable when master balanced its region after table was dropped > - > > Key: HBASE-10349 > URL: https://issues.apache.org/jira/browse/HBASE-10349 > Project: HBase > Issue Type: Bug >Affects Versions: 0.98.0 >Reporter: Ted Yu >Assignee: Jimmy Xiang > Fix For: 0.98.0, 0.96.2, 0.99.0 > > Attachments: > 10349-hadoop-hdfs-namenode-hor11n14.gq1.ygridcore.net.zip, 10349-output.log, > 10349-v1.txt, 10349-v2.txt, HBASE-10349-meta-test-and-debug.patch, > hbase-10349.patch, hbase-10349_v2.patch, > hbase-hbase-master-hor15n05.gq1.ygridcore.net.log.tar.gz > > > 0.98 was used. > This was sequence of events: > create 'tablethree_mod' > snapshot 'tablethree_mod', 'snapshot_tablethree_mod' > disable 'tablethree_mod' > 2014-01-15 09:34:51,749 restore_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:35:07,210 enable 'tablethree_mod' > 2014-01-15 09:35:46,134 delete_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:41:42,210 disable 'tablethree_mod' > 2014-01-15 09:41:43,610 drop 'tablethree_mod' > create 'tablethree_mod' > For the last table creation request: > {code} > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'create 'tablethree_mod', > {NAME => 'f1', VERSIONS => 3} > , > {NAME => 'f2', VERSIONS => 3} > , > {NAME => 'f3', VERSIONS => 3} > ' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'exists 'tablethree_mod'' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '0', 'f1:q1', 'value-0', 10' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '1', 'f1:q1', 'value-1', 20' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '2', 'f2:q2', 'value-2', 30' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '3', 'f3:q3', 'value-3', 40' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '4', 'f3:q3', 'value-4', 50' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO|Done writing commands to > file. Will execute them now. > 2014-01-15 10:03:53,000|beaver.machine|INFO|RUNNING: /usr/lib/hbase/bin/hbase > shell /grid/0/tmp/hwqe/artifacts/tmp-471142 > 2014-01-15 10:03:55,878|beaver.machine|INFO|2014-01-15 10:03:55,878 INFO > [main] Configuration.deprecation: hadoop.native.lib is deprecated. Instead, > use io.native.lib.available > 2014-01-15 10:03:57,283|beaver.machine|INFO|2014-01-15 10:03:57,283 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,669|beaver.machine|INFO|2014-01-15 10:03:57,669 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,720|beaver.machine|INFO|2014-01-15 10:03:57,720 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,997|beaver.machine|INFO| > 2014-01-15 10:03:57,997|beaver.machine|INFO|ERROR: Table already exists: > tablethree_mod! > 2014-01-15 10:03:57,997|beaver.machine|INFO| > {code} > This was an intermittent issue after using Snapshots, a table is not properly > dropped / and not able to properly re-create with the same name. And a > HRegion is empty or null Error occurs. (When you try to drop the table it > says it does not exist, and when you try to create the table it says that it > does already exist). > {code} > 2014-01-15 10:04:02,462|beaver.machine|INFO|ERROR: HRegionInfo was null or > empty in hbase:meta, row=keyvalues= > {tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:seqnumDuringOpen/1389778905355/Put/vlen=8/mvcc=0, > > tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:server/1389778905355/Put/vlen=32/mvcc=0, > > tablethree_mod,,1389778226606.afc82d1
[jira] [Commented] (HBASE-10349) Table became unusable when master balanced its region after table was dropped
[ https://issues.apache.org/jira/browse/HBASE-10349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13875560#comment-13875560 ] Hudson commented on HBASE-10349: FAILURE: Integrated in hbase-0.96 #262 (See [https://builds.apache.org/job/hbase-0.96/262/]) HBASE-10349 Table became unusable when master balanced its region after table was dropped (jxiang: rev 1559313) * /hbase/branches/0.96/hbase-server/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java * /hbase/branches/0.96/hbase-server/src/main/java/org/apache/hadoop/hbase/master/RegionStates.java * /hbase/branches/0.96/hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/DeleteTableHandler.java * /hbase/branches/0.96/hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestAssignmentManager.java * /hbase/branches/0.96/hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestAssignmentManagerOnCluster.java > Table became unusable when master balanced its region after table was dropped > - > > Key: HBASE-10349 > URL: https://issues.apache.org/jira/browse/HBASE-10349 > Project: HBase > Issue Type: Bug >Affects Versions: 0.98.0 >Reporter: Ted Yu >Assignee: Jimmy Xiang > Fix For: 0.98.0, 0.96.2, 0.99.0 > > Attachments: > 10349-hadoop-hdfs-namenode-hor11n14.gq1.ygridcore.net.zip, 10349-output.log, > 10349-v1.txt, 10349-v2.txt, HBASE-10349-meta-test-and-debug.patch, > hbase-10349.patch, hbase-10349_v2.patch, > hbase-hbase-master-hor15n05.gq1.ygridcore.net.log.tar.gz > > > 0.98 was used. > This was sequence of events: > create 'tablethree_mod' > snapshot 'tablethree_mod', 'snapshot_tablethree_mod' > disable 'tablethree_mod' > 2014-01-15 09:34:51,749 restore_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:35:07,210 enable 'tablethree_mod' > 2014-01-15 09:35:46,134 delete_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:41:42,210 disable 'tablethree_mod' > 2014-01-15 09:41:43,610 drop 'tablethree_mod' > create 'tablethree_mod' > For the last table creation request: > {code} > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'create 'tablethree_mod', > {NAME => 'f1', VERSIONS => 3} > , > {NAME => 'f2', VERSIONS => 3} > , > {NAME => 'f3', VERSIONS => 3} > ' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'exists 'tablethree_mod'' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '0', 'f1:q1', 'value-0', 10' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '1', 'f1:q1', 'value-1', 20' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '2', 'f2:q2', 'value-2', 30' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '3', 'f3:q3', 'value-3', 40' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '4', 'f3:q3', 'value-4', 50' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO|Done writing commands to > file. Will execute them now. > 2014-01-15 10:03:53,000|beaver.machine|INFO|RUNNING: /usr/lib/hbase/bin/hbase > shell /grid/0/tmp/hwqe/artifacts/tmp-471142 > 2014-01-15 10:03:55,878|beaver.machine|INFO|2014-01-15 10:03:55,878 INFO > [main] Configuration.deprecation: hadoop.native.lib is deprecated. Instead, > use io.native.lib.available > 2014-01-15 10:03:57,283|beaver.machine|INFO|2014-01-15 10:03:57,283 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,669|beaver.machine|INFO|2014-01-15 10:03:57,669 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,720|beaver.machine|INFO|2014-01-15 10:03:57,720 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,997|beaver.machine|INFO| > 2014-01-15 10:03:57,997|beaver.machine|INFO|ERROR: Table already exists: > tablethree_mod! > 2014-01-15 10:03:57,997|beaver.machine|INFO| > {code} > This was an intermittent issue after using Snapshots, a table is not properly > dropped / and not able to properly re-create with the same name. And a > HRegion is empty or null Error occurs. (When you try to drop the table it > says it does not exist, and when you try to create the table it says that it > does already exist). > {code} > 2014-01-15 10:04:02,462|beaver.machine|INFO|ERROR: HRegionInfo was null or > empty in hbase:meta, row=keyvalues= > {tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:seqnumDuringOpen/1389778905355/Put/vlen=8/mvcc=0, > > tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:server/1389778905355/Put/vlen=32/mvcc=0, > > t
[jira] [Commented] (HBASE-10349) Table became unusable when master balanced its region after table was dropped
[ https://issues.apache.org/jira/browse/HBASE-10349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13875546#comment-13875546 ] Hudson commented on HBASE-10349: SUCCESS: Integrated in HBase-0.98 #94 (See [https://builds.apache.org/job/HBase-0.98/94/]) HBASE-10349 Table became unusable when master balanced its region after table was dropped (jxiang: rev 1559312) * /hbase/branches/0.98/hbase-server/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java * /hbase/branches/0.98/hbase-server/src/main/java/org/apache/hadoop/hbase/master/RegionStates.java * /hbase/branches/0.98/hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/DeleteTableHandler.java * /hbase/branches/0.98/hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestAssignmentManager.java * /hbase/branches/0.98/hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestAssignmentManagerOnCluster.java > Table became unusable when master balanced its region after table was dropped > - > > Key: HBASE-10349 > URL: https://issues.apache.org/jira/browse/HBASE-10349 > Project: HBase > Issue Type: Bug >Affects Versions: 0.98.0 >Reporter: Ted Yu >Assignee: Jimmy Xiang > Fix For: 0.98.0, 0.96.2, 0.99.0 > > Attachments: > 10349-hadoop-hdfs-namenode-hor11n14.gq1.ygridcore.net.zip, 10349-output.log, > 10349-v1.txt, 10349-v2.txt, HBASE-10349-meta-test-and-debug.patch, > hbase-10349.patch, hbase-10349_v2.patch, > hbase-hbase-master-hor15n05.gq1.ygridcore.net.log.tar.gz > > > 0.98 was used. > This was sequence of events: > create 'tablethree_mod' > snapshot 'tablethree_mod', 'snapshot_tablethree_mod' > disable 'tablethree_mod' > 2014-01-15 09:34:51,749 restore_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:35:07,210 enable 'tablethree_mod' > 2014-01-15 09:35:46,134 delete_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:41:42,210 disable 'tablethree_mod' > 2014-01-15 09:41:43,610 drop 'tablethree_mod' > create 'tablethree_mod' > For the last table creation request: > {code} > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'create 'tablethree_mod', > {NAME => 'f1', VERSIONS => 3} > , > {NAME => 'f2', VERSIONS => 3} > , > {NAME => 'f3', VERSIONS => 3} > ' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'exists 'tablethree_mod'' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '0', 'f1:q1', 'value-0', 10' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '1', 'f1:q1', 'value-1', 20' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '2', 'f2:q2', 'value-2', 30' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '3', 'f3:q3', 'value-3', 40' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '4', 'f3:q3', 'value-4', 50' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO|Done writing commands to > file. Will execute them now. > 2014-01-15 10:03:53,000|beaver.machine|INFO|RUNNING: /usr/lib/hbase/bin/hbase > shell /grid/0/tmp/hwqe/artifacts/tmp-471142 > 2014-01-15 10:03:55,878|beaver.machine|INFO|2014-01-15 10:03:55,878 INFO > [main] Configuration.deprecation: hadoop.native.lib is deprecated. Instead, > use io.native.lib.available > 2014-01-15 10:03:57,283|beaver.machine|INFO|2014-01-15 10:03:57,283 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,669|beaver.machine|INFO|2014-01-15 10:03:57,669 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,720|beaver.machine|INFO|2014-01-15 10:03:57,720 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,997|beaver.machine|INFO| > 2014-01-15 10:03:57,997|beaver.machine|INFO|ERROR: Table already exists: > tablethree_mod! > 2014-01-15 10:03:57,997|beaver.machine|INFO| > {code} > This was an intermittent issue after using Snapshots, a table is not properly > dropped / and not able to properly re-create with the same name. And a > HRegion is empty or null Error occurs. (When you try to drop the table it > says it does not exist, and when you try to create the table it says that it > does already exist). > {code} > 2014-01-15 10:04:02,462|beaver.machine|INFO|ERROR: HRegionInfo was null or > empty in hbase:meta, row=keyvalues= > {tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:seqnumDuringOpen/1389778905355/Put/vlen=8/mvcc=0, > > tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:server/1389778905355/Put/vlen=32/mvcc=0, > > tab
[jira] [Commented] (HBASE-10349) Table became unusable when master balanced its region after table was dropped
[ https://issues.apache.org/jira/browse/HBASE-10349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13875247#comment-13875247 ] Ted Yu commented on HBASE-10349: +1 on patch v2. New tests are good. > Table became unusable when master balanced its region after table was dropped > - > > Key: HBASE-10349 > URL: https://issues.apache.org/jira/browse/HBASE-10349 > Project: HBase > Issue Type: Bug >Affects Versions: 0.98.0 >Reporter: Ted Yu >Assignee: Jimmy Xiang > Fix For: 0.98.0, 0.99.0 > > Attachments: > 10349-hadoop-hdfs-namenode-hor11n14.gq1.ygridcore.net.zip, 10349-output.log, > 10349-v1.txt, 10349-v2.txt, HBASE-10349-meta-test-and-debug.patch, > hbase-10349.patch, hbase-10349_v2.patch, > hbase-hbase-master-hor15n05.gq1.ygridcore.net.log.tar.gz > > > 0.98 was used. > This was sequence of events: > create 'tablethree_mod' > snapshot 'tablethree_mod', 'snapshot_tablethree_mod' > disable 'tablethree_mod' > 2014-01-15 09:34:51,749 restore_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:35:07,210 enable 'tablethree_mod' > 2014-01-15 09:35:46,134 delete_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:41:42,210 disable 'tablethree_mod' > 2014-01-15 09:41:43,610 drop 'tablethree_mod' > create 'tablethree_mod' > For the last table creation request: > {code} > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'create 'tablethree_mod', > {NAME => 'f1', VERSIONS => 3} > , > {NAME => 'f2', VERSIONS => 3} > , > {NAME => 'f3', VERSIONS => 3} > ' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'exists 'tablethree_mod'' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '0', 'f1:q1', 'value-0', 10' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '1', 'f1:q1', 'value-1', 20' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '2', 'f2:q2', 'value-2', 30' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '3', 'f3:q3', 'value-3', 40' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '4', 'f3:q3', 'value-4', 50' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO|Done writing commands to > file. Will execute them now. > 2014-01-15 10:03:53,000|beaver.machine|INFO|RUNNING: /usr/lib/hbase/bin/hbase > shell /grid/0/tmp/hwqe/artifacts/tmp-471142 > 2014-01-15 10:03:55,878|beaver.machine|INFO|2014-01-15 10:03:55,878 INFO > [main] Configuration.deprecation: hadoop.native.lib is deprecated. Instead, > use io.native.lib.available > 2014-01-15 10:03:57,283|beaver.machine|INFO|2014-01-15 10:03:57,283 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,669|beaver.machine|INFO|2014-01-15 10:03:57,669 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,720|beaver.machine|INFO|2014-01-15 10:03:57,720 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,997|beaver.machine|INFO| > 2014-01-15 10:03:57,997|beaver.machine|INFO|ERROR: Table already exists: > tablethree_mod! > 2014-01-15 10:03:57,997|beaver.machine|INFO| > {code} > This was an intermittent issue after using Snapshots, a table is not properly > dropped / and not able to properly re-create with the same name. And a > HRegion is empty or null Error occurs. (When you try to drop the table it > says it does not exist, and when you try to create the table it says that it > does already exist). > {code} > 2014-01-15 10:04:02,462|beaver.machine|INFO|ERROR: HRegionInfo was null or > empty in hbase:meta, row=keyvalues= > {tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:seqnumDuringOpen/1389778905355/Put/vlen=8/mvcc=0, > > tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:server/1389778905355/Put/vlen=32/mvcc=0, > > tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:serverstartcode/1389778905355/Put/vlen=8/mvcc=0} > > {code} > Thanks to Huned who discovered this issue. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (HBASE-10349) Table became unusable when master balanced its region after table was dropped
[ https://issues.apache.org/jira/browse/HBASE-10349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13875188#comment-13875188 ] Matteo Bertozzi commented on HBASE-10349: - +1 on jimmy v2 for me. (it will be nice also having the MetaEditor.overwriteRegions test and the add regions debug committed, but I guess i can create another jira for them) > Table became unusable when master balanced its region after table was dropped > - > > Key: HBASE-10349 > URL: https://issues.apache.org/jira/browse/HBASE-10349 > Project: HBase > Issue Type: Bug >Affects Versions: 0.98.0 >Reporter: Ted Yu >Assignee: Jimmy Xiang > Fix For: 0.98.0, 0.99.0 > > Attachments: > 10349-hadoop-hdfs-namenode-hor11n14.gq1.ygridcore.net.zip, 10349-output.log, > 10349-v1.txt, 10349-v2.txt, HBASE-10349-meta-test-and-debug.patch, > hbase-10349.patch, hbase-10349_v2.patch, > hbase-hbase-master-hor15n05.gq1.ygridcore.net.log.tar.gz > > > 0.98 was used. > This was sequence of events: > create 'tablethree_mod' > snapshot 'tablethree_mod', 'snapshot_tablethree_mod' > disable 'tablethree_mod' > 2014-01-15 09:34:51,749 restore_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:35:07,210 enable 'tablethree_mod' > 2014-01-15 09:35:46,134 delete_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:41:42,210 disable 'tablethree_mod' > 2014-01-15 09:41:43,610 drop 'tablethree_mod' > create 'tablethree_mod' > For the last table creation request: > {code} > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'create 'tablethree_mod', > {NAME => 'f1', VERSIONS => 3} > , > {NAME => 'f2', VERSIONS => 3} > , > {NAME => 'f3', VERSIONS => 3} > ' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'exists 'tablethree_mod'' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '0', 'f1:q1', 'value-0', 10' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '1', 'f1:q1', 'value-1', 20' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '2', 'f2:q2', 'value-2', 30' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '3', 'f3:q3', 'value-3', 40' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '4', 'f3:q3', 'value-4', 50' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO|Done writing commands to > file. Will execute them now. > 2014-01-15 10:03:53,000|beaver.machine|INFO|RUNNING: /usr/lib/hbase/bin/hbase > shell /grid/0/tmp/hwqe/artifacts/tmp-471142 > 2014-01-15 10:03:55,878|beaver.machine|INFO|2014-01-15 10:03:55,878 INFO > [main] Configuration.deprecation: hadoop.native.lib is deprecated. Instead, > use io.native.lib.available > 2014-01-15 10:03:57,283|beaver.machine|INFO|2014-01-15 10:03:57,283 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,669|beaver.machine|INFO|2014-01-15 10:03:57,669 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,720|beaver.machine|INFO|2014-01-15 10:03:57,720 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,997|beaver.machine|INFO| > 2014-01-15 10:03:57,997|beaver.machine|INFO|ERROR: Table already exists: > tablethree_mod! > 2014-01-15 10:03:57,997|beaver.machine|INFO| > {code} > This was an intermittent issue after using Snapshots, a table is not properly > dropped / and not able to properly re-create with the same name. And a > HRegion is empty or null Error occurs. (When you try to drop the table it > says it does not exist, and when you try to create the table it says that it > does already exist). > {code} > 2014-01-15 10:04:02,462|beaver.machine|INFO|ERROR: HRegionInfo was null or > empty in hbase:meta, row=keyvalues= > {tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:seqnumDuringOpen/1389778905355/Put/vlen=8/mvcc=0, > > tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:server/1389778905355/Put/vlen=32/mvcc=0, > > tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:serverstartcode/1389778905355/Put/vlen=8/mvcc=0} > > {code} > Thanks to Huned who discovered this issue. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (HBASE-10349) Table became unusable when master balanced its region after table was dropped
[ https://issues.apache.org/jira/browse/HBASE-10349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13875169#comment-13875169 ] Hadoop QA commented on HBASE-10349: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12623695/hbase-10349_v2.patch against trunk revision . ATTACHMENT ID: 12623695 {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 6 new or modified tests. {color:green}+1 hadoop1.0{color}. The patch compiles against the hadoop 1.0 profile. {color:green}+1 hadoop1.1{color}. The patch compiles against the hadoop 1.1 profile. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 lineLengths{color}. The patch does not introduce lines longer than 100 {color:red}-1 site{color}. The patch appears to cause mvn site goal to fail. {color:green}+1 core tests{color}. The patch passed unit tests in . Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/8461//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8461//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-protocol.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8461//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-thrift.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8461//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8461//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8461//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8461//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8461//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8461//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8461//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/8461//console This message is automatically generated. > Table became unusable when master balanced its region after table was dropped > - > > Key: HBASE-10349 > URL: https://issues.apache.org/jira/browse/HBASE-10349 > Project: HBase > Issue Type: Bug >Affects Versions: 0.98.0 >Reporter: Ted Yu >Assignee: Jimmy Xiang > Fix For: 0.98.0, 0.99.0 > > Attachments: > 10349-hadoop-hdfs-namenode-hor11n14.gq1.ygridcore.net.zip, 10349-output.log, > 10349-v1.txt, 10349-v2.txt, HBASE-10349-meta-test-and-debug.patch, > hbase-10349.patch, hbase-10349_v2.patch, > hbase-hbase-master-hor15n05.gq1.ygridcore.net.log.tar.gz > > > 0.98 was used. > This was sequence of events: > create 'tablethree_mod' > snapshot 'tablethree_mod', 'snapshot_tablethree_mod' > disable 'tablethree_mod' > 2014-01-15 09:34:51,749 restore_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:35:07,210 enable 'tablethree_mod' > 2014-01-15 09:35:46,134 delete_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:41:42,210 disable 'tablethree_mod' > 2014-01-15 09:41:43,610 drop 'tablethree_mod' > create 'tablethree_mod' > For the last table creation request: > {code} > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'create 'tablethree_mod', > {NAME => 'f1', VERSIONS => 3} > , > {NAME => 'f2', VERSIONS => 3} > , > {NAME => 'f3', VERSIONS => 3} > ' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'exists 'tablethree_mod'' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '0', 'f1:q1', 'value-0', 10' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '1', 'f1:q1', 'value-1', 20' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '2', 'f2:q2', 'value-2', 30' > 2014-01-15 10:03:53,0
[jira] [Commented] (HBASE-10349) Table became unusable when master balanced its region after table was dropped
[ https://issues.apache.org/jira/browse/HBASE-10349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13874924#comment-13874924 ] Jimmy Xiang commented on HBASE-10349: - The test is ok locally. Let me take a look and post a new patch. [~mbertozzi], it is a racing between table deletion and balancer. The balancer operates on a "copy" of the region assignments. When the balancer tries to balance a region, the region has been deleted (including the meta entry), and the table is removed (including the znode). In assigning the deleted region, the region server puts the region back in the meta again with just the server info. That's why the region info in the meta row is missing. > Table became unusable when master balanced its region after table was dropped > - > > Key: HBASE-10349 > URL: https://issues.apache.org/jira/browse/HBASE-10349 > Project: HBase > Issue Type: Bug >Affects Versions: 0.98.0 >Reporter: Ted Yu >Assignee: Jimmy Xiang > Fix For: 0.98.0, 0.99.0 > > Attachments: > 10349-hadoop-hdfs-namenode-hor11n14.gq1.ygridcore.net.zip, 10349-output.log, > 10349-v1.txt, 10349-v2.txt, HBASE-10349-meta-test-and-debug.patch, > hbase-10349.patch, hbase-hbase-master-hor15n05.gq1.ygridcore.net.log.tar.gz > > > 0.98 was used. > This was sequence of events: > create 'tablethree_mod' > snapshot 'tablethree_mod', 'snapshot_tablethree_mod' > disable 'tablethree_mod' > 2014-01-15 09:34:51,749 restore_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:35:07,210 enable 'tablethree_mod' > 2014-01-15 09:35:46,134 delete_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:41:42,210 disable 'tablethree_mod' > 2014-01-15 09:41:43,610 drop 'tablethree_mod' > create 'tablethree_mod' > For the last table creation request: > {code} > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'create 'tablethree_mod', > {NAME => 'f1', VERSIONS => 3} > , > {NAME => 'f2', VERSIONS => 3} > , > {NAME => 'f3', VERSIONS => 3} > ' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'exists 'tablethree_mod'' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '0', 'f1:q1', 'value-0', 10' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '1', 'f1:q1', 'value-1', 20' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '2', 'f2:q2', 'value-2', 30' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '3', 'f3:q3', 'value-3', 40' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '4', 'f3:q3', 'value-4', 50' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO|Done writing commands to > file. Will execute them now. > 2014-01-15 10:03:53,000|beaver.machine|INFO|RUNNING: /usr/lib/hbase/bin/hbase > shell /grid/0/tmp/hwqe/artifacts/tmp-471142 > 2014-01-15 10:03:55,878|beaver.machine|INFO|2014-01-15 10:03:55,878 INFO > [main] Configuration.deprecation: hadoop.native.lib is deprecated. Instead, > use io.native.lib.available > 2014-01-15 10:03:57,283|beaver.machine|INFO|2014-01-15 10:03:57,283 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,669|beaver.machine|INFO|2014-01-15 10:03:57,669 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,720|beaver.machine|INFO|2014-01-15 10:03:57,720 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,997|beaver.machine|INFO| > 2014-01-15 10:03:57,997|beaver.machine|INFO|ERROR: Table already exists: > tablethree_mod! > 2014-01-15 10:03:57,997|beaver.machine|INFO| > {code} > This was an intermittent issue after using Snapshots, a table is not properly > dropped / and not able to properly re-create with the same name. And a > HRegion is empty or null Error occurs. (When you try to drop the table it > says it does not exist, and when you try to create the table it says that it > does already exist). > {code} > 2014-01-15 10:04:02,462|beaver.machine|INFO|ERROR: HRegionInfo was null or > empty in hbase:meta, row=keyvalues= > {tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:seqnumDuringOpen/1389778905355/Put/vlen=8/mvcc=0, > > tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:server/1389778905355/Put/vlen=32/mvcc=0, > > tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:serverstartcode/1389778905355/Put/vlen=8/mvcc=0} > > {code} > Thanks to Huned who discovered this issue. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (HBASE-10349) Table became unusable when master balanced its region after table was dropped
[ https://issues.apache.org/jira/browse/HBASE-10349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13874613#comment-13874613 ] Matteo Bertozzi commented on HBASE-10349: - [~jxiang] can you explain why the region is still in META? the patch looks good to me to avoid any assignment transition after delete, but I still don't see anything in the balancer/assignment manager that can add back the region to META. > Table became unusable when master balanced its region after table was dropped > - > > Key: HBASE-10349 > URL: https://issues.apache.org/jira/browse/HBASE-10349 > Project: HBase > Issue Type: Bug >Affects Versions: 0.98.0 >Reporter: Ted Yu >Assignee: Jimmy Xiang > Fix For: 0.98.0, 0.99.0 > > Attachments: > 10349-hadoop-hdfs-namenode-hor11n14.gq1.ygridcore.net.zip, 10349-output.log, > 10349-v1.txt, 10349-v2.txt, HBASE-10349-meta-test-and-debug.patch, > hbase-10349.patch, hbase-hbase-master-hor15n05.gq1.ygridcore.net.log.tar.gz > > > 0.98 was used. > This was sequence of events: > create 'tablethree_mod' > snapshot 'tablethree_mod', 'snapshot_tablethree_mod' > disable 'tablethree_mod' > 2014-01-15 09:34:51,749 restore_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:35:07,210 enable 'tablethree_mod' > 2014-01-15 09:35:46,134 delete_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:41:42,210 disable 'tablethree_mod' > 2014-01-15 09:41:43,610 drop 'tablethree_mod' > create 'tablethree_mod' > For the last table creation request: > {code} > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'create 'tablethree_mod', > {NAME => 'f1', VERSIONS => 3} > , > {NAME => 'f2', VERSIONS => 3} > , > {NAME => 'f3', VERSIONS => 3} > ' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'exists 'tablethree_mod'' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '0', 'f1:q1', 'value-0', 10' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '1', 'f1:q1', 'value-1', 20' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '2', 'f2:q2', 'value-2', 30' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '3', 'f3:q3', 'value-3', 40' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '4', 'f3:q3', 'value-4', 50' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO|Done writing commands to > file. Will execute them now. > 2014-01-15 10:03:53,000|beaver.machine|INFO|RUNNING: /usr/lib/hbase/bin/hbase > shell /grid/0/tmp/hwqe/artifacts/tmp-471142 > 2014-01-15 10:03:55,878|beaver.machine|INFO|2014-01-15 10:03:55,878 INFO > [main] Configuration.deprecation: hadoop.native.lib is deprecated. Instead, > use io.native.lib.available > 2014-01-15 10:03:57,283|beaver.machine|INFO|2014-01-15 10:03:57,283 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,669|beaver.machine|INFO|2014-01-15 10:03:57,669 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,720|beaver.machine|INFO|2014-01-15 10:03:57,720 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,997|beaver.machine|INFO| > 2014-01-15 10:03:57,997|beaver.machine|INFO|ERROR: Table already exists: > tablethree_mod! > 2014-01-15 10:03:57,997|beaver.machine|INFO| > {code} > This was an intermittent issue after using Snapshots, a table is not properly > dropped / and not able to properly re-create with the same name. And a > HRegion is empty or null Error occurs. (When you try to drop the table it > says it does not exist, and when you try to create the table it says that it > does already exist). > {code} > 2014-01-15 10:04:02,462|beaver.machine|INFO|ERROR: HRegionInfo was null or > empty in hbase:meta, row=keyvalues= > {tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:seqnumDuringOpen/1389778905355/Put/vlen=8/mvcc=0, > > tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:server/1389778905355/Put/vlen=32/mvcc=0, > > tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:serverstartcode/1389778905355/Put/vlen=8/mvcc=0} > > {code} > Thanks to Huned who discovered this issue. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (HBASE-10349) Table became unusable when master balanced its region after table was dropped
[ https://issues.apache.org/jira/browse/HBASE-10349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13874454#comment-13874454 ] Hadoop QA commented on HBASE-10349: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12623550/hbase-10349.patch against trunk revision . ATTACHMENT ID: 12623550 {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 6 new or modified tests. {color:green}+1 hadoop1.0{color}. The patch compiles against the hadoop 1.0 profile. {color:green}+1 hadoop1.1{color}. The patch compiles against the hadoop 1.1 profile. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 lineLengths{color}. The patch does not introduce lines longer than 100 {color:red}-1 site{color}. The patch appears to cause mvn site goal to fail. {color:red}-1 core tests{color}. The patch failed these unit tests: org.apache.hadoop.hbase.coprocessor.TestMasterObserver org.apache.hadoop.hbase.master.TestAssignmentManagerOnCluster Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/8455//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8455//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8455//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8455//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8455//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8455//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-protocol.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8455//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8455//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8455//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-thrift.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8455//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/8455//console This message is automatically generated. > Table became unusable when master balanced its region after table was dropped > - > > Key: HBASE-10349 > URL: https://issues.apache.org/jira/browse/HBASE-10349 > Project: HBase > Issue Type: Bug >Affects Versions: 0.98.0 >Reporter: Ted Yu >Assignee: Jimmy Xiang > Fix For: 0.98.0, 0.99.0 > > Attachments: > 10349-hadoop-hdfs-namenode-hor11n14.gq1.ygridcore.net.zip, 10349-output.log, > 10349-v1.txt, 10349-v2.txt, HBASE-10349-meta-test-and-debug.patch, > hbase-10349.patch, hbase-hbase-master-hor15n05.gq1.ygridcore.net.log.tar.gz > > > 0.98 was used. > This was sequence of events: > create 'tablethree_mod' > snapshot 'tablethree_mod', 'snapshot_tablethree_mod' > disable 'tablethree_mod' > 2014-01-15 09:34:51,749 restore_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:35:07,210 enable 'tablethree_mod' > 2014-01-15 09:35:46,134 delete_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:41:42,210 disable 'tablethree_mod' > 2014-01-15 09:41:43,610 drop 'tablethree_mod' > create 'tablethree_mod' > For the last table creation request: > {code} > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'create 'tablethree_mod', > {NAME => 'f1', VERSIONS => 3} > , > {NAME => 'f2', VERSIONS => 3} > , > {NAME => 'f3', VERSIONS => 3} > ' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'exists 'tablethree_mod'' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '0', 'f1:q1', 'value-0', 10' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '1', 'f1:q1', 'value-1', 20' >
[jira] [Commented] (HBASE-10349) Table became unusable when master balanced its region after table was dropped
[ https://issues.apache.org/jira/browse/HBASE-10349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13873725#comment-13873725 ] Hadoop QA commented on HBASE-10349: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12623420/10349-v2.txt against trunk revision . ATTACHMENT ID: 12623420 {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 3 new or modified tests. {color:green}+1 hadoop1.0{color}. The patch compiles against the hadoop 1.0 profile. {color:green}+1 hadoop1.1{color}. The patch compiles against the hadoop 1.1 profile. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 lineLengths{color}. The patch does not introduce lines longer than 100 {color:red}-1 site{color}. The patch appears to cause mvn site goal to fail. {color:red}-1 core tests{color}. The patch failed these unit tests: {color:red}-1 core zombie tests{color}. There are 1 zombie test(s): at org.apache.hadoop.hbase.TestAcidGuarantees.testMixedAtomicity(TestAcidGuarantees.java:351) Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/8445//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8445//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-protocol.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8445//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-thrift.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8445//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8445//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8445//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8445//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8445//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8445//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8445//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/8445//console This message is automatically generated. > Table became unusable when master balanced its region after table was dropped > - > > Key: HBASE-10349 > URL: https://issues.apache.org/jira/browse/HBASE-10349 > Project: HBase > Issue Type: Bug >Reporter: Ted Yu >Assignee: Jimmy Xiang > Attachments: > 10349-hadoop-hdfs-namenode-hor11n14.gq1.ygridcore.net.zip, 10349-output.log, > 10349-v1.txt, 10349-v2.txt, HBASE-10349-meta-test-and-debug.patch, > hbase-hbase-master-hor15n05.gq1.ygridcore.net.log.tar.gz > > > 0.98 was used. > This was sequence of events: > create 'tablethree_mod' > snapshot 'tablethree_mod', 'snapshot_tablethree_mod' > disable 'tablethree_mod' > 2014-01-15 09:34:51,749 restore_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:35:07,210 enable 'tablethree_mod' > 2014-01-15 09:35:46,134 delete_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:41:42,210 disable 'tablethree_mod' > 2014-01-15 09:41:43,610 drop 'tablethree_mod' > create 'tablethree_mod' > For the last table creation request: > {code} > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'create 'tablethree_mod', > {NAME => 'f1', VERSIONS => 3} > , > {NAME => 'f2', VERSIONS => 3} > , > {NAME => 'f3', VERSIONS => 3} > ' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'exists 'tablethree_mod'' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '0', 'f1:q1', 'value-0', 10' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '1', 'f1:q1', 'value-1', 20' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree
[jira] [Commented] (HBASE-10349) Table became unusable when master balanced its region after table was dropped
[ https://issues.apache.org/jira/browse/HBASE-10349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13873313#comment-13873313 ] Hadoop QA commented on HBASE-10349: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12623348/HBASE-10349-meta-test-and-debug.patch against trunk revision . ATTACHMENT ID: 12623348 {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 3 new or modified tests. {color:green}+1 hadoop1.0{color}. The patch compiles against the hadoop 1.0 profile. {color:green}+1 hadoop1.1{color}. The patch compiles against the hadoop 1.1 profile. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 lineLengths{color}. The patch does not introduce lines longer than 100 {color:red}-1 site{color}. The patch appears to cause mvn site goal to fail. {color:green}+1 core tests{color}. The patch passed unit tests in . Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/8444//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8444//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8444//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8444//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8444//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8444//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-protocol.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8444//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8444//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8444//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-thrift.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8444//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/8444//console This message is automatically generated. > Table became unusable when master balanced its region after table was dropped > - > > Key: HBASE-10349 > URL: https://issues.apache.org/jira/browse/HBASE-10349 > Project: HBase > Issue Type: Bug >Reporter: Ted Yu > Attachments: > 10349-hadoop-hdfs-namenode-hor11n14.gq1.ygridcore.net.zip, 10349-output.log, > 10349-v1.txt, HBASE-10349-meta-test-and-debug.patch, > hbase-hbase-master-hor15n05.gq1.ygridcore.net.log.tar.gz > > > 0.98 was used. > This was sequence of events: > create 'tablethree_mod' > snapshot 'tablethree_mod', 'snapshot_tablethree_mod' > disable 'tablethree_mod' > 2014-01-15 09:34:51,749 restore_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:35:07,210 enable 'tablethree_mod' > 2014-01-15 09:35:46,134 delete_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:41:42,210 disable 'tablethree_mod' > 2014-01-15 09:41:43,610 drop 'tablethree_mod' > create 'tablethree_mod' > For the last table creation request: > {code} > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'create 'tablethree_mod', > {NAME => 'f1', VERSIONS => 3} > , > {NAME => 'f2', VERSIONS => 3} > , > {NAME => 'f3', VERSIONS => 3} > ' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'exists 'tablethree_mod'' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '0', 'f1:q1', 'value-0', 10' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '1', 'f1:q1', 'value-1', 20' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '2', 'f2:q2', 'value-2', 30' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '3', 'f3:q3', 'value-3', 40' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'pu
[jira] [Commented] (HBASE-10349) Table became unusable when master balanced its region after table was dropped
[ https://issues.apache.org/jira/browse/HBASE-10349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13873246#comment-13873246 ] Matteo Bertozzi commented on HBASE-10349: - I think that 10348-v1 a good check to have, for the assignment but is probably just half of the fix. the other part is on table creation, the region is still visible in META. and I don't think that the assignment adds the region back to META. > Table became unusable when master balanced its region after table was dropped > - > > Key: HBASE-10349 > URL: https://issues.apache.org/jira/browse/HBASE-10349 > Project: HBase > Issue Type: Bug >Reporter: Ted Yu > Attachments: > 10349-hadoop-hdfs-namenode-hor11n14.gq1.ygridcore.net.zip, 10349-output.log, > 10349-v1.txt, HBASE-10349-meta-test-and-debug.patch, > hbase-hbase-master-hor15n05.gq1.ygridcore.net.log.tar.gz > > > 0.98 was used. > This was sequence of events: > create 'tablethree_mod' > snapshot 'tablethree_mod', 'snapshot_tablethree_mod' > disable 'tablethree_mod' > 2014-01-15 09:34:51,749 restore_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:35:07,210 enable 'tablethree_mod' > 2014-01-15 09:35:46,134 delete_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:41:42,210 disable 'tablethree_mod' > 2014-01-15 09:41:43,610 drop 'tablethree_mod' > create 'tablethree_mod' > For the last table creation request: > {code} > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'create 'tablethree_mod', > {NAME => 'f1', VERSIONS => 3} > , > {NAME => 'f2', VERSIONS => 3} > , > {NAME => 'f3', VERSIONS => 3} > ' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'exists 'tablethree_mod'' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '0', 'f1:q1', 'value-0', 10' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '1', 'f1:q1', 'value-1', 20' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '2', 'f2:q2', 'value-2', 30' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '3', 'f3:q3', 'value-3', 40' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '4', 'f3:q3', 'value-4', 50' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO|Done writing commands to > file. Will execute them now. > 2014-01-15 10:03:53,000|beaver.machine|INFO|RUNNING: /usr/lib/hbase/bin/hbase > shell /grid/0/tmp/hwqe/artifacts/tmp-471142 > 2014-01-15 10:03:55,878|beaver.machine|INFO|2014-01-15 10:03:55,878 INFO > [main] Configuration.deprecation: hadoop.native.lib is deprecated. Instead, > use io.native.lib.available > 2014-01-15 10:03:57,283|beaver.machine|INFO|2014-01-15 10:03:57,283 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,669|beaver.machine|INFO|2014-01-15 10:03:57,669 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,720|beaver.machine|INFO|2014-01-15 10:03:57,720 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,997|beaver.machine|INFO| > 2014-01-15 10:03:57,997|beaver.machine|INFO|ERROR: Table already exists: > tablethree_mod! > 2014-01-15 10:03:57,997|beaver.machine|INFO| > {code} > This was an intermittent issue after using Snapshots, a table is not properly > dropped / and not able to properly re-create with the same name. And a > HRegion is empty or null Error occurs. (When you try to drop the table it > says it does not exist, and when you try to create the table it says that it > does already exist). > {code} > 2014-01-15 10:04:02,462|beaver.machine|INFO|ERROR: HRegionInfo was null or > empty in hbase:meta, row=keyvalues= > {tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:seqnumDuringOpen/1389778905355/Put/vlen=8/mvcc=0, > > tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:server/1389778905355/Put/vlen=32/mvcc=0, > > tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:serverstartcode/1389778905355/Put/vlen=8/mvcc=0} > > {code} > Thanks to Huned who discovered this issue. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (HBASE-10349) Table became unusable when master balanced its region after table was dropped
[ https://issues.apache.org/jira/browse/HBASE-10349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13873074#comment-13873074 ] Hadoop QA commented on HBASE-10349: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12623306/10349-v1.txt against trunk revision . ATTACHMENT ID: 12623306 {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:red}-1 tests included{color}. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. {color:green}+1 hadoop1.0{color}. The patch compiles against the hadoop 1.0 profile. {color:green}+1 hadoop1.1{color}. The patch compiles against the hadoop 1.1 profile. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 lineLengths{color}. The patch does not introduce lines longer than 100 {color:red}-1 site{color}. The patch appears to cause mvn site goal to fail. {color:green}+1 core tests{color}. The patch passed unit tests in . Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/8441//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8441//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8441//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8441//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8441//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8441//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-protocol.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8441//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8441//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8441//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-thrift.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/8441//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/8441//console This message is automatically generated. > Table became unusable when master balanced its region after table was dropped > - > > Key: HBASE-10349 > URL: https://issues.apache.org/jira/browse/HBASE-10349 > Project: HBase > Issue Type: Bug >Reporter: Ted Yu > Attachments: > 10349-hadoop-hdfs-namenode-hor11n14.gq1.ygridcore.net.zip, 10349-output.log, > 10349-v1.txt, hbase-hbase-master-hor15n05.gq1.ygridcore.net.log.tar.gz > > > 0.98 was used. > This was sequence of events: > create 'tablethree_mod' > snapshot 'tablethree_mod', 'snapshot_tablethree_mod' > disable 'tablethree_mod' > 2014-01-15 09:34:51,749 restore_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:35:07,210 enable 'tablethree_mod' > 2014-01-15 09:35:46,134 delete_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:41:42,210 disable 'tablethree_mod' > 2014-01-15 09:41:43,610 drop 'tablethree_mod' > create 'tablethree_mod' > For the last table creation request: > {code} > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'create 'tablethree_mod', > {NAME => 'f1', VERSIONS => 3} > , > {NAME => 'f2', VERSIONS => 3} > , > {NAME => 'f3', VERSIONS => 3} > ' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'exists 'tablethree_mod'' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '0', 'f1:q1', 'value-0', 10' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '1', 'f1:q1', 'value-1', 20' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '2', 'f2:q2', 'value-2', 30' > 2014-01-15 10:03:53,000|beaver.component.hbase
[jira] [Commented] (HBASE-10349) Table became unusable when master balanced its region after table was dropped
[ https://issues.apache.org/jira/browse/HBASE-10349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13873033#comment-13873033 ] Ted Yu commented on HBASE-10349: {code} Map>> assignmentsByTable = this.assignmentManager.getRegionStates().getAssignmentsByTable(); {code} One possibility is that afc82d1ceabbaca36a504b83b65fc0c9 went offline after the above call where HMaster#balance() call was still running. > Table became unusable when master balanced its region after table was dropped > - > > Key: HBASE-10349 > URL: https://issues.apache.org/jira/browse/HBASE-10349 > Project: HBase > Issue Type: Bug >Reporter: Ted Yu > Attachments: > 10349-hadoop-hdfs-namenode-hor11n14.gq1.ygridcore.net.zip, 10349-output.log, > hbase-hbase-master-hor15n05.gq1.ygridcore.net.log.tar.gz > > > 0.98 was used. > This was sequence of events: > create 'tablethree_mod' > snapshot 'tablethree_mod', 'snapshot_tablethree_mod' > disable 'tablethree_mod' > 2014-01-15 09:34:51,749 restore_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:35:07,210 enable 'tablethree_mod' > 2014-01-15 09:35:46,134 delete_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:41:42,210 disable 'tablethree_mod' > 2014-01-15 09:41:43,610 drop 'tablethree_mod' > create 'tablethree_mod' > For the last table creation request: > {code} > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'create 'tablethree_mod', > {NAME => 'f1', VERSIONS => 3} > , > {NAME => 'f2', VERSIONS => 3} > , > {NAME => 'f3', VERSIONS => 3} > ' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'exists 'tablethree_mod'' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '0', 'f1:q1', 'value-0', 10' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '1', 'f1:q1', 'value-1', 20' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '2', 'f2:q2', 'value-2', 30' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '3', 'f3:q3', 'value-3', 40' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '4', 'f3:q3', 'value-4', 50' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO|Done writing commands to > file. Will execute them now. > 2014-01-15 10:03:53,000|beaver.machine|INFO|RUNNING: /usr/lib/hbase/bin/hbase > shell /grid/0/tmp/hwqe/artifacts/tmp-471142 > 2014-01-15 10:03:55,878|beaver.machine|INFO|2014-01-15 10:03:55,878 INFO > [main] Configuration.deprecation: hadoop.native.lib is deprecated. Instead, > use io.native.lib.available > 2014-01-15 10:03:57,283|beaver.machine|INFO|2014-01-15 10:03:57,283 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,669|beaver.machine|INFO|2014-01-15 10:03:57,669 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,720|beaver.machine|INFO|2014-01-15 10:03:57,720 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,997|beaver.machine|INFO| > 2014-01-15 10:03:57,997|beaver.machine|INFO|ERROR: Table already exists: > tablethree_mod! > 2014-01-15 10:03:57,997|beaver.machine|INFO| > {code} > This was an intermittent issue after using Snapshots, a table is not properly > dropped / and not able to properly re-create with the same name. And a > HRegion is empty or null Error occurs. (When you try to drop the table it > says it does not exist, and when you try to create the table it says that it > does already exist). > {code} > 2014-01-15 10:04:02,462|beaver.machine|INFO|ERROR: HRegionInfo was null or > empty in hbase:meta, row=keyvalues= > {tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:seqnumDuringOpen/1389778905355/Put/vlen=8/mvcc=0, > > tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:server/1389778905355/Put/vlen=32/mvcc=0, > > tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:serverstartcode/1389778905355/Put/vlen=8/mvcc=0} > > {code} > Thanks to Huned who discovered this issue. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (HBASE-10349) Table became unusable when master balanced its region after table was dropped
[ https://issues.apache.org/jira/browse/HBASE-10349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13872891#comment-13872891 ] Ted Yu commented on HBASE-10349: >From namenode log I don't see the deletion corresponding to what Matteo posted >@ 2014-01-15 09:41:43,639 : {code} 2014-01-15 09:41:42,322 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2873)) - BLOCK* allocateBlock: /apps/hbase/data/data/default/tablethree_mod/ afc82d1ceabbaca36a504b83b65fc0c9/.tmp/2281cdbf37c54ab3b8dcc57069cae993. BP-1099602576-68.142.247.161-1389770223091 blk_1073743631_2807{blockUCState=UNDER_CONSTRUCTION,primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[68.142.246.154:50010|RBW], ReplicaUnderConstruction[68.142.246.158:50010|RBW], ReplicaUnderConstruction[68.142.246.159:50010|RBW]]} ... 2014-01-15 09:41:42,344 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2814)) - DIR* completeFile: /apps/hbase/data/data/default/tablethree_mod/ afc82d1ceabbaca36a504b83b65fc0c9/.tmp/2281cdbf37c54ab3b8dcc57069cae993 is closed by DFSClient_hb_rs_hor15n07.gq1.ygridcore.net,60020,1389770493951_719601563_28 ... 2014-01-15 09:41:44,868 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2873)) - BLOCK* allocateBlock: /apps/hbase/data/data/default/tablethree_mod/ afc82d1ceabbaca36a504b83b65fc0c9/.tmp/.regioninfo. BP-1099602576-68.142.247.161-1389770223091 blk_1073743636_2812{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[68.142.246.159:50010|RBW], ReplicaUnderConstruction[68.142.246.156:50010|RBW], ReplicaUnderConstruction[68.142.246.154:50010|RBW]]} {code} > Table became unusable when master balanced its region after table was dropped > - > > Key: HBASE-10349 > URL: https://issues.apache.org/jira/browse/HBASE-10349 > Project: HBase > Issue Type: Bug >Reporter: Ted Yu > Attachments: > 10349-hadoop-hdfs-namenode-hor11n14.gq1.ygridcore.net.zip, 10349-output.log, > hbase-hbase-master-hor15n05.gq1.ygridcore.net.log.tar.gz > > > 0.98 was used. > This was sequence of events: > create 'tablethree_mod' > snapshot 'tablethree_mod', 'snapshot_tablethree_mod' > disable 'tablethree_mod' > 2014-01-15 09:34:51,749 restore_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:35:07,210 enable 'tablethree_mod' > 2014-01-15 09:35:46,134 delete_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:41:42,210 disable 'tablethree_mod' > 2014-01-15 09:41:43,610 drop 'tablethree_mod' > create 'tablethree_mod' > For the last table creation request: > {code} > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'create 'tablethree_mod', > {NAME => 'f1', VERSIONS => 3} > , > {NAME => 'f2', VERSIONS => 3} > , > {NAME => 'f3', VERSIONS => 3} > ' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'exists 'tablethree_mod'' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '0', 'f1:q1', 'value-0', 10' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '1', 'f1:q1', 'value-1', 20' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '2', 'f2:q2', 'value-2', 30' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '3', 'f3:q3', 'value-3', 40' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '4', 'f3:q3', 'value-4', 50' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO|Done writing commands to > file. Will execute them now. > 2014-01-15 10:03:53,000|beaver.machine|INFO|RUNNING: /usr/lib/hbase/bin/hbase > shell /grid/0/tmp/hwqe/artifacts/tmp-471142 > 2014-01-15 10:03:55,878|beaver.machine|INFO|2014-01-15 10:03:55,878 INFO > [main] Configuration.deprecation: hadoop.native.lib is deprecated. Instead, > use io.native.lib.available > 2014-01-15 10:03:57,283|beaver.machine|INFO|2014-01-15 10:03:57,283 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,669|beaver.machine|INFO|2014-01-15 10:03:57,669 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,720|beaver.machine|INFO|2014-01-15 10:03:57,720 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,997|beaver.machine|INFO| > 2014-01-15 10:03:57,997|beaver.machine|INFO|ERROR: Table already exists: > tablethree_mod! > 2014-01-15 10:03:57,997|beaver.machine|INFO| > {code} > This was an intermittent issue after using Snapshots, a table is not properly > dropped / and not able to properly re-create with the same name. And a > HRegio
[jira] [Commented] (HBASE-10349) Table became unusable when master balanced its region after table was dropped
[ https://issues.apache.org/jira/browse/HBASE-10349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13872864#comment-13872864 ] Matteo Bertozzi commented on HBASE-10349: - maybe related to this.. META should have DELETE -> PUT (restore snapshot) -> DELETE... but the row looks not deleted from MetaReader.tableExists() {code} public static void overwriteRegions(CatalogTracker catalogTracker, List regionInfos) throws IOException { deleteRegions(catalogTracker, regionInfos); // Why sleep? This is the easiest way to ensure that the previous deletes does not // eclipse the following puts, that might happen in the same ts from the server. // See HBASE-9906, and HBASE-9879. Once either HBASE-9879, HBASE-8770 is fixed, // or HBASE-9905 is fixed and meta uses seqIds, we do not need the sleep. Threads.sleep(20); addRegionsToMeta(catalogTracker, regionInfos); LOG.info("Overwritten " + regionInfos); } {code} > Table became unusable when master balanced its region after table was dropped > - > > Key: HBASE-10349 > URL: https://issues.apache.org/jira/browse/HBASE-10349 > Project: HBase > Issue Type: Bug >Reporter: Ted Yu > Attachments: > 10349-hadoop-hdfs-namenode-hor11n14.gq1.ygridcore.net.zip, 10349-output.log, > hbase-hbase-master-hor15n05.gq1.ygridcore.net.log.tar.gz > > > 0.98 was used. > This was sequence of events: > create 'tablethree_mod' > snapshot 'tablethree_mod', 'snapshot_tablethree_mod' > disable 'tablethree_mod' > 2014-01-15 09:34:51,749 restore_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:35:07,210 enable 'tablethree_mod' > 2014-01-15 09:35:46,134 delete_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:41:42,210 disable 'tablethree_mod' > 2014-01-15 09:41:43,610 drop 'tablethree_mod' > create 'tablethree_mod' > For the last table creation request: > {code} > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'create 'tablethree_mod', > {NAME => 'f1', VERSIONS => 3} > , > {NAME => 'f2', VERSIONS => 3} > , > {NAME => 'f3', VERSIONS => 3} > ' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'exists 'tablethree_mod'' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '0', 'f1:q1', 'value-0', 10' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '1', 'f1:q1', 'value-1', 20' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '2', 'f2:q2', 'value-2', 30' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '3', 'f3:q3', 'value-3', 40' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '4', 'f3:q3', 'value-4', 50' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO|Done writing commands to > file. Will execute them now. > 2014-01-15 10:03:53,000|beaver.machine|INFO|RUNNING: /usr/lib/hbase/bin/hbase > shell /grid/0/tmp/hwqe/artifacts/tmp-471142 > 2014-01-15 10:03:55,878|beaver.machine|INFO|2014-01-15 10:03:55,878 INFO > [main] Configuration.deprecation: hadoop.native.lib is deprecated. Instead, > use io.native.lib.available > 2014-01-15 10:03:57,283|beaver.machine|INFO|2014-01-15 10:03:57,283 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,669|beaver.machine|INFO|2014-01-15 10:03:57,669 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,720|beaver.machine|INFO|2014-01-15 10:03:57,720 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,997|beaver.machine|INFO| > 2014-01-15 10:03:57,997|beaver.machine|INFO|ERROR: Table already exists: > tablethree_mod! > 2014-01-15 10:03:57,997|beaver.machine|INFO| > {code} > This was an intermittent issue after using Snapshots, a table is not properly > dropped / and not able to properly re-create with the same name. And a > HRegion is empty or null Error occurs. (When you try to drop the table it > says it does not exist, and when you try to create the table it says that it > does already exist). > {code} > 2014-01-15 10:04:02,462|beaver.machine|INFO|ERROR: HRegionInfo was null or > empty in hbase:meta, row=keyvalues= > {tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:seqnumDuringOpen/1389778905355/Put/vlen=8/mvcc=0, > > tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:server/1389778905355/Put/vlen=32/mvcc=0, > > tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:serverstartcode/1389778905355/Put/vlen=8/mvcc=0} > > {code} > Thanks to Huned who discovered this issue. -
[jira] [Commented] (HBASE-10349) Table became unusable when master balanced its region after table was dropped
[ https://issues.apache.org/jira/browse/HBASE-10349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13872853#comment-13872853 ] Matteo Bertozzi commented on HBASE-10349: - was MetaReader.tableExists()... and the rows seems directly from the meta table... any chances that we failed the MetaEditor.deleteRegions() or we are reading old data from META? the request to delete the region was sent {code} 15908 2014-01-15 09:41:43,639 INFO [MASTER_TABLE_OPERATIONS-hor15n05:6-0] catalog.MetaEditor: Deleted [{ENCODED => afc82d1ceabbaca36a504b83b65fc0c9, NAME => 'tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9.', STARTKEY => '', ENDKEY => ''}] {code} > Table became unusable when master balanced its region after table was dropped > - > > Key: HBASE-10349 > URL: https://issues.apache.org/jira/browse/HBASE-10349 > Project: HBase > Issue Type: Bug >Reporter: Ted Yu > Attachments: 10349-output.log, > hbase-hbase-master-hor15n05.gq1.ygridcore.net.log.tar.gz > > > 0.98 was used. > This was sequence of events: > create 'tablethree_mod' > snapshot 'tablethree_mod', 'snapshot_tablethree_mod' > disable 'tablethree_mod' > 2014-01-15 09:34:51,749 restore_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:35:07,210 enable 'tablethree_mod' > 2014-01-15 09:35:46,134 delete_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:41:42,210 disable 'tablethree_mod' > 2014-01-15 09:41:43,610 drop 'tablethree_mod' > create 'tablethree_mod' > For the last table creation request: > {code} > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'create 'tablethree_mod', > {NAME => 'f1', VERSIONS => 3} > , > {NAME => 'f2', VERSIONS => 3} > , > {NAME => 'f3', VERSIONS => 3} > ' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'exists 'tablethree_mod'' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '0', 'f1:q1', 'value-0', 10' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '1', 'f1:q1', 'value-1', 20' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '2', 'f2:q2', 'value-2', 30' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '3', 'f3:q3', 'value-3', 40' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '4', 'f3:q3', 'value-4', 50' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO|Done writing commands to > file. Will execute them now. > 2014-01-15 10:03:53,000|beaver.machine|INFO|RUNNING: /usr/lib/hbase/bin/hbase > shell /grid/0/tmp/hwqe/artifacts/tmp-471142 > 2014-01-15 10:03:55,878|beaver.machine|INFO|2014-01-15 10:03:55,878 INFO > [main] Configuration.deprecation: hadoop.native.lib is deprecated. Instead, > use io.native.lib.available > 2014-01-15 10:03:57,283|beaver.machine|INFO|2014-01-15 10:03:57,283 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,669|beaver.machine|INFO|2014-01-15 10:03:57,669 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,720|beaver.machine|INFO|2014-01-15 10:03:57,720 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,997|beaver.machine|INFO| > 2014-01-15 10:03:57,997|beaver.machine|INFO|ERROR: Table already exists: > tablethree_mod! > 2014-01-15 10:03:57,997|beaver.machine|INFO| > {code} > This was an intermittent issue after using Snapshots, a table is not properly > dropped / and not able to properly re-create with the same name. And a > HRegion is empty or null Error occurs. (When you try to drop the table it > says it does not exist, and when you try to create the table it says that it > does already exist). > {code} > 2014-01-15 10:04:02,462|beaver.machine|INFO|ERROR: HRegionInfo was null or > empty in hbase:meta, row=keyvalues= > {tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:seqnumDuringOpen/1389778905355/Put/vlen=8/mvcc=0, > > tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:server/1389778905355/Put/vlen=32/mvcc=0, > > tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:serverstartcode/1389778905355/Put/vlen=8/mvcc=0} > > {code} > Thanks to Huned who discovered this issue. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (HBASE-10349) Table became unusable when master balanced its region after table was dropped
[ https://issues.apache.org/jira/browse/HBASE-10349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13872823#comment-13872823 ] Matteo Bertozzi commented on HBASE-10349: - I guess the problem has more to do with the disable step. from the logs looks like the region afc82d1ceabbaca36a504b83b65fc0c9 was in the list of region to delete, since there is the log of "Archiving region". so it should also be removed from meta by the MetaEditor.deleteRegions() {code} 15909 2014-01-15 09:41:43,651 DEBUG [MASTER_TABLE_OPERATIONS-hor15n05:6-0] handler.DeleteTableHandler: Archiving region tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9. from FS {code} looking at the MetaEditor.tableExists() to see if is reading from META or from the znode.. > Table became unusable when master balanced its region after table was dropped > - > > Key: HBASE-10349 > URL: https://issues.apache.org/jira/browse/HBASE-10349 > Project: HBase > Issue Type: Bug >Reporter: Ted Yu > Attachments: 10349-output.log, > hbase-hbase-master-hor15n05.gq1.ygridcore.net.log.tar.gz > > > 0.98 was used. > This was sequence of events: > create 'tablethree_mod' > snapshot 'tablethree_mod', 'snapshot_tablethree_mod' > disable 'tablethree_mod' > 2014-01-15 09:34:51,749 restore_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:35:07,210 enable 'tablethree_mod' > 2014-01-15 09:35:46,134 delete_snapshot 'snapshot_tablethree_mod' > 2014-01-15 09:41:42,210 disable 'tablethree_mod' > 2014-01-15 09:41:43,610 drop 'tablethree_mod' > create 'tablethree_mod' > For the last table creation request: > {code} > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'create 'tablethree_mod', > {NAME => 'f1', VERSIONS => 3} > , > {NAME => 'f2', VERSIONS => 3} > , > {NAME => 'f3', VERSIONS => 3} > ' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'exists 'tablethree_mod'' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '0', 'f1:q1', 'value-0', 10' > 2014-01-15 10:03:52,999|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '1', 'f1:q1', 'value-1', 20' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '2', 'f2:q2', 'value-2', 30' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '3', 'f3:q3', 'value-3', 40' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO| 'put 'tablethree_mod', > '4', 'f3:q3', 'value-4', 50' > 2014-01-15 10:03:53,000|beaver.component.hbase|INFO|Done writing commands to > file. Will execute them now. > 2014-01-15 10:03:53,000|beaver.machine|INFO|RUNNING: /usr/lib/hbase/bin/hbase > shell /grid/0/tmp/hwqe/artifacts/tmp-471142 > 2014-01-15 10:03:55,878|beaver.machine|INFO|2014-01-15 10:03:55,878 INFO > [main] Configuration.deprecation: hadoop.native.lib is deprecated. Instead, > use io.native.lib.available > 2014-01-15 10:03:57,283|beaver.machine|INFO|2014-01-15 10:03:57,283 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,669|beaver.machine|INFO|2014-01-15 10:03:57,669 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,720|beaver.machine|INFO|2014-01-15 10:03:57,720 WARN > [main] conf.Configuration: hbase-site.xml:an attempt to override final > parameter: dfs.support.append; Ignoring. > 2014-01-15 10:03:57,997|beaver.machine|INFO| > 2014-01-15 10:03:57,997|beaver.machine|INFO|ERROR: Table already exists: > tablethree_mod! > 2014-01-15 10:03:57,997|beaver.machine|INFO| > {code} > This was an intermittent issue after using Snapshots, a table is not properly > dropped / and not able to properly re-create with the same name. And a > HRegion is empty or null Error occurs. (When you try to drop the table it > says it does not exist, and when you try to create the table it says that it > does already exist). > {code} > 2014-01-15 10:04:02,462|beaver.machine|INFO|ERROR: HRegionInfo was null or > empty in hbase:meta, row=keyvalues= > {tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:seqnumDuringOpen/1389778905355/Put/vlen=8/mvcc=0, > > tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:server/1389778905355/Put/vlen=32/mvcc=0, > > tablethree_mod,,1389778226606.afc82d1ceabbaca36a504b83b65fc0c9./info:serverstartcode/1389778905355/Put/vlen=8/mvcc=0} > > {code} > Thanks to Huned who discovered this issue. -- This message was sent by Atlassian JIRA (v6.1.5#6160)