[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14229296#comment-14229296 ] Hudson commented on HBASE-11689: SUCCESS: Integrated in HBase-0.98 #706 (See [https://builds.apache.org/job/HBase-0.98/706/]) HBASE-12479 Backport HBASE-11689 (Track meta in transition) (Virag Kothari) (apurtell: rev 9e9d3f4cec89af600ecc88a739e56552746e37fc) * hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/MetaRegionTracker.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java * hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java * hbase-protocol/src/main/protobuf/ZooKeeper.proto * hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java * hbase-server/src/test/java/org/apache/hadoop/hbase/catalog/TestCatalogTracker.java * hbase-client/src/main/java/org/apache/hadoop/hbase/master/RegionState.java * hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMasterFailover.java * hbase-client/src/main/java/org/apache/hadoop/hbase/ServerName.java * hbase-client/src/main/java/org/apache/hadoop/hbase/catalog/CatalogTracker.java * hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMasterNoCluster.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java * hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/ZooKeeperProtos.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/RegionStateStore.java Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 1.0.0, 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Fix For: 2.0.0 Attachments: HBASE-11689-branch-1.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, hbase-11689-revised.patch, hbase-11689-revised_2.patch, hbase-11689-revised_2.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14229324#comment-14229324 ] Hudson commented on HBASE-11689: SUCCESS: Integrated in HBase-0.98-on-Hadoop-1.1 #673 (See [https://builds.apache.org/job/HBase-0.98-on-Hadoop-1.1/673/]) HBASE-12479 Backport HBASE-11689 (Track meta in transition) (Virag Kothari) (apurtell: rev 9e9d3f4cec89af600ecc88a739e56552746e37fc) * hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMasterNoCluster.java * hbase-server/src/test/java/org/apache/hadoop/hbase/catalog/TestCatalogTracker.java * hbase-client/src/main/java/org/apache/hadoop/hbase/ServerName.java * hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/ZooKeeperProtos.java * hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java * hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMasterFailover.java * hbase-client/src/main/java/org/apache/hadoop/hbase/catalog/CatalogTracker.java * hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java * hbase-client/src/main/java/org/apache/hadoop/hbase/master/RegionState.java * hbase-protocol/src/main/protobuf/ZooKeeper.proto * hbase-server/src/main/java/org/apache/hadoop/hbase/master/RegionStateStore.java * hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/MetaRegionTracker.java Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 1.0.0, 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Fix For: 2.0.0 Attachments: HBASE-11689-branch-1.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, hbase-11689-revised.patch, hbase-11689-revised_2.patch, hbase-11689-revised_2.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14229451#comment-14229451 ] Hudson commented on HBASE-11689: SUCCESS: Integrated in HBase-0.98 #707 (See [https://builds.apache.org/job/HBase-0.98/707/]) HBASE-12479 Backport HBASE-11689 (Track meta in transition) (Virag Kothari); addendum (apurtell: rev 679e164e39066dfe9129fe7fada2fa5c3aac5b98) * hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestAssignmentManagerOnCluster.java Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 1.0.0, 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Fix For: 2.0.0 Attachments: HBASE-11689-branch-1.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, hbase-11689-revised.patch, hbase-11689-revised_2.patch, hbase-11689-revised_2.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14229462#comment-14229462 ] Hudson commented on HBASE-11689: SUCCESS: Integrated in HBase-0.98-on-Hadoop-1.1 #674 (See [https://builds.apache.org/job/HBase-0.98-on-Hadoop-1.1/674/]) HBASE-12479 Backport HBASE-11689 (Track meta in transition) (Virag Kothari); addendum (apurtell: rev 679e164e39066dfe9129fe7fada2fa5c3aac5b98) * hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestAssignmentManagerOnCluster.java Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 1.0.0, 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Fix For: 2.0.0 Attachments: HBASE-11689-branch-1.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, hbase-11689-revised.patch, hbase-11689-revised_2.patch, hbase-11689-revised_2.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14223747#comment-14223747 ] Hudson commented on HBASE-11689: SUCCESS: Integrated in HBase-0.98 #699 (See [https://builds.apache.org/job/HBase-0.98/699/]) Revert HBASE-12479 Backport HBASE-11689 (Track meta in transition) (Virag Kothari) (apurtell: rev 11bd497a9b33f47fa632f0fd06c758f0fdb79d20) * hbase-server/src/main/java/org/apache/hadoop/hbase/master/RegionStateStore.java * hbase-client/src/main/java/org/apache/hadoop/hbase/catalog/CatalogTracker.java * hbase-server/src/test/java/org/apache/hadoop/hbase/catalog/TestCatalogTracker.java * hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/MasterProtos.java * hbase-client/src/main/java/org/apache/hadoop/hbase/ServerName.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java * hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java * hbase-client/src/main/java/org/apache/hadoop/hbase/master/RegionState.java * hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java * hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/MetaRegionTracker.java * hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMasterNoCluster.java * hbase-protocol/src/main/protobuf/ZooKeeper.proto * hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMasterFailover.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java * hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/ZooKeeperProtos.java Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 1.0.0, 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Fix For: 2.0.0 Attachments: HBASE-11689-branch-1.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, hbase-11689-revised.patch, hbase-11689-revised_2.patch, hbase-11689-revised_2.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14223808#comment-14223808 ] Hudson commented on HBASE-11689: SUCCESS: Integrated in HBase-0.98-on-Hadoop-1.1 #666 (See [https://builds.apache.org/job/HBase-0.98-on-Hadoop-1.1/666/]) Revert HBASE-12479 Backport HBASE-11689 (Track meta in transition) (Virag Kothari) (apurtell: rev 11bd497a9b33f47fa632f0fd06c758f0fdb79d20) * hbase-client/src/main/java/org/apache/hadoop/hbase/catalog/CatalogTracker.java * hbase-client/src/main/java/org/apache/hadoop/hbase/master/RegionState.java * hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/ZooKeeperProtos.java * hbase-client/src/main/java/org/apache/hadoop/hbase/ServerName.java * hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMasterNoCluster.java * hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/RegionStateStore.java * hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java * hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMasterFailover.java * hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/MetaRegionTracker.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java * hbase-protocol/src/main/protobuf/ZooKeeper.proto * hbase-server/src/test/java/org/apache/hadoop/hbase/catalog/TestCatalogTracker.java * hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/MasterProtos.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 1.0.0, 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Fix For: 2.0.0 Attachments: HBASE-11689-branch-1.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, hbase-11689-revised.patch, hbase-11689-revised_2.patch, hbase-11689-revised_2.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14222198#comment-14222198 ] Hudson commented on HBASE-11689: SUCCESS: Integrated in HBase-1.0 #496 (See [https://builds.apache.org/job/HBase-1.0/496/]) HBASE-12479 Backport HBASE-11689 (Track meta in transition) (Virag Kothari) (apurtell: rev 9904252615d74e94eb33439ec7faa97f5d1e515d) * hbase-protocol/src/main/protobuf/ZooKeeper.proto * hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMasterNoCluster.java * hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMasterFailover.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java * hbase-client/src/main/java/org/apache/hadoop/hbase/ServerName.java * hbase-server/src/test/java/org/apache/hadoop/hbase/TestMetaTableLocator.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java * hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/ZooKeeperProtos.java * hbase-client/src/main/java/org/apache/hadoop/hbase/master/RegionState.java * hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestAssignmentManagerOnCluster.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/RegionStateStore.java * hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/MetaTableLocator.java * hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 1.0.0, 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Fix For: 2.0.0 Attachments: HBASE-11689-branch-1.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, hbase-11689-revised.patch, hbase-11689-revised_2.patch, hbase-11689-revised_2.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1405#comment-1405 ] Hudson commented on HBASE-11689: FAILURE: Integrated in HBase-0.98 #696 (See [https://builds.apache.org/job/HBase-0.98/696/]) HBASE-12479 Backport HBASE-11689 (Track meta in transition) (Virag Kothari) (apurtell: rev 0a5ab37d77532a3fd068789e07b6c55522d8dbe2) * hbase-client/src/main/java/org/apache/hadoop/hbase/master/RegionState.java * hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java * hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMasterFailover.java * hbase-server/src/test/java/org/apache/hadoop/hbase/catalog/TestCatalogTracker.java * hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/MetaRegionTracker.java * hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java * hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMasterNoCluster.java * hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/ZooKeeperProtos.java * hbase-protocol/src/main/protobuf/ZooKeeper.proto * hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/RegionStateStore.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java * hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/MasterProtos.java * hbase-client/src/main/java/org/apache/hadoop/hbase/ServerName.java * hbase-client/src/main/java/org/apache/hadoop/hbase/catalog/CatalogTracker.java Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 1.0.0, 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Fix For: 2.0.0 Attachments: HBASE-11689-branch-1.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, hbase-11689-revised.patch, hbase-11689-revised_2.patch, hbase-11689-revised_2.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1454#comment-1454 ] Hudson commented on HBASE-11689: FAILURE: Integrated in HBase-0.98-on-Hadoop-1.1 #663 (See [https://builds.apache.org/job/HBase-0.98-on-Hadoop-1.1/663/]) HBASE-12479 Backport HBASE-11689 (Track meta in transition) (Virag Kothari) (apurtell: rev 0a5ab37d77532a3fd068789e07b6c55522d8dbe2) * hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMasterFailover.java * hbase-client/src/main/java/org/apache/hadoop/hbase/ServerName.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java * hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java * hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMasterNoCluster.java * hbase-client/src/main/java/org/apache/hadoop/hbase/master/RegionState.java * hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/MetaRegionTracker.java * hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/MasterProtos.java * hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java * hbase-protocol/src/main/protobuf/ZooKeeper.proto * hbase-server/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java * hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/ZooKeeperProtos.java * hbase-server/src/test/java/org/apache/hadoop/hbase/catalog/TestCatalogTracker.java * hbase-client/src/main/java/org/apache/hadoop/hbase/catalog/CatalogTracker.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/RegionStateStore.java Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 1.0.0, 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Fix For: 2.0.0 Attachments: HBASE-11689-branch-1.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, hbase-11689-revised.patch, hbase-11689-revised_2.patch, hbase-11689-revised_2.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14119009#comment-14119009 ] Enis Soztutar commented on HBASE-11689: --- Thanks [~jxiang]. I think there was something else wrong with my setup. Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 1.0.0, 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Fix For: 2.0.0 Attachments: HBASE-11689-branch-1.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, hbase-11689-revised.patch, hbase-11689-revised_2.patch, hbase-11689-revised_2.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116618#comment-14116618 ] Jimmy Xiang commented on HBASE-11689: - These tests are ok locally. Looking into it now. Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 1.0.0, 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Attachments: HBASE-11689-branch-1.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, hbase-11689-revised.patch, hbase-11689-revised_2.patch, hbase-11689-revised_2.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115027#comment-14115027 ] Mikhail Antonov commented on HBASE-11689: - Patch is stale, could you rebase it? Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 1.0.0, 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Attachments: HBASE-11689-branch-1.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115209#comment-14115209 ] Hadoop QA commented on HBASE-11689: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12665307/HBASE-11689.patch against trunk revision . ATTACHMENT ID: 12665307 {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 12 new or modified tests. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 lineLengths{color}. The patch does not introduce lines longer than 100 {color:green}+1 site{color}. The mvn site goal succeeds with this patch. {color:red}-1 core tests{color}. The patch failed these unit tests: org.apache.hadoop.hbase.replication.TestPerTableCFReplication org.apache.hadoop.hbase.TestRegionRebalancing {color:red}-1 core zombie tests{color}. There are 4 zombie test(s): Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/10639//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10639//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10639//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10639//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10639//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10639//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10639//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10639//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10639//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10639//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/10639//console This message is automatically generated. Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 1.0.0, 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Attachments: HBASE-11689-branch-1.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115333#comment-14115333 ] Jimmy Xiang commented on HBASE-11689: - I am making some change to the patch. I will upload the revised patch shortly. Thanks. Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 1.0.0, 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Attachments: HBASE-11689-branch-1.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115340#comment-14115340 ] Andrey Stepachev commented on HBASE-11689: -- Thank you [~jxiang]. Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 1.0.0, 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Attachments: HBASE-11689-branch-1.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115610#comment-14115610 ] Hadoop QA commented on HBASE-11689: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12665365/hbase-11689-revised.patch against trunk revision . ATTACHMENT ID: 12665365 {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 12 new or modified tests. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 lineLengths{color}. The patch does not introduce lines longer than 100 {color:green}+1 site{color}. The mvn site goal succeeds with this patch. {color:red}-1 core tests{color}. The patch failed these unit tests: org.apache.hadoop.hbase.master.TestRestartCluster org.apache.hadoop.hbase.util.hbck.TestOfflineMetaRebuildBase org.apache.hadoop.hbase.TestRegionRebalancing org.apache.hadoop.hbase.master.TestDistributedLogSplitting {color:red}-1 core zombie tests{color}. There are 4 zombie test(s): Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/10645//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10645//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10645//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10645//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10645//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10645//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10645//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10645//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10645//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10645//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/10645//console This message is automatically generated. Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 1.0.0, 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Attachments: HBASE-11689-branch-1.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, hbase-11689-revised.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115615#comment-14115615 ] Jimmy Xiang commented on HBASE-11689: - Looking the failed tests. Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 1.0.0, 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Attachments: HBASE-11689-branch-1.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, hbase-11689-revised.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115767#comment-14115767 ] Jimmy Xiang commented on HBASE-11689: - [~octo47], are you ok with my changes? Thanks. Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 1.0.0, 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Attachments: HBASE-11689-branch-1.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, hbase-11689-revised.patch, hbase-11689-revised_2.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115778#comment-14115778 ] Andrey Stepachev commented on HBASE-11689: -- Great, [~jxiang], I would have to guess myself to use RegionState. I'm perfectly well with current patch. Thank you! Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 1.0.0, 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Attachments: HBASE-11689-branch-1.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, hbase-11689-revised.patch, hbase-11689-revised_2.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115833#comment-14115833 ] Hadoop QA commented on HBASE-11689: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12665407/hbase-11689-revised_2.patch against trunk revision . ATTACHMENT ID: 12665407 {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 12 new or modified tests. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 lineLengths{color}. The patch does not introduce lines longer than 100 {color:green}+1 site{color}. The mvn site goal succeeds with this patch. {color:red}-1 core tests{color}. The patch failed these unit tests: org.apache.hadoop.hbase.TestClassFinder Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/10648//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10648//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10648//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10648//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10648//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10648//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10648//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10648//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10648//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10648//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/10648//console This message is automatically generated. Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 1.0.0, 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Attachments: HBASE-11689-branch-1.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, hbase-11689-revised.patch, hbase-11689-revised_2.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115982#comment-14115982 ] Hadoop QA commented on HBASE-11689: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12665442/hbase-11689-revised_2.patch against trunk revision . ATTACHMENT ID: 12665442 {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 12 new or modified tests. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 lineLengths{color}. The patch does not introduce lines longer than 100 {color:green}+1 site{color}. The mvn site goal succeeds with this patch. {color:red}-1 core tests{color}. The patch failed these unit tests: Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/10651//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10651//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10651//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10651//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10651//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10651//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10651//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10651//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10651//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10651//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/10651//console This message is automatically generated. Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 1.0.0, 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Attachments: HBASE-11689-branch-1.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, hbase-11689-revised.patch, hbase-11689-revised_2.patch, hbase-11689-revised_2.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115989#comment-14115989 ] Hadoop QA commented on HBASE-11689: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12665442/hbase-11689-revised_2.patch against trunk revision . ATTACHMENT ID: 12665442 {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 12 new or modified tests. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 lineLengths{color}. The patch does not introduce lines longer than 100 {color:red}-1 site{color}. The patch appears to cause mvn site goal to fail. {color:red}-1 core tests{color}. The patch failed these unit tests: org.apache.hadoop.hbase.TestClassFinder Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/10652//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10652//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10652//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10652//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10652//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10652//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10652//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10652//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10652//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10652//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/10652//console This message is automatically generated. Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 1.0.0, 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Attachments: HBASE-11689-branch-1.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, hbase-11689-revised.patch, hbase-11689-revised_2.patch, hbase-11689-revised_2.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116101#comment-14116101 ] Hudson commented on HBASE-11689: FAILURE: Integrated in HBase-TRUNK #5448 (See [https://builds.apache.org/job/HBase-TRUNK/5448/]) HBASE-11689 Track meta in transition (Andrey Stepachev and Jimmy Xiang) (jxiang: rev b7f7514762433a7a02635e141e60d0e2ba333049) * hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/ZKUtil.java * hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMasterFailover.java * hbase-server/src/test/java/org/apache/hadoop/hbase/TestMetaTableLocator.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java * hbase-client/src/main/java/org/apache/hadoop/hbase/ServerName.java * hbase-protocol/src/main/protobuf/ZooKeeper.proto * hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMasterNoCluster.java * hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestAssignmentManagerOnCluster.java * hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/ZooKeeperProtos.java * hbase-client/src/main/java/org/apache/hadoop/hbase/master/RegionState.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/MetaServerShutdownHandler.java * hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/MetaTableLocator.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/RegionStateStore.java * hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 1.0.0, 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Attachments: HBASE-11689-branch-1.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, hbase-11689-revised.patch, hbase-11689-revised_2.patch, hbase-11689-revised_2.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116175#comment-14116175 ] Enis Soztutar commented on HBASE-11689: --- It seems that this is committed but left open and no indication from the committer that it has been committed. I think this fails some of the tests in master right now for me (verified with manual bisecting). An example test is TestDistributedLogSplitting. [~jxiang] can you please check it or revert the patch. Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 1.0.0, 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Attachments: HBASE-11689-branch-1.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, hbase-11689-revised.patch, hbase-11689-revised_2.patch, hbase-11689-revised_2.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113708#comment-14113708 ] Hadoop QA commented on HBASE-11689: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12664964/HBASE-11689-branch-1.patch against trunk revision . ATTACHMENT ID: 12664964 {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 12 new or modified tests. {color:red}-1 patch{color}. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/10619//console This message is automatically generated. Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 1.0.0, 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Attachments: HBASE-11689-branch-1.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112475#comment-14112475 ] Virag Kothari commented on HBASE-11689: --- Hi [~octo47], Thanks for working on this. As zk less assignment is backported to 0.98, it would be good to have this one there too. Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Attachments: HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112530#comment-14112530 ] Andrey Stepachev commented on HBASE-11689: -- [~virag] patch has a couple of refactoring and renames which would not be acceptable to 0.98. would you like to review it for, is it usable for 0.98. Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Attachments: HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112598#comment-14112598 ] Virag Kothari commented on HBASE-11689: --- bq. would you like to review it for, is it usable for 0.98. Definitely very usable. It would be great if you can have a patch for 0.98. I will review. Thxs Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Attachments: HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112750#comment-14112750 ] Hadoop QA commented on HBASE-11689: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12664669/HBASE-11689.patch against trunk revision . ATTACHMENT ID: 12664669 {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 18 new or modified tests. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 lineLengths{color}. The patch does not introduce lines longer than 100 {color:green}+1 site{color}. The mvn site goal succeeds with this patch. {color:red}-1 core tests{color}. The patch failed these unit tests: org.apache.hadoop.hbase.regionserver.TestTags org.apache.hadoop.hbase.client.TestReplicaWithCluster org.apache.hadoop.hbase.replication.TestPerTableCFReplication org.apache.hadoop.hbase.TestMetaTableLocator {color:red}-1 core zombie tests{color}. There are 5 zombie test(s): at org.apache.hadoop.hbase.mapreduce.TestImportTsv.testBulkOutputWithTsvImporterTextMapper(TestImportTsv.java:227) Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/10611//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10611//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10611//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10611//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10611//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10611//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10611//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10611//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10611//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10611//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/10611//console This message is automatically generated. Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Attachments: HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112909#comment-14112909 ] Jimmy Xiang commented on HBASE-11689: - Looks good to me. +1. As to the issue about ZooKeeperProtos.Master vs MetaRegionServer, we can fix it at commit if it is ok with you. Thanks a lot for the patch and making the changes. Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Attachments: HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112925#comment-14112925 ] Andrey Stepachev commented on HBASE-11689: -- Looks good for me too. Thank you [~jxiang] for reviewing. ZooKeeperProtos.Master now not an issue currently, all code now uses MetaRegionLocator methods for MetaRegionServer. As for ServerName#parseFrom, it used only for ZooKeeperProtos.Master records only. Of course it will be better to move this method to somewhere (ZkUtils?) and rename to something more meaningful. Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Attachments: HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch, HBASE-11689.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110615#comment-14110615 ] Andrey Stepachev commented on HBASE-11689: -- bq. Is there a place we need the whole structure? Yes, you are right. Reverted back and introduce new name getMetaRegionLocationAndState. This method is only used in master during startup. Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Attachments: HBASE-11689.patch, HBASE-11689.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109105#comment-14109105 ] Andrey Stepachev commented on HBASE-11689: -- [~jxiang], can you look at this patch (https://reviews.apache.org/r/24996/) and make some comments? Thank you. Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Attachments: HBASE-11689.patch, HBASE-11689.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109108#comment-14109108 ] Hadoop QA commented on HBASE-11689: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12664146/HBASE-11689.patch against trunk revision . ATTACHMENT ID: 12664146 {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 18 new or modified tests. {color:red}-1 javac{color}. The patch appears to cause mvn compile goal to fail. Compilation errors resume: [ERROR] COMPILATION ERROR : [ERROR] /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase-client/src/main/java/org/apache/hadoop/hbase/MetaRegionLocation.java:[132,25] error: cannot find symbol [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.5.1:compile (default-compile) on project hbase-client: Compilation failure [ERROR] /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/hbase-client/src/main/java/org/apache/hadoop/hbase/MetaRegionLocation.java:[132,25] error: cannot find symbol [ERROR] - [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn goals -rf :hbase-client Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/10562//console This message is automatically generated. Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Attachments: HBASE-11689.patch, HBASE-11689.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109171#comment-14109171 ] Hadoop QA commented on HBASE-11689: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12664147/HBASE-11689.patch against trunk revision . ATTACHMENT ID: 12664147 {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 18 new or modified tests. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:red}-1 javadoc{color}. The javadoc tool appears to have generated 11 warning messages. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:red}-1 lineLengths{color}. The patch introduces the following lines longer than 100: + ZooKeeperProtos.MetaRegionServer.PARSER.parseFrom(data, prefixLen, data.length - prefixLen); + serverName = ServerName.valueOf(parseZNode(data, ZooKeeperProtos.MetaRegionServer.PARSER).getServer()); +MetaRegionLocation rl = master.getMetaTableLocator().getMetaRegionLocation(master.getZooKeeper()); + MetaRegionLocation rl = master.getMetaTableLocator().getMetaRegionLocation(master.getZooKeeper()); {color:green}+1 site{color}. The mvn site goal succeeds with this patch. {color:red}-1 core tests{color}. The patch failed these unit tests: {color:red}-1 core zombie tests{color}. There are 1 zombie test(s): at org.apache.hadoop.hbase.io.crypto.TestEncryption.testSmallBlocks(TestEncryption.java:48) Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/10563//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10563//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10563//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10563//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10563//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10563//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10563//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10563//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10563//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/10563//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/10563//console This message is automatically generated. Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Attachments: HBASE-11689.patch, HBASE-11689.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109748#comment-14109748 ] Jimmy Xiang commented on HBASE-11689: - bq. + required RegionState.State state = 3; This should be optional. You renamed getMetaRegionLocation to getMetaServerName? Probably it is better to keep the original name? Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Attachments: HBASE-11689.patch, HBASE-11689.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109781#comment-14109781 ] Andrey Stepachev commented on HBASE-11689: -- Thank you Jimmy for reviewing. bq. required RegionState.State state = 3; yeah, definitely optional is better. fixed. bq. You renamed getMetaRegionLocation to getMetaServerName? Probably it is better to keep the original name? MetaTableLocator is private interface, but this names more precisely shows what actually requested. getMetaRegionLocation now returns whole structure including current state in oppose to getMetaServerName, which returns only ServerName. Does it make sense to rename them back? Can you suggest, how method, returning MetaRegionLocation structure can be named after renaming? Thank you. Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Attachments: HBASE-11689.patch, HBASE-11689.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109839#comment-14109839 ] Jimmy Xiang commented on HBASE-11689: - bq. getMetaRegionLocation now returns whole structure including current state Is there a place we need the whole structure? The old places that need the meta location can keep use the original getMetaRegionLocation. Only when master starts up, it needs to check the additional RegionState to find out if the meta is in transition, right? Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Attachments: HBASE-11689.patch, HBASE-11689.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108681#comment-14108681 ] Mikhail Antonov commented on HBASE-11689: - Looks pretty good. I added some comments there. A question - does this patch assume that meta is co-located with master? Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Attachments: HBASE-11689.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108737#comment-14108737 ] Andrey Stepachev commented on HBASE-11689: -- Thank you, Mikhail, for review. I'll address issues shortly. bq. A question - does this patch assume that meta is co-located with master? I think - not. In fact, this patch gives responsibility of writing metalocation to AssignmentManager, but not imply anything about meta location. Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Attachments: HBASE-11689.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107468#comment-14107468 ] Andrey Stepachev commented on HBASE-11689: -- https://reviews.apache.org/r/24996/ Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 2.0.0 Reporter: Jimmy Xiang Assignee: Andrey Stepachev Attachments: HBASE-11689.patch With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096724#comment-14096724 ] Andrey Stepachev commented on HBASE-11689: -- Researched how it implemented now. We have a couple of options to do this task: # We can, as proposed in comments above, enhance MetaRegionServer with additional _optional_ field typed RegionState.State. But that solution has implications: #* we need to combat with possibly concurrent updates (RS and Master, both write to that znode) #* RS has to know what state to write into updated PB (read and versioned update, I suppose). # We can create new znode or hierarchy of znodes and store state for each meta region (only for one currently) and can restrict PB to have all fields _required_. I'd prefer to go with second solution, it is more cosine and provides good visibility and write paths (only Master writes to state and only RS writes to location znode). What do you think about that. Or there is another, better solution exists? Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Reporter: Jimmy Xiang Assignee: Andrey Stepachev With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097109#comment-14097109 ] Jimmy Xiang commented on HBASE-11689: - How about go with option 1 and make sure only master updates it? It doesn't help for the RS to update this znode since the meta is still not online anyway without letting the master know. Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Reporter: Jimmy Xiang Assignee: Andrey Stepachev With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097145#comment-14097145 ] Andrey Stepachev commented on HBASE-11689: -- [~jxiang] Making only master write this znode make sense. Lets go with 1. Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Reporter: Jimmy Xiang Assignee: Andrey Stepachev With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097232#comment-14097232 ] Mikhail Antonov commented on HBASE-11689: - Yeah, this approach looks most practical to me (for the time being at least). Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Reporter: Jimmy Xiang Assignee: Andrey Stepachev With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095259#comment-14095259 ] Andrey Stepachev commented on HBASE-11689: -- [~jxiang], I'd like to help with this jira. Is it ok if i'll take it for me? Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Reporter: Jimmy Xiang With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095549#comment-14095549 ] Jimmy Xiang commented on HBASE-11689: - Cool, that's great. Assigned to you. Thanks. Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Reporter: Jimmy Xiang Assignee: Andrey Stepachev With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089176#comment-14089176 ] Jimmy Xiang commented on HBASE-11689: - It's a different. ZK-based assignment uses ZK to coordinate, zk-less uses RPC. We can use the meta location znode to do the tracking. Currently, the meta location znode has a PB MetaRegionServer. We can add the state info to it, just as we did for region state in meta row. Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Reporter: Jimmy Xiang With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089349#comment-14089349 ] stack commented on HBASE-11689: --- bq. We can add the state info to it, just as we did for region state in meta row. We'd have one system to look up user regions and another to look up meta regions? bq. Are we going to support many small meta regions? Lets back up and talk about being able to split meta first. Thats a big change. Lets make a system that will work for two and two hundred regions in meta. +1 on recording in znode meta transition state for now while one meta region only. Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Reporter: Jimmy Xiang With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14088348#comment-14088348 ] Jimmy Xiang commented on HBASE-11689: - This is needed for not co-locating meta and master. Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Reporter: Jimmy Xiang With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14088354#comment-14088354 ] stack commented on HBASE-11689: --- Bring back -ROOT- region! (smile) Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Reporter: Jimmy Xiang With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14088489#comment-14088489 ] Mikhail Antonov commented on HBASE-11689: - [~jxiang] do you mean tracking it in ZK, by adding some other znodes to track the state? Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Reporter: Jimmy Xiang With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14088505#comment-14088505 ] Jimmy Xiang commented on HBASE-11689: - If we have just 1 or several meta regions, ZK is a good option. If we are going to have many meta regions, ZK may not be good. Are we going to support many small meta regions? Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Reporter: Jimmy Xiang With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HBASE-11689) Track meta in transition
[ https://issues.apache.org/jira/browse/HBASE-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14088521#comment-14088521 ] Mikhail Antonov commented on HBASE-11689: - As now I believe we only allow 1 meta region, I guess the question then is - (how) do we split meta? In longer term using ZK for tracking seems contradict to zk-less assignment :) Track meta in transition Key: HBASE-11689 URL: https://issues.apache.org/jira/browse/HBASE-11689 Project: HBase Issue Type: Bug Components: Region Assignment Reporter: Jimmy Xiang With ZK-less region assignment, user regions in transition are tracked in meta. We need a way to track meta in transition too. -- This message was sent by Atlassian JIRA (v6.2#6252)