[jira] [Created] (HBASE-10576) Custom load balancer to co-locate the regions of two tables which are having same split keys
rajeshbabu created HBASE-10576: -- Summary: Custom load balancer to co-locate the regions of two tables which are having same split keys Key: HBASE-10576 URL: https://issues.apache.org/jira/browse/HBASE-10576 Project: HBase Issue Type: Sub-task Components: Balancer Reporter: rajeshbabu Assignee: rajeshbabu To support local indexing both user table and index table should have same split keys. This issue to provide custom balancer to colocate the regions of two tables which are having same split keys. This helps in Phoenix as well. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Created] (HBASE-10577) Remove unnecessary looping in FSHLog
Himanshu Vashishtha created HBASE-10577:
---
Summary: Remove unnecessary looping in FSHLog
Key: HBASE-10577
URL: https://issues.apache.org/jira/browse/HBASE-10577
Project: HBase
Issue Type: Bug
Components: wal
Affects Versions: 0.99.0
Reporter: Himanshu Vashishtha
In the new disruptor based FSHLog, the Syncer threads are handed a batch of
SyncFuture objects from the RingBufferHandler. The Syncer then invokes a sync
call on the current writer instance.
This handing of batch is done in serially in RingBufferHandler, that is, every
syncer receives a non overlapping batch of SyncFutures. Once synced, Syncer
thread updates highestSyncedSequence.
In the run method of Syncer, we have:
{code}
long currentHighestSyncedSequence = highestSyncedSequence.get();
if (currentSequence currentHighestSyncedSequence) {
syncCount += releaseSyncFuture(takeSyncFuture,
currentHighestSyncedSequence, null);
// Done with the 'take'. Go around again and do a new 'take'.
continue;
}
{code}
I find this logic of polling the BlockingQueue again in this condition
un-necessary. When the currentHighestSyncedSequence is already greater than
currentSequence, then doesn't it mean some other Syncer has already synced
SyncFuture of these ops ? And, we should just go ahead and release all the
SyncFutures for this batch to unblock the handlers. That would avoid polling
the Blockingqueue for all SyncFuture objects in this case.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
[jira] [Created] (HBASE-10578) For the same row key, the KV in the newest StoreFile should be returned
Amitanand Aiyer created HBASE-10578: --- Summary: For the same row key, the KV in the newest StoreFile should be returned Key: HBASE-10578 URL: https://issues.apache.org/jira/browse/HBASE-10578 Project: HBase Issue Type: Bug Components: Scanners Affects Versions: 0.89-fb, 0.98.1 Reporter: Amitanand Aiyer Priority: Minor -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Created] (HBASE-10579) [Documentation]: ExportSnapshot tool package incorrectly documented
Aleksandr Shulman created HBASE-10579: - Summary: [Documentation]: ExportSnapshot tool package incorrectly documented Key: HBASE-10579 URL: https://issues.apache.org/jira/browse/HBASE-10579 Project: HBase Issue Type: Bug Components: documentation, snapshots Affects Versions: 0.98.0 Reporter: Aleksandr Shulman Priority: Minor Fix For: 0.96.2, 0.98.1 Documentation Page: http://hbase.apache.org/book/ops.snapshots.html Expected documentation: The class should be specified as org.apache.hadoop.hbase.snapshot.ExportSnapshot Current documentation: Specified as: org.apache.hadoop.hbase.snapshot.tool.ExportSnapshot This makes sense because the class is located in the org.apache.hadoop.hbase.snapshot package: https://github.com/apache/hbase/blob/0.98/hbase-server/src/main/java/org/apache/hadoop/hbase/snapshot/ExportSnapshot.java#19 -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Created] (HBASE-10580) IntegrationTestingUtility#restoreCluster leak resource when running in a mini cluster mode
Jeffrey Zhong created HBASE-10580: - Summary: IntegrationTestingUtility#restoreCluster leak resource when running in a mini cluster mode Key: HBASE-10580 URL: https://issues.apache.org/jira/browse/HBASE-10580 Project: HBase Issue Type: Bug Components: test Affects Versions: 0.96.1, 0.96.0, 0.98.0, 0.99.0 Reporter: Jeffrey Zhong When the utility isn't run in distributed cluster mode, the restore only shutdown MiniHBaseCluster not MiniDFSCluster MiniZKCluster. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Created] (HBASE-10581) ACL znode is left without PBed during upgrading hbase0.94* to hbase0.96+
Jeffrey Zhong created HBASE-10581: - Summary: ACL znode is left without PBed during upgrading hbase0.94* to hbase0.96+ Key: HBASE-10581 URL: https://issues.apache.org/jira/browse/HBASE-10581 Project: HBase Issue Type: Bug Reporter: Jeffrey Zhong Assignee: Jeffrey Zhong ACL znodes are left in the upgrade process when upgrading 0.94 to 0.96+ Those 0.94 znodes will choke HMaster because their data aren't PBed. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Created] (HBASE-10582) 0.94-0.96 Upgrade: ACL can't be repopulated when ACL table contains row for table '-ROOT' or '.META.'
Jeffrey Zhong created HBASE-10582: - Summary: 0.94-0.96 Upgrade: ACL can't be repopulated when ACL table contains row for table '-ROOT' or '.META.' Key: HBASE-10582 URL: https://issues.apache.org/jira/browse/HBASE-10582 Project: HBase Issue Type: Bug Affects Versions: 0.96.1, 0.96.0, 0.98.0 Reporter: Jeffrey Zhong Assignee: Jeffrey Zhong Priority: Critical When '-ROOT-', '.META' rows are contained in ACL table, during upgrade process, ACL zk nodes can't be populated to zookeeper because AccessControlLists#loadAll(HRegion) fails to load table permissions due to parsePermissionRecord throws IllegalArgumentException from TableName.valueof. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
Re: [VOTE] The 2nd hbase 0.94.17 release candidate is available for download
+1 - checked documentation and tarball - Ran in local and distributes mode - checked the UI pages - loaded 100m KeyValues - tested scan performance - converted between FAST_DIFF and NONE encoding - tested flushes and compactions -- Lars From: lars hofhansl la...@apache.org To: hbase-dev dev@hbase.apache.org Sent: Tuesday, February 18, 2014 8:31 PM Subject: [VOTE] The 2nd hbase 0.94.17 release candidate is available for download The 2nd 0.94.17 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.17-rc1/ Signed with my code signing key: C7CFE328 HBase 0.94.17 is a bug fix release with 35 fixes: [HBASE-7963] - HBase VerifyReplication not working when security enabled [HBASE-10249] - TestReplicationSyncUpTool fails because failover takes too long [HBASE-10274] - MiniZookeeperCluster should close ZKDatabase when shutdown ZooKeeperServers [HBASE-10319] - HLog should roll periodically to allow DN decommission to eventually complete. [HBASE-10320] - Avoid ArrayList.iterator() ExplicitColumnTracker [HBASE-10335] - AuthFailedException in zookeeper may block replication forever [HBASE-10340] - [BACKPORT] HBASE-9892 Add info port to ServerName to support multi instances in a node [HBASE-10363] - [0.94] TestInputSampler and TestInputSamplerTool fail under hadoop 2.0/23 profiles. [HBASE-10371] - Compaction creates empty hfile, then selects this file for compaction and creates empty hfile and over again [HBASE-10383] - Secure Bulk Load for 'completebulkload' fails for version 0.94.15 [HBASE-10400] - [hbck] Continue if region dir missing on region merge attempt [HBASE-10401] - [hbck] perform overlap group merges in parallel [HBASE-10448] - ZKUtil create and watch methods don't set watch in some cases [HBASE-10470] - Import generates huge log file while importing large amounts of data [HBASE-10481] - API Compatibility JDiff script does not properly handle arguments in reverse order [HBASE-10482] - ReplicationSyncUp doesn't clean up its ZK, needed for tests [HBASE-10485] - PrefixFilter#filterKeyValue() should perform filtering on row key [HBASE-10489] - TestImportExport fails in 0.94 with Hadoop2 [HBASE-10493] - InclusiveStopFilter#filterKeyValue() should perform filtering on row key [HBASE-10501] - Improve IncreasingToUpperBoundRegionSplitPolicy to avoid too many regions [HBASE-10505] - Import.filterKv does not call Filter.filterRowKey [HBASE-10506] - Fail-fast if client connection is lost before the real call be executed in RPC layer [HBASE-10508] - Backport HBASE-10365 'HBaseFsck should clean up connection properly when repair is completed' to 0.94 and 0.96 [HBASE-10539] - HRegion.addAndGetGlobalMemstoreSize returns previous size [HBASE-10545] - RS Hangs waiting on region to close on shutdown; has to timeout before can go down [HBASE-10546] - Two scanner objects are open for each hbase map task but only one scanner object is closed [HBASE-10551] - Change local mode back to one RS thread by default [HBASE-10552] - HFilePerformanceEvaluation.GaussianRandomReadBenchmark fails sometimes. [HBASE-10555] - Backport HBASE-8519 to 0.94, Backup master will never come up if primary master dies during initialization [HBASE-10562] - Fix TestMultiTableInputFormat for Hadoop 2 in 0.94 [HBASE-10212] - New rpc metric: number of active handler [HBASE-10423] - Report back the message of split or rollback failure to the master [HBASE-10457] - Print corrupted file information in SnapshotInfo tool without -file option [HBASE-10473] - Add utility for adorning http Context [HBASE-10480] - TestLogRollPeriod#testWithEdits may fail due to insufficient waiting Notable in this release is HBASE-10501, which changes how regions are distributed for an initially empty table. The list of changes is also available here: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753version=12325845 Here're the jenkins runs for this RC: https://builds.apache.org/job/HBase-0.94.17/15/ and https://builds.apache.org/job/HBase-0.94.17-security/5/ Please try out the RC, check out the doc, take it for a spin, etc, and vote +1/-1 by EOD February 24th on whether we should release this as 0.94.17. As before, I realize that release testing is like pulling teeth, but please give this is quick run, so we can get these bug fixes out there. Thanks. -- Lars
[jira] [Created] (HBASE-10583) backport HBASE-8402 to 0.94
Liu Shaohui created HBASE-10583: --- Summary: backport HBASE-8402 to 0.94 Key: HBASE-10583 URL: https://issues.apache.org/jira/browse/HBASE-10583 Project: HBase Issue Type: Bug Reporter: Liu Shaohui see HBASE-8402 -- This message was sent by Atlassian JIRA (v6.1.5#6160)
