[jira] [Resolved] (HBASE-12446) [list | abort] Compactions
[ https://issues.apache.org/jira/browse/HBASE-12446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju resolved HBASE-12446. Resolution: Incomplete I'm not actively working on this task. Will mark it incomplete. Incase anyone else wants to pick it up, go for it. > [list | abort] Compactions > -- > > Key: HBASE-12446 > URL: https://issues.apache.org/jira/browse/HBASE-12446 > Project: HBase > Issue Type: New Feature >Affects Versions: 1.0.0 >Reporter: Manukranth Kolloju > Original Estimate: 168h > Remaining Estimate: 168h > > In some cases, we would need to quickly reduce load on a server without > killing it. Compactions is one of the critical processes which takes up a lot > of CPU and disk IOPS. We should have a way to list compactions given the > regionserver and abort compactions given regionserver and compaction id. And > additionally abort all compactions. > Pardon me if there was already a similar Jira, I'd be happy to merge this > there. > The current code handles interrupts. We should be able to interrupt the > thread that is performing the compaction and abort it from either the UI or > from the command line. This Jira is targeted to expose an admin function to > perform such a task. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-12888) Display number of regions on the table jsp page.
Manukranth Kolloju created HBASE-12888: -- Summary: Display number of regions on the table jsp page. Key: HBASE-12888 URL: https://issues.apache.org/jira/browse/HBASE-12888 Project: HBase Issue Type: Improvement Components: regionserver Affects Versions: 1.0.0 Reporter: Manukranth Kolloju Priority: Trivial Fix For: 1.0.0 This is a simple patch to display the number of regions in the table jsp page in the info web page. Currently we have only the total number of regions in the regionserver. This adds the per table count of the regions. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Reopened] (HBASE-12771) TestFailFast#testFastFail failing
[
https://issues.apache.org/jira/browse/HBASE-12771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manukranth Kolloju reopened HBASE-12771:
> TestFailFast#testFastFail failing
> -
>
> Key: HBASE-12771
> URL: https://issues.apache.org/jira/browse/HBASE-12771
> Project: HBase
> Issue Type: Bug
> Components: test
>Affects Versions: 1.0.0
>Reporter: stack
>Assignee: Manukranth Kolloju
>
> Fails on our internal rig and from time to time on apache. Here is latest:
> {code}
> org.apache.hadoop.hbase.client.TestFastFail.testFastFail
> Failing for the past 1 build (Since Failed#654 )
> Took 7.1 sec.
> Error Message
> Only few thread should ideally be waiting for the dead regionserver to be
> coming back. numBlockedWorkers:155 threads that retried : 10
> Stacktrace
> java.lang.AssertionError: Only few thread should ideally be waiting for the
> dead regionserver to be coming back. numBlockedWorkers:155 threads that
> retried : 10
> at org.junit.Assert.fail(Assert.java:88)
> at org.junit.Assert.assertTrue(Assert.java:41)
> at
> org.apache.hadoop.hbase.client.TestFastFail.testFastFail(TestFastFail.java:270)
> {code}
> Opening this issue so can start tracking the fails. Looking in log, nothing
> obvious. Will be back to this one.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Resolved] (HBASE-12771) TestFailFast#testFastFail failing
[
https://issues.apache.org/jira/browse/HBASE-12771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manukranth Kolloju resolved HBASE-12771.
Resolution: Fixed
> TestFailFast#testFastFail failing
> -
>
> Key: HBASE-12771
> URL: https://issues.apache.org/jira/browse/HBASE-12771
> Project: HBase
> Issue Type: Bug
> Components: test
>Affects Versions: 1.0.0
>Reporter: stack
>Assignee: Manukranth Kolloju
>
> Fails on our internal rig and from time to time on apache. Here is latest:
> {code}
> org.apache.hadoop.hbase.client.TestFastFail.testFastFail
> Failing for the past 1 build (Since Failed#654 )
> Took 7.1 sec.
> Error Message
> Only few thread should ideally be waiting for the dead regionserver to be
> coming back. numBlockedWorkers:155 threads that retried : 10
> Stacktrace
> java.lang.AssertionError: Only few thread should ideally be waiting for the
> dead regionserver to be coming back. numBlockedWorkers:155 threads that
> retried : 10
> at org.junit.Assert.fail(Assert.java:88)
> at org.junit.Assert.assertTrue(Assert.java:41)
> at
> org.apache.hadoop.hbase.client.TestFastFail.testFastFail(TestFastFail.java:270)
> {code}
> Opening this issue so can start tracking the fails. Looking in log, nothing
> obvious. Will be back to this one.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (HBASE-12446) [list | abort] Compactions
Manukranth Kolloju created HBASE-12446: -- Summary: [list | abort] Compactions Key: HBASE-12446 URL: https://issues.apache.org/jira/browse/HBASE-12446 Project: HBase Issue Type: New Feature Affects Versions: 1.0.0 Reporter: Manukranth Kolloju Fix For: 1.0.0 In some cases, we would need to quickly reduce load on a server without killing it. Compactions is one of the critical processes which takes up a lot of CPU and disk IOPS. We should have a way to list compactions given the regionserver and abort compactions given regionserver and compaction id. And additionally abort all compactions. Pardon me if there was already a similar Jira, I'd be happy to merge this there. The current code handles interrupts. We should be able to interrupt the thread that is performing the compaction and abort it from either the UI or from the command line. This Jira is targeted to expose an admin function to perform such a task. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-12333) Add Integration Test Running which is more friendly
Manukranth Kolloju created HBASE-12333: -- Summary: Add Integration Test Running which is more friendly Key: HBASE-12333 URL: https://issues.apache.org/jira/browse/HBASE-12333 Project: HBase Issue Type: New Feature Components: test Affects Versions: 2.0.0 Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Fix For: 2.0.0 This Jira is intended to add a Driver class which would run a list of Integration tests on an actual hbase cluster. And generate a machine readable results file in JSON and put it on HDFS. The idea is to make it easy to run driver class using a long list of appropriate command line params and wait for the JSON file on the HDFS. This will help in plugging into external automation and makes it easier to maintain Continuous Integration Scripts. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-12284) Make TestMasterOperationsForRegionReplicas less flaky
Manukranth Kolloju created HBASE-12284: -- Summary: Make TestMasterOperationsForRegionReplicas less flaky Key: HBASE-12284 URL: https://issues.apache.org/jira/browse/HBASE-12284 Project: HBase Issue Type: Bug Components: test Affects Versions: 2.0.0 Reporter: Manukranth Kolloju Priority: Minor Fix For: 2.0.0 This test seems to be failing occassionaly, like once in 30 times. Maybe the test needs some love ? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-12258) Make TestHBaseFsck less flaky
Manukranth Kolloju created HBASE-12258: -- Summary: Make TestHBaseFsck less flaky Key: HBASE-12258 URL: https://issues.apache.org/jira/browse/HBASE-12258 Project: HBase Issue Type: Bug Components: test Affects Versions: 2.0.0 Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Priority: Minor Fix For: 2.0.0 Attachments: 0001-TestHbaseFsck-is-flaky-and-has-some-multithreading-i.patch TestHBaseFsck is flaky sometimes. This jira is to make it pass more predictably. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-12250) Adding an endpoint for updating the regionserver config
Manukranth Kolloju created HBASE-12250: -- Summary: Adding an endpoint for updating the regionserver config Key: HBASE-12250 URL: https://issues.apache.org/jira/browse/HBASE-12250 Project: HBase Issue Type: Task Components: regionserver Affects Versions: 2.0.0 Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Priority: Minor Fix For: 2.0.0 This is a follow up Jira that adds the end point for updating the configuration on the regionserver. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-12227) Prevent unpublished HRegionServer objects referenced on other threads
Manukranth Kolloju created HBASE-12227: -- Summary: Prevent unpublished HRegionServer objects referenced on other threads Key: HBASE-12227 URL: https://issues.apache.org/jira/browse/HBASE-12227 Project: HBase Issue Type: Bug Components: regionserver Affects Versions: 2.0.0 Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Priority: Minor Fix For: 2.0.0 HRegionServer's constructor has a bunch of initializations(Sleeper, ZookeeperWatcher) that require us to pass "this" into other threads and initialize them. This makes the RegionServer intialization vulnerable to race conditions where the other threads might reference unpublished HRegionServer objects. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-12208) Integerating Jacoco code coverage report into the hadoop qa bot
Manukranth Kolloju created HBASE-12208: -- Summary: Integerating Jacoco code coverage report into the hadoop qa bot Key: HBASE-12208 URL: https://issues.apache.org/jira/browse/HBASE-12208 Project: HBase Issue Type: New Feature Components: test Affects Versions: 2.0.0 Reporter: Manukranth Kolloju Fix For: 2.0.0 HBASE-8936 introduced jacoco code coverage report into the pom, but its disabled by default. The code coverage tool would help in finding the extent of code coverage we have in new patches. The hadoop qa bot should be able to stamp a -1 on diffs that decrease the coverage. This jira is to do the same. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Reopened] (HBASE-8936) Fixing ZKSlipLog#Counters
[ https://issues.apache.org/jira/browse/HBASE-8936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju reopened HBASE-8936: --- > Fixing ZKSlipLog#Counters > - > > Key: HBASE-8936 > URL: https://issues.apache.org/jira/browse/HBASE-8936 > Project: HBase > Issue Type: Bug >Affects Versions: 0.89-fb >Reporter: Manukranth Kolloju >Assignee: Manukranth Kolloju >Priority: Trivial > Fix For: 0.89-fb > > Original Estimate: 24h > Remaining Estimate: 24h > > Avoiding usage of reflection in ZKSplitLog#Counters class. This use of > reflection is failing the jacoco code coverage annotation and execution. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-12199) Make TestAtomicOperation faster
Manukranth Kolloju created HBASE-12199: -- Summary: Make TestAtomicOperation faster Key: HBASE-12199 URL: https://issues.apache.org/jira/browse/HBASE-12199 Project: HBase Issue Type: Bug Components: test Affects Versions: 1.0.0 Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Priority: Trivial Fix For: 1.0.0 TestAtomicOperation has a bunch of tests which spawn a bunch of tests that do puts, appends, deletes, inc and then does gets to make sure that things happened. It uses TEST_UTIL.getLocalHRegion() to obtain an HRegion object. So, in essence the test doesn't need to sync to disk to make sure the edits have persisted. There is no regionserver/master to take care of wal replay or any failure for that matter. So, converting all the Durability settings for the edits to ASYNC_WAL seems like the right thing to do here to make the test run faster. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-12195) Fix dev-support/findHangingTests
Manukranth Kolloju created HBASE-12195: -- Summary: Fix dev-support/findHangingTests Key: HBASE-12195 URL: https://issues.apache.org/jira/browse/HBASE-12195 Project: HBase Issue Type: Improvement Components: test Affects Versions: 1.0.0 Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Priority: Minor Fix For: 1.0.0 The existing script findHangingTests.sh fails to actually find hanging tests. Fixing it by replacing it with findHangingTests.py. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-12194) Make TestEncodedSeekers faster
Manukranth Kolloju created HBASE-12194: -- Summary: Make TestEncodedSeekers faster Key: HBASE-12194 URL: https://issues.apache.org/jira/browse/HBASE-12194 Project: HBase Issue Type: Bug Components: test Affects Versions: 1.0.0 Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Priority: Trivial Fix For: 1.0.0 Same as TestCacheOnWrite. This one also doesn't need the edits to be committed to wal for the test to be sensible. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-12191) Make TestCacheOnWrite faster.
Manukranth Kolloju created HBASE-12191: -- Summary: Make TestCacheOnWrite faster. Key: HBASE-12191 URL: https://issues.apache.org/jira/browse/HBASE-12191 Project: HBase Issue Type: Bug Components: test Affects Versions: 1.0.0 Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Priority: Trivial Fix For: 1.0.0 Attachments: 0001-INTERNAL-FixTestCacheOnWrite.patch This test is intended to verify the cache on write capabilities of the LRUBlockCache and doesn't really case about the data being synced to wal periodically or not. In cases where there is a region server death the test is screwed anyway because it tests an inmemeory status. So, setting Durability to ASYNC is a no risk change and makes the test run faster. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-12154) TestLoadAndSwitchEncodeOnDisk is flaky on shared jenkins boxes
Manukranth Kolloju created HBASE-12154: -- Summary: TestLoadAndSwitchEncodeOnDisk is flaky on shared jenkins boxes Key: HBASE-12154 URL: https://issues.apache.org/jira/browse/HBASE-12154 Project: HBase Issue Type: Bug Components: test Affects Versions: 1.0.0 Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Priority: Minor Fix For: 1.0.0 It doesn't make sense to run a load test on a shared box where other tests are being run. We should probably move this to integration tests and make sure its covered. In cases where the jenkins machines are shared across several projects which are doing disk IO, I have observed that this test runs into slow syncs and eventually times out. And that being said, we can't increase the timeout on this test, since its already 3 minutes. This test being disk sensitive, might have better coverage on IT. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-12153) Fixing TestReplicaWithCluster
Manukranth Kolloju created HBASE-12153: -- Summary: Fixing TestReplicaWithCluster Key: HBASE-12153 URL: https://issues.apache.org/jira/browse/HBASE-12153 Project: HBase Issue Type: Bug Components: test Affects Versions: 1.0.0 Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Priority: Trivial Fix For: 1.0.0 This test takes about 30 ~ 40 seconds depending upon the resources available. Doesn't make sense to have such a tight bound(30s) on the unit test. [~nkeywal], what do you think ? Did you intend to have such a tight bound while adding the test here ? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-12149) TestRegionPlacement is failing undeterministically
Manukranth Kolloju created HBASE-12149:
--
Summary: TestRegionPlacement is failing undeterministically
Key: HBASE-12149
URL: https://issues.apache.org/jira/browse/HBASE-12149
Project: HBase
Issue Type: Bug
Components: test
Affects Versions: 1.0.0
Reporter: Manukranth Kolloju
Assignee: Manukranth Kolloju
Priority: Minor
Fix For: 1.0.0
TestRegionPlacement has tests that are flaky and fail in a cascading fashion.
We need to fix this cascading behavior and also fix the flakyness of the tests.
16:20:59 java.lang.AssertionError: Region {ENCODED =>
958cbbb4405e3bbcfd04185538912d4c, NAME =>
'testRegionAssignment,\x02\x02\x02,1412205636586.958cbbb4405e3bbcfd04185538912d4c.',
STARTKEY => '\x02\x02\x02', ENDKEY => '\x03\x03\x03'} not present on any of
the expected servers
16:20:59at org.junit.Assert.fail(Assert.java:88)
16:20:59at
org.apache.hadoop.hbase.master.TestRegionPlacement.killRandomServerAndVerifyAssignment(TestRegionPlacement.java:347)
16:20:59at
org.apache.hadoop.hbase.master.TestRegionPlacement.testRegionPlacement(TestRegionPlacement.java:270)
16:20:59
16:20:59
testFavoredNodesPresentForRoundRobinAssignment(org.apache.hadoop.hbase.master.TestRegionPlacement)
Time elapsed: 0.047 sec <<< ERROR!
16:20:59 java.lang.ArrayIndexOutOfBoundsException: 9
16:20:59at
java.util.concurrent.CopyOnWriteArrayList.get(CopyOnWriteArrayList.java:368)
16:20:59at
java.util.concurrent.CopyOnWriteArrayList.get(CopyOnWriteArrayList.java:377)
16:20:59at
org.apache.hadoop.hbase.LocalHBaseCluster.getRegionServer(LocalHBaseCluster.java:237)
16:20:59at
org.apache.hadoop.hbase.MiniHBaseCluster.getRegionServer(MiniHBaseCluster.java:609)
16:20:59at
org.apache.hadoop.hbase.master.TestRegionPlacement.testFavoredNodesPresentForRoundRobinAssignment(TestRegionPlacement.java:113)
16:20:59
16:20:59
testFavoredNodesPresentForRandomAssignment(org.apache.hadoop.hbase.master.TestRegionPlacement)
Time elapsed: 0.041 sec <<< ERROR!
16:20:59 java.lang.ArrayIndexOutOfBoundsException: 9
16:20:59at
java.util.concurrent.CopyOnWriteArrayList.get(CopyOnWriteArrayList.java:368)
16:20:59at
java.util.concurrent.CopyOnWriteArrayList.get(CopyOnWriteArrayList.java:377)
16:20:59at
org.apache.hadoop.hbase.LocalHBaseCluster.getRegionServer(LocalHBaseCluster.java:237)
16:20:59at
org.apache.hadoop.hbase.MiniHBaseCluster.getRegionServer(MiniHBaseCluster.java:609)
16:20:59at
org.apache.hadoop.hbase.master.TestRegionPlacement.testFavoredNodesPresentForRandomAssignment(TestRegionPlacement.java:173)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (HBASE-12147) Porting Online Config Change from 89-fb
Manukranth Kolloju created HBASE-12147: -- Summary: Porting Online Config Change from 89-fb Key: HBASE-12147 URL: https://issues.apache.org/jira/browse/HBASE-12147 Project: HBase Issue Type: New Feature Affects Versions: 1.0.0 Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Fix For: 1.0.0 This jira is to track the forward port of HBASE-8805 and HBASE-8544 implemented by [~gaurav.menghani] in 89-fb. This adds a lot of operational efficiency to manage clusters that serving production traffic. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HBASE-11228) Adding HLogBenchmark
[ https://issues.apache.org/jira/browse/HBASE-11228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju resolved HBASE-11228. Resolution: Fixed Release Note: This might not be needed. > Adding HLogBenchmark > > > Key: HBASE-11228 > URL: https://issues.apache.org/jira/browse/HBASE-11228 > Project: HBase > Issue Type: Test > Components: test >Affects Versions: 0.89-fb >Reporter: Manukranth Kolloju >Assignee: Manukranth Kolloju >Priority: Minor > Fix For: 0.89-fb > > > Adding HLog benchmark to run against the HDFS releases to measure pure > performance of HLogs. Similar to HLogPerformanceEvaluation, but lays more > emphasis on the HLog performance as opposed to RegionServer performance while > writing to 1 hlog. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HBASE-11343) Writing the RootRegionLocation znode in thrift format.
[ https://issues.apache.org/jira/browse/HBASE-11343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju resolved HBASE-11343. Resolution: Fixed > Writing the RootRegionLocation znode in thrift format. > -- > > Key: HBASE-11343 > URL: https://issues.apache.org/jira/browse/HBASE-11343 > Project: HBase > Issue Type: Improvement >Affects Versions: 0.89-fb >Reporter: Manukranth Kolloju >Assignee: Manukranth Kolloju >Priority: Minor > Fix For: 0.89-fb > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HBASE-11379) Force fix regioninfo in HBCK
[ https://issues.apache.org/jira/browse/HBASE-11379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju resolved HBASE-11379. Resolution: Fixed > Force fix regioninfo in HBCK > > > Key: HBASE-11379 > URL: https://issues.apache.org/jira/browse/HBASE-11379 > Project: HBase > Issue Type: Bug > Components: hbck >Affects Versions: 0.89-fb >Reporter: Manukranth Kolloju >Assignee: Manukranth Kolloju >Priority: Minor > Fix For: 0.89-fb > > > Fixing the corrupt regioninfo files. During the Alter table the regioninfo is > getting corrputed. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Reopened] (HBASE-8808) Use Jacoco to generate Unit Test coverage reports
[ https://issues.apache.org/jira/browse/HBASE-8808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju reopened HBASE-8808: --- > Use Jacoco to generate Unit Test coverage reports > - > > Key: HBASE-8808 > URL: https://issues.apache.org/jira/browse/HBASE-8808 > Project: HBase > Issue Type: Bug > Components: build >Affects Versions: 0.89-fb >Reporter: Manukranth Kolloju >Assignee: Manukranth Kolloju >Priority: Trivial > Fix For: 0.89-fb > > Attachments: Screen Shot 2013-06-25 at 11.35.30 AM.png > > Original Estimate: 24h > Remaining Estimate: 24h > > Enabling the code coverage tool jacoco in maven -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-12132) mvn install -Dtest= also runs the hbase-it tests.
Manukranth Kolloju created HBASE-12132: -- Summary: mvn install -Dtest= also runs the hbase-it tests. Key: HBASE-12132 URL: https://issues.apache.org/jira/browse/HBASE-12132 Project: HBase Issue Type: Bug Reporter: Manukranth Kolloju Priority: Minor mvn install -Dtest= runs tests in it and they time out. This Jira is intended to fix that behavior. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Reopened] (HBASE-12115) Fix NumberFormat Exception in TableInputFormatBase.
[ https://issues.apache.org/jira/browse/HBASE-12115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju reopened HBASE-12115: > Fix NumberFormat Exception in TableInputFormatBase. > --- > > Key: HBASE-12115 > URL: https://issues.apache.org/jira/browse/HBASE-12115 > Project: HBase > Issue Type: Sub-task > Components: test >Affects Versions: 1.0.0 >Reporter: Manukranth Kolloju >Assignee: Manukranth Kolloju >Priority: Minor > Fix For: 1.0.0 > > Original Estimate: 24h > Remaining Estimate: 24h > > DNS.reverseDns doesn't work well with IPv6 addresses. This patch is to fix > that. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HBASE-12115) Fix NumberFormat Exception in TableInputFormatBase.
[ https://issues.apache.org/jira/browse/HBASE-12115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju resolved HBASE-12115. Resolution: Fixed > Fix NumberFormat Exception in TableInputFormatBase. > --- > > Key: HBASE-12115 > URL: https://issues.apache.org/jira/browse/HBASE-12115 > Project: HBase > Issue Type: Sub-task > Components: test >Affects Versions: 1.0.0 >Reporter: Manukranth Kolloju >Assignee: Manukranth Kolloju >Priority: Minor > Fix For: 1.0.0 > > Original Estimate: 24h > Remaining Estimate: 24h > > DNS.reverseDns doesn't work well with IPv6 addresses. This patch is to fix > that. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-12115) Fix NumberFormat Exception in TableInputFormatBase.
Manukranth Kolloju created HBASE-12115: -- Summary: Fix NumberFormat Exception in TableInputFormatBase. Key: HBASE-12115 URL: https://issues.apache.org/jira/browse/HBASE-12115 Project: HBase Issue Type: Bug Components: test Affects Versions: 1.0.0 Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Priority: Minor Fix For: 1.0.0 DNS.reverseDns doesn't work well with IPv6 addresses. This patch is to fix that. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-12075) Preemptive Fast Fail
Manukranth Kolloju created HBASE-12075: -- Summary: Preemptive Fast Fail Key: HBASE-12075 URL: https://issues.apache.org/jira/browse/HBASE-12075 Project: HBase Issue Type: New Feature Components: Client Affects Versions: 1.0.0 Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Fix For: 1.0.0 In multi threaded clients, we use a feature developed on 0.89-fb branch called Preemptive Fast Fail. This allows the client threads which would potentially fail, fail fast. The idea behind this feature is that we allow, among the hundreds of client threads, one thread to try and establish connection with the regionserver and if that succeeds, we mark it as a live node again. Meanwhile, other threads which are trying to establish connection to the same server would ideally go into the timeouts which is effectively unfruitful. We can in those cases return appropriate exceptions to those clients instead of letting them retry. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-11881) Improve the swift structures for KeyValue lists
Manukranth Kolloju created HBASE-11881: -- Summary: Improve the swift structures for KeyValue lists Key: HBASE-11881 URL: https://issues.apache.org/jira/browse/HBASE-11881 Project: HBase Issue Type: Bug Components: Thrift Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Priority: Minor Fix For: 0.89-fb With introduction of swift we have to build composite data structures that can represent a list of KeyValues in a more efficient manner. This can be used both in Put and the Result objects. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-11783) Adding Per request metrics
Manukranth Kolloju created HBASE-11783: -- Summary: Adding Per request metrics Key: HBASE-11783 URL: https://issues.apache.org/jira/browse/HBASE-11783 Project: HBase Issue Type: New Feature Components: metrics Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Priority: Minor Fix For: 0.89-fb The jira adds a framework to log per request metrics in the regionserver side. The metrics have a set of attributes and metrics values so that once published to an analytics services, we can slice through the data and identify hot spots or pathological patterns at the granularity of a request. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HBASE-11417) Determining and storing the Write/Read Amplification inside HBase
Manukranth Kolloju created HBASE-11417: -- Summary: Determining and storing the Write/Read Amplification inside HBase Key: HBASE-11417 URL: https://issues.apache.org/jira/browse/HBASE-11417 Project: HBase Issue Type: Brainstorming Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju We should be able to calculate the read and write amplification from inside hbase and store it in the StoreFiles. This should give us a broad picture of the usage pattern to identify and answer some key questions * What is the read/write amplification. * What portion of the data can be served out of Cache/Flash or Disk and how do we identify it. * Whether HBase is the best fit for the work load. * Or whether HBase was a right fit for the work load in the first place. etc. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HBASE-11389) Find and document all the Configuration parameters in hbase.
Manukranth Kolloju created HBASE-11389: -- Summary: Find and document all the Configuration parameters in hbase. Key: HBASE-11389 URL: https://issues.apache.org/jira/browse/HBASE-11389 Project: HBase Issue Type: Improvement Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Assignee: Rishit Shroff Priority: Minor Fix For: 0.89-fb Over time, features people work get buried in the large heap of config parameters that we have. This task is to find and document all the config parameters in hbase and tag them. This should be automated so that we can run it every now and then and find out the lost configs. Ideas on how these can be found : 1. Look for Configuration objects and identify where we are setting values. 2. Identify constants/strings that are the parameter names. 3. Identify the constants that are default values. 4. Identify where in the code they are present and tag them appropriately, for example if a constant is being read in a bunch of places like HRegionServer.class, HRegion.class, we can tag it with HRegionServer and HRegion. We can go a bit further and subtag them with the functions they are displayed in. 5. Obtain the comments around the parameter name constants when they are defined. A few pointers to traversing the java source tree : http://stackoverflow.com/questions/2183488/traversing-through-the-ast-node http://www.vogella.com/tutorials/EclipseJDT/article.html -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HBASE-11379) Force fix regioninfo in HBCK
Manukranth Kolloju created HBASE-11379: -- Summary: Force fix regioninfo in HBCK Key: HBASE-11379 URL: https://issues.apache.org/jira/browse/HBASE-11379 Project: HBase Issue Type: Bug Components: hbck Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Priority: Minor Fix For: 0.89-fb Fixing the corrupt regioninfo files. During the Alter table the regioninfo is getting corrputed. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Resolved] (HBASE-8484) Adding diagnostic messages when the RegionServer hists an IOException in RegionServerReport
[ https://issues.apache.org/jira/browse/HBASE-8484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju resolved HBASE-8484. --- Resolution: Fixed > Adding diagnostic messages when the RegionServer hists an IOException in > RegionServerReport > --- > > Key: HBASE-8484 > URL: https://issues.apache.org/jira/browse/HBASE-8484 > Project: HBase > Issue Type: Task > Components: regionserver >Affects Versions: 0.89-fb >Reporter: Manukranth Kolloju >Priority: Trivial > Fix For: 0.89-fb > > > This diff adds instrumentation in the case when we catch IOException in > regionserver report. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HBASE-11343) Writing the RootRegionLocation znode in thrift format.
Manukranth Kolloju created HBASE-11343: -- Summary: Writing the RootRegionLocation znode in thrift format. Key: HBASE-11343 URL: https://issues.apache.org/jira/browse/HBASE-11343 Project: HBase Issue Type: Improvement Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Priority: Minor Fix For: 0.89-fb -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Resolved] (HBASE-10894) Add mock implementations for HTableInterface for facilitating mock testing
[ https://issues.apache.org/jira/browse/HBASE-10894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju resolved HBASE-10894. Resolution: Fixed > Add mock implementations for HTableInterface for facilitating mock testing > -- > > Key: HBASE-10894 > URL: https://issues.apache.org/jira/browse/HBASE-10894 > Project: HBase > Issue Type: Improvement > Components: test >Affects Versions: 0.89-fb >Reporter: Manukranth Kolloju >Assignee: Manukranth Kolloju >Priority: Trivial > Fix For: 0.89-fb > > > To facilitate mock testing, providing empty implementations to the interface > which could be inherited from. This will avoid breaking of user code when the > interfaces change. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Resolved] (HBASE-10759) Use Guava Lexicographic comparator : Backporting
[ https://issues.apache.org/jira/browse/HBASE-10759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju resolved HBASE-10759. Resolution: Fixed > Use Guava Lexicographic comparator : Backporting > > > Key: HBASE-10759 > URL: https://issues.apache.org/jira/browse/HBASE-10759 > Project: HBase > Issue Type: Improvement > Components: regionserver >Affects Versions: 0.89-fb >Reporter: Manukranth Kolloju >Assignee: Manukranth Kolloju >Priority: Minor > Fix For: 0.89-fb > > > Adding guava comparator into the Bytes.compareTo function which is very > fundamental to HBase compare functions and comparators. Backporting the > change from HBASE-4012 -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Resolved] (HBASE-10959) Packaging test sources jar
[ https://issues.apache.org/jira/browse/HBASE-10959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju resolved HBASE-10959. Resolution: Fixed > Packaging test sources jar > -- > > Key: HBASE-10959 > URL: https://issues.apache.org/jira/browse/HBASE-10959 > Project: HBase > Issue Type: Test > Components: test >Affects Versions: 0.89-fb >Reporter: Manukranth Kolloju >Assignee: Manukranth Kolloju >Priority: Trivial > Fix For: 0.89-fb > > > Packaging test sources jar -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Resolved] (HBASE-10893) Bug in Fast Diff Delta Block Encoding
[
https://issues.apache.org/jira/browse/HBASE-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manukranth Kolloju resolved HBASE-10893.
Resolution: Fixed
> Bug in Fast Diff Delta Block Encoding
> -
>
> Key: HBASE-10893
> URL: https://issues.apache.org/jira/browse/HBASE-10893
> Project: HBase
> Issue Type: Bug
> Components: Scanners
>Affects Versions: 0.89-fb
>Reporter: Manukranth Kolloju
>Assignee: Manukranth Kolloju
> Fix For: 0.89-fb
>
> Attachments: HBASE-10893.patch
>
>
> The following 2 key values if encoded and decoded, produce wrong results:
> byte[] row = Bytes.toBytes("abcd");
> byte[] family = new byte[] { 'f' };
> byte[] qualifier0 = new byte[] { 'b' };
> byte[] qualifier1 = new byte[] { 'c' };
> byte[] value0 = new byte[] { 0x01 };
> byte[] value1 = new byte[] { 0x00 };
> kvList.add(new KeyValue(row, family, qualifier0, 0, Type.Put, value0));
> kvList.add(new KeyValue(row, family, qualifier1, 0, Type.Put, value1));
> while using Fast Diff Delta Block encoding.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Resolved] (HBASE-10891) Add socks proxy support to hbase clients.
[ https://issues.apache.org/jira/browse/HBASE-10891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju resolved HBASE-10891. Resolution: Fixed > Add socks proxy support to hbase clients. > - > > Key: HBASE-10891 > URL: https://issues.apache.org/jira/browse/HBASE-10891 > Project: HBase > Issue Type: Improvement > Components: IPC/RPC >Affects Versions: 0.89-fb >Reporter: Manukranth Kolloju >Assignee: Manukranth Kolloju >Priority: Trivial > Fix For: 0.89-fb > > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HBASE-11233) Making multiputs asynchronous on server side.
Manukranth Kolloju created HBASE-11233: -- Summary: Making multiputs asynchronous on server side. Key: HBASE-11233 URL: https://issues.apache.org/jira/browse/HBASE-11233 Project: HBase Issue Type: New Feature Components: regionserver Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Fix For: 0.89-fb The idea is to break the write pipeline into 2 parts: 1. Before WAL commit 2. After WAL commit Once that is done, we should always do 2 on a callback to the event when 1 is finished. This will help us in parallelizing multiputs. Currently the multiputs are executed in a serial fashion wherein the order in which the multiputs for different regions are executed is not of a concern. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HBASE-11228) Adding HLogBenchmark
Manukranth Kolloju created HBASE-11228: -- Summary: Adding HLogBenchmark Key: HBASE-11228 URL: https://issues.apache.org/jira/browse/HBASE-11228 Project: HBase Issue Type: Test Components: test Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Priority: Minor Fix For: 0.89-fb Adding HLog benchmark to run against the HDFS releases to measure pure performance of HLogs. Similar to HLogPerformanceEvaluation, but lays more emphasis on the HLog performance as opposed to RegionServer performance while writing to 1 hlog. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HBASE-11021) HBase Fsck
Manukranth Kolloju created HBASE-11021: -- Summary: HBase Fsck Key: HBASE-11021 URL: https://issues.apache.org/jira/browse/HBASE-11021 Project: HBase Issue Type: Bug Components: hbck Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Priority: Minor Fix For: 0.89-fb -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HBASE-10959) Packaging test sources jar
Manukranth Kolloju created HBASE-10959: -- Summary: Packaging test sources jar Key: HBASE-10959 URL: https://issues.apache.org/jira/browse/HBASE-10959 Project: HBase Issue Type: Test Components: test Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Priority: Trivial Fix For: 0.89-fb Packaging test sources jar -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HBASE-10894) Add mock implementations for HTableInterface for facilitating mock testing
Manukranth Kolloju created HBASE-10894: -- Summary: Add mock implementations for HTableInterface for facilitating mock testing Key: HBASE-10894 URL: https://issues.apache.org/jira/browse/HBASE-10894 Project: HBase Issue Type: Improvement Components: test Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Priority: Trivial Fix For: 0.89-fb To facilitate mock testing, providing empty implementations to the interface which could be inherited from. This will avoid breaking of user code when the interfaces change. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HBASE-10893) Bug in Fast Diff Delta Block Encoding
Manukranth Kolloju created HBASE-10893:
--
Summary: Bug in Fast Diff Delta Block Encoding
Key: HBASE-10893
URL: https://issues.apache.org/jira/browse/HBASE-10893
Project: HBase
Issue Type: Bug
Components: Scanners
Affects Versions: 0.89-fb
Reporter: Manukranth Kolloju
Assignee: Manukranth Kolloju
Fix For: 0.89-fb
The following 2 key values if encoded and decoded, produce wrong results:
byte[] row = Bytes.toBytes("abcd");
byte[] family = new byte[] { 'f' };
byte[] qualifier0 = new byte[] { 'b' };
byte[] qualifier1 = new byte[] { 'c' };
byte[] value0 = new byte[] { 0x01 };
byte[] value1 = new byte[] { 0x00 };
kvList.add(new KeyValue(row, family, qualifier0, 0, Type.Put, value0));
kvList.add(new KeyValue(row, family, qualifier1, 0, Type.Put, value1));
while using Fast Diff Delta Block encoding.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Created] (HBASE-10891) Add socks proxy support to hbase clients.
Manukranth Kolloju created HBASE-10891: -- Summary: Add socks proxy support to hbase clients. Key: HBASE-10891 URL: https://issues.apache.org/jira/browse/HBASE-10891 Project: HBase Issue Type: Improvement Components: IPC/RPC Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Priority: Trivial Fix For: 0.89-fb -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HBASE-10808) Simplify Leases by using a ConcurrentHashMap
Manukranth Kolloju created HBASE-10808: -- Summary: Simplify Leases by using a ConcurrentHashMap Key: HBASE-10808 URL: https://issues.apache.org/jira/browse/HBASE-10808 Project: HBase Issue Type: Bug Components: Scanners Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Priority: Minor Fix For: 0.89-fb This fix simplifies the Leases to use a ConcurrentHashMap instead of a DelayQueue so as to avoid the Synchronization cost. The LeaseChecker now should check the ConcurrentHashMap periodically to check if a scanner has been inactive for atleast the max time. This has a weaker guarantee on when the lease will be expired but is more efficient and decreases the amount of contention. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Resolved] (HBASE-10027) CompoundRowPrefixFilter
[ https://issues.apache.org/jira/browse/HBASE-10027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju resolved HBASE-10027. Resolution: Fixed > CompoundRowPrefixFilter > --- > > Key: HBASE-10027 > URL: https://issues.apache.org/jira/browse/HBASE-10027 > Project: HBase > Issue Type: New Feature > Components: Filters >Affects Versions: 0.89-fb >Reporter: Manukranth Kolloju >Assignee: Manukranth Kolloju > Fix For: 0.89-fb > > Original Estimate: 168h > Remaining Estimate: 168h > > In order to scan a sequence of row prefixes optimally, this filter will > provide a hint to the Scanner via the scan query matcher to go to the next > prefix after finishing scanning with the current range. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Resolved] (HBASE-10437) Integrating CompoundRowPrefixFilter with RowPrefixBloomFilter
[ https://issues.apache.org/jira/browse/HBASE-10437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju resolved HBASE-10437. Resolution: Fixed > Integrating CompoundRowPrefixFilter with RowPrefixBloomFilter > - > > Key: HBASE-10437 > URL: https://issues.apache.org/jira/browse/HBASE-10437 > Project: HBase > Issue Type: New Feature > Components: Scanners >Affects Versions: 0.89-fb >Reporter: Manukranth Kolloju >Assignee: Manukranth Kolloju >Priority: Minor > Fix For: 0.89-fb > > Original Estimate: 72h > Remaining Estimate: 72h > > Adding the changes to Filter which can be used to incorporate the bloom > filter optimizations into the CompoundRowPrefixFilter. > Having the context of the bloom filters from inside the filter gives a lot of > benefit in terms of performance. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Resolved] (HBASE-9828) Fix the reflection call in SequenceFileLogReader
[ https://issues.apache.org/jira/browse/HBASE-9828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju resolved HBASE-9828. --- Resolution: Fixed > Fix the reflection call in SequenceFileLogReader > > > Key: HBASE-9828 > URL: https://issues.apache.org/jira/browse/HBASE-9828 > Project: HBase > Issue Type: Bug >Affects Versions: 0.89-fb >Reporter: Manukranth Kolloju >Assignee: Manukranth Kolloju >Priority: Trivial > Fix For: 0.89-fb > > Original Estimate: 24h > Remaining Estimate: 24h > > In SequenceFileLogReader, Class.getMethod() fails to get a private method in > the class. So converting it to Class.getDeclaredMethod(). -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HBASE-10759) Use Guava Lexicographic comparator : Backporting
Manukranth Kolloju created HBASE-10759: -- Summary: Use Guava Lexicographic comparator : Backporting Key: HBASE-10759 URL: https://issues.apache.org/jira/browse/HBASE-10759 Project: HBase Issue Type: Improvement Components: regionserver Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Priority: Minor Fix For: 0.89-fb Adding guava comparator into the Bytes.compareTo function which is very fundamental to HBase compare functions and comparators. Backporting the change from HBASE-4012 -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HBASE-10756) Adding Data Types and Structured Row Keys in 0.89-fb HBase
Manukranth Kolloju created HBASE-10756: -- Summary: Adding Data Types and Structured Row Keys in 0.89-fb HBase Key: HBASE-10756 URL: https://issues.apache.org/jira/browse/HBASE-10756 Project: HBase Issue Type: New Feature Components: Usability Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Fix For: 0.89-fb As an extension to some of the work done on Presto + HBase side, and also inspired by some of the work done on open source and Pheonix, introducing data types and structured row keys will enable the data base(hbase) to de-couple database level optimizations from the application level schema. The attempt is to provide a table definition & specification to define the row key structure which can be composed as a composite struct composed of primitive data types. The data base can make intelligent decisions of how to interpret the data. For instance, having an understanding of the the structure of row key will hint the database about the parts of the data that are valuable and can use that information to construct indexes/bloom filters based on these parts of the row key. This can be extended to the column qualifiers and Nested Types as well. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HBASE-10754) RPC benchmark comparision between HadoopRPC and swift.
Manukranth Kolloju created HBASE-10754: -- Summary: RPC benchmark comparision between HadoopRPC and swift. Key: HBASE-10754 URL: https://issues.apache.org/jira/browse/HBASE-10754 Project: HBase Issue Type: New Feature Components: IPC/RPC Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Priority: Minor Fix For: 0.89-fb Adding a benchmark to stress test batchget on a small cluster. The idea is as follows : * The controller thread starts a bunch of pre-configured number of worker threads. Each worker does the follows : * Perform a small amount of random puts and collect the corresponding rows. * Perform batch gets using a random subset of the pre-collected rows. * Collect aggregated and p99/p95 throughput and latencies from the benchmarks. * Report the statistics on standard out. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HBASE-10568) InMemroy Row Prefix Bloom Filter
Manukranth Kolloju created HBASE-10568: -- Summary: InMemroy Row Prefix Bloom Filter Key: HBASE-10568 URL: https://issues.apache.org/jira/browse/HBASE-10568 Project: HBase Issue Type: New Feature Components: regionserver Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Fix For: 0.89-fb This in-memory bloom filter gives faster lookups for rowPrefixes while using CompoundRowPrefixFilter. This intends to supplement the row prefix filter on the hfiles. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Created] (HBASE-10437) Integrating CompoundRowPrefixFilter with RowPrefixBloomFilter
Manukranth Kolloju created HBASE-10437: -- Summary: Integrating CompoundRowPrefixFilter with RowPrefixBloomFilter Key: HBASE-10437 URL: https://issues.apache.org/jira/browse/HBASE-10437 Project: HBase Issue Type: New Feature Components: Scanners Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Priority: Minor Fix For: 0.89-fb Adding the changes to Filter which can be used to incorporate the bloom filter optimizations into the CompoundRowPrefixFilter. Having the context of the bloom filters from inside the filter gives a lot of benefit in terms of performance. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Created] (HBASE-10027) CompoundRowPrefixFilter
Manukranth Kolloju created HBASE-10027: -- Summary: CompoundRowPrefixFilter Key: HBASE-10027 URL: https://issues.apache.org/jira/browse/HBASE-10027 Project: HBase Issue Type: New Feature Components: Filters Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Fix For: 0.89-fb In order to scan a sequence of row ranges optimally, this filter will provide a hint to the Scanner via the scan query matcher to go to the next range after finishing scanning with the current range. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Created] (HBASE-10006) Zookeeper wrapper to delete Zookeeper nodes recursively within a timerange
Manukranth Kolloju created HBASE-10006: -- Summary: Zookeeper wrapper to delete Zookeeper nodes recursively within a timerange Key: HBASE-10006 URL: https://issues.apache.org/jira/browse/HBASE-10006 Project: HBase Issue Type: New Feature Components: Zookeeper Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Priority: Trivial Fix For: 0.89-fb This feature is intended to add functionality to delete Zookeeper znodes which belong to a specific timerange. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Created] (HBASE-9949) Fix the race condition between Compaction and StoreScanner.init
Manukranth Kolloju created HBASE-9949: - Summary: Fix the race condition between Compaction and StoreScanner.init Key: HBASE-9949 URL: https://issues.apache.org/jira/browse/HBASE-9949 Project: HBase Issue Type: Bug Components: Scanners Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Priority: Minor Fix For: 0.89-fb The StoreScanner constructor has multiple stages and there can be a race betwwen an ongoing compaction and the StoreScanner constructor where we might get the list of scanners before a compaction and seek on those scanners after the compaction. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Created] (HBASE-9930) Change the RPC stack to Thrift
Manukranth Kolloju created HBASE-9930: - Summary: Change the RPC stack to Thrift Key: HBASE-9930 URL: https://issues.apache.org/jira/browse/HBASE-9930 Project: HBase Issue Type: Umbrella Components: IPC/RPC Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Fix For: 0.89-fb This umbrella task is to talk about the effort to change the RPC stack in 0.89-fb to Thrift instead of using HadoopRPC. We are using Swift which is a fast and easy-to-use, annotation-based Java library for creating Thrift serializable types and services. The idea is to annotate the Data Structures that need to be transported across the wire and services interfaces that produce and consume these data structures. This will enable us to move away from the Proxy based Thrift server implementation and adopt the Native thrift server interface. This also allows us to write C++ and PHP clients which directly talk to the actual regionserver demons rather than proxy demons which introduce additional hops, memory and CPU overhead. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Created] (HBASE-9904) Solve skipping data in HTable scans
Manukranth Kolloju created HBASE-9904: - Summary: Solve skipping data in HTable scans Key: HBASE-9904 URL: https://issues.apache.org/jira/browse/HBASE-9904 Project: HBase Issue Type: Bug Components: Client Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Fix For: 0.89-fb The HTable client cannot retry a scan operation in the getRegionServerWithRetries code path. This will result in the client missing data. This can be worked around using hbase.client.retries.number to 1. The whole problem is that Callable knows nothing about retries and the protocol it dances to as well doesn't support retires. This fix will keep Callable protocol (ugly thing worth merciless refactoring) intact but will change ScannerCallable to anticipate retries. What we want is to make failed operations to be identities for outside world: N1 , N2 , F3 , N3 , F4 , F4 , N4 ... = N1 , N2 , N3 , N4 ... where Nk are successful operation and Fk are failed operations. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Created] (HBASE-9828) Fix the reflection call in SequenceFileLogReader
Manukranth Kolloju created HBASE-9828: - Summary: Fix the reflection call in SequenceFileLogReader Key: HBASE-9828 URL: https://issues.apache.org/jira/browse/HBASE-9828 Project: HBase Issue Type: Bug Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Priority: Trivial Fix For: 0.89-fb In SequenceFileLogReader, Class.getMethod() fails to get a private method in the class. So converting it to Class.getDeclaredMethod(). -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Created] (HBASE-9815) Add Histogram representative of row key distribution inside a region.
Manukranth Kolloju created HBASE-9815: - Summary: Add Histogram representative of row key distribution inside a region. Key: HBASE-9815 URL: https://issues.apache.org/jira/browse/HBASE-9815 Project: HBase Issue Type: New Feature Components: HFile Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Fix For: 0.89-fb Using histogram information, users can parallelize the scan workload into equal sized scans based on the estimated size from the Histogram information. This will help in enabling systems which are trying to perform queries on top of HBase to do cost based optimization while scanning. The Idea is to keep this histogram information into the HFile in the trailer and populate this on compaction and/or flush. The HRegionInterface can expose an API to return the Histogram information of a region, which can be generated by merging histograms of all the hfiles. Implementing the histogram on the basis of http://jmlr.org/papers/volume11/ben-haim10a/ben-haim10a.pdf http://dl.acm.org/citation.cfm?id=1951376 and NumericHistogram from hive. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Created] (HBASE-9704) Fix Unit tests
Manukranth Kolloju created HBASE-9704: - Summary: Fix Unit tests Key: HBASE-9704 URL: https://issues.apache.org/jira/browse/HBASE-9704 Project: HBase Issue Type: Bug Components: Compaction Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Priority: Minor Fix For: 0.89-fb Fixing the following unit tests: TestCompaction -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Resolved] (HBASE-9325) Add functionality to flush and wait and use it in ClientLocalScanner
[ https://issues.apache.org/jira/browse/HBASE-9325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju resolved HBASE-9325. --- Resolution: Fixed > Add functionality to flush and wait and use it in ClientLocalScanner > > > Key: HBASE-9325 > URL: https://issues.apache.org/jira/browse/HBASE-9325 > Project: HBase > Issue Type: New Feature > Components: Client >Affects Versions: 0.89-fb >Reporter: Manukranth Kolloju >Assignee: Manukranth Kolloju >Priority: Minor > Fix For: 0.89-fb > > > Add a functionality in HConnectionManager to perform flushAndWait for flush. > This is to facilitate the ClientLocalScanner to be able to flush the regions > before creating hardlink snapshots. This will give an estimate of the > freshness of the data the ClientLocalScanner will produce. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HBASE-9219) Fix TestMergeMeta and TestMergeTable
[ https://issues.apache.org/jira/browse/HBASE-9219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju resolved HBASE-9219. --- Resolution: Fixed > Fix TestMergeMeta and TestMergeTable > > > Key: HBASE-9219 > URL: https://issues.apache.org/jira/browse/HBASE-9219 > Project: HBase > Issue Type: Bug >Affects Versions: 0.89-fb >Reporter: Manukranth Kolloju >Assignee: Manukranth Kolloju >Priority: Trivial > Fix For: 0.89-fb > > Original Estimate: 24h > Remaining Estimate: 24h > > This diff fixes TestMergeMeta and TestMergeTable. There was a Zookeeper > cluster setup embedded inside the HBaseClusterSetup step. Seperating both the > steps. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HBASE-9114) Fix TestChangingEncoding
[ https://issues.apache.org/jira/browse/HBASE-9114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju resolved HBASE-9114. --- Resolution: Fixed Hadoop Flags: Reviewed > Fix TestChangingEncoding > > > Key: HBASE-9114 > URL: https://issues.apache.org/jira/browse/HBASE-9114 > Project: HBase > Issue Type: Bug > Components: master >Affects Versions: 0.89-fb >Reporter: Manukranth Kolloju >Assignee: Manukranth Kolloju >Priority: Minor > Fix For: 0.89-fb > > > TestChangingEncoding tries to do alterTable when the table is disabled. The > region reopener is not activated if the table is disabled. So, removing the > check to fix this test. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-9325) Add functionality to flush and wait and use it in ClientLocalScanner
Manukranth Kolloju created HBASE-9325: - Summary: Add functionality to flush and wait and use it in ClientLocalScanner Key: HBASE-9325 URL: https://issues.apache.org/jira/browse/HBASE-9325 Project: HBase Issue Type: New Feature Components: Client Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Priority: Minor Fix For: 0.89-fb Add a functionality in HConnectionManager to perform flushAndWait for flush. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-9219) Fix TestMergeMeta and TestMergeTable
Manukranth Kolloju created HBASE-9219: - Summary: Fix TestMergeMeta and TestMergeTable Key: HBASE-9219 URL: https://issues.apache.org/jira/browse/HBASE-9219 Project: HBase Issue Type: Bug Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Priority: Trivial Fix For: 0.89-fb This diff fixes TestMergeMeta and TestMergeTable. There was a Zookeeper cluster setup embedded inside the HBaseClusterSetup step. Seperating both the steps. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-9114) Fix TestChangingEncoding
Manukranth Kolloju created HBASE-9114: - Summary: Fix TestChangingEncoding Key: HBASE-9114 URL: https://issues.apache.org/jira/browse/HBASE-9114 Project: HBase Issue Type: Bug Components: master Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Priority: Minor Fix For: 0.89-fb TestChangingEncoding tries to do alterTable when the table is disabled. The region reopener is not activated if the table is disabled. So, removing the check to fix this test. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HBASE-8936) Fixing ZKSlipLog#Counters
[ https://issues.apache.org/jira/browse/HBASE-8936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju resolved HBASE-8936. --- Resolution: Fixed Hadoop Flags: Reviewed > Fixing ZKSlipLog#Counters > - > > Key: HBASE-8936 > URL: https://issues.apache.org/jira/browse/HBASE-8936 > Project: HBase > Issue Type: Bug >Affects Versions: 0.89-fb >Reporter: Manukranth Kolloju >Assignee: Manukranth Kolloju >Priority: Trivial > Fix For: 0.89-fb > > Original Estimate: 24h > Remaining Estimate: 24h > > Avoiding usage of reflection in ZKSplitLog#Counters class. This use of > reflection is failing the jacoco code coverage annotation and execution. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-8936) Fixing ZKSlipLog#Counters
Manukranth Kolloju created HBASE-8936: - Summary: Fixing ZKSlipLog#Counters Key: HBASE-8936 URL: https://issues.apache.org/jira/browse/HBASE-8936 Project: HBase Issue Type: Bug Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Priority: Trivial Fix For: 0.89-fb Avoiding usage of reflection in ZKSplitLog#Counters class. This use of reflection is failing the jacoco code coverage annotation and execution. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HBASE-8307) Adding a Histogram utility which captures data and creates a histogram.
[ https://issues.apache.org/jira/browse/HBASE-8307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju resolved HBASE-8307. --- Resolution: Fixed > Adding a Histogram utility which captures data and creates a histogram. > --- > > Key: HBASE-8307 > URL: https://issues.apache.org/jira/browse/HBASE-8307 > Project: HBase > Issue Type: New Feature > Components: metrics >Affects Versions: 0.89-fb >Reporter: Manukranth Kolloju >Assignee: Manukranth Kolloju >Priority: Minor > Fix For: 0.89-fb > > Original Estimate: 168h > Remaining Estimate: 168h > > This diff is to create a Histogram class which can be used to find the > Percentile estimates of metrics in HBase. We can use this utility to > calculate P99/P95 metrics of various metrics like latency etc. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HBASE-8185) Feature to enable Client Side Scanning(Client side merging) in HBase.
[ https://issues.apache.org/jira/browse/HBASE-8185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju resolved HBASE-8185. --- Resolution: Fixed > Feature to enable Client Side Scanning(Client side merging) in HBase. > - > > Key: HBASE-8185 > URL: https://issues.apache.org/jira/browse/HBASE-8185 > Project: HBase > Issue Type: New Feature > Components: regionserver >Affects Versions: 0.89-fb >Reporter: Manukranth Kolloju >Assignee: Manukranth Kolloju > Fix For: 0.89-fb > > Original Estimate: 168h > Remaining Estimate: 168h > > The motivation of this was to enable the client to be able to open the region > scanner(and in turn open StoreScanners) and perform the merge on the client > side. This will lower the cpu ops that are consumed by the RegionServer since > the data is pulled directly from the datanode. In cases where the user is > interested to perform a large scan on hbase data check-pointed at a point of > time, we think that ClientSideScan(ClientSideMerge) would give a very high > throughput as compared to using the ClientScanner in HTable. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HBASE-8330) What is the necessity of having a private ThreadLocal in FSReaderV2
[ https://issues.apache.org/jira/browse/HBASE-8330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju resolved HBASE-8330. --- Resolution: Fixed > What is the necessity of having a private ThreadLocal in FSReaderV2 > --- > > Key: HBASE-8330 > URL: https://issues.apache.org/jira/browse/HBASE-8330 > Project: HBase > Issue Type: Brainstorming > Components: HFile >Affects Versions: 0.89-fb >Reporter: Manukranth Kolloju >Assignee: Manukranth Kolloju >Priority: Minor > Fix For: 0.89-fb > > > I was trying to investigate the scenarios in which we perform a seek back of > 24 bytes(Header size) while we do a HFileBlock read. In the process I > stumbled upon this issue. In order to avoid the seek back problem, what we do > is to store the header of the next block in a class named PrefetchedHeader. > This prefetched header is stored as a private ThreadLocal object in the > FSReaderV2 class. I was wondering why we would be needing a ThreadLocalc when > each FSReader object has its own PrefetchedHeader object and moreover if its > private. Can anybody familiar with this part of the code tell me what was the > design decision that was taken at that time? -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HBASE-8491) Fixing the TestHeapSizes.
[ https://issues.apache.org/jira/browse/HBASE-8491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju resolved HBASE-8491. --- Resolution: Fixed > Fixing the TestHeapSizes. > - > > Key: HBASE-8491 > URL: https://issues.apache.org/jira/browse/HBASE-8491 > Project: HBase > Issue Type: Bug >Affects Versions: 0.89-fb >Reporter: Manukranth Kolloju >Assignee: Manukranth Kolloju >Priority: Trivial > Fix For: 0.89-fb > > > Accounting for the extra references added. Did an absolute count of non > static variables and updated accordingly. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HBASE-8808) Use Jacoco to generate Unit Test coverage reports
[ https://issues.apache.org/jira/browse/HBASE-8808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju resolved HBASE-8808. --- Resolution: Fixed Hadoop Flags: Reviewed > Use Jacoco to generate Unit Test coverage reports > - > > Key: HBASE-8808 > URL: https://issues.apache.org/jira/browse/HBASE-8808 > Project: HBase > Issue Type: Bug > Components: build >Affects Versions: 0.89-fb >Reporter: Manukranth Kolloju >Assignee: Manukranth Kolloju >Priority: Trivial > Fix For: 0.89-fb > > Attachments: Screen Shot 2013-06-25 at 11.35.30 AM.png > > Original Estimate: 24h > Remaining Estimate: 24h > > Enabling the code coverage tool jacoco in maven -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-8808) Use Jacoco to generate Unit Test coverage reports
Manukranth Kolloju created HBASE-8808: - Summary: Use Jacoco to generate Unit Test coverage reports Key: HBASE-8808 URL: https://issues.apache.org/jira/browse/HBASE-8808 Project: HBase Issue Type: Bug Reporter: Manukranth Kolloju Priority: Trivial Enabling the code coverage tool jacoco in maven -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-8491) Fixing the TestHeapSizes.
Manukranth Kolloju created HBASE-8491: - Summary: Fixing the TestHeapSizes. Key: HBASE-8491 URL: https://issues.apache.org/jira/browse/HBASE-8491 Project: HBase Issue Type: Bug Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Priority: Trivial Fix For: 0.89-fb Accounting for the extra references added. Did an absolute count of non static variables and updated accordingly. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-8484) Adding diagnostic messages when the RegionServer hists an IOException in RegionServerReport
Manukranth Kolloju created HBASE-8484: - Summary: Adding diagnostic messages when the RegionServer hists an IOException in RegionServerReport Key: HBASE-8484 URL: https://issues.apache.org/jira/browse/HBASE-8484 Project: HBase Issue Type: Task Components: regionserver Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Priority: Trivial Fix For: 0.89-fb This diff adds instrumentation in the case when we catch IOException in regionserver report. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-8330) What is the necessity of having a private ThreadLocal in FSReaderV2
Manukranth Kolloju created HBASE-8330: - Summary: What is the necessity of having a private ThreadLocal in FSReaderV2 Key: HBASE-8330 URL: https://issues.apache.org/jira/browse/HBASE-8330 Project: HBase Issue Type: Brainstorming Components: HFile Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Priority: Minor Fix For: 0.89-fb I was trying to investigate the scenarios in which we perform a seek back of 24 bytes(Header size) while we do a HFileBlock read. In the process I stumbled upon this issue. In order to avoid the seek back problem, what we do is to store the header of the next block in a class named PrefetchedHeader. This prefetched header is stored as a private ThreadLocal object in the FSReaderV2 class. I was wondering why we would be needing a ThreadLocalc when each FSReader object has its own PrefetchedHeader object and moreover if its private. Can anybody familiar with this part of the code tell me what was the design decision that was taken at that time? -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-8311) Make HBaseFsck less verbose
Manukranth Kolloju created HBASE-8311: - Summary: Make HBaseFsck less verbose Key: HBASE-8311 URL: https://issues.apache.org/jira/browse/HBASE-8311 Project: HBase Issue Type: Improvement Components: hbck Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Priority: Minor Fix For: 0.89-fb Adding an option to output summaries related to each table into a file in json format. The table information would contain the following details total/online/offline (not deployed)/missing/skipped regions. Also each table would contain a list of errors for the regions for that table. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-8307) Adding a Histogram utility which captures data and creates a histogram.
Manukranth Kolloju created HBASE-8307: - Summary: Adding a Histogram utility which captures data and creates a histogram. Key: HBASE-8307 URL: https://issues.apache.org/jira/browse/HBASE-8307 Project: HBase Issue Type: New Feature Components: metrics Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Assignee: Manukranth Kolloju Priority: Minor Fix For: 0.89-fb This diff is to create a Histogram class which can be used to find the Percentile estimates of metrics in HBase. We can use this utility to calculate P99/P95 metrics of various metrics like latency etc. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-8245) Throttle region opens
Manukranth Kolloju created HBASE-8245: - Summary: Throttle region opens Key: HBASE-8245 URL: https://issues.apache.org/jira/browse/HBASE-8245 Project: HBase Issue Type: Improvement Components: master Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Priority: Minor Fix For: 0.89-fb When a dead region server comes up, the regions that belonged to the region server are assigned to it very aggressively. This causes a increase in the get latencies over all these regions which are under movement and hurt the performance. Instead spreading out this process over a period of time will be beneficial. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HBASE-8206) Thread safety issues with Compression.Algorithm.GZ and SNAPPY
[ https://issues.apache.org/jira/browse/HBASE-8206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju resolved HBASE-8206. --- Resolution: Fixed > Thread safety issues with Compression.Algorithm.GZ and SNAPPY > - > > Key: HBASE-8206 > URL: https://issues.apache.org/jira/browse/HBASE-8206 > Project: HBase > Issue Type: Bug >Affects Versions: 0.89-fb >Reporter: Manukranth Kolloju >Priority: Minor > Fix For: 0.89-fb > > Original Estimate: 24h > Remaining Estimate: 24h > > The Compression.Algorithm was not completely thread safe. Hence making it > thread safe. Trying to fix this the same way it was fixed in HBase > trunk(HBASE-5458) with a minor change since the fix in trunk is not > completely thread safe. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-8206) Thread safety issues with Compression.Algorithm.GZ and SNAPPY
Manukranth Kolloju created HBASE-8206: - Summary: Thread safety issues with Compression.Algorithm.GZ and SNAPPY Key: HBASE-8206 URL: https://issues.apache.org/jira/browse/HBASE-8206 Project: HBase Issue Type: Bug Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Priority: Minor Fix For: 0.89-fb The Compression.Algorithm was not completely thread safe. Hence making it thread safe. Trying to fix this the same way it was fixed in HBase trunk(HBASE-5458) with a minor change since the fix in trunk is not completely thread safe. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-8194) Fixing the non deterministic failure of TestHFileOutputFormat.
Manukranth Kolloju created HBASE-8194: - Summary: Fixing the non deterministic failure of TestHFileOutputFormat. Key: HBASE-8194 URL: https://issues.apache.org/jira/browse/HBASE-8194 Project: HBase Issue Type: Bug Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Priority: Minor Fix For: 0.89-fb The test creates regions in the meta region and waits for the master to allot them to regionservers. When the favored nodes were set, the timout was not completely reliable to say that they will be set. Instead setting the favored nodes while creating the regions directly in the starting would ensure that the master creates the regions assigning selected favored nodes. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-8185) Pulling HRegionScanner code outside the HRegion class.
Manukranth Kolloju created HBASE-8185: - Summary: Pulling HRegionScanner code outside the HRegion class. Key: HBASE-8185 URL: https://issues.apache.org/jira/browse/HBASE-8185 Project: HBase Issue Type: New Feature Components: regionserver Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Fix For: 0.89-fb In order to reuse the RegionScanner class without instantiating the HRegion class, we will have to bring RegionScanner class outside HRegion. This is a preliminary diff to another feature called Client Side Scanning. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-8113) Bring back the seek+read functionality to HBase
Manukranth Kolloju created HBASE-8113: - Summary: Bring back the seek+read functionality to HBase Key: HBASE-8113 URL: https://issues.apache.org/jira/browse/HBASE-8113 Project: HBase Issue Type: New Feature Affects Versions: 0.89-fb Reporter: Manukranth Kolloju Priority: Minor Fix For: 0.89-fb It was observed that the seek + read gives better performance than pread when performing relatively large scans(scan which cannot be cached). Hence bringing it back to HBase. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HBASE-7424) Enable the DeltaEncoding for the HFileOutputFormat
[ https://issues.apache.org/jira/browse/HBASE-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju resolved HBASE-7424. --- Tags: HFileOutputFormat Resolution: Fixed Fix Version/s: 0.89-fb Hadoop Flags: Reviewed > Enable the DeltaEncoding for the HFileOutputFormat > -- > > Key: HBASE-7424 > URL: https://issues.apache.org/jira/browse/HBASE-7424 > Project: HBase > Issue Type: New Feature >Reporter: Manukranth Kolloju >Priority: Minor > Labels: HFileOutputFormat > Fix For: 0.89-fb > > > HFileOutputFormat has a writer embedded but it is not configured to use the > DeltaEncoding. This revision is to add that support to the HFileOutputFormat > while it is used as an OutputFormat either the Mapper or the Reducer for a > MapReduce task. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HBASE-8082) Fixing NullPointerException in org.apache.hadoop.hbase.regionserver.HRegion.RegionScanner.nextRows.
[ https://issues.apache.org/jira/browse/HBASE-8082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manukranth Kolloju resolved HBASE-8082. --- Resolution: Fixed Fix Version/s: 0.89-fb Hadoop Flags: Reviewed > Fixing NullPointerException in > org.apache.hadoop.hbase.regionserver.HRegion.RegionScanner.nextRows. > --- > > Key: HBASE-8082 > URL: https://issues.apache.org/jira/browse/HBASE-8082 > Project: HBase > Issue Type: Bug >Reporter: Manukranth Kolloju >Priority: Blocker > Fix For: 0.89-fb > > > This change is in fb-hbase -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-8082) Fixing NullPointerException in org.apache.hadoop.hbase.regionserver.HRegion.RegionScanner.nextRows.
Manukranth Kolloju created HBASE-8082: - Summary: Fixing NullPointerException in org.apache.hadoop.hbase.regionserver.HRegion.RegionScanner.nextRows. Key: HBASE-8082 URL: https://issues.apache.org/jira/browse/HBASE-8082 Project: HBase Issue Type: Bug Reporter: Manukranth Kolloju Priority: Blocker This change is in fb-hbase -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-7734) Fix TestFromClientSide#testFilterAcrossMultipleRegions
Manukranth Kolloju created HBASE-7734: - Summary: Fix TestFromClientSide#testFilterAcrossMultipleRegions Key: HBASE-7734 URL: https://issues.apache.org/jira/browse/HBASE-7734 Project: HBase Issue Type: Bug Reporter: Manukranth Kolloju In RegionScanner.nextRows, checking filter's done value to ensure that null, which was the expected value by the client, was returned. This check was removed when ScanPrefetcher was introduced. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-7532) Enable the FavoredNodes for the HFileOutputFormat
Manukranth Kolloju created HBASE-7532: - Summary: Enable the FavoredNodes for the HFileOutputFormat Key: HBASE-7532 URL: https://issues.apache.org/jira/browse/HBASE-7532 Project: HBase Issue Type: New Feature Reporter: Manukranth Kolloju Priority: Minor -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-7514) Fix the TestLogSplitOnMasterFailover.testWithDistributedLogSplittingAndErrors.
Manukranth Kolloju created HBASE-7514: - Summary: Fix the TestLogSplitOnMasterFailover.testWithDistributedLogSplittingAndErrors. Key: HBASE-7514 URL: https://issues.apache.org/jira/browse/HBASE-7514 Project: HBase Issue Type: Bug Reporter: Manukranth Kolloju Priority: Minor -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
