Re: Test HBase throughput with ycsb

2014-03-24 Thread ramkrishna vasudevan
We have a fork of YCSB compiled with 0.98 for working with visibility and ACLs. Atleast the changes in pom.xml will be useful incase you just need YCSB to run with recent versions. https://github.com/ramkrish86/YCSB/tree/ycsb_visibility. Regards Ram On Tue, Mar 25, 2014 at 10:43 AM, Nick Dimidu

Re: Test HBase throughput with ycsb

2014-03-24 Thread Nick Dimiduk
I'll add: YCSB is able to run mixed read and write workload while PerfEval does not. This is something I'd like to add in the future. Last I looked, the official YCSB didn't support HBase versions 0.96 or later. Nicholas (nkeywal) maintained a fork on his github that compiled against more modern ve

[jira] [Created] (HBASE-10825) Add copy-from option to ExportSnapshot

2014-03-24 Thread Matteo Bertozzi (JIRA)
Matteo Bertozzi created HBASE-10825: --- Summary: Add copy-from option to ExportSnapshot Key: HBASE-10825 URL: https://issues.apache.org/jira/browse/HBASE-10825 Project: HBase Issue Type: Bug

[jira] [Created] (HBASE-10824) Enhance detection of protobuf generated code in line length detection

2014-03-24 Thread Ted Yu (JIRA)
Ted Yu created HBASE-10824: -- Summary: Enhance detection of protobuf generated code in line length detection Key: HBASE-10824 URL: https://issues.apache.org/jira/browse/HBASE-10824 Project: HBase Is

Re: Test HBase throughput with ycsb

2014-03-24 Thread Ted Yu
This post is a bit old but it touches two of the most commonly used tools: http://sujee.net/tech/articles/hadoop/hbase-performance-testing/ PerformanceEvaluation has gone through continued enhancements. FYI On Mon, Mar 24, 2014 at 7:22 PM, yanqing huang wrote: >I want to ask something abou

Test HBase throughput with ycsb

2014-03-24 Thread yanqing huang
I want to ask something about the ycsb throughput of testing HBase. In my use case, I want to test HBase query throughput and average latency in hadoop cluster instead of benchmarking different DB which is YCSB good at. I care more about the performance of HBase job running in hadoop cluster.

[jira] [Created] (HBASE-10823) Resolve LATEST_TIMESTAMP to current server time before scanning for ACLs

2014-03-24 Thread Andrew Purtell (JIRA)
Andrew Purtell created HBASE-10823: -- Summary: Resolve LATEST_TIMESTAMP to current server time before scanning for ACLs Key: HBASE-10823 URL: https://issues.apache.org/jira/browse/HBASE-10823 Project:

Re: Co-locate meta and master, and beyond

2014-03-24 Thread Jimmy Xiang
Thanks Stack for the review. I will come up a release note and commit the patch to trunk tomorrow if no objection. I will address the follow up issues soon. Thanks everyone for the encouragement :) On Mon, Mar 24, 2014 at 3:46 PM, Ted Yu wrote: > Nice work Jimmy. > > > On Thu, Mar 20, 2014 at

[jira] [Resolved] (HBASE-10822) Thread local addendum to HBASE-10656 Counter

2014-03-24 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-10822. --- Resolution: Fixed Hadoop Flags: Reviewed Applied to trunk. Thanks [~ikeda] > Thread local addendum t

[jira] [Created] (HBASE-10822) Thread local addendum to HBASE-10656 Counter

2014-03-24 Thread stack (JIRA)
stack created HBASE-10822: - Summary: Thread local addendum to HBASE-10656 Counter Key: HBASE-10822 URL: https://issues.apache.org/jira/browse/HBASE-10822 Project: HBase Issue Type: Improvement

ANNOUNCE: The third hbase-0.96.2 release candidate (WAS --> Re: ANNOUNCE: The second hbase-0.96.2 release candiate (WAS --> Fwd: ANNOUNCE: The first hbase-0.96.2 release candidate is available for dow

2014-03-24 Thread Stack
The third release candidate for hbase-0.96.2 is available here: http://people.apache.org/~stack/hbase-0.96.2RC2/ and up in a staging memory repository here: https://repository.apache.org/content/repositories/orgapachehbase-1012 This RC has two fixes beyond RC0 and RC1: HBASE-10819 "(HBASE-1

[jira] [Created] (HBASE-10821) Make ColumnInterpreter#getValue() abstract

2014-03-24 Thread Ted Yu (JIRA)
Ted Yu created HBASE-10821: -- Summary: Make ColumnInterpreter#getValue() abstract Key: HBASE-10821 URL: https://issues.apache.org/jira/browse/HBASE-10821 Project: HBase Issue Type: Task R

[ANNOUNCE] HBase 0.94.18 is available for download

2014-03-24 Thread lars hofhansl
The HBase Team is pleased to announce the immediate release of HBase 0.94.18. Download it from your favorite Apache mirror [1]. This release has also been pushed to Apache's maven repository. All previous 0.92.x and 0.94.x releases can upgraded to 0.94.18 via a rolling upgrade without downtime,

Re: Co-locate meta and master, and beyond

2014-03-24 Thread Ted Yu
Nice work Jimmy. On Thu, Mar 20, 2014 at 9:08 AM, Jimmy Xiang wrote: > Here is a heads up on some work I've been doing of late. > > > My goal is to make region assignment simpler, faster, more reliable > > and maintainable making it so we are able to handle many more regions > > more efficientl

[jira] [Created] (HBASE-10820) Bulkload: something is going bananas with '_tmp'

2014-03-24 Thread Nick Dimiduk (JIRA)
Nick Dimiduk created HBASE-10820: Summary: Bulkload: something is going bananas with '_tmp' Key: HBASE-10820 URL: https://issues.apache.org/jira/browse/HBASE-10820 Project: HBase Issue Type:

[jira] [Resolved] (HBASE-10819) Backport HBASE-8063 (Filter HFiles based on first/last key) into 0.96

2014-03-24 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-10819. --- Resolution: Fixed Assignee: stack Committed. > Backport HBASE-8063 (Filter HFiles based on first/last

Re: ANNOUNCE: The second hbase-0.96.2 release candiate (WAS --> Fwd: ANNOUNCE: The first hbase-0.96.2 release candidate is available for download

2014-03-24 Thread Stack
Sinking because it is missing HBASE-10819, "Backport HBASE-8063 (Filter HFiles based on first/last key) into 0.96" Let me put up a new RC in a few. St.Ack On Sun, Mar 23, 2014 at 10:45 AM, Stack wrote: > Here is RC1. Its the same as RC0 only it is properly named and I svn > add'd a bit of mi

Re: Regressions on upgrading from 0.94 to 0.96

2014-03-24 Thread Stack
On Mon, Mar 24, 2014 at 11:44 AM, lars hofhansl wrote: > Yeah. Sorry. That's not good. I usually make sure that does not happen, > but I missed that one. > > I don't know what to do about issues like this. The RM's can't possibly > watch all issues. Another area where I find this a lot is with bu

[jira] [Created] (HBASE-10819) Backport HBASE-8063 (Filter HFiles based on first/last key) into 0.96

2014-03-24 Thread Andrew Purtell (JIRA)
Andrew Purtell created HBASE-10819: -- Summary: Backport HBASE-8063 (Filter HFiles based on first/last key) into 0.96 Key: HBASE-10819 URL: https://issues.apache.org/jira/browse/HBASE-10819 Project: HB

Re: Regressions on upgrading from 0.94 to 0.96

2014-03-24 Thread Andrew Purtell
I filed HBASE-10819 On Mon, Mar 24, 2014 at 11:44 AM, lars hofhansl wrote: > Yeah. Sorry. That's not good. I usually make sure that does not happen, > but I missed that one. > > I don't know what to do about issues like this. The RM's can't possibly > watch all issues. Another area where I find

[jira] [Resolved] (HBASE-10802) CellComparator.compareStaticIgnoreMvccVersion compares type wrongly

2014-03-24 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell resolved HBASE-10802. Resolution: Fixed Fix Version/s: 0.98.1 0.99.0 > CellComparator.

Re: [VOTE] The 1st hbase 0.94.18 release candidate is available for download

2014-03-24 Thread lars hofhansl
Thanks J-D, JM, and Ted. Release is forthcoming. On to 0.94.19 :) -- Lars From: Ted Yu To: "dev@hbase.apache.org" ; lars hofhansl Sent: Saturday, March 22, 2014 7:14 PM Subject: Re: [VOTE] The 1st hbase 0.94.18 release candidate is available for download

Re: Regressions on upgrading from 0.94 to 0.96

2014-03-24 Thread lars hofhansl
Yeah. Sorry. That's not good. I usually make sure that does not happen, but I missed that one. I don't know what to do about issues like this. The RM's can't possibly watch all issues. Another area where I find this a lot is with bug fixes that are committed to 0.96 or 0.98 and later, but the c

[jira] [Created] (HBASE-10818) Add integration test for bulkload with replicas

2014-03-24 Thread Nick Dimiduk (JIRA)
Nick Dimiduk created HBASE-10818: Summary: Add integration test for bulkload with replicas Key: HBASE-10818 URL: https://issues.apache.org/jira/browse/HBASE-10818 Project: HBase Issue Type: S

Re: Regressions on upgrading from 0.94 to 0.96

2014-03-24 Thread Stack
On Sun, Mar 23, 2014 at 9:32 PM, Ishan Chhabra wrote: > When looking at HBASE-8063< > https://issues.apache.org/jira/browse/HBASE-8063>, > I noticed that it was backported to 0.94 > (HBASE-8198) > but not to 0.96. I don't know if this was intention

[jira] [Created] (HBASE-10817) Add some tests on a real cluster for replica: multi master, replication

2014-03-24 Thread Nicolas Liochon (JIRA)
Nicolas Liochon created HBASE-10817: --- Summary: Add some tests on a real cluster for replica: multi master, replication Key: HBASE-10817 URL: https://issues.apache.org/jira/browse/HBASE-10817 Project

[jira] [Created] (HBASE-10816) CatalogTracker abortable usage

2014-03-24 Thread Jimmy Xiang (JIRA)
Jimmy Xiang created HBASE-10816: --- Summary: CatalogTracker abortable usage Key: HBASE-10816 URL: https://issues.apache.org/jira/browse/HBASE-10816 Project: HBase Issue Type: Bug Repo

[jira] [Created] (HBASE-10815) Master regionserver should be rolling-upgradable

2014-03-24 Thread Jimmy Xiang (JIRA)
Jimmy Xiang created HBASE-10815: --- Summary: Master regionserver should be rolling-upgradable Key: HBASE-10815 URL: https://issues.apache.org/jira/browse/HBASE-10815 Project: HBase Issue Type: Su

[jira] [Created] (HBASE-10814) RpcClient: some calls can get stuck when connection is closing

2014-03-24 Thread Nicolas Liochon (JIRA)
Nicolas Liochon created HBASE-10814: --- Summary: RpcClient: some calls can get stuck when connection is closing Key: HBASE-10814 URL: https://issues.apache.org/jira/browse/HBASE-10814 Project: HBase