Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download

2014-01-27 Thread tsuna
rst RC of any new major release. :P -- Benoit "tsuna" Sigoure

Re: 1.5.0-SNAPSHOT conflicting with hbase-proto 0.96.x

2014-01-27 Thread tsuna
On Mon, Jan 27, 2014 at 9:48 AM, Jonathan Hsieh wrote: > So is the suggestion to just add the other signature to hbase's version? The existing signature is useless as it cannot be used from outside Google's protobuf package. -- Benoit "tsuna" Sigoure

Re: 1.5.0-SNAPSHOT conflicting with hbase-proto 0.96.x

2014-01-27 Thread tsuna
agree on the API. I don't expect this class to change much if at all anyway. It's just really unfortunate that this method was changed, what's more with a signature that renders it unusable. -- Benoit "tsuna" Sigoure

Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download

2014-01-26 Thread tsuna
If this RC sinks, can you please include this one in 0.98.0: https://issues.apache.org/jira/browse/HBASE-10422 -- Benoit "tsuna" Sigoure

Re: 1.5.0-SNAPSHOT conflicting with hbase-proto 0.96.x

2014-01-26 Thread tsuna
r.run(NioWorker.java:178) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:744) > > It will be very simple to rename ZeroCopyLiteralByteString class in > asynchbase into something different and republish new jar. > Hope, someone may propose better solution. -- Benoit "tsuna" Sigoure

Re: Giving a chance to buggy coprocessors to clean up

2013-12-10 Thread tsuna
d / cleaned up. -- Benoit "tsuna" Sigoure

Re: [VOTE] The 1st hbase 0.94.12 release candidate is available for download

2013-09-17 Thread tsuna
reads that are much faster now that HBASE-9428 is fixed. -- Benoit "tsuna" Sigoure

Re: [DISCUSS] Set scanner caching to a better default? HBASE-7008

2012-10-30 Thread tsuna
On Sat, Oct 27, 2012 at 5:46 PM, lars hofhansl wrote: > Any value between 10 and 1000 should be OK, really. Maybe the default should > be 100. FWIW, asynchbase uses 128 rows as the default for its scanners, and 4096 maximum KVs by default too. -- Benoit "tsuna" Sigoure

Re: Plans for asynchbase re:96

2012-09-22 Thread tsuna
ocol) it's worthwhile to start looking at integrating support for the new protocol in asynchbase. -- Benoit "tsuna" Sigoure

Re: Removing HRegionInterface in 0.96, HBASE-5889

2012-05-03 Thread tsuna
obuf, then you know it's HBase >= 0.96, parse the protobuf and find where the META table is and what protocol version it expects. - Otherwise, it's not a protobuf, keep doing whatever we were doing prior HBase 0.96. -- Benoit "tsuna" Sigoure Software Engineer @ www.StumbleUpon.com

Re: Mocking classes for unit tests Was: asynchbase-1.2.0-rc1 is available for download

2012-02-22 Thread tsuna
e APIs clean, then I think it's worthwhile. -- Benoit "tsuna" Sigoure Software Engineer @ www.StumbleUpon.com

Re: HBase wire compatibility

2012-02-22 Thread tsuna
om scratch for about 2 years now, I can tell you that the only things I had to fix across HBase release were wire-level serialization breakages. The heavy logic of the client has remained mostly unchanged since the days of HBase 0.20. -- Benoit "tsuna" Sigoure Software Engineer @ www.StumbleUpon.com

Re: hbase 0.94.0

2012-02-06 Thread tsuna
multiple instances where the DBA team and > the AppServer team are different people, especially with any group > exploring multi-tenancy.  For that use case, client & server compat is > critical. Agreed. -- Benoit "tsuna" Sigoure Software Engineer @ www.StumbleUpon.com

Re: Reading from client buffer

2011-05-19 Thread tsuna
fully. But asynchbase can do this because it's asynchronous. You can't have a useful write buffer that's synchronous, because it would mean that as soon as you call put(), you get blocked until the buffer is flushed. Well you can always compensate by creating a shitload of thr

Re: HConnectionManager max cached instances

2011-04-29 Thread tsuna
and then very rarely as servers hosting .META. and -ROOT- fail). -- Benoit "tsuna" Sigoure Software Engineer @ www.StumbleUpon.com

Re: HTable thread safety in 0.20.6

2011-03-06 Thread tsuna
side, so we can finally move away from the inefficient model with thread pools containing hundreds of threads. > Based on discussion below, is async-hbase a "thick" / smart client or > something less than that? asynchbase is a thick client too, it implements all the logic that is needed to use HBase. Some of the logic is actually implemented slightly differently, but as far as end-users are concerned these are implementation details (for better performance / reliability / scalability). -- Benoit "tsuna" Sigoure Software Engineer @ www.StumbleUpon.com

Re: HTable thread safety in 0.20.6

2011-03-04 Thread tsuna
On Fri, Mar 4, 2011 at 10:04 AM, Stack wrote: > At Benoit's suggestion, we've changed the way we version Interfaces; > rather than a global version for all, we now version each Interface > separately.  More to come... Yup, thank you very much for implementing this :) -- Ben

Re: HTable thread safety in 0.20.6

2011-03-04 Thread tsuna
emented in such a way that the client will be able to detect different server versions and adjust itself accordingly. Eventually, I hope it'll be possible to have rolling upgrades of a cluster, at least between minor versions. -- Benoit "tsuna" Sigoure Software Engineer @ www.StumbleUpon.com

Re: HTable thread safety in 0.20.6

2011-02-20 Thread tsuna
nd up and very efficient in a multi-threaded application that uses HBase as a backend. It also works with all HBase versions, whereas with HTable you need to change the .jar and restart your application whenever you want to switch between different versions. -- Benoit "tsuna" S

Re: requests count per HRegion and rebalance

2011-02-07 Thread tsuna
On Mon, Feb 7, 2011 at 10:59 AM, Todd Lipcon wrote: > Unfortunately you can't get at any of the really juicy details like CMS FLS > statistics :( Do you have to resort to reading back your own GC log to figure this stuff out? :( -- Benoit "tsuna" Sigo

Re: requests count per HRegion and rebalance

2011-02-07 Thread tsuna
the hood it starts a thread in the remote JVM to handle RMI calls that probably go over the loopback interface. This is pretty much how jconsole and friends work, BTW. Pretty horrible stuff. :( -- Benoit "tsuna" Sigoure Software Engineer @ www.StumbleUpon.com

Re: requests count per HRegion and rebalance

2011-02-07 Thread tsuna
to make good load balancing decisions. If the master has information such as QPS per region, latency per region, number of GC cycles per GC type, then it can get a pretty clear picture of the load of each RS and try to even it out. -- Benoit "tsuna" Sigoure Software Engineer @ www.StumbleUpon.com

Re: requests count per HRegion and rebalance

2011-02-07 Thread tsuna
me allows for opportunities such as warming up the block cache in the destination RS before it starts serving. -- Benoit "tsuna" Sigoure Software Engineer @ www.StumbleUpon.com

Re: write performance degradation

2011-02-01 Thread tsuna
show anything useful here, the machine is 100% idle up until the 3rd section where it's reading a bit from disk, but it's still mostly idle. Something else that we don't see from this trace is amiss. -- Benoit "tsuna" Sigoure Software Engineer @ www.StumbleUpon.com

Re: write performance degradation

2011-01-31 Thread tsuna
always be 0. What's printed by /sbin/sysctl vm.swappiness ? -- Benoit "tsuna" Sigoure Software Engineer @ www.StumbleUpon.com

Re: write performance degradation

2011-01-30 Thread tsuna
It could be useful to see the output of "vmstat 1" (let it run for at least 30 seconds while the problem is occurring and pastebin the result). If the problem seems i/o related, the output of "iostat -xkd 1" can also help. -- Benoit "tsuna" Sigoure Software Engineer @ www.StumbleUpon.com

Re: Heap fragmentation

2011-01-20 Thread tsuna
On Thu, Jan 20, 2011 at 2:58 PM, Todd Lipcon wrote: > On Thu, Jan 20, 2011 at 2:52 PM, tsuna wrote: > >> On Thu, Jan 20, 2011 at 9:33 AM, Todd Lipcon wrote: >> > I did some experiments to understand our full GC issues better last >> night. >>

Re: Heap fragmentation

2011-01-20 Thread tsuna
On Thu, Jan 20, 2011 at 9:33 AM, Todd Lipcon wrote: > I did some experiments to understand our full GC issues better last night. > Here are the results: > http://people.apache.org/~todd/hbase-fragmentation/ Just curious: what hardware configuration was used during this test? -- Beno

Re: Client developer mailing list

2010-09-08 Thread tsuna
u guys > don't think it's a good idea. I think dev ML is already a good enough for this purpose. PS: http://github.com/stumbleupon/asynchbase -- Benoit "tsuna" Sigoure Software Engineer @ www.StumbleUpon.com

Re: Review Request: HBASE-2468: Improvements to prewarm META cache on clients.

2010-06-08 Thread tsuna
inal Object PRESENT = new Object(); [...] public boolean add(E e) { return map.put(e, PRESENT)==null; } -- Benoit "tsuna" Sigoure Software Engineer @ www.StumbleUpon.com

Re: Review Request: HBASE-2468: Improvements to prewarm META cache on clients.

2010-06-08 Thread tsuna
to trust what people like Joshua Bloch write, but I can be convinced otherwise :) -- Benoit "tsuna" Sigoure Software Engineer @ www.StumbleUpon.com

Re: Please welcome Todd Lipcon as our latest committer

2010-05-26 Thread tsuna
On Mon, May 24, 2010 at 11:54 PM, Stack wrote: > Good on you Todd, Congrats Todd, very well deserved with all the good work you've been doing for HBase recently! Two thumbs up for you, keep up the good work! -- Benoit "tsuna" Sigoure Software Engineer @ www.StumbleUpon.com