Re: Hbase Assignments in trunk.

2012-09-11 Thread n keywal
option always rang a bit > > weird to me. > > > > Maybe switch in 0.98+? > > > > -- Lars > > > > > > - Original Message - > > From: n keywal > > To: dev@hbase.apache.org > > Cc: > > Sent: Thursday, September 6, 2012 12:53 AM > &

Re: Hbase Assignments in trunk.

2012-09-10 Thread Enis Söztutar
aybe switch in 0.98+? > > -- Lars > > > - Original Message - > From: n keywal > To: dev@hbase.apache.org > Cc: > Sent: Thursday, September 6, 2012 12:53 AM > Subject: Re: Hbase Assignments in trunk. > > On the Async vs. sync: there are 3 different ways to write multiple

Re: Hbase Assignments in trunk.

2012-09-10 Thread lars hofhansl
ay, September 6, 2012 12:53 AM Subject: Re: Hbase Assignments in trunk. On the Async vs. sync: there are 3 different ways to write multiple znodes in ZK, and huge differences in the performances between them: 1) for loop sync 2) for loop async 3) multi Async will be 20 to 100 times faster than sync

Re: Hbase Assignments in trunk.

2012-09-06 Thread Stack
On Thu, Sep 6, 2012 at 3:16 AM, Jonathan Hsieh wrote: > On Wed, Sep 5, 2012 at 4:08 PM, Stack wrote: > >> On Wed, Sep 5, 2012 at 12:38 PM, Jonathan Hsieh wrote: ... >> We should post these invariants somewhere? In dev section of refguide? >> >> We should definitely put this in the javadoc. May

Re: Hbase Assignments in trunk.

2012-09-06 Thread Dave Wang
There's a discussion on the ZK mailing list about releasing ZK 3.4.4, which will have multi and some other fixes. Once that is out, we can move to that on trunk. That will also help with one of the replication patches that Himanshu currently has pending, which relies on multi. - Dave On Thu, Se

Re: Hbase Assignments in trunk.

2012-09-06 Thread Jonathan Hsieh
IMO, moving to new ZK seems to makes sense for HBase trunk. Jon. On Thu, Sep 6, 2012 at 12:53 AM, n keywal wrote: > On the Async vs. sync: there are 3 different ways to write multiple znodes > in ZK, and huge differences in the performances between them: > > 1) for loop sync > 2) for loop asyn

Re: Hbase Assignments in trunk.

2012-09-06 Thread Jonathan Hsieh
On Wed, Sep 5, 2012 at 4:08 PM, Stack wrote: > On Wed, Sep 5, 2012 at 12:38 PM, Jonathan Hsieh wrote: > ... > > We've also talked about defining design and code invariants -- here's the > > one that I've gotten so far: (We can pull up more from discussion) > > > > * ZK state should transient (

Re: Hbase Assignments in trunk.

2012-09-06 Thread n keywal
On the Async vs. sync: there are 3 different ways to write multiple znodes in ZK, and huge differences in the performances between them: 1) for loop sync 2) for loop async 3) multi Async will be 20 to 100 times faster than sync. multi will be 2 to 4 times faster than async (that is, 80 to 400 tim

Re: Hbase Assignments in trunk.

2012-09-05 Thread Stack
On Wed, Sep 5, 2012 at 5:17 PM, Jonathan Hsieh wrote: > Here's a link to the pdf/picture. > > http://people.apache.org/~jmhsieh/hbase/120905-hbase-assignment.pdf > Pretty picture. Not a pretty story. What you thinking? St.Ack

Re: Hbase Assignments in trunk.

2012-09-05 Thread Jonathan Hsieh
Here's a link to the pdf/picture. http://people.apache.org/~jmhsieh/hbase/120905-hbase-assignment.pdf Jon. On Wed, Sep 5, 2012 at 5:07 PM, Jonathan Hsieh wrote: > > > On Wed, Sep 5, 2012 at 4:08 PM, Stack wrote: > >> On Wed, Sep 5, 2012 at 12:38 PM, Jonathan Hsieh wrote: >> > I generally thi

Re: Hbase Assignments in trunk.

2012-09-05 Thread Jonathan Hsieh
On Wed, Sep 5, 2012 at 4:08 PM, Stack wrote: > On Wed, Sep 5, 2012 at 12:38 PM, Jonathan Hsieh wrote: > > I generally think in pictures, so I've mapped out the single Assignment > > control flow as found in trunk yesterday in terms of threads and network > > communications (each of which can pos

Re: Hbase Assignments in trunk.

2012-09-05 Thread Stack
On Wed, Sep 5, 2012 at 12:38 PM, Jonathan Hsieh wrote: > I generally think in pictures, so I've mapped out the single Assignment > control flow as found in trunk yesterday in terms of threads and network > communications (each of which can possibly fail). It is a process that has > 18 or so netwo

Hbase Assignments in trunk.

2012-09-05 Thread Jonathan Hsieh
I generally think in pictures, so I've mapped out the single Assignment control flow as found in trunk yesterday in terms of threads and network communications (each of which can possibly fail). It is a process that has 18 or so network communications, 3 processes, and about 8 threads coordinating