Re: Server Crash Recovery (WAS -- Re: ANN: The third hbase 0.94.0 release candidate is available for download)

2012-05-16 Thread Mikael Sitruk
Hey St.Ack Thanks for clarifications, For 4. replay of log: (Please correct if i'm wrong) So the RS will: a. split the log via HLogSplitter, write concurrently log content to other log files under each region, b. replay those smaller logs into its own memstore and own logs (is it done when the

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-16 Thread Jonathan Hsieh
to block release. Jon. On Tue, May 1, 2012 at 4:26 PM, lars hofhansl lhofha...@yahoo.com wrote: The third 0.94.0 RC is available for download here: http://people.apache.org/~larsh/hbase-0.94.0-rc3/ (My gpg key is available from pgp.mit.edu. Key id: 7CA45750) HBase 0.94 is a performance release

RE: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-16 Thread Ramkrishna.S.Vasudevan
See Inline.. Regards Ram -Original Message- From: Jonathan Hsieh [mailto:j...@cloudera.com] Sent: Wednesday, May 16, 2012 9:35 PM To: dev@hbase.apache.org; lars hofhansl Subject: Re: ANN: The third hbase 0.94.0 release candidate is available for download [Apparently I'm a little

Re: Server Crash Recovery (WAS -- Re: ANN: The third hbase 0.94.0 release candidate is available for download)

2012-05-16 Thread Stack
On Wed, May 16, 2012 at 12:25 AM, Mikael Sitruk mikael.sit...@gmail.com wrote: Hey St.Ack Thanks for clarifications, For 4. replay of log: (Please correct if i'm wrong) So the RS will: a. split the log via HLogSplitter, write concurrently log content to other log files under each region,

Server Crash Recovery (WAS -- Re: ANN: The third hbase 0.94.0 release candidate is available for download)

2012-05-15 Thread Stack
(Moved this conversation off the vote thread) On Sat, May 12, 2012 at 3:14 PM, Mikael Sitruk mikael.sit...@gmail.com wrote: So in case a RS goes down, the master will split the log and reassign the regions to other RS, then each RS will replay the log, during this step the regions are

RE: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-14 Thread Ramkrishna.S.Vasudevan
: Re: ANN: The third hbase 0.94.0 release candidate is available for download OK, I'll change my tactic :) If there are no -1's by Wed, May 16th, I'll release RC4 as 0.94.0. -- Lars - Original Message - From: Stack st...@duboce.net To: lars hofhansl lhofha...@yahoo.com Cc

RE: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-14 Thread Ramkrishna.S.Vasudevan
-Original Message- From: Ramkrishna.S.Vasudevan [mailto:ramkrishna.vasude...@huawei.com] Sent: Monday, May 14, 2012 11:48 AM To: dev@hbase.apache.org; 'lars hofhansl' Subject: RE: ANN: The third hbase 0.94.0 release candidate is available for download Hi We (it includes the test team here

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-14 Thread Ted Yu
' Subject: RE: ANN: The third hbase 0.94.0 release candidate is available for download Hi We (it includes the test team here) 0.94 RC and carried out various operations on it. Puts, Scans, and all the restart scenarios (using kill -9 also). Even the encoding stuffs were tested

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-14 Thread lars hofhansl
From: Ted Yu yuzhih...@gmail.com To: dev@hbase.apache.org Sent: Monday, May 14, 2012 7:17 AM Subject: Re: ANN: The third hbase 0.94.0 release candidate is available for download Thanks for sharing this information, Ramkrishna. Dictionary WAL compression makes replication not functional

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-14 Thread Todd Lipcon
if I cut a new RC now. -- Lars From: Ted Yu yuzhih...@gmail.com To: dev@hbase.apache.org Sent: Monday, May 14, 2012 7:17 AM Subject: Re: ANN: The third hbase 0.94.0 release candidate is available for download Thanks for sharing this information

RE: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-14 Thread Ramkrishna.S.Vasudevan
; lars hofhansl Subject: Re: ANN: The third hbase 0.94.0 release candidate is available for download On Mon, May 14, 2012 at 8:15 AM, lars hofhansl lhofha...@yahoo.com wrote: It's default off. I'd say we just say it's an experimental feature in the release notes. +1 for calling

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-13 Thread lars hofhansl
: ANN: The third hbase 0.94.0 release candidate is available for download On Fri, May 11, 2012 at 10:26 PM, lars hofhansl lhofha...@yahoo.com wrote: Thanks Stack. So that's two +1 (mine doesn't count I guess). And no -1. Why doesn't yours count?  Usually the RMs does, if they +1 it.  So

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-12 Thread Mikael Sitruk
Thanks for the clarifications St.Ack. Still I have some questions in regards of 3 in scenario discussed - when a region is offline it means that client operation are not possible on it (even read)? In case a second master is up (in an environment with multiple master), i presume all this occurs

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-12 Thread Stack
On Sat, May 12, 2012 at 10:14 AM, Mikael Sitruk mikael.sit...@gmail.com wrote: Thanks for the clarifications St.Ack. Still I have some questions in regards of 3 in scenario discussed -  when a region is offline it means that client operation are not possible on it (even read)? Correct. In

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-12 Thread Mikael Sitruk
Hi St.Ack You asked for it :-) So in case a RS goes down, the master will split the log and reassign the regions to other RS, then each RS will replay the log, during this step the regions are unavailable, and clients will got exceptions. 1. how the master will choose a RS to assign a region? 2.

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-11 Thread Mikael Sitruk
Stack hi Sorry for not being precise enough. The point is that i'm trying to check the impact of HA scenarios. one of them is when the master goes down. That is true that the Master is not it the critical path of read/write unless (please correct me if i'm wrong): 1. new client are trying to

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-11 Thread Stack
On Fri, May 11, 2012 at 3:24 AM, Mikael Sitruk mikael.sit...@gmail.com wrote: Sorry for not being precise enough. The point is that i'm trying to check the impact of HA scenarios. one of them is when the master goes down. That is true that the Master is not it the critical path of read/write

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-11 Thread lars hofhansl
From: Stack st...@duboce.net To: dev@hbase.apache.org; lars hofhansl lhofha...@yahoo.com Sent: Thursday, May 10, 2012 9:15 PM Subject: Re: ANN: The third hbase 0.94.0 release candidate is available for download On Tue, May 1, 2012 at 4:26 PM, lars hofhansl lhofha...@yahoo.com wrote

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-11 Thread Stack
On Fri, May 11, 2012 at 10:26 PM, lars hofhansl lhofha...@yahoo.com wrote: Thanks Stack. So that's two +1 (mine doesn't count I guess). And no -1. Why doesn't yours count? Usually the RMs does, if they +1 it. So, that'd be 3x+1 + a non-binding +1. I talked to Ram offline, and we'll fix

RE: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-10 Thread Ramkrishna.S.Vasudevan
sinking the current one. Regards Ram -Original Message- From: lars hofhansl [mailto:lhofha...@yahoo.com] Sent: Thursday, May 10, 2012 6:27 AM To: dev@hbase.apache.org Subject: Re: ANN: The third hbase 0.94.0 release candidate is available for download Gentle reminder to please

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-10 Thread Andrew Purtell
-Original Message- From: lars hofhansl [mailto:lhofha...@yahoo.com] Sent: Thursday, May 10, 2012 6:27 AM To: dev@hbase.apache.org Subject: Re: ANN: The third hbase 0.94.0 release candidate is available for download Gentle reminder to please provide your votes. (and actually

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-10 Thread Todd Lipcon
On Thu, May 10, 2012 at 8:41 AM, Ramkrishna.S.Vasudevan ramkrishna.vasude...@huawei.com wrote: But older version has a filehandler leak in DN side for which Todd has provided fix in hadoop side. Refer to HDFS-3359.  We can easily reproduce this problem if we have a multiple column family table

RE: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-10 Thread rama krishna
Date: Thu, 10 May 2012 10:01:20 -0700 Subject: Re: ANN: The third hbase 0.94.0 release candidate is available for download To: dev@hbase.apache.org CC: lhofha...@yahoo.com; ram_krish...@hotmail.com On Thu, May 10, 2012 at 8:41 AM, Ramkrishna.S.Vasudevan ramkrishna.vasude...@huawei.com

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-10 Thread Stack
On Tue, May 1, 2012 at 4:26 PM, lars hofhansl lhofha...@yahoo.com wrote: The third 0.94.0 RC is available for download here: http://people.apache.org/~larsh/hbase-0.94.0-rc3/ (My gpg key is available from pgp.mit.edu. Key id: 7CA45750) I'm +1 on this RC going out as 0.94.0. On the hadoop

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-10 Thread Mikael Sitruk
PM, lars hofhansl lhofha...@yahoo.com wrote: The third 0.94.0 RC is available for download here: http://people.apache.org/~larsh/hbase-0.94.0-rc3/ (My gpg key is available from pgp.mit.edu. Key id: 7CA45750) I'm +1 on this RC going out as 0.94.0. On the hadoop 2.0.0 issues, I'm w/ Andy

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-10 Thread Stack
On Thu, May 10, 2012 at 10:04 PM, Mikael Sitruk mikael.sit...@gmail.com wrote: Stack do you have latency graph during the time the RS and HMaster were down? (did you see a big variance in latency)? Not sure I follow Mikael. The master is not in the read/write path so its restart wouldn't

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-09 Thread lars hofhansl
Gentle reminder to please provide your votes. (and actually this is 4th RC, rather than the third) -- Lars From: lars hofhansl lhofha...@yahoo.com To: hbase-dev dev@hbase.apache.org Sent: Tuesday, May 1, 2012 4:26 PM Subject: ANN: The third hbase 0.94.0 release

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-08 Thread Elliott Clark
: Todd Lipcon t...@cloudera.com To: dev@hbase.apache.org; lars hofhansl lhofha...@yahoo.com Cc: Sent: Tuesday, May 1, 2012 9:35 PM Subject: Re: ANN: The third hbase 0.94.0 release candidate is available

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-08 Thread Elliott Clark
, May 7, 2012 11:07 AM Subject: Re: ANN: The third hbase 0.94.0 release candidate is available for download Sorry everything is in elapsed time as reported by Elapsed time in milliseconds. So higher is worse. The standard deviation on 0.92.1 writes is 4,591,384 so Write 5 is a little outside

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-07 Thread Elliott Clark
; lars hofhansl lhofha...@yahoo.com Cc: Sent: Tuesday, May 1, 2012 9:35 PM Subject: Re: ANN: The third hbase 0.94.0 release candidate is available for download +1 from me, I took it for a spin on the local filesystem

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-07 Thread Elliott Clark
- Original Message - From: Todd Lipcon t...@cloudera.com To: dev@hbase.apache.org; lars hofhansl lhofha...@yahoo.com Cc: Sent: Tuesday, May 1, 2012 9:35 PM Subject: Re: ANN: The third hbase 0.94.0 release candidate

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-07 Thread Enis Söztutar
: The third hbase 0.94.0 release candidate is available for download +1 from me, I took it for a spin on the local filesystem with some YCSB load. Here is my signature on the non-secure tarball

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-04 Thread Elliott Clark
- From: Todd Lipcon t...@cloudera.com To: dev@hbase.apache.org; lars hofhansl lhofha...@yahoo.com Cc: Sent: Tuesday, May 1, 2012 9:35 PM Subject: Re: ANN: The third hbase 0.94.0 release candidate is available for download +1 from me, I took it for a spin

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-03 Thread Mikael Sitruk
- Original Message - From: Todd Lipcon t...@cloudera.com To: dev@hbase.apache.org; lars hofhansl lhofha...@yahoo.com Cc: Sent: Tuesday, May 1, 2012 9:35 PM Subject: Re: ANN: The third hbase 0.94.0 release candidate is available for download +1

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-03 Thread Elliott Clark
...@yahoo.com Cc: Sent: Tuesday, May 1, 2012 9:35 PM Subject: Re: ANN: The third hbase 0.94.0 release candidate is available for download +1 from me, I took it for a spin on the local filesystem with some YCSB load. Here is my signature on the non

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-02 Thread Elliott Clark
- Original Message - From: Todd Lipcon t...@cloudera.com To: dev@hbase.apache.org; lars hofhansl lhofha...@yahoo.com Cc: Sent: Tuesday, May 1, 2012 9:35 PM Subject: Re: ANN: The third hbase 0.94.0 release candidate is available for download +1 from me, I took it for a spin

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-02 Thread Ted Yu
...@yahoo.com Cc: Sent: Tuesday, May 1, 2012 9:35 PM Subject: Re: ANN: The third hbase 0.94.0 release candidate is available for download +1 from me, I took it for a spin on the local filesystem with some YCSB load. Here is my signature on the non-secure tarball. -BEGIN PGP SIGNATURE

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-02 Thread Elliott Clark
: ANN: The third hbase 0.94.0 release candidate is available for download +1 from me, I took it for a spin on the local filesystem with some YCSB load. Here is my signature on the non-secure tarball. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.10 (GNU/Linux) iEYEABECAAYFAk

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-02 Thread Ted Yu
then be pulled straight from that tag. -- Lars - Original Message - From: Todd Lipcon t...@cloudera.com To: dev@hbase.apache.org; lars hofhansl lhofha...@yahoo.com Cc: Sent: Tuesday, May 1, 2012 9:35 PM Subject: Re: ANN: The third hbase 0.94.0 release

ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-01 Thread lars hofhansl
The third 0.94.0 RC is available for download here: http://people.apache.org/~larsh/hbase-0.94.0-rc3/ (My gpg key is available from pgp.mit.edu. Key id: 7CA45750) HBase 0.94 is a performance release, and there are some interesting new features as well. It is wire compatible with 0.92.x. 0.92

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-01 Thread Todd Lipcon
PM, lars hofhansl lhofha...@yahoo.com wrote: The third 0.94.0 RC is available for download here: http://people.apache.org/~larsh/hbase-0.94.0-rc3/ (My gpg key is available from pgp.mit.edu. Key id: 7CA45750) HBase 0.94 is a performance release, and there are some interesting new features

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-05-01 Thread lars hofhansl
hofhansl lhofha...@yahoo.com Cc: Sent: Tuesday, May 1, 2012 9:35 PM Subject: Re: ANN: The third hbase 0.94.0 release candidate is available for download +1 from me, I took it for a spin on the local filesystem with some YCSB load. Here is my signature on the non-secure tarball. -BEGIN PGP

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-04-23 Thread Jonathan Hsieh
I hate to do this but I think this sinks this rc: https://issues.apache.org/jira/browse/HBASE-5861 Jon. On Wed, Apr 18, 2012 at 4:20 PM, lars hofhansl lhofha...@yahoo.com wrote: The third 0.94.0 RC is available for download here: http://people.apache.org/~larsh/hbase-0.94.0-rc2/ I signed

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-04-23 Thread Stack
On Mon, Apr 23, 2012 at 10:46 AM, Jonathan Hsieh j...@cloudera.com wrote: I hate to do this but I think this sinks this rc: https://issues.apache.org/jira/browse/HBASE-5861 Party-pooper! I put up some questions in the issue Jon. Good on you, St.Ack

Re: ANN: The third hbase 0.94.0 release candidate is available for download

2012-04-23 Thread lars hofhansl
...@yahoo.com Cc: Sent: Monday, April 23, 2012 10:46 AM Subject: Re: ANN: The third hbase 0.94.0 release candidate is available for download I hate to do this but I think this sinks this rc: https://issues.apache.org/jira/browse/HBASE-5861 Jon. On Wed, Apr 18, 2012 at 4:20 PM, lars hofhansl

RE: The third hbase 0.94.0 release candidate is available for download

2012-04-18 Thread Ramkrishna.S.Vasudevan
Thanks Lars. Will give it a go in next few days and get back on it. Regards Ram -Original Message- From: lars hofhansl [mailto:lhofha...@yahoo.com] Sent: Thursday, April 19, 2012 4:51 AM To: hbase-dev Subject: ANN: The third hbase 0.94.0 release candidate is available for download

Re: ANN: The second hbase 0.94.0 release candidate is available for download

2012-04-15 Thread Jonathan Hsieh
this announcement. RC2 to follow soon. From: lars hofhansl lhofha...@yahoo.com To: hbase-dev dev@hbase.apache.org Sent: Friday, April 13, 2012 5:35 PM Subject: ANN: The second hbase 0.94.0 release candidate is available for download The second 0.94.0 RC is available

ANN: The second hbase 0.94.0 release candidate is available for download

2012-04-13 Thread lars hofhansl
The second 0.94.0 RC is available for download here: http://people.apache.org/~larsh/hbase-0.94.0-rc1/ I signed the tarballs. My gpg key (signed by stack) is available from pgp.mit.edu. Key id: 7CA45750 HBase 0.94 is a performance release with a few new features as well. It is wire compatible

RE: ANN: The first hbase 0.94.0 release candidate is available for download

2012-03-31 Thread Ramakrishna s vasudevan
From: Jonathan Hsieh [j...@cloudera.com] Sent: Saturday, March 31, 2012 7:01 AM To: dev@hbase.apache.org; lars hofhansl Subject: Re: ANN: The first hbase 0.94.0 release candidate is available for download This looks like a bug in hdfs 0.23 shim later added to 0.23.0 in HDFS-2412

Re: ANN: The first hbase 0.94.0 release candidate is available for download

2012-03-31 Thread Ted Yu
Would HBASE-5690 sink rc0 ? compression does not work in Store.java of 0.94 Thanks On Tue, Mar 27, 2012 at 11:28 PM, lars hofhansl lhofha...@yahoo.com wrote: The first 0.94.0 RC is available for download here: http://people.apache.org/~larsh/hbase-0.94.0-rc0/ (The tarballs are signed

Re: ANN: The first hbase 0.94.0 release candidate is available for download

2012-03-31 Thread Ted Yu
...@yahoo.comwrote: The first 0.94.0 RC is available for download here: http://people.apache.org/~larsh/hbase-0.94.0-rc0/ (The tarballs are signed by Stack this time, since I do not have a signed Apache key, yet.) HBase 0.94 is first and foremost a performance release with a few new features

Re: ANN: The first hbase 0.94.0 release candidate is available for download

2012-03-31 Thread lars hofhansl
On Tue, Mar 27, 2012 at 11:28 PM, lars hofhansl lhofha...@yahoo.com wrote: The first 0.94.0 RC is available for download here: http://people.apache.org/%7Elarsh/hbase-0.94.0-rc0/ (The tarballs are signed by Stack this time, since I do not have a signed Apache key, yet.) HBase 0.94 is first

RE: ANN: The first hbase 0.94.0 release candidate is available for download

2012-03-30 Thread Ramkrishna.S.Vasudevan
29, 2012 9:27 PM To: dev@hbase.apache.org Cc: lars hofhansl Subject: Re: ANN: The first hbase 0.94.0 release candidate is available for download To be clear, a rolling restart from 90 to 94 isn't expected to work. But a shutdown and restart ought to. (If not, like Jon said, we'll be fixing

Re: ANN: The first hbase 0.94.0 release candidate is available for download

2012-03-30 Thread Jonathan Hsieh
mistake with this? Regards Ram -Original Message- From: Todd Lipcon [mailto:t...@cloudera.com] Sent: Thursday, March 29, 2012 9:27 PM To: dev@hbase.apache.org Cc: lars hofhansl Subject: Re: ANN: The first hbase 0.94.0 release candidate is available for download To be clear

Re: ANN: The first hbase 0.94.0 release candidate is available for download

2012-03-30 Thread lars hofhansl
: The first hbase 0.94.0 release candidate is available for download Hi When we tried to start the 0.94 version with hadoop 0.23.1 we got the following exception stack trace.. Even 0.92.2 snapshot also had the same problem.  2012-03-30 11:12:19,487 FATAL org.apache.hadoop.hbase.master.HMaster

Re: ANN: The first hbase 0.94.0 release candidate is available for download

2012-03-30 Thread Jonathan Hsieh
. -- Lars From: Ramkrishna.S.Vasudevan ramkrishna.vasude...@huawei.com To: dev@hbase.apache.org Cc: 'lars hofhansl' lhofha...@yahoo.com Sent: Friday, March 30, 2012 6:03 AM Subject: RE: ANN: The first hbase 0.94.0 release candidate is available

Re: ANN: The first hbase 0.94.0 release candidate is available for download

2012-03-30 Thread Jonathan Hsieh
: Ramkrishna.S.Vasudevan ramkrishna.vasude...@huawei.com To: dev@hbase.apache.org Cc: 'lars hofhansl' lhofha...@yahoo.com Sent: Friday, March 30, 2012 6:03 AM Subject: RE: ANN: The first hbase 0.94.0 release candidate is available for download Hi When we tried to start the 0.94 version

Re: ANN: The first hbase 0.94.0 release candidate is available for download

2012-03-28 Thread Stack
: Wednesday, March 28, 2012 5:11 PM Subject: Re: ANN: The first hbase 0.94.0 release candidate is available for download The change was for HBASE-5258 Incompatibility was expected. Thanks On Wed, Mar 28, 2012 at 5:01 PM, Stack st...@duboce.net wrote: On Wed, Mar 28, 2012 at 3:54 PM, Ted Yu

Re: ANN: The first hbase 0.94.0 release candidate is available for download

2012-03-28 Thread yuzhihong
not test rolling upgrade to 0.94? Thanks. -- Lars From: Ted Yu yuzhih...@gmail.com To: dev@hbase.apache.org Sent: Wednesday, March 28, 2012 5:11 PM Subject: Re: ANN: The first hbase 0.94.0 release candidate is available for download The change

RE: ANN: The first hbase 0.94.0 release candidate is available for download

2012-03-28 Thread Ramkrishna.S.Vasudevan
@hbase.apache.org Subject: Re: ANN: The first hbase 0.94.0 release candidate is available for download I only used 0.94 for 20 minutes :-) It worked during that time. So yes to all questions. On Mar 28, 2012, at 9:14 PM, Stack st...@duboce.net wrote: Is it working for you Ted? You going

RE: ANN: The first hbase 0.94.0 release candidate is available for download

2012-03-28 Thread Ramkrishna.S.Vasudevan
Thanks Lars and Jon. I too expect the same to work. I will try testing it that way. Regards Ram -Original Message- From: lars hofhansl [mailto:lhofha...@yahoo.com] Sent: Thursday, March 29, 2012 10:27 AM To: dev@hbase.apache.org Subject: Re: ANN: The first hbase 0.94.0 release

Re: hbase 0.94.0

2012-02-06 Thread tsuna
On Mon, Jan 30, 2012 at 3:37 PM, Nicolas Spiegelberg nspiegelb...@fb.com wrote: I'm advocating that RPC compatibility breakage is not acceptable for FB because this is a vital and highly-deployed infrastructure piece.  I'm assuming this strategy may not be acceptable for other major

Re: hbase 0.94.0

2012-02-02 Thread Jean-Daniel Cryans
Late answer, I just came back from vacation. On Mon, Jan 30, 2012 at 10:03 PM, Nicolas Spiegelberg nspiegelb...@fb.com wrote: I think HFile upgrade in particular is more complicated than you think. We currently have production traffic running with HFileV1.  It has a 5-min SLA.  We can't afford

Re: hbase 0.94.0

2012-02-02 Thread Nicolas Spiegelberg
I think HFile upgrade in particular is more complicated than you think. We currently have production traffic running with HFileV1. It has a 5-min SLA. We can't afford to take the entire downtime to rewrite 100GB (or whatever) worth of data. We need to do this while the cluster is live. AFAIK

Re: hbase 0.94.0

2012-02-02 Thread lars hofhansl
@hbase.apache.org Sent: Thursday, February 2, 2012 5:24 PM Subject: Re: hbase 0.94.0 I think HFile upgrade in particular is more complicated than you think. We currently have production traffic running with HFileV1.  It has a 5-min SLA.  We can't afford to take the entire downtime to rewrite 100GB (or whatever

Re: hbase 0.94.0

2012-02-01 Thread Andrew Purtell
:37 PM Subject: Re: hbase 0.94.0 Traditionally there have been no guarantees of cross major version compatibility. RPC especially. Never a rolling upgrade from an 0.90 to an 0.92, for example. For persistent data, there is a migration utility for upping from one major release to the next. I'm

Re: hbase 0.94.0

2012-01-31 Thread Nicolas Spiegelberg
1) The trunk has more master work. Specifically 89-master related features that we implemented for our grid architecture. You have a list of issues Nicolas? We have a list, but it's non-trivial. You're more than welcome to help if you want. :) 2) Client/Server compatibility. Even if we

Re: hbase 0.94.0

2012-01-30 Thread Todd Lipcon
j...@cloudera.com To: Matt Corgan mcor...@hotpads.com Cc: lars hofhansl lhofha...@yahoo.com; dev dev@hbase.apache.org Sent: Friday, January 27, 2012 6:11 PM Subject: Re: hbase 0.94.0 Lars, Matt, I like Matt's suggestion -- as long as it is not a burden let's keep it in. If it becomes one

Re: hbase 0.94.0

2012-01-30 Thread Nicolas Spiegelberg
@hbase.apache.org; lars hofhansl lhofha...@yahoo.com Sent: Friday, January 27, 2012 10:10 AM Subject: Re: hbase 0.94.0 Lars, The upcoming CDH4 Beta HBase will be based on the latest hotness, 0.92.0. A CDH4 GA HBase will have to have an upgrade path from CDH3 HBase. If that HBase is 0.92 based

Re: hbase 0.94.0

2012-01-30 Thread Jonathan Hsieh
From: Jonathan Hsieh j...@cloudera.com To: dev@hbase.apache.org; lars hofhansl lhofha...@yahoo.com Sent: Friday, January 27, 2012 10:10 AM Subject: Re: hbase 0.94.0 Lars, The upcoming CDH4 Beta HBase will be based on the latest hotness, 0.92.0. A CDH4 GA

Re: hbase 0.94.0

2012-01-30 Thread Andrew Purtell
: lars hofhansl lhofha...@yahoo.com; Matt Corgan mcor...@hotpads.com Sent: Monday, January 30, 2012 10:44 AM Subject: Re: hbase 0.94.0 On Sun, Jan 29, 2012 at 7:30 AM, Ted Yu yuzhih...@gmail.com wrote: Initial results from HBASE-5074, support checksums in HBase block cache, look promising

Re: hbase 0.94.0

2012-01-30 Thread Ted Yu
Subject: Re: hbase 0.94.0 On Sun, Jan 29, 2012 at 7:30 AM, Ted Yu yuzhih...@gmail.com wrote: Initial results from HBASE-5074, support checksums in HBase block cache, look promising. Shall we discuss whether 0.94 should include it (assuming Dhruba can finish the feature in Feb

Re: hbase 0.94.0

2012-01-30 Thread Nicolas Spiegelberg
...@hotpads.com Sent: Monday, January 30, 2012 10:44 AM Subject: Re: hbase 0.94.0 On Sun, Jan 29, 2012 at 7:30 AM, Ted Yu yuzhih...@gmail.com wrote: Initial results from HBASE-5074, support checksums in HBase block cache, look promising. Shall we discuss whether 0.94 should include

Re: hbase 0.94.0

2012-01-30 Thread Andrew Purtell
...@gmail.com To: dev@hbase.apache.org; Andrew Purtell apurt...@apache.org Cc: lars hofhansl lhofha...@yahoo.com; Matt Corgan mcor...@hotpads.com Sent: Monday, January 30, 2012 11:46 AM Subject: Re: hbase 0.94.0 Before long term wire and format compatibility is reached, I am -0 on time based

Re: hbase 0.94.0

2012-01-30 Thread Nicolas Spiegelberg
Traditionally there have been no guarantees of cross major version compatibility. RPC especially. Never a rolling upgrade from an 0.90 to an 0.92, for example. For persistent data, there is a migration utility for upping from one major release to the next. I'm advocating that RPC compatibility

Re: hbase 0.94.0

2012-01-30 Thread Jimmy Xiang
Currently, Jon and me in Cloudera are trying to come up a proposal for client server wire compatibility and rolling upgrade support. We will share with the community after we come to some consensus internal at first. :) Thanks, Jimmy On Mon, Jan 30, 2012 at 3:37 PM, Nicolas Spiegelberg

Re: hbase 0.94.0

2012-01-30 Thread Lars H
Sent: Friday, January 27, 2012 10:10 AM Subject: Re: hbase 0.94.0 Lars, The upcoming CDH4 Beta HBase will be based on the latest hotness, 0.92.0. A CDH4 GA HBase will have to have an upgrade path from CDH3 HBase. If that HBase is 0.92 based, we'll test that, and if timing works out and we

Re: hbase 0.94.0

2012-01-30 Thread Stack
On Mon, Jan 30, 2012 at 11:21 AM, Nicolas Spiegelberg nspiegelb...@fb.com wrote: 1) The trunk has more master work.  Specifically 89-master related features that we implemented for our grid architecture.  It sounds like most of those features are rising in prominence in the Open Source

Re: hbase 0.94.0

2012-01-30 Thread Stack
On Mon, Jan 30, 2012 at 10:44 AM, Todd Lipcon t...@cloudera.com wrote: Maybe the discussion should be whether 0.94 should be a time-gated or feature-gated release? IMO we already have enough good stuff in there on the perf front. It will be great if the checksum improvement makes it, but if it

Re: hbase 0.94.0

2012-01-30 Thread Stack
On Mon, Jan 30, 2012 at 3:37 PM, Nicolas Spiegelberg nspiegelb...@fb.com wrote: However, I think it's safe to say that there are multiple instances where the DBA team and the AppServer team are different people, especially with any group exploring multi-tenancy.  For that use case, client

Re: hbase 0.94.0

2012-01-30 Thread Nicolas Spiegelberg
1) The trunk has more master work. Specifically 89-master related features that we implemented for our grid architecture. You have a list of issues Nicolas? It's at least 3 major features. We're more than willing to work with you on porting. It sounds like eBay Cloudera have some possible

Re: hbase 0.94.0

2012-01-30 Thread Devaraj Das
j...@cloudera.com To: dev@hbase.apache.org; lars hofhansl lhofha...@yahoo.com Sent: Friday, January 27, 2012 10:10 AM Subject: Re: hbase 0.94.0 Lars, The upcoming CDH4 Beta HBase will be based on the latest hotness, 0.92.0. A CDH4 GA HBase will have to have an upgrade path from CDH3

Re: hbase 0.94.0

2012-01-29 Thread Ted Yu
? -- Lars From: Jonathan Hsieh j...@cloudera.com To: Matt Corgan mcor...@hotpads.com Cc: lars hofhansl lhofha...@yahoo.com; dev dev@hbase.apache.org Sent: Friday, January 27, 2012 6:11 PM Subject: Re: hbase 0.94.0 Lars, Matt, I like Matt's suggestion

Re: hbase 0.94.0

2012-01-27 Thread Ted Yu
I think we should have 3 consecutive successful builds on Apache Jenkins for TRUNK before branching. Cheers On Thu, Jan 26, 2012 at 9:13 PM, Stack st...@duboce.net wrote: (Replying in one mail to a couple of points raised above in this thread) On Thu, Jan 26, 2012 at 9:37 AM, lars hofhansl

Re: hbase 0.94.0

2012-01-27 Thread lars hofhansl
...@cloudera.com To: dev@hbase.apache.org Cc: lars hofhansl lhofha...@yahoo.com Sent: Friday, January 27, 2012 7:20 AM Subject: Re: hbase 0.94.0 On Thu, Jan 26, 2012 at 9:13 PM, Stack st...@duboce.net wrote: -1 on our working on stuff to make it easier to skip intermediary versions.  Migrations

Re: hbase 0.94.0

2012-01-27 Thread Stack
On Fri, Jan 27, 2012 at 7:20 AM, Todd Lipcon t...@cloudera.com wrote: On Thu, Jan 26, 2012 at 9:13 PM, Stack st...@duboce.net wrote: -1 on our working on stuff to make it easier to skip intermediary versions.  Migrations are hard enough going between particular versions already.  Support for

Re: hbase 0.94.0

2012-01-27 Thread Stack
On Fri, Jan 27, 2012 at 8:42 AM, Stack st...@duboce.net wrote: In this particular case, there was no explicit migration step needed going 0.90 to 0.92.  Upgrading from 0.90 to 0.94 should just be running the 0.92 to 0.94 migration script (if there is one). Thinking more, the above only really

Re: hbase 0.94.0

2012-01-27 Thread lars hofhansl
- Original Message - From: Stack st...@duboce.net To: dev@hbase.apache.org Cc: Sent: Friday, January 27, 2012 9:02 AM Subject: Re: hbase 0.94.0 On Fri, Jan 27, 2012 at 8:42 AM, Stack st...@duboce.net wrote: In this particular case, there was no explicit migration step needed going 0.90 to 0.92

Re: hbase 0.94.0

2012-01-27 Thread Jonathan Hsieh
in 0.94? -- Lars - Original Message - From: Stack st...@duboce.net To: dev@hbase.apache.org Cc: Sent: Friday, January 27, 2012 9:02 AM Subject: Re: hbase 0.94.0 On Fri, Jan 27, 2012 at 8:42 AM, Stack st...@duboce.net wrote: In this particular case, there was no explicit migration

Re: hbase 0.94.0

2012-01-27 Thread Stack
On Fri, Jan 27, 2012 at 9:16 AM, lars hofhansl lhofha...@yahoo.com wrote: Stack, what's your feeling w.r.t. to HBASE-2600, will keeping the 0.90 - 0.92 migration path make the migration code for HBASE-2600 (much) more complicated in 0.94? hbase-2600 should go in when its ready. It might make

Re: hbase 0.94.0

2012-01-27 Thread lars hofhansl
@hbase.apache.org; lars hofhansl lhofha...@yahoo.com Sent: Friday, January 27, 2012 10:10 AM Subject: Re: hbase 0.94.0 Lars, The upcoming CDH4 Beta HBase will be based on the latest hotness, 0.92.0. A CDH4 GA HBase will have to have an upgrade path from CDH3 HBase. If that HBase is 0.92 based, we'll test

Re: hbase 0.94.0

2012-01-27 Thread Matt Corgan
From: Jonathan Hsieh j...@cloudera.com To: dev@hbase.apache.org; lars hofhansl lhofha...@yahoo.com Sent: Friday, January 27, 2012 10:10 AM Subject: Re: hbase 0.94.0 Lars, The upcoming CDH4 Beta HBase will be based on the latest hotness, 0.92.0. A CDH4 GA

Re: hbase 0.94.0

2012-01-27 Thread lars hofhansl
From: Andrew Purtell apurt...@apache.org To: dev@hbase.apache.org dev@hbase.apache.org; lars hofhansl lhofha...@yahoo.com Sent: Thursday, January 26, 2012 11:27 AM Subject: Re: hbase 0.94.0 Dare I mention secondary indexes for 0.96? You can. :-) But what does that mean

Re: hbase 0.94.0

2012-01-27 Thread lars hofhansl
Thanks would be awesome! Let's do that in 0.96. :) - Original Message - From: Matt Corgan mcor...@hotpads.com To: lars hofhansl lhofha...@yahoo.com; dev dev@hbase.apache.org Cc: Jonathan Hsieh j...@cloudera.com Sent: Friday, January 27, 2012 12:06 PM Subject: Re: hbase 0.94.0

Re: hbase 0.94.0

2012-01-27 Thread Jonathan Hsieh
can make sure (if needed) that it is all working. Does that work for you guys? -- Lars From: Jonathan Hsieh j...@cloudera.com To: dev@hbase.apache.org; lars hofhansl lhofha...@yahoo.com Sent: Friday, January 27, 2012 10:10 AM Subject: Re: hbase 0.94.0

Re: hbase 0.94.0

2012-01-27 Thread lars hofhansl
version of HBASE-5128? -- Lars From: Jonathan Hsieh j...@cloudera.com To: Matt Corgan mcor...@hotpads.com Cc: lars hofhansl lhofha...@yahoo.com; dev dev@hbase.apache.org Sent: Friday, January 27, 2012 6:11 PM Subject: Re: hbase 0.94.0 Lars, Matt, I like Matt's

Re: hbase 0.94.0

2012-01-27 Thread Jonathan Hsieh
From: Jonathan Hsieh j...@cloudera.com To: Matt Corgan mcor...@hotpads.com Cc: lars hofhansl lhofha...@yahoo.com; dev dev@hbase.apache.org Sent: Friday, January 27, 2012 6:11 PM Subject: Re: hbase 0.94.0 Lars, Matt, I like Matt's suggestion

Re: hbase 0.94.0

2012-01-26 Thread Jonathan Hsieh
@hbase.apache.org Sent: Wednesday, January 25, 2012 8:34 PM Subject: hbase 0.94.0 Lets branch end of february? No new features thereafter. Is this too close in? Would be grand if 0.94.0 shipped before hbasecon. What should 0.94.0 have in it? I don't mind if the list is short. Unless someone else wants

Re: hbase 0.94.0

2012-01-26 Thread Jonathan Hsieh
Can you help me understand the significance cutting the branch a month from now? As a strawman -- now that 0.92 is out (and ideally just getting fixes and supportability improvements instead of new features), why don't we cut a branch even earlier and then just bring in the features we decide get

Re: hbase 0.94.0

2012-01-26 Thread Ted Yu
. I'm happy to be the release manager if you're tired of it. :) From: Stack st...@duboce.net To: HBase Dev List dev@hbase.apache.org Sent: Wednesday, January 25, 2012 8:34 PM Subject: hbase 0.94.0 Lets branch end of february? No new features

  1   2   >