Re: HBase 0.94.15: writes stalls periodically even under moderate steady load (AWS EC2)

2014-01-16 Thread lars hofhansl
In any case, though, I would not expect HBase to have any issue with that, unless there are some server issues at the HDFS layer. @Vladimir, what happens when you run HDFS' DFSIO? -- Lars - Original Message - From: Bryan Beaudreault To: dev@hbase.apache.org Cc: Sent: Thursday, Janua

Re: [VOTE] The 1st hbase 0.94.16 release candidate is available for download

2014-01-16 Thread lars hofhansl
region between the RS hundreds of times a second - Checked internal Phoenix build against 0.94 tip If one more (binding) person could have look, that would be a appreciated. Thanks. -- Lars - Original Message - From: Ted Yu To: "dev@hbase.apache.org" ; lars hofhansl Cc: S

Re: [VOTE] The 1st hbase 0.94.16 release candidate is available for download

2014-01-16 Thread lars hofhansl
Thanks, JM. What's that exception in the master. Does this always happen? Probably just HBCK uncleanly disconnecting. -- Lars - Original Message - From: Jean-Marc Spaggiari To: dev ; lars hofhansl Cc: Sent: Thursday, January 16, 2014 1:08 PM Subject: Re: [VOTE] The 1st

Re: 答复: 答复: HBase 0.94.15: writes stalls periodically even under moderate steady load (AWS EC2)

2014-01-17 Thread lars hofhansl
Rodionov To: "dev@hbase.apache.org" Cc: lars hofhansl Sent: Thursday, January 16, 2014 6:46 AM Subject: Re: 答复: 答复: HBase 0.94.15: writes stalls periodically even under moderate steady load (AWS EC2) 1.0.4 (default). On Thu, Jan 16, 2014 at 12:24 AM, 谢良 wrote: > Just curious

Re: [VOTE] The 1st hbase 0.94.16 release candidate is available for download

2014-01-17 Thread lars hofhansl
Thanks. Will release 0.94.16 today. -- Lars - Original Message - From: Jean-Marc Spaggiari To: dev ; lars hofhansl Cc: Sent: Thursday, January 16, 2014 1:18 PM Subject: Re: [VOTE] The 1st hbase 0.94.16 release candidate is available for download Yes, each time I do HBCK I see the

Re: DISCUSSION: 1.0.0

2014-01-20 Thread lars hofhansl
I'm happy to volunteer. Happy if Enis does it, too. From: Stack To: HBase Dev List Cc: lars hofhansl Sent: Monday, January 20, 2014 1:43 PM Subject: Re: DISCUSSION: 1.0.0 On Thu, Jan 2, 2014 at 1:20 PM, Enis Söztutar wrote: I think whether we

Re: Design review: Secondary index support through coprocess

2014-01-20 Thread lars hofhansl
Yep. That's my concern too. Would need to configure a generous number of handlers to prevent this from happening. From: Vladimir Rodionov To: "dev@hbase.apache.org" Sent: Monday, January 20, 2014 11:57 AM Subject: RE: Design review: Secondary index support t

[ANNOUNCE] HBase 0.94.16 is available for download

2014-01-20 Thread lars hofhansl
The HBase Team is pleased to announce the immediate release of HBase 0.94.16. Download it from your favorite Apache mirror [1]. This release has also been pushed to Apache's maven repository. All previous 0.92.x and 0.94.x releases can upgraded to 0.94.16 via a rolling upgrade without downtime,

Re: Are we no longer giving credit in SVN commit messages?

2014-01-20 Thread lars hofhansl
I always do that, unless I contributed the change myself, in which case I assume it is implied that the change is mine. Did somebody not do that? That would be bad (IMHO) -- Lars - Original Message - From: Andrew Purtell To: "dev@hbase.apache.org" Cc: Sent: Monday, January 20, 2014

Re: Are we no longer giving credit in SVN commit messages?

2014-01-20 Thread lars hofhansl
So just to confirm we're agreeing to follow the following format. HBASE-x . () What do people do about their own contributions? I have not bothered with tagged my own patches with "(LarsH)". -- Lars - Original Message - From: Jonathan Hsieh To: "dev@hbase.apache.org" Cc: Sent:

Re: [ANNOUNCE] HBase 0.94.16 is available for download

2014-01-20 Thread lars hofhansl
My counting skills appear to be suffering as age progresses. 0.94.16 fixes 21 issues (not 31). -- Lars From: lars hofhansl To: hbase-dev Sent: Monday, January 20, 2014 5:30 PM Subject: [ANNOUNCE] HBase 0.94.16 is available for download The HBase Team is

Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download

2014-01-25 Thread lars hofhansl
Probably not related to this RC specifically. I tried to upgrade my HBase 0.94 data to 0.98. The first time I started HBase the master died, because I did not confiure short circuit reads correctly. The problem is that on each subsequent start the master dies with: master.HMaster: Unhandled ex

Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download

2014-01-25 Thread lars hofhansl
neral work needed for the upgrade path. -- Lars ____ From: lars hofhansl To: "dev@hbase.apache.org" Cc: "u...@hbase.apache.org" Sent: Saturday, January 25, 2014 1:22 PM Subject: Re: [VOTE] The 1st HBase 0.98.0 release candidate is available

Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download

2014-01-25 Thread lars hofhansl
-- Lars ____ From: lars hofhansl To: "dev@hbase.apache.org" ; lars hofhansl Cc: "u...@hbase.apache.org" Sent: Saturday, January 25, 2014 1:28 PM Subject: Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download I "fixed" that by delet

Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download

2014-01-25 Thread lars hofhansl
No I didn't. Sorry. Never mind me. From: Andrew Purtell To: "dev@hbase.apache.org" Cc: "u...@hbase.apache.org" ; "dev@hbase.apache.org" ; lars hofhansl Sent: Saturday, January 25, 2014 2:10 PM Subject: Re: [VOTE] The 1s

Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download

2014-01-25 Thread lars hofhansl
+1, Based on the following: - Checked tarball, documentation, etc - Installed with Hadoop 2.2 - Went through the upgrade process from 0.94 - Loaded 50m rows - scanned, flushed, scanned again, compacted, scanned again - ran my scan client test Observations: - The error message could be a bit more

Re: [VOTE] The 1st HBase 0.98.0 release candidate is available for download

2014-01-25 Thread lars hofhansl
g in the blockcache and all KVs filtered at the server with a filter. But as you said, this is not a discussion thread. We can tackle performance improvements later in the cycle. -- Lars From: Andrew Purtell To: "u...@hbase.apache.org" ; lars hofha

Re: Sporadic memstore slowness for Read Heavy workloads

2014-01-26 Thread lars hofhansl
This is somewhat of a known issue, and I'm sure Vladimir will chime in soon. :) Reseek is expensive compared to next if next would get us the KV we're looking for. However, HBase does not know that ahead of time. There might be a 1000 versions of the previous KV to be skipped first. HBase seeks

Re: Sporadic memstore slowness for Read Heavy workloads

2014-01-28 Thread lars hofhansl
To: "dev@hbase.apache.org" Cc: "u...@hbase.apache.org" ; lars hofhansl Sent: Tuesday, January 28, 2014 9:04 AM Subject: Re: Sporadic memstore slowness for Read Heavy workloads Lexicographically, (ROW, COL2, T=3) should come after (ROW, COL1, T=1) because COL2 > COL1

Re: Sporadic memstore slowness for Read Heavy workloads

2014-01-28 Thread lars hofhansl
I see you figured it out. I should read all email before I sent my last reply. From: Varun Sharma To: "dev@hbase.apache.org" Cc: "u...@hbase.apache.org" ; lars hofhansl Sent: Tuesday, January 28, 2014 9:43 AM Subject: Re: Sporadic m

Re: Tagging 0.98.0 RC1 tomorrow

2014-01-29 Thread lars hofhansl
HBASE-10436 was broken for all of 0.96. I do not think that should be blocker for 0.98. It can fixed in a future point release. My $0.02. From: Andrew Purtell To: "dev@hbase.apache.org" Sent: Tuesday, January 28, 2014 5:54 PM Subject: Tagging 0.98.0 RC1 tomo

Re: StoreScanner created for memstore flush should be bothered about updated readers?

2014-01-30 Thread lars hofhansl
>From what I found is that the main performance detriment comes from the fact >that we need to take a lock for each next/peek call of the StoreScanner. Even >when those are uncontended (which they are in 99.9% of the cases) the memory >read/writes barriers are expensive. I doubt you'll see much

Re: StoreScanner created for memstore flush should be bothered about updated readers?

2014-01-30 Thread lars hofhansl
Interesting. Did you see the cause for the scanner reset? Was it a concurrent compaction? - Original Message - From: ramkrishna vasudevan To: "dev@hbase.apache.org" ; lars hofhansl Cc: Sent: Thursday, January 30, 2014 9:41 PM Subject: Re: StoreScanner created for mems

Re: StoreScanner created for memstore flush should be bothered about updated readers?

2014-01-31 Thread lars hofhansl
So now the memstore flush includes data from other persisted store files? That is bad. - Original Message - From: ramkrishna vasudevan To: "dev@hbase.apache.org" ; lars hofhansl Cc: Sent: Thursday, January 30, 2014 9:52 PM Subject: Re: StoreScanner created for memstore fl

Re: Binary API compatibility is not a requirement for any 0.98 release candidate

2014-02-03 Thread lars hofhansl
My $0.02... Wire (client-server and server-server) compatibility is a must have. Binary compatibility should be a best effort. I.e. we shouldn't go out of our way to break things, but if we want to clean up an API we should do that. So much for 0.98. Going forward... Once we go past version 1.0

Re: Binary API compatibility is not a requirement for any 0.98 release candidate

2014-02-04 Thread lars hofhansl
to retain binary compatibility, let's put these in. As usual, just my $0.02. -- Lars From: Jonathan Hsieh To: Andrew Purtell Cc: "dev@hbase.apache.org" ; lars hofhansl ; Andrew Purtell Sent: Tuesday, February 4, 2014 3:25 PM Subject: Re: Binary

Re: DISCUSSION: 1.0.0

2014-02-10 Thread lars hofhansl
+ a clearly defined compatibility strategy between patch, minor, and major versions + known coprocessor interfaces. For example right now a coprocessor can use everything on HRegion. We need to distill what's useful into an interface. + (wishes for ponies and unicorns, probably not going to happe

Re: DISCUSSION: 1.0.0

2014-02-10 Thread lars hofhansl
4:46 PM Subject: Re: DISCUSSION: 1.0.0 On Mon, Feb 10, 2014 at 4:42 PM, lars hofhansl wrote: > + known coprocessor interfaces. For example right now a coprocessor can > use everything on HRegion. We need to distill what's useful into an > interface. We started this with Enviro

Re: DISCUSSION: Enis for 1.0.0 RM

2014-02-11 Thread lars hofhansl
I don't think we need to vote. In any case +1 from me. From: Stack To: HBase Dev List Sent: Tuesday, February 11, 2014 3:20 PM Subject: DISCUSSION: Enis for 1.0.0 RM Over on the tail of concurrent thread 'DISCUSSION: 1.0.0', Enis volunteered (again) as 1.

0.94.17RC next later this week

2014-02-11 Thread lars hofhansl
I'm planning to cut an RC for 0.94.17 this week. Let me know of any issues that should be fixed that are not currently assigned to 0.94.17. Thanks. -- Lars

Re: 0.94.17RC next later this week

2014-02-13 Thread lars hofhansl
Lemme try. We need to sort out HBASE-10514. -- Lars - Original Message - From: Jean-Marc Spaggiari To: dev ; lars hofhansl Cc: Sent: Thursday, February 13, 2014 5:47 AM Subject: Re: 0.94.17RC next later this week Any chance to get it before the week-end? 2014-02-11 23:47 GMT-05

Re: 0.94.17RC next later this week

2014-02-13 Thread lars hofhansl
Just created the tag and started the release builds (although it looks like I cannot access jenkins atm to check status). Let's do it in 0.94.18. -- Lars From: Ted Yu To: "dev@hbase.apache.org" ; lars hofhansl Sent: Thursday, February 1

[VOTE] The 1st hbase 0.94.17 release candidate is available for download

2014-02-14 Thread lars hofhansl
The 1st 0.94.17 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.17-rc0/ Signed with my code signing key: C7CFE328 HBase 0.94.17 is a bug fix release with 26 fixes:     [HBASE-7963] - HBase VerifyReplication not working when security enabled     [HBASE-10249] - TestRepli

Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download

2014-02-14 Thread lars hofhansl
; [INFO] Total time: 1:09:06.469s > > > On Fri, Feb 14, 2014 at 3:56 PM, lars hofhansl wrote: > > > The 1st 0.94.17 RC is available for download at > > http://people.apache.org/~larsh/hbase-0.94.17-rc0/ > > Signed with my code signing key: C7CFE328 > > > >

Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download

2014-02-15 Thread lars hofhansl
From: Jean-Marc Spaggiari To: dev ; lars hofhansl Sent: Saturday, February 15, 2014 6:29 PM Subject: Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download ;) Thanks for that ;) I have testing in progress, but figured something strange when running in standalone. I

Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download

2014-02-15 Thread lars hofhansl
utility for adorning http Context   HBASE-10340  [BACKPORT] HBASE-9892 Add info port to ServerName to support multi instances in a node   -- Lars From: Jean-Marc Spaggiari To: dev ; lars hofhansl Sent: Saturday, February 15, 2014 6:29 PM Subject: Re: [VOTE] T

Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download

2014-02-16 Thread lars hofhansl
OK. -1 on the RC. - Original Message - From: Andrew Purtell To: "dev@hbase.apache.org" ; lars hofhansl Cc: Sent: Saturday, February 15, 2014 11:32 PM Subject: Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download On Sat, Feb 15, 2014 at 9:1

Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download

2014-02-16 Thread lars hofhansl
tion.java:97)     at java.lang.Thread.run(Thread.java:744) Occured 30% of the time, and only on GaussianRandomReadBenchmark. JM 2014-02-16 2:32 GMT-05:00 Andrew Purtell : > On Sat, Feb 15, 2014 at 9:18 PM, lars hofhansl wrote: > > > Actually looks like this was by design in HBASE-10340/HBASE-9892.

Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download

2014-02-16 Thread lars hofhansl
that file. -- Lars - Original Message - From: lars hofhansl To: "dev@hbase.apache.org" Cc: Sent: Sunday, February 16, 2014 10:15 AM Subject: Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download Hmm... Do you see this in 0.94.17 only (but not in

Re: [VOTE] The 1st hbase 0.94.17 release candidate is available for download

2014-02-16 Thread lars hofhansl
generate a key < 0, which is rare, but by no means impossible. We need to clamp the min and max values to 0 and 2*N, resp. -- Lars From: Jean-Marc Spaggiari To: dev ; lars hofhansl Sent: Sunday, February 16, 2014 10:59 AM Subject: Re: [VOTE] The 1st hb

[VOTE] The 2nd hbase 0.94.17 release candidate is available for download

2014-02-18 Thread lars hofhansl
The 2nd 0.94.17 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.17-rc1/ Signed with my code signing key: C7CFE328 HBase 0.94.17 is a bug fix release with 35 fixes:     [HBASE-7963] - HBase VerifyReplication not working when security enabled     [HBASE-10249] - TestRepli

Re: [VOTE] The 2nd hbase 0.94.17 release candidate is available for download

2014-02-20 Thread lars hofhansl
+1 - checked documentation and tarball - Ran in local and distributes mode - checked the UI pages - loaded 100m KeyValues - tested scan performance - converted between FAST_DIFF and NONE encoding - tested flushes and compactions -- Lars From: lars hofhansl

Re: [VOTE] The 2nd hbase 0.94.17 release candidate is available for download

2014-02-23 Thread lars hofhansl
t; not the case before (Not sure in which version this has been introduced) > > > > Summary: > > - IntgrationTestLoadAndVerify results still "strange"; > > - Split behaviour in the UA seem the have changed. > > - +1 > > > > JM > > PS:

Re: Cleanup HTable public interface

2014-02-24 Thread lars hofhansl
+1. Let's clean it up before 1.0. Including a clean HTableInterface. The tricky part of HTableInterface was what to include in it. Up to this point the guiding principle was to expose nothing of the internal implementation (i.e. nothing about regions or start/end keys, etc). Thanks for stepping

Re: Cleanup HTable public interface

2014-02-24 Thread lars hofhansl
ck? We can discuss there. -- Lars From: Ted Yu To: "dev@hbase.apache.org" ; lars hofhansl Sent: Monday, February 24, 2014 3:37 PM Subject: Re: Cleanup HTable public interface HTableInterface is marked with: @InterfaceAudience.Public @Interface

Re: Discussion: dropping filterKeyValue(Cell ignored) from FilterBase

2014-02-24 Thread lars hofhansl
Let's remove it and add adequate documentation. It has been the source of too many problems. If filterRowKey returns true filterKeyValue needs to be consistent with it. filterKeyValue can assume that filterRowKey has already been called for the row. -- Lars F

[ANNOUNCE] HBase 0.94.17 is available for download

2014-02-25 Thread lars hofhansl
The HBase Team is pleased to announce the immediate release of HBase 0.94.17. Download it from your favorite Apache mirror [1]. This release has also been pushed to Apache's maven repository. All previous 0.92.x and 0.94.x releases can upgraded to 0.94.17 via a rolling upgrade without downtime,

Re: DISCUSS: We need a mascot, a totem HBASE-4920

2014-03-04 Thread lars hofhansl
Let's do it as long as we're not calling it a "fish". +1 From: Stack To: HBase Dev List Sent: Tuesday, March 4, 2014 11:44 AM Subject: Re: DISCUSS: We need a mascot, a totem HBASE-4920 On Tue, Mar 4, 2014 at 9:14 AM, Nick Dimiduk wrote: > On Tue, Mar 4,

Re: Hadoop1 support in 0.98/1.0

2014-03-04 Thread lars hofhansl
+1 on dropping Hadoop 1 support after 0.98. If we want to tie HBase performance featured a bit closer to Hadoop features it seems we have to do that. -- Lars From: Andrew Purtell To: "dev@hbase.apache.org" Sent: Tuesday, March 4, 2014 5:09 PM Subject: Re:

Re: Hadoop1 support in 0.98/1.0

2014-03-05 Thread lars hofhansl
From: Stack To: HBase Dev List ; lars hofhansl Sent: Wednesday, March 5, 2014 11:39 AM Subject: Re: Hadoop1 support in 0.98/1.0 (Good discusssion) Intellectually and if we go by the numbers, it makes 'sense' keeping hadoop1 support in hbase1. But if we instead allo

Re: Please welcome our newest committer, Mr. Honghua Feng

2014-03-12 Thread lars hofhansl
Congrats and welcome! From: Stack To: HBase Dev List Sent: Wednesday, March 12, 2014 2:52 PM Subject: Please welcome our newest committer, Mr. Honghua Feng Please welcome our latest committer, 冯宏华.  He has contributed some sweet patches since he started h

0.94.18RC0 soon

2014-03-13 Thread lars hofhansl
And while we're at announcing RCs, I would also like to roll the first RC for 0.94.18 this week. I would like to get HBASE-10514 and HBASE-10642 in before that. Anything else? -- Lars

Re: 0.94.18RC0 soon

2014-03-13 Thread lars hofhansl
That'd be good to have. I moved to 0.94.19 as there was no 0.94 patch and I have no time to make time right now (but maybe it's dead simple and just applies). -- Lars From: Ted Yu To: "dev@hbase.apache.org" ; lars hofhansl Sent: Sub

Re: 0.94.18RC0 soon

2014-03-14 Thread lars hofhansl
Thanks Rajesh! From: rajesh babu Chintaguntla To: dev@hbase.apache.org; lars hofhansl Sent: Friday, March 14, 2014 12:02 PM Subject: Re: 0.94.18RC0 soon Committed HBASE-10549. Thanks, Rajeshbabu. On Fri, Mar 14, 2014 at 8:03 AM, lars hofhansl wrote

Re: Releases tests....

2014-03-14 Thread lars hofhansl
I got this list from Dave Wang, but folks didn't really update it. Can resurface it. -- Lars From: Stack To: HBase Dev List Sent: Friday, March 14, 2014 10:19 AM Subject: Re: Releases tests On Fri, Mar 14, 2014 at 7:00 AM, Jean-Marc Spaggiari < jean-m

Re: Releases tests....

2014-03-14 Thread lars hofhansl
Part of the idea is that folks would test the release(s) they are interested in. If you're on 0.96.0 and want to upgrade to 0.96.2 or 0.98.2, then 0.96.2RC0 or 0.98.2RC0 is you should test now (you would do so anyway before you deploy - hopefully, but here's the chance to do it as a service to th

[VOTE] The 1st hbase 0.94.18 release candidate is available for download

2014-03-14 Thread lars hofhansl
The 1st 0.94.18 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.18-rc0/ Signed with my code signing key: C7CFE328 HBase 0.94.18 is a bug fix release with 26 fixes:     [HBASE-9708] - Improve Snapshot Name Error Message     [HBASE-9778] - Add hint to ExplicitColumnTracke

Re: [VOTE] The 1st hbase 0.94.18 release candidate is available for download

2014-03-19 Thread lars hofhansl
, etc. Please remember to have a look. I know a lot of RCs came out at the same time; release testing is an important service to the community. -- Lars From: lars hofhansl To: hbase-dev Sent: Friday, March 14, 2014 11:44 PM Subject: [VOTE] The 1st hbase 0.

Re: [VOTE] The 1st hbase 0.94.18 release candidate is available for download

2014-03-21 Thread lars hofhansl
Please have a look folks... :) -- Lars From: lars hofhansl To: hbase-dev Sent: Friday, March 14, 2014 11:44 PM Subject: [VOTE] The 1st hbase 0.94.18 release candidate is available for download The 1st 0.94.18 RC is available for download at http

Re: [VOTE] The 1st HBase 0.98.1 release candidate (RC0) is available

2014-03-21 Thread lars hofhansl
I'll look at 0.98.1RC0 this weekend. Promised! -- Lars From: Andrew Purtell To: "dev@hbase.apache.org" Sent: Friday, March 21, 2014 6:16 PM Subject: Re: [VOTE] The 1st HBase 0.98.1 release candidate (RC0) is available Migration from 0.94 to 0.98 is in fac

Re: Regressions on upgrading from 0.94 to 0.96

2014-03-24 Thread lars hofhansl
Yeah. Sorry. That's not good. I usually make sure that does not happen, but I missed that one. I don't know what to do about issues like this. The RM's can't possibly watch all issues. Another area where I find this a lot is with bug fixes that are committed to 0.96 or 0.98 and later, but the c

Re: [VOTE] The 1st hbase 0.94.18 release candidate is available for download

2014-03-24 Thread lars hofhansl
Thanks J-D, JM, and Ted. Release is forthcoming. On to 0.94.19 :) -- Lars From: Ted Yu To: "dev@hbase.apache.org" ; lars hofhansl Sent: Saturday, March 22, 2014 7:14 PM Subject: Re: [VOTE] The 1st hbase 0.94.18 release candidate is ava

[ANNOUNCE] HBase 0.94.18 is available for download

2014-03-24 Thread lars hofhansl
The HBase Team is pleased to announce the immediate release of HBase 0.94.18. Download it from your favorite Apache mirror [1]. This release has also been pushed to Apache's maven repository. All previous 0.92.x and 0.94.x releases can upgraded to 0.94.18 via a rolling upgrade without downtime,

0.94 non-secure tarballs

2014-03-26 Thread lars hofhansl
I am thinking to stop releasing the tarballs without the security code. They do not really add anything, the secure tarballs work perfectly OK without security. The secure builds just have some source and class files. I would also get rid of the non-secure build completely and just have one way

Re: [VOTE] The 3rd HBase 0.98.1 release candidate (RC2) is available for download

2014-03-26 Thread lars hofhansl
+1 - downloaded the -hadoop2 and -src tarballs - inspected both tarballs, the documentation, CHANGES.txt, etc - installed in local and distributed mode (with Hadoop 2.2.0) - in both local and distributed mode, inserted some rows, flushed, compacted, scanned, etc - spot checked the UI pages It

Re: 0.94 non-secure tarballs

2014-03-27 Thread lars hofhansl
  We don't even have a profile for a non-secure Hadoop anymore, so I can't see this being an issue any longer. On Wed, Mar 26, 2014 at 9:39 PM, Jesse Yates wrote: > +1 > > Might need a good set of documentation the first couple times, but seems > reasonable. > On Mar 26, 2

protobuf version in 0.94

2014-04-01 Thread lars hofhansl
Is anybody aware of any reason why we wouldn't just update the protobuf version in 0.94 to 2.5.0? I know 2.5.0 is backward compatible with 2.4.0, but is the reverse true as well? I.e. if we do not change any .proto files will 2.4.0 be able to decoded message encoded with 2.5.0? If yes, we should

Re: [VOTE] The 4th HBase 0.98.1 release candidate (RC3) is available for download

2014-04-03 Thread lars hofhansl
To be fair, Phoenix should not have relied on an unreleased dependency. (I know there are corporate timing issues, but they really should not force us into situations like these). As far as I understand the issue, it not just a performance but can lead to incorrect results. Then again, this is

Login access to jenkins broken?

2014-04-03 Thread lars hofhansl
Is it just me? As of today I can no longer log in to jenkins (builds.apache.org) with my Apache credentials. Other services still work, so I do have the right username and password. Is anybody else seeing that? -- Lars

Re: protobuf version in 0.94

2014-04-06 Thread lars hofhansl
e > 0.94.x in clusters pre HADOOP-9845 they will hit issues during rolling > restarts specially if the 2.4.0 jar is present. For instance, that can > break MR jobs. > > esteban. > > > > > -- > Cloudera, Inc. > > > > On Tue, Apr 1, 2014 at 9:31 PM, lars

Re: Disambiguate cell time for 1.0

2014-04-10 Thread lars hofhansl
Should we discuss this here: https://issues.apache.org/jira/browse/HBASE-10247? From: Sergey Shelukhin To: dev@hbase.apache.org Sent: Thursday, April 10, 2014 6:16 PM Subject: Re: Disambiguate cell time for 1.0 Adding nonces to deletes and puts is possible,

State of 0.94

2014-04-12 Thread lars hofhansl
I was just looking at some 0.94 test failures (TestDistributedLogSplitting in this case) and found that the specific issue is already fixed in trunk (along with a bunch of other improvements). It is not possible for me to track *every* change that goes into any of the other branches to see whet

Re: State of 0.94

2014-04-13 Thread lars hofhansl
Thanks Stack and Andy. And thanks for not quoting the whiny part of my note. :) -- Lars From: Andrew Purtell To: "dev@hbase.apache.org" Sent: Subject: Re: State of 0.94 On Sat, Apr 12, 2014 at 9:56 PM, Stack wrote: > > If you create a patch for any br

Re: HBase atomic append functionality (not just client)

2014-04-14 Thread lars hofhansl
The jira would be this one: HBASE-10247. If the client promises not muck with timestamps we first look into the memstore. If we find a version there, we know it is the right one, only otherwise do we need to check the HFiles. (This is not possible if the client can set timestamps, because the la

Re: HBase atomic append functionality (not just client)

2014-04-14 Thread lars hofhansl
v To: "dev@hbase.apache.org" ; lars hofhansl Cc: "u...@hbase.apache.org" Sent: Monday, April 14, 2014 1:51 PM Subject: Re: HBase atomic append functionality (not just client) Thanks, Lars This JIRA is worth looking at. This hint will improve all reads: simple gets, increment

Re: HBase atomic append functionality (not just client)

2014-04-15 Thread lars hofhansl
It would. From: Sergey Shelukhin To: dev@hbase.apache.org Cc: "u...@hbase.apache.org" Sent: Tuesday, April 15, 2014 11:13 AM Subject: Re: HBase atomic append functionality (not just client) Hmm... Wouldn't mvcc prevent seeing partial append? Append is jus

0.99.0 and 1.0.0 targets in Jira

2014-04-16 Thread lars hofhansl
I see we have both targets in Jira and some issues targeted to 0.99.0 and some to 1.0.0. Which one should we use? -- Lars

Re: 0.99.0 and 1.0.0 targets in Jira

2014-04-16 Thread lars hofhansl
Agreed. From: Jonathan Hsieh To: "dev@hbase.apache.org" ; lars hofhansl Sent: Wednesday, April 16, 2014 9:28 PM Subject: Re: 0.99.0 and 1.0.0 targets in Jira I'd prefer if we got rid of one -- maybe mark all as 0.99 and remove 1.0.0.  

Re: 0.99.0 and 1.0.0 targets in Jira

2014-04-16 Thread lars hofhansl
APSHOT > branch > > and make trunk 2.0-SNAPSHOT (or 1.99-SNAPSHOT?). > > > > Wouldn't trunk become 1.1-SNAPSHOT? > >  On Wed, Apr 16, 2014 at 9:11 PM, lars hofhansl wrote: > > > > > I see we have both targets in Jira and some issues

Re: a way to record # of rows 'deleted' due to TTL

2014-04-18 Thread lars hofhansl
There is no good way at the moment unless you handle it completely yourself via a coprocessor. I suppose we could add a metric...? Would that be good enough? Even that would not be entirely trivial to add into the bowls of the ColumnTrackers (wouldn't want to count it during normal scans but onl

Re: 0.98.2

2014-04-19 Thread lars hofhansl
And 0.94.19 is due as well. Planning an RC on Monday, that way we do not have the RCs at the same time. -- Lars From: Andrew Purtell To: "dev@hbase.apache.org" Sent: Saturday, April 19, 2014 7:28 AM Subject: 0.98.2 I'd like to start the RC for 0.98.2 at

0.94.19RC0 today

2014-04-21 Thread lars hofhansl
I'm ready to roll the next RC. Anything that should go in that cannot wait until next month? Thanks. -- Lars

[VOTE] The 1st hbase 0.94.19 release candidate is available for download

2014-04-21 Thread lars hofhansl
The 1st 0.94.19 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.19-rc0/ Signed with my code signing key: C7CFE328 HBase 0.94.19 is a bug fix release with 29 bug and test fixes: Bug     [HBASE-10118] - Major compact keeps deletes with future timestamps     [HBASE-10312]

Re: [VOTE] The 1st hbase 0.94.19 release candidate is available for download

2014-04-23 Thread lars hofhansl
Thanks Ted and Esteban! -- Lars From: Esteban Gutierrez To: "dev@hbase.apache.org" Cc: lars hofhansl Sent: Tuesday, April 22, 2014 9:36 PM Subject: Re: [VOTE] The 1st hbase 0.94.19 release candidate is available for download +1 (n

Re: Leaving the world of SQL, need some basic guidance and/or ideas

2014-04-23 Thread lars hofhansl
2nd'ed... That is *exactly* what Phoenix was built to do. From: Jesse Yates To: dev@hbase.apache.org Sent: Wednesday, April 23, 2014 9:22 AM Subject: Re: Leaving the world of SQL, need some basic guidance and/or ideas If you want to stay with the SQL syntax

Re: [VOTE] The 1st hbase 0.94.19 release candidate is available for download

2014-04-24 Thread lars hofhansl
a way to change the balancer without having to restart HBase... I checked the webUI, the logs and HBCK all over the process and they are all reporting well. Last, integration test is running for the 2 last hours with no issues. So I'm +1 with this release. JM 2014-04-24 2:40 GMT-04:00

[ANNOUNCE] HBase 0.94.19 is available for download

2014-04-28 Thread lars hofhansl
The HBase Team is pleased to announce the immediate release of HBase 0.94.19. Download it from your favorite Apache mirror [1]. This release has also been pushed to Apache's maven repository. All previous 0.92.x and 0.94.x releases can upgraded to 0.94.19 via a rolling upgrade without downtime,

Re: [VOTE] The 1st HBase 0.98.2 release candidate (RC0) is available

2014-05-12 Thread lars hofhansl
Getting folks test releases is like pulling teeths, or herding cats, or getting three kids to agree which song from Frozen is the best :) All jokes aside, this *is* a problem. With the goal of more frequent releases release verification needs to be a smooth process. I do not know how to fix it,

Fw: [VOTE] The 1st HBase 0.98.2 release candidate (RC0) is available

2014-05-12 Thread lars hofhansl
Resending... Looks like first attempt did not go through (still Apache email issues?). - Forwarded Message - From: lars hofhansl To: "dev@hbase.apache.org" Cc: "u...@hbase.apache.org" Sent: Monday, May 12, 2014 11:01 AM Subject: Re: [VOTE] The 1st HBase 0.98

0.94.20 soon

2014-05-16 Thread lars hofhansl
I'd like to do an RC for 0.94.20 soon. Looks like it'd be a nice and small release, only 7 fixes so far. 0.94 is maturing. :) Anything that should get pulled in? Thanks. -- Lars

Hadoop 1.0, 1.1, short circuit reading, and replication

2014-05-16 Thread lars hofhansl
Doing some local testing I noticed that replication does not work with Hadoop 1.0.x or Hadoop 1.1.x when SSR is enabled. Was banging my head at it for a while and until I realize what the issues was, then I also came across this: https://issues.apache.org/jira/browse/HDFS-2757 (which J-D fixed).

Re: 0.94.20 soon

2014-05-17 Thread lars hofhansl
Looking. Seems like a bug we should fix. From: qiang tian To: "dev@hbase.apache.org" ; lars hofhansl Sent: Saturday, May 17, 2014 6:39 PM Subject: Re: 0.94.20 soon Hi Lars,Andrew, Could you take a look at HBASE-11096? Thanks. On Friday, Ma

Re: On coprocessor API evolution

2014-05-17 Thread lars hofhansl
But note that such a high level interface will probably not allow access at level necessary for Phoenix. You can't eat your cake and keep it. For some performance you deep access to HBase internals (RegionScanners, for example). At the same time, these *are* internal. I suppose to least we can

Re: On coprocessor API evolution

2014-05-17 Thread lars hofhansl
We've seen similar issues with Filters. Those are good rules to follow. From: Vladimir Rodionov To: "dev@hbase.apache.org" Sent: Friday, May 16, 2014 10:59 AM Subject: Re: On coprocessor API evolution 1) Have default implementations (abstract classes) for

Re: On coprocessor API evolution

2014-05-17 Thread lars hofhansl
That would be separate use case, though. It's easy to say coprocessors are too invasive, but that is what they were designed for: A way to extend region server and HMaster without requiring subclassing the main classes and taking over completely. I'm all in favor of adding new APIs for other

Re: On coprocessor API evolution

2014-05-18 Thread lars hofhansl
ssor API. Thanks, James On Sun, May 18, 2014 at 12:41 AM, Andrew Purtell wrote: > That's a good point. We have use cases for the current APIs (security, > Phoenix) but no motivating use case for HBASE-11125 yet. I would be better > if we had one lined up. > > > On Sunda

Re: On coprocessor API evolution

2014-05-18 Thread lars hofhansl
riggers... Sure, let's do that too. But realize that is a *new* use case, and that we'll keep the old stuff. -- Lars From: Michael Segel To: dev@hbase.apache.org; lars hofhansl Sent: Sunday, May 18, 2014 10:21 AM Subject: Re: On coprocessor API evol

0.94.20RC0 tonight...

2014-05-22 Thread lars hofhansl
... if I can work out the git process. -- Lars

Re: 0.94.20RC0 tonight...

2014-05-22 Thread lars hofhansl
at would be too old school, I guess). Rather the build just hangs. So has anybody does this successfully? If so, how? -- Lars ____ From: lars hofhansl To: Hbase-dev Sent: Thursday, May 22, 2014 3:54 PM Subject: 0.94.20RC0 tonight... ... if I can work out the git process. -- Lars

Re: 0.94.20RC0 tonight...

2014-05-22 Thread lars hofhansl
ay, May 22, 2014 10:16 PM Subject: Re: 0.94.20RC0 tonight... Branch field should specify branch. Please take a look at http://stackoverflow.com/questions/10195900/jenkins-git-plugin-how-to-build-specific-tag Cheers On May 22, 2014, at 9:57 PM, lars hofhansl wrote: > Looks like git is gettin

<    2   3   4   5   6   7   8   9   10   11   >