Re: Resolved JIRAs

2013-07-29 Thread lars hofhansl
...@gmail.com To: dev@hbase.apache.org Cc: lars hofhansl la...@apache.org Sent: Monday, July 29, 2013 2:39 PM Subject: Re: Resolved JIRAs bq. another way to do this is not have issues that target multiple branches/releases. +1 On Mon, Jul 29, 2013 at 2:34 PM, Andrew Purtell apurt...@apache.org wrote

Re: Resolved JIRAs

2013-07-29 Thread lars hofhansl
. That is easy in #1 and #3, but hard for #2. #1 and #2 are easier to understand. #3 can be confusing. #1 is cumbersome. My vote would remain with #3. -- Lars From: Enis Söztutar enis@gmail.com To: dev@hbase.apache.org dev@hbase.apache.org; lars hofhansl la

Re: MAX_FILESIZE and hbase.hregion.max.filesize are both 10Gb

2013-07-28 Thread lars hofhansl
It starts with smaller regions and then ramps up the size as the table in question is growing in size. Makes make for a more even distribution of regions. Into how many region did you presplit your table? How many region servers do you have available in this cluster? Maybe that number was less

Re: [ANNOUNCE] The 1st hbase 0.94.10 release candidate is available for download

2013-07-24 Thread lars hofhansl
; lars hofhansl la...@apache.org Sent: Wednesday, July 24, 2013 11:04 AM Subject: Re: [ANNOUNCE] The 1st hbase 0.94.10 release candidate is available for download +1 Compared md5s. Dir layout looks right. Doc checks out. Runs fine in standalone mode. Loaded some data. Confirmed

[ANNOUNCE] HBase 0.94.10 is available for download

2013-07-24 Thread lars hofhansl
The HBase Team is pleased to announce the immediate release of HBase 0.94.10. Download it from your favorite Apache mirror [1]. This release has also been pushed to Apache's maven repository. As usual, all previous 0.92.x and 0.94.x releases can upgraded to 0.94.10 via a rolling upgrade without

[jira] [Created] (HBASE-9037) LruBlockCache is too verbose at Debug level

2013-07-24 Thread Lars Hofhansl (JIRA)
Lars Hofhansl created HBASE-9037: Summary: LruBlockCache is too verbose at Debug level Key: HBASE-9037 URL: https://issues.apache.org/jira/browse/HBASE-9037 Project: HBase Issue Type: Bug

Re: [ANNOUNCE] The 1st hbase 0.94.10 release candidate is available for download

2013-07-24 Thread lars hofhansl
test because of that... Le 2013-07-24 18:22, Jean-Daniel Cryans jdcry...@apache.org a écrit : Yeah AFAIK it's almost always been like this. J-D On Wed, Jul 24, 2013 at 11:17 AM, lars hofhansl la...@apache.org wrote: Thanks Stack! Hmm... That log message is not new. That's a pretty small

Re: Couple notes and questions on RegionObserver's

2013-07-24 Thread lars hofhansl
Yes, coprocessors are per region and instantiated when the region is instantiated, which is what happens at enable. That's by design. How else would you design it? How would you allow for reloading updated coprocessor classes? -- Lars From: Vladimir Rodionov

[jira] [Resolved] (HBASE-9037) LruBlockCache is too verbose at Debug level

2013-07-24 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-9037. -- Resolution: Invalid Fix Version/s: (was: 0.94.10) LruBlockCache is too verbose

[jira] [Reopened] (HBASE-8698) potential thread creation in MetaScanner.metaScan

2013-07-24 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl reopened HBASE-8698: -- Assignee: Lars Hofhansl potential thread creation in MetaScanner.metaScan

Re: Couple notes and questions on RegionObserver's

2013-07-24 Thread lars hofhansl
he probably can elaborate further. -- Lars From: Vladimir Rodionov vrodio...@carrieriq.com To: dev@hbase.apache.org dev@hbase.apache.org; lars hofhansl la...@apache.org Sent: Wednesday, July 24, 2013 10:19 PM Subject: RE: Couple notes and questions

Re: Smarter Region assignment policy?

2013-07-23 Thread lars hofhansl
Principal Platform Engineer Carrier IQ, www.carrieriq.com e-mail: vrodio...@carrieriq.com From: lars hofhansl [la...@apache.org] Sent: Monday, July 22, 2013 4:04 PM To: dev@hbase.apache.org Subject: Re: Smarter Region assignment policy? Hmm... So

Re: [ANNOUNCE] The 1st hbase 0.94.10 release candidate is available for download

2013-07-23 Thread lars hofhansl
Thank you JM! And also thanks to J-D (on another thread) for having a look. With J-D's +1 I need one more +1 from a committer. Thanks. -- Lars - Original Message - From: Jean-Marc Spaggiari jean-m...@spaggiari.org To: dev@hbase.apache.org; lars hofhansl la...@apache.org Cc: Sent

Re: Smarter Region assignment policy?

2013-07-22 Thread lars hofhansl
I faintly remember there was a jira that attempted to assign the regions to the same region servers after a restart based on existing .META. information (if possible). Will try to find that and see why it is not working as expected. -- Lars From: Vladimir

Re: Smarter Region assignment policy?

2013-07-22 Thread lars hofhansl
Hmm... So that's an interesting bug then. Might filing a jira? -- Lars - Original Message - From: Vladimir Rodionov vrodio...@carrieriq.com To: dev@hbase.apache.org dev@hbase.apache.org; lars hofhansl la...@apache.org Cc: Sent: Monday, July 22, 2013 3:30 PM Subject: RE: Smarter

Re: Smarter Region assignment policy?

2013-07-22 Thread lars hofhansl
Yep. Seems stale. You can try to comment on it to revive. - Original Message - From: Vladimir Rodionov vrodio...@carrieriq.com To: dev@hbase.apache.org dev@hbase.apache.org; lars hofhansl la...@apache.org Cc: Sent: Monday, July 22, 2013 4:21 PM Subject: RE: Smarter Region assignment

[jira] [Reopened] (HBASE-9019) Port HBASE-8690: Reduce unnecessary getFileStatus hdfs calls in TTL hfile and hlog cleanners to 0.94

2013-07-22 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl reopened HBASE-9019: -- Ted fixed the description. Reopening for the backport. Port HBASE-8690: Reduce

[jira] [Created] (HBASE-9025) Thread safety issue in MetaScanner

2013-07-22 Thread Lars Hofhansl (JIRA)
Lars Hofhansl created HBASE-9025: Summary: Thread safety issue in MetaScanner Key: HBASE-9025 URL: https://issues.apache.org/jira/browse/HBASE-9025 Project: HBase Issue Type: Bug Affects

Re: Time to think about 0.94.10

2013-07-19 Thread lars hofhansl
Awesome :) -- Lars - Original Message - From: Jean-Marc Spaggiari jean-m...@spaggiari.org To: dev@hbase.apache.org; lars hofhansl la...@apache.org Cc: Sent: Friday, July 19, 2013 1:03 PM Subject: Re: Time to think about 0.94.10 Let's do it! I should have a a branch new 4 nodes

[ANNOUNCE] The 1st hbase 0.94.10 release candidate is available for download

2013-07-19 Thread lars hofhansl
The 1st 0.94.10 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.10-rc0/ Signed with my code signing key: C7CFE328 Like the previous point releases, 0.94.10 is a primarily a bug fix release. This RC has 35 issues resolved against it:     [HBASE-8774] - Add BatchSize

Re: Time to think about 0.94.10

2013-07-19 Thread lars hofhansl
Rolling the RC now. Last call :) From: lars hofhansl la...@apache.org To: hbase-dev dev@hbase.apache.org Sent: Wednesday, July 17, 2013 5:48 PM Subject: Time to think about 0.94.10 I would like to do an RC early next week. Please let me know of any urgent issue

[jira] [Created] (HBASE-9005) Improve documentation around KEEP_DELETED_CELLS, time range scans, and delete markers

2013-07-19 Thread Lars Hofhansl (JIRA)
Lars Hofhansl created HBASE-9005: Summary: Improve documentation around KEEP_DELETED_CELLS, time range scans, and delete markers Key: HBASE-9005 URL: https://issues.apache.org/jira/browse/HBASE-9005

[jira] [Resolved] (HBASE-8968) Avoid call to zk in HRegionServer#getMaster() to log the master address which already read from the zk.

2013-07-17 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-8968. -- Resolution: Fixed Committed to 0.94. Thanks for the patch. Avoid call to zk

Time to think about 0.94.10

2013-07-17 Thread lars hofhansl
I would like to do an RC early next week. Please let me know of any urgent issue you would like to have include in this month's release. -- Lars

[jira] [Resolved] (HBASE-8806) Row locks are acquired repeatedly in HRegion.doMiniBatchMutation for duplicate rows.

2013-07-16 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-8806. -- Resolution: Fixed Committed to 0.94. In 0.95+ this will be fixed with HBASE-8877

[jira] [Created] (HBASE-8945) Remove ColumnTracker.update() method

2013-07-13 Thread Lars Hofhansl (JIRA)
Lars Hofhansl created HBASE-8945: Summary: Remove ColumnTracker.update() method Key: HBASE-8945 URL: https://issues.apache.org/jira/browse/HBASE-8945 Project: HBase Issue Type: Bug

[jira] [Resolved] (HBASE-8620) Port HBASE-6874 Implement prefetching for scanners from 0.89-fb to 0.94

2013-07-10 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-8620. -- Resolution: Won't Fix Port HBASE-6874 Implement prefetching for scanners from 0.89-fb

Re: [ANNOUNCE] HBase 0.94.9 is available for download

2013-07-06 Thread lars hofhansl
dev@hbase.apache.org; lars hofhansl la...@apache.org Cc: hbase-user u...@hbase.apache.org Sent: Friday, July 5, 2013 9:12 PM Subject: Re: [ANNOUNCE] HBase 0.94.9 is available for download Thanks Lars. It looks like HBASE-8656, though part of the tarball, is not included in 0.94.9 tag

Re: [ANNOUNCE] HBase 0.94.9 is available for download

2013-07-06 Thread lars hofhansl
Fixed the tags. Need to figure out how to fix up the maven release. From: Aditya adityakish...@gmail.com To: dev@hbase.apache.org dev@hbase.apache.org; lars hofhansl la...@apache.org Cc: hbase-user u...@hbase.apache.org Sent: Friday, July 5, 2013 9:12 PM

Re: [ANNOUNCE] HBase 0.94.9 is available for download

2013-07-06 Thread lars hofhansl
@hbase.apache.org; lars hofhansl la...@apache.org Cc: hbase-user u...@hbase.apache.org Sent: Friday, July 5, 2013 9:12 PM Subject: Re: [ANNOUNCE] HBase 0.94.9 is available for download Thanks Lars. It looks like HBASE-8656, though part of the tarball, is not included in 0.94.9 tag

Re: [ANNOUNCE] HBase 0.94.9 is available for download

2013-07-06 Thread lars hofhansl
@hbase.apache.org Cc: dev@hbase.apache.org dev@hbase.apache.org; hbase-user u...@hbase.apache.org Sent: Saturday, July 6, 2013 1:32 AM Subject: Re: [ANNOUNCE] HBase 0.94.9 is available for download Looks like option #2 is better. Cheers On Jul 6, 2013, at 1:22 AM, lars hofhansl la...@apache.org

Re: [ANNOUNCE] HBase 0.94.9 is available for download

2013-07-06 Thread lars hofhansl
@hbase.apache.org; hbase-user u...@hbase.apache.org Sent: Saturday, July 6, 2013 1:32 AM Subject: Re: [ANNOUNCE] HBase 0.94.9 is available for download Looks like option #2 is better. Cheers On Jul 6, 2013, at 1:22 AM, lars hofhansl la...@apache.org wrote: So I cannot fix the maven release after the fact

Re: [ANNOUNCE] HBase 0.94.9 is available for download

2013-07-06 Thread lars hofhansl
- From: lars hofhansl la...@apache.org To: u...@hbase.apache.org u...@hbase.apache.org; dev@hbase.apache.org dev@hbase.apache.org Cc: Sent: Saturday, July 6, 2013 9:09 AM Subject: Re: [ANNOUNCE] HBase 0.94.9 is available for download I am still leaning towards #1. There is no bug, just one jira

Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download

2013-07-06 Thread lars hofhansl
Are these times or ops/sec, or something else? - Original Message - From: Jean-Marc Spaggiari jean-m...@spaggiari.org To: dev@hbase.apache.org; lars hofhansl la...@apache.org Cc: Sent: Friday, July 5, 2013 8:24 PM Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate

Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download

2013-07-04 Thread lars hofhansl
. JM 2013/7/2 Elliott Clark ecl...@apache.org: +1 untared. Checked the sig. Ran Ycsb. Ran PE. upgraded from 94.8. On Tue, Jul 2, 2013 at 11:32 AM, lars hofhansl la...@apache.org wrote: passes fine here too - Original Message - From: Jean-Daniel Cryans jdcry...@apache.org

Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download

2013-07-03 Thread lars hofhansl
Thanks Elliott, J-D, and JM. I will release 0.94.9 later today. -- Lars - Original Message - From: Elliott Clark ecl...@apache.org To: dev@hbase.apache.org dev@hbase.apache.org; lars hofhansl la...@apache.org Cc: Sent: Tuesday, July 2, 2013 12:48 PM Subject: Re: [ANNOUNCE] The 1st

Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download

2013-07-03 Thread lars hofhansl
jean-m...@spaggiari.org To: dev@hbase.apache.org; lars hofhansl la...@apache.org Cc: Sent: Friday, June 28, 2013 8:06 PM Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download Sorry for the delay team. The new PDF with the 0.94.8 and 0.94.9 performance graphs

[jira] [Resolved] (HBASE-8767) Backport hbase-8001 and hbase-8012, avoid lazy seek

2013-07-02 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-8767. -- Resolution: Fixed Backport hbase-8001 and hbase-8012, avoid lazy seek

Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download

2013-07-02 Thread lars hofhansl
TestRegionObserverScannerOpenHook work for you? I will retry to run it again on 3 different computers to see. JM 2013/7/1 lars hofhansl la...@apache.org: Hah. I let Cody answer here. I didn't like the empty table either, but he preferred it. -- Lars

Re: Issues with delete markers

2013-07-01 Thread lars hofhansl
That would be quite dramatic change, we cannot pass delete markers to the existing filters without confusing them. We could invent a new method (filterDeleteKV or filterDeleteMarker or something) on filters along with a new filter type that implements that method. -- Lars - Original

Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download

2013-07-01 Thread lars hofhansl
The usual friendly reminder to please test release, so that I can release this tomorrow. Thanks. -- Lars - Original Message - From: lars hofhansl la...@apache.org To: hbase-dev dev@hbase.apache.org Cc: Sent: Monday, June 24, 2013 3:51 PM Subject: [ANNOUNCE] The 1st hbase 0.94.9

Re: Issues with delete markers

2013-07-01 Thread lars hofhansl
That is the easy part :) The hard part is to add this to filters in a backwards compatible way. -- Lars - Original Message - From: Varun Sharma va...@pinterest.com To: u...@hbase.apache.org; lars hofhansl la...@apache.org Cc: dev@hbase.apache.org dev@hbase.apache.org Sent: Monday, July

Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download

2013-07-01 Thread lars hofhansl
Hah. I let Cody answer here. I didn't like the empty table either, but he preferred it. -- Lars From: Jean-Daniel Cryans jdcry...@apache.org To: dev@hbase.apache.org dev@hbase.apache.org; lars hofhansl la...@apache.org Sent: Monday, July 1, 2013 10:35 AM

Re: Poor HBase random read performance

2013-07-01 Thread lars hofhansl
This came up a few times before. From: Vladimir Rodionov vrodio...@carrieriq.com To: dev@hbase.apache.org dev@hbase.apache.org; lars hofhansl la...@apache.org Sent: Monday, July 1, 2013 11:08 AM Subject: RE: Poor HBase random read performance I would like

Re: Poor HBase random read performance

2013-07-01 Thread lars hofhansl
Sorry. Hit enter too early. Some discussion here: http://apache-hbase.679495.n3.nabble.com/keyvalue-cache-td3882628.html but no actionable outcome. -- Lars From: lars hofhansl la...@apache.org To: dev@hbase.apache.org dev@hbase.apache.org Sent: Monday, July 1

Re: Poor HBase random read performance

2013-06-30 Thread Lars Hofhansl
reevaluate it, with index blocks in block cache. On Sat, Jun 29, 2013 at 3:24 PM, lars hofhansl la...@apache.org wrote: Should also say that random reads this way are somewhat of a worst case scenario. If the working set is much larger than the block cache and the reads are random, then each

Re: 30% random performance in 0.95+

2013-06-29 Thread lars hofhansl
...@spaggiari.org To: dev@hbase.apache.org; lars hofhansl la...@apache.org Cc: Sent: Friday, June 28, 2013 8:03 PM Subject: Re: 30% random performance in 0.95+ I think we should do that on 0.94 as well. I don't see any good reason to not do it. JM 2013/6/28 lars hofhansl la...@apache.org: Yep. Now

Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download

2013-06-29 Thread lars hofhansl
this is a reason for concern. -- Lars From: Jean-Marc Spaggiari jean-m...@spaggiari.org To: dev@hbase.apache.org; lars hofhansl la...@apache.org Sent: Tuesday, June 25, 2013 3:51 PM Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available

Re: Poor HBase random read performance

2013-06-29 Thread lars hofhansl
I've seen the same bad performance behavior when I tested this on a real cluster. (I think it was in 0.94.6) Instead of en/disabling the blockcache, I tested sequential and random reads on a data set that does not fit into the (aggregate) block cache. Sequential reads were drastically faster

Re: Poor HBase random read performance

2013-06-29 Thread lars hofhansl
From: lars hofhansl la...@apache.org To: dev@hbase.apache.org dev@hbase.apache.org Sent: Saturday, June 29, 2013 3:09 PM Subject: Re: Poor HBase random read performance I've seen the same bad performance behavior when I tested this on a real cluster. (I think

Re: 30% random performance in 0.95+

2013-06-28 Thread lars hofhansl
I partially tracked this down to HBASE-8001 and HBASE-8012 by looking at the call stacks in a profiling session. HBASE-8767 is a backport of both patched to 0.94. -- Lars From: lars hofhansl la...@apache.org To: dev@hbase.apache.org dev@hbase.apache.org Sent

Re: 30% random performance in 0.95+

2013-06-28 Thread lars hofhansl
, Jun 28, 2013 at 10:53 AM, lars hofhansl la...@apache.org wrote: I partially tracked this down to HBASE-8001 and HBASE-8012 by looking at the call stacks in a profiling session. HBASE-8767 is a backport of both patched to 0.94. Sounds like nice work by Raymond Liu... St.Ack

Re: 30% random performance in 0.95+

2013-06-28 Thread lars hofhansl
-m...@spaggiari.org To: dev@hbase.apache.org; lars hofhansl la...@apache.org Cc: Sent: Friday, June 28, 2013 1:18 PM Subject: Re: 30% random performance in 0.95+ I have the script done to run over a list of svn releases, so if required, just give me a bunch of them or a range and I can restart

Re: 30% random performance in 0.95+

2013-06-28 Thread lars hofhansl
And indeed just this makes a tremendous difference. Unpatched 0.94 with 40% block cache configured is actually faster than 0.95 with the same block cache size. -- Lars - Original Message - From: lars hofhansl la...@apache.org To: dev@hbase.apache.org dev@hbase.apache.org Cc: Sent

Re: 30% random performance in 0.95+

2013-06-28 Thread lars hofhansl
Yep. Now the question is: Make these changes to 0.94 as well? Or just document these better. -- Lars - Original Message - From: Andrew Purtell apurt...@apache.org To: dev@hbase.apache.org dev@hbase.apache.org; lars hofhansl la...@apache.org Cc: Sent: Friday, June 28, 2013 2:08 PM

Re: [COMPACTIONS] Anyone seen hbase.hstore.compaction.min.size in trunk/0.95?

2013-06-24 Thread lars hofhansl
I think it depends on how large we expect the initially flushed HFile to be (just to state the obvious). The current default matches the memstore flushsize, so if we mostly flush because of that limit the current default should be good. If we have many column families, where one dominates, we

[jira] [Resolved] (HBASE-5083) Backup HMaster should have http infoport open with link to the active master

2013-06-24 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-5083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-5083. -- Resolution: Fixed Hadoop Flags: Reviewed Backup HMaster should have http infoport

[jira] [Resolved] (HBASE-8656) Rpc call may not be notified in SecureClient

2013-06-24 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-8656. -- Resolution: Fixed Hadoop Flags: Reviewed Rpc call may not be notified

[ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download

2013-06-24 Thread lars hofhansl
The 1st 0.94.9 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.9-rc0/ Signed with my code signing key: C7CFE328 Like the previous point releases, 0.94.9 is a primarily a bug fix release. This RC is comparatively small with 26 issues resolved against it:    

Re: 30% random performance in 0.95+

2013-06-23 Thread lars hofhansl
Thanks JM! From: Jean-Marc Spaggiari jean-m...@spaggiari.org To: dev@hbase.apache.org; lars hofhansl la...@apache.org Sent: Saturday, June 22, 2013 7:21 AM Subject: Re: 30% random performance in 0.95+ Hey, a dichotomic search. (http://en.wikipedia.org/wiki

Re: 30% random performance in 0.95+

2013-06-22 Thread lars hofhansl
an issue ;) If you want I can run the RandomRead test for the last 12 months, running a test for every 5 or 10 commits? so we will see when this happened? JM 2013/6/21 lars hofhansl la...@apache.org: Is anybody ware of what set of changes would be responsible for giving 0.95+ a 30% boost

Re: 30% random performance in 0.95+

2013-06-22 Thread lars hofhansl
commits? so we will see when this happened? JM 2013/6/21 lars hofhansl la...@apache.org: Is anybody ware of what set of changes would be responsible for giving 0.95+ a 30% boost in random read performance over 0.94? Thanks. -- Lars -- Best regards,     - Andy Problems worthy

[jira] [Resolved] (HBASE-8401) Backport HBASE-8284 Allow String Offset(s) in ColumnPaginationFilter for bookmark based pagination

2013-06-21 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-8401. -- Resolution: Won't Fix Fix Version/s: (was: 0.94.9) No activity. Marking as Won't

30% random performance in 0.95+

2013-06-21 Thread lars hofhansl
Is anybody ware of what set of changes would be responsible for giving 0.95+ a 30% boost in random read performance over 0.94? Thanks. -- Lars

[jira] [Resolved] (HBASE-8759) Family Delete Markers not getting purged after major compaction

2013-06-20 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-8759. -- Resolution: Not A Problem Family Delete Markers not getting purged after major compaction

Re: HBase Column Family Limit Reasoning

2013-06-20 Thread lars hofhansl
There's also some good discussion here: https://issues.apache.org/jira/browse/HBASE-3149 This mostly discusses the small HFiles created, since all CFs have to be flushed together, but it's still worth a read. -- Lars From: Stack st...@duboce.net To: HBase Dev

Re: [COMPACTIONS] Anyone seen hbase.hstore.compaction.min.size in trunk/0.95?

2013-06-20 Thread lars hofhansl
Weird, that jira is marked as later and the commit message seems to indicate a revert. Did the revert inadvertently remove that config from 0.95.trunk? That option is indeed gone from trunk, I was under the impression that striped/tired compression are not ready quite, yet. Or did Elliotts

[jira] [Resolved] (HBASE-8767) Backport hbase-8001, avoid lazy seek

2013-06-19 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-8767. -- Resolution: Fixed Committed to 0.94 Backport hbase-8001, avoid lazy seek

[jira] [Reopened] (HBASE-8767) Backport hbase-8001, avoid lazy seek

2013-06-19 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl reopened HBASE-8767: -- This reliably breaks a bunch of tests in 0.94. Reverting for now. Backport hbase

Time to think about 0.94.9

2013-06-19 Thread lars hofhansl
If you have any outstanding patches and want those in 0.94.9, please start to wrap them up. Personally I would like to get HBASE-8755 into 0.94.9. -- Lars

Some HLog issues

2013-06-14 Thread lars hofhansl
While looking at the HLog code I saw some funny methods that are *only* called from tests. For example:   public long append(HRegionInfo regionInfo, HLogKey logKey, WALEdit logEdit, HTableDescriptor htd, boolean doSync) which seems to be (almost) a carbon copy of:  

[jira] [Resolved] (HBASE-8698) potential thread creation in MetaScanner.metaScan

2013-06-06 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-8698. -- Resolution: Invalid potential thread creation in MetaScanner.metaScan

Re: Please welcome our newest committer, Jeffrey Zhong

2013-06-04 Thread lars hofhansl
Welcome Jeffrey. From: Stack st...@duboce.net To: HBase Dev List dev@hbase.apache.org Sent: Tuesday, June 4, 2013 3:47 AM Subject: Please welcome our newest committer, Jeffrey Zhong Please welcome our newest committer, the mighty Jeffrey Zhong.  He has been

[ANNOUNCE] HBase 0.94.8 is available for download

2013-06-01 Thread lars hofhansl
[ANNOUNCE] HBase 0.94.8 is available for download The HBase Team is pleased to announce the immediate release of HBase 0.94.8. Download it from your favorite Apache mirror [1]. As usual, all previous 0.92.x and 0.94.x releases can upgraded to 0.94.8 via a rolling upgrade without downtime,

[jira] [Resolved] (HBASE-8655) Backport to 94 - HBASE-8346(Prefetching .META. rows in case only when useCache is set to true)

2013-05-30 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-8655. -- Resolution: Fixed Assignee: Anoop Sam John Committed to 0.94. Thanks for the patch

Re: [ANNOUNCE] The 1st hbase 0.94.8 release candidate is available for download

2013-05-30 Thread lars hofhansl
a node and they were still there when all came back and MR job completed. St.Ack On Wed, May 29, 2013 at 5:25 PM, lars hofhansl la...@apache.org wrote: Friendly reminder to please have a look at this release and vote. Thanks. -- Lars

Re: Build failed in Jenkins: HBase-0.94 #197

2013-05-29 Thread lars hofhansl
Thanks Andy. Looks like it's working fine now. From: Andrew Purtell apurt...@apache.org To: Andrew Purtell apurt...@apache.org Cc: dev@hbase.apache.org dev@hbase.apache.org; lars hofhansl la...@apache.org; Ted Yu yuzhih...@gmail.com Sent: Wednesday, May 29

Re: [ANNOUNCE] The 1st hbase 0.94.8 release candidate is available for download

2013-05-29 Thread lars hofhansl
Friendly reminder to please have a look at this release and vote. Thanks. -- Lars From: lars hofhansl la...@apache.org To: hbase-dev dev@hbase.apache.org Sent: Wednesday, May 22, 2013 4:10 PM Subject: [ANNOUNCE] The 1st hbase 0.94.8 release candidate

Re: Build failed in Jenkins: HBase-0.94 #197

2013-05-28 Thread lars hofhansl
From: Ted Yu yuzhih...@gmail.com To: dev@hbase.apache.org; lars hofhansl la...@apache.org Sent: Saturday, May 25, 2013 8:52 AM Subject: Re: Build failed in Jenkins: HBase-0.94 #197 According to http://54.241.6.143/job/HBase-0.94/198/artifact/target/rat.txt , the build performed RAT check

Re: Build failed in Jenkins: HBase-0.94 #197

2013-05-25 Thread lars hofhansl
All the recent 0.94 EC2 jenkins builds failed with this: Stack trace : org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.rat:apache-rat-plugin:0.8:check (default) on project hbase: Too many unapproved licenses: 1785 I'll check it out as soon as possible.

Re: I'm starting in on 0.95.1...

2013-05-24 Thread lars hofhansl
Want us to stop checking in 0.95? From: Stack st...@duboce.net To: HBase Dev List dev@hbase.apache.org Sent: Friday, May 24, 2013 3:38 PM Subject: Re: I'm starting in on 0.95.1... On Thu, May 16, 2013 at 11:19 AM, Enis Söztutar enis@gmail.com wrote:

[jira] [Created] (HBASE-8620) Port HBASE-6874 Implement prefetching for scanners from 0.89-fb to 0.94

2013-05-24 Thread Lars Hofhansl (JIRA)
Lars Hofhansl created HBASE-8620: Summary: Port HBASE-6874 Implement prefetching for scanners from 0.89-fb to 0.94 Key: HBASE-8620 URL: https://issues.apache.org/jira/browse/HBASE-8620 Project: HBase

No 0.94 checkins please

2013-05-22 Thread lars hofhansl
Rolling 0.94.8RC0 (i.e. need to wait for a successful jenkins build) -- Lars

[ANNOUNCE] The 1st hbase 0.94.8 release candidate is available for download

2013-05-22 Thread lars hofhansl
The 1st 0.94.8 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.8-rc0/ Signed with my code signing key: C7CFE328 Like the previous point releases, 0.94.8 is a primarily a bug fix release. This RC has 45 issues resolved against it, contributed by 22 individuals. The

Re: No 0.94 checkins please

2013-05-22 Thread lars hofhansl
All clear. From: lars hofhansl la...@apache.org To: hbase-dev dev@hbase.apache.org Sent: Wednesday, May 22, 2013 1:31 PM Subject: No 0.94 checkins please Rolling 0.94.8RC0 (i.e. need to wait for a successful jenkins build) -- Lars

Re: [ANNOUNCE] The 1st hbase 0.94.8 release candidate is available for download

2013-05-22 Thread lars hofhansl
Sorry wrong link for list of changes. This one is better: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753version=12324145 -- Lars - Original Message - From: lars hofhansl la...@apache.org To: hbase-dev dev@hbase.apache.org Cc: Sent: Wednesday, May 22, 2013

Re: [ANNOUNCE] The 1st hbase 0.94.8 release candidate is available for download

2013-05-22 Thread lars hofhansl
Sorry fixed now. -- Lars - Original Message - From: Jean-Marc Spaggiari jean-m...@spaggiari.org To: dev@hbase.apache.org; lars hofhansl la...@apache.org Cc: Sent: Wednesday, May 22, 2013 10:09 PM Subject: Re: [ANNOUNCE] The 1st hbase 0.94.8 release candidate is available

Re: Time to tie the bow around 0.94.8

2013-05-20 Thread lars hofhansl
I'm going to roll a 0.94.8RC tomorrow. If you have something that really cannot wait until 0.94.9 please let me know. -- Lars From: lars hofhansl la...@apache.org To: hbase-dev dev@hbase.apache.org Sent: Tuesday, May 14, 2013 8:35 PM Subject: Time to tie the bow

[jira] [Resolved] (HBASE-7210) Backport HBASE-6059 to 0.94

2013-05-19 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-7210. -- Resolution: Fixed Backport HBASE-6059 to 0.94

[jira] [Resolved] (HBASE-8538) HBaseAdmin#isTableEnabled() should check table existence before checking zk state.

2013-05-16 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-8538. -- Resolution: Fixed Hadoop Flags: Reviewed Committed to 0.94 (including comment suggested

[jira] [Resolved] (HBASE-7210) Backport HBASE-6059 to 0.94

2013-05-16 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-7210. -- Resolution: Later Fix Version/s: (was: 0.94.8) Closing as Later. Please reopen

[jira] [Resolved] (HBASE-7965) Port table locking to 0.94 (HBASE-7305, HBASE-7546, HBASE-7933)

2013-05-15 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-7965. -- Resolution: Won't Fix Looks like this is not happening for 0.94. Closing. Please re-open

[jira] [Resolved] (HBASE-5930) Limits the amount of time an edit can live in the memstore.

2013-05-15 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-5930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-5930. -- Resolution: Fixed Hadoop Flags: Reviewed Committed addendum to 0.95 and full patch

[jira] [Resolved] (HBASE-8493) Backport HBASE-8422, 'Master won't go down', to 0.94

2013-05-15 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-8493. -- Resolution: Fixed Hadoop Flags: Reviewed Committed to 0.94. Thanks for the patch, Rajesh

Re: 0.94 Security + Jira

2013-05-15 Thread lars hofhansl
...@cloudera.com wrote: The problem is that it runs infrequently and drops little jira updates that polutes our inboxes about things we've fixed last week.  If not off then it should be more frequent so that it only shows things from yesterday. Jon. On Wed, May 15, 2013 at 4:43 PM, lars hofhansl la

Time to tie the bow around 0.94.8

2013-05-14 Thread lars hofhansl
I would like spin a 0.94.8 RC during the coming week. 0.94.8 currently 27 resolved issues and 9 in patch available status. It would be nice to get closure on the open issues soon. Thanks. -- Lars

[jira] [Resolved] (HBASE-6428) Pluggable Compaction policies

2013-05-13 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-6428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-6428. -- Resolution: Implemented Turns out this is already done in trunk. Closing

[jira] [Created] (HBASE-8525) Use sleep multilier when choosing sinks in ReplicationSource

2013-05-10 Thread Lars Hofhansl (JIRA)
Lars Hofhansl created HBASE-8525: Summary: Use sleep multilier when choosing sinks in ReplicationSource Key: HBASE-8525 URL: https://issues.apache.org/jira/browse/HBASE-8525 Project: HBase

All region server died due to Parent directory doesn't exist

2013-05-09 Thread lars hofhansl
We just had all RegionServers die in a test cluster. All with the following exception. (This is CDH4.2.1 with HBase 0.94.7 build against it) Strangely HDFS is up and running (I can ls all directories, create files in it, etc. HDFS's fsck reports that all is well), yet we had the RSs die with

Re: All region server died due to Parent directory doesn't exist

2013-05-09 Thread lars hofhansl
- From: lars hofhansl la...@apache.org To: hbase-dev dev@hbase.apache.org Cc: Sent: Wednesday, May 8, 2013 11:39 PM Subject: All region server died due to Parent directory doesn't exist We just had all RegionServers die in a test cluster. All with the following exception. (This is CDH4.2.1

<    4   5   6   7   8   9   10   11   12   13   >