improvement on compaction

2015-11-13 Thread WangYQ
in hbase0.98.10, DefaultCompactPolicy sort HFiles using seq_id as the main factor.the new file created after compaction will get ist seq_id from hregion,if we have some HFiles, seq_ids are as follows:f1 4f2 6f3 8f4 9f5 12 if we compact file f2,f3,f4, get f6_new, we will get seq_id

Hadoop 2.6.1+ recommendations

2015-11-13 Thread Sean Busbey
Heya folks, In response to our push the Hadoop community has been making patch releases on the 2.6 and 2.7 line. So far on 2.6 they've gotten out 2, with the first containing fixes for all of the critical issues that led to us marking 2.6.0 as a no-no[1]. Any opposition to adding in a line for

Re: Hadoop 2.6.1+ recommendations

2015-11-13 Thread Ted Yu
bq. adding in a line for 2.6.1+ similar to the 2.7.1+ line +1 We should periodically update the matrix with new hadoop releases. Cheers On Fri, Nov 13, 2015 at 7:15 AM, Sean Busbey wrote: > Heya folks, > > In response to our push the Hadoop community has been making

Re: Hadoop 2.6.1+ recommendations

2015-11-13 Thread Nick Dimiduk
I've verified compilation at least of 1.1.x on 2.6 releases. I'm fine with upgrading "X" to "NT" for this combination. While we're in there, we should also clarify the meaning of "Not Supported" vs "Not Tested". It seems we don't say what we mean by these distinctions. On Fri, Nov 13, 2015 at

[jira] [Created] (HBASE-14808) HBase Book takes 15 seconds to render

2015-11-13 Thread Cosmin Lehene (JIRA)
Cosmin Lehene created HBASE-14808: - Summary: HBase Book takes 15 seconds to render Key: HBASE-14808 URL: https://issues.apache.org/jira/browse/HBASE-14808 Project: HBase Issue Type: Bug

Re: Hadoop 2.6.1+ recommendations

2015-11-13 Thread Elliott Clark
We've been running a version of 2.6.X for a while and it's been quite stable for us. I would be +1 for supporting 2.6.1+ On Fri, Nov 13, 2015 at 8:58 AM, Nick Dimiduk wrote: > I've verified compilation at least of 1.1.x on 2.6 releases. I'm fine with > upgrading "X" to "NT"

[jira] [Created] (HBASE-14809) Namespace permission granted to group

2015-11-13 Thread Steven Hancz (JIRA)
Steven Hancz created HBASE-14809: Summary: Namespace permission granted to group Key: HBASE-14809 URL: https://issues.apache.org/jira/browse/HBASE-14809 Project: HBase Issue Type: Bug

Re: Hadoop 2.6.1+ recommendations

2015-11-13 Thread Andrew Purtell
FWIW, we're also running a version of 2.6* with 0.98 for a while now and it's stable. * - We patched in HDFS level infinite timeout fixes (like HDFS-7005) and the fix for HBase corruption when using at-rest encryption, and these are in 2.6.1+. On Fri, Nov 13, 2015 at 9:48 AM, Elliott Clark

[jira] [Created] (HBASE-14810) Update Hadoop support description to explain "not tested" vs "not supported"

2015-11-13 Thread Sean Busbey (JIRA)
Sean Busbey created HBASE-14810: --- Summary: Update Hadoop support description to explain "not tested" vs "not supported" Key: HBASE-14810 URL: https://issues.apache.org/jira/browse/HBASE-14810 Project:

Re: Planning for HBase 2.0

2015-11-13 Thread Biju N
Thanks Anoop. To summarize for my understanding, - If off heap is used for bucket cache then after 11425, LRU & Bucket cache will be off heap. - If oh heap is used for bucket cache then everything will be on heap. Is this correct? If so I am assuming that the property "bucketcache.ioengine" will

Re: Hadoop 2.6.1+ recommendations

2015-11-13 Thread Elliott Clark
On Fri, Nov 13, 2015 at 12:15 PM, Sean Busbey wrote: > Elliot what (approximate) HBase version has that been with? 1.0? > 1.2.0-SNAPSHOT

Re: Hadoop 2.6.1+ recommendations

2015-11-13 Thread Sean Busbey
excellent point. I filed HBASE-14810. On Fri, Nov 13, 2015 at 10:58 AM, Nick Dimiduk wrote: > I've verified compilation at least of 1.1.x on 2.6 releases. I'm fine with > upgrading "X" to "NT" for this combination. > > While we're in there, we should also clarify the

[jira] [Created] (HBASE-14811) HBaseInterClusterReplicationEndpoint retry logic is broken

2015-11-13 Thread Ashu Pachauri (JIRA)
Ashu Pachauri created HBASE-14811: - Summary: HBaseInterClusterReplicationEndpoint retry logic is broken Key: HBASE-14811 URL: https://issues.apache.org/jira/browse/HBASE-14811 Project: HBase

Re: Hadoop 2.6.1+ recommendations

2015-11-13 Thread Sean Busbey
Elliot what (approximate) HBase version has that been with? 1.0? On Fri, Nov 13, 2015 at 11:48 AM, Elliott Clark wrote: > We've been running a version of 2.6.X for a while and it's been quite > stable for us. I would be +1 for supporting 2.6.1+ > > On Fri, Nov 13, 2015 at

Re: [VOTE] The 1st HBase 1.0.3 release candidate (RC0) is available

2015-11-13 Thread Andrew Purtell
s/October/November/ . Sorry about the paste-o. On Fri, Nov 13, 2015 at 4:39 PM, Andrew Purtell wrote: > The 1st HBase 1.0.3 release candidate (RC0) is available for download at > http://people.apache.org/~apurtell/1.0.3RC0/ and Maven artifacts are also > available in the

[VOTE] The 1st HBase 1.0.3 release candidate (RC0) is available

2015-11-13 Thread Andrew Purtell
The 1st HBase 1.0.3 release candidate (RC0) is available for download at http://people.apache.org/~apurtell/1.0.3RC0/ and Maven artifacts are also available in the temporary repository https://repository.apache.org/content/repositories/orgapachehbase-1119/ . The API compatibility report with

[jira] [Created] (HBASE-14813) REST documentation under package.html should go to the book

2015-11-13 Thread Enis Soztutar (JIRA)
Enis Soztutar created HBASE-14813: - Summary: REST documentation under package.html should go to the book Key: HBASE-14813 URL: https://issues.apache.org/jira/browse/HBASE-14813 Project: HBase

Re: [VOTE] The 1st HBase 0.98.16 release candidate (RC0) is available

2015-11-13 Thread Andrew Purtell
s/October/November/ . Sorry about the paste-o. Gentle reminder that I'd like to close this vote on Monday November 16. On Tue, Nov 10, 2015 at 10:31 AM, Andrew Purtell wrote: > The 1st HBase 0.98.16 release candidate (RC0) is available for download at >

[jira] [Created] (HBASE-14812) ResultBoundedCompletionService deadlock

2015-11-13 Thread Elliott Clark (JIRA)
Elliott Clark created HBASE-14812: - Summary: ResultBoundedCompletionService deadlock Key: HBASE-14812 URL: https://issues.apache.org/jira/browse/HBASE-14812 Project: HBase Issue Type: Bug