Build failed in Jenkins: HBase-TRUNK #3329

2012-09-13 Thread Apache Jenkins Server
See Changes: [gchanan] HBASE-6260 balancer state should be stored in ZK [stack] Use link suggested by Otis [stack] Edits suggested by Ted around mvn release -- [...truncated 2676 lines...] Tests ru

Build failed in Jenkins: HBase-TRUNK-on-Hadoop-2.0.0 #172

2012-09-13 Thread Apache Jenkins Server
See Changes: [gchanan] HBASE-6260 balancer state should be stored in ZK [stack] Use link suggested by Otis [stack] Edits suggested by Ted around mvn release [stack] Add note on how to enable shortcircuit reads [larsh] HBA

Re: HBase code coverage and code analysis available on analysis.apache.org.

2012-09-13 Thread Enis Söztutar
Can we exclude the generated classes. For clover code coverage, we do exclude those (see pom.xml). Thanks, Enis On Thu, Sep 13, 2012 at 2:26 PM, Jonathan Hsieh wrote: > I think part of the problem they (INFRA) had was that the findbugs wasn't > able to pick up our existing (incomplete) list of

Please review: HBASE-6381 assignment manager improvement

2012-09-13 Thread Jimmy Xiang
Hi, As I mentioned during the contributor's pow-wow, your review is appreciated! https://reviews.apache.org/r/6535/ The change is presented in the slides: http://files.meetup.com/1350427/assignment-manager.pdf Thanks a lot, Jimmy

Re: HBase code coverage and code analysis available on analysis.apache.org.

2012-09-13 Thread Jonathan Hsieh
I think part of the problem they (INFRA) had was that the findbugs wasn't able to pick up our existing (incomplete) list of findbugs violations. We never got findbugs to 0 we haven't started enforcing it. If anyone is interested in improving this analysis page, go ahead and run with it. I think

Re: HBase code coverage and code analysis available on analysis.apache.org.

2012-09-13 Thread Andrew Purtell
Also the 'array is stored directly' violation class, lots of probable false positives there due to our use of byte[] On Thu, Sep 13, 2012 at 2:05 PM, Elliott Clark wrote: > Yeah there are some really great things in there. Thanks. > > Is there anyway to have an ignore list like findbugs, so gene

Re: read short circuit

2012-09-13 Thread Andrew Purtell
Yeah, on HBase-0.94-security On Thu, Sep 13, 2012 at 1:34 PM, n keywal wrote: > We've got two security builds on 0.94: HBase-0.94-security and > HBase-0.94-security-on-Hadoop-23 > We can change the setting on one of them? > > On Thu, Sep 13, 2012 at 10:20 PM, Andrew Purtell wrote: > >> Hey N, >>

Re: HBase code coverage and code analysis available on analysis.apache.org.

2012-09-13 Thread Elliott Clark
Yeah there are some really great things in there. Thanks. Is there anyway to have an ignore list like findbugs, so generated code can be ignored ? On Thu, Sep 13, 2012 at 1:21 PM, lars hofhansl wrote: > There are some gems in there. > > > > > From: Jonathan Hs

Re: read short circuit

2012-09-13 Thread n keywal
We've got two security builds on 0.94: HBase-0.94-security and HBase-0.94-security-on-Hadoop-23 We can change the setting on one of them? On Thu, Sep 13, 2012 at 10:20 PM, Andrew Purtell wrote: > Hey N, > > It makes sense to have a 0.94 build with -Psecurity enabled and local > shortcut disabled.

Re: HBase code coverage and code analysis available on analysis.apache.org.

2012-09-13 Thread lars hofhansl
There are some gems in there. From: Jonathan Hsieh To: dev@hbase.apache.org Sent: Thursday, September 13, 2012 12:58 PM Subject: HBase code coverage and code analysis available on analysis.apache.org. Hooray! we have a "sonar" code coverage and code metrics

Re: read short circuit

2012-09-13 Thread Andrew Purtell
Hey N, It makes sense to have a 0.94 build with -Psecurity enabled and local shortcut disabled. What do you think? For trunk builds your points sound good, and I have no opinion. On Thursday, September 13, 2012, n keywal wrote: > If I sum-up : > > We make it the default: > 1) Documented as such

Build failed in Jenkins: HBase-TRUNK #3328

2012-09-13 Thread Apache Jenkins Server
See Changes: [stack] Add note on how to enable shortcircuit reads -- [...truncated 2624 lines...] Running org.apache.hadoop.hbase.regionserver.handler.TestCloseRegionHandler Tests run: 3, Failures: 0

HBase code coverage and code analysis available on analysis.apache.org.

2012-09-13 Thread Jonathan Hsieh
Hooray! we have a "sonar" code coverage and code metrics job setup on analysis.apache.org! https://analysis.apache.org/dashboard/index/org.apache.hbase:hbase It looks like it may only run the small tests, but this still provides good data points. I found this especially interesting: https://anal

Re: read short circuit

2012-09-13 Thread n keywal
If I sum-up : We make it the default: 1) Documented as such (what JD wrote already + a reference to HDFS-3907) 2) Set in the config we use for the unit tests. Andrew, you said that we should keep some test with it off ? May be we could do that in one of the existing build on the trunk, for exampl

ANN: The 1st hbase 0.94.2 release candidate is available for download

2012-09-13 Thread lars hofhansl
The 1st 0.94.2 RC is available for download here: http://people.apache.org/~larsh/hbase-0.94.2-rc0/ Signed with my code signing key: A1AC25A9 0.94.2 is a bug fix release and has 85 issues resolved against it. These are mostly bug fixes, but also include performance improvements, and a compatibil

Re: read short circuit

2012-09-13 Thread Andrew Purtell
That's https://issues.apache.org/jira/browse/HBASE-4867 On Thu, Sep 13, 2012 at 10:57 AM, Jesse Yates wrote: > There was a jira a while back (can't remember the number) that I think came > from the Facebook fellas to have multiple hbase-site.xmls, with a naming > scheme such that you can do layer

Re: read short circuit

2012-09-13 Thread Jean-Daniel Cryans
On Thu, Sep 13, 2012 at 10:28 AM, Stack wrote: > Write a short paragraph and I'll make an HDFS configuration sections > like this HBase configurations section on manual and stick it in > there: http://hbase.apache.org/book.html#perf.configurations Here's a first stab: Leveraging local data Sinc

Re: read short circuit

2012-09-13 Thread Jesse Yates
There was a jira a while back (can't remember the number) that I think came from the Facebook fellas to have multiple hbase-site.xmls, with a naming scheme such that you can do layering of configurations. What ever happened to that? --- Jesse Yates @jesse_yates jyates.github.com

Jenkins build is back to normal : HBase-0.94 #468

2012-09-13 Thread Apache Jenkins Server
See

Re: read short circuit

2012-09-13 Thread Andrew Purtell
On Thu, Sep 13, 2012 at 9:51 AM, Jean-Daniel Cryans wrote: > One issue with the current implementation is that you can only have 1 > user that short circuit reads, all the others who have the config > enabled will get a fat Exception. At SU we don't have special config > files for every MR job so

Re: read short circuit

2012-09-13 Thread Andrew Purtell
Making it the default seems reasonable. For <= 0.94, the security profile has a separate hbase-site.xml file under test resources where there it could be defaulted as off. Reason is the local block sharing requires some shared group membership between HBase and HDFS service accounts that might be

Re: read short circuit

2012-09-13 Thread Stack
On Thu, Sep 13, 2012 at 9:51 AM, Jean-Daniel Cryans wrote: > On Thu, Sep 13, 2012 at 9:42 AM, n keywal wrote: >> It's all in the "pretty much" :-) >> Should we make it the default (i.e. recommending it in the doc, emitting a >> warning if it's not set) for all installation ? > > I'd recommend it

Jenkins build is back to normal : HBase-0.94-security #52

2012-09-13 Thread Apache Jenkins Server
See

Build failed in Jenkins: HBase-0.94 #467

2012-09-13 Thread Apache Jenkins Server
See Changes: [larsh] HBASE-6769 HRS.multi eats NoSuchColumnFamilyException (Elliott Clark) -- [...truncated 635 lines...] Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWith

Was HBASE-3817 really fixed? (HBase Shell has an issue accepting FILTER for the 'scan' command.)

2012-09-13 Thread Shumin Wu
Hi, I saw an issue about using filter in scan on shell was reported as fixed in version 0.92.0 from (https://issues.apache.org/jira/browse/HBASE-3817), but it seems using a filter still makes the hbase shell disfunctioning in 0.92.1. Can anyone else reproduce this issue? Script to reproduce

Build failed in Jenkins: HBase-TRUNK #3327

2012-09-13 Thread Apache Jenkins Server
See Changes: [larsh] HBASE-6769 HRS.multi eats NoSuchColumnFamilyException (Elliott Clark) -- [...truncated 2630 lines...] Running org.apache.hadoop.hbase.filter.TestFilterWithScanLimits Tests run: 1

Re: read short circuit

2012-09-13 Thread Jean-Daniel Cryans
On Thu, Sep 13, 2012 at 9:42 AM, n keywal wrote: > It's all in the "pretty much" :-) > Should we make it the default (i.e. recommending it in the doc, emitting a > warning if it's not set) for all installation ? I'd recommend it in the doc as an important config to consider. One issue with the c

Re: read short circuit

2012-09-13 Thread n keywal
It's all in the "pretty much" :-) Should we make it the default (i.e. recommending it in the doc, emitting a warning if it's not set) for all installation ? Or would it make sense to separate the store and wal cases, meaning that we need a change in hdfs to make this possible? On Thu, Sep 13, 201

Re: read short circuit

2012-09-13 Thread Jean-Daniel Cryans
On Thu, Sep 13, 2012 at 7:58 AM, n keywal wrote: > Hi, > > Is there any known counter indication for read short circuit? > I had a look at JD's presentation from January. It was tested vs. HBase as > a whole; and still recommended for nearly all cases. Pretty much. > > We could make it at least

read short circuit

2012-09-13 Thread n keywal
Hi, Is there any known counter indication for read short circuit? I had a look at JD's presentation from January. It was tested vs. HBase as a whole; and still recommended for nearly all cases. We could make it at least the default when reading HLog files (even if it seems it's a 'per client" con

Build failed in Jenkins: HBase-TRUNK-on-Hadoop-2.0.0 #171

2012-09-13 Thread Apache Jenkins Server
See Changes: [gchanan] HBASE-6658 Rename WritableByteArrayComparable to something not mentioning Writable -- [...truncated 12924 lines...] Forking command line: /bin/sh -c cd

Re: ANN: The second hbase 0.92.2 release candidate is available for download

2012-09-13 Thread yuzhihong
Thanks Ram and Rajesh for your work. I think we have 3 binding +1's I will make the announcement later in the morning. On Sep 12, 2012, at 10:58 PM, "Ramkrishna.S.Vasudevan" wrote: > Tried out the 0.92.2 RC1. > > Started one Master and two RS. Inserted data, scanned the data. Issued