Build failed in Jenkins: HBase-TRUNK #3148

2012-07-18 Thread Apache Jenkins Server
See Changes: [larsh] HBASE-6406 Remove TestReplicationPeer [tedyu] HBASE-6421 [pom] add jettison and fix netty specification (Jesse Yates) -- [...truncated 2578 lines...] Running org.apache.hadoop.h

RE: Wondering what hbck should do in this situation

2012-07-18 Thread Ramkrishna.S.Vasudevan
J-d Corrections, if META does not have an entry then we cannot know if it is splitted or not.. Apologies for that. I think we need to check for Reference files and if the opening fails we need to report it. That should be the way. But we should also confirm whether this region was split properly,

RE: Wondering what hbck should do in this situation

2012-07-18 Thread Ramkrishna.S.Vasudevan
J-D Just going thro the explanation I feel that the region that had references is a parent region and it should have an entry in META saying it is SPLIT and OFFLINE? May be while fixing those cases where we find something in HDFS and not in META we may need see if it is splitted? Was there any

Build failed in Jenkins: HBase-0.94 #339

2012-07-18 Thread Apache Jenkins Server
See Changes: [larsh] HBASE-6406 Remove TestReplicationPeer [larsh] HBASE-6426 Add Hadoop 2.0.x profile to 0.92+ -- [...truncated 585 lines...] Running org.apache.hadoop.hbase.coprocessor.TestRegionObs

RE: [poll] Does anyone run or test against hadoop 0.21, 0.22, 0.23 under HBase 0.92.0+/0.94.0?

2012-07-18 Thread Ramkrishna.S.Vasudevan
We work on hadoop 2.0. Regards Ram > -Original Message- > From: Ted Yu [mailto:yuzhih...@gmail.com] > Sent: Thursday, July 19, 2012 1:42 AM > To: dev@hbase.apache.org > Cc: u...@hbase.apache.org > Subject: Re: [poll] Does anyone run or test against hadoop 0.21, 0.22, > 0.23 under HBase 0.

Jenkins build is back to normal : HBase-0.92 #479

2012-07-18 Thread Apache Jenkins Server
See

Build failed in Jenkins: HBase-0.94 #338

2012-07-18 Thread Apache Jenkins Server
See Changes: [jxiang] HBASE-6392 UnknownRegionException blocks hbck from sideline big overlap regions -- [...truncated 611 lines...] Running org.apache.hadoop.hbase.coprocessor.TestAggregateProtocol T

Build failed in Jenkins: HBase-TRUNK #3147

2012-07-18 Thread Apache Jenkins Server
See Changes: [tedyu] HBASE-6405 Addendum for Eclipse (Jesse Yates) -- [...truncated 3217 lines...] Running org.apache.hadoop.hbase.regionserver.wal.TestHLog Tests run: 10, Failures: 0, Errors: 0, Ski

Build failed in Jenkins: hbase-0.90 #518

2012-07-18 Thread Apache Jenkins Server
See Changes: [jxiang] HBASE-6392 UnknownRegionException blocks hbck from sideline big overlap regions -- [...truncated 900 lines...] A src/site/site.xml A src/site/site.vm A sr

Re: ANN: The first hbase 0.94.1 release candidate is available for download

2012-07-18 Thread lars hofhansl
I am hereby sinking RC0. That was quick. We had too many failed/hung tests. Turns out the culprit wasHBASE-6389, which has been reverted. If you commit against 0.94, please retarget to 0.94.1. Stay tuned for RC1. Thanks. -- Lars From: lars hofhansl To: Andr

Jenkins build is back to normal : HBase-0.94 #337

2012-07-18 Thread Apache Jenkins Server
See

Jenkins build is back to normal : HBase-TRUNK #3146

2012-07-18 Thread Apache Jenkins Server
See

Re: [poll] Does anyone run or test against hadoop 0.21, 0.22, 0.23 under HBase 0.92.0+/0.94.0?

2012-07-18 Thread Jonathan Hsieh
On Wed, Jul 18, 2012 at 5:35 PM, Stack wrote: > On Thu, Jul 19, 2012 at 2:23 AM, Jonathan Hsieh wrote: > > I don't think this affects the decision you refer to. I'm not trying to > age > > off older versions -- I'm trying find out from this discussion which > > "newer" versions we should have HB

Re: [poll] Does anyone run or test against hadoop 0.21, 0.22, 0.23 under HBase 0.92.0+/0.94.0?

2012-07-18 Thread Stack
On Thu, Jul 19, 2012 at 2:23 AM, Jonathan Hsieh wrote: > I don't think this affects the decision you refer to. I'm not trying to age > off older versions -- I'm trying find out from this discussion which > "newer" versions we should have HBase work/compile against, and if we can > just say 1.x and

Build failed in Jenkins: HBase-TRUNK #3145

2012-07-18 Thread Apache Jenkins Server
See Changes: [tedyu] HBASE-6389 Revert, the patch breaks TestZooKeeper -- [...truncated 2469 lines...] Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.108 sec Running org.apache.h

Re: [poll] Does anyone run or test against hadoop 0.21, 0.22, 0.23 under HBase 0.92.0+/0.94.0?

2012-07-18 Thread Jonathan Hsieh
inline On Wed, Jul 18, 2012 at 5:09 PM, Stack wrote: > On Wed, Jul 18, 2012 at 9:58 PM, Jonathan Hsieh wrote: > > Hi, > > > > I'm trying to get a feel to see how affected folks would be if we > > potentially only had hbase support a hadoop 1.0 build and a hadoop 2.0 > > build profile (and perha

Re: [poll] Does anyone run or test against hadoop 0.21, 0.22, 0.23 under HBase 0.92.0+/0.94.0?

2012-07-18 Thread Stack
On Wed, Jul 18, 2012 at 9:58 PM, Jonathan Hsieh wrote: > Hi, > > I'm trying to get a feel to see how affected folks would be if we > potentially only had hbase support a hadoop 1.0 build and a hadoop 2.0 > build profile (and perhaps a hadoop 3.0-SNAPSHOT proflile). Specifically, > does anyone use

Re: ANN: The first hbase 0.94.1 release candidate is available for download

2012-07-18 Thread Andrew Purtell
I opened https://issues.apache.org/jira/browse/HBASE-6424, trying to get to it today but maybe not. On Wed, Jul 18, 2012 at 4:22 PM, lars hofhansl wrote: > If that test consistently fails the RC should be -1'ed. > I'll double check later tonight. > > > > - Original Message - > From: Andre

Build failed in Jenkins: HBase-TRUNK-on-Hadoop-2.0.0 #98

2012-07-18 Thread Apache Jenkins Server
See Changes: [tedyu] HBASE-6419 PersistentMetricsTimeVaryingRate gets used for non-time-based metrics (part2 of HBASE-6220) (Paul Cavallaro) [tedyu] HBASE-6400 Add getMasterAdmin() and getMasterMonitor() to HConnection (Eni

Re: ANN: The first hbase 0.94.1 release candidate is available for download

2012-07-18 Thread lars hofhansl
If that test consistently fails the RC should be -1'ed. I'll double check later tonight. - Original Message - From: Andrew Purtell To: dev@hbase.apache.org; lars hofhansl Cc: Sent: Wednesday, July 18, 2012 1:51 PM Subject: Re: ANN: The first hbase 0.94.1 release candidate is available

Re: [poll] Does anyone run or test against hadoop 0.21, 0.22, 0.23 under HBase 0.92.0+/0.94.0?

2012-07-18 Thread lars hofhansl
Out of curiosity, why 0.23 and not wait a bit for the 2.0.x branch? - Original Message - From: Tony Dean To: "u...@hbase.apache.org" ; "dev@hbase.apache.org" Cc: Sent: Wednesday, July 18, 2012 2:47 PM Subject: RE: [poll] Does anyone run or test against hadoop 0.21, 0.22, 0.23 under

RE: [poll] Does anyone run or test against hadoop 0.21, 0.22, 0.23 under HBase 0.92.0+/0.94.0?

2012-07-18 Thread Tony Dean
We are using HBase 0.94.0 against Hadoop 1.0.3, but plan to move to 0.23.x. -Original Message- From: Ted Yu [mailto:yuzhih...@gmail.com] Sent: Wednesday, July 18, 2012 4:12 PM To: dev@hbase.apache.org Cc: u...@hbase.apache.org Subject: Re: [poll] Does anyone run or test against hadoop 0.2

Re: ANN: The first hbase 0.94.1 release candidate is available for download

2012-07-18 Thread Ted Yu
Here is my comment about consistently hanging TestZooKeeper: https://issues.apache.org/jira/browse/HBASE-6389?focusedCommentId=13417697&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13417697 On Wed, Jul 18, 2012 at 1:51 PM, Andrew Purtell wrote: > Currently I'm -

Re: ANN: The first hbase 0.94.1 release candidate is available for download

2012-07-18 Thread Andrew Purtell
Currently I'm -0.5 because tests don't pass fully for me locally -- TestReplication hangs with the same jstack as attached to HBASE-6406 as https://issues.apache.org/jira/secure/attachment/12536942/testReplication.jstack . Best regards, - Andy Problems worthy of attack prove their worth by h

Re: [poll] Does anyone run or test against hadoop 0.21, 0.22, 0.23 under HBase 0.92.0+/0.94.0?

2012-07-18 Thread Andrew Purtell
Works for me, 1.0 and 2.0 only. Not 3.0. On Wed, Jul 18, 2012 at 12:58 PM, Jonathan Hsieh wrote: > Hi, > > I'm trying to get a feel to see how affected folks would be if we > potentially only had hbase support a hadoop 1.0 build and a hadoop 2.0 > build profile (and perhaps a hadoop 3.0-SNAPSHOT

Re: [poll] Does anyone run or test against hadoop 0.21, 0.22, 0.23 under HBase 0.92.0+/0.94.0?

2012-07-18 Thread Ted Yu
We use hadoop 0.22 Cheers On Wed, Jul 18, 2012 at 12:58 PM, Jonathan Hsieh wrote: > Hi, > > I'm trying to get a feel to see how affected folks would be if we > potentially only had hbase support a hadoop 1.0 build and a hadoop 2.0 > build profile (and perhaps a hadoop 3.0-SNAPSHOT proflile). S

[poll] Does anyone run or test against hadoop 0.21, 0.22, 0.23 under HBase 0.92.0+/0.94.0?

2012-07-18 Thread Jonathan Hsieh
Hi, I'm trying to get a feel to see how affected folks would be if we potentially only had hbase support a hadoop 1.0 build and a hadoop 2.0 build profile (and perhaps a hadoop 3.0-SNAPSHOT proflile). Specifically, does anyone use hbase on top of hadoop 0.21.x, 0.22.x, or 0.23.x (which became had

Build failed in Jenkins: HBase-TRUNK #3144

2012-07-18 Thread Apache Jenkins Server
See Changes: [tedyu] HBASE-6419 PersistentMetricsTimeVaryingRate gets used for non-time-based metrics (part2 of HBASE-6220) (Paul Cavallaro) [tedyu] HBASE-6400 Add getMasterAdmin() and getMasterMonitor() to HConnection (Enis) --

Re: ANN: The first hbase 0.94.1 release candidate is available for download

2012-07-18 Thread Andrew Purtell
On Tue, Jul 17, 2012 at 2:18 PM, lars hofhansl wrote: > I created a public Google spreadsheet: > https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdHM0LTlwQVAyUDJ2U2Z1bEprSEYxdXc#gid=0 > > If you do some testing on the 0.94.1RC please put a note there. Any testing > help is greatly apprec

Re: Wondering what hbck should do in this situation

2012-07-18 Thread Ted Yu
Adding check on whether the referenced files can be found would help. If any of the referenced files isn't found, report and don't repair. Cheers On Wed, Jul 18, 2012 at 8:53 AM, Jean-Daniel Cryans wrote: > Hey devs, > > I encountered an "interesting" situation with hbck in 0.94, we had > this r

Wondering what hbck should do in this situation

2012-07-18 Thread Jean-Daniel Cryans
Hey devs, I encountered an "interesting" situation with hbck in 0.94, we had this region which was on HDFS that wasn't in .META. and hbck decided to include it back: ERROR: Region { meta => null, hdfs => hdfs://sfor3s24:10101/hbase/url_stumble_summary/159952764, deployed => } on HDFS, but not li

Re: How to merge regions?

2012-07-18 Thread Stack
On Tue, Jul 17, 2012 at 7:08 PM, Ionut Ignatescu wrote: > - Let's say I have more consecutive empty regions. I'm considering 2 options > in this situation: merge empty partitions in a bigger one or > > stick them to the first non-empty region. I think for the second approach I > have to disable th

Build failed in Jenkins: HBase-TRUNK #3143

2012-07-18 Thread Apache Jenkins Server
See -- [...truncated 2573 lines...] Running org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 47.244 sec Running org.apache.had

Re: hbase mttr vs. hdfs

2012-07-18 Thread Stack
The proposal seems good to me. Its minimally intrusive. See also below... On Mon, Jul 16, 2012 at 7:08 PM, N Keywal wrote: > And to continue on this, for the files still opened (i.e. our wal > files), we've got two calls to the dead DN: > > one, during the input stream opening, from DFSClient#u

Re: hbase mttr vs. hdfs

2012-07-18 Thread Stack
On Fri, Jul 13, 2012 at 6:31 PM, Andrew Purtell wrote: > Changing the block placement policy for HBase WALs to avoid the local > machine is interesting. Those who could make use of this approach > would be those who: > > - Control their NameNode, it's classpath, and it's configuration > >

Re: hbase mttr vs. hdfs

2012-07-18 Thread Stack
On Tue, Jul 17, 2012 at 7:14 PM, N Keywal wrote: >> I suppose as Todd suggests, we could do this client side. The extra >> state would complicate NN (making it difficult to get such a change > > After some iterations I came to a solution close to his proposition, > mentionned in my mail from yest