Re: The Jenkins VMs are increasingly slow / overloaded

The current 0.94 run on ubuntu1 has been running for > 80 minutes and has not run a single test, yet (still compiling). This is pretty terrible. Anything you can do will help :) From: Andrew Purtell To: "dev@hbase.apache.org" Sent: Tuesday, March 19, 2013 4:

Build failed in Jenkins: HBase-TRUNK #3976

See Changes: [tedyu] HBASE-7878 recoverFileLease does not check return value of recoverLease, revert [enis] HBASE-8146 IntegrationTestBigLinkedList does not work on distributed setup [jxiang] HBASE-7803 [REST] Support caching on scan -

Jenkins build is back to normal : hbase-0.95 #89

See

Re: HBase 0.94 build on top of hadoop 2.0

I got the following test failures running 0.94 against 2.0.4-SNAPSHOT: Failed tests: testRetrying(org.apache.hadoop.hbase.catalog.TestMetaReaderEditor): reader: count=2, t=null testMROnTable(org.apache.hadoop.hbase.mapreduce.TestImportTsv) testMROnTableWithTimestamp(org.apache.hadoop.hbase.mapr

[jira] [Created] (HBASE-8151) Small optimization in HFileReaderV2

Lars Hofhansl created HBASE-8151: Summary: Small optimization in HFileReaderV2 Key: HBASE-8151 URL: https://issues.apache.org/jira/browse/HBASE-8151 Project: HBase Issue Type: Bug

Re: Not able to access JIRA - Is it down?

So may be its just me. It is just connecting for 2 mins and again goes down. :( REgards Ram On Wed, Mar 20, 2013 at 9:12 AM, Ted Yu wrote: > I think the JIRA is up. > > On Tue, Mar 19, 2013 at 8:15 PM, ramkrishna vasudevan < > ramkrishna.s.vasude...@gmail.com> wrote: > > > > > >

Re: Not able to access JIRA - Is it down?

I think the JIRA is up. On Tue, Mar 19, 2013 at 8:15 PM, ramkrishna vasudevan < ramkrishna.s.vasude...@gmail.com> wrote: > >

Build failed in Jenkins: hbase-0.95-on-hadoop2 #34

See Changes: [enis] HBASE-8146 IntegrationTestBigLinkedList does not work on distributed setup [jxiang] HBASE-7803 [REST] Support caching on scan [stack] HBASE-7481 Allow IOExceptions to be thrown from Filter methods [stack] HBA

Build failed in Jenkins: HBase-TRUNK-on-Hadoop-2.0.0 #455

See Changes: [tedyu] HBASE-7878 recoverFileLease does not check return value of recoverLease, revert [enis] HBASE-8146 IntegrationTestBigLinkedList does not work on distributed setup [jxiang] HBASE-7803 [REST] Support cac

Re: Consistency issue when a Put is in the memstore but a more recent Delete is cleaned in a major compaction

As long as a client application can date a Delete into the future or a Put into the past I do not see how we can eliminate these conditions completely and not at the same time also give up idempotent updates (which is a great property of HBase). From: Sergey S

Re: Consistency issue when a Put is in the memstore but a more recent Delete is cleaned in a major compaction

Yes, it is the same window of opportunity that was mentioned in some other JIRAs and threads (see also HBASE-7902) and would have been made wider by dropping deletes during minor compactions :) If flush is done before major compaction, the window wi

Build failed in Jenkins: HBase-TRUNK #3975

See Changes: [stack] HBASE-7481 Allow IOExceptions to be thrown from Filter methods [stack] HBASE-8035 Add site target check to precommit tests; ANOTHER ADDENDUM [tedyu] HBASE-7878 recoverFileLease does not check return value of recoverLe

[jira] [Created] (HBASE-8150) the code that handles RAITE on master in 0.94 should not always use the same plan

Sergey Shelukhin created HBASE-8150: --- Summary: the code that handles RAITE on master in 0.94 should not always use the same plan Key: HBASE-8150 URL: https://issues.apache.org/jira/browse/HBASE-8150

Build failed in Jenkins: hbase-0.95 #88

See Changes: [stack] HBASE-7481 Allow IOExceptions to be thrown from Filter methods [stack] HBASE-8140 TableMapReduceUtils#addDependencyJar fails when nested inside another MR job -- ADDENDUM [stack] HBASE-8140 TableMapReduceUtils#addDepend

Re: HBase 0.94 build on top of hadoop 2.0

Francis here says that they are running 94 with 23 in production here : https://issues.apache.org/jira/browse/HBASE-7834?focusedCommentId=13577938&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13577938 If not we can file a bug if there is enough interest. However, I

Re: HBase 0.94 build on top of hadoop 2.0

I'd prefer hbase compiling over hadoop 2.0.x. I've got one instance with the internally and its just been failing on TestRowCounter and TestImportExport frequently. Jon. On Tue, Mar 19, 2013 at 3:47 PM, lars hofhansl wrote: > Seems more useful than HBase on Hadoop 0.23. > I think we should eit

Re: Build failed in Jenkins: HBase-0.94 #913

That one happened today (didn't look today) :) OK... So for trunk too: Most successful run s are on Ubuntu3. From: Ted Yu To: dev@hbase.apache.org; lars hofhansl Sent: Tuesday, March 19, 2013 3:53 PM Subject: Re: Build failed in Jenkins: HBase-0.94 #913 Wha

[jira] [Created] (HBASE-8149) [replication] Add more unit tests for new replication state interfaces

Chris Trezzo created HBASE-8149: --- Summary: [replication] Add more unit tests for new replication state interfaces Key: HBASE-8149 URL: https://issues.apache.org/jira/browse/HBASE-8149 Project: HBase

Re: The Jenkins VMs are increasingly slow / overloaded

I'm setting it up now. The Jenkins host is ready, working on the PV AMI for the slaves. > Should we try and organize a whiparound among orgs to help pay for it once its up and running? Sure, if we pool resources then we could pay for more parallel instances. We could also consider more interesti

[jira] [Created] (HBASE-8148) Allow IPC to bind on a specific address

Jean-Daniel Cryans created HBASE-8148: - Summary: Allow IPC to bind on a specific address Key: HBASE-8148 URL: https://issues.apache.org/jira/browse/HBASE-8148 Project: HBase Issue Type: I

Jenkins build is back to normal : HBase-0.94-security #128

See

Build failed in Jenkins: HBase-TRUNK #3974

See Changes: [stack] HBASE-8035 Add site target check to precommit tests -- ADDENDUM [stack] HBASE-8138 Using [packed=true] for repeated field of primitive numeric types (types which use the varint, 32-bit, or 64-bit wire types)

Re: Build failed in Jenkins: HBase-0.94 #913

What about https://builds.apache.org/job/HBase-TRUNK/3972/consoleFull ? It was produced on ubuntu4. On Tue, Mar 19, 2013 at 3:50 PM, lars hofhansl wrote: > It's interesting that this build happened on Ubuntu 3. > As I wrote a few days back, the vast majority of all successful 0.94 test > runs h

Re: Build failed in Jenkins: HBase-0.94 #913

It's interesting that this build happened on Ubuntu 3. As I wrote a few days back, the vast majority of all successful 0.94 test runs happened on Ubuntu 3. When you look at the trunk build, the *only* successful runs happened on Ubuntu 3. -- Lars From: Ted Yu

[jira] [Resolved] (HBASE-6446) Replication source will throw EOF exception when hlog size is 0

[ https://issues.apache.org/jira/browse/HBASE-6446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo resolved HBASE-6446. - Resolution: Duplicate > Replication source will throw EOF exception when hlog size is 0 > ---

Re: HBase 0.94 build on top of hadoop 2.0

Seems more useful than HBase on Hadoop 0.23. I think we should either retire the HBase-on-0.23 tests or move them to Hadoop 2.0. I'd vote the latter. -- Lars From: Stack To: HBase Dev List Sent: Tuesday, March 19, 2013 3:41 PM Subject: Re: HBase 0.94 build

Re: HBase 0.94 build on top of hadoop 2.0

On Tue, Mar 19, 2013 at 2:55 PM, Ted Yu wrote: > Should we have a standalone build for hadoop 2.0 ? > I would say no. File an issue though. If a patch for hbase to make it work, attach it. St.Ack

[jira] [Created] (HBASE-8147) Add Integration Test for "The HCat Scenario"

Nick Dimiduk created HBASE-8147: --- Summary: Add Integration Test for "The HCat Scenario" Key: HBASE-8147 URL: https://issues.apache.org/jira/browse/HBASE-8147 Project: HBase Issue Type: Test

HBase 0.94 build on top of hadoop 2.0

Hi, Currently we don't have 0.94 build on top of hadoop 2.0 I found this: https://builds.apache.org/job/HBase-0.94-security-on-Hadoop-23/ But it doesn't compile: [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.5.1:compile (default-compile) on project hbase: Compil

[jira] [Resolved] (HBASE-8145) TestHCM flaky: java.lang.IllegalArgumentException: Row length is 0

[ https://issues.apache.org/jira/browse/HBASE-8145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nkeywal resolved HBASE-8145. Resolution: Duplicate > TestHCM flaky: java.lang.IllegalArgumentException: Row length is 0 > --

[jira] [Created] (HBASE-8146) IntegrationTestBigLinkedList does not work on distributed setup

Enis Soztutar created HBASE-8146: Summary: IntegrationTestBigLinkedList does not work on distributed setup Key: HBASE-8146 URL: https://issues.apache.org/jira/browse/HBASE-8146 Project: HBase

Re: Consistency issue when a Put is in the memstore but a more recent Delete is cleaned in a major compaction

I think this came up in recent discussions about the whether we get get rid of delete tombstones on non-major compactions. One of the subtasks for stripe compactions deals with this case. On Tue, Mar 19, 2013 at 2:27 PM, Ted Yu wrote: > This is also related: > > HBASE-8086 Major compact should

Re: Consistency issue when a Put is in the memstore but a more recent Delete is cleaned in a major compaction

This is also related: HBASE-8086 Major compact should flush memstore firstly On Tue, Mar 19, 2013 at 2:24 PM, Ted Yu wrote: > Here is one related thread (on minor compaction, though) : > > Is it feasible to delete qualified tombstones during minor compaction? > > > On Tue, Mar 19, 2013 at 1:42

Re: Consistency issue when a Put is in the memstore but a more recent Delete is cleaned in a major compaction

Here is one related thread (on minor compaction, though) : Is it feasible to delete qualified tombstones during minor compaction? On Tue, Mar 19, 2013 at 1:42 PM, Jean-Daniel Cryans wrote: > Hey guys, > > I looked around a bit and couldn't find a jira directly related to > this. Here's an exampl

Build failed in Jenkins: hbase-0.95 #87

See Changes: [nkeywal] HBASE-8135 Mutation should implement HeapSize -- [...truncated 3561 lines...] Running org.apache.hadoop.hbase.coprocessor.TestMasterObserver Tests run: 4, Failures: 0, Errors: 0,

Re: Build failed in Jenkins: HBase-0.94 #913

0.94 build is green again - #915. On Tue, Mar 19, 2013 at 11:17 AM, lars hofhansl wrote: > Test last 0.94 run failed due to HBASE-8125, which is fixed now. > At this point I would still suspect environmental issues rather than > actual problems. > > > -- Lars > > > >

Jenkins build is back to normal : HBase-0.94 #915

See

Re: The Jenkins VMs are increasingly slow / overloaded

+1 Jenkins EC2 plugin works pretty well, though whatever makes a build machine get "stuck" is equally applicable on EC2. On Tue, Mar 19, 2013 at 10:48 AM, Andrew Purtell wrote: > I have checked with the folks here and until/unless the situation with ASF > Jenkins VMs improves, we can provide a ho

Consistency issue when a Put is in the memstore but a more recent Delete is cleaned in a major compaction

Hey guys, I looked around a bit and couldn't find a jira directly related to this. Here's an example of inconsistency in every HBase version (although the shell won't let you do it in trunk): create 't', 'f' delete 't', '1', 'f:1', 3 flush 't' put 't', '1', 'f:1', '1', 2 scan 't' major_compact 't

[jira] [Created] (HBASE-8145) TestHCM flaky: java.lang.IllegalArgumentException: Row length is 0

nkeywal created HBASE-8145: -- Summary: TestHCM flaky: java.lang.IllegalArgumentException: Row length is 0 Key: HBASE-8145 URL: https://issues.apache.org/jira/browse/HBASE-8145 Project: HBase Issue T

[jira] [Created] (HBASE-8144) Limit number of attempts to assign a region

Jimmy Xiang created HBASE-8144: -- Summary: Limit number of attempts to assign a region Key: HBASE-8144 URL: https://issues.apache.org/jira/browse/HBASE-8144 Project: HBase Issue Type: Bug

Re: Re: review request: HBASE-7403 Online Merge

On Sat, Mar 16, 2013 at 7:25 AM, Chunhui Shen wrote: > Kevin, > Could we repair overlapping regions by hbck now, except offline merge? I > think not, if so, please tell me the issue, thanks > > hbck has two options to repair overlapping regions -- either merge them or "sideline" them so they can

Re: The Jenkins VMs are increasingly slow / overloaded

+1 if can be done. Can point our CI link over there. What help you need Andrew? Should we try and organize a whiparound among orgs to help pay for it once its up and running? I've been on and off working w/ Roman to get our IT builds running over on bigtop but currently stuck on this strange is

Re: Performances Tests

What is the y axis's unit? seconds or operations per second etc? (nit: would be nice to have on the axis.. ) Based on the context, I believe it is ops/s. Jon. On Sat, Mar 16, 2013 at 7:03 PM, Jean-Marc Spaggiari < jean-m...@spaggiari.org> wrote: > Hi Enis, > > "interesting" in the positive wa

Re: Build failed in Jenkins: HBase-0.94 #913

Test last 0.94 run failed due to HBASE-8125, which is fixed now. At this point I would still suspect environmental issues rather than actual problems. -- Lars From: Ted Yu To: dev@hbase.apache.org Sent: Tuesday, March 19, 2013 9:59 AM Subject: Re: Build fai

[jira] [Resolved] (HBASE-8125) HBASE-7435 breaks BuiltInGzipDecompressor on Hadoop < 1.0.x

[ https://issues.apache.org/jira/browse/HBASE-8125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-8125. -- Resolution: Fixed Thanks Ted. > HBASE-7435 breaks BuiltInGzipDecompressor on H

Re: The Jenkins VMs are increasingly slow / overloaded

I have checked with the folks here and until/unless the situation with ASF Jenkins VMs improves, we can provide a hosted Jenkins up in EC2, in us-west-1: - A m1.large instance running 24/7 hosting Jenkins - A pool of 5 m1.large instances serving as Jenkins slaves, managed by Jenkins with its

Build failed in Jenkins: HBase-0.94 #914

See -- [...truncated 5907 lines...] Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.075 sec Running org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster Tests run: 10, Failures

Build failed in Jenkins: hbase-0.95 #86

See Changes: [anoopsamjohn] HBASE-7992 provide pre/post region offline hooks for HMaster.offlineRegion() (Rajeshbabu) -- [...truncated 3564 lines...] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, T

[jira] [Reopened] (HBASE-8125) HBASE-7435 breaks BuiltInGzipDecompressor on Hadoop < 1.0.x

[ https://issues.apache.org/jira/browse/HBASE-8125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl reopened HBASE-8125: -- > HBASE-7435 breaks BuiltInGzipDecompressor on Hadoop < 1.0.x > ---

Re: Build failed in Jenkins: HBase-0.94 #913

Large tests were not even executed in that build. Test failures so far seem to be random. On Tue, Mar 19, 2013 at 9:54 AM, ramkrishna vasudevan < ramkrishna.s.vasude...@gmail.com> wrote: > Ted, in build 911 test failed? Is there any frequently failing ones? > > Regards > Ram > > On Tue, Mar 19,

Re: Build failed in Jenkins: HBase-0.94 #913

Ted, in build 911 test failed? Is there any frequently failing ones? Regards Ram On Tue, Mar 19, 2013 at 10:19 PM, Andrew Purtell wrote: > > So I think the build failures were not purely due to environment issues. > > You're right, we don't know either way, it's messy. > > On 3/19/13, Ted Yu w

Re: Build failed in Jenkins: HBase-0.94 #913

> So I think the build failures were not purely due to environment issues. You're right, we don't know either way, it's messy. On 3/19/13, Ted Yu wrote: > The most recent 3 trunk builds passed. This one was on ubuntu4: > https://builds.apache.org/job/HBase-TRUNK/3972/consoleFull > > So I think t

Re: Build failed in Jenkins: HBase-0.94 #913

The most recent 3 trunk builds passed. This one was on ubuntu4: https://builds.apache.org/job/HBase-TRUNK/3972/consoleFull So I think the build failures were not purely due to environment issues. On Tue, Mar 19, 2013 at 9:20 AM, Ted Yu wrote: > Builds #910 and #914 were on ubuntu4 > > But build

Re: The Jenkins VMs are increasingly slow / overloaded

What, like travis-ci.org ? On Tue, Mar 19, 2013 at 8:49 AM, Andrew Purtell wrote: > Would the HBase dev community be open to alternate hosted Jenkins test > infrastructure? > > -- > Best regards, > >- Andy > > Problems worthy of attack prove their worth by hitting back. - Piet Hein > (via To

Re: Build failed in Jenkins: HBase-0.94 #913

Builds #910 and #914 were on ubuntu4 But build #911 and #912 failed too. On Tue, Mar 19, 2013 at 8:39 AM, Andrew Purtell wrote: > I see one test failure which may have an environmental cause: > > Results : > > Failed tests: > testSleepWithoutInterrupt(org.apache.hadoop.hbase.util.TestThreads):

The Jenkins VMs are increasingly slow / overloaded

Would the HBase dev community be open to alternate hosted Jenkins test infrastructure? -- Best regards, - Andy Problems worthy of attack prove their worth by hitting back. - Piet Hein (via Tom White)

Re: Build failed in Jenkins: HBase-0.94 #913

I see one test failure which may have an environmental cause: Results : Failed tests: testSleepWithoutInterrupt(org.apache.hadoop.hbase.util.TestThreads): Elapsed time 5897 ms is out of the expected range of the sleep time 5000 Tests run: 663, Failures: 1, Errors: 0, Skipped: 0 ? On Tue, Mar 1

[jira] [Resolved] (HBASE-7993) add access control to HMaster offline region.

[ https://issues.apache.org/jira/browse/HBASE-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John resolved HBASE-7993. --- Resolution: Duplicate Fixed as part of HBASE-7992 > add access control to HM

Re: Build failed in Jenkins: HBase-0.94 #913

0.94 Jenkins builds have been failing (both secure and insecure). Looks like one of the recent checkins caused the problem. FYI

Build failed in Jenkins: HBase-0.94 #913

See -- [...truncated 5471 lines...] Running org.apache.hadoop.hbase.regionserver.TestScanWithBloomError Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.292 sec Running org.apache.hadoop.hbase.

Build failed in Jenkins: HBase-TRUNK-on-Hadoop-2.0.0 #454

See Changes: [nkeywal] HBASE-7590 Add a costless notifications mechanism from master to regionservers & clients - new files [nkeywal] HBASE-7590 Add a costless notifications mechanism from master to regionservers & clients

Build failed in Jenkins: hbase-0.95-on-hadoop2 #33

See Changes: [nkeywal] HBASE-7590 Add a costless notifications mechanism from master to regionservers & clients - new files [nkeywal] HBASE-7590 Add a costless notifications mechanism from master to regionservers & clients -

Build failed in Jenkins: hbase-0.95 #85

See Changes: [nkeywal] HBASE-7590 Add a costless notifications mechanism from master to regionservers & clients - new files [nkeywal] HBASE-7590 Add a costless notifications mechanism from master to regionservers & clients

Build failed in Jenkins: HBase-0.94 #912

See -- [...truncated 5926 lines...] Running org.apache.hadoop.hbase.mapreduce.TestMultiTableInputFormat Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 361.386 sec Running org.apache.hadoop.hbas

Build failed in Jenkins: HBase-0.94 #911

See -- [...truncated 5331 lines...] [WARNING] :36: warning - Tag @inheritDoc cannot be used in co

Build failed in Jenkins: HBase-0.94-security #127

See Changes: [apurtell] HBASE-8141. Remove accidental uses of org.mortbay.log.Log [tedyu] HBASE-8014 Backport HBASE-6915 to 0.94 (Jean-Marc) [nkeywal] HBASE-8128 HTable#put improvements [mbertozzi] HBASE-8067 TestHFileArchiving.te

Build failed in Jenkins: hbase-0.95 #84

See Changes: [stack] HBASE-8142 Sporadic TestZKProcedureControllers failures on trunk [sershe] HBASE-8080 refactor default compactor to make its parts easier to reuse -- [...truncated 3562 lines...] Te