Build failed in Jenkins: HBase-TRUNK-on-Hadoop-2.0.0 #448

See Changes: [enis] HBASE-8116 TestSnapshotCloneIndependence fails in trunk builds intermittently [sershe] HBASE-8034 record on-disk data size for store file and make it available during writing [enis] HBASE-7938 Add inte

Re: [ANNOUNCE] The 3rd hbase 0.94.6 release candidate is available for download

Here was test suite under security profile on 64 bit Linux box: Tests run: 1380, Failures: 0, Errors: 0, Skipped: 13 [INFO] [INFO] BUILD SUCCESS [INFO]

Build failed in Jenkins: HBase-0.94-security #124

See Changes: [larsh] updated CHANGES.txt [tedyu] HBASE-7824 Improve master start up time when there is log splitting work, revert due to TestMasterFailover#testMasterFailoverWithMockedRITOnDeadRS failure [larsh] CHANGES.txt for 0

[jira] [Created] (HBASE-8120) TestSnapshotCloneIndependence is missing in 0.94

Ted Yu created HBASE-8120: - Summary: TestSnapshotCloneIndependence is missing in 0.94 Key: HBASE-8120 URL: https://issues.apache.org/jira/browse/HBASE-8120 Project: HBase Issue Type: Bug

Re: [ANNOUNCE] The 3rd hbase 0.94.6 release candidate is available for download

Understood, Lars. This situation rarely happens. On Thu, Mar 14, 2013 at 8:07 PM, lars hofhansl wrote: > Jenkins VMs are *incredibly* slow right now. > Security build is running for 39 mins and has not even sync'ed from SVN. > > > In the 0.94 build I see the small tests timing out. > > No need

[jira] [Resolved] (HBASE-8116) TestSnapshotCloneIndependence fails in trunk builds intermittently

[ https://issues.apache.org/jira/browse/HBASE-8116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar resolved HBASE-8116. -- Resolution: Fixed Fix Version/s: 0.98.0 0.95.0 Assignee: Enis

Re: [ANNOUNCE] The 3rd hbase 0.94.6 release candidate is available for download

Jenkins VMs are *incredibly* slow right now. Security build is running for 39 mins and has not even sync'ed from SVN. In the 0.94 build I see the small tests timing out. No need to wait for this. I ran the entire suite (security and not) multiple times before I spun the RC. -- Lars

[jira] [Created] (HBASE-8119) StochasticLoadBalancer does not take into account per table balance

Enis Soztutar created HBASE-8119: Summary: StochasticLoadBalancer does not take into account per table balance Key: HBASE-8119 URL: https://issues.apache.org/jira/browse/HBASE-8119 Project: HBase

Build failed in Jenkins: HBase-0.94 #903

See Changes: [larsh] updated CHANGES.txt [tedyu] HBASE-7824 Improve master start up time when there is log splitting work, revert due to TestMasterFailover#testMasterFailoverWithMockedRITOnDeadRS failure [larsh] CHANGES.txt for 0.94.6RC2

Re: [ANNOUNCE] The 3rd hbase 0.94.6 release candidate is available for download

Ah that explains that.I'm fine either way. From: Ted Yu To: dev@hbase.apache.org; lars hofhansl Sent: Thursday, March 14, 2013 7:00 PM Subject: Re: [ANNOUNCE] The 3rd hbase 0.94.6 release candidate is available for download ubuntu2 and ubuntu3 were offlin

Re: [ANNOUNCE] The 3rd hbase 0.94.6 release candidate is available for download

ubuntu2 and ubuntu3 were offline Does it make sense to hold checkin for 0.94 a little longer so that we have Jenkins builds for both profiles ? That way there is clear correlation between RC2 and Jenkins builds. Just my two cents. On Thu, Mar 14, 2013 at 6:46 PM, lars hofhansl wrote: > No Ted,

Re: [ANNOUNCE] The 3rd hbase 0.94.6 release candidate is available for download

No Ted, I released this just to screw everybody and have you wonder why nothing is working :) Seriously... Did the exact jenkins build locally, instead of waiting for an entire day to get a slot on a jenkins VM. All tests passed in both builds. -- Lars From

Re: [ANNOUNCE] The 3rd hbase 0.94.6 release candidate is available for download

Lars: HBase-0.94-security and HBase-0.94 Jenkins builds are still pending. I assume test suite for both secure and insecure profiles passed for you locally. Cheers On Thu, Mar 14, 2013 at 6:24 PM, lars hofhansl wrote: > The 3rd and hopefully last 0.94.6 RC is available for download at > http:/

[ANNOUNCE] The 3rd hbase 0.94.6 release candidate is available for download

The 3rd and hopefully last 0.94.6 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.6-rc2/ Signed with my code signing key: C7CFE328 0.94.6 is a primarily a bug fix release. This RC has 55 issues resolved against it, contributed by 28 individuals. These are mostly bug f

Re: no 0.94 commits please, for 0.94.6RC2

All clear. From: lars hofhansl To: hbase-dev Sent: Thursday, March 14, 2013 11:16 AM Subject: no 0.94 commits please, for 0.94.6RC2 Waiting for a successful jenkins run.

Build failed in Jenkins: HBase-TRUNK #3960

See Changes: [enis] HBASE-7938 Add integration test for ImportTsv/LoadIncrementalHFiles workflow (Nick Dimiduk) [tedyu] HBASE-8017 Upgrade hadoop 1 dependency to 1.1.2 (Ted Yu) [tedyu] HBASE-8044 Revert due to objection from Lars and Sta

Build failed in Jenkins: hbase-0.95 #74

See Changes: [enis] HBASE-7938 Add integration test for ImportTsv/LoadIncrementalHFiles workflow (Nick Dimiduk) [tedyu] HBASE-8044 Revert due to objection from Lars and Stack [larsh] HBASE-8025 zkcli fails when SERVER_GC_OPTS is enabled (D

[jira] [Created] (HBASE-8118) TestTablePermission depends on the execution order

Matteo Bertozzi created HBASE-8118: -- Summary: TestTablePermission depends on the execution order Key: HBASE-8118 URL: https://issues.apache.org/jira/browse/HBASE-8118 Project: HBase Issue Ty

[jira] [Created] (HBASE-8117) Remove redundant byte conversion methods from HConstants

Nick Dimiduk created HBASE-8117: --- Summary: Remove redundant byte conversion methods from HConstants Key: HBASE-8117 URL: https://issues.apache.org/jira/browse/HBASE-8117 Project: HBase Issue Ty

[jira] [Created] (HBASE-8116) TestSnapshotCloneIndependence fails in trunk builds intermittently

Ted Yu created HBASE-8116: - Summary: TestSnapshotCloneIndependence fails in trunk builds intermittently Key: HBASE-8116 URL: https://issues.apache.org/jira/browse/HBASE-8116 Project: HBase Issue Typ

[jira] [Created] (HBASE-8115) Consolidate Import and ImportTsv into a single, user-extensible Import utility

Nick Dimiduk created HBASE-8115: --- Summary: Consolidate Import and ImportTsv into a single, user-extensible Import utility Key: HBASE-8115 URL: https://issues.apache.org/jira/browse/HBASE-8115 Project: H

[jira] [Created] (HBASE-8114) [89-fb] Interrupt the server execution when client has closed the connection

Adela Maznikar created HBASE-8114: - Summary: [89-fb] Interrupt the server execution when client has closed the connection Key: HBASE-8114 URL: https://issues.apache.org/jira/browse/HBASE-8114 Project:

[jira] [Created] (HBASE-8113) Bring back the seek+read functionality to HBase

Manukranth Kolloju created HBASE-8113: - Summary: Bring back the seek+read functionality to HBase Key: HBASE-8113 URL: https://issues.apache.org/jira/browse/HBASE-8113 Project: HBase Issue

[jira] [Created] (HBASE-8112) Deprecate HTable#batch(final List)

Ted Yu created HBASE-8112: - Summary: Deprecate HTable#batch(final List) Key: HBASE-8112 URL: https://issues.apache.org/jira/browse/HBASE-8112 Project: HBase Issue Type: Bug Reporter: Ted

Re: Need pointers to Master ZK Lock code

You can look for the code in ActiveMasterManager.java. Also zookeeper has a recipe for leader election, which is pretty straightforward ( http://zookeeper.apache.org/doc/trunk/recipes.html#sc_leaderElection). Apache Curator (recently incubating) also has a leader election recipe implementation. E

[jira] [Created] (HBASE-8111) Avoid un necessary dns lookup during the load of master web ui

Rishit Shroff created HBASE-8111: Summary: Avoid un necessary dns lookup during the load of master web ui Key: HBASE-8111 URL: https://issues.apache.org/jira/browse/HBASE-8111 Project: HBase

Need pointers to Master ZK Lock code

Hi folks, I wonder if someone could provide me some pointers to where the code which holds the zookeeper lock on the hbase/master node. Not that something is wrong there but I am trying to do something similar for another project, would appreciate any pointers. Thanks Varun

Re: HBase type support

could you point me to the big picture of this jira? from what I've understood this is something like extending the Bytes.toInt() to all the types to allow the user to have something more like table.putInt(myKey, 100); int v = table.getInt(myKey) something like this right? or is there

[jira] [Resolved] (HBASE-7824) Improve master start up time when there is log splitting work

[ https://issues.apache.org/jira/browse/HBASE-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-7824. -- Resolution: Won't Fix Since we backed this out twice... -1 on attempting this again.

[jira] [Reopened] (HBASE-7824) Improve master start up time when there is log splitting work

[ https://issues.apache.org/jira/browse/HBASE-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl reopened HBASE-7824: -- > Improve master start up time when there is log splitting work > -

Re: no 0.94 commits please, for 0.94.6RC2

Meh... Looked through the test history, you're right. I'll back it out. This is the 2nd time we're backing this out. I will remove this from 0.94 altogether. -- Lars From: lars hofhansl To: Ted Yu ; "dev@hbase.apache.org" Sent: Thursday, March 14, 2013 2:3

Re: no 0.94 commits please, for 0.94.6RC2

I ran the tests locally multiple time and it was fine. I do not think we need to back this out... Again. From: Ted Yu To: dev@hbase.apache.org; lars hofhansl Sent: Thursday, March 14, 2013 2:27 PM Subject: Re: no 0.94 commits please, for 0.94.6RC2 Lars: Je

Re: no 0.94 commits please, for 0.94.6RC2

Lars: Jeffrey, Devaraj and I worked together on the test failure of TestMasterFailover#testMasterFailoverWithMockedRITOnDeadRS in 0.94 This test passed pretty consistently before HBASE-7824 went in. However, it fails quite frequently in current 0.94 branch. Jeffrey had some initial finding which

Re: no 0.94 commits please, for 0.94.6RC2

I am still waiting for any jenkins run. Decided to build the release myself (running through all tests, just like jenkins would). From: lars hofhansl To: hbase-dev Sent: Thursday, March 14, 2013 11:16 AM Subject: no 0.94 commits please, for 0.94.6RC2 Waiti

[jira] [Resolved] (HBASE-8110) Get#getMaxVersions is actually named setMaxVersions

[ https://issues.apache.org/jira/browse/HBASE-8110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesse Yates resolved HBASE-8110. Resolution: Invalid > Get#getMaxVersions is actually named setMaxVersions > ---

[jira] [Created] (HBASE-8110) Get#getMaxVersions is actually named setMaxVersions

Jesse Yates created HBASE-8110: -- Summary: Get#getMaxVersions is actually named setMaxVersions Key: HBASE-8110 URL: https://issues.apache.org/jira/browse/HBASE-8110 Project: HBase Issue Type: Bug

no 0.94 commits please, for 0.94.6RC2

Waiting for a successful jenkins run.

[jira] [Resolved] (HBASE-7876) Got exception when manually triggers a split on an empty region

[ https://issues.apache.org/jira/browse/HBASE-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-7876. -- Resolution: Fixed Fix Version/s: (was: 0.94.7) 0.94.6 Committed t

[jira] [Resolved] (HBASE-8025) zkcli fails when SERVER_GC_OPTS is enabled

[ https://issues.apache.org/jira/browse/HBASE-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-8025. -- Resolution: Fixed Hadoop Flags: Reviewed Committed to 0.94, 0.95, 0.98. Thanks for your p

Re: Is it feasible to delete qualified tombstones during minor compaction?

That is true. The memstore is special, though, in the sense that it will contain only stuff newer than in any storefile (new in the sense of when it was inserted rather than it's timestamp, and so I say in another thread there's still weirdness). There is no such separation of new vs old betwee

[jira] [Created] (HBASE-8109) HBase can manage blocks instead of files in HDFS

Sergey Shelukhin created HBASE-8109: --- Summary: HBase can manage blocks instead of files in HDFS Key: HBASE-8109 URL: https://issues.apache.org/jira/browse/HBASE-8109 Project: HBase Issue Ty

Re: Is it feasible to delete qualified tombstones during minor compaction?

Actually, major compaction still doesn't look at memstore so the window for reappearing puts is still there, it's just small. I am +1 on the OP idea :) On Thu, Mar 14, 2013 at 10:00 AM, lars hofhansl wrote: > Unless you can guarantee that all KVs affected by a delete marker have > been deleted y

Re: Patch for HBase 7295

Hi Ted, We are using HBase 0.94.3 in production - however this should primarily affect the HBase Client. I checked that the patch applies cleanly against 0.94. I ran "mvn test" but its taking forever (over an hour now) but not seeing any failures yet. I have uploaded the v4 for trunk since the v3

[jira] [Created] (HBASE-8108) Add m2eclispe lifecycle mapping to hbase-commn

Jesse Yates created HBASE-8108: -- Summary: Add m2eclispe lifecycle mapping to hbase-commn Key: HBASE-8108 URL: https://issues.apache.org/jira/browse/HBASE-8108 Project: HBase Issue Type: Bug

Re: running test suite for patches using 0.94 branch on Jenkins

I logged HBASE-8107 I am looking at 0.94 test failures right now with my teammates. Hopefully I can get to this soon :-) On Thu, Mar 14, 2013 at 5:56 AM, Jean-Marc Spaggiari < jean-m...@spaggiari.org> wrote: > I agree, that would be very good to have that for 0.94. > > JM > > 2013/3/13 Nick Dim

[jira] [Created] (HBASE-8107) Allow non-trunk patch to be tested by Hadoop QA

Ted Yu created HBASE-8107: - Summary: Allow non-trunk patch to be tested by Hadoop QA Key: HBASE-8107 URL: https://issues.apache.org/jira/browse/HBASE-8107 Project: HBase Issue Type: Bug R

Re: Is it feasible to delete qualified tombstones during minor compaction?

Unless you can guarantee that all KVs affected by a delete marker have been deleted you cannot remove the delete marker. That's a fact :) That means in order to remove a delete marker you have to look everywhere where a potentially affected KV could reside. Currently that is everywhere and hence

[jira] [Created] (HBASE-8106) Test to check replication log znodes move is done correctly

Himanshu Vashishtha created HBASE-8106: -- Summary: Test to check replication log znodes move is done correctly Key: HBASE-8106 URL: https://issues.apache.org/jira/browse/HBASE-8106 Project: HBase

Re: Is it feasible to delete qualified tombstones during minor compaction?

That is correct. On Thu, Mar 14, 2013 at 9:28 AM, ramkrishna vasudevan < ramkrishna.s.vasude...@gmail.com> wrote: > So seeing the final patch it means that whatever Liang has asked for is not > available right? > > Regards > Ram > > On Thu, Mar 14, 2013 at 9:55 PM, Ted Yu wrote: > > > The issue

[jira] [Resolved] (HBASE-7824) Improve master start up time when there is log splitting work

[ https://issues.apache.org/jira/browse/HBASE-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-7824. -- Resolution: Fixed > Improve master start up time when there is log splitting work > ---

[jira] [Resolved] (HBASE-7624) Backport HBASE-5359 and HBASE-7596 to 0.94

[ https://issues.apache.org/jira/browse/HBASE-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-7624. -- Resolution: Fixed Hadoop Flags: Reviewed > Backport HBASE-5359 and HBASE-7596 to 0.94

[jira] [Resolved] (HBASE-7985) TestMasterFailover.testMasterFailoverWithMockedRITOnDeadRS fails frequently in 0.94

[ https://issues.apache.org/jira/browse/HBASE-7985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-7985. -- Resolution: Not A Problem This is no longer a problem with the changes in HBASE-7824 (was rever

Re: Is it feasible to delete qualified tombstones during minor compaction?

So seeing the final patch it means that whatever Liang has asked for is not available right? Regards Ram On Thu, Mar 14, 2013 at 9:55 PM, Ted Yu wrote: > The issue was HBASE-7902 > > The final patch was just mostly renaming: > > - Collections.singletonList(memstoreScanner), > ScanType.

Re: Is it feasible to delete qualified tombstones during minor compaction?

The issue was HBASE-7902 The final patch was just mostly renaming: - Collections.singletonList(memstoreScanner), ScanType.MINOR_COMPACT, + Collections.singletonList(memstoreScanner), ScanType.COMPACT_RETAIN_DELETES, Cheers On Thu, Mar 14, 2013 at 9:22 AM, Anoop John wrote: >

0.94 tests in bad shape again

No RC before this is fixed. Maybe this is all env related. I looked through the past few test runs and cataloged all passes and failures (as long as these are not due an actual code problem). Ubuntu 1: Passed: 1, Failed: 1 Ubuntu 3: Passed: 8, Failed: 2 Ubuntu 4: Passed: 0, Failed: 5 Ubuntu 5:

Re: Is it feasible to delete qualified tombstones during minor compaction?

Hi I have seen some issue raised by Sergey regarding removing Delete markers during minor compaction. Not remembering the issue id and details :( -Anoop- On Thu, Mar 14, 2013 at 3:11 PM, 谢良 wrote: > Currently, all tombstones only get cleaned up with major compactions. I > guess the or

Re: Patch for HBase 7295

The issue was logged against 0.94.3 In your production, what version are you using ? Can you validate that the latest 0.94 / trunk patches on 7295 apply cleanly, respectively ? Thanks On Thu, Mar 14, 2013 at 8:48 AM, Varun Sharma wrote: > Hi, > > Could someone take a look at 7295 - I attached

Patch for HBase 7295

Hi, Could someone take a look at 7295 - I attached a patch a while back and there was some discussion. Then it dropped off my plate. We have been running the patch for a long time now, in production. Can someone take a look ? Thanks Varun

Re: [ANNOUNCE] The 2nd hbase 0.94.6 release candidate is available for download

Even if we will most probably have a RC2, testRunShellTests failed twice in a row. Tests in error: testRunShellTests(org.apache.hadoop.hbase.client.TestShell): (RuntimeError) Shell unit tests failed. Check output file for details. Tests run: 1322, Failures: 0, Errors: 1, Skipped: 13 I will try

[jira] [Created] (HBASE-8105) RegionServer Doesn't Rejoin Cluster after Netsplit

philo vivero created HBASE-8105: --- Summary: RegionServer Doesn't Rejoin Cluster after Netsplit Key: HBASE-8105 URL: https://issues.apache.org/jira/browse/HBASE-8105 Project: HBase Issue Type: Bu

Re: patch waiting for HBASE-8025

Hi Dave, I'm having a look. Nicolas On Thu, Mar 14, 2013 at 2:59 PM, Dave Latham wrote: > Is anyone available to take a look at (and hopefully commit) the small > patch for HBASE-8025? > > Thanks, > Dave >

patch waiting for HBASE-8025

Is anyone available to take a look at (and hopefully commit) the small patch for HBASE-8025? Thanks, Dave

Re: Is it feasible to delete qualified tombstones during minor compaction?

You can try this out using CP, particularly if you use 0.94 and above. Regards Ram On Thu, Mar 14, 2013 at 3:11 PM, 谢良 wrote: > Currently, all tombstones only get cleaned up with major compactions. I > guess the original > design probably considered that we need to ensure whether there are othe

Build failed in Jenkins: HBase-TRUNK-on-Hadoop-2.0.0 #447

See Changes: [stack] HBASE-8090 Versioning site; part two, publish 0.94 site and add link from main site [ramkrishna] HBASE-8066 - Provide Admin.isTableAvailable() for a given table along with splitkeys (Ram) - addendum fo

Build failed in Jenkins: hbase-0.95-on-hadoop2 #26

See Changes: [ramkrishna] HBASE-8066 - Provide Admin.isTableAvailable() for a given table along with splitkeys (Ram)-addendum to for javadoc warnings [enis] HBASE-8094 TestTableInputFormatScan doesn't assert anything (Nick Dimidu

[jira] [Created] (HBASE-8104) HBase consistency and availability after replication

Brian Fu created HBASE-8104: --- Summary: HBase consistency and availability after replication Key: HBASE-8104 URL: https://issues.apache.org/jira/browse/HBASE-8104 Project: HBase Issue Type: New Feat

Build failed in Jenkins: HBase-0.94 #900

See -- [...truncated 5996 lines...] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.468 sec Running org.apache.hadoop.hbase.master.cleaner.TestHFileCleaner Tests run: 3, Failures: 0, Errors: 0

Re: running test suite for patches using 0.94 branch on Jenkins

I agree, that would be very good to have that for 0.94. JM 2013/3/13 Nick Dimiduk : > There's quite a bit of activity on 0.94: +1 > > On Wed, Mar 13, 2013 at 6:23 PM, Ted Yu wrote: > >> Hi, >> I noticed the number of backports to 0.94 is ticking up. >> If the contributor clicks 'Submit Patch' bu

Re: Replication hosed after simple cluster restart

I agree that we should try to add a test for this. A chance Lars you found it, but will be even better if the test suite can detect such things. Does any-one have opened the JIRA for the test part? JM 2013/3/14 lars hofhansl : > I have proposed some minor changes (including adding the jitter) o

Build failed in Jenkins: HBase-TRUNK #3959

See Changes: [stack] HBASE-8090 Versioning site; part two, publish 0.94 site and add link from main site -- [...truncated 3568 lines...] Running org.apache.hadoop.hbase.regionserver.wal.TestHLogSpli

Build failed in Jenkins: HBase-0.94 #899

See Changes: [stack] HBASE-8090 Versioning site; part two, publish 0.94 site and add link from main site [stack] HBASE-8090 Versioning site; part two, publish 0.94 site and add link from main site [stack] HBASE-8103 Fix pom so 0.94 can ge

Is it feasible to delete qualified tombstones during minor compaction?

Currently, all tombstones only get cleaned up with major compactions. I guess the original design probably considered that we need to ensure whether there are other versions of the deleted key in other storefiles which are not included in minor compaction? If that's true, i have a thought, maybe

[jira] [Resolved] (HBASE-8090) Versioning site; part two, publish 0.94 site and add link from main site

[ https://issues.apache.org/jira/browse/HBASE-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-8090. -- Resolution: Fixed Fix Version/s: 0.95.0 Assignee: stack Release Note: Added a '0.94 Documen

Build failed in Jenkins: hbase-0.95 #73

See Changes: [ramkrishna] HBASE-8066 - Provide Admin.isTableAvailable() for a given table along with splitkeys (Ram)-addendum to for javadoc warnings -- [...truncated 3556 lines...] Tests run: 1, Failu

Build failed in Jenkins: HBase-TRUNK #3958

See Changes: [ramkrishna] HBASE-8066 - Provide Admin.isTableAvailable() for a given table along with splitkeys (Ram) - addendum for javadoc warnings -- [...truncated 3562 lines...] Running org.apach