Build failed in Jenkins: HBase-TRUNK #3976

2013-03-20 Thread Apache Jenkins Server
See https://builds.apache.org/job/HBase-TRUNK/3976/changes Changes: [tedyu] HBASE-7878 recoverFileLease does not check return value of recoverLease, revert [enis] HBASE-8146 IntegrationTestBigLinkedList does not work on distributed setup [jxiang] HBASE-7803 [REST] Support caching on scan

Re: The Jenkins VMs are increasingly slow / overloaded

2013-03-20 Thread lars hofhansl
The current 0.94 run on ubuntu1 has been running for 80 minutes and has not run a single test, yet (still compiling). This is pretty terrible. Anything you can do will help :) From: Andrew Purtell apurt...@apache.org To: dev@hbase.apache.org

Build failed in Jenkins: HBase-0.94 #916

2013-03-20 Thread Apache Jenkins Server
See https://builds.apache.org/job/HBase-0.94/916/changes Changes: [jmhsieh] HBASE-8142 Sporadic TestZKProcedureController failures (Jeffrey Zhong) -- [...truncated 5331 lines...] [WARNING]

Re: The Jenkins VMs are increasingly slow / overloaded

2013-03-20 Thread Andrew Purtell
I have this almost ready for you to play around with. Aim is to get a clean trunk and 0.94 build first before turning it loose. The build deps are all set up in the custom AMI, ASF build tools, protoc, etc. At this point just working on debugging the Jenkins SVN plug in. svn: E155005: No

[jira] [Created] (HBASE-8152) Avoid creating empty reference file when splitkey is outside the range of a store file

2013-03-20 Thread clockfly (JIRA)
clockfly created HBASE-8152: --- Summary: Avoid creating empty reference file when splitkey is outside the range of a store file Key: HBASE-8152 URL: https://issues.apache.org/jira/browse/HBASE-8152 Project:

Re: Performances Tests

2013-03-20 Thread Jean-Marc Spaggiari
Hi Lars, Can you share the code you are using so I can compate with PE? Also, I will re-run all for my scanRange100 tests today and update the spreadsheet again to make sure it's correct. Also also re-download all the HBase versions to make sure they are all clean. I'm not doing any configuration

[jira] [Created] (HBASE-8153) TestJoinedScanners fails occasionally

2013-03-20 Thread Liang Xie (JIRA)
Liang Xie created HBASE-8153: Summary: TestJoinedScanners fails occasionally Key: HBASE-8153 URL: https://issues.apache.org/jira/browse/HBASE-8153 Project: HBase Issue Type: Test

[jira] [Created] (HBASE-8154) HBaseTestingUtility.startMiniDFSClusterForTestHLog should handle Address already in use and retry automatically

2013-03-20 Thread Liang Xie (JIRA)
Liang Xie created HBASE-8154: Summary: HBaseTestingUtility.startMiniDFSClusterForTestHLog should handle Address already in use and retry automatically Key: HBASE-8154 URL:

Re: Performances Tests

2013-03-20 Thread Ted Yu
I am curious to know how trunk stands in the performance comparison. There have been many optimizations going into trunk. Getting hold of overall improvement would be nice. Cheers On Wed, Mar 20, 2013 at 5:02 AM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: Hi Lars, Can you share the

[jira] [Created] (HBASE-8155) Allow Record Compression for HLogs

2013-03-20 Thread Nicolas Spiegelberg (JIRA)
Nicolas Spiegelberg created HBASE-8155: -- Summary: Allow Record Compression for HLogs Key: HBASE-8155 URL: https://issues.apache.org/jira/browse/HBASE-8155 Project: HBase Issue Type: New

[jira] [Created] (HBASE-8156) Support for Namenode HA for non-idempotent operations

2013-03-20 Thread Himanshu Vashishtha (JIRA)
Himanshu Vashishtha created HBASE-8156: -- Summary: Support for Namenode HA for non-idempotent operations Key: HBASE-8156 URL: https://issues.apache.org/jira/browse/HBASE-8156 Project: HBase

Re: Consistency issue when a Put is in the memstore but a more recent Delete is cleaned in a major compaction

2013-03-20 Thread Jean-Daniel Cryans
On Tue, Mar 19, 2013 at 6:50 PM, lars hofhansl la...@apache.org wrote: As long as a client application can date a Delete into the future or a Put into the past I do not see how we can eliminate these conditions completely and not at the same time also give up idempotent updates (which is a

Re: Performances Tests

2013-03-20 Thread Jean-Marc Spaggiari
Hi Ted, I will try to build the trunk version and add it in the list So I have to: - Re-download all HBase version to make sure PE is using the right one; - Re-run the scanRange100 tests to validate the values already found; - Add the trunk; - Add LoadTestTool Than will keep my free time

[jira] [Created] (HBASE-8158) Backport HBASE-8140 TableMapReduceUtils#addDependencyJar fails when nested inside another MR job

2013-03-20 Thread Nick Dimiduk (JIRA)
Nick Dimiduk created HBASE-8158: --- Summary: Backport HBASE-8140 TableMapReduceUtils#addDependencyJar fails when nested inside another MR job Key: HBASE-8158 URL: https://issues.apache.org/jira/browse/HBASE-8158

Jenkins build is back to normal : HBase-TRUNK #3978

2013-03-20 Thread Apache Jenkins Server
See https://builds.apache.org/job/HBase-TRUNK/3978/

Building trunk

2013-03-20 Thread Jean-Marc Spaggiari
Is there anything I'm nissing to build the trunk? I followed the steps on the online book, but I'm still facing some issues. I have extracted a clean SVN trunk, was able to pass mvn package -DskipTests [INFO] [INFO] BUILD

possible improvement to compaction invocation

2013-03-20 Thread Ted Yu
Hi, I was looking at how compaction is invoked from HBaseAdmin (line 1460 in trunk code) final String tableName = tableNameString(tableNameOrRegionName, ct); ListPairHRegionInfo, ServerName pairs = MetaReader.getTableRegionsAndLocations(ct, tableName);

Re: Building trunk

2013-03-20 Thread Ted Yu
I am trying to reproduce locally. BTW I was trying to find tar ball from successful 0.95 build but couldn't find one: https://builds.apache.org/job/HBase-0.95/89/artifact/0.95/ On Wed, Mar 20, 2013 at 2:12 PM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: Is there anything I'm nissing

Re: possible improvement to compaction invocation

2013-03-20 Thread Jesse Yates
Since compactions are long running, async jobs anyways, I don't see much gain in grouping these together. Sure, we might save a round-trip, but these are neither high-volume calls nor bottle-necked in the RTT of the request. It could be nice to see this unified though into a general multi-region

Re: Performances Tests

2013-03-20 Thread Enis Söztutar
Thanks so much for doing this J-M. Enis On Wed, Mar 20, 2013 at 11:44 AM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: Hi Ted, I will try to build the trunk version and add it in the list So I have to: - Re-download all HBase version to make sure PE is using the right one; -

Re: The Jenkins VMs are increasingly slow / overloaded

2013-03-20 Thread Andrew Purtell
We have an EC2 hosted Jenkins master and slave pool set up in us-west-1. There are 'HBase-TRUNK' and 'HBase-0.94' projects with bare bones configuration. I've mailed access information and credentials to stack, larsh, and ndimiduk -- a list drawn up simply based on replies to this thread.

Re: Building trunk

2013-03-20 Thread Ted Yu
I ran the following command twice: MAVEN_OPTS=-Xmx10g mvn clean site install assembly:assembly -DskipTests -Prelease $ ls -l target/hbase-0.97-SNAPSHOT* -rw-r--r-- 1 zy users 3933 Mar 20 21:35 target/hbase-0.97-SNAPSHOT-site.xml -rw-r--r-- 1 zy users 61778669 Mar 20 21:35

Re: The Jenkins VMs are increasingly slow / overloaded

2013-03-20 Thread Ted Yu
Thanks Andrew for this effort. Can I get access as well ? On Wed, Mar 20, 2013 at 2:37 PM, Andrew Purtell apurt...@apache.org wrote: We have an EC2 hosted Jenkins master and slave pool set up in us-west-1. There are 'HBase-TRUNK' and 'HBase-0.94' projects with bare bones configuration. I've

Build failed in Jenkins: HBase-0.94 #917

2013-03-20 Thread Apache Jenkins Server
See https://builds.apache.org/job/HBase-0.94/917/changes Changes: [ramkrishna] HBASE-8131 - Create table handler needs to handle failure cases.(Ram) -- [...truncated 5927 lines...] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.372

Re: The Jenkins VMs are increasingly slow / overloaded

2013-03-20 Thread Andrew Purtell
Go to http://54.241.6.143 Log in as user yuzhihong current password PravAZa2. On Wed, Mar 20, 2013 at 10:39 PM, Ted Yu yuzhih...@gmail.com wrote: Thanks Andrew for this effort. Can I get access as well ? On Wed, Mar 20, 2013 at 2:37 PM, Andrew Purtell apurt...@apache.org wrote: We

Re: Building trunk

2013-03-20 Thread Jonathan Hsieh
Specifically, the missing jar references usually mean you need to do a mvn install (with optional -DskipTests) Jon. On Wed, Mar 20, 2013 at 2:12 PM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: Is there anything I'm nissing to build the trunk? I followed the steps on the online book,

Fwd: Questions about versions and timestamp

2013-03-20 Thread Benyi Wang
Hi, Please forgive me if my questions have been already asked and answered many times because I could not googled any of them. If I do the following commands in hbase shell, hbase(main):048:0 create test_ts_ver, data 0 row(s) in 1.0550 seconds hbase(main):049:0 describe test_ts_ver DESCRIPTION

[jira] [Resolved] (HBASE-7898) Serializing Cells over RPC

2013-03-20 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-7898. -- Resolution: Fixed Hadoop Flags: Reviewed There is a bunch to do on rpc still but the new fashion for

Re: Questions about versions and timestamp

2013-03-20 Thread Ted Yu
A few pointers so that you can find the answer yourself: http://hbase.apache.org/book.html Take a look at 2.5.2.8. Managed Compactions and http://hbase.apache.org/book.html#compaction You can also use search-hadoop.com e.g. 'Possible to delete a specific cell?' Cheers On Wed, Mar 20, 2013 at

Re: Building trunk

2013-03-20 Thread Jean-Marc Spaggiari
Thanks Jonathan, mvn install did the trick! Do we have that documented anywhere on the online book? Ted, I will try to build also 0.95 and add it to my list... [INFO] [INFO] Reactor Summary: [INFO] [INFO] HBase

Re: Building trunk

2013-03-20 Thread Stack
On Wed, Mar 20, 2013 at 4:28 PM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: Thanks Jonathan, mvn install did the trick! Do we have that documented anywhere on the online book? See here JM: http://hbase.apache.org/book.html#build If its wrong, lets fix it. St.Ack

Jenkins build is back to normal : hbase-0.95 #91

2013-03-20 Thread Apache Jenkins Server
See https://builds.apache.org/job/hbase-0.95/91/changes

Re: Building trunk

2013-03-20 Thread Jonathan Hsieh
Jean-Marc, Its a mavenism. But if it makes it easier for folks if we document it, I'm all for it. http://maven.apache.org/guides/introduction/introduction-to-the-lifecycle.html Want to give a crack at adding docs about it? It is just like any other patch but applied to the reference guide's

[jira] [Created] (HBASE-8159) hbase.apache.org website javadoc is missing info from newer classes

2013-03-20 Thread Jonathan Hsieh (JIRA)
Jonathan Hsieh created HBASE-8159: - Summary: hbase.apache.org website javadoc is missing info from newer classes Key: HBASE-8159 URL: https://issues.apache.org/jira/browse/HBASE-8159 Project: HBase

[jira] [Created] (HBASE-8160) HMaster#move doesn't check if master initialized

2013-03-20 Thread Jimmy Xiang (JIRA)
Jimmy Xiang created HBASE-8160: -- Summary: HMaster#move doesn't check if master initialized Key: HBASE-8160 URL: https://issues.apache.org/jira/browse/HBASE-8160 Project: HBase Issue Type: Bug

[jira] [Created] (HBASE-8162) Fix import of hbase-default.xml into refguide; broke

2013-03-20 Thread stack (JIRA)
stack created HBASE-8162: Summary: Fix import of hbase-default.xml into refguide; broke Key: HBASE-8162 URL: https://issues.apache.org/jira/browse/HBASE-8162 Project: HBase Issue Type: Bug

[jira] [Resolved] (HBASE-8162) Fix import of hbase-default.xml into refguide; broke

2013-03-20 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-8162. -- Resolution: Fixed Fix Version/s: 0.98.0 Assignee: stack Committed to trunk.

Jenkins build is back to normal : HBase-0.94 #918

2013-03-20 Thread Apache Jenkins Server
See https://builds.apache.org/job/HBase-0.94/918/changes

[jira] [Resolved] (HBASE-8159) hbase.apache.org website javadoc is missing info from newer classes

2013-03-20 Thread Jonathan Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hsieh resolved HBASE-8159. --- Resolution: Fixed Java doc for the missing classes are now present.

[jira] [Created] (HBASE-8163) MemstoreChunkPool: An improvement for JAVA GC when using MSLAB

2013-03-20 Thread chunhui shen (JIRA)
chunhui shen created HBASE-8163: --- Summary: MemstoreChunkPool: An improvement for JAVA GC when using MSLAB Key: HBASE-8163 URL: https://issues.apache.org/jira/browse/HBASE-8163 Project: HBase

Build failed in Jenkins: HBase-TRUNK #3979

2013-03-20 Thread Apache Jenkins Server
See https://builds.apache.org/job/HBase-TRUNK/3979/changes Changes: [stack] HBASE-8162 Fix import of hbase-default.xml into refguide; broke [enis] HBASE-7546 Obtain a table read lock on region split operations [stack] HBASE-7533 Write an RPC Specification for 0.96

[jira] [Created] (HBASE-8164) TestTableLockManager fails intermittently in trunk builds

2013-03-20 Thread Ted Yu (JIRA)
Ted Yu created HBASE-8164: - Summary: TestTableLockManager fails intermittently in trunk builds Key: HBASE-8164 URL: https://issues.apache.org/jira/browse/HBASE-8164 Project: HBase Issue Type: Bug

Build failed in Jenkins: HBase-TRUNK-on-Hadoop-2.0.0 #456

2013-03-20 Thread Apache Jenkins Server
See https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/456/changes Changes: [stack] HBASE-8162 Fix import of hbase-default.xml into refguide; broke [enis] HBASE-7546 Obtain a table read lock on region split operations [stack] HBASE-7533 Write an RPC Specification for 0.96 [stack]

Build failed in Jenkins: HBase-TRUNK #3980

2013-03-20 Thread Apache Jenkins Server
See https://builds.apache.org/job/HBase-TRUNK/3980/changes Changes: [sershe] HBASE-7948 client doesn't need to refresh meta while the region is opening -- [...truncated 3133 lines...] Running org.apache.hadoop.hbase.regionserver.TestWideScanner Tests

[jira] [Created] (HBASE-8165) Update our protobuf to 2.5 from 2.4.1

2013-03-20 Thread stack (JIRA)
stack created HBASE-8165: Summary: Update our protobuf to 2.5 from 2.4.1 Key: HBASE-8165 URL: https://issues.apache.org/jira/browse/HBASE-8165 Project: HBase Issue Type: Bug Reporter: