Re: large heaps

2013-06-12 Thread Nicolas Liochon
Thanks a lot Todd, your conclusion does confirm the feeling I had around large heaps with HBase. On Thu, Jun 13, 2013 at 7:30 AM, Todd Lipcon wrote: > Hey Nicolas, > > I've corresponded with that guy a few times in the past -- back when i > was attempting to hack some patches into G1 for better

Re: Exception while using HBase trunk with hadoop - 2.0.3

2013-06-12 Thread Seth Yang
ramkrishna vasudevan writes: > > It works now. Thanks Ted for your time and help. > > Regards > Ram > > On Fri, Feb 22, 2013 at 10:48 AM, Ted Yu wrote: > > > Ram: > > Here is what we have in pom.xml: > > 2.0.2-alpha > > > > You can try the patch from HBASE-7904 and rebuild your HBase t

Build failed in Jenkins: HBase-0.95 #386

2013-06-12 Thread apurtell
See -- [...truncated 3910 lines...] Running org.apache.hadoop.hbase.regionserver.wal.TestHLogSplit Tests run: 35, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 139.729 sec Tests run: 35, Failures: 0, Errors: 0, S

Build failed in Jenkins: HBase-0.95-Hadoop-2 #378

2013-06-12 Thread apurtell
See -- [...truncated 3964 lines...] Running org.apache.hadoop.hbase.ipc.TestDelayedRpc Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.139 sec Running org.apache.hadoop.hbase.TestDrainingSe

[jira] [Created] (HBASE-8741) Mutations on Regions in recovery mode might have same sequenceIDs

2013-06-12 Thread Himanshu Vashishtha (JIRA)
Himanshu Vashishtha created HBASE-8741: -- Summary: Mutations on Regions in recovery mode might have same sequenceIDs Key: HBASE-8741 URL: https://issues.apache.org/jira/browse/HBASE-8741 Project:

Re: large heaps

2013-06-12 Thread Todd Lipcon
Hey Nicolas, I've corresponded with that guy a few times in the past -- back when i was attempting to hack some patches into G1 for better performance on HBase. The end result of that investigation was the MSLAB feature which made it into 0.90.x. The main thing I learned about GC is that big heap

Build failed in Jenkins: HBase-0.95-Hadoop-2 #377

2013-06-12 Thread apurtell
See -- [...truncated 7759 lines...] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.431 sec Running org.apache.hadoop.hbase.coprocessor.TestAggregateProtocol Tests run: 45, Failures: 0, Er

Build failed in Jenkins: HBase-0.95 #385

2013-06-12 Thread apurtell
See -- [...truncated 3910 lines...] Tests run: 35, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 139.269 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLogSplit Tests run: 35, Failures: 0, Errors: 0, S

Jenkins build is back to normal : HBase-0.94-Security #211

2013-06-12 Thread apurtell
See

Build failed in Jenkins: HBase-0.94-Hadoop-2 #186

2013-06-12 Thread apurtell
See Changes: [jyates] HBASE-8702: Make WALEditCodec pluggable -- [...truncated 3121 lines...] Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.319 sec Running org.apache.hadoop.hbas

Build failed in Jenkins: HBase-0.94-Security-Hadoop-2 #187

2013-06-12 Thread apurtell
See Changes: [jyates] HBASE-8702: Make WALEditCodec pluggable -- [...truncated 5304 lines...] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.884 sec Running org.apache.h

Build failed in Jenkins: HBase-0.95 #384

2013-06-12 Thread apurtell
See -- [...truncated 3910 lines...] Tests run: 35, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 140.602 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLogSplit Tests run: 35, Failures: 0, Errors: 0, S

Build failed in Jenkins: HBase-0.95-Hadoop-2 #376

2013-06-12 Thread apurtell
See -- [...truncated 3971 lines...] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.701 sec Running org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFiles Tests run: 7, Failures: 0, E

large heaps

2013-06-12 Thread Nicolas Liochon
Hi there, During the hackathon I had some discussions around GC on large heaps. This guy, who seems to know what he is talking about, and had a patch accepted in hotspot jdk, said in 2011 that he's got a configuration working reasonably well with large heaps at that time : "I was able to keep GC

Build failed in Jenkins: HBase-0.95 #383

2013-06-12 Thread apurtell
See -- [...truncated 3910 lines...] Tests run: 35, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 128.061 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLogSplitCompressed Tests run: 35, Failures: 0, Er

Build failed in Jenkins: HBase-0.95-Hadoop-2 #375

2013-06-12 Thread apurtell
See -- [...truncated 4672 lines...] at java.lang.Thread.run(Thread.java:662) Running org.apache.hadoop.hbase.mapreduce.TestCellCounter Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:

Build failed in Jenkins: HBase-0.95 #382

2013-06-12 Thread apurtell
See -- [...truncated 4049 lines...] Running org.apache.hadoop.hbase.regionserver.wal.TestLogRolling Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 515.01 sec Results : Tests run: 1580, Failures: 0,

Build failed in Jenkins: HBase-0.95-Hadoop-2 #374

2013-06-12 Thread apurtell
See -- [...truncated 3984 lines...] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.187 sec Running org.apache.hadoop.hbase.regionserver.TestClusterId Tests run: 1, Failures: 0, Errors: 0,

Build failed in Jenkins: HBase-0.95 #381

2013-06-12 Thread apurtell
See -- [...truncated 4048 lines...] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 52.34 sec Running org.apache.hadoop.hbase.TestIOFencing Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elaps

Build failed in Jenkins: HBase-TRUNK-on-Hadoop-2.0.0 #566

2013-06-12 Thread Apache Jenkins Server
See Changes: [dmeil] hbase-8739. book.xml fixed typo in MapReduce chapter "spitting" [dmeil] hbase-8738. refguide, OpsMgt chapter, overhauled HBase metrics section. [jyates] HBASE-8702: Make WALEditCodec pluggable [mber

Build failed in Jenkins: HBase-TRUNK #387

2013-06-12 Thread apurtell
See Changes: [dmeil] hbase-8739. book.xml fixed typo in MapReduce chapter "spitting" [dmeil] hbase-8738. refguide, OpsMgt chapter, overhauled HBase metrics section. [jyates] HBASE-8702: Make WALEditCodec pluggable [mbertozzi] HBASE-8706 Some

Build failed in Jenkins: HBase-0.95 #380

2013-06-12 Thread apurtell
See Changes: [dmeil] hbase-8739. book.xml fixed typo in MapReduce chapter "spitting" -- [...truncated 7278 lines...] Downloading: http://people.apache.org/~garyh/mvn/org/apache/maven/shared/maven-shared-i

Build failed in Jenkins: HBase-0.95-Hadoop-2 #373

2013-06-12 Thread apurtell
See -- [...truncated 3969 lines...] Running org.apache.hadoop.hbase.regionserver.wal.TestLogRollAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 133.721 sec Running org.apache.hadoop.hba

Build failed in Jenkins: HBase-0.94-Security #210

2013-06-12 Thread apurtell
See -- [...truncated 6746 lines...] Running org.apache.hadoop.hbase.util.TestIdLock Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.442 sec Running org.apache.hadoop.hbase.util.TestEnviron

Build failed in Jenkins: hbase-0.95-on-hadoop2 #131

2013-06-12 Thread Apache Jenkins Server
See Changes: [jyates] HBASE-8702: Make WALEditCodec pluggable [mbertozzi] HBASE-8706 Some improvement in snapshot (binlijin) -- [...truncated 24487 lines...] Forking command line: /bin/sh -

Build failed in Jenkins: HBase-0.95-Hadoop-2 #372

2013-06-12 Thread apurtell
See Changes: [dmeil] hbase-8739. book.xml fixed typo in MapReduce chapter "spitting" -- [...truncated 3971 lines...] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 228.979 sec Run

Build failed in Jenkins: hbase-0.95 #241

2013-06-12 Thread Apache Jenkins Server
See Changes: [jyates] HBASE-8702: Make WALEditCodec pluggable [mbertozzi] HBASE-8706 Some improvement in snapshot (binlijin) -- [...truncated 3752 lines...] Tests run: 12, Failures: 0, Errors: 0, Skip

Jenkins build is back to normal : HBase-0.95 #378

2013-06-12 Thread apurtell
See

Build failed in Jenkins: HBase-0.95-Hadoop-2 #371

2013-06-12 Thread apurtell
See Changes: [dmeil] hbase-8738. refguide, OpsMgt chapter, overhauled HBase metrics section. -- [...truncated 3963 lines...] Running org.apache.hadoop.hbase.regionserver.TestRegionFavoredNodes Test

[jira] [Created] (HBASE-8740) Generate unique table names in TestAccessController

2013-06-12 Thread Alex Araujo (JIRA)
Alex Araujo created HBASE-8740: -- Summary: Generate unique table names in TestAccessController Key: HBASE-8740 URL: https://issues.apache.org/jira/browse/HBASE-8740 Project: HBase Issue Type: Imp

[jira] [Created] (HBASE-8739) [refGuide] corrected map-task "spitting"

2013-06-12 Thread Doug Meil (JIRA)
Doug Meil created HBASE-8739: Summary: [refGuide] corrected map-task "spitting" Key: HBASE-8739 URL: https://issues.apache.org/jira/browse/HBASE-8739 Project: HBase Issue Type: Bug Re

Build failed in Jenkins: HBase-0.95-Hadoop-2 #370

2013-06-12 Thread apurtell
See Changes: [jyates] HBASE-8702: Make WALEditCodec pluggable -- [...truncated 3975 lines...] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.404 sec Running org.apache.hadoop.hbas

Jenkins build is back to normal : HBase-TRUNK #4176

2013-06-12 Thread Apache Jenkins Server
See

[jira] [Created] (HBASE-8738) [refGuide] Overhauled HBase metrics section

2013-06-12 Thread Doug Meil (JIRA)
Doug Meil created HBASE-8738: Summary: [refGuide] Overhauled HBase metrics section Key: HBASE-8738 URL: https://issues.apache.org/jira/browse/HBASE-8738 Project: HBase Issue Type: Improvement

Jenkins build is back to normal : HBase-0.95 #376

2013-06-12 Thread apurtell
See

Build failed in Jenkins: HBase-0.95 #377

2013-06-12 Thread apurtell
See Changes: [jyates] HBASE-8702: Make WALEditCodec pluggable [mbertozzi] HBASE-8706 Some improvement in snapshot (binlijin) -- [...truncated 4037 lines...] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0,

Build failed in Jenkins: HBase-0.95-Hadoop-2 #369

2013-06-12 Thread apurtell
See Changes: [mbertozzi] HBASE-8706 Some improvement in snapshot (binlijin) -- [...truncated 4855 lines...] Running org.apache.hadoop.hbase.regionserver.wal.TestLogRollAbort Tests run: 1, Failures:

Build failed in Jenkins: hbase-0.95 #240

2013-06-12 Thread Apache Jenkins Server
See -- [...truncated 3746 lines...] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 100.895 sec Running org.apache.hadoop.hbase.util.TestMiniClusterLoadParallel Tests run: 4, Failures: 0, Errors

[jira] [Created] (HBASE-8737) [replication] Change replication RPC to use cell blocks

2013-06-12 Thread Chris Trezzo (JIRA)
Chris Trezzo created HBASE-8737: --- Summary: [replication] Change replication RPC to use cell blocks Key: HBASE-8737 URL: https://issues.apache.org/jira/browse/HBASE-8737 Project: HBase Issue Typ

[jira] [Created] (HBASE-8736) Clean up naming of constants for metrics

2013-06-12 Thread Elliott Clark (JIRA)
Elliott Clark created HBASE-8736: Summary: Clean up naming of constants for metrics Key: HBASE-8736 URL: https://issues.apache.org/jira/browse/HBASE-8736 Project: HBase Issue Type: Bug

Build failed in Jenkins: HBase-0.95-Hadoop-2 #368

2013-06-12 Thread apurtell
See -- [...truncated 7779 lines...] Tests run: 63, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 102.002 sec Running org.apache.hadoop.hbase.regionserver.handler.TestOpenRegionHandler Tests run: 5, Failu

Build failed in Jenkins: HBase-0.95 #375

2013-06-12 Thread apurtell
See Changes: [sershe] HBASE-8700 IntegrationTestBigLinkedList can fail due to random number collision -- [...truncated 6967 lines...] Tests run: 35, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 129.386

Build failed in Jenkins: HBase-0.95-Hadoop-2 #367

2013-06-12 Thread apurtell
See Changes: [sershe] HBASE-8700 IntegrationTestBigLinkedList can fail due to random number collision -- [...truncated 7775 lines...] at java.util.concurrent.ThreadPoolExecutor$Worker.runT

Fwd: DesignLounge @ HadoopSummit

2013-06-12 Thread Devaraj Das
FYI Begin forwarded message: *From:* Eric Baldeschwieler *Date:* June 11, 2013, 10:46:25 AM PDT *To:* "common-...@hadoop.apache.org" *Subject:* *DesignLounge @ HadoopSummit* *Reply-To:* common-...@hadoop.apache.org Hi Folks, We thought we'd try something new at Hadoop Summit this year to buil

Re: VOTE: hbase-0.95.1 release candidate 1 is available for download

2013-06-12 Thread Jimmy Xiang
A configuration issue. Authorization has to be enabled. RPC does authorization checking no matter it is enabled or not. This is a minor nit we can fix later. Thanks, Jimmy On Tue, Jun 11, 2013 at 8:21 PM, Stack wrote: > On Tue, Jun 11, 2013 at 3:46 PM, Jimmy Xiang wrote: > > > My bad, in H

[jira] [Created] (HBASE-8735) "backup" hbase masters should eventually become active if the "primary" never comes up.

2013-06-12 Thread Jonathan Hsieh (JIRA)
Jonathan Hsieh created HBASE-8735: - Summary: "backup" hbase masters should eventually become active if the "primary" never comes up. Key: HBASE-8735 URL: https://issues.apache.org/jira/browse/HBASE-8735

[jira] [Created] (HBASE-8734) HBase side support for BIGTOP-1007 (Introduce a modules system for HBase coprocessor applications)

2013-06-12 Thread Andrew Purtell (JIRA)
Andrew Purtell created HBASE-8734: - Summary: HBase side support for BIGTOP-1007 (Introduce a modules system for HBase coprocessor applications) Key: HBASE-8734 URL: https://issues.apache.org/jira/browse/HBASE-8734

Re: Batch and checkAndPut

2013-06-12 Thread Ted Yu
You can use HTable.checkAndPut(): boolean checkAndPut(byte[] row, byte[] family, byte[] qualifier, byte[] value, Put put) throws IOException; Take a look at its javadoc for details. Cheers On Wed, Jun 12, 2013 at 2:46 AM, victorspivak wrote: > I saw a similar question but not exactly w

[jira] [Reopened] (HBASE-8721) fix for bug that delete can mask puts that happened after the delete was entered

2013-06-12 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell reopened HBASE-8721: --- Reopening. There's discussion continuing and a reasonable defense of the proposal.

Batch and checkAndPut

2013-06-12 Thread victorspivak
I saw a similar question but not exactly what I have.I have a row with several fields. I would like to update these fields for one row in a batch (i assume it will be atomic) but I would like to update them if one of these fields value satisfy a condition. What are my options? Thanks, Victor --

Build failed in Jenkins: HBase-TRUNK-on-Hadoop-2.0.0 #565

2013-06-12 Thread Apache Jenkins Server
See Changes: [sershe] HBASE-8700 IntegrationTestBigLinkedList can fail due to random number collision -- [...truncated 3787 lines...] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0,

Build failed in Jenkins: hbase-0.95-on-hadoop2 #130

2013-06-12 Thread Apache Jenkins Server
See Changes: [stack] Set new version to 0.95.2-SNAPSHOT [sershe] HBASE-8700 IntegrationTestBigLinkedList can fail due to random number collision -- [...truncated 24521 lines...] Forking co

Build failed in Jenkins: HBase-TRUNK-Hadoop-2 #366

2013-06-12 Thread apurtell
See Changes: [sershe] HBASE-8700 IntegrationTestBigLinkedList can fail due to random number collision [ddas] HBASE-8344. Improves the assignment when node failures happen to choose the secondary RS as the new primary RS [Michael Stack

Build failed in Jenkins: hbase-0.95 #239

2013-06-12 Thread Apache Jenkins Server
See Changes: [stack] Set new version to 0.95.2-SNAPSHOT -- [...truncated 3747 lines...] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 455.356 sec Running org.apache.hadoop.hbase.regio

Re: VOTE: hbase-0.95.1 release candidate 1 is available for download

2013-06-12 Thread Stack
On Mon, Jun 10, 2013 at 3:48 PM, Elliott Clark wrote: > So the maven pom's still point to 1.0 as default no matter what version of > the client you point at. Where is this pointing? I just uploaded new deploy. Here is client pom: https://repository.apache.org/service/local/repo_groups/snap