Re: LZ4 compression support
Yeah, saw that... Was just wondering why Vladimir thinks HBase users won't see any perf. improvements and whether Laxman has the numbers from benchmarking he referred to. Otis Performance Monitoring for Solr / ElasticSearch / HBase - http://sematext.com/spm From: Andrew Purtell andrew.purt...@gmail.com To: dev@hbase.apache.org dev@hbase.apache.org Cc: dev@hbase.apache.org dev@hbase.apache.org; lakshman...@huawei.com lakshman...@huawei.com; Vladimir Rodionov vrodio...@carrieriq.com Sent: Thursday, May 17, 2012 1:49 AM Subject: Re: LZ4 compression support It's on the to do list: https://issues.apache.org/jira/browse/HBASE-5838 On May 16, 2012, at 8:17 PM, Otis Gospodnetic otis_gospodne...@yahoo.com wrote: Hi, (almost 3 months old thread) LZ4 perf test numbers in https://issues.apache.org/jira/browse/HADOOP-7657?focusedCommentId=13170733page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13170733 looks pretty impressive. Why do you think HBase users would not see perf difference in HBase? We saw it when we moved from LZO to Snappy. Laxman, did you end up testing LZ4 with HBase? Would it be possible for you to share the results? Thanks, Otis Performance Monitoring for Solr / ElasticSearch / HBase - http://sematext.com/spm From: Vladimir Rodionov vrodio...@carrieriq.com To: dev@hbase.apache.org dev@hbase.apache.org; lakshman...@huawei.com lakshman...@huawei.com; 'Stack' st...@duboce.net Sent: Tuesday, February 28, 2012 1:20 PM Subject: RE: LZ4 compression support LZ4 is slightly faster than snappy (from my own tests) but I really doubt that anyone will see performance difference in HBase (or in Hadoop) Best regards, Vladimir Rodionov Principal Platform Engineer Carrier IQ, www.carrieriq.com e-mail: vrodio...@carrieriq.com From: Laxman [lakshman...@huawei.com] Sent: Tuesday, February 28, 2012 7:17 AM To: 'Stack'; dev@hbase.apache.org Subject: RE: LZ4 compression support Hi Stack, I haven't tried LZ4 in Hadoop. Currently, I'm directly testing LZ4 with HBase. Will publish my findings soon. -- Regards, Laxman -Original Message- From: saint@gmail.com [mailto:saint@gmail.com] On Behalf Of Stack Sent: Monday, February 27, 2012 11:33 PM To: dev@hbase.apache.org; lakshman...@huawei.com Subject: Re: LZ4 compression support On Mon, Feb 27, 2012 at 6:59 AM, Laxman lakshman...@huawei.com wrote: Hi, Some more compression algorithms are supported in Hadoop. IMO, if not all, we can add support for few faster algorithms (Like LZ4) in HBase also to take the advantage of its speed. https://issues.apache.org/jira/browse/HADOOP-7657 What would you suggest Laxman? Have you tried hbase against hadoop 0.23.1 using LZ4? Or are you thinking of pulling it into hbase? St.Ack Confidentiality Notice: The information contained in this message, including any attachments hereto, may be confidential and is intended to be read only by the individual or entity to whom this message is addressed. If the reader of this message is not the intended recipient or an agent or designee of the intended recipient, please note that any review, use, disclosure or distribution of this message or its attachments, in any form, is strictly prohibited. If you have received this message in error, please immediately notify the sender and/or notificati...@carrieriq.com and delete or destroy any copy of this message and its attachments.
Re: Please welcome our newest committer and PMC member, Liyin Tang
Congrats! --- Jesse Yates @jesse_yates jyates.github.com On Wed, May 16, 2012 at 10:55 PM, Li Pi l...@idle.li wrote: Welcome!!! On Wed, May 16, 2012 at 10:51 PM, Ramkrishna.S.Vasudevan ramkrishna.vasude...@huawei.com wrote: Welcome Liyin... Congrats -Original Message- From: Andrew Purtell [mailto:andrew.purt...@gmail.com] Sent: Thursday, May 17, 2012 11:17 AM To: dev@hbase.apache.org Cc: HBase Dev List Subject: Re: Please welcome our newest committer and PMC member, Liyin Tang Welcome Liyin! On May 16, 2012, at 9:04 PM, Stack st...@duboce.net wrote: One of us Liyin! Keep up the great work. Add yourself to the pom.xml team section (Don't break the build!). St.Ack
Re: Please welcome our newest committer and PMC member, Liyin Tang
Welcome welcome! Jon. On Wed, May 16, 2012 at 9:04 PM, Stack st...@duboce.net wrote: One of us Liyin! Keep up the great work. Add yourself to the pom.xml team section (Don't break the build!). St.Ack -- // Jonathan Hsieh (shay) // Software Engineer, Cloudera // j...@cloudera.com
Re: Publishing jars for hbase compiled against hadoop 0.23.x/hadoop 2.0.x
See my comments inlined... On Wed, May 16, 2012 at 04:06PM, Andrew Purtell wrote: [cc bigtop-dev] On Wed, May 16, 2012 at 3:22 PM, Jesse Yates jesse.k.ya...@gmail.com wrote: ═+1 on a small number of supported versions with different classifiers that only span a limited api skew to avoid a mountain of reflection. Along with that, support for the builds via jenkins testing. and I think HBase should consider having a single blessed set of dependencies and only one build for a given release, This would be really nice, but seems a bit unreasonable given that we are the hadoop database (if not in name, at least by connotation). I think limiting our support to the latest X versions (2-3?) is reasonable given consistent APIs I was talking release mechanics not source/compilation/testing level support. Hence the suggestion for multiple Jenkins projects for the dependency versions we care about. That care could be scoped like you suggest. I like what Bigtop espouses: carefully constructed snapshots of the world, well tested in total. Seems easier to manage then laying out various planes from increasingly higher dimensional spaces. If they get traction we can act as a responsible upstream project. As for our official release, we'd have maybe two, I'll grant you that, Hadoop 1 and Hadoop 2. X=2 will be a challenge. It's not just the Hadoop version that could change, but the versions of all of its dependencies, SLF4J, Guava, JUnit, protobuf, etc. etc. etc.; and that could happen at any time on point releases. If we are supporting the whole series of 1.x and 2.x releases, then that could be a real pain. Guava is a good example, it was a bit painful for us to move from 9 to 11 but not so for core as far as I know. One of the by-design advantages of stack-assembly-validation automation approach (that BigTop incidentally took ;) is that it provides a relatively no-effort creation of stack updates when a single or multiple dependencies got changed. Yes, it requires certain upfront time-investment to make the first base stack definition. And from here it should be pretty much downhill. We have applied a similar approach for the creation of X86 Solaris based stacks for Sun Microsystems' rack-mount servers and it was a hoot and saved us a tremendous amount of money back then (not that it helped Sun in the long run) - we should be very careful in picking which new versions we support and when. A lot of the pain with the hadoop distributions has been then wildly shifting apis, making a lot of work painful for handling different versions (distcp/backup situations come to mind here, among other things. We also have test dependencies on interfaces that are LimitedPrivate at best. It's a source of friction. +1 on the idea of having classifiers for the different versions we actually release as proper artifacts, and should be completely reasonable to enable via profiles. I'd have to double check as to _how_ people would specify that classifier/version of hbase from the maven repo, but it seems entirely possible (my worry here is about the collison with the -tests and -sources classifiers, which are standard mvn conventions for different builds). Otherwise, with maven it is very reasonable to have people hosting profiles for versions that they want to support - generally, this means just another settings.xml file that includes another profile that people can activate on their own, when they want to build against their own version. This was a question I had, maybe you know. What happens if you want to build something like artifact-version-classifier-tests or -source? Would that work? Otherwise we'd have to add a suffix using property substitutions in profiles, right? *-tests artifacts in maven are somewhat special animals and can't be dependent upon in the common sense. This actually was a reason that BigTop has chosen to make/use regular binary jar artifacts and use a name designator for their test-related nature. With regards, Cos Best regards, ═ ═- Andy Problems worthy of attack prove their worth by hitting back. - Piet Hein (via Tom White) signature.asc Description: Digital signature
Re: Please welcome our newest committer and PMC member, Liyin Tang
Welcome！ ：) -邮件原件- 发件人: saint@gmail.com [mailto:saint@gmail.com] 代表 Stack 发送时间: 2012年5月17日 12:04 收件人: HBase Dev List 主题: Please welcome our newest committer and PMC member, Liyin Tang One of us Liyin! Keep up the great work. Add yourself to the pom.xml team section (Don't break the build!). St.Ack
Build failed in Jenkins: HBase-TRUNK #2889
See https://builds.apache.org/job/HBase-TRUNK/2889/changes Changes: [stack] HBASE-5935 Add Region-level PB-based calls to HMasterInterface -- [...truncated 8529 lines...] Running org.apache.hadoop.hbase.client.TestAdmin Tests run: 39, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 160.992 sec Running org.apache.hadoop.hbase.client.TestFromClientSide3 Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.557 sec Running org.apache.hadoop.hbase.client.TestMultipleTimestamps Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.912 sec Running org.apache.hadoop.hbase.client.TestHCM Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.132 sec Running org.apache.hadoop.hbase.master.TestActiveMasterManager Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.894 sec Running org.apache.hadoop.hbase.client.TestHTablePool$TestHTableReusablePool Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.12 sec Running org.apache.hadoop.hbase.master.TestMasterStatusServlet Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.086 sec Running org.apache.hadoop.hbase.master.TestMasterShutdown Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.552 sec Running org.apache.hadoop.hbase.master.TestAssignmentManager Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.862 sec Running org.apache.hadoop.hbase.master.TestHMasterRPCException Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.036 sec Running org.apache.hadoop.hbase.master.TestLogsCleaner Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.04 sec Running org.apache.hadoop.hbase.client.TestHTablePool$TestHTableThreadLocalPool Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.689 sec Running org.apache.hadoop.hbase.client.TestFromClientSide Tests run: 56, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 174.936 sec Running org.apache.hadoop.hbase.master.TestOpenedRegionHandler Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.578 sec Running org.apache.hadoop.hbase.master.TestMasterTransitions Tests run: 3, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 17.983 sec Running org.apache.hadoop.hbase.master.TestDefaultLoadBalancer Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.519 sec Running org.apache.hadoop.hbase.master.TestZKBasedOpenCloseRegion Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.779 sec Running org.apache.hadoop.hbase.master.TestClockSkewDetection Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.387 sec Running org.apache.hadoop.hbase.master.TestRollingRestart Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 47.159 sec Running org.apache.hadoop.hbase.master.TestRestartCluster Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.056 sec Running org.apache.hadoop.hbase.master.TestMaster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.565 sec Running org.apache.hadoop.hbase.master.TestMasterNoCluster Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.272 sec Running org.apache.hadoop.hbase.master.TestMXBean Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.673 sec Running org.apache.hadoop.hbase.master.TestSplitLogManager Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.075 sec Running org.apache.hadoop.hbase.master.TestMasterRestartAfterDisablingTable Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.437 sec Running org.apache.hadoop.hbase.metrics.TestMetricsMBeanBase Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.157 sec Running org.apache.hadoop.hbase.master.TestMasterFailover Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 65.57 sec Running org.apache.hadoop.hbase.TestGlobalMemStoreSize Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.304 sec Running org.apache.hadoop.hbase.replication.TestReplicationZookeeper Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.606 sec Running org.apache.hadoop.hbase.TestFullLogReconstruction Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 42.499 sec Running org.apache.hadoop.hbase.replication.TestReplicationSource Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.555 sec Running org.apache.hadoop.hbase.TestZooKeeper Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.131 sec Running org.apache.hadoop.hbase.replication.TestReplicationPeer Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.297 sec Running org.apache.hadoop.hbase.master.TestDistributedLogSplitting Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 100.78 sec Running org.apache.hadoop.hbase.replication.regionserver.TestReplicationSink Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.197 sec Running
Build failed in Jenkins: HBase-TRUNK-on-Hadoop-2.0.0 #7
See https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/7/changes Changes: [stack] HBASE-5935 Add Region-level PB-based calls to HMasterInterface -- [...truncated 9130 lines...] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.87 sec Running org.apache.hadoop.hbase.master.TestMasterShutdown Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.209 sec Running org.apache.hadoop.hbase.master.TestHMasterRPCException Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.131 sec Running org.apache.hadoop.hbase.client.TestHTablePool$TestHTableThreadLocalPool Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.075 sec Running org.apache.hadoop.hbase.master.TestLogsCleaner Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.307 sec Running org.apache.hadoop.hbase.master.TestOpenedRegionHandler Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.073 sec Running org.apache.hadoop.hbase.master.TestMasterTransitions Tests run: 3, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 11.505 sec Running org.apache.hadoop.hbase.client.TestFromClientSide Tests run: 56, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 148.265 sec Running org.apache.hadoop.hbase.master.TestZKBasedOpenCloseRegion Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.664 sec Running org.apache.hadoop.hbase.master.TestDefaultLoadBalancer Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.591 sec Running org.apache.hadoop.hbase.master.TestClockSkewDetection Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.347 sec Running org.apache.hadoop.hbase.master.TestRollingRestart Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.125 sec Running org.apache.hadoop.hbase.master.TestRestartCluster Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.636 sec Running org.apache.hadoop.hbase.master.TestMasterNoCluster Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.621 sec Running org.apache.hadoop.hbase.master.TestMaster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.064 sec Running org.apache.hadoop.hbase.master.TestMXBean Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.27 sec Running org.apache.hadoop.hbase.master.TestSplitLogManager Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.933 sec Running org.apache.hadoop.hbase.master.TestMasterRestartAfterDisablingTable Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.088 sec Running org.apache.hadoop.hbase.metrics.TestMetricsMBeanBase Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.206 sec Running org.apache.hadoop.hbase.master.TestMasterFailover Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.442 sec Running org.apache.hadoop.hbase.TestGlobalMemStoreSize Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.508 sec Running org.apache.hadoop.hbase.replication.TestReplicationZookeeper Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.739 sec Running org.apache.hadoop.hbase.TestFullLogReconstruction Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.48 sec Running org.apache.hadoop.hbase.master.TestDistributedLogSplitting Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 58.606 sec Running org.apache.hadoop.hbase.TestZooKeeper Running org.apache.hadoop.hbase.replication.TestReplicationSource Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.477 sec Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.165 sec Running org.apache.hadoop.hbase.replication.TestReplicationPeer Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.185 sec Running org.apache.hadoop.hbase.replication.regionserver.TestReplicationSourceManager Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.302 sec Running org.apache.hadoop.hbase.replication.TestMasterReplication Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.017 sec Running org.apache.hadoop.hbase.replication.regionserver.TestReplicationSink Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.624 sec Running org.apache.hadoop.hbase.TestMultiVersions Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.059 sec Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditorNoCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.264 sec Running org.apache.hadoop.hbase.TestHBaseTestingUtility Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.209 sec Running org.apache.hadoop.hbase.replication.TestMultiSlaveReplication Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 53.799 sec Running org.apache.hadoop.hbase.catalog.TestCatalogTracker Tests run: 9, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 5.565 sec Running
Re: Please welcome our newest committer and PMC member, Liyin Tang
Welcome! On 5/17/12 12:04 AM, Stack st...@duboce.net wrote: One of us Liyin! Keep up the great work. Add yourself to the pom.xml team section (Don't break the build!). St.Ack
RE: Please welcome our newest committer and PMC member, Liyin Tang
Great work. Congratulations Liyin! Regards, Uma From: Doug Meil [doug.m...@explorysmedical.com] Sent: Thursday, May 17, 2012 5:43 PM To: dev@hbase.apache.org Subject: Re: Please welcome our newest committer and PMC member, Liyin Tang Welcome! On 5/17/12 12:04 AM, Stack st...@duboce.net wrote: One of us Liyin! Keep up the great work. Add yourself to the pom.xml team section (Don't break the build!). St.Ack
understanding the code base, patterns, threading, etc.
Greetings, Other than reading the the source code, google papers, seda, etc. how does someone get solid understanding of the code base? Are there any high-level (or low level!) diagrams of sort that go over the various components of hbase? (various read/write stages, gossip, etc.) I'm guessing this is wishful thinking but I thought I'd ask :)
Re: understanding the code base, patterns, threading, etc.
Well, the first answer is always the same: read the code! :) Of course, sometimes it's difficult to get the high level concepts quickly that way (even with good docs, like the HBase code generally has). So I'd recommend seeing the upcoming talk by committer Lars Hofhansl at HBaseCon on Tuesday--that's exactly what it's about! It's called HBase Internals. If you're not attending, I'm sure they'll post slides (and maybe video?) afterwards. Ian On May 17, 2012, at 8:39 AM, S Ahmed wrote: Greetings, Other than reading the the source code, google papers, seda, etc. how does someone get solid understanding of the code base? Are there any high-level (or low level!) diagrams of sort that go over the various components of hbase? (various read/write stages, gossip, etc.) I'm guessing this is wishful thinking but I thought I'd ask :)
Re: Please welcome our newest committer and PMC member, Liyin Tang
Welcome Liyin! -- Lars From: Stack st...@duboce.net To: HBase Dev List dev@hbase.apache.org Sent: Wednesday, May 16, 2012 9:04 PM Subject: Please welcome our newest committer and PMC member, Liyin Tang One of us Liyin! Keep up the great work. Add yourself to the pom.xml team section (Don't break the build!). St.Ack
Build failed in Jenkins: HBase-TRUNK #2890
See https://builds.apache.org/job/HBase-TRUNK/2890/changes Changes: [tedyu] HBASE-5826 Improve sync of HLog edits (Todd) -- [...truncated 8509 lines...] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.159 sec Running org.apache.hadoop.hbase.zookeeper.TestZKTable Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.26 sec Running org.apache.hadoop.hbase.zookeeper.TestZKLeaderManager Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.896 sec Running org.apache.hadoop.hbase.io.hfile.slab.TestSingleSizeCache Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.866 sec Running org.apache.hadoop.hbase.zookeeper.TestZooKeeperNodeTracker Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.892 sec Running org.apache.hadoop.hbase.rest.TestSchemaResource Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.321 sec Running org.apache.hadoop.hbase.io.encoding.TestChangingEncoding Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 253.767 sec Running org.apache.hadoop.hbase.io.hfile.TestCacheOnWrite Tests run: 36, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.813 sec Running org.apache.hadoop.hbase.rest.TestGzipFilter Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.802 sec Running org.apache.hadoop.hbase.rest.TestRowResource Running org.apache.hadoop.hbase.rest.TestMultiRowResource Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.782 sec Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.138 sec Running org.apache.hadoop.hbase.zookeeper.TestZooKeeperACL Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 51.776 sec Running org.apache.hadoop.hbase.rest.client.TestRemoteTable Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.15 sec Running org.apache.hadoop.hbase.rest.TestVersionResource Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.112 sec Running org.apache.hadoop.hbase.rest.client.TestRemoteAdmin Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.731 sec Running org.apache.hadoop.hbase.rest.TestStatusResource Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.358 sec Running org.apache.hadoop.hbase.rest.TestScannersWithFilters Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.28 sec Running org.apache.hadoop.hbase.rest.TestTableResource Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.139 sec Running org.apache.hadoop.hbase.monitoring.TestTaskMonitor Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.344 sec Running org.apache.hadoop.hbase.monitoring.TestMemoryBoundedLogMessageBuffer Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.256 sec Running org.apache.hadoop.hbase.metrics.TestMetricsMBeanBase Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.13 sec Running org.apache.hadoop.hbase.TestInfoServers Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.533 sec Running org.apache.hadoop.hbase.rest.TestScannerResource Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.178 sec Running org.apache.hadoop.hbase.regionserver.TestServerCustomProtocol Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.455 sec Running org.apache.hadoop.hbase.regionserver.TestAtomicOperation Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.18 sec Running org.apache.hadoop.hbase.regionserver.TestEndToEndSplitTransaction Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 44.985 sec Running org.apache.hadoop.hbase.regionserver.TestHRegion Tests run: 62, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 45.444 sec Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplayCompressed Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.352 sec Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplay Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.021 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLog Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 77.283 sec Running org.apache.hadoop.hbase.regionserver.wal.TestLogRollingNoCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.361 sec Running org.apache.hadoop.hbase.regionserver.TestStore Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.413 sec Running org.apache.hadoop.hbase.regionserver.TestRpcMetrics Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.804 sec Running org.apache.hadoop.hbase.regionserver.TestBlocksRead Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.045 sec Running org.apache.hadoop.hbase.regionserver.wal.TestLogRollAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 157.187 sec Running org.apache.hadoop.hbase.regionserver.wal.TestLogRolling Tests run: 2, Failures: 0, Errors: 0,
Re: Please welcome our newest committer and PMC member, Liyin Tang
Welcome Liyin! On Wed, May 16, 2012 at 9:04 PM, Stack st...@duboce.net wrote: One of us Liyin! Keep up the great work. Add yourself to the pom.xml team section (Don't break the build!). St.Ack
Re: Please welcome our newest committer and PMC member, Liyin Tang
Congrats Liyin! :) Himanshu On Thu, May 17, 2012 at 10:10 AM, lars hofhansl lhofha...@yahoo.com wrote: Welcome Liyin! -- Lars From: Stack st...@duboce.net To: HBase Dev List dev@hbase.apache.org Sent: Wednesday, May 16, 2012 9:04 PM Subject: Please welcome our newest committer and PMC member, Liyin Tang One of us Liyin! Keep up the great work. Add yourself to the pom.xml team section (Don't break the build!). St.Ack
Re: Please welcome our newest committer and PMC member, Liyin Tang
Congratulations! On May 17, 2012, at 6:04 AM, Stack wrote: One of us Liyin! Keep up the great work. Add yourself to the pom.xml team section (Don't break the build!). St.Ack
Re: Please welcome our newest committer and PMC member, Liyin Tang
Cool. Thank you all ! Looking forward to working more closely in the community. Thanks a lot Liyin On Thu, May 17, 2012 at 9:58 AM, Lars George lars.geo...@gmail.com wrote: Congratulations! On May 17, 2012, at 6:04 AM, Stack wrote: One of us Liyin! Keep up the great work. Add yourself to the pom.xml team section (Don't break the build!). St.Ack
Jenkins build is back to normal : HBase-TRUNK #2891
See https://builds.apache.org/job/HBase-TRUNK/2891/changes
Build failed in Jenkins: HBase-0.94 #194
See https://builds.apache.org/job/HBase-0.94/194/changes Changes: [apurtell] HBASE-6004. Adding more logging to help debugging MR job (Jimmy Xiang) [apurtell] HBASE-6001. Upgrade slf4j to 1.6.1 -- [...truncated 573 lines...] Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 141.308 sec Running org.apache.hadoop.hbase.io.hfile.TestChecksum Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.892 sec Running org.apache.hadoop.hbase.io.hfile.TestHFileBlockIndex Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.049 sec Running org.apache.hadoop.hbase.io.hfile.TestHFilePerformance Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.82 sec Running org.apache.hadoop.hbase.io.hfile.TestHFileBlock Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 48.438 sec Running org.apache.hadoop.hbase.io.hfile.TestFixedFileTrailer Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.859 sec Running org.apache.hadoop.hbase.io.hfile.TestHFileSeek Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.24 sec Running org.apache.hadoop.hbase.io.hfile.slab.TestSingleSizeCache Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.665 sec Running org.apache.hadoop.hbase.io.hfile.slab.TestSlabCache Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.072 sec Running org.apache.hadoop.hbase.zookeeper.TestZKTable Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.807 sec Running org.apache.hadoop.hbase.zookeeper.TestZKLeaderManager Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.01 sec Running org.apache.hadoop.hbase.zookeeper.TestZooKeeperNodeTracker Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.708 sec Running org.apache.hadoop.hbase.rest.TestSchemaResource Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.634 sec Running org.apache.hadoop.hbase.io.hfile.TestCacheOnWrite Tests run: 36, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.361 sec Running org.apache.hadoop.hbase.rest.TestGzipFilter Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.788 sec Running org.apache.hadoop.hbase.rest.TestRowResource Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.724 sec Running org.apache.hadoop.hbase.rest.TestMultiRowResource Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.513 sec Running org.apache.hadoop.hbase.io.encoding.TestChangingEncoding Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 241.287 sec Running org.apache.hadoop.hbase.rest.client.TestRemoteTable Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.265 sec Running org.apache.hadoop.hbase.rest.TestVersionResource Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.581 sec Running org.apache.hadoop.hbase.rest.client.TestRemoteAdmin Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.285 sec Running org.apache.hadoop.hbase.rest.TestStatusResource Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.031 sec Running org.apache.hadoop.hbase.rest.TestTableResource Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.151 sec Running org.apache.hadoop.hbase.rest.TestScannerResource Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.516 sec Running org.apache.hadoop.hbase.monitoring.TestTaskMonitor Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.315 sec Running org.apache.hadoop.hbase.monitoring.TestMemoryBoundedLogMessageBuffer Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.244 sec Running org.apache.hadoop.hbase.metrics.TestMetricsMBeanBase Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.124 sec Running org.apache.hadoop.hbase.rest.TestScannersWithFilters Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.36 sec Running org.apache.hadoop.hbase.TestInfoServers Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.062 sec Running org.apache.hadoop.hbase.zookeeper.TestZooKeeperACL Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 102.364 sec Running org.apache.hadoop.hbase.regionserver.TestServerCustomProtocol Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.106 sec Running org.apache.hadoop.hbase.regionserver.TestAtomicOperation Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.848 sec Running org.apache.hadoop.hbase.regionserver.TestHRegion Tests run: 61, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.574 sec Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplayCompressed Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 32.873 sec Running org.apache.hadoop.hbase.regionserver.TestEndToEndSplitTransaction Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.426 sec Running
Jenkins build is back to normal : HBase-0.94 #195
See https://builds.apache.org/job/HBase-0.94/195/changes
Build failed in Jenkins: HBase-0.92 #408
See https://builds.apache.org/job/HBase-0.92/408/changes Changes: [apurtell] HBASE-6001. Upgrade slf4j to 1.6.1 (update CHANGES.txt) [apurtell] HBASE-6001. Upgrade slf4j to 1.6.1 -- [...truncated 1781 lines...] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.956 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.486 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverInterface Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.291 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.211 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverBypass Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.133 sec Running org.apache.hadoop.hbase.mapred.TestTableMapReduce Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 68.616 sec Running org.apache.hadoop.hbase.mapred.TestTableInputFormat Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.265 sec Running org.apache.hadoop.hbase.TestGlobalMemStoreSize Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.82 sec Running org.apache.hadoop.hbase.mapreduce.TestTableSplit Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.136 sec Running org.apache.hadoop.hbase.mapreduce.TestTableMapReduce Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 99.307 sec Running org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 58.695 sec Running org.apache.hadoop.hbase.mapreduce.TestSimpleTotalOrderPartitioner Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.448 sec Running org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 178.216 sec Running org.apache.hadoop.hbase.mapreduce.TestImportTsv Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 89.538 sec Running org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 465.612 sec Running org.apache.hadoop.hbase.mapreduce.TestTimeRangeMapRed Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 46.823 sec Running org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFiles Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.317 sec Running org.apache.hadoop.hbase.TestAcidGuarantees Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 119.83 sec Running org.apache.hadoop.hbase.TestSerialization Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.329 sec Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditorNoCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.099 sec Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditor Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.942 sec Running org.apache.hadoop.hbase.catalog.TestCatalogTrackerOnCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 148.109 sec Running org.apache.hadoop.hbase.catalog.TestCatalogTracker Tests run: 9, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 3.419 sec Running org.apache.hadoop.hbase.client.TestResult Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.145 sec Running org.apache.hadoop.hbase.client.TestTimestampsFilter Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.171 sec Running org.apache.hadoop.hbase.client.TestShell Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 90.197 sec Running org.apache.hadoop.hbase.client.TestFromClientSide Tests run: 48, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 157.183 sec Running org.apache.hadoop.hbase.client.TestHCM Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.625 sec Running org.apache.hadoop.hbase.client.TestAttributes Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.14 sec Running org.apache.hadoop.hbase.client.TestScannerTimeout Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 53.376 sec Running org.apache.hadoop.hbase.client.TestMetaScanner Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.219 sec Running org.apache.hadoop.hbase.client.TestHTableUtil Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.94 sec Running org.apache.hadoop.hbase.client.TestMetaMigrationRemovingHTD Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.532 sec Running org.apache.hadoop.hbase.client.TestOperation Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.578 sec Running org.apache.hadoop.hbase.client.TestHTablePool Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.571 sec Running
Build failed in Jenkins: HBase-TRUNK #2894
See https://builds.apache.org/job/HBase-TRUNK/2894/changes Changes: [stack] HBASE-6034 Upgrade Hadoop dependencies [stack] HBASE-6022 Include Junit in the libs when packaging so that TestAcidGaurntee can run [stack] Added a bit of doc on how to use mvn to publish the site [stack] HBASE-6005 Addendum... fixing release links -- [...truncated 10225 lines...] Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.869 sec Running org.apache.hadoop.hbase.client.TestFromClientSide3 Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.285 sec Running org.apache.hadoop.hbase.client.TestHCM Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.518 sec Running org.apache.hadoop.hbase.master.TestActiveMasterManager Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.933 sec Running org.apache.hadoop.hbase.master.TestMasterStatusServlet Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.08 sec Running org.apache.hadoop.hbase.master.TestAssignmentManager Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.804 sec Running org.apache.hadoop.hbase.master.TestHMasterRPCException Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.007 sec Running org.apache.hadoop.hbase.master.TestMasterShutdown Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.157 sec Running org.apache.hadoop.hbase.client.TestHTablePool$TestHTableReusablePool Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.149 sec Running org.apache.hadoop.hbase.master.TestLogsCleaner Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.273 sec Running org.apache.hadoop.hbase.client.TestHTablePool$TestHTableThreadLocalPool Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.446 sec Running org.apache.hadoop.hbase.master.TestOpenedRegionHandler Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.573 sec Running org.apache.hadoop.hbase.client.TestFromClientSide Tests run: 56, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 177.48 sec Running org.apache.hadoop.hbase.master.TestMasterTransitions Tests run: 3, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 22.708 sec Running org.apache.hadoop.hbase.master.TestDefaultLoadBalancer Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.532 sec Running org.apache.hadoop.hbase.master.TestZKBasedOpenCloseRegion Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.297 sec Running org.apache.hadoop.hbase.master.TestClockSkewDetection Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.311 sec Running org.apache.hadoop.hbase.master.TestRollingRestart Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 46.123 sec Running org.apache.hadoop.hbase.master.TestRestartCluster Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.748 sec Running org.apache.hadoop.hbase.master.TestMasterNoCluster Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.122 sec Running org.apache.hadoop.hbase.master.TestMaster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.151 sec Running org.apache.hadoop.hbase.master.TestSplitLogManager Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.859 sec Running org.apache.hadoop.hbase.master.TestMXBean Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.878 sec Running org.apache.hadoop.hbase.master.TestMasterRestartAfterDisablingTable Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.178 sec Running org.apache.hadoop.hbase.metrics.TestMetricsMBeanBase Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.125 sec Running org.apache.hadoop.hbase.master.TestMasterFailover Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 68.666 sec Running org.apache.hadoop.hbase.TestGlobalMemStoreSize Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.097 sec Running org.apache.hadoop.hbase.replication.TestReplicationZookeeper Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.641 sec Running org.apache.hadoop.hbase.TestFullLogReconstruction Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 53.779 sec Running org.apache.hadoop.hbase.TestZooKeeper Tests run: 9, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 30.203 sec FAILURE! Running org.apache.hadoop.hbase.replication.TestReplicationSource Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.876 sec Running org.apache.hadoop.hbase.replication.TestReplicationPeer Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.802 sec Running org.apache.hadoop.hbase.master.TestDistributedLogSplitting Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 108.423 sec Running org.apache.hadoop.hbase.replication.regionserver.TestReplicationSourceManager Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.981 sec
Jenkins build is back to normal : HBase-TRUNK #2895
See https://builds.apache.org/job/HBase-TRUNK/2895/changes
Build failed in Jenkins: HBase-0.94 #197
See https://builds.apache.org/job/HBase-0.94/197/changes Changes: [jmhsieh] HBASE-6018 hbck fails with a RejectedExecutionException when 50 regions present -- [...truncated 569 lines...] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.71 sec Running org.apache.hadoop.hbase.client.TestShell Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 81.928 sec Running org.apache.hadoop.hbase.client.TestMetaScanner Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.964 sec Running org.apache.hadoop.hbase.client.TestHTableUtil Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.725 sec Running org.apache.hadoop.hbase.client.TestMultiParallel Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.496 sec Running org.apache.hadoop.hbase.client.replication.TestReplicationAdmin Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.848 sec Running org.apache.hadoop.hbase.client.TestMultipleTimestamps Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 32.255 sec Running org.apache.hadoop.hbase.client.TestHCM Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.04 sec Running org.apache.hadoop.hbase.client.TestHTablePool$TestHTableReusablePool Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.132 sec Running org.apache.hadoop.hbase.master.TestMasterShutdown Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.236 sec Running org.apache.hadoop.hbase.master.TestActiveMasterManager Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.86 sec Running org.apache.hadoop.hbase.master.TestMasterStatusServlet Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.958 sec Running org.apache.hadoop.hbase.master.TestHMasterRPCException Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.093 sec Running org.apache.hadoop.hbase.master.TestDeadServer Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.206 sec Running org.apache.hadoop.hbase.client.TestHTablePool$TestHTableThreadLocalPool Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.55 sec Running org.apache.hadoop.hbase.master.TestLogsCleaner Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.055 sec Running org.apache.hadoop.hbase.client.TestAdmin Tests run: 37, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 173.08 sec Running org.apache.hadoop.hbase.client.TestFromClientSide Tests run: 55, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 162.259 sec Running org.apache.hadoop.hbase.master.TestOpenedRegionHandler Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.575 sec Running org.apache.hadoop.hbase.master.TestMasterTransitions Tests run: 3, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 18.86 sec Running org.apache.hadoop.hbase.master.TestDefaultLoadBalancer Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.557 sec Running org.apache.hadoop.hbase.master.TestZKBasedOpenCloseRegion Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.723 sec Running org.apache.hadoop.hbase.master.TestClockSkewDetection Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.293 sec Running org.apache.hadoop.hbase.master.TestRollingRestart Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 44.281 sec Running org.apache.hadoop.hbase.master.TestRestartCluster Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.529 sec Running org.apache.hadoop.hbase.master.TestMaster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.367 sec Running org.apache.hadoop.hbase.master.TestSplitLogManager Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.602 sec Running org.apache.hadoop.hbase.master.TestMasterZKSessionRecovery Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.743 sec Running org.apache.hadoop.hbase.master.TestMasterFailover Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 63.94 sec Running org.apache.hadoop.hbase.metrics.TestMetricsMBeanBase Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.117 sec Running org.apache.hadoop.hbase.TestGlobalMemStoreSize Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.673 sec Running org.apache.hadoop.hbase.TestFullLogReconstruction Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.101 sec Running org.apache.hadoop.hbase.replication.TestReplicationZookeeper Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.733 sec Running org.apache.hadoop.hbase.master.TestMasterRestartAfterDisablingTable Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 73.694 sec Running org.apache.hadoop.hbase.replication.TestReplicationSource Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.295 sec Running org.apache.hadoop.hbase.master.TestDistributedLogSplitting Tests run: 4,
Build failed in Jenkins: HBase-0.92 #409
See https://builds.apache.org/job/HBase-0.92/409/changes Changes: [stack] HBASE-6034 Upgrade Hadoop dependencies [stack] HBASE-6034 Upgrade Hadoop dependencies -- [...truncated 1788 lines...] Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.848 sec Running org.apache.hadoop.hbase.regionserver.TestRpcMetrics Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.934 sec Running org.apache.hadoop.hbase.regionserver.TestCompoundBloomFilter Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.056 sec Running org.apache.hadoop.hbase.regionserver.TestBlocksRead Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.137 sec Running org.apache.hadoop.hbase.regionserver.TestKeyValueScanFixture Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.121 sec Running org.apache.hadoop.hbase.regionserver.TestExplicitColumnTracker Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.891 sec Running org.apache.hadoop.hbase.regionserver.TestStoreFile Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.738 sec Running org.apache.hadoop.hbase.regionserver.TestWideScanner Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.919 sec Running org.apache.hadoop.hbase.regionserver.TestQueryMatcher Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.55 sec Running org.apache.hadoop.hbase.regionserver.TestReadWriteConsistencyControl Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.116 sec Running org.apache.hadoop.hbase.regionserver.TestResettingCounters Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.839 sec Running org.apache.hadoop.hbase.regionserver.TestStoreScanner Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.157 sec Running org.apache.hadoop.hbase.regionserver.TestMinVersions Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.316 sec Running org.apache.hadoop.hbase.regionserver.TestMemStoreLAB Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.378 sec Running org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 70.589 sec Running org.apache.hadoop.hbase.regionserver.TestSplitTransaction Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.082 sec Running org.apache.hadoop.hbase.regionserver.TestScanDeleteTracker Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.612 sec Running org.apache.hadoop.hbase.regionserver.TestCompactSelection Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.737 sec Running org.apache.hadoop.hbase.regionserver.TestStoreFileBlockCacheSummary Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.335 sec Running org.apache.hadoop.hbase.regionserver.TestMemStore Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.19 sec Running org.apache.hadoop.hbase.regionserver.TestGetClosestAtOrBefore Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.235 sec Running org.apache.hadoop.hbase.regionserver.TestScanWithBloomError Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.133 sec Running org.apache.hadoop.hbase.regionserver.TestKeyValueSkipListSet Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.122 sec Running org.apache.hadoop.hbase.regionserver.TestKeyValueHeap Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.51 sec Running org.apache.hadoop.hbase.regionserver.TestMXBean Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.763 sec Running org.apache.hadoop.hbase.regionserver.TestScanner Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.732 sec Running org.apache.hadoop.hbase.regionserver.TestRegionSplitPolicy Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.699 sec Running org.apache.hadoop.hbase.regionserver.TestMultiColumnScanner Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.731 sec Running org.apache.hadoop.hbase.regionserver.TestHRegionInfo Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.653 sec Running org.apache.hadoop.hbase.regionserver.handler.TestCloseRegionHandler Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.198 sec Running org.apache.hadoop.hbase.regionserver.handler.TestOpenRegionHandler Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.961 sec Running org.apache.hadoop.hbase.regionserver.TestHRegionServerBulkLoad Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 51.627 sec Running org.apache.hadoop.hbase.regionserver.TestRSKilledWhenMasterInitializing Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 73.976 sec Running org.apache.hadoop.hbase.regionserver.TestMasterAddressManager Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.598 sec Running
Re: understanding the code base, patterns, threading, etc.
I was afraid you were going to say that :) Looking forward to the vidoes! On Thu, May 17, 2012 at 9:44 AM, Ian Varley ivar...@salesforce.com wrote: Well, the first answer is always the same: read the code! :) Of course, sometimes it's difficult to get the high level concepts quickly that way (even with good docs, like the HBase code generally has). So I'd recommend seeing the upcoming talk by committer Lars Hofhansl at HBaseCon on Tuesday--that's exactly what it's about! It's called HBase Internals. If you're not attending, I'm sure they'll post slides (and maybe video?) afterwards. Ian On May 17, 2012, at 8:39 AM, S Ahmed wrote: Greetings, Other than reading the the source code, google papers, seda, etc. how does someone get solid understanding of the code base? Are there any high-level (or low level!) diagrams of sort that go over the various components of hbase? (various read/write stages, gossip, etc.) I'm guessing this is wishful thinking but I thought I'd ask :)
Build failed in Jenkins: HBase-TRUNK #2896
See https://builds.apache.org/job/HBase-TRUNK/2896/changes Changes: [apurtell] HBASE-6023. Normalize security audit logging level with Hadoop [tedyu] HBASE-5927 SSH and DisableTableHandler happening together does not clear the znode of the region and RIT map (Rajesh) [apurtell] HBASE-6021. NullPointerException when running LoadTestTool without specifying compression type [apurtell] HBASE-6011. Unable to start master in local mode -- [...truncated 10227 lines...] Running org.apache.hadoop.hbase.regionserver.TestBlocksRead Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.228 sec Running org.apache.hadoop.hbase.regionserver.wal.TestLogRollingNoCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.493 sec Running org.apache.hadoop.hbase.regionserver.TestStoreFileBlockCacheSummary Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.806 sec Running org.apache.hadoop.hbase.regionserver.TestHRegion Tests run: 62, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 39.244 sec Running org.apache.hadoop.hbase.regionserver.TestFSErrorsExposed Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.834 sec Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplay Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.194 sec Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplayCompressed Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.497 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLog Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 68.253 sec Running org.apache.hadoop.hbase.regionserver.handler.TestCloseRegionHandler Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.306 sec Running org.apache.hadoop.hbase.regionserver.handler.TestOpenRegionHandler Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.069 sec Running org.apache.hadoop.hbase.regionserver.wal.TestLogRollAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 157.934 sec Running org.apache.hadoop.hbase.filter.TestColumnRangeFilter Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.208 sec Running org.apache.hadoop.hbase.regionserver.TestHRegionServerBulkLoad Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 47.82 sec Running org.apache.hadoop.hbase.coprocessor.TestClassLoading Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 32.335 sec Running org.apache.hadoop.hbase.regionserver.wal.TestLogRolling Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 90.166 sec Running org.apache.hadoop.hbase.coprocessor.TestAggregateProtocol Tests run: 45, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.911 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.114 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.336 sec Running org.apache.hadoop.hbase.coprocessor.TestRowProcessorEndpoint Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.658 sec Running org.apache.hadoop.hbase.coprocessor.TestWALObserver Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.289 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterObserver Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.932 sec Running org.apache.hadoop.hbase.coprocessor.TestCoprocessorEndpoint Tests run: 3, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 33.237 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.027 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.786 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverBypass Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.247 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverInterface Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.867 sec Running org.apache.hadoop.hbase.TestGlobalMemStoreSize Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.86 sec Running org.apache.hadoop.hbase.mapred.TestTableInputFormat Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.699 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLogSplit Running org.apache.hadoop.hbase.mapreduce.TestHLogRecordReader Tests run: 30, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 240.754 sec Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.841 sec Running org.apache.hadoop.hbase.mapred.TestTableMapReduce Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 105.731 sec Running
Build failed in Jenkins: HBase-0.94 #198
See https://builds.apache.org/job/HBase-0.94/198/changes Changes: [apurtell] HBASE-6023. Normalize security audit logging level with Hadoop [tedyu] HBASE-5927 SSH and DisableTableHandler happening together does not clear the znode of the region and RIT map (Rajesh) [apurtell] HBASE-6021. NullPointerException when running LoadTestTool without specifying compression type [apurtell] HBASE-6011. Unable to start master in local mode -- [...truncated 569 lines...] Running org.apache.hadoop.hbase.TestClusterBootOrder Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.067 sec Running org.apache.hadoop.hbase.master.TestDistributedLogSplitting Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 94.324 sec Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditor Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.63 sec Running org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFiles Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.132 sec Running org.apache.hadoop.hbase.catalog.TestCatalogTrackerOnCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 77.242 sec Running org.apache.hadoop.hbase.mapreduce.TestImportExport Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 46.535 sec Running org.apache.hadoop.hbase.mapreduce.TestWALPlayer Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 45.917 sec Running org.apache.hadoop.hbase.mapreduce.TestTimeRangeMapRed Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.665 sec Running org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 103.689 sec Running org.apache.hadoop.hbase.mapreduce.TestMultithreadedTableMapper Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 113.593 sec Running org.apache.hadoop.hbase.mapreduce.TestTableMapReduce Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 117.146 sec Running org.apache.hadoop.hbase.mapreduce.TestHLogRecordReader Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.853 sec Running org.apache.hadoop.hbase.mapreduce.TestImportTsv Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 138.9 sec Running org.apache.hadoop.hbase.regionserver.TestStore Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.182 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLogBench Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.237 sec Running org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster Tests run: 6, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 44.379 sec FAILURE! Running org.apache.hadoop.hbase.regionserver.wal.TestHLog Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 60.281 sec Running org.apache.hadoop.hbase.regionserver.wal.TestLogRollingNoCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.5 sec Running org.apache.hadoop.hbase.regionserver.wal.TestLogRollAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 156.102 sec Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplay Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.644 sec Running org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 286.184 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLogSplit Tests run: 30, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 242.313 sec Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplayCompressed Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.658 sec Running org.apache.hadoop.hbase.regionserver.TestRegionServerMetrics Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 55.478 sec Running org.apache.hadoop.hbase.regionserver.TestAtomicOperation Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.348 sec Running org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 550.042 sec Running org.apache.hadoop.hbase.regionserver.TestFSErrorsExposed Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.997 sec Running org.apache.hadoop.hbase.regionserver.TestServerCustomProtocol Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.871 sec Running org.apache.hadoop.hbase.regionserver.TestParallelPut Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.077 sec Running org.apache.hadoop.hbase.regionserver.TestRpcMetrics Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.005 sec Running org.apache.hadoop.hbase.regionserver.handler.TestCloseRegionHandler Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.997 sec Running org.apache.hadoop.hbase.regionserver.TestSeekOptimizations Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.509
Re: understanding the code base, patterns, threading, etc.
I'd also recommend Lars George's excellent HBase The Definitive Guide. It will give you a good conceptual foundation and an understanding of how the API works. Then when you are tracing code paths in the internals that act in service to the API, they will make more sense. On Thu, May 17, 2012 at 4:45 PM, S Ahmed sahmed1...@gmail.com wrote: I was afraid you were going to say that :) Looking forward to the vidoes! On Thu, May 17, 2012 at 9:44 AM, Ian Varley ivar...@salesforce.com wrote: Well, the first answer is always the same: read the code! :) Of course, sometimes it's difficult to get the high level concepts quickly that way (even with good docs, like the HBase code generally has). So I'd recommend seeing the upcoming talk by committer Lars Hofhansl at HBaseCon on Tuesday--that's exactly what it's about! It's called HBase Internals. If you're not attending, I'm sure they'll post slides (and maybe video?) afterwards. Ian On May 17, 2012, at 8:39 AM, S Ahmed wrote: Greetings, Other than reading the the source code, google papers, seda, etc. how does someone get solid understanding of the code base? Are there any high-level (or low level!) diagrams of sort that go over the various components of hbase? (various read/write stages, gossip, etc.) I'm guessing this is wishful thinking but I thought I'd ask :) -- Best regards, - Andy Problems worthy of attack prove their worth by hitting back. - Piet Hein (via Tom White)
Build failed in Jenkins: HBase-TRUNK-on-Hadoop-2.0.0 #8
See https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/8/changes Changes: [apurtell] HBASE-6023. Normalize security audit logging level with Hadoop [tedyu] HBASE-5927 SSH and DisableTableHandler happening together does not clear the znode of the region and RIT map (Rajesh) [apurtell] HBASE-6021. NullPointerException when running LoadTestTool without specifying compression type [apurtell] HBASE-6011. Unable to start master in local mode [jmhsieh] HBASE-6018 hbck fails with a RejectedExecutionException when 50 regions present [liyin] Add Liyin Tang to the developer list [stack] HBASE-6034 Upgrade Hadoop dependencies [stack] HBASE-6022 Include Junit in the libs when packaging so that TestAcidGaurntee can run [stack] Added a bit of doc on how to use mvn to publish the site [stack] HBASE-6005 Addendum... fixing release links [stack] HBASE-5802 Change the default metrics class to NullContextWithUpdateThread [apurtell] HBASE-6010. Security audit logger configuration for log4j [apurtell] HBASE-6004. Adding more logging to help debugging MR job (Jimmy Xiang) [stack] HBASE-6005 Broken Links on Homepages [apurtell] HBASE-6001. Upgrade slf4j to 1.6.1 [tedyu] HBASE-6029 HBCK doesn't recover Balance switch if exception occurs in onlineHbck() (Maryann) [tedyu] HBASE-5826 Revert, Todd has review comments pending. [tedyu] HBASE-5826 Improve sync of HLog edits (Todd) -- [...truncated 9150 lines...] Running org.apache.hadoop.hbase.filter.TestColumnRangeFilter Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.958 sec Running org.apache.hadoop.hbase.regionserver.TestHRegionServerBulkLoad Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 45.521 sec Running org.apache.hadoop.hbase.coprocessor.TestClassLoading Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.445 sec Running org.apache.hadoop.hbase.coprocessor.TestAggregateProtocol Tests run: 45, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.604 sec Running org.apache.hadoop.hbase.regionserver.wal.TestLogRolling Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 82.28 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.272 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.782 sec Running org.apache.hadoop.hbase.coprocessor.TestRowProcessorEndpoint Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.326 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterObserver Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.207 sec Running org.apache.hadoop.hbase.coprocessor.TestWALObserver Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.713 sec Running org.apache.hadoop.hbase.coprocessor.TestCoprocessorEndpoint Tests run: 3, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 26.598 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.504 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.785 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverBypass Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.736 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverInterface Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.931 sec Running org.apache.hadoop.hbase.TestGlobalMemStoreSize Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.826 sec Running org.apache.hadoop.hbase.mapred.TestTableInputFormat Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.276 sec Running org.apache.hadoop.hbase.mapreduce.TestHLogRecordReader Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.078 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLogSplit Tests run: 30, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 201.156 sec Running org.apache.hadoop.hbase.mapred.TestTableMapReduce Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 101.123 sec Running org.apache.hadoop.hbase.mapreduce.TestTableMapReduce Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 82.082 sec FAILURE! Running org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 75.283 sec Running org.apache.hadoop.hbase.mapreduce.TestWALPlayer Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 40.868 sec FAILURE! org.apache.maven.surefire.booter.SurefireBooterForkException: Error occurred in starting fork, check output in log at
Build failed in Jenkins: HBase-TRUNK #2897
See https://builds.apache.org/job/HBase-TRUNK/2897/changes Changes: [jmhsieh] HBASE-6013 Polish sharp edges from CopyTable -- [...truncated 8522 lines...] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 47.034 sec Running org.apache.hadoop.hbase.mapreduce.TestMultithreadedTableMapper Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 112.423 sec Running org.apache.hadoop.hbase.mapreduce.TestTableMapReduce Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 112.308 sec Running org.apache.hadoop.hbase.mapreduce.TestHLogRecordReader Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.967 sec Running org.apache.hadoop.hbase.mapreduce.TestImportTsv Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 135.7 sec Running org.apache.hadoop.hbase.regionserver.TestStore Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.28 sec Running org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster Tests run: 6, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 41.576 sec FAILURE! Running org.apache.hadoop.hbase.regionserver.wal.TestHLog Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 64.194 sec Running org.apache.hadoop.hbase.regionserver.wal.TestLogRollingNoCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.418 sec Running org.apache.hadoop.hbase.regionserver.wal.TestLogRollAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 157.245 sec Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplay Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.526 sec Running org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 286.451 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLogSplit Tests run: 30, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 244.38 sec Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplayCompressed Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.768 sec Running org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 485.294 sec Running org.apache.hadoop.hbase.regionserver.TestRegionServerMetrics Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 66.634 sec Running org.apache.hadoop.hbase.regionserver.TestMXBean Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.553 sec Running org.apache.hadoop.hbase.regionserver.TestRSKilledWhenMasterInitializing Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 60.477 sec Running org.apache.hadoop.hbase.regionserver.TestAtomicOperation Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.633 sec Running org.apache.hadoop.hbase.regionserver.TestHRegionOnCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.6 sec Running org.apache.hadoop.hbase.regionserver.TestFSErrorsExposed Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 32.769 sec Running org.apache.hadoop.hbase.regionserver.TestParallelPut Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.195 sec Running org.apache.hadoop.hbase.regionserver.TestRpcMetrics Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.94 sec Running org.apache.hadoop.hbase.regionserver.handler.TestCloseRegionHandler Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.135 sec Running org.apache.hadoop.hbase.regionserver.TestSeekOptimizations Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.409 sec Running org.apache.hadoop.hbase.regionserver.handler.TestOpenRegionHandler Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.964 sec Running org.apache.hadoop.hbase.regionserver.TestBlocksRead Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.825 sec Running org.apache.hadoop.hbase.regionserver.TestStoreScanner Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.045 sec Running org.apache.hadoop.hbase.regionserver.TestSplitLogWorker Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.131 sec Running org.apache.hadoop.hbase.regionserver.TestServerCustomProtocol Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.592 sec Running org.apache.hadoop.hbase.regionserver.metrics.TestSchemaMetrics Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.244 sec Running org.apache.hadoop.hbase.regionserver.wal.TestLogRolling Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 240.231 sec Running org.apache.hadoop.hbase.regionserver.TestStoreFileBlockCacheSummary Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.404 sec Running org.apache.hadoop.hbase.regionserver.TestMasterAddressManager Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.612 sec Running
RE: Please welcome our newest committer and PMC member, Liyin Tang
Congratulations Liyin! -Original Message- From: saint@gmail.com [mailto:saint@gmail.com] On Behalf Of Stack Sent: Thursday, May 17, 2012 12:04 PM To: HBase Dev List Subject: Please welcome our newest committer and PMC member, Liyin Tang One of us Liyin! Keep up the great work. Add yourself to the pom.xml team section (Don't break the build!). St.Ack
Build failed in Jenkins: HBase-0.94 #199
See https://builds.apache.org/job/HBase-0.94/199/changes Changes: [jmhsieh] BASE-6013 Polish sharp edges from CopyTable [tedyu] HBASE-5342 Grant/Revoke global permissions (Matteo) -- [...truncated 573 lines...] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.912 sec Running org.apache.hadoop.hbase.catalog.TestCatalogTracker Tests run: 9, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 6.177 sec Running org.apache.hadoop.hbase.TestClusterBootOrder Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.581 sec Running org.apache.hadoop.hbase.master.TestDistributedLogSplitting Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 103.529 sec Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditor Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.546 sec Running org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFiles Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.975 sec Running org.apache.hadoop.hbase.catalog.TestCatalogTrackerOnCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 77.747 sec Running org.apache.hadoop.hbase.mapreduce.TestImportExport Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 47.716 sec Running org.apache.hadoop.hbase.mapreduce.TestWALPlayer Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 46.733 sec Running org.apache.hadoop.hbase.mapreduce.TestTimeRangeMapRed Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 40.933 sec Running org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 103.187 sec Running org.apache.hadoop.hbase.mapreduce.TestMultithreadedTableMapper Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 115.373 sec Running org.apache.hadoop.hbase.mapreduce.TestTableMapReduce Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 115.468 sec Running org.apache.hadoop.hbase.mapreduce.TestHLogRecordReader Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.361 sec Running org.apache.hadoop.hbase.mapreduce.TestImportTsv Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 131.553 sec Running org.apache.hadoop.hbase.regionserver.TestStore Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.272 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLogBench Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.189 sec Running org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster Tests run: 6, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 41.977 sec FAILURE! Running org.apache.hadoop.hbase.regionserver.wal.TestHLog Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 60.522 sec Running org.apache.hadoop.hbase.regionserver.wal.TestLogRollingNoCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.099 sec Running org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 210.26 sec Running org.apache.hadoop.hbase.regionserver.wal.TestLogRollAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 151.705 sec Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplay Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.364 sec Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplayCompressed Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.101 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLogSplit Tests run: 30, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 243.995 sec Running org.apache.hadoop.hbase.regionserver.TestRegionServerMetrics Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 56.182 sec Running org.apache.hadoop.hbase.regionserver.TestAtomicOperation Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.126 sec Running org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 556.596 sec Running org.apache.hadoop.hbase.regionserver.TestFSErrorsExposed Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.817 sec Running org.apache.hadoop.hbase.regionserver.TestParallelPut Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.197 sec Running org.apache.hadoop.hbase.regionserver.TestRpcMetrics Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.797 sec Running org.apache.hadoop.hbase.regionserver.TestHRegionOnCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.971 sec Running org.apache.hadoop.hbase.regionserver.handler.TestCloseRegionHandler Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.078 sec Running org.apache.hadoop.hbase.regionserver.handler.TestOpenRegionHandler Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.956 sec Running
Build failed in Jenkins: HBase-0.92 #410
See https://builds.apache.org/job/HBase-0.92/410/changes Changes: [apurtell] HBASE-6023. Normalize security audit logging level with Hadoop [apurtell] HBASE-6021. NullPointerException when running LoadTestTool without specifying compression type [apurtell] HBASE-6011. Unable to start master in local mode [apurtell] HBASE-5124. Backport LoadTestTool to 0.92 [jmhsieh] HBASE-6018 hbck fails with a RejectedExecutionException when 50 regions present -- [...truncated 1813 lines...] Running org.apache.hadoop.hbase.metrics.TestExactCounterMetric Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.102 sec Running org.apache.hadoop.hbase.metrics.TestMetricsMBeanBase Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.13 sec Running org.apache.hadoop.hbase.TestGlobalMemStoreSize Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.81 sec Running org.apache.hadoop.hbase.TestZooKeeper Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 86.18 sec Running org.apache.hadoop.hbase.replication.TestReplicationZookeeper Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.636 sec Running org.apache.hadoop.hbase.replication.TestMasterReplication Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 91.018 sec Running org.apache.hadoop.hbase.replication.TestReplicationSource Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.228 sec Running org.apache.hadoop.hbase.replication.TestReplication Tests run: 8, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 114.892 sec FAILURE! Running org.apache.hadoop.hbase.replication.TestReplicationPeer Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.624 sec Running org.apache.hadoop.hbase.replication.regionserver.TestReplicationSink Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.926 sec Running org.apache.hadoop.hbase.replication.regionserver.TestReplicationSourceManager Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.994 sec Running org.apache.hadoop.hbase.replication.TestMultiSlaveReplication Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 55.201 sec Running org.apache.hadoop.hbase.TestHBaseTestingUtility Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 96.741 sec Running org.apache.hadoop.hbase.TestMultiVersions Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.75 sec Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditorNoCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.13 sec Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditor Running org.apache.hadoop.hbase.catalog.TestCatalogTracker Tests run: 9, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 3.496 sec Running org.apache.hadoop.hbase.catalog.TestCatalogTrackerOnCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 147.541 sec Running org.apache.hadoop.hbase.coprocessor.TestAggregateProtocol Tests run: 44, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.26 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterObserver Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.362 sec Running org.apache.hadoop.hbase.coprocessor.TestCoprocessorEndpoint Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.208 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverStacking Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.747 sec Running org.apache.hadoop.hbase.coprocessor.TestClassLoading Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.962 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverInterface Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 32.353 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.947 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.392 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.467 sec Running org.apache.hadoop.hbase.coprocessor.TestWALObserver Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.494 sec Running org.apache.hadoop.hbase.coprocessor.TestCoprocessorInterface Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.913 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.677 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverBypass Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.544 sec Running org.apache.hadoop.hbase.TestCompare Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.234 sec
Build failed in Jenkins: HBase-0.92-security #107
See https://builds.apache.org/job/HBase-0.92-security/107/changes Changes: [tedyu] HBASE-5342 Grant/Revoke global permissions (Matteo) [apurtell] HBASE-6023. Normalize security audit logging level with Hadoop [apurtell] HBASE-6021. NullPointerException when running LoadTestTool without specifying compression type [apurtell] HBASE-6011. Unable to start master in local mode [apurtell] HBASE-5124. Backport LoadTestTool to 0.92 [jmhsieh] HBASE-6018 hbck fails with a RejectedExecutionException when 50 regions present [stack] HBASE-6034 Upgrade Hadoop dependencies [stack] HBASE-6034 Upgrade Hadoop dependencies [apurtell] HBASE-6001. Upgrade slf4j to 1.6.1 (update CHANGES.txt) [apurtell] HBASE-6001. Upgrade slf4j to 1.6.1 [stack] Setting version at 0.92.2 so can start cutting RCs using jenkins builds [ramkrishna] HBASE-5806 Handle split region related failures on master restart and RS restart(Chinna rao) [stack] HBASE-5922 HalfStoreFileReader seekBefore causes StackOverflowError [todd] HBASE-5973. Add ability for potentially long-running IPC calls to abort if client disconnects. Contributed by Todd Lipcon. [stack] HBASE-5942 HConnnectionManager.getRegionServerWithRetries doesn't call afterCall properly [tedyu] HBASE-5894 Table deletion failed but HBaseAdmin#deletetable reports it as success (Xufeng) -- [...truncated 7210 lines...] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.147 sec Forking command line: /bin/sh -c cd https://builds.apache.org/job/HBase-0.92-security/ws/trunk /home/jenkins/tools/java/jdk1.6.0_27-32/jre/bin/java -enableassertions -Xmx1400m -Djava.security.egd=file:/dev/./urandom -jar https://builds.apache.org/job/HBase-0.92-security/ws/trunk/target/surefire/surefirebooter277555846566120.jar https://builds.apache.org/job/HBase-0.92-security/ws/trunk/target/surefire/surefire4500130711920716336tmp https://builds.apache.org/job/HBase-0.92-security/ws/trunk/target/surefire/surefire4770905737335426367tmp Running org.apache.hadoop.hbase.io.hfile.slab.TestSlabCache Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.61 sec Forking command line: /bin/sh -c cd https://builds.apache.org/job/HBase-0.92-security/ws/trunk /home/jenkins/tools/java/jdk1.6.0_27-32/jre/bin/java -enableassertions -Xmx1400m -Djava.security.egd=file:/dev/./urandom -jar https://builds.apache.org/job/HBase-0.92-security/ws/trunk/target/surefire/surefirebooter17295599464707536.jar https://builds.apache.org/job/HBase-0.92-security/ws/trunk/target/surefire/surefire6948157122022325405tmp https://builds.apache.org/job/HBase-0.92-security/ws/trunk/target/surefire/surefire2498558375700690266tmp Running org.apache.hadoop.hbase.io.hfile.slab.TestSingleSizeCache Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.461 sec Forking command line: /bin/sh -c cd https://builds.apache.org/job/HBase-0.92-security/ws/trunk /home/jenkins/tools/java/jdk1.6.0_27-32/jre/bin/java -enableassertions -Xmx1400m -Djava.security.egd=file:/dev/./urandom -jar https://builds.apache.org/job/HBase-0.92-security/ws/trunk/target/surefire/surefirebooter3896227745082102071.jar https://builds.apache.org/job/HBase-0.92-security/ws/trunk/target/surefire/surefire3263654218367113441tmp https://builds.apache.org/job/HBase-0.92-security/ws/trunk/target/surefire/surefire704799610943088tmp Running org.apache.hadoop.hbase.io.hfile.TestCachedBlockQueue Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.105 sec Forking command line: /bin/sh -c cd https://builds.apache.org/job/HBase-0.92-security/ws/trunk /home/jenkins/tools/java/jdk1.6.0_27-32/jre/bin/java -enableassertions -Xmx1400m -Djava.security.egd=file:/dev/./urandom -jar https://builds.apache.org/job/HBase-0.92-security/ws/trunk/target/surefire/surefirebooter2988977492032879371.jar https://builds.apache.org/job/HBase-0.92-security/ws/trunk/target/surefire/surefire7224249680785271905tmp https://builds.apache.org/job/HBase-0.92-security/ws/trunk/target/surefire/surefire7292136820296379783tmp Running org.apache.hadoop.hbase.io.hfile.TestHFileBlockIndex Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.87 sec Forking command line: /bin/sh -c cd https://builds.apache.org/job/HBase-0.92-security/ws/trunk /home/jenkins/tools/java/jdk1.6.0_27-32/jre/bin/java -enableassertions -Xmx1400m -Djava.security.egd=file:/dev/./urandom -jar https://builds.apache.org/job/HBase-0.92-security/ws/trunk/target/surefire/surefirebooter6788819364324155081.jar https://builds.apache.org/job/HBase-0.92-security/ws/trunk/target/surefire/surefire8481368018329715092tmp https://builds.apache.org/job/HBase-0.92-security/ws/trunk/target/surefire/surefire3997045606050412525tmp Running org.apache.hadoop.hbase.io.hfile.TestLruBlockCache Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.344 sec Forking command line: /bin/sh -c cd
Build failed in Jenkins: HBase-0.92 #411
See https://builds.apache.org/job/HBase-0.92/411/changes Changes: [jmhsieh] HBASE-6013 Polish sharp edges from CopyTable [tedyu] HBASE-5342 Grant/Revoke global permissions (Matteo) -- [...truncated 1827 lines...] Running org.apache.hadoop.hbase.metrics.TestMetricsHistogram Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.165 sec Running org.apache.hadoop.hbase.metrics.TestExponentiallyDecayingSample Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.153 sec Running org.apache.hadoop.hbase.metrics.TestExactCounterMetric Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.104 sec Running org.apache.hadoop.hbase.metrics.TestMetricsMBeanBase Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.131 sec Running org.apache.hadoop.hbase.TestGlobalMemStoreSize Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.253 sec Running org.apache.hadoop.hbase.TestZooKeeper Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 87.42 sec Running org.apache.hadoop.hbase.replication.TestReplicationZookeeper Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.693 sec Running org.apache.hadoop.hbase.replication.TestMasterReplication Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 110.237 sec Running org.apache.hadoop.hbase.replication.TestReplicationSource Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.593 sec Running org.apache.hadoop.hbase.replication.TestReplication Tests run: 8, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 98.59 sec FAILURE! Running org.apache.hadoop.hbase.replication.TestReplicationPeer Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.669 sec Running org.apache.hadoop.hbase.replication.regionserver.TestReplicationSink Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.176 sec Running org.apache.hadoop.hbase.replication.regionserver.TestReplicationSourceManager Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.008 sec Running org.apache.hadoop.hbase.replication.TestMultiSlaveReplication Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 57.094 sec Running org.apache.hadoop.hbase.TestHBaseTestingUtility Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 99.287 sec Running org.apache.hadoop.hbase.TestMultiVersions Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.949 sec Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditorNoCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.163 sec Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditor Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.949 sec Running org.apache.hadoop.hbase.catalog.TestCatalogTracker Tests run: 9, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 3.49 sec Running org.apache.hadoop.hbase.catalog.TestCatalogTrackerOnCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 147.787 sec Running org.apache.hadoop.hbase.coprocessor.TestAggregateProtocol Tests run: 44, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.248 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterObserver Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.965 sec Running org.apache.hadoop.hbase.coprocessor.TestCoprocessorEndpoint Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.437 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverStacking Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.753 sec Running org.apache.hadoop.hbase.coprocessor.TestClassLoading Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.74 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverInterface Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.408 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.183 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.841 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.246 sec Running org.apache.hadoop.hbase.coprocessor.TestWALObserver Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.972 sec Running org.apache.hadoop.hbase.coprocessor.TestCoprocessorInterface Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.916 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.431 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverBypass Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.499 sec Running
test failure after upgrading to hadoop 1.0.3 Was: ClassNotFoundException: org.apache.commons.io.FileUtils
See the following. -- Forwarded message -- From: Ted Yu yuzhih...@gmail.com Date: Thu, May 17, 2012 at 9:37 PM Subject: Re: ClassNotFoundException: org.apache.commons.io.FileUtils To: mapreduce-...@hadoop.apache.org I changed hadoop version to 1.0.2 and the test passed. I would tend to say 1.0.3 had a regression in this regard. Cheers On Thu, May 17, 2012 at 8:11 PM, Ted Yu yuzhih...@gmail.com wrote: Correction to my first email: I refreshed my HBase 0.92 workspace and I could see the same test failure. Under ~/.m2/repository/org/apache/commons/commons-io, I still see 1.3.2 I ran 'mvn dependency:tree' under 0.92 and don't see commons-io in the output. Do we need to include commons-io explicitly in our pom.xml ? For Todd's question: LM-SJN-00713032:205-hadoop zhihyu$ svn info Path: . URL: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1 Repository Root: https://svn.apache.org/repos/asf Repository UUID: 13f79535-47bb-0310-9956-ffa450edef68 Revision: 1339961 Node Kind: directory Schedule: normal Last Changed Author: mattf Last Changed Rev: 1339945 Last Changed Date: 2012-05-17 18:25:57 -0700 (Thu, 17 May 2012) The line I referenced in my first email came from ivy/libraries.properties On Thu, May 17, 2012 at 8:06 PM, Todd Lipcon t...@cloudera.com wrote: I believe we upgraded to commons-io 3.0 in 1.0.3. Did you check the 1.0.3 pom? -Todd On Thu, May 17, 2012 at 8:01 PM, Ted Yu yuzhih...@gmail.com wrote: Hi, HBase 0.92 upgraded hadoop to 1.0.3 today. We started seeing some test failures which we didn't see before. e.g.: https://builds.apache.org/view/G-L/view/HBase/job/HBase-0.92/410/testReport/org.apache.hadoop.hbase.mapred/TestTableMapReduce/testMultiRegionTable/ Here is the interesting part: Caused by: java.lang.ClassNotFoundException: org.apache.commons.io.FileUtils at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) ... 15 more In hadoop 1.0, I see: commons-io.version=2.1 HBase doesn't specify commons-io version. When I run the same test on MacBook, I don't see the test fail. commons-io in local mvn repo is 1.3.2 If someone can give me hint on why the unit test failed, that would be great. -- Todd Lipcon Software Engineer, Cloudera
