Yes, I've run through TestLogRolling at least 40 times locally and haven't been able to trigger it! Somehow Jenkins always seems to find those rare conditions though.
For HBASE-4252, if the issue is the log writer rolling being skipped because numEntries == 0 (?), then try using log.rollWriter(true). This adds a "force" parameter to allow the roll to continue (part of the HBASE-4222 change). I can't tell if that will fix the issue since I'm having a hard time reproducing it, but maybe it will work for you. 2011/8/26 bijieshan <[email protected]> > Yes, this's the same problem, about how it happens, I described it in the > issue of HBASE-4252. I'll submit the patch sooner. > For it can't be reproduced easily, I'm taking more tests use varied env. > > -----邮件原件----- > 发件人: Gary Helmling [mailto:[email protected]] > 发送时间: 2011年8月27日 2:12 > 收件人: [email protected] > 主题: Re: Build failed in Jenkins: hbase-0.90 #276 > > This looks like the intermittent failure described in HBASE-4252. Possibly > some of the tweaks I made to try to speed this beast up made it worse? > > I'm continuing to test and seeing if I can reproduce it locally. > > > On Fri, Aug 26, 2011 at 7:22 AM, Apache Jenkins Server < > [email protected]> wrote: > > > See <https://builds.apache.org/job/hbase-0.90/276/changes> > > > > Changes: > > > > [garyh] Amend HBASE-4222 Fix test failure due to region balancing while > > running > > > > ------------------------------------------ > > [...truncated 1183 lines...] > > Running org.apache.hadoop.hbase.mapreduce.TestTimeRangeMapRed > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.928 > sec > > Running org.apache.hadoop.hbase.zookeeper.TestZooKeeperMainServerArg > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.027 sec > > Running org.apache.hadoop.hbase.mapreduce.TestSimpleTotalOrderPartitioner > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.084 sec > > Running org.apache.hadoop.hbase.master.TestClockSkewDetection > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.236 sec > > Running org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat > > Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 137.712 > sec > > Running > org.apache.hadoop.hbase.master.TestMasterRestartAfterDisablingTable > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.68 sec > > Running org.apache.hadoop.hbase.regionserver.TestFSErrorsExposed > > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.315 > sec > > Running org.apache.hadoop.hbase.client.replication.TestReplicationAdmin > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.442 sec > > Running org.apache.hadoop.hbase.regionserver.TestScanDeleteTracker > > Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.113 sec > > Running org.apache.hadoop.hbase.client.TestMetaScanner > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 40.149 > sec > > Running org.apache.hadoop.hbase.metrics.TestMetricsMBeanBase > > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.032 sec > > Running org.apache.hadoop.hbase.TestRegionRebalancing > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 111.672 > sec > > Running org.apache.hadoop.hbase.filter.TestSingleColumnValueExcludeFilter > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec > > Running org.apache.hadoop.hbase.filter.TestInclusiveStopFilter > > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec > > Running org.apache.hadoop.hbase.rest.TestTableResource > > Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 76.845 > sec > > Running org.apache.hadoop.hbase.mapreduce.TestTableSplit > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec > > Running org.apache.hadoop.hbase.TestHBaseTestingUtility > > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 78.422 > sec > > Running org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFiles > > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.948 > sec > > Running org.apache.hadoop.hbase.rest.TestSchemaResource > > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.688 > sec > > Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplay > > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.563 > sec > > Running org.apache.hadoop.hbase.regionserver.TestKeyValueScanFixture > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.015 sec > > Running org.apache.hadoop.hbase.rest.model.TestTableListModel > > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.125 sec > > Running org.apache.hadoop.hbase.rest.model.TestColumnSchemaModel > > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.03 sec > > Running org.apache.hadoop.hbase.regionserver.TestStoreFile > > Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 51.116 > sec > > Running org.apache.hadoop.hbase.zookeeper.TestZooKeeperNodeTracker > > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.375 sec > > Running org.apache.hadoop.hbase.regionserver.wal.TestHLogMethods > > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.421 sec > > Running org.apache.hadoop.hbase.rest.model.TestScannerModel > > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.127 sec > > Running org.apache.hadoop.hbase.rest.TestVersionResource > > Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.247 > sec > > Running org.apache.hadoop.hbase.filter.TestFilter > > Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.194 > sec > > Running org.apache.hadoop.hbase.regionserver.TestWideScanner > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.675 > sec > > Running org.apache.hadoop.hbase.regionserver.TestSplitTransaction > > Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.339 sec > > Running > > org.apache.hadoop.hbase.replication.regionserver.TestReplicationSink > > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.055 > sec > > Running org.apache.hadoop.hbase.regionserver.TestGetClosestAtOrBefore > > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.744 > sec > > Running > > org.apache.hadoop.hbase.regionserver.TestReadWriteConsistencyControl > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.02 sec > > Running org.apache.hadoop.hbase.util.TestMergeTable > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 63.632 > sec > > Running org.apache.hadoop.hbase.rest.model.TestVersionModel > > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.126 sec > > Running org.apache.hadoop.hbase.rest.model.TestCellSetModel > > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.136 sec > > Running org.apache.hadoop.hbase.rest.client.TestRemoteTable > > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.571 > sec > > Running org.apache.hadoop.hbase.rest.model.TestStorageClusterStatusModel > > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.132 sec > > Running org.apache.hadoop.hbase.avro.TestAvroServer > > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 52.034 > sec > > Running org.apache.hadoop.hbase.TestFullLogReconstruction > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 58.253 > sec > > Running org.apache.hadoop.hbase.TestSerialization > > Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.06 sec > > Running org.apache.hadoop.hbase.regionserver.TestKeyValueHeap > > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.091 sec > > Running org.apache.hadoop.hbase.regionserver.TestStoreScanner > > Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.031 > sec > > Running org.apache.hadoop.hbase.TestHMsg > > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.022 sec > > Running org.apache.hadoop.hbase.io.hfile.TestReseekTo > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.21 sec > > Running org.apache.hadoop.hbase.regionserver.TestHRegionInfo > > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.018 sec > > Running org.apache.hadoop.hbase.util.TestIncrementingEnvironmentEdge > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec > > Running org.apache.hadoop.hbase.util.TestKeying > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec > > Running org.apache.hadoop.hbase.regionserver.TestScanner > > Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 64.207 > sec > > Running org.apache.hadoop.hbase.util.TestHBaseFsck > > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.126 > sec > > Running org.apache.hadoop.hbase.master.TestRestartCluster > > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 47.864 > sec > > Running org.apache.hadoop.hbase.client.TestShell > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 276.195 > sec > > Running org.apache.hadoop.hbase.rest.model.TestTableInfoModel > > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.132 sec > > Running org.apache.hadoop.hbase.TestInfoServers > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.509 > sec > > Running org.apache.hadoop.hbase.master.TestLogsCleaner > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.148 sec > > Running org.apache.hadoop.hbase.regionserver.TestMasterAddressManager > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.299 sec > > Running org.apache.hadoop.hbase.catalog.TestCatalogTrackerOnCluster > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 161.321 > sec > > Running org.apache.hadoop.hbase.regionserver.TestQueryMatcher > > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.101 sec > > Running org.apache.hadoop.hbase.zookeeper.TestZKTable > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.283 sec > > Running org.apache.hadoop.hbase.client.TestAdmin > > Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 249.584 > > sec > > Running org.apache.hadoop.hbase.regionserver.TestPriorityCompactionQueue > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.075 sec > > Running org.apache.hadoop.hbase.util.TestMergeTool > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.713 > sec > > Running org.apache.hadoop.hbase.TestAcidGuarantees > > Tests run: 3, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 0.015 sec > > Running org.apache.hadoop.hbase.util.TestBase64 > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.017 sec > > Running org.apache.hadoop.hbase.regionserver.TestMemStore > > Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 47.804 > sec > > Running org.apache.hadoop.hbase.rest.TestScannerResource > > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 44.528 > sec > > Running org.apache.hadoop.hbase.io.hfile.TestLruBlockCache > > Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.055 sec > > Running org.apache.hadoop.hbase.master.TestDeadServer > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.019 sec > > Running org.apache.hadoop.hbase.rest.TestGzipFilter > > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 42.82 sec > > Running org.apache.hadoop.hbase.mapreduce.TestTableMapReduce > > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 102.903 > sec > > Running org.apache.hadoop.hbase.TestKeyValue > > Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.025 sec > > Running org.apache.hadoop.hbase.client.TestMultiParallel > > Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.131 > sec > > Running org.apache.hadoop.hbase.master.TestMaster > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 92.349 > sec > > Running org.apache.hadoop.hbase.master.TestRollingRestart > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 73.521 > sec > > Running org.apache.hadoop.hbase.client.TestResult > > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.037 sec > > Running org.apache.hadoop.hbase.client.TestHTablePool > > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.712 > sec > > Running org.apache.hadoop.hbase.rest.model.TestTableSchemaModel > > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.137 sec > > Running org.apache.hadoop.hbase.util.TestByteBloomFilter > > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.554 sec > > Running org.apache.hadoop.hbase.filter.TestFilterList > > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.039 sec > > Running org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan > > Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 319.583 > > sec > > Running org.apache.hadoop.hbase.regionserver.TestHRegion > > Tests run: 54, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.798 > sec > > Running org.apache.hadoop.hbase.master.TestMasterFailover > > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 60.685 > sec > > Running org.apache.hadoop.hbase.rest.model.TestTableRegionModel > > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.032 sec > > Running org.apache.hadoop.hbase.client.TestTimestampsFilter > > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.548 > sec > > Running org.apache.hadoop.hbase.master.TestLoadBalancer > > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.234 sec > > Running org.apache.hadoop.hbase.util.TestRootPath > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.021 sec > > Running org.apache.hadoop.hbase.client.TestScannerTimeout > > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 69.024 > sec > > Running org.apache.hadoop.hbase.regionserver.wal.TestWALObserver > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.31 sec > > Running org.apache.hadoop.hbase.mapred.TestTableMapReduce > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 63.837 > sec > > Running org.apache.hadoop.hbase.master.TestActiveMasterManager > > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.389 sec > > Running > > > org.apache.hadoop.hbase.replication.regionserver.TestReplicationSourceManager > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.861 sec > > Running org.apache.hadoop.hbase.util.TestBytes > > Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.022 > sec > > Running org.apache.hadoop.hbase.util.TestCompressionTest > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.024 sec > > Running org.apache.hadoop.hbase.client.TestGetRowVersions > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.397 > sec > > Running org.apache.hadoop.hbase.filter.TestDependentColumnFilter > > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.343 sec > > Running org.apache.hadoop.hbase.rest.model.TestCellModel > > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.126 sec > > Running org.apache.hadoop.hbase.master.TestCatalogJanitor > > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.478 sec > > Running org.apache.hadoop.hbase.catalog.TestCatalogTracker > > Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.075 sec > > Running org.apache.hadoop.hbase.replication.TestReplicationSource > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.37 sec > > Running org.apache.hadoop.hbase.rest.TestRowResource > > Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 48.949 > sec > > Running org.apache.hadoop.hbase.io.hfile.TestHFile > > Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.322 sec > > Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditor > > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.939 > sec > > Running org.apache.hadoop.hbase.mapreduce.TestImportTsv > > Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.761 > sec > > Running org.apache.hadoop.hbase.rest.client.TestRemoteAdmin > > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 39.545 > sec > > Running org.apache.hadoop.hbase.regionserver.wal.TestHLog > > Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 88.553 > sec > > Running org.apache.hadoop.hbase.client.TestTimestamp > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.643 > sec > > Running org.apache.hadoop.hbase.TestScanMultipleVersions > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.656 > sec > > Running org.apache.hadoop.hbase.rest.model.TestStorageClusterVersionModel > > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.029 sec > > Running org.apache.hadoop.hbase.client.TestHCM > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.132 > sec > > > > Results : > > > > Failed tests: > > > > Tests run: 642, Failures: 1, Errors: 0, Skipped: 9 > > > > [INFO] > > ------------------------------------------------------------------------ > > [INFO] BUILD FAILURE > > [INFO] > > ------------------------------------------------------------------------ > > [INFO] Total time: 1:26:52.646s > > [INFO] Finished at: Fri Aug 26 14:21:24 UTC 2011 > > [INFO] Final Memory: 32M/401M > > [INFO] > > ------------------------------------------------------------------------ > > [ERROR] Failed to execute goal > > org.apache.maven.plugins:maven-surefire-plugin:2.4.3:test (default-test) > on > > project hbase: There are test failures. > > [ERROR] > > [ERROR] Please refer to < > > > https://builds.apache.org/job/hbase-0.90/ws/trunk/target/surefire-reports> > > for the individual test results. > > [ERROR] -> [Help 1] > > [ERROR] > > [ERROR] To see the full stack trace of the errors, re-run Maven with the > -e > > switch. > > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > > [ERROR] > > [ERROR] For more information about the errors and possible solutions, > > please read the following articles: > > [ERROR] [Help 1] > > http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException > > Build step 'Invoke top-level Maven targets' marked build as failure > > [locks-and-latches] Releasing all the locks > > [locks-and-latches] All the locks released > > Archiving artifacts > > Recording test results > > > > >
