This looks like the intermittent failure described in HBASE-4252. Possibly some of the tweaks I made to try to speed this beast up made it worse?
I'm continuing to test and seeing if I can reproduce it locally. On Fri, Aug 26, 2011 at 7:22 AM, Apache Jenkins Server < [email protected]> wrote: > See <https://builds.apache.org/job/hbase-0.90/276/changes> > > Changes: > > [garyh] Amend HBASE-4222 Fix test failure due to region balancing while > running > > ------------------------------------------ > [...truncated 1183 lines...] > Running org.apache.hadoop.hbase.mapreduce.TestTimeRangeMapRed > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.928 sec > Running org.apache.hadoop.hbase.zookeeper.TestZooKeeperMainServerArg > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.027 sec > Running org.apache.hadoop.hbase.mapreduce.TestSimpleTotalOrderPartitioner > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.084 sec > Running org.apache.hadoop.hbase.master.TestClockSkewDetection > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.236 sec > Running org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat > Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 137.712 sec > Running org.apache.hadoop.hbase.master.TestMasterRestartAfterDisablingTable > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.68 sec > Running org.apache.hadoop.hbase.regionserver.TestFSErrorsExposed > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.315 sec > Running org.apache.hadoop.hbase.client.replication.TestReplicationAdmin > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.442 sec > Running org.apache.hadoop.hbase.regionserver.TestScanDeleteTracker > Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.113 sec > Running org.apache.hadoop.hbase.client.TestMetaScanner > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 40.149 sec > Running org.apache.hadoop.hbase.metrics.TestMetricsMBeanBase > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.032 sec > Running org.apache.hadoop.hbase.TestRegionRebalancing > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 111.672 sec > Running org.apache.hadoop.hbase.filter.TestSingleColumnValueExcludeFilter > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec > Running org.apache.hadoop.hbase.filter.TestInclusiveStopFilter > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec > Running org.apache.hadoop.hbase.rest.TestTableResource > Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 76.845 sec > Running org.apache.hadoop.hbase.mapreduce.TestTableSplit > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec > Running org.apache.hadoop.hbase.TestHBaseTestingUtility > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 78.422 sec > Running org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFiles > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.948 sec > Running org.apache.hadoop.hbase.rest.TestSchemaResource > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.688 sec > Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplay > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.563 sec > Running org.apache.hadoop.hbase.regionserver.TestKeyValueScanFixture > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.015 sec > Running org.apache.hadoop.hbase.rest.model.TestTableListModel > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.125 sec > Running org.apache.hadoop.hbase.rest.model.TestColumnSchemaModel > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.03 sec > Running org.apache.hadoop.hbase.regionserver.TestStoreFile > Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 51.116 sec > Running org.apache.hadoop.hbase.zookeeper.TestZooKeeperNodeTracker > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.375 sec > Running org.apache.hadoop.hbase.regionserver.wal.TestHLogMethods > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.421 sec > Running org.apache.hadoop.hbase.rest.model.TestScannerModel > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.127 sec > Running org.apache.hadoop.hbase.rest.TestVersionResource > Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.247 sec > Running org.apache.hadoop.hbase.filter.TestFilter > Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.194 sec > Running org.apache.hadoop.hbase.regionserver.TestWideScanner > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.675 sec > Running org.apache.hadoop.hbase.regionserver.TestSplitTransaction > Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.339 sec > Running > org.apache.hadoop.hbase.replication.regionserver.TestReplicationSink > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.055 sec > Running org.apache.hadoop.hbase.regionserver.TestGetClosestAtOrBefore > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.744 sec > Running > org.apache.hadoop.hbase.regionserver.TestReadWriteConsistencyControl > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.02 sec > Running org.apache.hadoop.hbase.util.TestMergeTable > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 63.632 sec > Running org.apache.hadoop.hbase.rest.model.TestVersionModel > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.126 sec > Running org.apache.hadoop.hbase.rest.model.TestCellSetModel > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.136 sec > Running org.apache.hadoop.hbase.rest.client.TestRemoteTable > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.571 sec > Running org.apache.hadoop.hbase.rest.model.TestStorageClusterStatusModel > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.132 sec > Running org.apache.hadoop.hbase.avro.TestAvroServer > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 52.034 sec > Running org.apache.hadoop.hbase.TestFullLogReconstruction > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 58.253 sec > Running org.apache.hadoop.hbase.TestSerialization > Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.06 sec > Running org.apache.hadoop.hbase.regionserver.TestKeyValueHeap > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.091 sec > Running org.apache.hadoop.hbase.regionserver.TestStoreScanner > Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.031 sec > Running org.apache.hadoop.hbase.TestHMsg > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.022 sec > Running org.apache.hadoop.hbase.io.hfile.TestReseekTo > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.21 sec > Running org.apache.hadoop.hbase.regionserver.TestHRegionInfo > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.018 sec > Running org.apache.hadoop.hbase.util.TestIncrementingEnvironmentEdge > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec > Running org.apache.hadoop.hbase.util.TestKeying > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec > Running org.apache.hadoop.hbase.regionserver.TestScanner > Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 64.207 sec > Running org.apache.hadoop.hbase.util.TestHBaseFsck > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.126 sec > Running org.apache.hadoop.hbase.master.TestRestartCluster > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 47.864 sec > Running org.apache.hadoop.hbase.client.TestShell > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 276.195 sec > Running org.apache.hadoop.hbase.rest.model.TestTableInfoModel > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.132 sec > Running org.apache.hadoop.hbase.TestInfoServers > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.509 sec > Running org.apache.hadoop.hbase.master.TestLogsCleaner > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.148 sec > Running org.apache.hadoop.hbase.regionserver.TestMasterAddressManager > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.299 sec > Running org.apache.hadoop.hbase.catalog.TestCatalogTrackerOnCluster > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 161.321 sec > Running org.apache.hadoop.hbase.regionserver.TestQueryMatcher > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.101 sec > Running org.apache.hadoop.hbase.zookeeper.TestZKTable > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.283 sec > Running org.apache.hadoop.hbase.client.TestAdmin > Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 249.584 > sec > Running org.apache.hadoop.hbase.regionserver.TestPriorityCompactionQueue > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.075 sec > Running org.apache.hadoop.hbase.util.TestMergeTool > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.713 sec > Running org.apache.hadoop.hbase.TestAcidGuarantees > Tests run: 3, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 0.015 sec > Running org.apache.hadoop.hbase.util.TestBase64 > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.017 sec > Running org.apache.hadoop.hbase.regionserver.TestMemStore > Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 47.804 sec > Running org.apache.hadoop.hbase.rest.TestScannerResource > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 44.528 sec > Running org.apache.hadoop.hbase.io.hfile.TestLruBlockCache > Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.055 sec > Running org.apache.hadoop.hbase.master.TestDeadServer > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.019 sec > Running org.apache.hadoop.hbase.rest.TestGzipFilter > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 42.82 sec > Running org.apache.hadoop.hbase.mapreduce.TestTableMapReduce > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 102.903 sec > Running org.apache.hadoop.hbase.TestKeyValue > Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.025 sec > Running org.apache.hadoop.hbase.client.TestMultiParallel > Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.131 sec > Running org.apache.hadoop.hbase.master.TestMaster > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 92.349 sec > Running org.apache.hadoop.hbase.master.TestRollingRestart > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 73.521 sec > Running org.apache.hadoop.hbase.client.TestResult > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.037 sec > Running org.apache.hadoop.hbase.client.TestHTablePool > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.712 sec > Running org.apache.hadoop.hbase.rest.model.TestTableSchemaModel > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.137 sec > Running org.apache.hadoop.hbase.util.TestByteBloomFilter > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.554 sec > Running org.apache.hadoop.hbase.filter.TestFilterList > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.039 sec > Running org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan > Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 319.583 > sec > Running org.apache.hadoop.hbase.regionserver.TestHRegion > Tests run: 54, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.798 sec > Running org.apache.hadoop.hbase.master.TestMasterFailover > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 60.685 sec > Running org.apache.hadoop.hbase.rest.model.TestTableRegionModel > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.032 sec > Running org.apache.hadoop.hbase.client.TestTimestampsFilter > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.548 sec > Running org.apache.hadoop.hbase.master.TestLoadBalancer > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.234 sec > Running org.apache.hadoop.hbase.util.TestRootPath > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.021 sec > Running org.apache.hadoop.hbase.client.TestScannerTimeout > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 69.024 sec > Running org.apache.hadoop.hbase.regionserver.wal.TestWALObserver > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.31 sec > Running org.apache.hadoop.hbase.mapred.TestTableMapReduce > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 63.837 sec > Running org.apache.hadoop.hbase.master.TestActiveMasterManager > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.389 sec > Running > org.apache.hadoop.hbase.replication.regionserver.TestReplicationSourceManager > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.861 sec > Running org.apache.hadoop.hbase.util.TestBytes > Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.022 sec > Running org.apache.hadoop.hbase.util.TestCompressionTest > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.024 sec > Running org.apache.hadoop.hbase.client.TestGetRowVersions > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.397 sec > Running org.apache.hadoop.hbase.filter.TestDependentColumnFilter > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.343 sec > Running org.apache.hadoop.hbase.rest.model.TestCellModel > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.126 sec > Running org.apache.hadoop.hbase.master.TestCatalogJanitor > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.478 sec > Running org.apache.hadoop.hbase.catalog.TestCatalogTracker > Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.075 sec > Running org.apache.hadoop.hbase.replication.TestReplicationSource > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.37 sec > Running org.apache.hadoop.hbase.rest.TestRowResource > Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 48.949 sec > Running org.apache.hadoop.hbase.io.hfile.TestHFile > Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.322 sec > Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditor > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.939 sec > Running org.apache.hadoop.hbase.mapreduce.TestImportTsv > Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.761 sec > Running org.apache.hadoop.hbase.rest.client.TestRemoteAdmin > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 39.545 sec > Running org.apache.hadoop.hbase.regionserver.wal.TestHLog > Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 88.553 sec > Running org.apache.hadoop.hbase.client.TestTimestamp > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.643 sec > Running org.apache.hadoop.hbase.TestScanMultipleVersions > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.656 sec > Running org.apache.hadoop.hbase.rest.model.TestStorageClusterVersionModel > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.029 sec > Running org.apache.hadoop.hbase.client.TestHCM > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.132 sec > > Results : > > Failed tests: > > Tests run: 642, Failures: 1, Errors: 0, Skipped: 9 > > [INFO] > ------------------------------------------------------------------------ > [INFO] BUILD FAILURE > [INFO] > ------------------------------------------------------------------------ > [INFO] Total time: 1:26:52.646s > [INFO] Finished at: Fri Aug 26 14:21:24 UTC 2011 > [INFO] Final Memory: 32M/401M > [INFO] > ------------------------------------------------------------------------ > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-surefire-plugin:2.4.3:test (default-test) on > project hbase: There are test failures. > [ERROR] > [ERROR] Please refer to < > https://builds.apache.org/job/hbase-0.90/ws/trunk/target/surefire-reports> > for the individual test results. > [ERROR] -> [Help 1] > [ERROR] > [ERROR] To see the full stack trace of the errors, re-run Maven with the -e > switch. > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > [ERROR] > [ERROR] For more information about the errors and possible solutions, > please read the following articles: > [ERROR] [Help 1] > http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException > Build step 'Invoke top-level Maven targets' marked build as failure > [locks-and-latches] Releasing all the locks > [locks-and-latches] All the locks released > Archiving artifacts > Recording test results > >
