See <https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/5/changes>
Changes: [tedyu] HBASE-5998 Bulk assignment: regionserver optimization by using a temporary cache for table descriptors when receveing an open regions request (N Keywal) [dmeil] hbase-6003. fixed 2 links in Performance.xml that should have been going to case-studies chapter. [nspiegelberg] [HBASE-5867] Improve Compaction Throttle Default Summary: We recently had a production issue where our compactions fell behind because our compaction throttle was improperly tuned and accidentally upgraded all compactions to the large pool. The default from HBASE-3877 makes 1 bad assumption: the default number of flushed files in a compaction. MinFilesToCompact should be taken into consideration. As a default, it is less damaging for the large thread to be slightly higher than it needs to be and only get timed-majors versus having everything accidentally promoted. Test Plan: - mvn test Reviewers: JIRA, Kannan, Liyin Reviewed By: Kannan CC: stack Differential Revision: https://reviews.facebook.net/D2943 ------------------------------------------ [...truncated 13337 lines...] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.863 sec Running org.apache.hadoop.hbase.regionserver.TestHRegion Tests run: 62, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 53.336 sec Running org.apache.hadoop.hbase.regionserver.wal.TestLogRollAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.267 sec Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplay Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.737 sec Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplayCompressed Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.379 sec Running org.apache.hadoop.hbase.regionserver.TestFSErrorsExposed Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 46.041 sec Running org.apache.hadoop.hbase.regionserver.handler.TestCloseRegionHandler Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.583 sec Running org.apache.hadoop.hbase.regionserver.handler.TestOpenRegionHandler Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.566 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLog Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.338 sec Running org.apache.hadoop.hbase.filter.TestColumnRangeFilter Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.679 sec Running org.apache.hadoop.hbase.regionserver.TestHRegionServerBulkLoad Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 40.7 sec Running org.apache.hadoop.hbase.coprocessor.TestClassLoading Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.479 sec Running org.apache.hadoop.hbase.coprocessor.TestAggregateProtocol Tests run: 45, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.289 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.769 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.122 sec Running org.apache.hadoop.hbase.coprocessor.TestRowProcessorEndpoint Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.702 sec Running org.apache.hadoop.hbase.regionserver.wal.TestLogRolling Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 93.194 sec Running org.apache.hadoop.hbase.coprocessor.TestWALObserver Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.245 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterObserver Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.794 sec Running org.apache.hadoop.hbase.coprocessor.TestCoprocessorEndpoint Tests run: 3, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 25.908 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.164 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.757 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverBypass Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.808 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverInterface Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.585 sec Running org.apache.hadoop.hbase.TestGlobalMemStoreSize Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.852 sec Running org.apache.hadoop.hbase.mapred.TestTableInputFormat Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.644 sec Running org.apache.hadoop.hbase.mapreduce.TestHLogRecordReader Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.698 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLogSplit Tests run: 30, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 193.323 sec Running org.apache.hadoop.hbase.mapred.TestTableMapReduce Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 91.992 sec Running org.apache.hadoop.hbase.mapreduce.TestTableMapReduce Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 77.934 sec <<< FAILURE! Running org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 69.905 sec Running org.apache.hadoop.hbase.mapreduce.TestWALPlayer Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.794 sec Running org.apache.hadoop.hbase.mapreduce.TestMultithreadedTableMapper Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 67.925 sec <<< FAILURE! Running org.apache.hadoop.hbase.mapreduce.TestTimeRangeMapRed Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 32.391 sec Running org.apache.hadoop.hbase.mapreduce.TestImportTsv Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 145.315 sec Running org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat Tests run: 9, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 195.183 sec <<< FAILURE! Running org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFiles Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.943 sec Running org.apache.hadoop.hbase.thrift2.TestThriftHBaseServiceHandler Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.058 sec Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditorNoCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.386 sec Running org.apache.hadoop.hbase.mapreduce.TestImportExport Tests run: 2, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 43.819 sec <<< FAILURE! Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditor Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.862 sec Running org.apache.hadoop.hbase.catalog.TestCatalogTracker Tests run: 9, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 5.79 sec Running org.apache.hadoop.hbase.client.TestFromClientSide3 Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.337 sec Running org.apache.hadoop.hbase.TestAcidGuarantees Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 82.825 sec Running org.apache.hadoop.hbase.client.TestTimestampsFilter Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.102 sec Running org.apache.hadoop.hbase.catalog.TestCatalogTrackerOnCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 79.206 sec Running org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 280.044 sec Running org.apache.hadoop.hbase.client.TestHCM Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.241 sec Running org.apache.hadoop.hbase.client.TestMetaScanner Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.365 sec Running org.apache.hadoop.hbase.client.TestShell Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 65.038 sec Running org.apache.hadoop.hbase.client.TestHTableUtil Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.016 sec Running org.apache.hadoop.hbase.client.TestMetaMigrationRemovingHTD Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.761 sec Running org.apache.hadoop.hbase.client.TestScannerTimeout Running org.apache.hadoop.hbase.client.TestHTablePool$TestHTableReusablePool Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.127 sec Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.376 sec Running org.apache.hadoop.hbase.client.replication.TestReplicationAdmin Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.977 sec Running org.apache.hadoop.hbase.client.TestHTablePool$TestHTableThreadLocalPool Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.731 sec Running org.apache.hadoop.hbase.client.TestMultipleTimestamps Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.269 sec Running org.apache.hadoop.hbase.metrics.TestMetricsMBeanBase Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.126 sec Running org.apache.hadoop.hbase.client.TestMultiParallel Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.895 sec Running org.apache.hadoop.hbase.rest.TestGzipFilter Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.863 sec Running org.apache.hadoop.hbase.constraint.TestConstraint Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.46 sec Running org.apache.hadoop.hbase.rest.TestMultiRowResource Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.345 sec Running org.apache.hadoop.hbase.rest.TestScannersWithFilters Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.864 sec Running org.apache.hadoop.hbase.rest.TestRowResource Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.038 sec Running org.apache.hadoop.hbase.rest.client.TestRemoteAdmin Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.716 sec Running org.apache.hadoop.hbase.client.TestFromClientSide Tests run: 56, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 146.553 sec Running org.apache.hadoop.hbase.rest.client.TestRemoteTable Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.241 sec Running org.apache.hadoop.hbase.rest.TestVersionResource Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.483 sec Running org.apache.hadoop.hbase.rest.TestStatusResource Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.44 sec Running org.apache.hadoop.hbase.rest.TestTableResource Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.159 sec Running org.apache.hadoop.hbase.rest.TestScannerResource Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.548 sec Running org.apache.hadoop.hbase.rest.TestSchemaResource Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.797 sec Running org.apache.hadoop.hbase.io.encoding.TestLoadAndSwitchEncodeOnDisk Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.239 sec Running org.apache.hadoop.hbase.client.TestAdmin Tests run: 39, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 127.965 sec Running org.apache.hadoop.hbase.thrift.TestThriftServer Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 56.919 sec Running org.apache.hadoop.hbase.io.encoding.TestUpgradeFromHFileV1ToEncoding Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 71.267 sec Running org.apache.hadoop.hbase.io.hfile.TestHFileSeek Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.388 sec Running org.apache.hadoop.hbase.io.encoding.TestDataBlockEncoders Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 113.818 sec Running org.apache.hadoop.hbase.io.hfile.slab.TestSlabCache Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.95 sec Running org.apache.hadoop.hbase.io.hfile.TestChecksum Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.127 sec Running org.apache.hadoop.hbase.io.hfile.TestHFileBlockIndex Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.186 sec Running org.apache.hadoop.hbase.io.hfile.TestLruBlockCache Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.752 sec Running org.apache.hadoop.hbase.io.hfile.slab.TestSingleSizeCache Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.224 sec Running org.apache.hadoop.hbase.io.hfile.TestFixedFileTrailer Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.693 sec Running org.apache.hadoop.hbase.io.hfile.TestHFileBlockCompatibility Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.449 sec Running org.apache.hadoop.hbase.io.hfile.TestHFilePerformance Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.494 sec Running org.apache.hadoop.hbase.io.encoding.TestChangingEncoding Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 207.858 sec Running org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingTTL Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 61.847 sec Running org.apache.hadoop.hbase.io.hfile.TestForceCacheImportantBlocks Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 80.517 sec Running org.apache.hadoop.hbase.io.hfile.TestCacheOnWrite Tests run: 36, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 44.248 sec Running org.apache.hadoop.hbase.TestClusterBootOrder Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.156 sec Running org.apache.hadoop.hbase.io.hfile.TestHFileBlock Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 48.377 sec Running org.apache.hadoop.hbase.replication.regionserver.TestReplicationSourceManager Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.355 sec Running org.apache.hadoop.hbase.avro.TestAvroServer Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.225 sec Running org.apache.hadoop.hbase.replication.regionserver.TestReplicationSink Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.349 sec Running org.apache.hadoop.hbase.replication.TestReplicationSource Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.846 sec Running org.apache.hadoop.hbase.replication.TestReplicationPeer Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.051 sec Running org.apache.hadoop.hbase.replication.TestReplicationZookeeper Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.715 sec Running org.apache.hadoop.hbase.replication.TestMultiSlaveReplication Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 55.74 sec Running org.apache.hadoop.hbase.ipc.TestDelayedRpc Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.484 sec Running org.apache.hadoop.hbase.ipc.TestPBOnWritableRpc Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.928 sec Running org.apache.hadoop.hbase.replication.TestMasterReplication Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 40.442 sec Running org.apache.hadoop.hbase.TestZooKeeper Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.807 sec Running org.apache.hadoop.hbase.TestHBaseTestingUtility Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.662 sec Running org.apache.hadoop.hbase.thrift.TestThriftServerCmdLine Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 405.443 sec Running org.apache.hadoop.hbase.replication.TestReplication Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 112.099 sec Results : Failed tests: testMultiRegionTable(org.apache.hadoop.hbase.mapreduce.TestTableMapReduce) testMultithreadedTableMapper(org.apache.hadoop.hbase.mapreduce.TestMultithreadedTableMapper) testMRIncrementalLoad(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat) testMRIncrementalLoadWithSplit(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat) Tests in error: testSimpleCase(org.apache.hadoop.hbase.mapreduce.TestImportExport) testWithDeletes(org.apache.hadoop.hbase.mapreduce.TestImportExport) Tests run: 982, Failures: 4, Errors: 2, Skipped: 9 [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 32:00.415s [INFO] Finished at: Tue May 15 23:53:07 UTC 2012 [INFO] Final Memory: 56M/691M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12-TRUNK-HBASE-2:test (secondPartTestsExecution) on project hbase: There are test failures. [ERROR] [ERROR] Please refer to <https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/target/surefire-reports> for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException Build step 'Invoke top-level Maven targets' marked build as failure Archiving artifacts Recording test results Updating HBASE-5998 Updating HBASE-6003 Updating HBASE-3877 Updating HBASE-5867
