See <https://hudson.apache.org/hudson/job/HBase-TRUNK/1440/changes>
Changes:
[jgray] HBASE-2944 cannot alter bloomfilter setting for a column family from
hbase shell (kannan via jgray)
[stack] HBASE-2692 Master rewrite and cleanup for 0.90
Patch brought over from 0.90_master_rewrite branch.
Replication test is broke as are some of the rest tests.
Others should be passing.
Some of the changes made in this fat patch:
+ In HLogKey, we now use encoded region name instead of full region name.
+ On split, daughters are opened on the parent's regionserver; let the new
balancer
sort them out later when it cuts in.
+ Added move region from one server to another as well as enable/disable
balancer.
+ All .META. and -ROOT- edits go via new *Editor and *Reader classes -- no more
do we have 5 different ways of reading and editing .META.
+ Rather than 3 different listeners to hlog each w/ own way of listening,
instead
we only have WALObserver now.
+ New Server Interface that has whats common to HMaster and RegionServer. Also
new Services Interface. This should make test writing cleaner making it so
less need of full cluster context testing anything -- e.g. the new
Interfaces are good w/ Mockito.
+ New balacner that runs on a period and takes into consideration all load
across cluster.
+ Table online/offline is now a flag in ZK; the offline flag on a region is
just used splitting from here on out.
+ Moved fixup of failed add of daughter edits to .META. into shutdown server
recover code (It used to be in basescanner).
+ The heartbeat now sends master the regionserver load and is used sending
shutdown message from master to regionserver ONLY; all other messages are
via zk (HMsg is pretty bare now).
+ No more Worker in RS and ToDoQueue in master. Both in master and regionserver
we use handlers instead run out of Executors.
+ Client can not send split, flush, compact direct to RS; no longer does
it go via master.
+ Server shutdown runs differently now. All are watching a flag in zk.
When RS notices its gone, it closes all user-space regions. If thats all
it was carrying, then it goes down. Otherwise, waits on master to send
the shutdown msg via heartbeat.
------------------------------------------
[...truncated 792 lines...]
AU src/site/resources/images/architecture.gif
AU src/site/resources/images/hadoop-logo.jpg
AU src/site/resources/images/hbase_logo_med.gif
AU src/site/resources/images/favicon.ico
AU src/site/resources/images/hbase_small.gif
A src/site/resources/css
A src/site/resources/css/site.css
A src/site/xdoc
A src/site/xdoc/cygwin.xml
A src/site/xdoc/acid-semantics.xml
A src/site/xdoc/metrics.xml
A src/site/xdoc/index.xml
A src/site/xdoc/replication.xml
A src/site/xdoc/old_news.xml
A src/site/xdoc/bulk-loads.xml
A src/site/xdoc/pseudo-distributed.xml
A src/site/fml
A src/site/fml/faq.fml
A src/docbkx
A src/docbkx/sample_article.xml
A src/docbkx/book.xml
AU src/saveVersion.sh
A src/examples
A src/examples/thrift
A src/examples/thrift/DemoClient.java
A src/examples/thrift/DemoClient.cpp
A src/examples/thrift/DemoClient.rb
A src/examples/thrift/DemoClient.php
AU src/examples/thrift/DemoClient.py
A src/examples/thrift/README.txt
A src/examples/thrift/Makefile
A src/examples/mapreduce
A src/examples/mapreduce/org
A src/examples/mapreduce/org/apache
A src/examples/mapreduce/org/apache/hadoop
A src/examples/mapreduce/org/apache/hadoop/hbase
A src/examples/mapreduce/org/apache/hadoop/hbase/mapreduce
A
src/examples/mapreduce/org/apache/hadoop/hbase/mapreduce/SampleUploader.java
A
src/examples/mapreduce/org/apache/hadoop/hbase/mapreduce/IndexBuilder.java
A src/examples/mapreduce/index-builder-setup.rb
A src/examples/README.txt
A bin
AU bin/hbase-daemons.sh
A bin/rename_table.rb
AU bin/hbase
A bin/copy_table.rb
A bin/check_meta.rb
AU bin/start-hbase.sh
A bin/hirb.rb
A bin/set_meta_block_caching.rb
A bin/loadtable.rb
AU bin/hbase-daemon.sh
A bin/hbase-config.sh
A bin/local-regionservers.sh
AU bin/zookeepers.sh
A bin/local-master-backup.sh
A bin/add_table.rb
A bin/rolling-restart.sh
AU bin/regionservers.sh
A bin/master-backup.sh
A bin/replication
A bin/replication/copy_tables_desc.rb
A bin/replication/add_peer.rb
AU bin/stop-hbase.sh
A pom.xml
A README.txt
U .
At revision 991408
[locks-and-latches] Checking to see if we really have the locks
[locks-and-latches] Have all the locks, build can start
[trunk] $ /home/hudson/tools/maven/apache-maven-2.2.1/bin/mvn clean
-Dmaven.test.redirectTestOutputToFile=true deploy
[INFO] Scanning for projects...
[INFO] ------------------------------------------------------------------------
[INFO] Building HBase
[INFO] task-segment: [clean, deploy]
[INFO] ------------------------------------------------------------------------
[INFO] [clean:clean {execution: default-clean}]
[WARNING] POM for 'commons-httpclient:commons-httpclient:pom:3.0.1:compile' is
invalid.
Its dependencies (if any) will NOT be available to the current build.
[INFO] [antrun:run {execution: generate}]
[INFO] Executing tasks
[mkdir] Created dir:
<https://hudson.apache.org/hudson/job/HBase-TRUNK/ws/trunk/target/hbase-webapps>
[copy] Copying 4 files to
<https://hudson.apache.org/hudson/job/HBase-TRUNK/ws/trunk/target/hbase-webapps>
[mkdir] Created dir:
<https://hudson.apache.org/hudson/job/HBase-TRUNK/ws/trunk/target/hbase-webapps/master/WEB-INF>
[mkdir] Created dir:
<https://hudson.apache.org/hudson/job/HBase-TRUNK/ws/trunk/target/hbase-webapps/regionserver/WEB-INF>
[INFO] Executed tasks
[INFO] [build-helper:add-source {execution: add-jspc-source}]
[INFO] Source directory:
<https://hudson.apache.org/hudson/job/HBase-TRUNK/ws/trunk/target/jspc> added.
[INFO] [build-helper:add-source {execution: add-package-info}]
[INFO] Source directory:
<https://hudson.apache.org/hudson/job/HBase-TRUNK/ws/trunk/target/generated-sources>
added.
[INFO] [resources:resources {execution: default-resources}]
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 6 resources
[INFO] [compiler:compile {execution: default-compile}]
[INFO] Compiling 419 source files to
<https://hudson.apache.org/hudson/job/HBase-TRUNK/ws/trunk/target/classes>
[INFO] [resources:testResources {execution: default-testResources}]
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 4 resources
[INFO] [compiler:testCompile {execution: default-testCompile}]
[INFO] Compiling 164 source files to
<https://hudson.apache.org/hudson/job/HBase-TRUNK/ws/trunk/target/test-classes>
[INFO] [surefire:test {execution: default-test}]
[INFO] Surefire report directory:
<https://hudson.apache.org/hudson/job/HBase-TRUNK/ws/trunk/target/surefire-reports>
-------------------------------------------------------
T E S T S
-------------------------------------------------------
Running org.apache.hadoop.hbase.client.TestMultipleTimestamps
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 97.045 sec
Running org.apache.hadoop.hbase.TestZooKeeper
Tests run: 4, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 81.175 sec <<<
FAILURE!
Running org.apache.hadoop.hbase.regionserver.wal.TestLogRolling
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 109.384 sec
Running org.apache.hadoop.hbase.io.hfile.TestCachedBlockQueue
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.106 sec
Running org.apache.hadoop.hbase.filter.TestPrefixFilter
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.156 sec
Running org.apache.hadoop.hbase.util.TestMergeMeta
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 75.357 sec
Running org.apache.hadoop.hbase.io.TestHeapSize
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.143 sec
Running org.apache.hadoop.hbase.io.TestImmutableBytesWritable
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.111 sec
Running org.apache.hadoop.hbase.rest.model.TestRowModel
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.449 sec
Running org.apache.hadoop.hbase.io.hfile.TestHFileSeek
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.155 sec
Running org.apache.hadoop.hbase.regionserver.TestStore
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.393 sec
Running org.apache.hadoop.hbase.zookeeper.TestHQuorumPeer
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.531 sec
Running org.apache.hadoop.hbase.rest.TestScannersWithFilters
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.602 sec
Running org.apache.hadoop.hbase.io.hfile.TestHFilePerformance
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.433 sec
Running org.apache.hadoop.hbase.io.TestHbaseObjectWritable
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.219 sec
Running org.apache.hadoop.hbase.regionserver.wal.TestHLogSplit
Tests run: 16, Failures: 0, Errors: 8, Skipped: 0, Time elapsed: 57.692 sec <<<
FAILURE!
Running org.apache.hadoop.hbase.thrift.TestThriftServer
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 51.396 sec
Running org.apache.hadoop.hbase.filter.TestColumnPrefixFilter
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.651 sec
Running org.apache.hadoop.hbase.master.TestZKBasedOpenCloseRegion
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.154 sec
Running org.apache.hadoop.hbase.TestCompare
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.135 sec
Running org.apache.hadoop.hbase.regionserver.TestExplicitColumnTracker
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.942 sec
Running org.apache.hadoop.hbase.util.TestEnvironmentEdgeManager
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.271 sec
Running org.apache.hadoop.hbase.util.TestDefaultEnvironmentEdge
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.067 sec
Running org.apache.hadoop.hbase.master.TestMasterTransitions
Tests run: 3, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 35.316 sec
Running org.apache.hadoop.hbase.regionserver.TestScanWildcardColumnTracker
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.582 sec
Running org.apache.hadoop.hbase.regionserver.TestKeyValueSkipListSet
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.122 sec
Running org.apache.hadoop.hbase.io.hfile.TestSeekTo
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.602 sec
Running org.apache.hadoop.hbase.filter.TestPageFilter
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.04 sec
Running org.apache.hadoop.hbase.filter.TestColumnPaginationFilter
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.113 sec
Running org.apache.hadoop.hbase.rest.TestStatusResource
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.735 sec
Running org.apache.hadoop.hbase.client.TestFromClientSide
Tests run: 35, Failures: 0, Errors: 0, Skipped: 4, Time elapsed: 259.956 sec
Running org.apache.hadoop.hbase.replication.TestReplication
Tests run: 2, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 156.192 sec <<<
FAILURE!
Running org.apache.hadoop.hbase.regionserver.TestCompaction
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 80.672 sec
Running org.apache.hadoop.hbase.TestMultiParallelPut
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 118.629 sec
Running org.apache.hadoop.hbase.filter.TestSingleColumnValueFilter
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.146 sec
Running org.apache.hadoop.hbase.mapreduce.TestTimeRangeMapRed
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.549 sec
Running org.apache.hadoop.hbase.mapreduce.TestSimpleTotalOrderPartitioner
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.395 sec
Running org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 180.29 sec
Running org.apache.hadoop.hbase.regionserver.TestFSErrorsExposed
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 53.577 sec
Running org.apache.hadoop.hbase.regionserver.TestScanDeleteTracker
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.551 sec
Running org.apache.hadoop.hbase.client.TestMetaScanner
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.853 sec
Running org.apache.hadoop.hbase.metrics.TestMetricsMBeanBase
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.124 sec
Running org.apache.hadoop.hbase.TestRegionRebalancing
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 93.581 sec
Running org.apache.hadoop.hbase.filter.TestSingleColumnValueExcludeFilter
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.115 sec
Running org.apache.hadoop.hbase.filter.TestInclusiveStopFilter
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.118 sec
Running org.apache.hadoop.hbase.rest.TestTableResource
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 52.091 sec
Running org.apache.hadoop.hbase.TestHBaseTestingUtility
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.009 sec
Running org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFiles
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.367 sec
Running org.apache.hadoop.hbase.rest.TestSchemaResource
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.728 sec
Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplay
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.077 sec
Running org.apache.hadoop.hbase.regionserver.TestKeyValueScanFixture
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.115 sec
Running org.apache.hadoop.hbase.rest.model.TestTableListModel
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.484 sec
Running org.apache.hadoop.hbase.rest.model.TestColumnSchemaModel
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.323 sec
Running org.apache.hadoop.hbase.regionserver.TestStoreFile
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.228 sec
Running org.apache.hadoop.hbase.zookeeper.TestZooKeeperNodeTracker
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.116 sec
Running org.apache.hadoop.hbase.rest.model.TestScannerModel
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.497 sec
Running org.apache.hadoop.hbase.regionserver.wal.TestHLogMethods
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.426 sec
Running org.apache.hadoop.hbase.rest.TestVersionResource
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.884 sec
Running org.apache.hadoop.hbase.filter.TestFilter
Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.365 sec
Running org.apache.hadoop.hbase.regionserver.TestWideScanner
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.356 sec
Running org.apache.hadoop.hbase.regionserver.TestSplitTransaction
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.059 sec
Running org.apache.hadoop.hbase.replication.regionserver.TestReplicationSink
killed.
[INFO] ------------------------------------------------------------------------
[ERROR] BUILD ERROR
[INFO] ------------------------------------------------------------------------
[INFO] Error while executing forked tests.; nested exception is
org.apache.maven.surefire.booter.shade.org.codehaus.plexus.util.cli.CommandLineTimeOutException:
Error while executing external command, process killed.
Process timeout out after 3600 seconds
[INFO] ------------------------------------------------------------------------
[INFO] For more information, run Maven with the -e switch
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 91 minutes 15 seconds
[INFO] Finished at: Wed Sep 01 02:10:11 UTC 2010
[INFO] Final Memory: 45M/225M
[INFO] ------------------------------------------------------------------------
[locks-and-latches] Releasing all the locks
[locks-and-latches] All the locks released
Archiving artifacts
Recording test results
