See http://hudson.zones.apache.org/hudson/job/HBase-Patch/721/changes
Changes:
[stack] HBASE-1215 part2; check that all has been major compacted before
starting migration
[stack] HBASE-1662 Tool to run major compaction on catalog regions when hbase
is shutdown
------------------------------------------
[...truncated 31080 lines...]
[junit] 2009-07-16 02:42:22,140 INFO [main] regionserver.HRegion(782):
compaction completed on region TestMergeTool,row_0500,1247712109978 in 0sec
[junit] 2009-07-16 02:42:22,140 DEBUG [main] regionserver.HRegion(2077):
Files for region: TestMergeTool,row_0500,1247712109978
[junit] 2009-07-16 02:42:22,142 DEBUG [main] regionserver.HRegion(2219): f
hdfs://localhost:42142/user/hudson/TestMergeTool/1896946606/.regioninfo size=632
[junit] 2009-07-16 02:42:22,142 DEBUG [main] regionserver.HRegion(2216): d
hdfs://localhost:42142/user/hudson/TestMergeTool/1896946606/contents
[junit] 2009-07-16 02:42:22,143 DEBUG [main] regionserver.HRegion(2219): f
hdfs://localhost:42142/user/hudson/TestMergeTool/1896946606/contents/3485040393589449139
size=471
[junit] 2009-07-16 02:42:22,143 INFO [main] regionserver.HRegion(2106):
Creating new region REGION => {NAME => 'TestMergeTool,row_0100,1247712142143',
STARTKEY => 'row_0100', ENDKEY => 'row_0600', ENCODED => 1237826972, TABLE =>
{{NAME => 'TestMergeTool', FAMILIES => [{NAME => 'contents', VERSIONS => '3',
COMPRESSION => 'NONE', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY =>
'false', BLOCKCACHE => 'true'}]}}
[junit] 2009-07-16 02:42:22,160 INFO [main] regionserver.HRegion(2115):
starting merge of regions: TestMergeTool,row_0100,1247712140899 and
TestMergeTool,row_0500,1247712109978 into new region REGION => {NAME =>
'TestMergeTool,row_0100,1247712142143', STARTKEY => 'row_0100', ENDKEY =>
'row_0600', ENCODED => 1237826972, TABLE => {{NAME => 'TestMergeTool', FAMILIES
=> [{NAME => 'contents', VERSIONS => '3', COMPRESSION => 'NONE', TTL =>
'2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}]}} with start key <row_0100> and end key <row_0600>
[junit] 2009-07-16 02:42:22,160 DEBUG [main] regionserver.HRegion(439):
Closing TestMergeTool,row_0100,1247712140899: compactions & flushes disabled
[junit] 2009-07-16 02:42:22,160 DEBUG [main] regionserver.HRegion(469):
Updates disabled for region, no outstanding scanners on
TestMergeTool,row_0100,1247712140899
[junit] 2009-07-16 02:42:22,160 DEBUG [main] regionserver.HRegion(476): No
more row locks outstanding on region TestMergeTool,row_0100,1247712140899
[junit] 2009-07-16 02:42:22,161 DEBUG [main] regionserver.Store(451):
closed contents
[junit] 2009-07-16 02:42:22,161 INFO [main] regionserver.HRegion(488):
Closed TestMergeTool,row_0100,1247712140899
[junit] 2009-07-16 02:42:22,161 DEBUG [main] regionserver.HRegion(439):
Closing TestMergeTool,row_0500,1247712109978: compactions & flushes disabled
[junit] 2009-07-16 02:42:22,161 DEBUG [main] regionserver.HRegion(469):
Updates disabled for region, no outstanding scanners on
TestMergeTool,row_0500,1247712109978
[junit] 2009-07-16 02:42:22,161 DEBUG [main] regionserver.HRegion(476): No
more row locks outstanding on region TestMergeTool,row_0500,1247712109978
[junit] 2009-07-16 02:42:22,162 DEBUG [main] regionserver.Store(451):
closed contents
[junit] 2009-07-16 02:42:22,162 INFO [main] regionserver.HRegion(488):
Closed TestMergeTool,row_0500,1247712109978
[junit] 2009-07-16 02:42:22,212 DEBUG [main] regionserver.HRegion(2148):
Files for new region
[junit] 2009-07-16 02:42:22,213 DEBUG [main] regionserver.HRegion(2216): d
hdfs://localhost:42142/user/hudson/TestMergeTool/1237826972/contents
[junit] 2009-07-16 02:42:22,214 DEBUG [main] regionserver.HRegion(2219): f
hdfs://localhost:42142/user/hudson/TestMergeTool/1237826972/contents/2145845169200538002
size=471
[junit] 2009-07-16 02:42:22,214 DEBUG [main] regionserver.HRegion(2219): f
hdfs://localhost:42142/user/hudson/TestMergeTool/1237826972/contents/6729654796362959835
size=699
[junit] 2009-07-16 02:42:22,214 DEBUG [main] regionserver.HRegion(267):
Opening region TestMergeTool,row_0100,1247712142143, encoded=1237826972
[junit] 2009-07-16 02:42:22,257 DEBUG [main] regionserver.Store(386):
loaded /user/hudson/TestMergeTool/1237826972/contents/2145845169200538002,
isReference=false, sequence id=6, length=471, majorCompaction=true
[junit] 2009-07-16 02:42:22,261 DEBUG [main] regionserver.Store(386):
loaded /user/hudson/TestMergeTool/1237826972/contents/6729654796362959835,
isReference=false, sequence id=5, length=699, majorCompaction=true
[junit] 2009-07-16 02:42:22,264 INFO [main] regionserver.HRegion(342):
region TestMergeTool,row_0100,1247712142143/1237826972 available; sequence id
is 7
[junit] 2009-07-16 02:42:22,264 INFO [main] regionserver.HRegion(767):
Starting compaction on region TestMergeTool,row_0100,1247712142143
[junit] 2009-07-16 02:42:22,276 DEBUG [main] regionserver.Store(716):
Compaction size of contents: 1.1k; Skipped 0 file(s), size: 0
[junit] 2009-07-16 02:42:22,296 DEBUG [main] regionserver.Store(725):
Started compaction of 2 file(s) into
/user/hudson/TestMergeTool/compaction.dir/1237826972/6795051200236590574
[junit] 2009-07-16 02:42:22,491 DEBUG [main] regionserver.Store(740):
Completed compaction of contents; store size is 837.0
[junit] 2009-07-16 02:42:22,507 INFO [main] regionserver.HRegion(782):
compaction completed on region TestMergeTool,row_0100,1247712142143 in 0sec
[junit] 2009-07-16 02:42:22,507 DEBUG [main] regionserver.HRegion(2155):
Files for new region
[junit] 2009-07-16 02:42:22,508 DEBUG [main] regionserver.HRegion(2219): f
hdfs://localhost:42142/user/hudson/TestMergeTool/1237826972/.regioninfo size=632
[junit] 2009-07-16 02:42:22,508 DEBUG [main] regionserver.HRegion(2216): d
hdfs://localhost:42142/user/hudson/TestMergeTool/1237826972/contents
[junit] 2009-07-16 02:42:22,509 DEBUG [main] regionserver.HRegion(2219): f
hdfs://localhost:42142/user/hudson/TestMergeTool/1237826972/contents/2777050033599489019
size=837
[junit] 2009-07-16 02:42:22,510 DEBUG [main] regionserver.HRegion(1951):
DELETING region hdfs://localhost:42142/user/hudson/TestMergeTool/1075563045
[junit] 2009-07-16 02:42:22,527 DEBUG [main] regionserver.HRegion(1951):
DELETING region hdfs://localhost:42142/user/hudson/TestMergeTool/1896946606
[junit] 2009-07-16 02:42:22,543 INFO [main] regionserver.HRegion(2161):
merge completed. New region is TestMergeTool,row_0100,1247712142143
[junit] 2009-07-16 02:42:22,543 DEBUG [main] util.Merge(319): Removing
region: REGION => {NAME => 'TestMergeTool,row_0100,1247712140899', STARTKEY =>
'row_0100', ENDKEY => 'row_0400', ENCODED => 1075563045, TABLE => {{NAME =>
'TestMergeTool', FAMILIES => [{NAME => 'contents', VERSIONS => '3', COMPRESSION
=> 'NONE', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}]}} from .META.,,1
[junit] 2009-07-16 02:42:22,544 DEBUG [main] util.Merge(319): Removing
region: REGION => {NAME => 'TestMergeTool,row_0500,1247712109978', STARTKEY =>
'row_0500', ENDKEY => 'row_0600', ENCODED => 1896946606, TABLE => {{NAME =>
'TestMergeTool', FAMILIES => [{NAME => 'contents', VERSIONS => '3', COMPRESSION
=> 'NONE', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}]}} from .META.,,1
[junit] 2009-07-16 02:42:22,545 INFO [main] util.Merge(255): Adding REGION
=> {NAME => 'TestMergeTool,row_0100,1247712142143', STARTKEY => 'row_0100',
ENDKEY => 'row_0600', ENCODED => 1237826972, TABLE => {{NAME =>
'TestMergeTool', FAMILIES => [{NAME => 'contents', VERSIONS => '3', COMPRESSION
=> 'NONE', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}]}} to REGION => {NAME => '.META.,,1', STARTKEY => '',
ENDKEY => '', ENCODED => 1028785192, TABLE => {{NAME => '.META.', IS_META =>
'true', MEMSTORE_FLUSHSIZE => '16384', FAMILIES => [{NAME => 'historian',
VERSIONS => '2147483647', COMPRESSION => 'NONE', TTL => '604800', BLOCKSIZE =>
'8192', IN_MEMORY => 'false', BLOCKCACHE => 'false'}, {NAME => 'info', VERSIONS
=> '10', COMPRESSION => 'NONE', TTL => '2147483647', BLOCKSIZE => '8192',
IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}}
[junit] 2009-07-16 02:42:22,545 DEBUG [main] regionserver.HRegion(439):
Closing TestMergeTool,row_0100,1247712142143: compactions & flushes disabled
[junit] 2009-07-16 02:42:22,546 DEBUG [main] regionserver.HRegion(469):
Updates disabled for region, no outstanding scanners on
TestMergeTool,row_0100,1247712142143
[junit] 2009-07-16 02:42:22,546 DEBUG [main] regionserver.HRegion(476): No
more row locks outstanding on region TestMergeTool,row_0100,1247712142143
[junit] 2009-07-16 02:42:22,546 DEBUG [main] regionserver.Store(451):
closed contents
[junit] 2009-07-16 02:42:22,546 INFO [main] regionserver.HRegion(488):
Closed TestMergeTool,row_0100,1247712142143
[junit] 2009-07-16 02:42:22,546 DEBUG [main] regionserver.HRegion(439):
Closing -ROOT-,,0: compactions & flushes disabled
[junit] 2009-07-16 02:42:22,547 DEBUG [main] regionserver.HRegion(469):
Updates disabled for region, no outstanding scanners on -ROOT-,,0
[junit] 2009-07-16 02:42:22,547 DEBUG [main] regionserver.HRegion(476): No
more row locks outstanding on region -ROOT-,,0
[junit] 2009-07-16 02:42:22,547 DEBUG [main] regionserver.Store(451):
closed info
[junit] 2009-07-16 02:42:22,547 INFO [main] regionserver.HRegion(488):
Closed -ROOT-,,0
[junit] 2009-07-16 02:42:22,547 DEBUG [main] regionserver.HRegion(439):
Closing .META.,,1: compactions & flushes disabled
[junit] 2009-07-16 02:42:22,547 DEBUG [main] regionserver.HRegion(469):
Updates disabled for region, no outstanding scanners on .META.,,1
[junit] 2009-07-16 02:42:22,548 DEBUG [main] regionserver.HRegion(476): No
more row locks outstanding on region .META.,,1
[junit] 2009-07-16 02:42:22,548 DEBUG [main] regionserver.HRegion(892):
Started memstore flush for region .META.,,1. Current region memstore size 1016.0
[junit] 2009-07-16 02:42:22,590 DEBUG [main] regionserver.Store(533): Added
hdfs://localhost:42142/user/hudson/.META./1028785192/historian/8062766611426984776,
entries=2, sequenceid=27, memsize=288.0, filesize=521.0 to .META.,,1
[junit] 2009-07-16 02:42:22,634 DEBUG [main] regionserver.Store(533): Added
hdfs://localhost:42142/user/hudson/.META./1028785192/info/658404383641063542,
entries=3, sequenceid=27, memsize=728.0, filesize=874.0 to .META.,,1
[junit] 2009-07-16 02:42:22,634 DEBUG [main] regionserver.HRegion(969):
Finished memstore flush of ~1016.0 for region .META.,,1 in 86ms, sequence
id=27, compaction requested=true
[junit] 2009-07-16 02:42:22,635 DEBUG [main] regionserver.Store(451):
closed historian
[junit] 2009-07-16 02:42:22,635 DEBUG [main] regionserver.Store(451):
closed info
[junit] 2009-07-16 02:42:22,635 INFO [main] regionserver.HRegion(488):
Closed .META.,,1
[junit] 2009-07-16 02:42:22,671 INFO [main] regionserver.HLog(315): Roll
/user/hudson/.logs_1247712141516/hlog.dat.1247712141531, entries=6,
calcsize=1131, filesize=1151. New hlog
/user/hudson/.logs_1247712141516/hlog.dat.1247712142655
[junit] 2009-07-16 02:42:22,672 DEBUG [main] regionserver.HLog(324): Last
sequence written is empty. Deleting all old hlogs
[junit] 2009-07-16 02:42:22,672 INFO [main] regionserver.HLog(449):
removing old hlog file /user/hudson/.logs_1247712141516/hlog.dat.1247712141531
whose highest sequence/edit id is 26
[junit] 2009-07-16 02:42:22,686 DEBUG [main] regionserver.HLog(486):
closing hlog writer in hdfs://localhost:42142/user/hudson/.logs_1247712141516
[junit] 2009-07-16 02:42:22,722 DEBUG [main] regionserver.HRegion(1833):
Opening region: REGION => {NAME => 'TestMergeTool,row_0100,1247712142143',
STARTKEY => 'row_0100', ENDKEY => 'row_0600', ENCODED => 1237826972, TABLE =>
{{NAME => 'TestMergeTool', FAMILIES => [{NAME => 'contents', VERSIONS => '3',
COMPRESSION => 'NONE', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY =>
'false', BLOCKCACHE => 'true'}]}}
[junit] 2009-07-16 02:42:22,723 DEBUG [main] regionserver.HRegion(267):
Opening region TestMergeTool,row_0100,1247712142143, encoded=1237826972
[junit] 2009-07-16 02:42:22,729 DEBUG [main] regionserver.Store(386):
loaded /user/hudson/TestMergeTool/1237826972/contents/2777050033599489019,
isReference=false, sequence id=6, length=837, majorCompaction=false
[junit] 2009-07-16 02:42:22,732 INFO [main] regionserver.HRegion(342):
region TestMergeTool,row_0100,1247712142143/1237826972 available; sequence id
is 7
[junit] 2009-07-16 02:42:22,736 DEBUG [main] regionserver.HRegion(439):
Closing TestMergeTool,row_0100,1247712142143: compactions & flushes disabled
[junit] 2009-07-16 02:42:22,736 DEBUG [main] regionserver.HRegion(469):
Updates disabled for region, no outstanding scanners on
TestMergeTool,row_0100,1247712142143
[junit] 2009-07-16 02:42:22,736 DEBUG [main] regionserver.HRegion(476): No
more row locks outstanding on region TestMergeTool,row_0100,1247712142143
[junit] 2009-07-16 02:42:22,737 DEBUG [main] regionserver.Store(451):
closed contents
[junit] 2009-07-16 02:42:22,737 INFO [main] regionserver.HRegion(488):
Closed TestMergeTool,row_0100,1247712142143
[junit] 2009-07-16 02:42:22,737 INFO [main] util.TestMergeTool(187):
Verified merging regions 0+1+2 and 3
[junit] 2009-07-16 02:42:22,737 INFO [main] util.TestMergeTool(174):
merging regions 0+1+2+3 and 4
[junit] 2009-07-16 02:42:22,738 INFO [main] util.Merge(82): Verifying that
file system is available...
[junit] 2009-07-16 02:42:22,738 INFO [main] util.Merge(91): Verifying that
HBase is not running...
[junit] 2009-07-16 02:42:22,766 DEBUG [main] client.HConnectionManager(97):
Created new HBASE_INSTANCES
[junit] 2009-07-16 02:42:22,870 INFO [main] util.Merge(197): Merging
regions TestMergeTool,row_0100,1247712142143 and TestMergeTool,,1247712109978
in table TestMergeTool
[junit] 2009-07-16 02:42:22,900 INFO [main] regionserver.HLog(215): HLog
configuration: blocksize=67108864, rollsize=63753420, enabled=true,
flushlogentries=100, optionallogflushinternal=10000ms
[junit] 2009-07-16 02:42:22,918 INFO [main] regionserver.HLog(315): New
hlog /user/hudson/.logs_1247712142870/hlog.dat.1247712142900
[junit] 2009-07-16 02:42:22,918 DEBUG [main] regionserver.HRegion(1833):
Opening region: REGION => {NAME => '-ROOT-,,0', STARTKEY => '', ENDKEY => '',
ENCODED => 70236052, TABLE => {{NAME => '-ROOT-', IS_ROOT => 'true', IS_META =>
'true', MEMSTORE_FLUSHSIZE => '16384', FAMILIES => [{NAME => 'info',
COMPRESSION => 'NONE', VERSIONS => '10', TTL => '2147483647', BLOCKSIZE =>
'8192', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}}
[junit] 2009-07-16 02:42:22,919 DEBUG [main] regionserver.HRegion(267):
Opening region -ROOT-,,0, encoded=70236052
[junit] 2009-07-16 02:42:22,927 DEBUG [main] regionserver.Store(386):
loaded /user/hudson/-ROOT-/70236052/info/3609574215731178588,
isReference=false, sequence id=2, length=840, majorCompaction=false
[junit] 2009-07-16 02:42:22,929 INFO [main] regionserver.HRegion(342):
region -ROOT-,,0/70236052 available; sequence id is 3
[junit] 2009-07-16 02:42:22,929 INFO [main] regionserver.HRegion(767):
Starting compaction on region -ROOT-,,0
[junit] 2009-07-16 02:42:22,931 INFO [main] regionserver.HRegion(782):
compaction completed on region -ROOT-,,0 in 0sec
[junit] 2009-07-16 02:42:22,932 INFO [main] util.Merge(211): Found meta
for region1 .META.,,1, meta for region2 .META.,,1
[junit] 2009-07-16 02:42:22,932 DEBUG [main] regionserver.HRegion(1833):
Opening region: REGION => {NAME => '.META.,,1', STARTKEY => '', ENDKEY => '',
ENCODED => 1028785192, TABLE => {{NAME => '.META.', IS_META => 'true',
MEMSTORE_FLUSHSIZE => '16384', FAMILIES => [{NAME => 'historian', VERSIONS =>
'2147483647', COMPRESSION => 'NONE', TTL => '604800', BLOCKSIZE => '8192',
IN_MEMORY => 'false', BLOCKCACHE => 'false'}, {NAME => 'info', VERSIONS =>
'10', COMPRESSION => 'NONE', TTL => '2147483647', BLOCKSIZE => '8192',
IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}}
[junit] 2009-07-16 02:42:22,933 DEBUG [main] regionserver.HRegion(267):
Opening region .META.,,1, encoded=1028785192
[junit] 2009-07-16 02:42:22,941 DEBUG [main] regionserver.Store(386):
loaded /user/hudson/.META./1028785192/historian/3273176304520798258,
isReference=false, sequence id=20, length=651, majorCompaction=false
[junit] 2009-07-16 02:42:22,945 DEBUG [main] regionserver.Store(386):
loaded /user/hudson/.META./1028785192/historian/8062766611426984776,
isReference=false, sequence id=27, length=521, majorCompaction=false
[junit] 2009-07-16 02:42:22,951 DEBUG [main] regionserver.Store(386):
loaded /user/hudson/.META./1028785192/info/2372730667674113407,
isReference=false, sequence id=20, length=994, majorCompaction=false
[junit] 2009-07-16 02:42:22,956 DEBUG [main] regionserver.Store(386):
loaded /user/hudson/.META./1028785192/info/658404383641063542,
isReference=false, sequence id=27, length=874, majorCompaction=false
[junit] 2009-07-16 02:42:22,960 DEBUG [main] regionserver.Store(386):
loaded /user/hudson/.META./1028785192/info/7083057801559277407,
isReference=false, sequence id=6, length=2226, majorCompaction=false
[junit] 2009-07-16 02:42:22,962 INFO [main] regionserver.HRegion(342):
region .META.,,1/1028785192 available; sequence id is 28
[junit] 2009-07-16 02:42:22,962 INFO [main] regionserver.HRegion(767):
Starting compaction on region .META.,,1
[junit] 2009-07-16 02:42:22,977 DEBUG [main] regionserver.Store(716):
Compaction size of historian: 1.1k; Skipped 0 file(s), size: 0
[junit] 2009-07-16 02:42:22,998 DEBUG [main] regionserver.Store(725):
Started compaction of 2 file(s) into
/user/hudson/.META./compaction.dir/1028785192/7593711209258604043
[junit] 2009-07-16 02:42:23,073 DEBUG [main] regionserver.Store(740):
Completed compaction of historian; store size is 781.0
[junit] 2009-07-16 02:42:23,075 DEBUG [main] regionserver.Store(716):
Compaction size of info: 4.0k; Skipped 1 file(s), size: 2226
[junit] 2009-07-16 02:42:23,093 DEBUG [main] regionserver.Store(725):
Started compaction of 2 file(s) into
/user/hudson/.META./compaction.dir/1028785192/6762202158142559254
[junit] 2009-07-16 02:42:23,169 DEBUG [main] regionserver.Store(740):
Completed compaction of info; store size is 3.3k
[junit] 2009-07-16 02:42:23,185 INFO [main] regionserver.HRegion(782):
compaction completed on region .META.,,1 in 0sec
[junit] 2009-07-16 02:42:23,187 DEBUG [main] regionserver.HRegion(1833):
Opening region: REGION => {NAME => 'TestMergeTool,row_0100,1247712142143',
STARTKEY => 'row_0100', ENDKEY => 'row_0600', ENCODED => 1237826972, TABLE =>
{{NAME => 'TestMergeTool', FAMILIES => [{NAME => 'contents', COMPRESSION =>
'NONE', VERSIONS => '3', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY
=> 'false', BLOCKCACHE => 'true'}]}}
[junit] 2009-07-16 02:42:23,187 DEBUG [main] regionserver.HRegion(267):
Opening region TestMergeTool,row_0100,1247712142143, encoded=1237826972
[junit] 2009-07-16 02:42:23,194 DEBUG [main] regionserver.Store(386):
loaded /user/hudson/TestMergeTool/1237826972/contents/2777050033599489019,
isReference=false, sequence id=6, length=837, majorCompaction=false
[junit] 2009-07-16 02:42:23,196 INFO [main] regionserver.HRegion(342):
region TestMergeTool,row_0100,1247712142143/1237826972 available; sequence id
is 7
[junit] 2009-07-16 02:42:23,196 DEBUG [main] regionserver.HRegion(1833):
Opening region: REGION => {NAME => 'TestMergeTool,,1247712109978', STARTKEY =>
'', ENDKEY => '', ENCODED => 457082496, TABLE => {{NAME => 'TestMergeTool',
FAMILIES => [{NAME => 'contents', VERSIONS => '3', COMPRESSION => 'NONE', TTL
=> '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}]}}
[junit] 2009-07-16 02:42:23,197 DEBUG [main] regionserver.HRegion(267):
Opening region TestMergeTool,,1247712109978, encoded=457082496
[junit] 2009-07-16 02:42:23,203 DEBUG [main] regionserver.Store(386):
loaded /user/hudson/TestMergeTool/457082496/contents/3476047101244300334,
isReference=false, sequence id=7, length=471, majorCompaction=false
[junit] 2009-07-16 02:42:23,205 INFO [main] regionserver.HRegion(342):
region TestMergeTool,,1247712109978/457082496 available; sequence id is 8
[junit] 2009-07-16 02:42:23,206 INFO [main] regionserver.HRegion(767):
Starting major compaction on region TestMergeTool,row_0100,1247712142143
[junit] 2009-07-16 02:42:23,241 DEBUG [main] regionserver.Store(725):
Started compaction of 1 file(s) into
/user/hudson/TestMergeTool/compaction.dir/1237826972/2246818140127313993
[junit] 2009-07-16 02:42:23,484 DEBUG [main] regionserver.Store(740):
Completed major compaction of contents; store size is 837.0
[junit] 2009-07-16 02:42:23,496 INFO [main] regionserver.HRegion(782):
compaction completed on region TestMergeTool,row_0100,1247712142143 in 0sec
[junit] 2009-07-16 02:42:23,496 DEBUG [main] regionserver.HRegion(2072):
Files for region: TestMergeTool,row_0100,1247712142143
[junit] 2009-07-16 02:42:23,497 DEBUG [main] regionserver.HRegion(2219): f
hdfs://localhost:42142/user/hudson/TestMergeTool/1237826972/.regioninfo size=632
[junit] 2009-07-16 02:42:23,497 DEBUG [main] regionserver.HRegion(2216): d
hdfs://localhost:42142/user/hudson/TestMergeTool/1237826972/contents
[junit] 2009-07-16 02:42:23,498 DEBUG [main] regionserver.HRegion(2219): f
hdfs://localhost:42142/user/hudson/TestMergeTool/1237826972/contents/8868303102954382375
size=837
[junit] 2009-07-16 02:42:23,498 INFO [main] regionserver.HRegion(767):
Starting major compaction on region TestMergeTool,,1247712109978
[junit] 2009-07-16 02:42:23,528 DEBUG [main] regionserver.Store(725):
Started compaction of 1 file(s) into
/user/hudson/TestMergeTool/compaction.dir/457082496/3077758108079210613
[junit] 2009-07-16 02:42:23,579 DEBUG [main] regionserver.Store(740):
Completed major compaction of contents; store size is 471.0
[junit] 2009-07-16 02:42:23,587 INFO [main] regionserver.HRegion(782):
compaction completed on region TestMergeTool,,1247712109978 in 0sec
[junit] 2009-07-16 02:42:23,588 DEBUG [main] regionserver.HRegion(2077):
Files for region: TestMergeTool,,1247712109978
[junit] 2009-07-16 02:42:23,589 DEBUG [main] regionserver.HRegion(2219): f
hdfs://localhost:42142/user/hudson/TestMergeTool/457082496/.regioninfo size=583
[junit] 2009-07-16 02:42:23,589 DEBUG [main] regionserver.HRegion(2216): d
hdfs://localhost:42142/user/hudson/TestMergeTool/457082496/contents
[junit] 2009-07-16 02:42:23,590 DEBUG [main] regionserver.HRegion(2219): f
hdfs://localhost:42142/user/hudson/TestMergeTool/457082496/contents/2740606115876239680
size=471
[junit] 2009-07-16 02:42:23,590 INFO [main] regionserver.HRegion(2106):
Creating new region REGION => {NAME => 'TestMergeTool,,1247712143590', STARTKEY
=> '', ENDKEY => '', ENCODED => 721936729, TABLE => {{NAME => 'TestMergeTool',
FAMILIES => [{NAME => 'contents', COMPRESSION => 'NONE', VERSIONS => '3', TTL
=> '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}]}}
[junit] 2009-07-16 02:42:23,607 INFO [main] regionserver.HRegion(2115):
starting merge of regions: TestMergeTool,row_0100,1247712142143 and
TestMergeTool,,1247712109978 into new region REGION => {NAME =>
'TestMergeTool,,1247712143590', STARTKEY => '', ENDKEY => '', ENCODED =>
721936729, TABLE => {{NAME => 'TestMergeTool', FAMILIES => [{NAME =>
'contents', COMPRESSION => 'NONE', VERSIONS => '3', TTL => '2147483647',
BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}} with start
key <> and end key <>
[junit] 2009-07-16 02:42:23,608 DEBUG [main] regionserver.HRegion(439):
Closing TestMergeTool,row_0100,1247712142143: compactions & flushes disabled
[junit] 2009-07-16 02:42:23,608 DEBUG [main] regionserver.HRegion(469):
Updates disabled for region, no outstanding scanners on
TestMergeTool,row_0100,1247712142143
[junit] 2009-07-16 02:42:23,608 DEBUG [main] regionserver.HRegion(476): No
more row locks outstanding on region TestMergeTool,row_0100,1247712142143
[junit] 2009-07-16 02:42:23,608 DEBUG [main] regionserver.Store(451):
closed contents
[junit] 2009-07-16 02:42:23,608 INFO [main] regionserver.HRegion(488):
Closed TestMergeTool,row_0100,1247712142143
[junit] 2009-07-16 02:42:23,609 DEBUG [main] regionserver.HRegion(439):
Closing TestMergeTool,,1247712109978: compactions & flushes disabled
[junit] 2009-07-16 02:42:23,609 DEBUG [main] regionserver.HRegion(469):
Updates disabled for region, no outstanding scanners on
TestMergeTool,,1247712109978
[junit] 2009-07-16 02:42:23,609 DEBUG [main] regionserver.HRegion(476): No
more row locks outstanding on region TestMergeTool,,1247712109978
[junit] 2009-07-16 02:42:23,609 DEBUG [main] regionserver.Store(451):
closed contents
[junit] 2009-07-16 02:42:23,609 INFO [main] regionserver.HRegion(488):
Closed TestMergeTool,,1247712109978
[junit] 2009-07-16 02:42:23,655 DEBUG [main] regionserver.HRegion(2148):
Files for new region
[junit] 2009-07-16 02:42:23,656 DEBUG [main] regionserver.HRegion(2216): d
hdfs://localhost:42142/user/hudson/TestMergeTool/721936729/contents
[junit] 2009-07-16 02:42:23,657 DEBUG [main] regionserver.HRegion(2219): f
hdfs://localhost:42142/user/hudson/TestMergeTool/721936729/contents/5990119850000267511
size=837
[junit] 2009-07-16 02:42:23,657 DEBUG [main] regionserver.HRegion(2219): f
hdfs://localhost:42142/user/hudson/TestMergeTool/721936729/contents/6234778644244418784
size=471
[junit] 2009-07-16 02:42:23,657 DEBUG [main] regionserver.HRegion(267):
Opening region TestMergeTool,,1247712143590, encoded=721936729
[junit] 2009-07-16 02:42:23,696 DEBUG [main] regionserver.Store(386):
loaded /user/hudson/TestMergeTool/721936729/contents/5990119850000267511,
isReference=false, sequence id=6, length=837, majorCompaction=true
[junit] 2009-07-16 02:42:23,700 DEBUG [main] regionserver.Store(386):
loaded /user/hudson/TestMergeTool/721936729/contents/6234778644244418784,
isReference=false, sequence id=7, length=471, majorCompaction=true
[junit] 2009-07-16 02:42:23,702 INFO [main] regionserver.HRegion(342):
region TestMergeTool,,1247712143590/721936729 available; sequence id is 8
[junit] 2009-07-16 02:42:23,702 INFO [main] regionserver.HRegion(767):
Starting compaction on region TestMergeTool,,1247712143590
[junit] 2009-07-16 02:42:23,719 DEBUG [main] regionserver.Store(716):
Compaction size of contents: 1.3k; Skipped 0 file(s), size: 0
[junit] 2009-07-16 02:42:23,735 DEBUG [main] regionserver.Store(725):
Started compaction of 2 file(s) into
/user/hudson/TestMergeTool/compaction.dir/721936729/6615233658191772627
[junit] 2009-07-16 02:42:23,799 DEBUG [main] regionserver.Store(740):
Completed compaction of contents; store size is 975.0
[junit] 2009-07-16 02:42:23,815 INFO [main] regionserver.HRegion(782):
compaction completed on region TestMergeTool,,1247712143590 in 0sec
[junit] 2009-07-16 02:42:23,816 DEBUG [main] regionserver.HRegion(2155):
Files for new region
[junit] 2009-07-16 02:42:23,817 DEBUG [main] regionserver.HRegion(2219): f
hdfs://localhost:42142/user/hudson/TestMergeTool/721936729/.regioninfo size=583
[junit] 2009-07-16 02:42:23,817 DEBUG [main] regionserver.HRegion(2216): d
hdfs://localhost:42142/user/hudson/TestMergeTool/721936729/contents
[junit] 2009-07-16 02:42:23,818 DEBUG [main] regionserver.HRegion(2219): f
hdfs://localhost:42142/user/hudson/TestMergeTool/721936729/contents/7732341951134191
size=975
[junit] 2009-07-16 02:42:23,818 DEBUG [main] regionserver.HRegion(1951):
DELETING region hdfs://localhost:42142/user/hudson/TestMergeTool/1237826972
[junit] 2009-07-16 02:42:23,826 DEBUG [main] regionserver.HRegion(1951):
DELETING region hdfs://localhost:42142/user/hudson/TestMergeTool/457082496
[junit] 2009-07-16 02:42:23,842 INFO [main] regionserver.HRegion(2161):
merge completed. New region is TestMergeTool,,1247712143590
[junit] 2009-07-16 02:42:23,843 DEBUG [main] util.Merge(319): Removing
region: REGION => {NAME => 'TestMergeTool,row_0100,1247712142143', STARTKEY =>
'row_0100', ENDKEY => 'row_0600', ENCODED => 1237826972, TABLE => {{NAME =>
'TestMergeTool', FAMILIES => [{NAME => 'contents', COMPRESSION => 'NONE',
VERSIONS => '3', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY =>
'false', BLOCKCACHE => 'true'}]}} from .META.,,1
[junit] 2009-07-16 02:42:23,843 DEBUG [main] util.Merge(319): Removing
region: REGION => {NAME => 'TestMergeTool,,1247712109978', STARTKEY => '',
ENDKEY => '', ENCODED => 457082496, TABLE => {{NAME => 'TestMergeTool',
FAMILIES => [{NAME => 'contents', VERSIONS => '3', COMPRESSION => 'NONE', TTL
=> '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}]}} from .META.,,1
[junit] 2009-07-16 02:42:23,845 INFO [main] util.Merge(255): Adding REGION
=> {NAME => 'TestMergeTool,,1247712143590', STARTKEY => '', ENDKEY => '',
ENCODED => 721936729, TABLE => {{NAME => 'TestMergeTool', FAMILIES => [{NAME =>
'contents', COMPRESSION => 'NONE', VERSIONS => '3', TTL => '2147483647',
BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}} to REGION
=> {NAME => '.META.,,1', STARTKEY => '', ENDKEY => '', ENCODED => 1028785192,
TABLE => {{NAME => '.META.', IS_META => 'true', MEMSTORE_FLUSHSIZE => '16384',
FAMILIES => [{NAME => 'historian', VERSIONS => '2147483647', COMPRESSION =>
'NONE', TTL => '604800', BLOCKSIZE => '8192', IN_MEMORY => 'false', BLOCKCACHE
=> 'false'}, {NAME => 'info', VERSIONS => '10', COMPRESSION => 'NONE', TTL =>
'2147483647', BLOCKSIZE => '8192', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}]}}
[junit] 2009-07-16 02:42:23,845 DEBUG [main] regionserver.HRegion(439):
Closing TestMergeTool,,1247712143590: compactions & flushes disabled
[junit] 2009-07-16 02:42:23,845 DEBUG [main] regionserver.HRegion(469):
Updates disabled for region, no outstanding scanners on
TestMergeTool,,1247712143590
[junit] 2009-07-16 02:42:23,845 DEBUG [main] regionserver.HRegion(476): No
more row locks outstanding on region TestMergeTool,,1247712143590
[junit] 2009-07-16 02:42:23,846 DEBUG [main] regionserver.Store(451):
closed contents
[junit] 2009-07-16 02:42:23,846 INFO [main] regionserver.HRegion(488):
Closed TestMergeTool,,1247712143590
[junit] 2009-07-16 02:42:23,846 DEBUG [main] regionserver.HRegion(439):
Closing -ROOT-,,0: compactions & flushes disabled
[junit] 2009-07-16 02:42:23,846 DEBUG [main] regionserver.HRegion(469):
Updates disabled for region, no outstanding scanners on -ROOT-,,0
[junit] 2009-07-16 02:42:23,846 DEBUG [main] regionserver.HRegion(476): No
more row locks outstanding on region -ROOT-,,0
[junit] 2009-07-16 02:42:23,847 DEBUG [main] regionserver.Store(451):
closed info
[junit] 2009-07-16 02:42:23,847 INFO [main] regionserver.HRegion(488):
Closed -ROOT-,,0
[junit] 2009-07-16 02:42:23,847 DEBUG [main] regionserver.HRegion(439):
Closing .META.,,1: compactions & flushes disabled
[junit] 2009-07-16 02:42:23,847 DEBUG [main] regionserver.HRegion(469):
Updates disabled for region, no outstanding scanners on .META.,,1
[junit] 2009-07-16 02:42:23,847 DEBUG [main] regionserver.HRegion(476): No
more row locks outstanding on region .META.,,1
[junit] 2009-07-16 02:42:23,848 DEBUG [main] regionserver.HRegion(892):
Started memstore flush for region .META.,,1. Current region memstore size 968.0
[junit] 2009-07-16 02:42:23,886 DEBUG [main] regionserver.Store(533): Added
hdfs://localhost:42142/user/hudson/.META./1028785192/historian/4784804184849485333,
entries=2, sequenceid=34, memsize=280.0, filesize=505.0 to .META.,,1
[junit] 2009-07-16 02:42:23,934 DEBUG [main] regionserver.Store(533): Added
hdfs://localhost:42142/user/hudson/.META./1028785192/info/8219999990454686351,
entries=3, sequenceid=34, memsize=688.0, filesize=826.0 to .META.,,1
[junit] 2009-07-16 02:42:23,934 DEBUG [main] regionserver.HRegion(969):
Finished memstore flush of ~968.0 for region .META.,,1 in 86ms, sequence id=34,
compaction requested=true
[junit] 2009-07-16 02:42:23,934 DEBUG [main] regionserver.Store(451):
closed historian
[junit] 2009-07-16 02:42:23,935 DEBUG [main] regionserver.Store(451):
closed info
[junit] 2009-07-16 02:42:23,935 INFO [main] regionserver.HRegion(488):
Closed .META.,,1
[junit] 2009-07-16 02:42:23,963 INFO [main] regionserver.HLog(315): Roll
/user/hudson/.logs_1247712142870/hlog.dat.1247712142900, entries=6,
calcsize=1083, filesize=1103. New hlog
/user/hudson/.logs_1247712142870/hlog.dat.1247712143946
[junit] 2009-07-16 02:42:23,963 DEBUG [main] regionserver.HLog(324): Last
sequence written is empty. Deleting all old hlogs
[junit] 2009-07-16 02:42:23,963 INFO [main] regionserver.HLog(449):
removing old hlog file /user/hudson/.logs_1247712142870/hlog.dat.1247712142900
whose highest sequence/edit id is 33
[junit] 2009-07-16 02:42:23,970 DEBUG [main] regionserver.HLog(486):
closing hlog writer in hdfs://localhost:42142/user/hudson/.logs_1247712142870
[junit] 2009-07-16 02:42:23,998 DEBUG [main] regionserver.HRegion(1833):
Opening region: REGION => {NAME => 'TestMergeTool,,1247712143590', STARTKEY =>
'', ENDKEY => '', ENCODED => 721936729, TABLE => {{NAME => 'TestMergeTool',
FAMILIES => [{NAME => 'contents', COMPRESSION => 'NONE', VERSIONS => '3', TTL
=> '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}]}}
[junit] 2009-07-16 02:42:23,998 DEBUG [main] regionserver.HRegion(267):
Opening region TestMergeTool,,1247712143590, encoded=721936729
[junit] 2009-07-16 02:42:24,005 DEBUG [main] regionserver.Store(386):
loaded /user/hudson/TestMergeTool/721936729/contents/7732341951134191,
isReference=false, sequence id=7, length=975, majorCompaction=false
[junit] 2009-07-16 02:42:24,007 INFO [main] regionserver.HRegion(342):
region TestMergeTool,,1247712143590/721936729 available; sequence id is 8
[junit] 2009-07-16 02:42:24,013 DEBUG [main] regionserver.HRegion(439):
Closing TestMergeTool,,1247712143590: compactions & flushes disabled
[junit] 2009-07-16 02:42:24,013 DEBUG [main] regionserver.HRegion(469):
Updates disabled for region, no outstanding scanners on
TestMergeTool,,1247712143590
[junit] 2009-07-16 02:42:24,013 DEBUG [main] regionserver.HRegion(476): No
more row locks outstanding on region TestMergeTool,,1247712143590
[junit] 2009-07-16 02:42:24,013 DEBUG [main] regionserver.Store(451):
closed contents
[junit] 2009-07-16 02:42:24,013 INFO [main] regionserver.HRegion(488):
Closed TestMergeTool,,1247712143590
[junit] 2009-07-16 02:42:24,014 INFO [main] util.TestMergeTool(187):
Verified merging regions 0+1+2+3 and 4
[junit] 2009-07-16 02:42:24,014 DEBUG [main] regionserver.HLog(486):
closing hlog writer in /tmp/.logs_1247712138999
[junit] 2009-07-16 02:42:24,058 INFO [main] hbase.HBaseTestCase(627):
Shutting down FileSystem
[junit] 2009-07-16 02:42:24,058 INFO [main] hbase.HBaseTestCase(634):
Shutting down Mini DFS
[junit] Shutting down the Mini HDFS Cluster
[junit] Shutting down DataNode 1
[junit] 2009-07-16 02:42:24,167 WARN
[org.apache.hadoop.hdfs.server.datanode.dataxceiverser...@363068]
datanode.DataXceiverServer(137): DatanodeRegistration(127.0.0.1:60885,
storageID=DS-1136454523-67.195.138.9-60885-1247712136774, infoPort=32841,
ipcPort=43381):DataXceiveServer: java.nio.channels.AsynchronousCloseException
[junit] at
java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:185)
[junit] at
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:152)
[junit] at
sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84)
[junit] at
org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:130)
[junit] at java.lang.Thread.run(Thread.java:619)
[junit]
[junit] Shutting down DataNode 0
[junit] 2009-07-16 02:42:25,284 WARN
[org.apache.hadoop.hdfs.server.datanode.dataxceiverser...@996cca]
datanode.DataXceiverServer(137): DatanodeRegistration(127.0.0.1:41791,
storageID=DS-352486588-67.195.138.9-41791-1247712136029, infoPort=39271,
ipcPort=52078):DataXceiveServer: java.nio.channels.AsynchronousCloseException
[junit] at
java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:185)
[junit] at
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:152)
[junit] at
sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84)
[junit] at
org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:130)
[junit] at java.lang.Thread.run(Thread.java:619)
[junit]
[junit] 2009-07-16 02:42:26,486 WARN
[org.apache.hadoop.hdfs.server.namenode.fsnamesystem$replicationmoni...@a9255c]
namenode.FSNamesystem$ReplicationMonitor(2306): ReplicationMonitor thread
received InterruptedException.java.lang.InterruptedException: sleep interrupted
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 36.598 sec
[junit] Running org.apache.hadoop.hbase.util.TestRootPath
[junit] 2009-07-16 02:42:26,896 INFO [main] util.TestRootPath(60): Got
expected exception when checking invalid path:
[junit] java.io.IOException: Root directory does not contain a scheme
[junit] at
org.apache.hadoop.hbase.util.FSUtils.validateRootPath(FSUtils.java:214)
[junit] at
org.apache.hadoop.hbase.util.TestRootPath.testRootPath(TestRootPath.java:56)
[junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit] at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit] at java.lang.reflect.Method.invoke(Method.java:597)
[junit] at junit.framework.TestCase.runTest(TestCase.java:154)
[junit] at junit.framework.TestCase.runBare(TestCase.java:127)
[junit] at junit.framework.TestResult$1.protect(TestResult.java:106)
[junit] at junit.framework.TestResult.runProtected(TestResult.java:124)
[junit] at junit.framework.TestResult.run(TestResult.java:109)
[junit] at junit.framework.TestCase.run(TestCase.java:118)
[junit] at junit.framework.TestSuite.runTest(TestSuite.java:208)
[junit] at junit.framework.TestSuite.run(TestSuite.java:203)
[junit] at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:421)
[junit] at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:912)
[junit] at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:766)
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.073 sec
BUILD FAILED
http://hudson.zones.apache.org/hudson/job/HBase-Patch/ws/trunk/build.xml :509:
Tests failed!
Total time: 44 minutes 47 seconds
[locks-and-latches] Releasing all the locks
[locks-and-latches] All the locks released
Recording test results
Publishing Clover coverage report...
