[
https://issues.apache.org/jira/browse/HBASE-1715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Purtell updated HBASE-1715:
----------------------------------
Attachment: HBASE-1715-v3.patch
See combined patch -v3. Does some surgery to commit errant values to the
correct store.
{noformat}
2009-07-28 18:16:45,949 INFO org.apache.hadoop.hbase.regionserver.HRegion:
Starting major compaction on region
content,9c3bfc73c37edabe01867ea9c4d8ef9e,1248750470366
2009-07-28 18:16:45,975 DEBUG org.apache.hadoop.hbase.regionserver.Store:
Started compaction of 4 file(s) into /hbase/content/compaction.dir/448268753,
seqid=42603721
2009-07-28 18:17:19,017 WARN org.apache.hadoop.hbase.regionserver.Store: key
with wrong family found in store: want=content, got=url: fixing
2009-07-28 18:18:13,646 DEBUG org.apache.hadoop.hbase.regionserver.Store:
Completed major compaction of content; new storefile is
hdfs://test01:50000/hbase/content/448268753/content/848892875550881398; store
size is 521.4m
2009-07-28 18:18:13,646 DEBUG org.apache.hadoop.hbase.regionserver.Store:
Started compaction of 4 file(s) into /hbase/content/compaction.dir/448268753,
seqid=42603721
2009-07-28 18:18:13,935 WARN org.apache.hadoop.hbase.regionserver.Store: key
with wrong family found in store: want=info, got=url: fixing
2009-07-28 18:18:14,171 DEBUG org.apache.hadoop.hbase.regionserver.Store:
Completed major compaction of info; new storefile is
hdfs://test01:50000/hbase/content/448268753/info/2762972429935516536; store
size is 4.3m
2009-07-28 18:18:14,171 DEBUG org.apache.hadoop.hbase.regionserver.Store:
Started compaction of 4 file(s) into /hbase/content/compaction.dir/448268753,
seqid=42603721
2009-07-28 18:18:14,762 DEBUG org.apache.hadoop.hbase.regionserver.Store:
Completed major compaction of url; new storefile is
hdfs://test01:50000/hbase/content/448268753/url/7504151949043213112; store size
is 1.5m
2009-07-28 18:18:14,779 INFO org.apache.hadoop.hbase.regionserver.HRegion:
compaction completed on region
content,9c3bfc73c37edabe01867ea9c4d8ef9e,1248750470366 in 1mins, 28sec
{noformat}
After compaction completes, values are in the right place:
{noformat}
2009-07-28 18:20:11,865 INFO org.apache.hadoop.hbase.regionserver.HRegion:
Starting major compaction on region
content,9c3bfc73c37edabe01867ea9c4d8ef9e,1248750470366
2009-07-28 18:20:11,917 DEBUG org.apache.hadoop.hbase.regionserver.Store:
Started compaction of 1 file(s) into /hbase/content/compaction.dir/448268753,
seqid=42603721
2009-07-28 18:21:35,491 DEBUG org.apache.hadoop.hbase.regionserver.Store:
Completed major compaction of content; new storefile is
hdfs://test01:50000/hbase/content/448268753/content/6780236562798836512; store
size is 521.4m
2009-07-28 18:21:35,491 DEBUG org.apache.hadoop.hbase.regionserver.Store:
Started compaction of 1 file(s) into /hbase/content/compaction.dir/448268753,
seqid=42603721
2009-07-28 18:21:35,757 DEBUG org.apache.hadoop.hbase.regionserver.Store:
Completed major compaction of info; new storefile is
hdfs://test01:50000/hbase/content/448268753/info/1792173903054446564; store
size is 4.3m
2009-07-28 18:21:35,757 DEBUG org.apache.hadoop.hbase.regionserver.Store:
Started compaction of 1 file(s) into /hbase/content/compaction.dir/448268753,
seqid=42603721
2009-07-28 18:21:36,182 DEBUG org.apache.hadoop.hbase.regionserver.Store:
Completed major compaction of url; new storefile is
hdfs://test01:50000/hbase/content/448268753/url/182518719874068306; store size
is 1.5m
2009-07-28 18:21:36,198 INFO org.apache.hadoop.hbase.regionserver.HRegion:
compaction completed on region
content,9c3bfc73c37edabe01867ea9c4d8ef9e,1248750470366 in 1mins, 24sec
{noformat}
Patch may break TestStore.
> compaction failure in ScanWildcardColumnTracker.checkColumn
> -----------------------------------------------------------
>
> Key: HBASE-1715
> URL: https://issues.apache.org/jira/browse/HBASE-1715
> Project: Hadoop HBase
> Issue Type: Bug
> Reporter: Andrew Purtell
> Priority: Blocker
> Fix For: 0.20.0
>
> Attachments: HBASE-1715-v2.patch, HBASE-1715-v3.patch,
> HBASE-1715.patch
>
>
> I have at least one region that won't compact.
> {noformat}
> hbase> status 'detailed'
> [...]
> content,0b41cdd2ee9b36b0674ad423089800ba,1248257816633
> stores=3, storefiles=113, storefileSizeMB=1213, memstoreSizeMB=0,
> storefileIndexSizeMB=0
> [...]
> hbase> major_compact 'content'
> [...]
> hbase> status 'detailed'
> [...]
> content,0b41cdd2ee9b36b0674ad423089800ba,1248257816633
> stores=3, storefiles=113, storefileSizeMB=1213, memstoreSizeMB=0,
> storefileIndexSizeMB=0
> [...]
> hbase> major_compact 'content,0b41cdd2ee9b36b0674ad423089800ba,1248257816633'
> [...]
> hbase> status 'detailed'
> [...]
> content,0b41cdd2ee9b36b0674ad423089800ba,1248257816633
> stores=3, storefiles=113, storefileSizeMB=1213, memstoreSizeMB=0,
> storefileIndexSizeMB=0
> [...]
> {noformat}
> {noformat}
> $ hadoop fs -ls /hbase/content/1226419153/content
> Found 37 items
> -rw-r--r-- 2 hadoop supergroup 86422089 2009-07-24 16:11
> /hbase/content/1226419153/content/1045181559873943545
> -rw-r--r-- 2 hadoop supergroup 7167852 2009-07-26 05:13
> /hbase/content/1226419153/content/1225211885117827793
> -rw-r--r-- 2 hadoop supergroup 2678 2009-07-24 20:24
> /hbase/content/1226419153/content/1275251824404920815
> -rw-r--r-- 2 hadoop supergroup 10288489 2009-07-26 02:16
> /hbase/content/1226419153/content/1386224161790061095
> -rw-r--r-- 2 hadoop supergroup 16111798 2009-07-24 23:43
> /hbase/content/1226419153/content/1454452327579297030
> -rw-r--r-- 2 hadoop supergroup 12650208 2009-07-26 23:31
> /hbase/content/1226419153/content/1534514745508157864
> -rw-r--r-- 2 hadoop supergroup 6994590 2009-07-27 10:45
> /hbase/content/1226419153/content/1706519919143970421
> -rw-r--r-- 2 hadoop supergroup 13449537 2009-07-26 20:53
> /hbase/content/1226419153/content/2186668356269910871
> -rw-r--r-- 2 hadoop supergroup 10397457 2009-07-26 22:15
> /hbase/content/1226419153/content/2292706332643873473
> -rw-r--r-- 2 hadoop supergroup 6481576 2009-07-27 05:59
> /hbase/content/1226419153/content/2438489739664745000
> -rw-r--r-- 2 hadoop supergroup 10810191 2009-07-25 19:48
> /hbase/content/1226419153/content/2538008511360230014
> -rw-r--r-- 2 hadoop supergroup 13877559 2009-07-27 18:26
> /hbase/content/1226419153/content/2772019170563217117
> -rw-r--r-- 2 hadoop supergroup 12796040 2009-07-26 10:14
> /hbase/content/1226419153/content/2902101782772083009
> -rw-r--r-- 2 hadoop supergroup 6541657 2009-07-27 01:06
> /hbase/content/1226419153/content/3113808018684114931
> -rw-r--r-- 2 hadoop supergroup 8655428 2009-07-25 18:17
> /hbase/content/1226419153/content/3817932211925236778
> -rw-r--r-- 2 hadoop supergroup 1445535 2009-07-27 16:10
> /hbase/content/1226419153/content/4286233593585189878
> -rw-r--r-- 2 hadoop supergroup 9139508 2009-07-27 02:11
> /hbase/content/1226419153/content/495340788313226264
> -rw-r--r-- 2 hadoop supergroup 3313459 2009-07-26 05:57
> /hbase/content/1226419153/content/5167064731599803595
> -rw-r--r-- 2 hadoop supergroup 9473393 2009-07-26 14:44
> /hbase/content/1226419153/content/5490426319631514899
> -rw-r--r-- 2 hadoop supergroup 9321224 2009-07-26 19:40
> /hbase/content/1226419153/content/5790825797519034907
> -rw-r--r-- 2 hadoop supergroup 12171283 2009-07-27 12:20
> /hbase/content/1226419153/content/6036401533248383324
> -rw-r--r-- 2 hadoop supergroup 824790136 2009-07-23 22:28
> /hbase/content/1226419153/content/6211942192349190964
> -rw-r--r-- 2 hadoop supergroup 9905606 2009-07-27 07:45
> /hbase/content/1226419153/content/6295275445036553977
> -rw-r--r-- 2 hadoop supergroup 23857510 2009-07-27 17:02
> /hbase/content/1226419153/content/6535266251812885635
> -rw-r--r-- 2 hadoop supergroup 9177439 2009-07-26 11:21
> /hbase/content/1226419153/content/6625735185665629662
> -rw-r--r-- 2 hadoop supergroup 6916543 2009-07-27 20:15
> /hbase/content/1226419153/content/6934569497672884872
> -rw-r--r-- 2 hadoop supergroup 8818427 2009-07-27 13:48
> /hbase/content/1226419153/content/7162767181372457089
> -rw-r--r-- 2 hadoop supergroup 12028925 2009-07-25 08:48
> /hbase/content/1226419153/content/7254368961746328584
> -rw-r--r-- 2 hadoop supergroup 14695089 2009-07-27 09:16
> /hbase/content/1226419153/content/728058506789102941
> -rw-r--r-- 2 hadoop supergroup 9154325 2009-07-27 03:43
> /hbase/content/1226419153/content/7462549804082617977
> -rw-r--r-- 2 hadoop supergroup 22295283 2009-07-27 21:46
> /hbase/content/1226419153/content/7498645200757573769
> -rw-r--r-- 2 hadoop supergroup 5414671 2009-07-27 15:27
> /hbase/content/1226419153/content/758918234053985701
> -rw-r--r-- 2 hadoop supergroup 11260015 2009-07-26 08:16
> /hbase/content/1226419153/content/7626050291010778604
> -rw-r--r-- 2 hadoop supergroup 11309116 2009-07-26 12:57
> /hbase/content/1226419153/content/7704085331915902813
> -rw-r--r-- 2 hadoop supergroup 6326623 2009-07-26 17:58
> /hbase/content/1226419153/content/7735737241739599956
> -rw-r--r-- 2 hadoop supergroup 832 2009-07-24 20:15
> /hbase/content/1226419153/content/8170327402351444879
> -rw-r--r-- 2 hadoop supergroup 13480887 2009-07-26 16:32
> /hbase/content/1226419153/content/890729481029340216
> {noformat}
> Relevant nonstandard options:
> {noformat}
> <property>
> <name>hbase.hregion.max.filesize</name>
> <value>1073741824</value>
> </property>
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
