[
https://issues.apache.org/jira/browse/HBASE-4122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13094872#comment-13094872
]
stack commented on HBASE-4122:
------------------------------
For sure check_meta is looking at a gap only. Your suggestion that it broaden
the scope so it make a better call sounds right Jon.
Regards the meta that you are trying to fix, if it is the one I think you are
working on, here is what check_meta.rb output found which would be what it'd
used doing the fixup and looking at the keys, they seem to be going from left
to right in sort order rather than 'backward'... but maybe check_meta.rb --fix
bungled this anyways.
{code}
11/08/19 23:41:41 WARN check_meta: hole after REGION => {NAME =>
'crash_reports,b110818b10a17aa-47b8-4b3b-89e0-5c05a2110818,1313687445944.5eee164f9ccb72765d263cc98e2f5a26.',
STARTKEY => 'b110818b10a17aa-47b8-4b3b-89e0-5c05a2110818', ENDKEY =>
'b110818b482cd58-2690-4b59-a65b-f0bdc2110818', ENCODED =>
5eee164f9ccb72765d263cc98e2f5a26, TABLE => {{NAME => 'crash_reports',
MAX_FILESIZE => '1073741824', FAMILIES => [{NAME => 'flags', BLOOMFILTER =>
'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '1', TTL =>
'2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}, {NAME => 'ids', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1',
VERSIONS => '1', COMPRESSION => 'LZO', TTL => '2147483647', BLOCKSIZE =>
'65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'meta_data',
BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', VERSIONS => '3', COMPRESSION
=> 'LZO', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}, {NAME => 'processed_data', BLOOMFILTER => 'NONE',
REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '3', TTL =>
'2147483647', BLOCKSIZE => '524288', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}, {NAME => 'raw_data', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1',
COMPRESSION => 'LZO', VERSIONS => '3', TTL => '2147483647', BLOCKSIZE =>
'524288', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'timestamps',
BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS
=> '1', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}]}}
11/08/19 23:41:46 WARN check_meta: hole after REGION => {NAME =>
'crash_reports,d110818d237e63f-b236-4c89-a2c7-5f6342110818,1313685726288.99b31c552c27ed6b7fae2a05551c08f0.',
STARTKEY => 'd110818d237e63f-b236-4c89-a2c7-5f6342110818', ENDKEY =>
'd110818d5ae5051-df15-4ccd-b3c6-93d722110818', ENCODED =>
99b31c552c27ed6b7fae2a05551c08f0, TABLE => {{NAME => 'crash_reports',
MAX_FILESIZE => '1073741824', FAMILIES => [{NAME => 'flags', BLOOMFILTER =>
'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '1', TTL =>
'2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}, {NAME => 'ids', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1',
VERSIONS => '1', COMPRESSION => 'LZO', TTL => '2147483647', BLOCKSIZE =>
'65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'meta_data',
BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', VERSIONS => '3', COMPRESSION
=> 'LZO', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}, {NAME => 'processed_data', BLOOMFILTER => 'NONE',
REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '3', TTL =>
'2147483647', BLOCKSIZE => '524288', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}, {NAME => 'raw_data', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1',
COMPRESSION => 'LZO', VERSIONS => '3', TTL => '2147483647', BLOCKSIZE =>
'524288', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'timestamps',
BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS
=> '1', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}]}}
11/08/19 23:41:46 WARN check_meta: hole after REGION => {NAME =>
'crash_reports,d110818d5ae5051-df15-4ccd-b3c6-93d722110818,1313685726288.6f17c0badca9ad9d8b9cdd7734f4147f.',
STARTKEY => 'd110818d5ae5051-df15-4ccd-b3c6-93d722110818', ENDKEY =>
'd110818d926b2f0-1620-4c00-b057-5bddf2110818', ENCODED =>
6f17c0badca9ad9d8b9cdd7734f4147f, TABLE => {{NAME => 'crash_reports',
MAX_FILESIZE => '1073741824', FAMILIES => [{NAME => 'flags', BLOOMFILTER =>
'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '1', TTL =>
'2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}, {NAME => 'ids', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1',
VERSIONS => '1', COMPRESSION => 'LZO', TTL => '2147483647', BLOCKSIZE =>
'65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'meta_data',
BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', VERSIONS => '3', COMPRESSION
=> 'LZO', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}, {NAME => 'processed_data', BLOOMFILTER => 'NONE',
REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '3', TTL =>
'2147483647', BLOCKSIZE => '524288', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}, {NAME => 'raw_data', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1',
COMPRESSION => 'LZO', VERSIONS => '3', TTL => '2147483647', BLOCKSIZE =>
'524288', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'timestamps',
BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS
=> '1', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}]}}
11/08/19 23:41:46 WARN check_meta: hole after REGION => {NAME =>
'crash_reports,d110818d926b2f0-1620-4c00-b057-5bddf2110818,1313686340717.4a55c090329a685d18c03d91483dd9e4.',
STARTKEY => 'd110818d926b2f0-1620-4c00-b057-5bddf2110818', ENDKEY =>
'd110818dc9dcf1c-77cd-4d8d-907e-5f5902110818', ENCODED =>
4a55c090329a685d18c03d91483dd9e4, TABLE => {{NAME => 'crash_reports',
MAX_FILESIZE => '1073741824', FAMILIES => [{NAME => 'flags', BLOOMFILTER =>
'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '1', TTL =>
'2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}, {NAME => 'ids', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1',
VERSIONS => '1', COMPRESSION => 'LZO', TTL => '2147483647', BLOCKSIZE =>
'65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'meta_data',
BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', VERSIONS => '3', COMPRESSION
=> 'LZO', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}, {NAME => 'processed_data', BLOOMFILTER => 'NONE',
REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '3', TTL =>
'2147483647', BLOCKSIZE => '524288', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}, {NAME => 'raw_data', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1',
COMPRESSION => 'LZO', VERSIONS => '3', TTL => '2147483647', BLOCKSIZE =>
'524288', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'timestamps',
BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS
=> '1', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}]}}
11/08/19 23:41:46 WARN check_meta: hole after REGION => {NAME =>
'crash_reports,d110818dc9dcf1c-77cd-4d8d-907e-5f5902110818,1313725142834.938f334ca6399ce5a17d33dc1a045d8d.',
STARTKEY => 'd110818dc9dcf1c-77cd-4d8d-907e-5f5902110818', ENDKEY =>
'd110818de521594-7a61-4e3a-8332-155db2110818', ENCODED =>
938f334ca6399ce5a17d33dc1a045d8d, TABLE => {{NAME => 'crash_reports',
MAX_FILESIZE => '1073741824', FAMILIES => [{NAME => 'flags', BLOOMFILTER =>
'NONE', REPLICATION_SCOPE => '1', VERSIONS => '1', COMPRESSION => 'LZO', TTL =>
'2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}, {NAME => 'ids', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1',
COMPRESSION => 'LZO', VERSIONS => '1', TTL => '2147483647', BLOCKSIZE =>
'65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'meta_data',
BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS
=> '3', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}, {NAME => 'processed_data', BLOOMFILTER => 'NONE',
REPLICATION_SCOPE => '1', VERSIONS => '3', COMPRESSION => 'LZO', TTL =>
'2147483647', BLOCKSIZE => '524288', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}, {NAME => 'raw_data', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1',
VERSIONS => '3', COMPRESSION => 'LZO', TTL => '2147483647', BLOCKSIZE =>
'524288', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'timestamps',
BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', VERSIONS => '1', COMPRESSION
=> 'LZO', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}]}}
11/08/19 23:41:46 WARN check_meta: hole after REGION => {NAME =>
'crash_reports,d110818dc9dcf1c-77cd-4d8d-907e-5f5902110818,1313794261476.f5804f5529388eb35a81e47256e70115.',
STARTKEY => 'd110818dc9dcf1c-77cd-4d8d-907e-5f5902110818', ENDKEY =>
'd110819d3fd17c7-69aa-411d-a7d7-4169b2110819', ENCODED =>
f5804f5529388eb35a81e47256e70115, TABLE => {{NAME => 'crash_reports',
MAX_FILESIZE => '1073741824', FAMILIES => [{NAME => 'flags', BLOOMFILTER =>
'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '1', TTL =>
'2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}, {NAME => 'ids', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1',
VERSIONS => '1', COMPRESSION => 'LZO', TTL => '2147483647', BLOCKSIZE =>
'65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'meta_data',
BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', VERSIONS => '3', COMPRESSION
=> 'LZO', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}, {NAME => 'processed_data', BLOOMFILTER => 'NONE',
REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS => '3', TTL =>
'2147483647', BLOCKSIZE => '524288', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}, {NAME => 'raw_data', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1',
COMPRESSION => 'LZO', VERSIONS => '3', TTL => '2147483647', BLOCKSIZE =>
'524288', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'timestamps',
BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS
=> '1', TTL => '2147483debug2: channel 0: window 999152 sent adjust 49424
647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}}
orts', MAX_FILESIZE => '1073741824', FAMILIES => [{NAME => 'flags', BLOOMFILTER
=> 'NONE', REPLICATION_SCOPE => '1', VERSIONS => '1', COMPRESSION => 'LZO', TTL
=> '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}, {NAME => 'ids', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1',
COMPRESSION => 'LZO', VERSIONS => '1', TTL => '2147483647', BLOCKSIZE =>
'65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'meta_data',
BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', COMPRESSION => 'LZO', VERSIONS
=> '3', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}, {NAME => 'processed_data', BLOOMFILTER => 'NONE',
REPLICATION_SCOPE => '1', VERSIONS => '3', COMPRESSION => 'LZO', TTL =>
'2147483647', BLOCKSIZE => '524288', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}, {NAME => 'raw_data', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1',
VERSIONS => '3', COMPRESSION => 'LZO', TTL => '2147483647', BLOCKSIZE =>
'524288', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'timestamps',
BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '1', VERSIONS => '1', COMPRESSION
=> 'LZO', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}]}}
{code}
> improve hbck tool to fix .META. hole issue.
> -------------------------------------------
>
> Key: HBASE-4122
> URL: https://issues.apache.org/jira/browse/HBASE-4122
> Project: HBase
> Issue Type: Improvement
> Reporter: feng xu
> Fix For: 0.94.0
>
> Attachments: HBASE-4122.patch, check_meta.rb
>
>
> hbase hbck tool can check the META hole, but it can not fix this problem by
> --fix.
> I plan to improve the tool.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
