Vladislav Timchenko created HBASE-28664:
-------------------------------------------
Summary: [HBASE] The Archives folder in the HBASE root directory
starts to grow uncontrollably under load
Key: HBASE-28664
URL: https://issues.apache.org/jira/browse/HBASE-28664
Project: HBase
Issue Type: Bug
Reporter: Vladislav Timchenko
If there are empty .snapshotinfo and data.manifest in .hbase-snapshot dir, we
got a lot of this warns on master server
WARN [snapshot-hfile-cleaner-cache-refresher] snapshot.SnapshotFileCache:
Failed to refresh snapshot hfile cache!
org.apache.hadoop.hbase.snapshot.CorruptedSnapshotException: Couldn't read
snapshot info
from:hdfs://host/apps/hbase/data/.hbase-snapshot/test/.snapshotinfo
{color:#172b4d}how to reproduce:{color}
* {color:#172b4d}create a folder (for example snap2) at the path
/apps/base/data/.base-snapshot {color}
* {color:#172b4d}create two empty files there: .snapshotinfo data.manifest
{color}
* {color:#172b4d}give a load, for example like this: hbase lt -write 1:10:100
-num_keys 1000000 -read 100:30 -num_tablets 20 -data_block_encoding NONE -tn
load_test_tool {color}
* {color:#172b4d}wait... {color}
* {color:#172b4d}the /apps/base/data/archive folder will start to grow
(approximately to the size of /apps/base/data/data) {color}
* {color:#172b4d}if you delete the previously created snap2 folder, the size
of /aps/base/data/archive will return to its original state{color}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
