[
https://issues.apache.org/jira/browse/HDDS-11214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hemant Kumar resolved HDDS-11214.
---------------------------------
Fix Version/s: 1.5.0
Target Version/s: 1.5.0
Resolution: Fixed
> LOG files for RocksDB ops should be cleaned more frequently for heavy load
> --------------------------------------------------------------------------
>
> Key: HDDS-11214
> URL: https://issues.apache.org/jira/browse/HDDS-11214
> Project: Apache Ozone
> Issue Type: Bug
> Components: Ozone Manager, Snapshot
> Reporter: Jyotirmoy Sinha
> Assignee: Hemant Kumar
> Priority: Major
> Labels: ozone-snapshot, pull-request-available
> Fix For: 1.5.0
>
>
> LOG files for RocksDB ops should be cleaned more frequently for heavy load
> {code:java}
> $ sudo ls -lhat /var/lib/hadoop-ozone/om/data/om.db/ | grep LOG
> -rw-r--r--. 1 hdfs hdfs 51G Jul 14 00:58 LOG
> -rw-r--r--. 1 hdfs hdfs 28G Jul 13 05:27 LOG.old.1720873742994654
> -rw-r--r--. 1 hdfs hdfs 6.1G Jul 12 21:23 LOG.old.1720844684691659
> -rw-r--r--. 1 hdfs hdfs 5.7G Jul 12 19:05 LOG.old.1720836424956290
> -rw-r--r--. 1 hdfs hdfs 18G Jul 12 15:42 LOG.old.1720824277532908
> -rw-r--r--. 1 hdfs hdfs 3.8G Jul 12 10:36 LOG.old.1720805869296754
> -rw-r--r--. 1 hdfs hdfs 6.0G Jul 12 07:34 LOG.old.1720794964597898
> -rw-r--r--. 1 hdfs hdfs 2.3G Jul 12 01:36 LOG.old.1720773468503890
> -rw-r--r--. 1 hdfs hdfs 8.6M Jul 11 21:54 LOG.old.1720760149446571
> -rw-r--r--. 1 hdfs hdfs 213K Jul 11 04:06 LOG.old.1720696089213498
> -rw-r--r--. 1 hdfs hdfs 1.1M Jul 11 03:55 LOG.old.1720695671092044
> -rw-r--r--. 1 hdfs hdfs 196K Jul 11 03:00 LOG.old.1720692130837134
> -rw-r--r--. 1 hdfs hdfs 250K Jul 11 02:50 LOG.old.1720691744177530
> -rw-r--r--. 1 hdfs hdfs 524K Jul 11 02:36 LOG.old.1720690706184079
> -rw-r--r--. 1 hdfs hdfs 238K Jul 11 01:04 LOG.old.1720686429251615 {code}
> From above we see that these LOG files in the rocksdb also contributing
> significantly to the space usage. If the load is heavy, we should set
> aggressive cleanup of LOG in Rocksdb options.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@ozone.apache.org
For additional commands, e-mail: issues-h...@ozone.apache.org
