刘珍 created IOTDB-3734:
-------------------------

             Summary: [ wal delete ] No write operations, expired wal files 
will not be deleted
                 Key: IOTDB-3734
                 URL: https://issues.apache.org/jira/browse/IOTDB-3734
             Project: Apache IoTDB
          Issue Type: Improvement
          Components: mpp-cluster
            Reporter: 刘珍
            Assignee: Haiming Zhu


master_0701_b8efd24  ,MultiLeaderConsensus,3副本 3C3D
写入负载压力大,节点同步慢,wal文件会堆积(1个benchmark运行2小时,单个datanode上的某dataregion的wal文件夹大小达290多GB),
停止客户端写入,让iotdb 
同步完成,wal文件并不删除,{color:#DE350B}*只有再次发生写入操作,才会删除过期的wal文件,需优化。*{color}

复现流程
1. 192.168.10.62 / 66 / 68
schema_region_consensus_protocol_class=org.apache.iotdb.consensus.ratis.RatisConsensus
data_region_consensus_protocol_class=org.apache.iotdb.consensus.multileader.MultiLeaderConsensus
schema_replication_factor=3
data_replication_factor=3

2. 启动benchmark 见config.properties.1
运行2小时,停止benchmark。

3. 等待iotdb 同步数据完成。

查看过期的wal 并没有被删除。

4. benchmark运行config.properties.2
过期的wal文件才会被删除。



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to