[
https://issues.apache.org/jira/browse/HDFS-16922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17690255#comment-17690255
]
ASF GitHub Bot commented on HDFS-16922:
---------------------------------------
hfutatzhanghb commented on PR #5398:
URL: https://github.com/apache/hadoop/pull/5398#issuecomment-1434306589
Some UT logs are below:
```
2023-02-17 16:36:12,647 [DataXceiver for client
DFSClient_NONMAPREDUCE_-734351046_1 at /127.0.0.1:62549 [Receiving block
BP-888771553-172.16.26.102-1676622957798:blk_1073741825_1001]] INFO
datanode.DataNode (DataXceiver.java:writeBlock(932)) - Received
BP-888771553-172.16.26.102-1676622957798:blk_1073741825_1003 src:
/127.0.0.1:62549 dest: /127.0.0.1:62490 volume:
/Users/admin/IdeaProjects/hadoop_community/hadoop-hdfs-project/hadoop-hdfs/target/test/data/dfs/data/data5
of size 22
2023-02-17 16:36:12,652 [DataXceiver for client
DFSClient_NONMAPREDUCE_-734351046_1 at /127.0.0.1:62548 [Receiving block
BP-888771553-172.16.26.102-1676622957798:blk_1073741825_1001]] INFO
datanode.DataNode (DataXceiver.java:writeBlock(932)) - Received
BP-888771553-172.16.26.102-1676622957798:blk_1073741825_1002 src:
/127.0.0.1:62548 dest: /127.0.0.1:624
2023-02-17 16:36:16,633 [ibr-executor-0] WARN
datanode.IncrementalBlockReportManager
(IncrementalBlockReportManager.java:sendIBRs(211)) - zhb#sendIBRs reports
length is 1, report is
[DatanodeStorage[DS-30587342-b739-4417-a374-5b282565b03a,DISK,NORMAL][blk_1073741825_1002,
status: RECEIVED_BLOCK, delHint: null]]
2023-02-17 16:36:16,633 [ibr-executor-0] WARN
datanode.IncrementalBlockReportManager
(IncrementalBlockReportManager.java:sendIBRs(211)) - zhb#sendIBRs reports
length is 1, report is
[DatanodeStorage[DS-b0d4b422-d757-4d1c-8ec7-a08f69a93f09,DISK,NORMAL][blk_1073741825_1002,
status: RECEIVED_BLOCK, delHint: null]]
```
As the above logs show: the datanode received blk_1073741825_1003 and
blk_1073741825_1002 in one IBR interval, but it remove the
ReceivedDeletedBlockInfo info of blk_1073741825_1003.
should i open a new PR to upload the UT?
> The logic of IncrementalBlockReportManager#addRDBI method may cause missing
> blocks when cluster is busy.
> --------------------------------------------------------------------------------------------------------
>
> Key: HDFS-16922
> URL: https://issues.apache.org/jira/browse/HDFS-16922
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: datanode
> Reporter: ZhangHB
> Priority: Major
> Labels: pull-request-available
>
> The current logic of IncrementalBlockReportManager# addRDBI method could lead
> to the missing blocks when datanodes in pipeline are I/O busy.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
