ruiliang created HDFS-17628:
-------------------------------
Summary: hdfs ec datanode Decommissioning Stuck and some blk
Decommissioning to many nodes indefinitely
Key: HDFS-17628
URL: https://issues.apache.org/jira/browse/HDFS-17628
Project: Hadoop HDFS
Issue Type: Bug
Components: ec, hdfs
Affects Versions: 3.1.1
Reporter: ruiliang
Attachments: image-2024-09-20-10-47-10-051.png
When the datanode decommissioning reaches the last few blocks, the stuck phase
is processed, and there are unlimited decommissioning cases when viewing the
log. The md5 values of physical blocks on each node are consistent, indicating
that block replication is indeed performed. Has this issue been fixed? Is there
a patch available to fix it? thank you
!image-2024-09-20-10-47-10-051.png!
log
{code:java}
xx-dn-12-67-49.hiido.host.xx.xx.com is DECOMMISSIONING
grep 9223372036628464382_15347979 xxx-hdfs-datanode.log
2024-09-20 10:13:32,097 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.65.86:1019
2024-09-20 10:13:32,264 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.65.86:1019
2024-09-20 10:13:35,096 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.66.30:1019
2024-09-20 10:13:35,519 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.66.30:1019
2024-09-20 10:13:38,096 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.78.39:1019
2024-09-20 10:13:38,510 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.78.39:1019
2024-09-20 10:13:44,095 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.66.85:1019
2024-09-20 10:13:44,599 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.66.85:1019
2024-09-20 10:13:50,097 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.67.42:1019
2024-09-20 10:13:50,514 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.67.42:1019
2024-09-20 10:13:53,095 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.66.10:1019
2024-09-20 10:13:53,604 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.66.10:1019
2024-09-20 10:13:56,096 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.66.70:1019
2024-09-20 10:13:56,578 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.66.70:1019
2024-09-20 10:13:59,095 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.65.63:1019
2024-09-20 10:13:59,536 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.65.63:1019
2024-09-20 10:14:02,096 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.66.61:1019
2024-09-20 10:14:02,867 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.66.61:1019
2024-09-20 10:14:05,096 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.65.184:1019
2024-09-20 10:14:05,825 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.65.184:1019
2024-09-20 10:14:11,096 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.66.116:1019
2024-09-20 10:14:11,473 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.66.116:1019
2024-09-20 10:14:14,095 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.64.60:1019
2024-09-20 10:14:14,463 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.64.60:1019
2024-09-20 10:14:17,096 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.78.148:1019
2024-09-20 10:14:17,487 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.78.148:1019
2024-09-20 10:14:20,096 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.65.197:1019
2024-09-20 10:14:20,819 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.65.197:1019
2024-09-20 10:14:23,095 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.66.2:1019
2024-09-20 10:14:23,493 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.66.2:1019
2024-09-20 10:14:26,096 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.66.213:1019
2024-09-20 10:14:26,517 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.66.213:1019
2024-09-20 10:14:32,096 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.65.246:1019
2024-09-20 10:14:32,465 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.65.246:1019
2024-09-20 10:14:38,095 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.66.32:1019
2024-09-20 10:14:38,463 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.66.32:1019
2024-09-20 10:14:41,096 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.67.38:1019
2024-09-20 10:14:41,553 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.67.38:1019
2024-09-20 10:14:44,097 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.64.57:1019
2024-09-20 10:14:44,502 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.64.57:1019
2024-09-20 10:14:47,136 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.17.26:1019
2024-09-20 10:14:47,560 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.17.26:1019
2024-09-20 10:14:50,096 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.66.49:1019
2024-09-20 10:14:50,524 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.66.49:1019
2024-09-20 10:14:53,101 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.12.210:1019
2024-09-20 10:14:53,607 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.12.210:1019
2024-09-20 10:14:59,096 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.67.53:1019
2024-09-20 10:14:59,463 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.67.53:1019
2024-09-20 10:15:05,096 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.67.95:1019
2024-09-20 10:15:05,553 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.67.95:1019
2024-09-20 10:15:08,096 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.12.200:1019
2024-09-20 10:15:08,477 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.12.200:1019
2024-09-20 10:15:11,096 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.67.87:1019
2024-09-20 10:15:11,467 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.67.87:1019
2024-09-20 10:15:14,095 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.66.204:1019
2024-09-20 10:15:14,466 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.66.204:1019
2024-09-20 10:15:17,096 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.66.80:1019
2024-09-20 10:15:17,574 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.66.80:1019
2024-09-20 10:15:20,096 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.65.185:1019
2024-09-20 10:15:20,464 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.65.185:1019
2024-09-20 10:15:26,095 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.65.130:1019
2024-09-20 10:15:26,462 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.65.130:1019
2024-09-20 10:15:32,096 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.66.207:1019
2024-09-20 10:15:32,610 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.66.207:1019
2024-09-20 10:15:35,096 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.65.135:1019
2024-09-20 10:15:35,475 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.65.135:1019
2024-09-20 10:15:38,096 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.15.154:1019
2024-09-20 10:15:38,491 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.15.154:1019
2024-09-20 10:15:41,096 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.64.55:1019
2024-09-20 10:15:41,456 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.64.55:1019
2024-09-20 10:15:44,096 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.65.6:1019
2024-09-20 10:15:44,480 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.65.6:1019
2024-09-20 10:15:47,095 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.67.3:1019
2024-09-20 10:15:47,471 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.67.3:1019
2024-09-20 10:15:53,096 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.78.201:1019
2024-09-20 10:15:53,485 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.78.201:1019
2024-09-20 10:15:59,096 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.17.35:1019
2024-09-20 10:15:59,622 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.17.35:1019
2024-09-20 10:16:02,096 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.65.29:1019
2024-09-20 10:16:02,465 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.65.29:1019
2024-09-20 10:16:05,096 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.15.163:1019
2024-09-20 10:16:05,689 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.15.163:1019
2024-09-20 10:16:08,096 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.65.119:1019
2024-09-20 10:16:08,538 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.65.119:1019
2024-09-20 10:16:11,095 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.65.218:1019
2024-09-20 10:16:12,460 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.65.218:1019
2024-09-20 10:16:17,096 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.77.54:1019
2024-09-20 10:16:17,685 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.77.54:1019
2024-09-20 10:16:23,178 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.64.154:1019
2024-09-20 10:16:23,499 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.64.154:1019
2024-09-20 10:16:26,096 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.17.27:1019
2024-09-20 10:16:26,407 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.17.27:1019
2024-09-20 10:16:32,684 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.65.81:1019
2024-09-20 10:16:33,337 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.65.81:1019
2024-09-20 10:16:38,684 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.65.154:1019
2024-09-20 10:16:39,102 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.65.154:1019
2024-09-20 10:16:41,685 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.66.164:1019
2024-09-20 10:16:42,301 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.66.164:1019
2024-09-20 10:16:44,684 INFO datanode.DataNode
(DataNode.java:transferBlock(2328)) - DatanodeRegistration(10.12.67.49:1019,
datanodeUuid=e73eb2ed-634b-40bd-a110-21ce485b329c, infoPort=1022,
infoSecurePort=0, ipcPort=38010,
storageInfo=lv=-57;cid=CID-1becf536-8c05-40cb-a1ff-106923139c5c;nsid=848315649;c=1660893388633)
Starting thread to transfer
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979 to
10.12.64.11:1019
2024-09-20 10:16:45,100 INFO datanode.DataNode (DataNode.java:run(2541)) -
DataTransfer, at xx-dn-12-67-49.hiido.host.xx.xx.com:1019: Transmitted
BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464382_15347979
(numBytes=83886080) to /10.12.64.11:1019
root@xx-dn-12-67-49:/data/logs/hadoop/hdfs#
root@xx-dn-12-67-49:/data/logs/hadoop/hdfs# grep 9223372036628464382
hadoop-hdfs-root-datanode-xx-dn-12-67-49.hiido.host.xx.xx.com.log | wc -l
106hdfs fsck -fs hdfs://xxcluster06 -blockId blk_-9223372036628464382
Connecting to namenode via
http://xx-xxcluster06-xxnn2.hiido.host.xx.xx.com:50070/fsck?ugi=hdev&blockId=blk_-9223372036628464382+&path=%2F
FSCK started by hdev (auth:KERBEROS_SSL) from /10.12.67.139 at Fri Sep 20
10:17:30 CST 2024Block Id: blk_-9223372036628464382
Block belongs to:
/hive_warehouse/hiidosdk.db/xx_mbsdkevent_hour_original/dt=20220518/hour=22/part-00385-f56fc28c-d57b-4f07-94dd-924567379ac8.c000
No. of Expected Replica: 5
No. of live Replica: 4
No. of excess Replica: 0
No. of stale Replica: 0
No. of decommissioned Replica: 0
No. of decommissioning Replica: 2
No. of corrupted Replica: 0
Block replica on datanode/rack: xx-dn-12-66-198.hiido.host.xx.xx.com/4F08-15-12
is HEALTHY
Block replica on datanode/rack: xx-dn-12-66-63.hiido.host.xx.xx.com/4F08-06-06
is HEALTHY
Block replica on datanode/rack: xx-dn-12-64-54.hiido.host.xx.xx.com/4F08-07-17
is HEALTHY
Block replica on datanode/rack: xx-dn-12-67-36.hiido.host.xx.xx.com/4F08-02-15
is HEALTHY
Block replica on datanode/rack: xx-dn-12-66-18.hiido.host.xx.xx.com/4F08-01-09
is HEALTHY
Block replica on datanode/rack: xx-dn-12-67-40.hiido.host.xx.xx.com/4F08-02-02
is HEALTHY
Block replica on datanode/rack: xx-dn-12-66-72.hiido.host.xx.xx.com/4F08-06-02
is HEALTHY
Block replica on datanode/rack: xx-dn-12-11-96.hiido.host.xx.xx.com/4F08-06-12
is HEALTHY
Block replica on datanode/rack: xx-dn-12-18-224.hiido.host.xx.xx.com/4F08-03-06
is HEALTHY
Block replica on datanode/rack: xx-dn-12-14-168.hiido.host.xx.xx.com/4F08-05-11
is HEALTHY
Block replica on datanode/rack: xx-dn-12-64-11.hiido.host.xx.xx.com/4F08-08-15
is HEALTHY
Block replica on datanode/rack: xx-dn-12-66-164.hiido.host.xx.xx.com/4F08-01-15
is HEALTHY
Block replica on datanode/rack: xx-dn-12-65-154.hiido.host.xx.xx.com/4F08-04-13
is HEALTHY
Block replica on datanode/rack: xx-dn-12-65-81.hiido.host.xx.xx.com/4F08-03-11
is HEALTHY
Block replica on datanode/rack: xx-dn-12-17-27.hiido.host.xx.xx.com/4F08-03-01
is HEALTHY
Block replica on datanode/rack: xx-dn-12-64-154.hiido.host.xx.xx.com/4F08-08-13
is HEALTHY
Block replica on datanode/rack: xx-dn-12-77-54.hiido.host.xx.xx.com/4F08-10-04
is HEALTHY
Block replica on datanode/rack: xx-dn-12-65-218.hiido.host.xx.xx.com/4F08-12-04
is HEALTHY
Block replica on datanode/rack: xx-dn-12-65-119.hiido.host.xx.xx.com/4F08-04-14
is HEALTHY
Block replica on datanode/rack: xx-dn-12-15-163.hiido.host.xx.xx.com/4F08-05-15
is HEALTHY
Block replica on datanode/rack: xx-dn-12-65-29.hiido.host.xx.xx.com/4F08-07-15
is HEALTHY
Block replica on datanode/rack: xx-dn-12-17-35.hiido.host.xx.xx.com/4F08-03-03
is HEALTHY
Block replica on datanode/rack: xx-dn-12-78-201.hiido.host.xx.xx.com/4F08-15-06
is HEALTHY
Block replica on datanode/rack: xx-dn-12-67-3.hiido.host.xx.xx.com/4F08-12-10
is HEALTHY
Block replica on datanode/rack: xx-dn-12-65-6.hiido.host.xx.xx.com/4F08-01-13
is HEALTHY
Block replica on datanode/rack: xx-dn-12-64-55.hiido.host.xx.xx.com/4F08-07-17
is HEALTHY
Block replica on datanode/rack: xx-dn-12-15-154.hiido.host.xx.xx.com/4F08-05-13
is HEALTHY
Block replica on datanode/rack: xx-dn-12-65-135.hiido.host.xx.xx.com/4F08-07-14
is HEALTHY
Block replica on datanode/rack: xx-dn-12-66-207.hiido.host.xx.xx.com/4F08-15-05
is HEALTHY
Block replica on datanode/rack: xx-dn-12-65-130.hiido.host.xx.xx.com/4F08-12-03
is HEALTHY
Block replica on datanode/rack: xx-dn-12-65-185.hiido.host.xx.xx.com/4F08-15-10
is HEALTHY
Block replica on datanode/rack: xx-dn-12-66-80.hiido.host.xx.xx.com/4F08-06-01
is HEALTHY
Block replica on datanode/rack: xx-dn-12-66-204.hiido.host.xx.xx.com/4F08-15-04
is HEALTHY
Block replica on datanode/rack: xx-dn-12-67-87.hiido.host.xx.xx.com/4F08-10-03
is HEALTHY
Block replica on datanode/rack: xx-dn-12-12-200.hiido.host.xx.xx.com/4F08-05-05
is HEALTHY
Block replica on datanode/rack: xx-dn-12-67-95.hiido.host.xx.xx.com/4F08-10-01
is HEALTHY
Block replica on datanode/rack: xx-dn-12-67-53.hiido.host.xx.xx.com/4F08-02-14
is HEALTHY
Block replica on datanode/rack: xx-dn-12-12-210.hiido.host.xx.xx.com/4F08-05-04
is HEALTHY
Block replica on datanode/rack: xx-dn-12-66-49.hiido.host.xx.xx.com/4F08-06-04
is HEALTHY
Block replica on datanode/rack: xx-dn-12-17-26.hiido.host.xx.xx.com/4F08-03-02
is HEALTHY
Block replica on datanode/rack: xx-dn-12-64-57.hiido.host.xx.xx.com/4F08-07-16
is HEALTHY
Block replica on datanode/rack: xx-dn-12-67-38.hiido.host.xx.xx.com/4F08-02-15
is HEALTHY
Block replica on datanode/rack: xx-dn-12-66-32.hiido.host.xx.xx.com/4F08-12-07
is HEALTHY
Block replica on datanode/rack: xx-dn-12-65-246.hiido.host.xx.xx.com/4F08-01-08
is HEALTHY
Block replica on datanode/rack: xx-dn-12-66-213.hiido.host.xx.xx.com/4F08-12-08
is HEALTHY
Block replica on datanode/rack: xx-dn-12-66-2.hiido.host.xx.xx.com/4F08-01-09
is HEALTHY
Block replica on datanode/rack: xx-dn-12-65-197.hiido.host.xx.xx.com/4F08-15-12
is HEALTHY
Block replica on datanode/rack: xx-dn-12-78-148.hiido.host.xx.xx.com/4F08-11-14
is HEALTHY
Block replica on datanode/rack: xx-dn-12-64-60.hiido.host.xx.xx.com/4F08-07-18
is HEALTHY
Block replica on datanode/rack: xx-dn-12-66-116.hiido.host.xx.xx.com/4F08-06-08
is HEALTHY
Block replica on datanode/rack: xx-dn-12-65-184.hiido.host.xx.xx.com/4F08-15-11
is HEALTHY
Block replica on datanode/rack: xx-dn-12-66-61.hiido.host.xx.xx.com/4F08-06-06
is HEALTHY
Block replica on datanode/rack: xx-dn-12-65-63.hiido.host.xx.xx.com/4F08-12-06
is HEALTHY
Block replica on datanode/rack: xx-dn-12-66-70.hiido.host.xx.xx.com/4F08-06-05
is HEALTHY
Block replica on datanode/rack: xx-dn-12-66-10.hiido.host.xx.xx.com/4F08-01-07
is HEALTHY
Block replica on datanode/rack: xx-dn-12-67-42.hiido.host.xx.xx.com/4F08-02-02
is HEALTHY
Block replica on datanode/rack: xx-dn-12-66-85.hiido.host.xx.xx.com/4F08-06-03
is HEALTHY
Block replica on datanode/rack: xx-dn-12-78-39.hiido.host.xx.xx.com/4F08-11-15
is HEALTHY
Block replica on datanode/rack: xx-dn-12-66-30.hiido.host.xx.xx.com/4F08-12-05
is HEALTHY
Block replica on datanode/rack: xx-dn-12-67-11.hiido.host.xx.xx.com/4F08-02-13
is HEALTHY
Block replica on datanode/rack: xx-dn-12-65-86.hiido.host.xx.xx.com/4F08-03-10
is HEALTHY
Block replica on datanode/rack: xx-dn-12-66-226.hiido.host.xx.xx.com/4F08-02-03
is HEALTHY
Block replica on datanode/rack: xx-dn-12-64-23.hiido.host.xx.xx.com/4F08-12-09
is HEALTHY
Block replica on datanode/rack: xx-dn-12-67-21.hiido.host.xx.xx.com/4F08-02-15
is DECOMMISSIONING
Block replica on datanode/rack: xx-dn-12-67-49.hiido.host.xx.xx.com/4F08-02-14
is DECOMMISSIONING
Block replica on datanode/rack: xx-dn-12-65-9.hiido.host.xx.xx.com/4F08-07-10
is HEALTHY
Block replica on datanode/rack: xx-dn-12-66-78.hiido.host.xx.xx.com/4F08-06-02
is HEALTHY
hdfs fsck -fs hdfs://yycluster06
/hive_warehouse/hiidosdk.db/yy_mbsdkevent_hour_original/dt=20220518/hour=22/part-00385-f56fc28c-d57b-4f07-94dd-924567379ac8.c000
-files -blocks -locations
Connecting to namenode via
http://fs-hiido-yycluster06-yynn2.hiido.host.int.yy.com:50070/fsck?ugi=hdfs&files=1&blocks=1&locations=1&path=%2Fhive_warehouse%2Fhiidosdk.db%2Fyy_mbsdkevent_hour_original%2Fdt%3D20220518%2Fhour%3D22%2Fpart-00385-f56fc28c-d57b-4f07-94dd-924567379ac8.c000
FSCK started by hdfs (auth:KERBEROS_SSL) from /10.12.67.139 for path
/hive_warehouse/hiidosdk.db/yy_mbsdkevent_hour_original/dt=20220518/hour=22/part-00385-f56fc28c-d57b-4f07-94dd-924567379ac8.c000
at Fri Sep 20 10:35:17 CST 2024
/hive_warehouse/hiidosdk.db/yy_mbsdkevent_hour_original/dt=20220518/hour=22/part-00385-f56fc28c-d57b-4f07-94dd-924567379ac8.c000
252934304 bytes, erasure-coded: policy=RS-3-2-1024k, 1 block(s): OK
0. BP-1822992414-10.12.65.48-1660893388633:blk_-9223372036628464384_15347979
len=252934304 Live_repl=4 [
blk_-9223372036628464384:DatanodeInfoWithStorage[10.12.66.78:1019,DS-d1a774aa-29dd-4b49-9407-07e2237cb7a3,DISK],
blk_-9223372036628464383:DatanodeInfoWithStorage[10.12.65.9:1019,DS-c016e4ab-718a-44eb-b576-954d024defb0,DISK],
blk_-9223372036628464381:DatanodeInfoWithStorage[10.12.67.21:1019,DS-0750bdd6-570b-42c6-b365-571da8bba39b,DISK],
blk_-9223372036628464380:DatanodeInfoWithStorage[10.12.64.23:1019,DS-b7b950e0-0f12-4230-ad00-31f3bc5ffd05,DISK],
blk_-9223372036628464380:DatanodeInfoWithStorage[10.12.66.226:1019,DS-1d2eb6e6-4401-4478-ad78-3023f4182615,DISK],
blk_-9223372036628464382:DatanodeInfoWithStorage[10.12.65.86:1019,DS-5719776d-0791-44c3-afe3-50c452e391be,DISK],
blk_-9223372036628464382:DatanodeInfoWithStorage[10.12.67.11:1019,DS-acf5da44-d705-48fb-b344-44bd190e5978,DISK],
blk_-9223372036628464382:DatanodeInfoWithStorage[10.12.66.30:1019,DS-cf664e4d-45f6-4920-be16-6fb0d440d5fa,DISK],
blk_-9223372036628464382:DatanodeInfoWithStorage[10.12.78.39:1019,DS-355e926a-ae73-43e9-95a4-5d860ff6c9e5,DISK],
blk_-9223372036628464382:DatanodeInfoWithStorage[10.12.66.85:1019,DS-58f0420e-ea00-414a-840f-28f19c4e6b44,DISK],
blk_-9223372036628464382:DatanodeInfoWithStorage[10.12.67.42:1019,DS-0f6e5fbe-4551-4891-934f-24f94a57b886,DISK],
blk_-9223372036628464382:DatanodeInfoWithStorage[10.12.66.10:1019,DS-4a58cc26-9823-4db4-a696-00f9c28cef1c,DISK],
blk_-9223372036628464382:DatanodeInfoWithStorage[10.12.66.70:1019,DS-d748c49d-f14b-4a02-b464-473fe873fe93,DISK],
blk_-9223372036628464382:DatanodeInfoWithStorage[10.12.65.63:1019,DS-15c2b30e-9811-406b-86c2-7381c6c774b3,DISK],
blk_-9223372036628464382:DatanodeInfoWithStorage[10.12.66.61:1019,DS-95442f9c-6d31-468b-b4f1-6369867b932a,DISK],
blk_-9223372036628464382:DatanodeInfoWithStorage[10.12.65.184:1019,DS-302fc4a8-62e0-47f8-a5f8-5d9b306827be,DISK],
blk_-9223372036628464382:DatanodeInfoWithStorage[10.12.66.116:1019,DS-dcdcc06b-a70f-41d0-aaa0-ec004e593a39,DISK],
blk_-9223372036628464382:DatanodeInfoWithStorage[10.12.64.60:1019,DS-e9d3990e-be85-4196-a042-cbb5bde5536d,DISK],
blk_-9223372036628464382:DatanodeInfoWithStorage[10.12.78.148:1019,DS-75cce4cb-8c1b-4206-a5bc-9209ace4d94b,DISK],
blk_-9223372036628464382:DatanodeInfoWithStorage[10.12.65.197:1019,DS-680b5829-211a-4897-b8c1-e78a0d55cb00,DISK],
blk_-9223372036628464382:DatanodeInfoWithStorage[10.12.66.2:1019,DS-c8764492-b96f-4cf9-9206-90c48d1280fd,DISK],
blk_-9223372036628464382:DatanodeInfoWithStorage[10.12.66.213:1019,DS-a4b9c1cd-dc24-4b1c-86f3-e9e3992f85e9,DISK],
blk_-9223372036628464382:DatanodeInfoWithStorage[10.12.65.246:1019,DS-87643e61-8484-42b1-a62a-738d91f27f87,DISK],
blk_-9223372036628464382:DatanodeInfoWithStorage[10.12.66.32:1019,DS-c3b1bfd8-45c8-435b-a314-1ed8c2819de0,DISK],
blk_-9223372036628464382:DatanodeInfoWithStorage[10.12.67.38:1019,DS-d2346a26-14c4-41e9-b349-e198ab5b684e,DISK],
.....
.....
blk_-9223372036628464382:DatanodeInfoWithStorage[10.12.65.140:1019,DS-3f3f21b8-960f-49f7-86ab-d03947bc7aa9,DISK]]
Status: HEALTHY
Number of data-nodes: 310
Number of racks: 58
Total dirs: 0
Total symlinks: 0Replicated Blocks:
Total size: 0 B
Total files: 0
Total blocks (validated): 0
Minimally replicated blocks: 0
Over-replicated blocks: 0
Under-replicated blocks: 0
Mis-replicated blocks: 0
Default replication factor: 3
Average block replication: 0.0
Missing blocks: 0
Corrupt blocks: 0
Missing replicas: 0Erasure Coded Block Groups:
Total size: 252934304 B
Total files: 1
Total block groups (validated): 1 (avg. block group size 252934304 B)
Minimally erasure-coded block groups: 1 (100.0 %)
Over-erasure-coded block groups: 0 (0.0 %)
Under-erasure-coded block groups: 0 (0.0 %)
Unsatisfactory placement block groups: 0 (0.0 %)
Average block group size: 5.0
Missing block groups: 0
Corrupt block groups: 0
Missing internal blocks: 0 (0.0 %)
Decommissioning internal blocks: 1
FSCK ended at Fri Sep 20 10:35:17 CST 2024 in 1 milliseconds
The filesystem under path
'/hive_warehouse/hiidosdk.db/yy_mbsdkevent_hour_original/dt=20220518/hour=22/part-00385-f56fc28c-d57b-4f07-94dd-924567379ac8.c000'
is HEALTHY {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
