Srinivasu Majeti created HDFS-17349:
---------------------------------------
Summary: evictWriters command does not seem to work effectively
Key: HDFS-17349
URL: https://issues.apache.org/jira/browse/HDFS-17349
Project: Hadoop HDFS
Issue Type: Bug
Reporter: Srinivasu Majeti
Post running {{evictWriters}} on Datanodes while decommissioning going on,
noticed the below messages being logged. That means {{evictWriters is
successfully issued to Datanode and it tried interrupting all xceivers.}}
{code:java}
2023-11-29 16:37:18,599 INFO org.apache.hadoop.hdfs.server.datanode.DataNode:
Evicting all writers.
2023-11-29 16:37:18,600 INFO org.apache.hadoop.hdfs.server.datanode.DataNode:
Stopped the writer:
NioInetPeer(Socket[addr=/10.4.33.104,port=42982,localport=9866])
2023-11-29 16:37:18,600 INFO org.apache.hadoop.hdfs.server.datanode.DataNode:
Stopped the writer:
NioInetPeer(Socket[addr=/10.4.35.105,port=43300,localport=9866])
2023-11-29 16:37:18,600 INFO org.apache.hadoop.hdfs.server.datanode.DataNode:
Stopped the writer:
NioInetPeer(Socket[addr=/10.4.33.60,port=59978,localport=9866]){code}
Even after we see "Stopped the writer: NioInetPeer(Socket[addr=/10.4.35.105",
we still see open files not released from 10.4.35.105, and decommission did not
progress.
{code:java}
$ hdfs dfsadmin -listOpenFiles -blockingDecommission -path=/
Client Host Client Name Open File Path
10.4.35.105 DFSClient_NONMAPREDUCE_-211169064_96
/warehouse/tablespace/managed/hive/sys.db/query_data/date=2023-11-28/hive_3162c2fd-cdd0-47f4-979c-d1c3263bfc86_1
10.4.35.149 DFSClient_NONMAPREDUCE_1084942995_59
/warehouse/tablespace/managed/hive/sys.db/query_data/date=2023-11-28/hive_2360faef-7894-41d9-a13c-57d70593583e_1{code}
We may need to either report if evictWriters successfully executed or failed by
checking for the actual status of xceivers.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
