Ke Han created HDFS-17686:
-----------------------------
Summary: Inconsistent read results when upgrading cluster from
3.2.4 to 3.4.1
Key: HDFS-17686
URL: https://issues.apache.org/jira/browse/HDFS-17686
Project: Hadoop HDFS
Issue Type: Bug
Components: namenode
Affects Versions: 3.2.4, 3.4.1
Reporter: Ke Han
h1. Symptoms
When migrating HDFS cluster from 3.2.4 to 3.4.1, I observed that the
modification time of my folder can be inconsistent after the upgrade process.
h1. Reproduce
This can be reproduced deterministically with the following steps
Step1: Put the folder pVfezjff (attached) under tmp
Step2: Start up HDFS cluster 3.2.4 (1NN, 1SNN, 1DN), execute the following
commands
{code:java}
dfs -touchz /qxcKOnNw/ZtbuVsPJYFCsuPBrpE.txt
dfs -touchz /qxcKOnNw/ZtbuVsPJYFCsuPBrpE.yaml
dfs -appendToFile /tmp/upfuzz/hdfs/pVfezjff/ote /qxcKOnNw/ZtbuVsPJYFCsuPBrpE.txt
dfs -cp -f -p -d /qxcKOnNw/ /qxcKOnNw/
dfs -cp -f /qxcKOnNw/ZtbuVsPJYFCsuPBrpE.yaml /qxcKOnNw/
dfsadmin -disallowSnapshot /qxcKOnNw/
dfs -put -f /tmp/upfuzz/hdfs/pVfezjff/fhpetiuf /qxcKOnNw/
dfsadmin -allowSnapshot /qxcKOnNw/
dfs -cp -p -d /qxcKOnNw/ /qxcKOnNw/
dfs -cp -f -p /qxcKOnNw/ /qxcKOnNw/
dfs -createSnapshot /qxcKOnNw/
{code}
Execute a read in the old version
{code:java}
dfs -stat "%y" /qxcKOnNw/
"2024-12-06 20:00:02"{code}
Then stop the entire cluster and upgrade to 3.4.1 (1NN, 1SNN, 1DN), execute
another read:
{code:java}
dfs -stat "%y" /qxcKOnNw/
"2024-12-06 20:00:00"{code}
The modification time is inconsistent with the one before the upgrade.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
