J.Andreina created HDFS-7821:
--------------------------------
Summary: After rolling upgrade total files and directories
displayed on UI does not match with actual value.
Key: HDFS-7821
URL: https://issues.apache.org/jira/browse/HDFS-7821
Project: Hadoop HDFS
Issue Type: Bug
Reporter: J.Andreina
Assignee: J.Andreina
Non Ha Cluster with one DN.
dfs.blockreport.intervalMsec =120000
dfs.datanode.directoryscan.interval = 120
Steps to Reproduce:
===================
Step 1: Write 11 files to HDFS.
Step 2: Prepare rolling upgrade using "hdfs dfsadmin -rollingUpgrade prepare"
Step 3: Shutdown SNN and NN . Start NN with the "hdfs namenode -rollingUpgrade
started" option.
Step 4: Executed "hdfs dfsadmin -shutdownDatanode <DATANODE_HOST:IPC_PORT>
upgrade" and restarted Datanode
Step 5: Write 3 files to hdfs ( block id assigned are : blk_1073741831_1007,
blk_1073741832_1008,blk_1073741833_1009 )
Step 6: Shutdown both NN and DN
Step 7: Start NNs with the "hdfs namenode -rollingUpgrade rollback" option.
Start DNs with the "-rollback" option.
Step 8: Write 3 files to hdfs.
Issue:
=======
On UI Total files and directories shown is 3 ( while the count is 14 )
Observations:
=============
1. fsck report shows 14.
{noformat}
Status: HEALTHY
Total size: 37944 B
Total dirs: 7
Total files: 7
Total symlinks: 0
Total blocks (validated): 6 (avg. block size 6324 B)
Minimally replicated blocks: 6 (100.0 %)
Over-replicated blocks: 0 (0.0 %)
Under-replicated blocks: 6 (100.0 %)
Mis-replicated blocks: 0 (0.0 %)
Default replication factor: 3
Average block replication: 1.0
Corrupt blocks: 0
Missing replicas: 12 (66.666664 %)
Number of data-nodes: 1
Number of racks: 1
FSCK ended at Mon Feb 23 16:38:38 CST 2015 in 6 milliseconds
{noformat}
2. Afer restart of Namenode , UI gets updated with the actual count .
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
