[jira] [Assigned] (HDFS-3325) When configuring "dfs.namenode.safemode.threshold-pct" to a value greater or equal to 1 there is mismatch in the UI report
[ https://issues.apache.org/jira/browse/HDFS-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina reassigned HDFS-3325: Assignee: J.Andreina (was: Brandon Li) > When configuring "dfs.namenode.safemode.threshold-pct" to a value greater or > equal to 1 there is mismatch in the UI report > -- > > Key: HDFS-3325 > URL: https://issues.apache.org/jira/browse/HDFS-3325 > Project: Hadoop HDFS > Issue Type: Bug >Affects Versions: 2.0.0-alpha >Reporter: J.Andreina >Assignee: J.Andreina >Priority: Minor > Attachments: HDFS-3325.1.patch > > > When dfs.namenode.safemode.threshold-pct is configured to n > Namenode will be in safemode until n percentage of blocks that should satisfy > the minimal replication requirement defined by > dfs.namenode.replication.min is reported to namenode > But in UI it displays that n percentage of total blocks + 1 blocks are > additionally needed > to come out of the safemode > Scenario 1: > > Configurations: > dfs.namenode.safemode.threshold-pct = 2 > dfs.replication = 2 > dfs.namenode.replication.min =2 > Step 1: Start NN,DN1,DN2 > Step 2: Write a file "a.txt" which has got 167 blocks > step 3: Stop NN,DN1,DN2 > Step 4: start NN > In UI report the Number of blocks needed to come out of safemode and number > of blocks actually present is different. > {noformat} > Cluster Summary > Security is OFF > Safe mode is ON. The reported blocks 0 needs additional 335 blocks to reach > the threshold 2. of total blocks 167. Safe mode will be turned off > automatically. > 2 files and directories, 167 blocks = 169 total. > Heap Memory used 57.05 MB is 2% of Commited Heap Memory 2 GB. Max Heap Memory > is 2 GB. > Non Heap Memory used 23.37 MB is 17% of Commited Non Heap Memory 130.44 MB. > Max Non Heap Memory is 176 MB.{noformat} > Scenario 2: > === > Configurations: > dfs.namenode.safemode.threshold-pct = 1 > dfs.replication = 2 > dfs.namenode.replication.min =2 > Step 1: Start NN,DN1,DN2 > Step 2: Write a file "a.txt" which has got 167 blocks > step 3: Stop NN,DN1,DN2 > Step 4: start NN > In UI report the Number of blocks needed to come out of safemode and number > of blocks actually present is different > {noformat} > Cluster Summary > Security is OFF > Safe mode is ON. The reported blocks 0 needs additional 168 blocks to reach > the threshold 1. of total blocks 167. Safe mode will be turned off > automatically. > 2 files and directories, 167 blocks = 169 total. > Heap Memory used 56.2 MB is 2% of Commited Heap Memory 2 GB. Max Heap Memory > is 2 GB. > Non Heap Memory used 23.37 MB is 17% of Commited Non Heap Memory 130.44 MB. > Max Non Heap Memory is 176 MB.{noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (HDFS-3325) When configuring "dfs.namenode.safemode.threshold-pct" to a value greater or equal to 1 there is mismatch in the UI report
[ https://issues.apache.org/jira/browse/HDFS-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li reassigned HDFS-3325: Assignee: Brandon Li (was: Hari Mankude) > When configuring "dfs.namenode.safemode.threshold-pct" to a value greater or > equal to 1 there is mismatch in the UI report > -- > > Key: HDFS-3325 > URL: https://issues.apache.org/jira/browse/HDFS-3325 > Project: Hadoop HDFS > Issue Type: Bug >Affects Versions: 2.0.0-alpha >Reporter: J.Andreina >Assignee: Brandon Li >Priority: Minor > > When dfs.namenode.safemode.threshold-pct is configured to n > Namenode will be in safemode until n percentage of blocks that should satisfy > the minimal replication requirement defined by > dfs.namenode.replication.min is reported to namenode > But in UI it displays that n percentage of total blocks + 1 blocks are > additionally needed > to come out of the safemode > Scenario 1: > > Configurations: > dfs.namenode.safemode.threshold-pct = 2 > dfs.replication = 2 > dfs.namenode.replication.min =2 > Step 1: Start NN,DN1,DN2 > Step 2: Write a file "a.txt" which has got 167 blocks > step 3: Stop NN,DN1,DN2 > Step 4: start NN > In UI report the Number of blocks needed to come out of safemode and number > of blocks actually present is different. > {noformat} > Cluster Summary > Security is OFF > Safe mode is ON. The reported blocks 0 needs additional 335 blocks to reach > the threshold 2. of total blocks 167. Safe mode will be turned off > automatically. > 2 files and directories, 167 blocks = 169 total. > Heap Memory used 57.05 MB is 2% of Commited Heap Memory 2 GB. Max Heap Memory > is 2 GB. > Non Heap Memory used 23.37 MB is 17% of Commited Non Heap Memory 130.44 MB. > Max Non Heap Memory is 176 MB.{noformat} > Scenario 2: > === > Configurations: > dfs.namenode.safemode.threshold-pct = 1 > dfs.replication = 2 > dfs.namenode.replication.min =2 > Step 1: Start NN,DN1,DN2 > Step 2: Write a file "a.txt" which has got 167 blocks > step 3: Stop NN,DN1,DN2 > Step 4: start NN > In UI report the Number of blocks needed to come out of safemode and number > of blocks actually present is different > {noformat} > Cluster Summary > Security is OFF > Safe mode is ON. The reported blocks 0 needs additional 168 blocks to reach > the threshold 1. of total blocks 167. Safe mode will be turned off > automatically. > 2 files and directories, 167 blocks = 169 total. > Heap Memory used 56.2 MB is 2% of Commited Heap Memory 2 GB. Max Heap Memory > is 2 GB. > Non Heap Memory used 23.37 MB is 17% of Commited Non Heap Memory 130.44 MB. > Max Non Heap Memory is 176 MB.{noformat} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HDFS-3325) When configuring "dfs.namenode.safemode.threshold-pct" to a value greater or equal to 1 there is mismatch in the UI report
[ https://issues.apache.org/jira/browse/HDFS-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Mankude reassigned HDFS-3325: -- Assignee: Hari Mankude > When configuring "dfs.namenode.safemode.threshold-pct" to a value greater or > equal to 1 there is mismatch in the UI report > -- > > Key: HDFS-3325 > URL: https://issues.apache.org/jira/browse/HDFS-3325 > Project: Hadoop HDFS > Issue Type: Bug >Affects Versions: 2.0.0 >Reporter: J.Andreina >Assignee: Hari Mankude >Priority: Minor > Fix For: 2.0.0, 3.0.0 > > > When dfs.namenode.safemode.threshold-pct is configured to n > Namenode will be in safemode until n percentage of blocks that should satisfy > the minimal replication requirement defined by > dfs.namenode.replication.min is reported to namenode > But in UI it displays that n percentage of total blocks + 1 blocks are > additionally needed > to come out of the safemode > Scenario 1: > > Configurations: > dfs.namenode.safemode.threshold-pct = 2 > dfs.replication = 2 > dfs.namenode.replication.min =2 > Step 1: Start NN,DN1,DN2 > Step 2: Write a file "a.txt" which has got 167 blocks > step 3: Stop NN,DN1,DN2 > Step 4: start NN > In UI report the Number of blocks needed to come out of safemode and number > of blocks actually present is different. > {noformat} > Cluster Summary > Security is OFF > Safe mode is ON. The reported blocks 0 needs additional 335 blocks to reach > the threshold 2. of total blocks 167. Safe mode will be turned off > automatically. > 2 files and directories, 167 blocks = 169 total. > Heap Memory used 57.05 MB is 2% of Commited Heap Memory 2 GB. Max Heap Memory > is 2 GB. > Non Heap Memory used 23.37 MB is 17% of Commited Non Heap Memory 130.44 MB. > Max Non Heap Memory is 176 MB.{noformat} > Scenario 2: > === > Configurations: > dfs.namenode.safemode.threshold-pct = 1 > dfs.replication = 2 > dfs.namenode.replication.min =2 > Step 1: Start NN,DN1,DN2 > Step 2: Write a file "a.txt" which has got 167 blocks > step 3: Stop NN,DN1,DN2 > Step 4: start NN > In UI report the Number of blocks needed to come out of safemode and number > of blocks actually present is different > {noformat} > Cluster Summary > Security is OFF > Safe mode is ON. The reported blocks 0 needs additional 168 blocks to reach > the threshold 1. of total blocks 167. Safe mode will be turned off > automatically. > 2 files and directories, 167 blocks = 169 total. > Heap Memory used 56.2 MB is 2% of Commited Heap Memory 2 GB. Max Heap Memory > is 2 GB. > Non Heap Memory used 23.37 MB is 17% of Commited Non Heap Memory 130.44 MB. > Max Non Heap Memory is 176 MB.{noformat} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira