[jira] [Created] (HDFS-15277) Parent directory in the explorer does not support all path formats
Jianfei Jiang created HDFS-15277: Summary: Parent directory in the explorer does not support all path formats Key: HDFS-15277 URL: https://issues.apache.org/jira/browse/HDFS-15277 Project: Hadoop HDFS Issue Type: Improvement Reporter: Jianfei Jiang Assignee: Jianfei Jiang In HDFS-15239, a new button can click to parent folder is add. However, if the path is not formatted perfectly, it will not get the real parent. Path like follows are supported to get the file list in explorer.html, but they do not get the correct parent: /a/b/c/ will get /a/b/c now /a/bc -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-15251) Add new zookeeper event type case after zk updated to 3.5.x
Jianfei Jiang created HDFS-15251:
Summary: Add new zookeeper event type case after zk updated to
3.5.x
Key: HDFS-15251
URL: https://issues.apache.org/jira/browse/HDFS-15251
Project: Hadoop HDFS
Issue Type: Improvement
Components: hdfs
Affects Versions: 3.2.1
Reporter: Jianfei Jiang
In zookeeper 3.5.x, KeeperState add a new one named Closed, so should add Close
case to the swich as it is not an unexpected Zookeeper watch event state.
{code:java}
/** @deprecated */
@Deprecated
Unknown(-1),
Disconnected(0),
/** @deprecated */
@Deprecated
NoSyncConnected(1),
SyncConnected(3),
AuthFailed(4),
ConnectedReadOnly(5),
SaslAuthenticated(6),
Expired(-112),
Closed(7);{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-15245) Improve JournalNode web UI
Jianfei Jiang created HDFS-15245: Summary: Improve JournalNode web UI Key: HDFS-15245 URL: https://issues.apache.org/jira/browse/HDFS-15245 Project: Hadoop HDFS Issue Type: Improvement Components: journal-node, ui Affects Versions: 3.2.1 Reporter: Jianfei Jiang Assignee: Jianfei Jiang At present, journalnode web UI is a almost blank page. It almost has no useful infomation. # Add some infomation of journalnode at the main page. # Add a dropdown menu Utilities like DN and JN, contains Logs, Log Level, Metrics, Configuration & Process Thread Dump -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-14691) Wrong usage hint for hadoop fs command test
Jianfei Jiang created HDFS-14691: Summary: Wrong usage hint for hadoop fs command test Key: HDFS-14691 URL: https://issues.apache.org/jira/browse/HDFS-14691 Project: Hadoop HDFS Issue Type: Bug Reporter: Jianfei Jiang Assignee: Jianfei Jiang The command hadoop fs -test support seven options : -d / -e / -f / -s / -w / -r / -z. However when see the usage of this command, only see five options. w and r are missing. -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-13914) DN UI logs link is broken when https is enabled after HDFS-13902 fixed
Jianfei Jiang created HDFS-13914: Summary: DN UI logs link is broken when https is enabled after HDFS-13902 fixed Key: HDFS-13914 URL: https://issues.apache.org/jira/browse/HDFS-13914 Project: Hadoop HDFS Issue Type: Bug Reporter: Jianfei Jiang Assignee: Jianfei Jiang Attachments: HDFS-13914_001.patch The bug that DN UI logs link is broken when https is enabled is fixed by HDFS-13581, however, after fixing HDFS-13902, this bug appears again. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-13401) Different behavior in mkdir when the target folder of mount table is uncreated
Jianfei Jiang created HDFS-13401: Summary: Different behavior in mkdir when the target folder of mount table is uncreated Key: HDFS-13401 URL: https://issues.apache.org/jira/browse/HDFS-13401 Project: Hadoop HDFS Issue Type: Bug Reporter: Jianfei Jiang Assignee: Jianfei Jiang In federation cases, if we have a config like below: fs.viewfs.mounttable.ClusterX.link./foo hdfs://nn2-clusterx.example.com:8020/footarget When the folder hdfs://nn2-clusterx.example.com:8020/projects/footarget is not actually exist, the command [[hdfs dfs ls /]] can still see the folder, but the folder is not actually exist. then we try to use mkdir command to create the viewfs folder [[hdfs dfs mkdir /foo]], the return code is true, but the folder is not created. However, when we use [[hdfs dfs mkdir -p /foo/xxx]] which have a deeper location to create folder, the folder is successfully created. The results in these two cases may be ambigiuous. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-13261) Incorrect null value check
Jianfei Jiang created HDFS-13261:
Summary: Incorrect null value check
Key: HDFS-13261
URL: https://issues.apache.org/jira/browse/HDFS-13261
Project: Hadoop HDFS
Issue Type: Bug
Components: hdfs
Affects Versions: 3.0.0, 2.8.3
Reporter: Jianfei Jiang
Assignee: Jianfei Jiang
{code:java}
public void setZoneName(final String name) {
Preconditions.checkNotNull(name == null)---error parameter for
checkNotNull
zoneName = name;
}
{code}
Like above, in 3.x, the checkNotNull function gets wrong parameter in two
cases: \{{ZoneReencryptionStatus#setZoneName}} and
\{{AdminHelper#HelpCommand#HelpCommand}}
In 2.x, the error occurs once in \{{AdminHelper#HelpCommand#HelpCommand}}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-13147) Support -c argument for DFS command head and tail
Jianfei Jiang created HDFS-13147:
Summary: Support -c argument for DFS command head and tail
Key: HDFS-13147
URL: https://issues.apache.org/jira/browse/HDFS-13147
Project: Hadoop HDFS
Issue Type: New Feature
Reporter: Jianfei Jiang
Assignee: Jianfei Jiang
The offset of command {{head}} and {{tail}} is hard coded as 1024 bytes. Goal
to improve it that the offset can be specified by user like Linux commands.
Then the commands will be more flexible.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-13130) Log error: Incorrect class given in LoggerFactory.getLogger
Jianfei Jiang created HDFS-13130:
Summary: Log error: Incorrect class given in
LoggerFactory.getLogger
Key: HDFS-13130
URL: https://issues.apache.org/jira/browse/HDFS-13130
Project: Hadoop HDFS
Issue Type: Bug
Reporter: Jianfei Jiang
Assignee: Jianfei Jiang
In class org.apache.hadoop.hdfs.server.blockmanagement.SlowDiskTracker, the LOG
is targeted to SlowPeerTracker.class incorrectly**
*public class SlowDiskTracker {
public static final Logger LOG =
LoggerFactory.getLogger(SlowPeerTracker.class);*
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-13063) Fix the incorrect spelling in markdown file HDFSHighAvailabilityWithQJM.md
Jianfei Jiang created HDFS-13063:
Summary: Fix the incorrect spelling in markdown file
HDFSHighAvailabilityWithQJM.md
Key: HDFS-13063
URL: https://issues.apache.org/jira/browse/HDFS-13063
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Jianfei Jiang
Assignee: Jianfei Jiang
The word JournalNode in this markdown file is incorrect spelled.
In order for the Standby node to keep its state synchronized with the Active
node, both nodes communicate with a group of separate daemons called
"JournalNodes" (JNs). When any namespace modification is performed by the
Active node, it durably logs a record of the modification to a majority of
these JNs. The Standby node is capable of reading the edits from the JNs, and
is constantly watching them for changes to the edit log. As the Standby Node
sees the edits, it applies them to its own namespace. In the event of a
failover, the Standby will ensure that it has read all of the edits from the
{color:#33}*JounalNodes*{color} before promoting itself to the Active
state. This ensures that the namespace state is fully synchronized before a
failover occurs.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Reopened] (HDFS-12780) Fix spelling mistake in DistCpUtils.java
[ https://issues.apache.org/jira/browse/HDFS-12780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Jiang reopened HDFS-12780: -- > Fix spelling mistake in DistCpUtils.java > > > Key: HDFS-12780 > URL: https://issues.apache.org/jira/browse/HDFS-12780 > Project: Hadoop HDFS > Issue Type: Improvement >Affects Versions: 3.0.0-beta1 >Reporter: Jianfei Jiang >Priority: Major > Labels: patch > Attachments: HDFS-12780.patch > > > We found a spelling mistake in DistCpUtils.java. "* If checksums's can't be > retrieved," should be " * If checksums can't be retrieved," -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-13001) Testcase improvement for DFSAdmin
Jianfei Jiang created HDFS-13001:
Summary: Testcase improvement for DFSAdmin
Key: HDFS-13001
URL: https://issues.apache.org/jira/browse/HDFS-13001
Project: Hadoop HDFS
Issue Type: Sub-task
Affects Versions: 3.0.0, 2.9.0
Reporter: Jianfei Jiang
Assignee: Jianfei Jiang
Priority: Minor
Testcase improvement for DFSAdmin command. The commands should be tested under
following environments:
(1) Both Namenode are up online
(2) NN1 is off offline and NN2 is up online
(3) NN1 is up online and NN2 is down offline
(4) Both Namenode are down offline
The testcases can be improved.
Testcases can be improved like code below.
{code:java}
private void testExecuteDFSAdminCommand(int nnIndex, String[] command,
String message) throws Exception {
setUpHaCluster(false);
switch (nnIndex) {
case 0:
cluster.getDfsCluster().shutdownNameNode(0);
cluster.getDfsCluster().transitionToActive(1);
break;
case 1:
cluster.getDfsCluster().shutdownNameNode(1);
cluster.getDfsCluster().transitionToActive(0);
break;
case 2:
cluster.getDfsCluster().shutdownNameNode(0);
cluster.getDfsCluster().shutdownNameNode(1);
break;
default:
}
int exitCode = admin.run(command);
if (nnIndex != 2) {
assertEquals(err.toString().trim(), 0, exitCode);
assertOutputMatches(message + newLine);
} else {
assertNotEquals(err.toString().trim(), 0, exitCode);
assertOutputNotMatches(message + newLine);
}
}
{code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-12859) Admin command resetBalancerBandwidth
Jianfei Jiang created HDFS-12859: Summary: Admin command resetBalancerBandwidth Key: HDFS-12859 URL: https://issues.apache.org/jira/browse/HDFS-12859 Project: Hadoop HDFS Issue Type: New Feature Components: balancer & mover Affects Versions: 3.0.0-beta1 Reporter: Jianfei Jiang Fix For: 3.1.0 We can already set balancer bandwidth dynamically using command setBalancerBandwidth. The setting value is not persistent and not stored in configuration file. The different datanodes could their different default or former setting in configuration. When we suggested to develop a schedule balancer task which runs at midnight everyday. We set a larger bandwidth for it and hope to reset the value after finishing. However, we found it difficult to reset the different setting for different datanodes as the setBalancerBandwidth command can only set the same value to all datanodes. If we want to use unique setting for every datanode, we have to reset the datanodes. So it would be useful to have a command to synchronize the setting with the configuration file. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Reopened] (HDFS-12780) Fix spelling mistake in DistCpUtils.java
[ https://issues.apache.org/jira/browse/HDFS-12780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Jiang reopened HDFS-12780: -- > Fix spelling mistake in DistCpUtils.java > > > Key: HDFS-12780 > URL: https://issues.apache.org/jira/browse/HDFS-12780 > Project: Hadoop HDFS > Issue Type: Improvement >Affects Versions: 3.0.0-beta1 >Reporter: Jianfei Jiang > Labels: patch > Attachments: HDFS-12780.patch > > > We found a spelling mistake in DistCpUtils.java. "* If checksums's can't be > retrieved," should be " * If checksums can't be retrieved," -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDFS-12780) Fix spelling mistake in DistCpUtils.java
[ https://issues.apache.org/jira/browse/HDFS-12780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Jiang resolved HDFS-12780. -- Resolution: Fixed > Fix spelling mistake in DistCpUtils.java > > > Key: HDFS-12780 > URL: https://issues.apache.org/jira/browse/HDFS-12780 > Project: Hadoop HDFS > Issue Type: Improvement >Affects Versions: 3.0.0-beta1 >Reporter: Jianfei Jiang > Labels: patch > Attachments: HDFS-12780.patch > > > We found a spelling mistake in DistCpUtils.java. "* If checksums's can't be > retrieved," should be " * If checksums can't be retrieved," -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-12780) Fix spelling mistake in DistCpUtils.java
Jianfei Jiang created HDFS-12780: Summary: Fix spelling mistake in DistCpUtils.java Key: HDFS-12780 URL: https://issues.apache.org/jira/browse/HDFS-12780 Project: Hadoop HDFS Issue Type: Bug Reporter: Jianfei Jiang We found a spelling mistake in DistCpUtils.java. "* If checksums's can't be retrieved," should be " * If checksums can't be retrieved," -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
