[jira] [Created] (HDFS-6268) Better sorting in NetworkTopology#pseudoSortByDistance when no local node is found
Andrew Wang created HDFS-6268: - Summary: Better sorting in NetworkTopology#pseudoSortByDistance when no local node is found Key: HDFS-6268 URL: https://issues.apache.org/jira/browse/HDFS-6268 Project: Hadoop HDFS Issue Type: Improvement Affects Versions: 2.4.0 Reporter: Andrew Wang Assignee: Andrew Wang Priority: Minor In NetworkTopology#pseudoSortByDistance, if no local node is found, it will always place the first rack local node in the list in front. This became an issue when a dataset was loaded from a single datanode. This datanode ended up being the first replica for all the blocks in the dataset. When running an Impala query, the non-local reads when reading past a block boundary were all hitting this node, meaning massive load skew. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HDFS-6267) Upgrade Jetty6 to Jetty9
Fengdong Yu created HDFS-6267: - Summary: Upgrade Jetty6 to Jetty9 Key: HDFS-6267 URL: https://issues.apache.org/jira/browse/HDFS-6267 Project: Hadoop HDFS Issue Type: Improvement Components: datanode, namenode Affects Versions: 3.0.0 Reporter: Fengdong Yu Assignee: Fengdong Yu Priority: Minor Jetty stable version is 9.x, but it requires Java7, so I want to target 3.0 for this upgrade. Jetty9 is incompatible with Jetty6, so the patch will be big. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HDFS-6266) Identify full path for a given INode
Jing Zhao created HDFS-6266: --- Summary: Identify full path for a given INode Key: HDFS-6266 URL: https://issues.apache.org/jira/browse/HDFS-6266 Project: Hadoop HDFS Issue Type: Improvement Components: snapshots Reporter: Jing Zhao Assignee: Jing Zhao Currently when identifying the full path of a given inode, FSDirectory#getPathComponents and FSDirectory#getFullPathName can only handle normal cases where the inode and its ancestors are not in any snapshot. This jira aims to provide support to handle snapshots. This can be useful for identifying the "Rename" change in a snapshot diff report. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HDFS-6265) Prepare HDFS codebase for JUnit 4.11.
Chris Nauroth created HDFS-6265: --- Summary: Prepare HDFS codebase for JUnit 4.11. Key: HDFS-6265 URL: https://issues.apache.org/jira/browse/HDFS-6265 Project: Hadoop HDFS Issue Type: Bug Components: test Affects Versions: 2.4.0, 3.0.0 Reporter: Chris Nauroth Assignee: Chris Nauroth Priority: Minor Attachments: HDFS-6265.1.patch HADOOP-10503 upgrades the entire Hadoop repo to use JUnit 4.11. Some of the HDFS code needs some minor updates to fix deprecation warnings before the upgrade. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HDFS-6264) Provide FileSystem#create() variant which throws exception if parent directory doesn't exist
Ted Yu created HDFS-6264: Summary: Provide FileSystem#create() variant which throws exception if parent directory doesn't exist Key: HDFS-6264 URL: https://issues.apache.org/jira/browse/HDFS-6264 Project: Hadoop HDFS Issue Type: Task Reporter: Ted Yu Priority: Minor FileSystem#createNonRecursive() is deprecated. However, there is no DistributedFileSystem#create() implementation which throws exception if parent directory doesn't exist. This limits clients' migration away from the deprecated method. Variant of create() method should be added which throws exception if parent directory doesn't exist. -- This message was sent by Atlassian JIRA (v6.2#6252)
