[jira] [Updated] (HDFS-4273) Problem in DFSInputStream read retry logic may cause early failure

2013-12-17 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binglin Chang updated HDFS-4273: Attachment: HDFS-4273.v6.patch Update patch because of recent commit conflict, changes: Change getSt

[jira] [Updated] (HDFS-5676) fix inconsistent synchronization of CachingStrategy

2013-12-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5676: --- Attachment: (was: HDFS-5676.002.patch) > fix inconsistent synchronization of Cachi

[jira] [Commented] (HDFS-5676) fix inconsistent synchronization of CachingStrategy

2013-12-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13851485#comment-13851485 ] Colin Patrick McCabe commented on HDFS-5676: actually, looking at this again, I

[jira] [Commented] (HDFS-5675) Add Mkdirs operation to NNThroughputBenchmark

2013-12-17 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13851471#comment-13851471 ] Konstantin Shvachko commented on HDFS-5675: --- "mkdirsr" is a typo. OP_MKDIRS_USAGE

[jira] [Commented] (HDFS-5574) Remove buffer copy in BlockReader.skip

2013-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13851424#comment-13851424 ] Hadoop QA commented on HDFS-5574: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5662) Can't decommission a DataNode due to file's replication factor larger than the rest of the cluster size

2013-12-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13851408#comment-13851408 ] Arpit Agarwal commented on HDFS-5662: - Minor comment - contents of the {{if}} block in

[jira] [Commented] (HDFS-5676) fix inconsistent synchronization of CachingStrategy

2013-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13851388#comment-13851388 ] Hadoop QA commented on HDFS-5676: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-5675) Add Mkdirs operation to NNThroughputBenchmark

2013-12-17 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-5675: --- Attachment: mkdirsBenchmarkPatchTrunk_2.patch New patch addressing Konstantin's comments. > A

[jira] [Commented] (HDFS-5662) Can't decommission a DataNode due to file's replication factor larger than the rest of the cluster size

2013-12-17 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13851375#comment-13851375 ] Brandon Li commented on HDFS-5662: -- The patch basically allows datanode to be decommission

[jira] [Updated] (HDFS-5675) Add Mkdirs operation to NNThroughputBenchmark

2013-12-17 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-5675: --- Target Version/s: 3.0.0 > Add Mkdirs operation to NNThroughputBenchmark >

[jira] [Updated] (HDFS-5675) Add Mkdirs operation to NNThroughputBenchmark

2013-12-17 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-5675: --- Fix Version/s: (was: 3.0.0) > Add Mkdirs operation to NNThroughputBenchmark >

[jira] [Commented] (HDFS-5653) Log namenode hostname in various exceptions being thrown in a HA setup

2013-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13851362#comment-13851362 ] Hadoop QA commented on HDFS-5653: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5662) Can't decommission a DataNode due to file's replication factor larger than the rest of the cluster size

2013-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13851342#comment-13851342 ] Hadoop QA commented on HDFS-5662: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-5574) Remove buffer copy in BlockReader.skip

2013-12-17 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binglin Chang updated HDFS-5574: Attachment: HDFS-5574.v3.patch Thanks for the comments, Colin. The new v3 patch just remove changes

[jira] [Commented] (HDFS-5579) Under construction files make DataNode decommission take very long hours

2013-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13851322#comment-13851322 ] Hadoop QA commented on HDFS-5579: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5674) Editlog code cleanup

2013-12-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13851309#comment-13851309 ] Hudson commented on HDFS-5674: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4907 (See [https:

[jira] [Commented] (HDFS-5676) fix inconsistent synchronization of CachingStrategy

2013-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13851300#comment-13851300 ] Hadoop QA commented on HDFS-5676: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-5674) Editlog code cleanup

2013-12-17 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-5674: - Resolution: Fixed Fix Version/s: 2.4.0 Hadoop Flags: Reviewed

[jira] [Updated] (HDFS-5676) fix inconsistent synchronization of CachingStrategy

2013-12-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5676: --- Attachment: HDFS-5676.002.patch > fix inconsistent synchronization of CachingStrategy

[jira] [Commented] (HDFS-5676) fix inconsistent synchronization of CachingStrategy

2013-12-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13851292#comment-13851292 ] Colin Patrick McCabe commented on HDFS-5676: The issue is more that in createBl

[jira] [Updated] (HDFS-5674) Editlog code cleanup

2013-12-17 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-5674: - Attachment: h5674_20131218.patch Thanks Jing for reviewing this. h5674_20131218.p

[jira] [Commented] (HDFS-5453) Support fine grain locking in FSNamesystem

2013-12-17 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13851274#comment-13851274 ] Konstantin Shvachko commented on HDFS-5453: --- Daryn, just wanted to remind an issu

[jira] [Updated] (HDFS-5653) Log namenode hostname in various exceptions being thrown in a HA setup

2013-12-17 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5653: - Attachment: HDFS-5653.003.patch > Log namenode hostname in various exceptions being thrown in a HA setup >

[jira] [Commented] (HDFS-5442) Zero loss HDFS data replication for multiple datacenters

2013-12-17 Thread Jerry Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13851219#comment-13851219 ] Jerry Chen commented on HDFS-5442: -- {quote}It might be good to break up the work into two

[jira] [Commented] (HDFS-5653) Log namenode hostname in various exceptions being thrown in a HA setup

2013-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13851220#comment-13851220 ] Hadoop QA commented on HDFS-5653: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-5662) Can't decommission a DataNode due to file's replication factor larger than the rest of the cluster size

2013-12-17 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5662: - Status: Patch Available (was: Open) > Can't decommission a DataNode due to file's replication factor larg

[jira] [Updated] (HDFS-5662) Can't decommission a DataNode due to file's replication factor larger than the rest of the cluster size

2013-12-17 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5662: - Attachment: HDFS-5662.001.patch > Can't decommission a DataNode due to file's replication factor larger th

[jira] [Updated] (HDFS-5653) Log namenode hostname in various exceptions being thrown in a HA setup

2013-12-17 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5653: - Attachment: HDFS-5653.002.patch > Log namenode hostname in various exceptions being thrown in a HA setup >

[jira] [Commented] (HDFS-5677) Need error checking for HA cluster configuration

2013-12-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13851213#comment-13851213 ] Jing Zhao commented on HDFS-5677: - I also think this HA configuration error checking will b

[jira] [Commented] (HDFS-5675) Add Mkdirs operation to NNThroughputBenchmark

2013-12-17 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13851211#comment-13851211 ] Konstantin Shvachko commented on HDFS-5675: --- mkdirs is indeed an interesting oper

[jira] [Commented] (HDFS-5442) Zero loss HDFS data replication for multiple datacenters

2013-12-17 Thread Jerry Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13851209#comment-13851209 ] Jerry Chen commented on HDFS-5442: -- {quote}There are two clusters in your design document:

[jira] [Commented] (HDFS-5242) Reduce contention on DatanodeInfo instances

2013-12-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13851208#comment-13851208 ] Daryn Sharp commented on HDFS-5242: --- For the impact, it's been so long I don't have numbe

[jira] [Updated] (HDFS-5653) Log namenode hostname in various exceptions being thrown in a HA setup

2013-12-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5653: Assignee: Haohui Mai > Log namenode hostname in various exceptions being thrown in a HA setup >

[jira] [Updated] (HDFS-5579) Under construction files make DataNode decommission take very long hours

2013-12-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5579: Status: Patch Available (was: Open) > Under construction files make DataNode decommission take very long ho

[jira] [Commented] (HDFS-5242) Reduce contention on DatanodeInfo instances

2013-12-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13851206#comment-13851206 ] Daryn Sharp commented on HDFS-5242: --- An atomic reference would be fine but I'm not sure i

[jira] [Updated] (HDFS-5677) Need error checking for HA cluster configuration

2013-12-17 Thread Vincent Sheffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vincent Sheffer updated HDFS-5677: -- Description: If a node is declared in the *dfs.ha.namenodes.myCluster* but is _not_ later defin

[jira] [Created] (HDFS-5677) Need error checking for HA cluster configuration

2013-12-17 Thread Vincent Sheffer (JIRA)
Vincent Sheffer created HDFS-5677: - Summary: Need error checking for HA cluster configuration Key: HDFS-5677 URL: https://issues.apache.org/jira/browse/HDFS-5677 Project: Hadoop HDFS Issue Ty

[jira] [Updated] (HDFS-5677) Need error checking for HA cluster configuration

2013-12-17 Thread Vincent Sheffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vincent Sheffer updated HDFS-5677: -- Description: If a node is declared in the *dfs.ha.namenodes.myCluster* but is _not_ later defin

[jira] [Commented] (HDFS-5676) fix inconsistent synchronization of CachingStrategy

2013-12-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13851189#comment-13851189 ] Andrew Wang commented on HDFS-5676: --- Makes sense, good catch Colin. One comment and one q

[jira] [Work started] (HDFS-5676) fix inconsistent synchronization of CachingStrategy

2013-12-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-5676 started by Colin Patrick McCabe. > fix inconsistent synchronization of CachingStrategy > --- > >

[jira] [Updated] (HDFS-5676) fix inconsistent synchronization of CachingStrategy

2013-12-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5676: --- Status: Patch Available (was: In Progress) > fix inconsistent synchronization of Cach

[jira] [Updated] (HDFS-5676) fix inconsistent synchronization of CachingStrategy

2013-12-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5676: --- Attachment: HDFS-5676.001.patch also make CachingStrategy immutable. this makes it ea

[jira] [Created] (HDFS-5676) fix inconsistent synchronization of CachingStrategy

2013-12-17 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-5676: -- Summary: fix inconsistent synchronization of CachingStrategy Key: HDFS-5676 URL: https://issues.apache.org/jira/browse/HDFS-5676 Project: Hadoop HDFS

[jira] [Updated] (HDFS-5673) Implement logic for modification of ACLs.

2013-12-17 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5673: Attachment: HDFS-5673.1.patch I'm attaching the patch that implements the core ACL modification logi

[jira] [Commented] (HDFS-5651) remove dfs.namenode.caching.enabled

2013-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13851134#comment-13851134 ] Hadoop QA commented on HDFS-5651: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5653) Log namenode hostname in various exceptions being thrown in a HA setup

2013-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13851127#comment-13851127 ] Hadoop QA commented on HDFS-5653: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-5653) Log namenode hostname in various exceptions being thrown in a HA setup

2013-12-17 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5653: - Attachment: HDFS-5653.001.patch > Log namenode hostname in various exceptions being thrown in a HA setup >

[jira] [Commented] (HDFS-5653) Log namenode hostname in various exceptions being thrown in a HA setup

2013-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13851112#comment-13851112 ] Hadoop QA commented on HDFS-5653: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Resolved] (HDFS-5305) Add https support in HDFS

2013-12-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-5305. - Resolution: Fixed Fix Version/s: 2.4.0 Yes, we can resolve the jira now. Thanks for the excellent w

[jira] [Commented] (HDFS-5305) Add https support in HDFS

2013-12-17 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13851027#comment-13851027 ] Haohui Mai commented on HDFS-5305: -- The work has been committed in branch-2. Is it a good

[jira] [Commented] (HDFS-5536) Implement HTTP policy for Namenode and DataNode

2013-12-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13850961#comment-13850961 ] Hudson commented on HDFS-5536: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4903 (See [https:

[jira] [Commented] (HDFS-5545) Allow specifying endpoints for listeners in HttpServer

2013-12-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13850962#comment-13850962 ] Hudson commented on HDFS-5545: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4903 (See [https:

[jira] [Commented] (HDFS-5312) Generate HTTP / HTTPS URL in DFSUtil#getInfoServer() based on the configured http policy

2013-12-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13850960#comment-13850960 ] Hudson commented on HDFS-5312: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4903 (See [https:

[jira] [Commented] (HDFS-5629) Support HTTPS in JournalNode and SecondaryNameNode

2013-12-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13850964#comment-13850964 ] Hudson commented on HDFS-5629: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4903 (See [https:

[jira] [Commented] (HDFS-5538) URLConnectionFactory should pick up the SSL related configuration by default

2013-12-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13850965#comment-13850965 ] Hudson commented on HDFS-5538: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4903 (See [https:

[jira] [Commented] (HDFS-5431) support cachepool-based limit management in path-based caching

2013-12-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13850771#comment-13850771 ] Hudson commented on HDFS-5431: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4900 (See [https:

[jira] [Updated] (HDFS-5661) Browsing FileSystem via web ui, should use datanode's fqdn instead of ip address

2013-12-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5661: Assignee: Benoy Antony (was: Jing Zhao) Status: Patch Available (was: In Progress) > Browsing FileSy

[jira] [Updated] (HDFS-5629) Support HTTPS in JournalNode and SecondaryNameNode

2013-12-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5629: Fix Version/s: (was: 3.0.0) 2.4.0 I've merged this to branch-2. > Support HTTPS in J

[jira] [Updated] (HDFS-5431) support cachepool-based limit management in path-based caching

2013-12-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5431: --- Resolution: Fixed Fix Version/s: 3.0.0 Target Version/s: 3.0.0

[jira] [Assigned] (HDFS-5667) StorageType and State in DatanodeStorageInfo in NameNode is not accurate

2013-12-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDFS-5667: --- Assignee: Arpit Agarwal > StorageType and State in DatanodeStorageInfo in NameNode is not accu

[jira] [Work started] (HDFS-5667) StorageType and State in DatanodeStorageInfo in NameNode is not accurate

2013-12-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-5667 started by Arpit Agarwal. > StorageType and State in DatanodeStorageInfo in NameNode is not accurate > --

[jira] [Commented] (HDFS-4746) ClassCastException in BlockManager.addStoredBlock() due to that blockReceived came after file was closed.

2013-12-17 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13850944#comment-13850944 ] Plamen Jeliazkov commented on HDFS-4746: Konstantin, HDFS-5285 addresses your issu

[jira] [Updated] (HDFS-5651) remove dfs.namenode.caching.enabled

2013-12-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5651: --- Attachment: HDFS-5651.004.patch > remove dfs.namenode.caching.enabled > --

[jira] [Commented] (HDFS-5657) race condition causes writeback state error in NFS gateway

2013-12-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13850755#comment-13850755 ] Jing Zhao commented on HDFS-5657: - The patch looks good to me. One nit is that startOffset

[jira] [Updated] (HDFS-5657) race condition causes writeback state error in NFS gateway

2013-12-17 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5657: - Fix Version/s: 2.3.0 > race condition causes writeback state error in NFS gateway > --

[jira] [Commented] (HDFS-5574) Remove buffer copy in BlockReader.skip

2013-12-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13850902#comment-13850902 ] Colin Patrick McCabe commented on HDFS-5574: Let's close this as duplicate sinc

[jira] [Commented] (HDFS-5634) allow BlockReaderLocal to switch between checksumming and not

2013-12-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13850910#comment-13850910 ] Hudson commented on HDFS-5634: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4902 (See [https:

[jira] [Updated] (HDFS-5657) race condition causes writeback state error in NFS gateway

2013-12-17 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5657: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) > race c

[jira] [Commented] (HDFS-5242) Reduce contention on DatanodeInfo instances

2013-12-17 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13850805#comment-13850805 ] Suresh Srinivas commented on HDFS-5242: --- Alternatively, this can be done in a lockles

[jira] [Commented] (HDFS-5574) Remove buffer copy in BlockReader.skip

2013-12-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13850907#comment-13850907 ] Colin Patrick McCabe commented on HDFS-5574: actually, maybe I spoke too soon.

[jira] [Resolved] (HDFS-5564) Refactor tests in TestCacheDirectives

2013-12-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-5564. Resolution: Duplicate > Refactor tests in TestCacheDirectives >

[jira] [Commented] (HDFS-5564) Refactor tests in TestCacheDirectives

2013-12-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13850911#comment-13850911 ] Colin Patrick McCabe commented on HDFS-5564: we did this refactor as part of HD

[jira] [Updated] (HDFS-5312) Generate HTTP / HTTPS URL in DFSUtil#getInfoServer() based on the configured http policy

2013-12-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5312: Fix Version/s: (was: 3.0.0) 2.4.0 I've merged this to branch-2. > Generate HTTP / HT

[jira] [Commented] (HDFS-5667) StorageType and State in DatanodeStorageInfo in NameNode is not accurate

2013-12-17 Thread Eric Sirianni (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13850917#comment-13850917 ] Eric Sirianni commented on HDFS-5667: - Haven't had a chance yet - please go ahead and p

[jira] [Commented] (HDFS-5661) Browsing FileSystem via web ui, should use datanode's fqdn instead of ip address

2013-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13850923#comment-13850923 ] Hadoop QA commented on HDFS-5661: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-5634) allow BlockReaderLocal to switch between checksumming and not

2013-12-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5634: --- Attachment: HDFS-5634.008.patch > allow BlockReaderLocal to switch between checksummin

[jira] [Commented] (HDFS-5671) When Hbase RegionServer request block to DataNode and "java.io.IOException" occurs, the fail TCP socket is not closed (in status "CLOSE_WAIT" with port 1004 of DataNode)

2013-12-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13850753#comment-13850753 ] Colin Patrick McCabe commented on HDFS-5671: It seems like we should move this

[jira] [Updated] (HDFS-5675) Add Mkdirs operation to NNThroughputBenchmark

2013-12-17 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-5675: --- Attachment: mkdirsBenchmarkPatchTrunk.patch Attaching patch for trunk. Operation is done in th

[jira] [Work started] (HDFS-5675) Add Mkdirs operation to NNThroughputBenchmark

2013-12-17 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-5675 started by Plamen Jeliazkov. > Add Mkdirs operation to NNThroughputBenchmark > - > > Key: HDF

[jira] [Updated] (HDFS-5653) Log namenode hostname in various exceptions being thrown in a HA setup

2013-12-17 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5653: - Status: Patch Available (was: Open) > Log namenode hostname in various exceptions being thrown in a HA se

[jira] [Updated] (HDFS-4710) SCR should honor dfs.client.read.shortcircuit.buffer.size even when checksums are off

2013-12-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4710: --- Resolution: Fixed Status: Resolved (was: Patch Available) This was resolved i

[jira] [Commented] (HDFS-5657) race condition causes writeback state error in NFS gateway

2013-12-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13850899#comment-13850899 ] Hudson commented on HDFS-5657: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4901 (See [https:

[jira] [Updated] (HDFS-5653) Log namenode hostname in various exceptions being thrown in a HA setup

2013-12-17 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5653: - Attachment: HDFS-5653.000.patch > Log namenode hostname in various exceptions being thrown in a HA setup >

[jira] [Commented] (HDFS-5667) StorageType and State in DatanodeStorageInfo in NameNode is not accurate

2013-12-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13850914#comment-13850914 ] Arpit Agarwal commented on HDFS-5667: - Eric, are you looking at this? I'll pick it up o

[jira] [Updated] (HDFS-5545) Allow specifying endpoints for listeners in HttpServer

2013-12-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5545: Fix Version/s: (was: 3.0.0) 2.4.0 I've merged this to branch-2. > Allow specifying e

[jira] [Commented] (HDFS-5674) Editlog code cleanup

2013-12-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13850809#comment-13850809 ] Jing Zhao commented on HDFS-5674: - +1. Do we also want to add a simple javadoc for OP_INVAL

[jira] [Created] (HDFS-5675) Add Mkdirs operation to NNThroughputBenchmark

2013-12-17 Thread Plamen Jeliazkov (JIRA)
Plamen Jeliazkov created HDFS-5675: -- Summary: Add Mkdirs operation to NNThroughputBenchmark Key: HDFS-5675 URL: https://issues.apache.org/jira/browse/HDFS-5675 Project: Hadoop HDFS Issue Typ

[jira] [Commented] (HDFS-5634) allow BlockReaderLocal to switch between checksumming and not

2013-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13850926#comment-13850926 ] Hadoop QA commented on HDFS-5634: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-5536) Implement HTTP policy for Namenode and DataNode

2013-12-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5536: Fix Version/s: (was: 3.0.0) 2.4.0 I've merged this to branch-2. > Implement HTTP pol

[jira] [Commented] (HDFS-5657) race condition causes writeback state error in NFS gateway

2013-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13850815#comment-13850815 ] Hadoop QA commented on HDFS-5657: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Assigned] (HDFS-5649) Unregister NFS and Mount service when NFS gateway is shutting down

2013-12-17 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li reassigned HDFS-5649: Assignee: Brandon Li > Unregister NFS and Mount service when NFS gateway is shutting down >

[jira] [Updated] (HDFS-5496) Make replication queue initialization asynchronous

2013-12-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5496: Target Version/s: HDFS-5535 (Rolling upgrades) (was: 2.4.0) > Make replication queue initialization asynchr

[jira] [Commented] (HDFS-5634) allow BlockReaderLocal to switch between checksumming and not

2013-12-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13850743#comment-13850743 ] Colin Patrick McCabe commented on HDFS-5634: yeah, I suppose it should be neede

[jira] [Commented] (HDFS-5449) WebHdfs compatibility broken between 2.2 and 1.x / 23.x

2013-12-17 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13850920#comment-13850920 ] Jason Lowe commented on HDFS-5449: -- Patch looks pretty good to me. One question about the

[jira] [Commented] (HDFS-5496) Make replication queue initialization asynchronous

2013-12-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13850811#comment-13850811 ] Jing Zhao commented on HDFS-5496: - I will commit this patch to HDFS-5535 branch late today

[jira] [Updated] (HDFS-5657) race condition causes writeback state error in NFS gateway

2013-12-17 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5657: - Attachment: HDFS-5657.new.002.patch > race condition causes writeback state error in NFS gateway > ---

[jira] [Commented] (HDFS-5657) race condition causes writeback state error in NFS gateway

2013-12-17 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13850793#comment-13850793 ] Brandon Li commented on HDFS-5657: -- Uploaded a new patch to address Jing's last comment.

[jira] [Updated] (HDFS-5477) Block manager as a service

2013-12-17 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated HDFS-5477: - Attachment: Standalone BM.pdf Re-attach standalone pdf to fix graphics. > Block manager as a serv

[jira] [Updated] (HDFS-5658) Implement ACL as a INode feature

2013-12-17 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5658: - Attachment: HDFS-5658.001.patch Rebased on 12/17. > Implement ACL as a INode feature > --

[jira] [Updated] (HDFS-5619) NameNode: record ACL modifications to edit log.

2013-12-17 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5619: - Attachment: HDFS-5619.000.patch > NameNode: record ACL modifications to edit log. > --

  1   2   >