[jira] [Created] (HDFS-5687) Problem in accessing NN JSP page

sathish created HDFS-5687: - Summary: Problem in accessing NN JSP page Key: HDFS-5687 URL: https://issues.apache.org/jira/browse/HDFS-5687 Project: Hadoop HDFS Issue Type: Bug Components: hd

[jira] [Updated] (HDFS-5667) Include DatanodeStorage in StorageReport

[ https://issues.apache.org/jira/browse/HDFS-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5667: Attachment: h5667.04.patch > Include DatanodeStorage in StorageReport >

[jira] [Commented] (HDFS-5675) Add Mkdirs operation to NNThroughputBenchmark

[ https://issues.apache.org/jira/browse/HDFS-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852667#comment-13852667 ] Plamen Jeliazkov commented on HDFS-5675: [~stev...@iseran.com], sorry but I am conf

[jira] [Commented] (HDFS-5663) make the retry time and interval value configurable in openInfo()

[ https://issues.apache.org/jira/browse/HDFS-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852659#comment-13852659 ] Hudson commented on HDFS-5663: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4918 (See [https:

[jira] [Updated] (HDFS-5671) When client request block to DataNode and "java.io.IOException" occurs, the fail TCP socket is not closed (in status "CLOSE_WAIT" with port 1004 of DataNode)

[ https://issues.apache.org/jira/browse/HDFS-5671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JamesLi updated HDFS-5671: -- Description: lsof -i TCP:1004 | grep -c CLOSE_WAIT 18235 When client request a file's block to DataNode:1004. If

[jira] [Updated] (HDFS-5671) When client request block to DataNode and "java.io.IOException" occurs, the fail TCP socket is not closed (in status "CLOSE_WAIT" with port 1004 of DataNode)

[ https://issues.apache.org/jira/browse/HDFS-5671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JamesLi updated HDFS-5671: -- Description: lsof -i TCP:1004 | grep -c CLOSE_WAIT 18235 When client request a file's block to DataNode:1004. If

[jira] [Updated] (HDFS-5671) When client request block to DataNode and "java.io.IOException" occurs, the fail TCP socket is not closed (in status "CLOSE_WAIT" with port 1004 of DataNode)

[ https://issues.apache.org/jira/browse/HDFS-5671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JamesLi updated HDFS-5671: -- Summary: When client request block to DataNode and "java.io.IOException" occurs, the fail TCP socket is not clo

[jira] [Updated] (HDFS-5663) make the retry time and interval value configurable in openInfo()

[ https://issues.apache.org/jira/browse/HDFS-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HDFS-5663: Resolution: Fixed Fix Version/s: 2.4.0 Release Note: Makes the retries and time between retries getting

[jira] [Updated] (HDFS-5675) Add Mkdirs operation to NNThroughputBenchmark

[ https://issues.apache.org/jira/browse/HDFS-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-5675: --- Attachment: mkdirsBenchmarkPatchTrunk_3.patch Attaching new patch. # Fixed typo. # Fixed Java

[jira] [Commented] (HDFS-5671) When Hbase RegionServer request block to DataNode and "java.io.IOException" occurs, the fail TCP socket is not closed (in status "CLOSE_WAIT" with port 1004 of DataNode)

[ https://issues.apache.org/jira/browse/HDFS-5671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852655#comment-13852655 ] JamesLi commented on HDFS-5671: --- In DFSInputStream.blockSeekTo()-line 533,invoke getBlockRead

[jira] [Commented] (HDFS-5540) Fix TestBlocksWithNotEnoughRacks

[ https://issues.apache.org/jira/browse/HDFS-5540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852654#comment-13852654 ] Hadoop QA commented on HDFS-5540: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5671) When Hbase RegionServer request block to DataNode and "java.io.IOException" occurs, the fail TCP socket is not closed (in status "CLOSE_WAIT" with port 1004 of DataNode)

[ https://issues.apache.org/jira/browse/HDFS-5671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852650#comment-13852650 ] Hadoop QA commented on HDFS-5671: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-5671) When Hbase RegionServer request block to DataNode and "java.io.IOException" occurs, the fail TCP socket is not closed (in status "CLOSE_WAIT" with port 1004 of DataNode)

[ https://issues.apache.org/jira/browse/HDFS-5671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JamesLi updated HDFS-5671: -- Attachment: 5671v1.patch 5671.patch is not correct,this patch fix the CLOSE_WAIT bug,in our test,after patch,CL

[jira] [Commented] (HDFS-5663) make the retry time and interval value configurable in openInfo()

[ https://issues.apache.org/jira/browse/HDFS-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852635#comment-13852635 ] Hudson commented on HDFS-5663: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4917 (See [https:

[jira] [Resolved] (HDFS-5686) Cannot upgrade the layout version with -49 from -48

[ https://issues.apache.org/jira/browse/HDFS-5686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shinichi Yamashita resolved HDFS-5686. -- Resolution: Not A Problem I prepared for build environment separately. And Hadoop worked

[jira] [Commented] (HDFS-5686) Cannot upgrade the layout version with -49 from -48

[ https://issues.apache.org/jira/browse/HDFS-5686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852602#comment-13852602 ] Shinichi Yamashita commented on HDFS-5686: -- The layout version -48 used it which b

[jira] [Comment Edited] (HDFS-5686) Cannot upgrade the layout version with -49 from -48

[ https://issues.apache.org/jira/browse/HDFS-5686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852597#comment-13852597 ] Suresh Srinivas edited comment on HDFS-5686 at 12/19/13 4:32 AM:

[jira] [Commented] (HDFS-5686) Cannot upgrade the layout version with -49 from -48

[ https://issues.apache.org/jira/browse/HDFS-5686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852597#comment-13852597 ] Suresh Srinivas commented on HDFS-5686: --- Can you specify what release version of Apac

[jira] [Created] (HDFS-5686) Cannot upgrade the layout version with -49 from -48

Shinichi Yamashita created HDFS-5686: Summary: Cannot upgrade the layout version with -49 from -48 Key: HDFS-5686 URL: https://issues.apache.org/jira/browse/HDFS-5686 Project: Hadoop HDFS

[jira] [Updated] (HDFS-5685) DistCp will fail to copy with -delete switch

[ https://issues.apache.org/jira/browse/HDFS-5685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-5685: Affects Version/s: (was: 1.0.0) 1.2.1 > DistCp will fail to copy with -de

[jira] [Commented] (HDFS-5305) Add https support in HDFS

[ https://issues.apache.org/jira/browse/HDFS-5305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852568#comment-13852568 ] Suresh Srinivas commented on HDFS-5305: --- [~wheat9], nice job! Thanks for doing this.

[jira] [Updated] (HDFS-5540) Fix TestBlocksWithNotEnoughRacks

[ https://issues.apache.org/jira/browse/HDFS-5540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binglin Chang updated HDFS-5540: Attachment: HDFS-5540.v2.patch Update the patch, now the patch can apply with p0 clean, thanks for t

[jira] [Commented] (HDFS-5667) Include DatanodeStorage in StorageReport

[ https://issues.apache.org/jira/browse/HDFS-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852561#comment-13852561 ] Hadoop QA commented on HDFS-5667: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5442) Zero loss HDFS data replication for multiple datacenters

[ https://issues.apache.org/jira/browse/HDFS-5442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852557#comment-13852557 ] LiuLei commented on HDFS-5442: -- Hi Jerry Chen, The one cluster essentially is an HA cluster,

[jira] [Commented] (HDFS-5483) NN should gracefully handle multiple block replicas on same DN

[ https://issues.apache.org/jira/browse/HDFS-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852552#comment-13852552 ] Hadoop QA commented on HDFS-5483: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5220) Expose group resolution time as metric

[ https://issues.apache.org/jira/browse/HDFS-5220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852549#comment-13852549 ] Jimmy Xiang commented on HDFS-5220: --- The avg time is 0? It is so fast to find the group i

[jira] [Commented] (HDFS-5685) DistCp will fail to copy with -delete switch

[ https://issues.apache.org/jira/browse/HDFS-5685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852524#comment-13852524 ] Yongjun Zhang commented on HDFS-5685: - I've identified that the problem is in the imple

[jira] [Updated] (HDFS-5540) Fix TestBlocksWithNotEnoughRacks

[ https://issues.apache.org/jira/browse/HDFS-5540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5540: - Priority: Minor (was: Major) > Fix TestBlocksWithNotEnoughRacks > > >

[jira] [Commented] (HDFS-5540) Fix TestBlocksWithNotEnoughRacks

[ https://issues.apache.org/jira/browse/HDFS-5540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852502#comment-13852502 ] Junping Du commented on HDFS-5540: -- It can be applied, but not very clean. It is typically

[jira] [Commented] (HDFS-5685) DistCp will fail to copy with -delete switch

[ https://issues.apache.org/jira/browse/HDFS-5685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852473#comment-13852473 ] Jimmy Xiang commented on HDFS-5685: --- Looks like it's a Hadoop/MR instead of HDFS issue.

[jira] [Commented] (HDFS-5685) DistCp will fail to copy with -delete switch

[ https://issues.apache.org/jira/browse/HDFS-5685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852469#comment-13852469 ] Jimmy Xiang commented on HDFS-5685: --- Do we know why it can't find the file? Is it because

[jira] [Created] (HDFS-5685) DistCp will fail to copy with -delete switch

Yongjun Zhang created HDFS-5685: --- Summary: DistCp will fail to copy with -delete switch Key: HDFS-5685 URL: https://issues.apache.org/jira/browse/HDFS-5685 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-5442) Zero loss HDFS data replication for multiple datacenters

[ https://issues.apache.org/jira/browse/HDFS-5442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852434#comment-13852434 ] Jerry Chen commented on HDFS-5442: -- {quote}Along these lines, do the DataNodes in the seco

[jira] [Created] (HDFS-5684) o.a.h.fs.viewfs.ViewFileSystem.MountPoint has no public methods.

Keith Turner created HDFS-5684: -- Summary: o.a.h.fs.viewfs.ViewFileSystem.MountPoint has no public methods. Key: HDFS-5684 URL: https://issues.apache.org/jira/browse/HDFS-5684 Project: Hadoop HDFS

[jira] [Commented] (HDFS-5200) Datanode should have compatibility mode for sending combined block reports

[ https://issues.apache.org/jira/browse/HDFS-5200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852422#comment-13852422 ] Arpit Agarwal commented on HDFS-5200: - This Jira was filed with the objective of suppor

[jira] [Updated] (HDFS-5483) NN should gracefully handle multiple block replicas on same DN

[ https://issues.apache.org/jira/browse/HDFS-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5483: Fix Version/s: 3.0.0 Status: Patch Available (was: Open) > NN should gracefully handle m

[jira] [Updated] (HDFS-5667) Include DatanodeStorage in StorageReport

[ https://issues.apache.org/jira/browse/HDFS-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5667: Fix Version/s: (was: Heterogeneous Storage (HDFS-2832)) 3.0.0 Affe

[jira] [Updated] (HDFS-5220) Expose group resolution time as metric

[ https://issues.apache.org/jira/browse/HDFS-5220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang updated HDFS-5220: -- Status: Open (was: Patch Available) > Expose group resolution time as metric >

[jira] [Updated] (HDFS-5483) NN should gracefully handle multiple block replicas on same DN

[ https://issues.apache.org/jira/browse/HDFS-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5483: Attachment: (was: h5483.02.patch) > NN should gracefully handle multiple block replicas on same

[jira] [Updated] (HDFS-5483) NN should gracefully handle multiple block replicas on same DN

[ https://issues.apache.org/jira/browse/HDFS-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5483: Attachment: h5483.02.patch > NN should gracefully handle multiple block replicas on same DN > --

[jira] [Commented] (HDFS-5663) make the retry time and interval value configurable in openInfo()

[ https://issues.apache.org/jira/browse/HDFS-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852418#comment-13852418 ] Liang Xie commented on HDFS-5663: - The last QA result is good. [~saint@gmail.com] > ma

[jira] [Updated] (HDFS-5483) NN should gracefully handle multiple block replicas on same DN

[ https://issues.apache.org/jira/browse/HDFS-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5483: Attachment: h5483.02.patch Patch to ignore the extra replica and add test case. > NN should gracefu

[jira] [Commented] (HDFS-5220) Expose group resolution time as metric

[ https://issues.apache.org/jira/browse/HDFS-5220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852415#comment-13852415 ] Hadoop QA commented on HDFS-5220: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5667) Include DatanodeStorage in StorageReport

[ https://issues.apache.org/jira/browse/HDFS-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852410#comment-13852410 ] Eric Sirianni commented on HDFS-5667: - [~arpitagarwal], I'll apply the patch and try it

[jira] [Commented] (HDFS-5673) Implement logic for modification of ACLs.

[ https://issues.apache.org/jira/browse/HDFS-5673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852409#comment-13852409 ] Chris Nauroth commented on HDFS-5673: - Thanks for the review, Haohui. I'm going to get

[jira] [Updated] (HDFS-5661) Browsing FileSystem via web ui, should use datanode's fqdn instead of ip address

[ https://issues.apache.org/jira/browse/HDFS-5661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5661: Resolution: Fixed Fix Version/s: 2.3.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Commented] (HDFS-5661) Browsing FileSystem via web ui, should use datanode's fqdn instead of ip address

[ https://issues.apache.org/jira/browse/HDFS-5661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852404#comment-13852404 ] Hudson commented on HDFS-5661: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4915 (See [https:

[jira] [Updated] (HDFS-5483) NN should gracefully handle multiple block replicas on same DN

[ https://issues.apache.org/jira/browse/HDFS-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5483: Summary: NN should gracefully handle multiple block replicas on same DN (was: Make reportDiff resil

[jira] [Commented] (HDFS-5661) Browsing FileSystem via web ui, should use datanode's fqdn instead of ip address

[ https://issues.apache.org/jira/browse/HDFS-5661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852371#comment-13852371 ] Jing Zhao commented on HDFS-5661: - Thanks for the reminder, Benoy! I will commit the patch

[jira] [Resolved] (HDFS-5595) NameNode: implement AclManager as abstraction over INode ACL Map.

[ https://issues.apache.org/jira/browse/HDFS-5595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-5595. - Resolution: Won't Fix As per discussion on HDFS-4685, our plan has changed to implement the assoc

[jira] [Commented] (HDFS-5658) Implement ACL as a INode feature

[ https://issues.apache.org/jira/browse/HDFS-5658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852358#comment-13852358 ] Chris Nauroth commented on HDFS-5658: - Hi, Haohui. This patch looks good. A couple of

[jira] [Commented] (HDFS-5661) Browsing FileSystem via web ui, should use datanode's fqdn instead of ip address

[ https://issues.apache.org/jira/browse/HDFS-5661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852355#comment-13852355 ] Benoy Antony commented on HDFS-5661: Let me know if anything is needed from my side on

[jira] [Commented] (HDFS-5545) Allow specifying endpoints for listeners in HttpServer

[ https://issues.apache.org/jira/browse/HDFS-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852342#comment-13852342 ] Haohui Mai commented on HDFS-5545: -- I'll verify this bug and file a new jira to fix it if

[jira] [Commented] (HDFS-5449) WebHdfs compatibility broken between 2.2 and 1.x / 23.x

[ https://issues.apache.org/jira/browse/HDFS-5449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852343#comment-13852343 ] Hadoop QA commented on HDFS-5449: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5676) fix inconsistent synchronization of CachingStrategy

[ https://issues.apache.org/jira/browse/HDFS-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852314#comment-13852314 ] Hudson commented on HDFS-5676: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4913 (See [https:

[jira] [Updated] (HDFS-5662) Can't decommission a DataNode due to file's replication factor larger than the rest of the cluster size

[ https://issues.apache.org/jira/browse/HDFS-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5662: - Attachment: HDFS-5662.branch2.3.patch The patch to branch2.3 is slightly different in the unit test. Attac

[jira] [Updated] (HDFS-5662) Can't decommission a DataNode due to file's replication factor larger than the rest of the cluster size

[ https://issues.apache.org/jira/browse/HDFS-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5662: - Fix Version/s: 2.3.0 > Can't decommission a DataNode due to file's replication factor larger than > the r

[jira] [Updated] (HDFS-5676) fix inconsistent synchronization of CachingStrategy

[ https://issues.apache.org/jira/browse/HDFS-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5676: --- Resolution: Fixed Fix Version/s: 2.4.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-4685) Implementation of ACLs in HDFS

[ https://issues.apache.org/jira/browse/HDFS-4685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852294#comment-13852294 ] Chris Nauroth commented on HDFS-4685: - I can loop back now on the question of using ino

[jira] [Commented] (HDFS-5545) Allow specifying endpoints for listeners in HttpServer

[ https://issues.apache.org/jira/browse/HDFS-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852287#comment-13852287 ] Jason Lowe commented on HDFS-5545: -- Datanodes starting under jsvc are now getting this exc

[jira] [Commented] (HDFS-5636) Enforce a max TTL per cache pool

[ https://issues.apache.org/jira/browse/HDFS-5636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852285#comment-13852285 ] Colin Patrick McCabe commented on HDFS-5636: It might better to leave existing

[jira] [Updated] (HDFS-5667) Include DatanodeStorage in StorageReport

[ https://issues.apache.org/jira/browse/HDFS-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5667: Attachment: h5667.03.patch Update patch to remove blank comment lines. > Include DatanodeStorage in

[jira] [Commented] (HDFS-5636) Enforce a max TTL per cache pool

[ https://issues.apache.org/jira/browse/HDFS-5636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852261#comment-13852261 ] Andrew Wang commented on HDFS-5636: --- I actually thought about this a bit more, and in ter

[jira] [Commented] (HDFS-5667) Include DatanodeStorage in StorageReport

[ https://issues.apache.org/jira/browse/HDFS-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852254#comment-13852254 ] Arpit Agarwal commented on HDFS-5667: - [~sirianni], I added a test case but would be gr

[jira] [Updated] (HDFS-5667) Include DatanodeStorage in StorageReport

[ https://issues.apache.org/jira/browse/HDFS-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5667: Attachment: h5667.02.patch Patch to add DatanodeStorage to storage reports. Also has a couple of rel

[jira] [Updated] (HDFS-5662) Can't decommission a DataNode due to file's replication factor larger than the rest of the cluster size

[ https://issues.apache.org/jira/browse/HDFS-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5662: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) > Can't

[jira] [Commented] (HDFS-5662) Can't decommission a DataNode due to file's replication factor larger than the rest of the cluster size

[ https://issues.apache.org/jira/browse/HDFS-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852245#comment-13852245 ] Hudson commented on HDFS-5662: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4912 (See [https:

[jira] [Commented] (HDFS-5662) Can't decommission a DataNode due to file's replication factor larger than the rest of the cluster size

[ https://issues.apache.org/jira/browse/HDFS-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852241#comment-13852241 ] Brandon Li commented on HDFS-5662: -- I've committed the patch. Thank you, Arpit, for review

[jira] [Created] (HDFS-5683) Better audit log messages for caching operations

Andrew Wang created HDFS-5683: - Summary: Better audit log messages for caching operations Key: HDFS-5683 URL: https://issues.apache.org/jira/browse/HDFS-5683 Project: Hadoop HDFS Issue Type: Sub-

[jira] [Updated] (HDFS-5662) Can't decommission a DataNode due to file's replication factor larger than the rest of the cluster size

[ https://issues.apache.org/jira/browse/HDFS-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5662: - Issue Type: Improvement (was: Bug) > Can't decommission a DataNode due to file's replication factor large

[jira] [Updated] (HDFS-5220) Expose group resolution time as metric

[ https://issues.apache.org/jira/browse/HDFS-5220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang updated HDFS-5220: -- Attachment: hdfs-5220.patch Add the first version patch. One drawback is that the quantile info is in a

[jira] [Updated] (HDFS-5220) Expose group resolution time as metric

[ https://issues.apache.org/jira/browse/HDFS-5220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang updated HDFS-5220: -- Status: Patch Available (was: Open) > Expose group resolution time as metric >

[jira] [Commented] (HDFS-5449) WebHdfs compatibility broken between 2.2 and 1.x / 23.x

[ https://issues.apache.org/jira/browse/HDFS-5449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852229#comment-13852229 ] Jing Zhao commented on HDFS-5449: - Do we also want to add some javadoc/comment for the chan

[jira] [Commented] (HDFS-5662) Can't decommission a DataNode due to file's replication factor larger than the rest of the cluster size

[ https://issues.apache.org/jira/browse/HDFS-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852227#comment-13852227 ] Brandon Li commented on HDFS-5662: -- The unit test passed in my local test. > Can't decomm

[jira] [Commented] (HDFS-5676) fix inconsistent synchronization of CachingStrategy

[ https://issues.apache.org/jira/browse/HDFS-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852226#comment-13852226 ] Hadoop QA commented on HDFS-5676: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5449) WebHdfs compatibility broken between 2.2 and 1.x / 23.x

[ https://issues.apache.org/jira/browse/HDFS-5449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852204#comment-13852204 ] Daryn Sharp commented on HDFS-5449: --- Can: {code}xferPort = (int)(long)(Long)m.get("xferPo

[jira] [Updated] (HDFS-5634) allow BlockReaderLocal to switch between checksumming and not

[ https://issues.apache.org/jira/browse/HDFS-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5634: --- Target Version/s: 2.4.0 (was: 3.0.0) Affects Version/s: (was: 3.0.0)

[jira] [Commented] (HDFS-5673) Implement logic for modification of ACLs.

[ https://issues.apache.org/jira/browse/HDFS-5673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852200#comment-13852200 ] Haohui Mai commented on HDFS-5673: -- Acl: Acl.Builder can initialize the entries field alo

[jira] [Commented] (HDFS-5662) Can't decommission a DataNode due to file's replication factor larger than the rest of the cluster size

[ https://issues.apache.org/jira/browse/HDFS-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852179#comment-13852179 ] Hadoop QA commented on HDFS-5662: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-5496) Make replication queue initialization asynchronous

[ https://issues.apache.org/jira/browse/HDFS-5496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5496: Resolution: Fixed Fix Version/s: HDFS-5535 (Rolling upgrades) Hadoop Flags: Reviewed S

[jira] [Updated] (HDFS-5449) WebHdfs compatibility broken between 2.2 and 1.x / 23.x

[ https://issues.apache.org/jira/browse/HDFS-5449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-5449: - Attachment: HDFS-5449.trunk.patch The new patch throws an IOException if ipAddr or xferPort cannot be set

[jira] [Updated] (HDFS-5667) Include DatanodeStorage in StorageReport

[ https://issues.apache.org/jira/browse/HDFS-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5667: Summary: Include DatanodeStorage in StorageReport (was: StorageType and State in DatanodeStorageInf

[jira] [Updated] (HDFS-5634) allow BlockReaderLocal to switch between checksumming and not

[ https://issues.apache.org/jira/browse/HDFS-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5634: --- Attachment: HDFS-5634.009.branch-2.patch posted patch for branch-2 > allow BlockReade

[jira] [Updated] (HDFS-5634) allow BlockReaderLocal to switch between checksumming and not

[ https://issues.apache.org/jira/browse/HDFS-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5634: --- Status: Open (was: Patch Available) > allow BlockReaderLocal to switch between checks

[jira] [Updated] (HDFS-2832) Enable support for heterogeneous storages in HDFS

[ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-2832: Fix Version/s: 3.0.0 > Enable support for heterogeneous storages in HDFS > -

[jira] [Commented] (HDFS-5483) Make reportDiff resilient to malformed block reports

[ https://issues.apache.org/jira/browse/HDFS-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852142#comment-13852142 ] Arpit Agarwal commented on HDFS-5483: - {quote} It looks like we have two replicas of t

[jira] [Updated] (HDFS-5151) Add test case for commitBlockSynchronization with invalid Storage

[ https://issues.apache.org/jira/browse/HDFS-5151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5151: Parent Issue: HDFS-5682 (was: HDFS-2832) > Add test case for commitBlockSynchronization with invali

[jira] [Updated] (HDFS-5423) Verify initializations of LocatedBlock/RecoveringBlock

[ https://issues.apache.org/jira/browse/HDFS-5423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5423: Parent Issue: HDFS-5682 (was: HDFS-2832) > Verify initializations of LocatedBlock/RecoveringBlock >

[jira] [Updated] (HDFS-5264) Consider renaming StorageID

[ https://issues.apache.org/jira/browse/HDFS-5264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5264: Parent Issue: HDFS-5682 (was: HDFS-2832) > Consider renaming StorageID > --

[jira] [Updated] (HDFS-4989) Balancer needs to consider storage type in balancing

[ https://issues.apache.org/jira/browse/HDFS-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-4989: Parent Issue: HDFS-5682 (was: HDFS-2832) > Balancer needs to consider storage type in balancing > -

[jira] [Commented] (HDFS-5483) Make reportDiff resilient to malformed block reports

[ https://issues.apache.org/jira/browse/HDFS-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852131#comment-13852131 ] Buddy commented on HDFS-5483: - I want to clarify. I had the error case wrong in the above comme

[jira] [Updated] (HDFS-5178) DataTransferProtocol changes for supporting mutiple storages per DN

[ https://issues.apache.org/jira/browse/HDFS-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5178: Parent Issue: HDFS-5682 (was: HDFS-2832) > DataTransferProtocol changes for supporting mutiple stor

[jira] [Updated] (HDFS-5229) Add a storage type attribute to file

[ https://issues.apache.org/jira/browse/HDFS-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5229: Parent Issue: HDFS-5682 (was: HDFS-2832) > Add a storage type attribute to file > -

[jira] [Updated] (HDFS-5183) Combine ReplicaPlacementPolicy with VolumeChoosingPolicy together to have a global view in choosing DN storage for replica.

[ https://issues.apache.org/jira/browse/HDFS-5183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5183: Parent Issue: HDFS-5682 (was: HDFS-2832) > Combine ReplicaPlacementPolicy with VolumeChoosingPolicy

[jira] [Updated] (HDFS-5391) writeBlock should accept a target storage directory

[ https://issues.apache.org/jira/browse/HDFS-5391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5391: Parent Issue: HDFS-5682 (was: HDFS-2832) > writeBlock should accept a target storage directory > --

[jira] [Updated] (HDFS-4986) Namenode webUI changes to incorporate storage type

[ https://issues.apache.org/jira/browse/HDFS-4986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-4986: Parent Issue: HDFS-5682 (was: HDFS-2832) > Namenode webUI changes to incorporate storage type > ---

[jira] [Updated] (HDFS-5682) Heterogeneous Storage phase 2 - APIs to expose Storage Types

[ https://issues.apache.org/jira/browse/HDFS-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5682: Summary: Heterogeneous Storage phase 2 - APIs to expose Storage Types (was: Heterogeneous Storage p

[jira] [Commented] (HDFS-2832) Enable support for heterogeneous storages in HDFS

[ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852126#comment-13852126 ] Arpit Agarwal commented on HDFS-2832: - Phase 2 tasks will be tracked under HDFS-5682.

[jira] [Commented] (HDFS-5483) Make reportDiff resilient to malformed block reports

[ https://issues.apache.org/jira/browse/HDFS-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852118#comment-13852118 ] Arpit Agarwal commented on HDFS-5483: - Thanks for reporting, I'll take a look. While w

[jira] [Commented] (HDFS-5682) Heterogeneous Storage phase - APIs to expose Storage Types

[ https://issues.apache.org/jira/browse/HDFS-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852121#comment-13852121 ] Arpit Agarwal commented on HDFS-5682: - An updated design doc will be posted soon - plea

  1   2   >