[jira] [Commented] (HDFS-7824) GetContentSummary API and its namenode implementaion for Storage Type Quota/Usage

[ https://issues.apache.org/jira/browse/HDFS-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381638#comment-14381638 ] Hadoop QA commented on HDFS-7824: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7889: Attachment: HDFS-7889-001.patch Subclass DFSOutputStream to support writing striping layout files

[jira] [Commented] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381648#comment-14381648 ] Li Bo commented on HDFS-7888: - hi Nicholas I have just uploaded a patch to HDFS-7889. If you

[jira] [Commented] (HDFS-7729) Add logic to DFSOutputStream to support writing a file in striping layout

[ https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381653#comment-14381653 ] Li Bo commented on HDFS-7729: - hi, Zhe I have just uploaded a patch to HDFS-7889 and add a unit

[jira] [Updated] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7889: Status: Patch Available (was: Open) Subclass DFSOutputStream to support writing striping layout files

[jira] [Commented] (HDFS-7619) Erasure Coding: Handling files in snapshots

[ https://issues.apache.org/jira/browse/HDFS-7619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381543#comment-14381543 ] Takuya Fukudome commented on HDFS-7619: --- Hi [~jingzhao], I am interested in working

[jira] [Commented] (HDFS-7928) Scanning blocks from disk during rolling upgrade startup takes a lot of time if disks are busy

[ https://issues.apache.org/jira/browse/HDFS-7928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381743#comment-14381743 ] Hudson commented on HDFS-7928: -- FAILURE: Integrated in Hadoop-Yarn-trunk #878 (See

[jira] [Commented] (HDFS-6353) Check and make checkpoint before stopping the NameNode

[ https://issues.apache.org/jira/browse/HDFS-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381749#comment-14381749 ] Hudson commented on HDFS-6353: -- FAILURE: Integrated in Hadoop-Yarn-trunk #878 (See

[jira] [Commented] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381686#comment-14381686 ] Hadoop QA commented on HDFS-7889: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7980) Incremental BlockReport will dramatically slow down the startup of a namenode

[ https://issues.apache.org/jira/browse/HDFS-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381699#comment-14381699 ] Walter Su commented on HDFS-7980: - bq. NN treats the incremental block report as the first

[jira] [Commented] (HDFS-6353) Check and make checkpoint before stopping the NameNode

[ https://issues.apache.org/jira/browse/HDFS-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381738#comment-14381738 ] Hudson commented on HDFS-6353: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #144 (See

[jira] [Commented] (HDFS-7928) Scanning blocks from disk during rolling upgrade startup takes a lot of time if disks are busy

[ https://issues.apache.org/jira/browse/HDFS-7928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381732#comment-14381732 ] Hudson commented on HDFS-7928: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #144 (See

[jira] [Commented] (HDFS-7369) Erasure coding: distribute recovery work for striped blocks to DataNode

[ https://issues.apache.org/jira/browse/HDFS-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381851#comment-14381851 ] Kai Zheng commented on HDFS-7369: - bq.we can put GS logic and ECSchema work into separate

[jira] [Commented] (HDFS-7928) Scanning blocks from disk during rolling upgrade startup takes a lot of time if disks are busy

[ https://issues.apache.org/jira/browse/HDFS-7928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381853#comment-14381853 ] Hudson commented on HDFS-7928: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #144 (See

[jira] [Commented] (HDFS-6353) Check and make checkpoint before stopping the NameNode

[ https://issues.apache.org/jira/browse/HDFS-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381859#comment-14381859 ] Hudson commented on HDFS-6353: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #144 (See

[jira] [Commented] (HDFS-7891) A block placement policy with best fault tolerance

[ https://issues.apache.org/jira/browse/HDFS-7891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381864#comment-14381864 ] Tsz Wo Nicholas Sze commented on HDFS-7891: --- ... . But I think place 2 replica

[jira] [Commented] (HDFS-7369) Erasure coding: distribute recovery work for striped blocks to DataNode

[ https://issues.apache.org/jira/browse/HDFS-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381867#comment-14381867 ] Kai Zheng commented on HDFS-7369: - How about the counterpart, erasure encoding work in

[jira] [Updated] (HDFS-7980) Incremental BlockReport will dramatically slow down the startup of a namenode

[ https://issues.apache.org/jira/browse/HDFS-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-7980: Attachment: HDFS-7980.001.patch Incremental BlockReport will dramatically slow down the startup of a

[jira] [Commented] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381829#comment-14381829 ] Tsz Wo Nicholas Sze commented on HDFS-7888: --- Let's split the patch since the code

[jira] [Commented] (HDFS-6353) Check and make checkpoint before stopping the NameNode

[ https://issues.apache.org/jira/browse/HDFS-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381880#comment-14381880 ] Hudson commented on HDFS-6353: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2094 (See

[jira] [Commented] (HDFS-7928) Scanning blocks from disk during rolling upgrade startup takes a lot of time if disks are busy

[ https://issues.apache.org/jira/browse/HDFS-7928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381874#comment-14381874 ] Hudson commented on HDFS-7928: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2094 (See

[jira] [Commented] (HDFS-7980) Incremental BlockReport will dramatically slow down the startup of a namenode

[ https://issues.apache.org/jira/browse/HDFS-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381800#comment-14381800 ] Walter Su commented on HDFS-7980: - Sorry what I said before was not clear. I mean: If we

[jira] [Commented] (HDFS-7980) Incremental BlockReport will dramatically slow down the startup of a namenode

[ https://issues.apache.org/jira/browse/HDFS-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381848#comment-14381848 ] Tsz Wo Nicholas Sze commented on HDFS-7980: --- Missing delHint seems a minor issue.

[jira] [Assigned] (HDFS-7980) Incremental BlockReport will dramatically slow down the startup of a namenode

[ https://issues.apache.org/jira/browse/HDFS-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LiRuifeng reassigned HDFS-7980: --- Assignee: LiRuifeng (was: Walter Su) Incremental BlockReport will dramatically slow down the

[jira] [Assigned] (HDFS-7955) Improve naming of classes, methods, and variables related to block replication and recovery

[ https://issues.apache.org/jira/browse/HDFS-7955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Priyank Rastogi reassigned HDFS-7955: - Assignee: Rakesh R Improve naming of classes, methods, and variables related to block

[jira] [Commented] (HDFS-7891) A block placement policy with best fault tolerance

[ https://issues.apache.org/jira/browse/HDFS-7891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383212#comment-14383212 ] Walter Su commented on HDFS-7891: - And the risk of 1 failure out of 4 is higher than 1 out

[jira] [Updated] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7889: Attachment: HDFS-7889-002.patch fix several problems in Zhe's comments Subclass DFSOutputStream to support writing

[jira] [Updated] (HDFS-6945) BlockManager should remove a block from excessReplicateMap and decrement ExcessBlocks metric when the block is removed

[ https://issues.apache.org/jira/browse/HDFS-6945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-6945: Status: Open (was: Patch Available) BlockManager should remove a block from excessReplicateMap and

[jira] [Assigned] (HDFS-7949) WebImageViewer need support file size calculation with striped blocks

[ https://issues.apache.org/jira/browse/HDFS-7949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Priyank Rastogi reassigned HDFS-7949: - Assignee: Rakesh R WebImageViewer need support file size calculation with striped blocks

[jira] [Updated] (HDFS-7601) Operations(e.g. balance) failed due to deficient configuration parsing

[ https://issues.apache.org/jira/browse/HDFS-7601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doris Gu updated HDFS-7601: --- Attachment: (was: 0001-for-hdfs-7601.patch) Operations(e.g. balance) failed due to deficient

[jira] [Updated] (HDFS-7601) Operations(e.g. balance) failed due to deficient configuration parsing

[ https://issues.apache.org/jira/browse/HDFS-7601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doris Gu updated HDFS-7601: --- Attachment: 0001-for-hdfs-7601.patch Operations(e.g. balance) failed due to deficient configuration parsing

[jira] [Commented] (HDFS-7410) Support CreateFlags with append() to support hsync() for appending streams

[ https://issues.apache.org/jira/browse/HDFS-7410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383318#comment-14383318 ] Vinayakumar B commented on HDFS-7410: - Thanks [~cmccabe] for the reviews and commit.

[jira] [Commented] (HDFS-7717) Erasure Coding: provide a tool for convert files between replication and erasure coding

[ https://issues.apache.org/jira/browse/HDFS-7717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383233#comment-14383233 ] Kai Zheng commented on HDFS-7717: - I see. As related discussion when considering NN to

[jira] [Commented] (HDFS-7601) Operations(e.g. balance) failed due to deficient configuration parsing

[ https://issues.apache.org/jira/browse/HDFS-7601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383293#comment-14383293 ] Hadoop QA commented on HDFS-7601: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7700) Update document for quota by storage type

[ https://issues.apache.org/jira/browse/HDFS-7700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383312#comment-14383312 ] Arpit Agarwal commented on HDFS-7700: - +1 for the patch, I'll commit it tomorrow unless

[jira] [Commented] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1438#comment-1438 ] Hadoop QA commented on HDFS-7889: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383282#comment-14383282 ] Li Bo commented on HDFS-7889: - Thanks Zhe’s careful review. bq. Isn’t currentPacket always null

[jira] [Updated] (HDFS-6945) BlockManager should remove a block from excessReplicateMap and decrement ExcessBlocks metric when the block is removed

[ https://issues.apache.org/jira/browse/HDFS-6945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-6945: Target Version/s: 2.8.0 (was: 2.6.1) BlockManager should remove a block from excessReplicateMap

[jira] [Commented] (HDFS-7980) Incremental BlockReport will dramatically slow down the startup of a namenode

[ https://issues.apache.org/jira/browse/HDFS-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383287#comment-14383287 ] Walter Su commented on HDFS-7980: - {quote} NN could safely ignore the incremental when

[jira] [Assigned] (HDFS-7980) Incremental BlockReport will dramatically slow down the startup of a namenode

[ https://issues.apache.org/jira/browse/HDFS-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LiRuifeng reassigned HDFS-7980: --- Assignee: Walter Su (was: LiRuifeng) Incremental BlockReport will dramatically slow down the

[jira] [Updated] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7889: Status: In Progress (was: Patch Available) Subclass DFSOutputStream to support writing striping layout files

[jira] [Commented] (HDFS-4838) HDFS should use the new methods added in HADOOP-9574

[ https://issues.apache.org/jira/browse/HDFS-4838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382190#comment-14382190 ] Dongming Liang commented on HDFS-4838: -- I'll pick this up. HDFS should use the new

[jira] [Assigned] (HDFS-4838) HDFS should use the new methods added in HADOOP-9574

[ https://issues.apache.org/jira/browse/HDFS-4838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongming Liang reassigned HDFS-4838: Assignee: Dongming Liang HDFS should use the new methods added in HADOOP-9574

[jira] [Commented] (HDFS-7824) GetContentSummary API and its namenode implementaion for Storage Type Quota/Usage

[ https://issues.apache.org/jira/browse/HDFS-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382265#comment-14382265 ] Arpit Agarwal commented on HDFS-7824: - +1 for the patch. Thanks for your patience with

[jira] [Updated] (HDFS-7701) Support reporting per storage type quota and usage with hadoop/hdfs shell

[ https://issues.apache.org/jira/browse/HDFS-7701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7701: Status: Patch Available (was: Open) Support reporting per storage type quota and usage with

[jira] [Commented] (HDFS-7824) GetContentSummary API and its namenode implementation for Storage Type Quota/Usage

[ https://issues.apache.org/jira/browse/HDFS-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382328#comment-14382328 ] Hudson commented on HDFS-7824: -- FAILURE: Integrated in Hadoop-trunk-Commit #7440 (See

[jira] [Updated] (HDFS-7824) GetContentSummary API and its namenode implementation for Storage Type Quota/Usage

[ https://issues.apache.org/jira/browse/HDFS-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7824: Summary: GetContentSummary API and its namenode implementation for Storage Type Quota/Usage (was:

[jira] [Updated] (HDFS-7701) Support reporting per storage type quota and usage with hadoop/hdfs shell

[ https://issues.apache.org/jira/browse/HDFS-7701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7701: Assignee: Peter Shi (was: Xiaoyu Yao) Support reporting per storage type quota and usage with

[jira] [Commented] (HDFS-7824) GetContentSummary API and its namenode implementaion for Storage Type Quota/Usage

[ https://issues.apache.org/jira/browse/HDFS-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382117#comment-14382117 ] Xiaoyu Yao commented on HDFS-7824: -- TestTracing#testWriteTraceHooks has known issue

[jira] [Commented] (HDFS-7369) Erasure coding: distribute recovery work for striped blocks to DataNode

[ https://issues.apache.org/jira/browse/HDFS-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382317#comment-14382317 ] Jing Zhao commented on HDFS-7369: - GS stands for Generation Stamp. Erasure coding:

[jira] [Updated] (HDFS-7824) GetContentSummary API and its namenode implementation for Storage Type Quota/Usage

[ https://issues.apache.org/jira/browse/HDFS-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7824: Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Commented] (HDFS-7369) Erasure coding: distribute recovery work for striped blocks to DataNode

[ https://issues.apache.org/jira/browse/HDFS-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382316#comment-14382316 ] Jing Zhao commented on HDFS-7369: - GS stands for Generation Stamp. Erasure coding:

[jira] [Updated] (HDFS-7811) Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage

[ https://issues.apache.org/jira/browse/HDFS-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7811: Fix Version/s: (was: 2.7.0) Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage

[jira] [Updated] (HDFS-7990) IBR delete ack should not be delayed

[ https://issues.apache.org/jira/browse/HDFS-7990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-7990: -- Attachment: HDFS-7990.patch IBRs are always sent every heartbeat, even if it only contains delete acks.

[jira] [Updated] (HDFS-7990) IBR delete ack should not be delayed

[ https://issues.apache.org/jira/browse/HDFS-7990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-7990: -- Status: Patch Available (was: Open) IBR delete ack should not be delayed

[jira] [Commented] (HDFS-7369) Erasure coding: distribute recovery work for striped blocks to DataNode

[ https://issues.apache.org/jira/browse/HDFS-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382314#comment-14382314 ] Jing Zhao commented on HDFS-7369: - bq. converting blocks in replica mode into EC stripping

[jira] [Issue Comment Deleted] (HDFS-7369) Erasure coding: distribute recovery work for striped blocks to DataNode

[ https://issues.apache.org/jira/browse/HDFS-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7369: Comment: was deleted (was: GS stands for Generation Stamp.) Erasure coding: distribute recovery work for

[jira] [Commented] (HDFS-7990) IBR delete ack should not be delayed

[ https://issues.apache.org/jira/browse/HDFS-7990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382547#comment-14382547 ] Hadoop QA commented on HDFS-7990: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7410) Support CreateFlags with append() to support hsync() for appending streams

[ https://issues.apache.org/jira/browse/HDFS-7410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382578#comment-14382578 ] Colin Patrick McCabe commented on HDFS-7410: +1. TestTracing failure is

[jira] [Commented] (HDFS-5523) Support multiple subdirectory exports in HDFS NFS gateway

[ https://issues.apache.org/jira/browse/HDFS-5523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382522#comment-14382522 ] Brandon Li commented on HDFS-5523: -- Yes. We should not always export / as one of the

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382570#comment-14382570 ] Colin Patrick McCabe commented on HDFS-7878: I agree with [~jingzhao] that

[jira] [Commented] (HDFS-5523) Support multiple subdirectory exports in HDFS NFS gateway

[ https://issues.apache.org/jira/browse/HDFS-5523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382614#comment-14382614 ] Zhe Zhang commented on HDFS-5523: - Thanks Brandon for clarifying this. I agree this is a

[jira] [Commented] (HDFS-7410) Support CreateFlags with append() to support hsync() for appending streams

[ https://issues.apache.org/jira/browse/HDFS-7410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382616#comment-14382616 ] Hudson commented on HDFS-7410: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7442 (See

[jira] [Commented] (HDFS-7054) Make DFSOutputStream tracing more fine-grained

[ https://issues.apache.org/jira/browse/HDFS-7054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382434#comment-14382434 ] Colin Patrick McCabe commented on HDFS-7054: Thanks again for fixing

[jira] [Created] (HDFS-7995) Implement chmod in the HDFS Web UI

Ravi Prakash created HDFS-7995: -- Summary: Implement chmod in the HDFS Web UI Key: HDFS-7995 URL: https://issues.apache.org/jira/browse/HDFS-7995 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-7979) Initialize block report IDs with a random number

[ https://issues.apache.org/jira/browse/HDFS-7979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382622#comment-14382622 ] Colin Patrick McCabe commented on HDFS-7979: I think it's pretty unlikely that

[jira] [Updated] (HDFS-7936) Erasure coding: resolving conflicts in the branch when merging

[ https://issues.apache.org/jira/browse/HDFS-7936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7936: Description: This will be used to track and resolve conflicts when merging trunk changes. Below is a list

[jira] [Resolved] (HDFS-7965) TestTracing#testWriteTraceHooks is flaky

[ https://issues.apache.org/jira/browse/HDFS-7965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-7965. Resolution: Duplicate TestTracing#testWriteTraceHooks is flaky

[jira] [Commented] (HDFS-7839) Erasure coding: implement facilities in NameNode to create and manage EC zones

[ https://issues.apache.org/jira/browse/HDFS-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382455#comment-14382455 ] Zhe Zhang commented on HDFS-7839: - Thanks for the thoughts Kai; they are really helpful in

[jira] [Commented] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

[ https://issues.apache.org/jira/browse/HDFS-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382403#comment-14382403 ] Kihwal Lee commented on HDFS-7991: -- I am afraid the default behavior will break existing

[jira] [Commented] (HDFS-7758) Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead

[ https://issues.apache.org/jira/browse/HDFS-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382425#comment-14382425 ] Colin Patrick McCabe commented on HDFS-7758: Thanks, Eddy. Sorry that reviews

[jira] [Commented] (HDFS-7936) Erasure coding: resolving conflicts in the branch when merging

[ https://issues.apache.org/jira/browse/HDFS-7936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382423#comment-14382423 ] Zhe Zhang commented on HDFS-7936: - Thanks Kai! Erasure coding: resolving conflicts in the

[jira] [Commented] (HDFS-7701) Support reporting per storage type quota and usage with hadoop/hdfs shell

[ https://issues.apache.org/jira/browse/HDFS-7701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382450#comment-14382450 ] Hadoop QA commented on HDFS-7701: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5523) Support multiple subdirectory exports in HDFS NFS gateway

[ https://issues.apache.org/jira/browse/HDFS-5523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382461#comment-14382461 ] Zhe Zhang commented on HDFS-5523: - Thanks for the analysis Brandon! Do you think we should

[jira] [Commented] (HDFS-5523) Support multiple subdirectory exports in HDFS NFS gateway

[ https://issues.apache.org/jira/browse/HDFS-5523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382477#comment-14382477 ] Allen Wittenauer commented on HDFS-5523: bq. Do you think we should always export /

[jira] [Commented] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382364#comment-14382364 ] Zhe Zhang commented on HDFS-7889: - Thanks Bo for the patch! The main striped writing logic

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382381#comment-14382381 ] Allen Wittenauer commented on HDFS-5796: bq. Revert the changes in HDFS-5716

[jira] [Commented] (HDFS-7701) Support reporting per storage type quota and usage with hadoop/hdfs shell

[ https://issues.apache.org/jira/browse/HDFS-7701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382383#comment-14382383 ] Xiaoyu Yao commented on HDFS-7701: -- [~shihaoliang], Thanks for working on this! Can you

[jira] [Assigned] (HDFS-7285) Erasure Coding Support inside HDFS

[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDFS-7285: --- Assignee: Arpit Agarwal (was: Zhe Zhang) Erasure Coding Support inside HDFS

[jira] [Updated] (HDFS-7285) Erasure Coding Support inside HDFS

[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7285: Assignee: Zhe Zhang (was: Arpit Agarwal) Erasure Coding Support inside HDFS

[jira] [Commented] (HDFS-7891) A block placement policy with best fault tolerance

[ https://issues.apache.org/jira/browse/HDFS-7891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382417#comment-14382417 ] Zhe Zhang commented on HDFS-7891: - Thanks for the analysis Nicholas. I guess you are

[jira] [Commented] (HDFS-7963) Fix expected tracing spans in TestTracing along with HDFS-7054

[ https://issues.apache.org/jira/browse/HDFS-7963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382430#comment-14382430 ] Colin Patrick McCabe commented on HDFS-7963: Sorry, guys, I had to fight some

[jira] [Resolved] (HDFS-3668) XmlEditsVisitor should not use classes in com.sun.org.apache.xml.internal.serialize

[ https://issues.apache.org/jira/browse/HDFS-3668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-3668. -- Resolution: Not a Problem XmlEditsVisitor should not use classes in

[jira] [Updated] (HDFS-7993) Incorrect descriptions in fsck when nodes are decommissioned

[ https://issues.apache.org/jira/browse/HDFS-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7993: -- Target Version/s: 2.8.0 Affects Version/s: 2.6.0 Incorrect descriptions in fsck when nodes are

[jira] [Commented] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

[ https://issues.apache.org/jira/browse/HDFS-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383061#comment-14383061 ] Hadoop QA commented on HDFS-7991: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7996) After swapping a volume, BlockReceiver reports ReplicaNotFoundException

[ https://issues.apache.org/jira/browse/HDFS-7996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7996: Attachment: HDFS-7996.000.patch The patch makes {{BlockReceiver#PackageResponder#finalizeBlock()}}

[jira] [Commented] (HDFS-7959) WebHdfs logging is missing on Datanode

[ https://issues.apache.org/jira/browse/HDFS-7959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383082#comment-14383082 ] Hadoop QA commented on HDFS-7959: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7995) Implement chmod in the HDFS Web UI

[ https://issues.apache.org/jira/browse/HDFS-7995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383100#comment-14383100 ] Hadoop QA commented on HDFS-7995: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7963) Fix expected tracing spans in TestTracing along with HDFS-7054

[ https://issues.apache.org/jira/browse/HDFS-7963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381894#comment-14381894 ] Kihwal Lee commented on HDFS-7963: -- +1 Fix expected tracing spans in TestTracing along

[jira] [Updated] (HDFS-7963) Fix expected tracing spans in TestTracing along with HDFS-7054

[ https://issues.apache.org/jira/browse/HDFS-7963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7963: - Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Commented] (HDFS-7963) Fix expected tracing spans in TestTracing along with HDFS-7054

[ https://issues.apache.org/jira/browse/HDFS-7963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381900#comment-14381900 ] Hudson commented on HDFS-7963: -- FAILURE: Integrated in Hadoop-trunk-Commit #7439 (See

[jira] [Updated] (HDFS-7701) Support reporting per storage type quota and usage with hadoop/hdfs shell

[ https://issues.apache.org/jira/browse/HDFS-7701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Shi updated HDFS-7701: Status: Patch Available (was: Open) Support reporting per storage type quota and usage with hadoop/hdfs

[jira] [Updated] (HDFS-7701) Support reporting per storage type quota and usage with hadoop/hdfs shell

[ https://issues.apache.org/jira/browse/HDFS-7701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Shi updated HDFS-7701: Status: Open (was: Patch Available) Support reporting per storage type quota and usage with hadoop/hdfs

[jira] [Updated] (HDFS-7701) Support reporting per storage type quota and usage with hadoop/hdfs shell

[ https://issues.apache.org/jira/browse/HDFS-7701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Shi updated HDFS-7701: Attachment: HDFS-7701.01.patch Support reporting per storage type quota and usage with hadoop/hdfs shell

[jira] [Commented] (HDFS-7701) Support reporting per storage type quota and usage with hadoop/hdfs shell

[ https://issues.apache.org/jira/browse/HDFS-7701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381909#comment-14381909 ] Peter Shi commented on HDFS-7701: - This is my first patch, if any stupid error, please tell

[jira] [Commented] (HDFS-7701) Support reporting per storage type quota and usage with hadoop/hdfs shell

[ https://issues.apache.org/jira/browse/HDFS-7701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381912#comment-14381912 ] Peter Shi commented on HDFS-7701: - The patch is based on HDFS-7824.05.patch Support

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381915#comment-14381915 ] Kai Zheng commented on HDFS-7285: - Good discussion and plan. But I'm still a little bit

[jira] [Updated] (HDFS-7989) NFS gateway should shutdown when it can't start UDP or TCP server

[ https://issues.apache.org/jira/browse/HDFS-7989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-7989: - Attachment: HDFS-7989.002.patch It's kind of tricky to add unit tests. I manually tested it as the

[jira] [Commented] (HDFS-5523) Support multiple subdirectory exports in HDFS NFS gateway

[ https://issues.apache.org/jira/browse/HDFS-5523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382604#comment-14382604 ] Zhe Zhang commented on HDFS-5523: - Oh I see, the special treatment is about allowing nested

[jira] [Updated] (HDFS-7410) Support CreateFlags with append() to support hsync() for appending streams

[ https://issues.apache.org/jira/browse/HDFS-7410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7410: --- Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch

  1   2   >