[jira] [Commented] (HDFS-7748) Separate ECN flags from the Status in the DataTransferPipelineAck

[ https://issues.apache.org/jira/browse/HDFS-7748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387188#comment-14387188 ] Jing Zhao commented on HDFS-7748: - +1 > Separate ECN flags from the Status in the DataTran

[jira] [Updated] (HDFS-8005) Erasure Coding: simplify striped block recovery work computation and add tests

[ https://issues.apache.org/jira/browse/HDFS-8005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8005: Attachment: HDFS-8005.001.patch Rebase the patch. Also update {{chooseSourceNode}} to reflect the changes fro

[jira] [Commented] (HDFS-8005) Erasure Coding: simplify striped block recovery work computation and add tests

[ https://issues.apache.org/jira/browse/HDFS-8005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387208#comment-14387208 ] Jing Zhao commented on HDFS-8005: - Thanks for the comments, Zhe! bq. The only concern is t

[jira] [Commented] (HDFS-8005) Erasure Coding: simplify striped block recovery work computation and add tests

[ https://issues.apache.org/jira/browse/HDFS-8005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387319#comment-14387319 ] Jing Zhao commented on HDFS-8005: - I think the current {{chooseSourceDatanode}} is fine. Th

[jira] [Commented] (HDFS-8005) Erasure Coding: simplify striped block recovery work computation and add tests

[ https://issues.apache.org/jira/browse/HDFS-8005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387323#comment-14387323 ] Jing Zhao commented on HDFS-8005: - bq. Other than that, the 001 patch looks good Thanks fo

[jira] [Commented] (HDFS-8003) hdfs has 3 new shellcheck warnings and the related code change is questionable

[ https://issues.apache.org/jira/browse/HDFS-8003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387349#comment-14387349 ] Jing Zhao commented on HDFS-8003: - Thanks for the comments, [~aw]. The description of HDFS-

[jira] [Resolved] (HDFS-8005) Erasure Coding: simplify striped block recovery work computation and add tests

[ https://issues.apache.org/jira/browse/HDFS-8005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-8005. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed I've committed this. Thanks a

[jira] [Updated] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

[ https://issues.apache.org/jira/browse/HDFS-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7991: Attachment: HDFS-7991.002.patch Update the patch to suppress the shellcheck warnings. > Allow users to skip

[jira] [Commented] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

[ https://issues.apache.org/jira/browse/HDFS-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387419#comment-14387419 ] Jing Zhao commented on HDFS-7991: - bq. b) Why are we trying to fix this at the shell level

[jira] [Commented] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

[ https://issues.apache.org/jira/browse/HDFS-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387475#comment-14387475 ] Jing Zhao commented on HDFS-7991: - I see the problem and the current solution in this way:

[jira] [Updated] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

[ https://issues.apache.org/jira/browse/HDFS-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7991: Attachment: HDFS-7991.003.patch Update the patch to address other Allen's comments. > Allow users to skip ch

[jira] [Commented] (HDFS-7619) Erasure Coding: Handling files in snapshots

[ https://issues.apache.org/jira/browse/HDFS-7619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387793#comment-14387793 ] Jing Zhao commented on HDFS-7619: - Sure, thanks for working on this, [~tfukudom]! > Erasur

[jira] [Updated] (HDFS-7619) Erasure Coding: Handling files in snapshots

[ https://issues.apache.org/jira/browse/HDFS-7619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7619: Assignee: Takuya Fukudome (was: Jing Zhao) > Erasure Coding: Handling files in snapshots >

[jira] [Commented] (HDFS-7858) Improve HA Namenode Failover detection on the client

[ https://issues.apache.org/jira/browse/HDFS-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387816#comment-14387816 ] Jing Zhao commented on HDFS-7858: - Thanks for working on this, [~asuresh]. One concern is

[jira] [Commented] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

[ https://issues.apache.org/jira/browse/HDFS-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14389178#comment-14389178 ] Jing Zhao commented on HDFS-7991: - bq. This is easily fixed by just increasing the timeout

[jira] [Created] (HDFS-8036) Use snapshot path as source when using snapshot diff report in DistCp

Jing Zhao created HDFS-8036: --- Summary: Use snapshot path as source when using snapshot diff report in DistCp Key: HDFS-8036 URL: https://issues.apache.org/jira/browse/HDFS-8036 Project: Hadoop HDFS

[jira] [Updated] (HDFS-8036) Use snapshot path as source when using snapshot diff report in DistCp

[ https://issues.apache.org/jira/browse/HDFS-8036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8036: Status: Patch Available (was: Open) > Use snapshot path as source when using snapshot diff report in DistCp

[jira] [Updated] (HDFS-8036) Use snapshot path as source when using snapshot diff report in DistCp

[ https://issues.apache.org/jira/browse/HDFS-8036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8036: Attachment: HDFS-8036.000.patch Initial patch to fix. > Use snapshot path as source when using snapshot diff

[jira] [Commented] (HDFS-8035) Move checking replication and get client DN to BM and DM respectively

[ https://issues.apache.org/jira/browse/HDFS-8035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391072#comment-14391072 ] Jing Zhao commented on HDFS-8035: - The patch looks good to me. One comment is that now the

[jira] [Updated] (HDFS-8036) Use snapshot path as source when using snapshot diff report in DistCp

[ https://issues.apache.org/jira/browse/HDFS-8036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8036: Attachment: HDFS-8036.001.patch Add more unit tests: # make sure "." can also be used in the command (which m

[jira] [Commented] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391168#comment-14391168 ] Jing Zhao commented on HDFS-7888: - Thanks for working on this, Bo. The patch looks good to

[jira] [Commented] (HDFS-7839) Erasure coding: implement facilities in NameNode to create and manage EC zones

[ https://issues.apache.org/jira/browse/HDFS-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391396#comment-14391396 ] Jing Zhao commented on HDFS-7839: - Thanks for working on this, Zhe! The patch looks good to

[jira] [Commented] (HDFS-7811) Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage

[ https://issues.apache.org/jira/browse/HDFS-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391748#comment-14391748 ] Jing Zhao commented on HDFS-7811: - Thanks for updating the patch, Xiaoyu! The patch looks g

[jira] [Updated] (HDFS-7811) Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage

[ https://issues.apache.org/jira/browse/HDFS-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7811: Attachment: HDFS-7811.02.patch I did some simple cleanup based on the current 01 patch. Please see if it's c

[jira] [Updated] (HDFS-7619) Erasure Coding: Handling files in snapshots

[ https://issues.apache.org/jira/browse/HDFS-7619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7619: Parent Issue: HDFS-8031 (was: HDFS-7285) > Erasure Coding: Handling files in snapshots > --

[jira] [Commented] (HDFS-7619) Erasure Coding: Handling files in snapshots

[ https://issues.apache.org/jira/browse/HDFS-7619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392029#comment-14392029 ] Jing Zhao commented on HDFS-7619: - Yes, you're right. I will move the jira to HDFS-8031. >

[jira] [Commented] (HDFS-7622) Erasure Coding: handling file truncation

[ https://issues.apache.org/jira/browse/HDFS-7622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392127#comment-14392127 ] Jing Zhao commented on HDFS-7622: - Sure. Thanks for working on this. > Erasure Coding: han

[jira] [Updated] (HDFS-7622) Erasure Coding: handling file truncation

[ https://issues.apache.org/jira/browse/HDFS-7622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7622: Assignee: Takuya Fukudome (was: Jing Zhao) > Erasure Coding: handling file truncation >

[jira] [Commented] (HDFS-8035) Move checking replication and get client DN to BM and DM respectively

[ https://issues.apache.org/jira/browse/HDFS-8035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392189#comment-14392189 ] Jing Zhao commented on HDFS-8035: - +1 for the latest patch. You may need to update the jira

[jira] [Updated] (HDFS-7811) Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage

[ https://issues.apache.org/jira/browse/HDFS-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7811: Attachment: HDFS-7811.03.patch The 02 patch missed the symlink check before calling {{getStoragePolicyID}}.

[jira] [Commented] (HDFS-7839) Erasure coding: implement facilities in NameNode to create and manage EC zones

[ https://issues.apache.org/jira/browse/HDFS-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14393041#comment-14393041 ] Jing Zhao commented on HDFS-7839: - Thanks Kai. This question is important and I should make

[jira] [Commented] (HDFS-7782) Erasure coding: pread from files in striped layout

[ https://issues.apache.org/jira/browse/HDFS-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14393263#comment-14393263 ] Jing Zhao commented on HDFS-7782: - Thanks for updating the patch, Zhe! Comments on the 005

[jira] [Updated] (HDFS-7811) Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage

[ https://issues.apache.org/jira/browse/HDFS-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7811: Attachment: HDFS-7811.04.patch Thanks for the review, Xiaoyu and Nicholas! Update the patch to address Nicho

[jira] [Commented] (HDFS-7621) Erasure Coding: update the Balancer/Mover data migration logic

[ https://issues.apache.org/jira/browse/HDFS-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14394028#comment-14394028 ] Jing Zhao commented on HDFS-7621: - Sure. Assign the jira to you. Thanks for working on this

[jira] [Updated] (HDFS-7621) Erasure Coding: update the Balancer/Mover data migration logic

[ https://issues.apache.org/jira/browse/HDFS-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7621: Assignee: Walter Su (was: Jing Zhao) > Erasure Coding: update the Balancer/Mover data migration logic >

[jira] [Updated] (HDFS-7811) Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage

[ https://issues.apache.org/jira/browse/HDFS-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7811: Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch Available) I've commit

[jira] [Commented] (HDFS-7839) Erasure coding: implement facilities in NameNode to create and manage EC zones

[ https://issues.apache.org/jira/browse/HDFS-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14394045#comment-14394045 ] Jing Zhao commented on HDFS-7839: - Thanks Zhe for updating the patch. +1 > Erasure coding:

[jira] [Updated] (HDFS-7839) Erasure coding: implement facilities in NameNode to create and manage EC zones

[ https://issues.apache.org/jira/browse/HDFS-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7839: Hadoop Flags: Reviewed > Erasure coding: implement facilities in NameNode to create and manage EC zones > ---

[jira] [Commented] (HDFS-7782) Erasure coding: pread from files in striped layout

[ https://issues.apache.org/jira/browse/HDFS-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14394101#comment-14394101 ] Jing Zhao commented on HDFS-7782: - The 006 patch looks good to me overall. One issue I mis

[jira] [Updated] (HDFS-7782) Erasure coding: pread from files in striped layout

[ https://issues.apache.org/jira/browse/HDFS-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7782: Attachment: HDFS-7782.007.patch So I just extended Zhe's 005 and 006 patch and tried to demo the idea that a

[jira] [Updated] (HDFS-7782) Erasure coding: pread from files in striped layout

[ https://issues.apache.org/jira/browse/HDFS-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7782: Attachment: HDFS-7782.009.patch Thanks Zhe! The 009 patch adds more unit tests, and also fixes several small

[jira] [Commented] (HDFS-8059) Erasure coding: move dataBlockNum and parityBlockNum from BlockInfoStriped to INodeFile

[ https://issues.apache.org/jira/browse/HDFS-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14482080#comment-14482080 ] Jing Zhao commented on HDFS-8059: - Thanks for working on this, Yi! The patch looks good to

[jira] [Commented] (HDFS-8058) Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

[ https://issues.apache.org/jira/browse/HDFS-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14482332#comment-14482332 ] Jing Zhao commented on HDFS-8058: - Thanks for working on this, Yi! bq. The only concern I

[jira] [Commented] (HDFS-8059) Erasure coding: move dataBlockNum and parityBlockNum from BlockInfoStriped to INodeFile

[ https://issues.apache.org/jira/browse/HDFS-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14482620#comment-14482620 ] Jing Zhao commented on HDFS-8059: - bq. Otherwise we should use other ways to get these two

[jira] [Commented] (HDFS-8058) Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

[ https://issues.apache.org/jira/browse/HDFS-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14482661#comment-14482661 ] Jing Zhao commented on HDFS-8058: - bq. In my thought, this would never happen, although the

[jira] [Commented] (HDFS-7782) Erasure coding: pread from files in striped layout

[ https://issues.apache.org/jira/browse/HDFS-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14483611#comment-14483611 ] Jing Zhao commented on HDFS-7782: - Thanks Zhe! The 010 patch looks good to me. bq. made a

[jira] [Comment Edited] (HDFS-7782) Erasure coding: pread from files in striped layout

[ https://issues.apache.org/jira/browse/HDFS-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14483611#comment-14483611 ] Jing Zhao edited comment on HDFS-7782 at 4/7/15 5:52 PM: - Thanks Zh

[jira] [Commented] (HDFS-8023) Erasure Coding: retrieve eraure coding policy and schema for a block or file from NameNode

[ https://issues.apache.org/jira/browse/HDFS-8023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14483699#comment-14483699 ] Jing Zhao commented on HDFS-8023: - Thanks [~vinayrpet] for the work and [~drankye] for the

[jira] [Commented] (HDFS-7782) Erasure coding: pread from files in striped layout

[ https://issues.apache.org/jira/browse/HDFS-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14483739#comment-14483739 ] Jing Zhao commented on HDFS-7782: - yeah, the 011 patch looks pretty good to me. +1. Thanks

[jira] [Updated] (HDFS-7782) Erasure coding: pread from files in striped layout

[ https://issues.apache.org/jira/browse/HDFS-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7782: Hadoop Flags: Reviewed > Erasure coding: pread from files in striped layout > ---

[jira] [Commented] (HDFS-8077) Erasure coding: fix bug in EC zone and symlinks

[ https://issues.apache.org/jira/browse/HDFS-8077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14484053#comment-14484053 ] Jing Zhao commented on HDFS-8077: - I will take a look at this later today. > Erasure codin

[jira] [Updated] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

[ https://issues.apache.org/jira/browse/HDFS-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7991: Attachment: HDFS-7991.004.patch The 004 patch uses subshell to run the {{saveNamespace}} command through the

[jira] [Assigned] (HDFS-8077) Erasure coding: fix bug in EC zone and symlinks

[ https://issues.apache.org/jira/browse/HDFS-8077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao reassigned HDFS-8077: --- Assignee: Jing Zhao (was: Zhe Zhang) > Erasure coding: fix bug in EC zone and symlinks >

[jira] [Commented] (HDFS-8077) Erasure coding: fix bug in EC zone and symlinks

[ https://issues.apache.org/jira/browse/HDFS-8077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14484499#comment-14484499 ] Jing Zhao commented on HDFS-8077: - The failure of {{TestAddStripedBlocks}} is because we re

[jira] [Updated] (HDFS-7663) Erasure Coding: support Append on EC file

[ https://issues.apache.org/jira/browse/HDFS-7663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7663: Assignee: Yong Zhang (was: Jing Zhao) > Erasure Coding: support Append on EC file >

[jira] [Commented] (HDFS-7663) Erasure Coding: support Append on EC file

[ https://issues.apache.org/jira/browse/HDFS-7663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14484714#comment-14484714 ] Jing Zhao commented on HDFS-7663: - Sure. Assign the jira to you. Thanks for working on this

[jira] [Commented] (HDFS-8120) Erasure coding: created util class to analyze striped block groups

[ https://issues.apache.org/jira/browse/HDFS-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14490640#comment-14490640 ] Jing Zhao commented on HDFS-8120: - Thanks for working on this, Zhe! {code} +int numStri

[jira] [Updated] (HDFS-8077) Erasure coding: fix bug in EC zone and symlinks

[ https://issues.apache.org/jira/browse/HDFS-8077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8077: Attachment: HDFS-8077.001.patch Upload a patch fixing failed tests (except TestFileTruncate). Besides the fix

[jira] [Commented] (HDFS-8106) Fix test failure in TestAddStripedBlocks

[ https://issues.apache.org/jira/browse/HDFS-8106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14486548#comment-14486548 ] Jing Zhao commented on HDFS-8106: - Yes, the 001 patch in HDFS-8077 already fixes the issue.

[jira] [Resolved] (HDFS-8106) Fix test failure in TestAddStripedBlocks

[ https://issues.apache.org/jira/browse/HDFS-8106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-8106. - Resolution: Duplicate > Fix test failure in TestAddStripedBlocks >

[jira] [Commented] (HDFS-8105) Make TestReadStripedFile work with RS-6-3 and etc.

[ https://issues.apache.org/jira/browse/HDFS-8105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14486537#comment-14486537 ] Jing Zhao commented on HDFS-8105: - I think we can include this fix in HDFS-8104. > Make Te

[jira] [Resolved] (HDFS-8107) Fix stripping related test failures in TestFSImage

[ https://issues.apache.org/jira/browse/HDFS-8107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-8107. - Resolution: Duplicate duplicated with HDFS-8077. Besides, we can leave the unit test fix till the end (i.e

[jira] [Commented] (HDFS-8107) Fix stripping related test failures in TestFSImage

[ https://issues.apache.org/jira/browse/HDFS-8107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14486603#comment-14486603 ] Jing Zhao commented on HDFS-8107: - Thanks for the comments, Kai. I'm not saying we do not n

[jira] [Commented] (HDFS-8077) Erasure coding: fix bug in EC zone and symlinks

[ https://issues.apache.org/jira/browse/HDFS-8077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14486125#comment-14486125 ] Jing Zhao commented on HDFS-8077: - Thus the bug only exists in the EC feature branch. > Er

[jira] [Updated] (HDFS-8077) Erasure coding: fix bug in EC zone and symlinks

[ https://issues.apache.org/jira/browse/HDFS-8077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8077: Attachment: HDFS-8077.001.patch > Erasure coding: fix bug in EC zone and symlinks > -

[jira] [Updated] (HDFS-8077) Erasure coding: fix bug in EC zone and symlinks

[ https://issues.apache.org/jira/browse/HDFS-8077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8077: Attachment: (was: HDFS-8077.001.patch) > Erasure coding: fix bug in EC zone and symlinks > --

[jira] [Commented] (HDFS-8077) Erasure coding: fix bug in EC zone and symlinks

[ https://issues.apache.org/jira/browse/HDFS-8077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14486337#comment-14486337 ] Jing Zhao commented on HDFS-8077: - Looks like the trunk code is different. The third constr

[jira] [Commented] (HDFS-8077) Erasure coding: fix bug in EC zone and symlinks

[ https://issues.apache.org/jira/browse/HDFS-8077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14486124#comment-14486124 ] Jing Zhao commented on HDFS-8077: - The bug is caused by the change in HDFS-7907. In HDFS-79

[jira] [Commented] (HDFS-8089) Move o.a.h.hdfs.web.resources.* to the client jars

[ https://issues.apache.org/jira/browse/HDFS-8089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14486319#comment-14486319 ] Jing Zhao commented on HDFS-8089: - +1 > Move o.a.h.hdfs.web.resources.* to the client jars

[jira] [Commented] (HDFS-8106) Fix test failure in TestAddStripedBlocks

[ https://issues.apache.org/jira/browse/HDFS-8106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14486534#comment-14486534 ] Jing Zhao commented on HDFS-8106: - duplicated with HDFS-8077? > Fix test failure in TestAd

[jira] [Updated] (HDFS-8127) NameNode Failover during HA upgrade can cause DataNode to finalize upgrade

[ https://issues.apache.org/jira/browse/HDFS-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8127: Attachment: HDFS-8127.000.patch Upload a patch to fix the issue. Instead of adding -upgrade option, the patch

[jira] [Updated] (HDFS-8127) NameNode Failover during HA upgrade can cause DataNode to finalize upgrade

[ https://issues.apache.org/jira/browse/HDFS-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8127: Status: Patch Available (was: Open) > NameNode Failover during HA upgrade can cause DataNode to finalize upg

[jira] [Commented] (HDFS-7937) Erasure Coding: INodeFile quota computation unit tests

[ https://issues.apache.org/jira/browse/HDFS-7937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14493199#comment-14493199 ] Jing Zhao commented on HDFS-7937: - Thanks for working on this, Kai. The patch looks good to

[jira] [Commented] (HDFS-8010) Erasure coding: extend UnderReplicatedBlocks to accurately handle striped blocks

[ https://issues.apache.org/jira/browse/HDFS-8010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14493261#comment-14493261 ] Jing Zhao commented on HDFS-8010: - Thanks for working on this, Zhe! The patch looks good to

[jira] [Commented] (HDFS-7937) Erasure Coding: INodeFile quota computation unit tests

[ https://issues.apache.org/jira/browse/HDFS-7937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14493362#comment-14493362 ] Jing Zhao commented on HDFS-7937: - I think you can use Mockito if creating INodeFile in EC

[jira] [Commented] (HDFS-8120) Erasure coding: created util class to analyze striped block groups

[ https://issues.apache.org/jira/browse/HDFS-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14493543#comment-14493543 ] Jing Zhao commented on HDFS-8120: - Thanks for updating the patch, Zhe. And thanks for the r

[jira] [Commented] (HDFS-7937) Erasure Coding: INodeFile quota computation unit tests

[ https://issues.apache.org/jira/browse/HDFS-7937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14493558#comment-14493558 ] Jing Zhao commented on HDFS-7937: - Thanks for updating the patch, Kai! The new patch looks

[jira] [Commented] (HDFS-8127) NameNode Failover during HA upgrade can cause DataNode to finalize upgrade

[ https://issues.apache.org/jira/browse/HDFS-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14493563#comment-14493563 ] Jing Zhao commented on HDFS-8127: - Thanks for the review, Nicholas! bq. BootstrapStandby m

[jira] [Updated] (HDFS-8127) NameNode Failover during HA upgrade can cause DataNode to finalize upgrade

[ https://issues.apache.org/jira/browse/HDFS-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8127: Attachment: HDFS-8127.001.patch Update the patch to address Nicholas's comments and fix TestDFSUpgradeWithHA.

[jira] [Commented] (HDFS-8127) NameNode Failover during HA upgrade can cause DataNode to finalize upgrade

[ https://issues.apache.org/jira/browse/HDFS-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14494489#comment-14494489 ] Jing Zhao commented on HDFS-8127: - RollingUpgrade does not have this issue because instead

[jira] [Updated] (HDFS-8127) NameNode Failover during HA upgrade can cause DataNode to finalize upgrade

[ https://issues.apache.org/jira/browse/HDFS-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8127: Resolution: Fixed Fix Version/s: 2.7.1 Status: Resolved (was: Patch Available) Thanks Nich

[jira] [Commented] (HDFS-8120) Erasure coding: created util class to analyze striped block groups

[ https://issues.apache.org/jira/browse/HDFS-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495520#comment-14495520 ] Jing Zhao commented on HDFS-8120: - Thanks Zhe. The latest patch looks pretty good to me. So

[jira] [Created] (HDFS-8145) Fix the editlog corruption exposed by failed TestAddStripedBlocks

Jing Zhao created HDFS-8145: --- Summary: Fix the editlog corruption exposed by failed TestAddStripedBlocks Key: HDFS-8145 URL: https://issues.apache.org/jira/browse/HDFS-8145 Project: Hadoop HDFS Is

[jira] [Commented] (HDFS-8120) Erasure coding: created util class to analyze striped block groups

[ https://issues.apache.org/jira/browse/HDFS-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495571#comment-14495571 ] Jing Zhao commented on HDFS-8120: - bq. which make DFSOutputStream#completeFile fail Yes, t

[jira] [Issue Comment Deleted] (HDFS-8120) Erasure coding: created util class to analyze striped block groups

[ https://issues.apache.org/jira/browse/HDFS-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8120: Comment: was deleted (was: bq. which make DFSOutputStream#completeFile fail Yes, the completeFile call shoul

[jira] [Commented] (HDFS-8120) Erasure coding: created util class to analyze striped block groups

[ https://issues.apache.org/jira/browse/HDFS-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495576#comment-14495576 ] Jing Zhao commented on HDFS-8120: - bq. which make DFSOutputStream#completeFile fail. More

[jira] [Commented] (HDFS-8120) Erasure coding: created util class to analyze striped block groups

[ https://issues.apache.org/jira/browse/HDFS-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495769#comment-14495769 ] Jing Zhao commented on HDFS-8120: - Thanks for the explanation, Bo. bq. When DFSStripedOutp

[jira] [Created] (HDFS-8151) Always use snapshot path as source when invalid snapshot names are used for diff based distcp

Jing Zhao created HDFS-8151: --- Summary: Always use snapshot path as source when invalid snapshot names are used for diff based distcp Key: HDFS-8151 URL: https://issues.apache.org/jira/browse/HDFS-8151 Proje

[jira] [Updated] (HDFS-8151) Always use snapshot path as source when invalid snapshot names are used for diff based distcp

[ https://issues.apache.org/jira/browse/HDFS-8151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8151: Attachment: HDFS-8151.000.patch Patch to fix. > Always use snapshot path as source when invalid snapshot nam

[jira] [Updated] (HDFS-8151) Always use snapshot path as source when invalid snapshot names are used for diff based distcp

[ https://issues.apache.org/jira/browse/HDFS-8151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8151: Status: Patch Available (was: Open) > Always use snapshot path as source when invalid snapshot names are use

[jira] [Updated] (HDFS-8151) Always use snapshot path as source when invalid snapshot names are used for diff based distcp

[ https://issues.apache.org/jira/browse/HDFS-8151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8151: Component/s: distcp > Always use snapshot path as source when invalid snapshot names are used for > diff bas

[jira] [Updated] (HDFS-8151) Always use snapshot path as source when invalid snapshot names are used for diff based distcp

[ https://issues.apache.org/jira/browse/HDFS-8151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8151: Affects Version/s: 2.7.0 > Always use snapshot path as source when invalid snapshot names are used for > dif

[jira] [Updated] (HDFS-8151) Always use snapshot path as source when invalid snapshot names are used for diff based distcp

[ https://issues.apache.org/jira/browse/HDFS-8151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8151: Resolution: Fixed Fix Version/s: 2.7.1 Status: Resolved (was: Patch Available) Thanks for

[jira] [Commented] (HDFS-8120) Erasure coding: created util class to analyze striped block groups

[ https://issues.apache.org/jira/browse/HDFS-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14496787#comment-14496787 ] Jing Zhao commented on HDFS-8120: - +1 for the 008 patch. Thanks for the work, Zhe and Bo!

[jira] [Resolved] (HDFS-8120) Erasure coding: created util class to analyze striped block groups

[ https://issues.apache.org/jira/browse/HDFS-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-8120. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed I've committed this. > Erasu

[jira] [Updated] (HDFS-7934) Update RollingUpgrade rollback documentation: should use bootstrapstandby for standby NN

[ https://issues.apache.org/jira/browse/HDFS-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7934: Summary: Update RollingUpgrade rollback documentation: should use bootstrapstandby for standby NN (was: Duri

[jira] [Updated] (HDFS-7934) Update RollingUpgrade rollback documentation: should use bootstrapstandby for standby NN

[ https://issues.apache.org/jira/browse/HDFS-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7934: Resolution: Fixed Fix Version/s: 2.7.1 Hadoop Flags: Reviewed Status: Resolved (was: P

[jira] [Updated] (HDFS-7934) Update RollingUpgrade rollback documentation: should use bootstrapstandby for standby NN

[ https://issues.apache.org/jira/browse/HDFS-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7934: Component/s: documentation > Update RollingUpgrade rollback documentation: should use bootstrapstandby for >

[jira] [Updated] (HDFS-7934) Update RollingUpgrade rollback documentation: should use bootstrapstandby for standby NN

[ https://issues.apache.org/jira/browse/HDFS-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7934: Affects Version/s: 2.4.0 > Update RollingUpgrade rollback documentation: should use bootstrapstandby for > s

[jira] [Resolved] (HDFS-7952) On starting Standby with "rollback" option, lastPromisedEpoch gets updated and Active Namenode is shutting down.

[ https://issues.apache.org/jira/browse/HDFS-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7952. - Resolution: Duplicate Resolve as duplicate after HDFS-7934 got committed. > On starting Standby with "roll

<    8   9   10   11   12   13   14   15   16   17   >