[jira] [Comment Edited] (HDFS-16644) java.io.IOException Invalid token in javax.security.sasl.qop

[ https://issues.apache.org/jira/browse/HDFS-16644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17683033#comment-17683033 ] Yiqun Lin edited comment on HDFS-16644 at 2/1/23 2:19 PM: -- We also meet this

[jira] [Commented] (HDFS-16644) java.io.IOException Invalid token in javax.security.sasl.qop

[ https://issues.apache.org/jira/browse/HDFS-16644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17683033#comment-17683033 ] Yiqun Lin commented on HDFS-16644: -- We also meet this issue in our Hadoop3 cluster. Our DN server is

[jira] [Commented] (HDFS-15486) Costly sendResponse operation slows down async editlog handling

[ https://issues.apache.org/jira/browse/HDFS-15486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423086#comment-17423086 ] Yiqun Lin commented on HDFS-15486: -- Hi [~functioner], {quote}Yiqun Lin I reported a similar issue in

[jira] [Commented] (HDFS-15486) Costly sendResponse operation slows down async editlog handling

[ https://issues.apache.org/jira/browse/HDFS-15486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423081#comment-17423081 ] Yiqun Lin commented on HDFS-15486: -- Some notes for above draft patch: * Here we introduced the switch

[jira] [Updated] (HDFS-15486) Costly sendResponse operation slows down async editlog handling

[ https://issues.apache.org/jira/browse/HDFS-15486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15486: - Attachment: HDFS-15486_draft.patch > Costly sendResponse operation slows down async editlog handling >

[jira] [Commented] (HDFS-15486) Costly sendResponse operation slows down async editlog handling

[ https://issues.apache.org/jira/browse/HDFS-15486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423078#comment-17423078 ] Yiqun Lin commented on HDFS-15486: -- Asked by [~yuanbo] offline that if there is the patch for this JIRA, 

[jira] [Comment Edited] (HDFS-15660) StorageTypeProto is not compatiable between 3.x and 2.6

[ https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307712#comment-17307712 ] Yiqun Lin edited comment on HDFS-15660 at 3/24/21, 9:48 AM: Hi [~weichiu],

[jira] [Comment Edited] (HDFS-15660) StorageTypeProto is not compatiable between 3.x and 2.6

[ https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307712#comment-17307712 ] Yiqun Lin edited comment on HDFS-15660 at 3/24/21, 9:47 AM: Hi [~weichiu],

[jira] [Commented] (HDFS-15660) StorageTypeProto is not compatiable between 3.x and 2.6

[ https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307712#comment-17307712 ] Yiqun Lin commented on HDFS-15660: -- Hi [~weichiu], this compatible issue only happened in that old

[jira] [Commented] (HDFS-14558) RBF: Isolation/Fairness documentation

[ https://issues.apache.org/jira/browse/HDFS-14558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263438#comment-17263438 ] Yiqun Lin commented on HDFS-14558: -- LGTM, +1. > RBF: Isolation/Fairness documentation >

[jira] [Updated] (HDFS-14558) RBF: Isolation/Fairness documentation

[ https://issues.apache.org/jira/browse/HDFS-14558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-14558: - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Comment Edited] (HDFS-14558) RBF: Isolation/Fairness documentation

[ https://issues.apache.org/jira/browse/HDFS-14558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262526#comment-17262526 ] Yiqun Lin edited comment on HDFS-14558 at 1/11/21, 9:46 AM: mvnsite compiled

[jira] [Comment Edited] (HDFS-14558) RBF: Isolation/Fairness documentation

[ https://issues.apache.org/jira/browse/HDFS-14558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262526#comment-17262526 ] Yiqun Lin edited comment on HDFS-14558 at 1/11/21, 9:46 AM: mvnsite compiled

[jira] [Commented] (HDFS-14558) RBF: Isolation/Fairness documentation

[ https://issues.apache.org/jira/browse/HDFS-14558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262526#comment-17262526 ] Yiqun Lin commented on HDFS-14558: -- mvnsite compiled failed due to unexpected '<>' was used in

[jira] [Commented] (HDFS-14558) RBF: Isolation/Fairness documentation

[ https://issues.apache.org/jira/browse/HDFS-14558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262202#comment-17262202 ] Yiqun Lin commented on HDFS-14558: -- Hi [~fengnanli], do you have the time to address above review

[jira] [Commented] (HDFS-14558) RBF: Isolation/Fairness documentation

[ https://issues.apache.org/jira/browse/HDFS-14558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248545#comment-17248545 ] Yiqun Lin commented on HDFS-14558: -- [~fengnanli], thanks for updating the patch, most of the patch looks

[jira] [Updated] (HDFS-15660) StorageTypeProto is not compatiable between 3.x and 2.6

[ https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15660: - Description: In our case, when nn has upgraded to 3.1.3 and dn’s version was still 2.6,  we found hive

[jira] [Updated] (HDFS-15660) StorageTypeProto is not compatiable between 3.x and 2.6

[ https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15660: - Fix Version/s: 2.10.2 3.4.0 2.9.3 Hadoop Flags: Reviewed The

[jira] [Updated] (HDFS-15660) StorageTypeProto is not compatiable between 3.x and 2.6

[ https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15660: - Resolution: Fixed Status: Resolved (was: Patch Available) > StorageTypeProto is not compatiable

[jira] [Updated] (HDFS-15660) StorageTypeProto is not compatiable between 3.x and 2.6

[ https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15660: - Target Version/s: 2.9.3, 2.10.2 (was: 2.9.3, 3.3.1, 3.4.0, 3.1.5, 2.10.2, 3.2.3) Affects

[jira] [Commented] (HDFS-15660) StorageTypeProto is not compatiable between 3.x and 2.6

[ https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243715#comment-17243715 ] Yiqun Lin commented on HDFS-15660: -- Thanks for providing the test result for this change,

[jira] [Updated] (HDFS-15660) StorageTypeProto is not compatiable between 3.x and 2.6

[ https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15660: - Attachment: HDFS-15660.002.patch > StorageTypeProto is not compatiable between 3.x and 2.6 >

[jira] [Commented] (HDFS-15660) StorageTypeProto is not compatiable between 3.x and 2.6

[ https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239094#comment-17239094 ] Yiqun Lin commented on HDFS-15660: -- Attach the same patch to trigger Jenkins. > StorageTypeProto is not

[jira] [Updated] (HDFS-15660) StorageTypeProto is not compatiable between 3.x and 2.6

[ https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15660: - Status: Patch Available (was: Open) > StorageTypeProto is not compatiable between 3.x and 2.6 >

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231451#comment-17231451 ] Yiqun Lin commented on HDFS-14090: -- Thanks for addressing the comments, [~fengnanli], LGTM, +1. > RBF:

[jira] [Comment Edited] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17230612#comment-17230612 ] Yiqun Lin edited comment on HDFS-14090 at 11/12/20, 2:38 PM: - Hi

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17230612#comment-17230612 ] Yiqun Lin commented on HDFS-14090: -- Hi [~fengnanli], two nits for the latest patch: {noformat} smaller

[jira] [Comment Edited] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17230612#comment-17230612 ] Yiqun Lin edited comment on HDFS-14090 at 11/12/20, 1:07 PM: - Hi

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17230347#comment-17230347 ] Yiqun Lin commented on HDFS-14090: -- Sounds good to me, let's address #2 comment, [~fengnanli]. > RBF:

[jira] [Comment Edited] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227189#comment-17227189 ] Yiqun Lin edited comment on HDFS-14090 at 11/6/20, 6:58 AM: Hi [~fengnanli],

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227189#comment-17227189 ] Yiqun Lin commented on HDFS-14090: -- Hi [~fengnanli], some minor comments from me: 1. I see here we

[jira] [Commented] (HDFS-15651) Client could not obtain block when DN CommandProcessingThread exit

[ https://issues.apache.org/jira/browse/HDFS-15651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17225839#comment-17225839 ] Yiqun Lin commented on HDFS-15651: -- Thanks [~Aiphag0] for the quick fix. LGTM. +1. > Client could not

[jira] [Commented] (HDFS-15294) Federation balance tool

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224606#comment-17224606 ] Yiqun Lin commented on HDFS-15294: -- Hi [~coconut_icecream], as FedBlance is a completely new feature and

[jira] [Comment Edited] (HDFS-15640) Add diff threshold to FedBalance

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17221089#comment-17221089 ] Yiqun Lin edited comment on HDFS-15640 at 10/27/20, 2:48 AM: - Committed this

[jira] [Updated] (HDFS-15640) Add diff threshold to FedBalance

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15640: - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Resolved] (HDFS-15294) Federation balance tool

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin resolved HDFS-15294. -- Resolution: Fixed > Federation balance tool > --- > > Key:

[jira] [Updated] (HDFS-15640) Add diff threshold to FedBalance

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15640: - Summary: Add diff threshold to FedBalance (was: Add snapshot diff threshold to FedBalance) > Add diff

[jira] [Updated] (HDFS-15640) Add snapshot diff threshold to FedBalance

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15640: - Description: Currently in the DistCpProcedure it must submit distcp round by round until there is no

[jira] [Updated] (HDFS-15640) Add snapshot diff threshold to FedBalance

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15640: - Summary: Add snapshot diff threshold to FedBalance (was: RBF: Add fast distcp threshold to FedBalance.)

[jira] [Comment Edited] (HDFS-15651) Client could not obtain block when DN CommandProcessingThread exit

[ https://issues.apache.org/jira/browse/HDFS-15651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17220794#comment-17220794 ] Yiqun Lin edited comment on HDFS-15651 at 10/26/20, 4:21 PM: - Thanks for the

[jira] [Commented] (HDFS-15651) Client could not obtain block when DN CommandProcessingThread exit

[ https://issues.apache.org/jira/browse/HDFS-15651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17220794#comment-17220794 ] Yiqun Lin commented on HDFS-15651: -- Thanks for the comments, [~hexiaoqiao]. {quote}Catch the error and

[jira] [Comment Edited] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17220611#comment-17220611 ] Yiqun Lin edited comment on HDFS-15640 at 10/26/20, 10:33 AM: -- Latest patch

[jira] [Commented] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17220611#comment-17220611 ] Yiqun Lin commented on HDFS-15640: -- Latest patch LGTM, +1. Will commit this tomorrow once there is

[jira] [Updated] (HDFS-15651) Client could not obtain block when DN CommandProcessingThread exit

[ https://issues.apache.org/jira/browse/HDFS-15651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15651: - Description: In our cluster, we applied the HDFS-14997 improvement. We find one case that

[jira] [Updated] (HDFS-15651) Client could not obtain block when DN CommandProcessingThread exit

[ https://issues.apache.org/jira/browse/HDFS-15651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15651: - Description: In our cluster, we applied the HDFS-14997 improvement. We find one case that

[jira] [Updated] (HDFS-15651) Client could not obtain block when DN CommandProcessingThread exit

[ https://issues.apache.org/jira/browse/HDFS-15651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15651: - Description: In our cluster, we applied the HDFS-14997 improvement. We find one case that

[jira] [Created] (HDFS-15651) Client could not obtain block when DN CommandProcessingThread exit

Yiqun Lin created HDFS-15651: Summary: Client could not obtain block when DN CommandProcessingThread exit Key: HDFS-15651 URL: https://issues.apache.org/jira/browse/HDFS-15651 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17220448#comment-17220448 ] Yiqun Lin commented on HDFS-15640: -- Thanks for updating the patch, [~LiJinglun]! Looks very great now.

[jira] [Commented] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17220003#comment-17220003 ] Yiqun Lin commented on HDFS-15640: -- [~LiJinglun], the latest patch almost looks good to me. Minor

[jira] [Commented] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218221#comment-17218221 ] Yiqun Lin commented on HDFS-15640: -- {quote} Only a little problem is it might not be easy to know how

[jira] [Commented] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217678#comment-17217678 ] Yiqun Lin commented on HDFS-15640: -- [~LiJinglun] , use distcp execution time as fedbalance threshold is

[jira] [Commented] (HDFS-15486) Costly sendResponse operation slows down async editlog handling

[ https://issues.apache.org/jira/browse/HDFS-15486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164173#comment-17164173 ] Yiqun Lin commented on HDFS-15486: -- Hi [~yuanbo] , thanks for the comment. We don't have the  centos

[jira] [Updated] (HDFS-15486) Costly sendResponse operation slows down async editlog handling

[ https://issues.apache.org/jira/browse/HDFS-15486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15486: - Description: When our cluster NameNode in a very high load, we find it often stuck in Async-editlog

[jira] [Created] (HDFS-15486) Costly sendResponse operation slows down async editlog handling

Yiqun Lin created HDFS-15486: Summary: Costly sendResponse operation slows down async editlog handling Key: HDFS-15486 URL: https://issues.apache.org/jira/browse/HDFS-15486 Project: Hadoop HDFS

[jira] [Comment Edited] (HDFS-15448) When starting a DataNode, call BlockPoolManager#startAll() twice.

[ https://issues.apache.org/jira/browse/HDFS-15448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17149396#comment-17149396 ] Yiqun Lin edited comment on HDFS-15448 at 7/1/20, 12:28 PM: Not sure if it's

[jira] [Commented] (HDFS-15448) When starting a DataNode, call BlockPoolManager#startAll() twice.

[ https://issues.apache.org/jira/browse/HDFS-15448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17149396#comment-17149396 ] Yiqun Lin commented on HDFS-15448: -- Not sure if it's a right behavior to remove startAll() in

[jira] [Updated] (HDFS-15448) When starting a DataNode, call BlockPoolManager#startAll() twice.

[ https://issues.apache.org/jira/browse/HDFS-15448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15448: - Attachment: method_invoke_path.jpg > When starting a DataNode, call BlockPoolManager#startAll() twice. >

[jira] [Comment Edited] (HDFS-15294) Federation balance tool

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17149160#comment-17149160 ] Yiqun Lin edited comment on HDFS-15294 at 7/1/20, 6:44 AM: --- I update the

[jira] [Updated] (HDFS-15294) Federation balance tool

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15294: - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Updated] (HDFS-15294) Federation balance tool

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15294: - Description: This jira introduces a new HDFS federation balance tool to balance data across different

[jira] [Updated] (HDFS-15294) Federation balance tool

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15294: - Description: This jira introduces a new HDFS federation balance tool to balance data across different

[jira] [Updated] (HDFS-15374) Add documentation for fedbalance tool

[ https://issues.apache.org/jira/browse/HDFS-15374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15374: - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Updated] (HDFS-15374) Add documentation for fedbalance tool

[ https://issues.apache.org/jira/browse/HDFS-15374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15374: - Description: Add documentation for fedbalance tool. > Add documentation for fedbalance tool >

[jira] [Updated] (HDFS-15410) Add separated config file hdfs-fedbalance-default.xml for fedbalance tool

[ https://issues.apache.org/jira/browse/HDFS-15410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15410: - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Updated] (HDFS-15410) Add separated config file hdfs-fedbalance-default.xml for fedbalance tool

[ https://issues.apache.org/jira/browse/HDFS-15410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15410: - Description: Add a separated config file named hdfs-fedbalance-default.xml for fedbalance tool configs.

[jira] [Updated] (HDFS-15410) Add separated config file hdfs-fedbalance-default.xml for fedbalance tool

[ https://issues.apache.org/jira/browse/HDFS-15410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15410: - Summary: Add separated config file hdfs-fedbalance-default.xml for fedbalance tool (was: Add separated

[jira] [Commented] (HDFS-15410) Add separated config file fedbalance-default.xml for fedbalance tool

[ https://issues.apache.org/jira/browse/HDFS-15410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147742#comment-17147742 ] Yiqun Lin commented on HDFS-15410: -- [~inigoiri], would you mind to have a quick review for this JIRA and 

[jira] [Commented] (HDFS-15374) Add documentation for fedbalance tool

[ https://issues.apache.org/jira/browse/HDFS-15374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17142178#comment-17142178 ] Yiqun Lin commented on HDFS-15374: -- I generated the markdown documentation page in my local, it rendered

[jira] [Commented] (HDFS-15410) Add separated config file fedbalance-default.xml for fedbalance tool

[ https://issues.apache.org/jira/browse/HDFS-15410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17142164#comment-17142164 ] Yiqun Lin commented on HDFS-15410: -- LGTM , +1. [~elgoiri], Does the latest patch also look good to you?

[jira] [Commented] (HDFS-15410) Add separated config file fedbalance-default.xml for fedbalance tool

[ https://issues.apache.org/jira/browse/HDFS-15410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141672#comment-17141672 ] Yiqun Lin commented on HDFS-15410: -- [~LiJinglun], one minor comment: can you add more description for

[jira] [Updated] (HDFS-15374) Add documentation for fedbalance tool

[ https://issues.apache.org/jira/browse/HDFS-15374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15374: - Attachment: FedBalance_Screenshot3.jpg FedBalance_Screenshot2.jpg

[jira] [Comment Edited] (HDFS-15374) Add documentation for fedbalance tool

[ https://issues.apache.org/jira/browse/HDFS-15374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141662#comment-17141662 ] Yiqun Lin edited comment on HDFS-15374 at 6/22/20, 3:27 AM: The patch almost

[jira] [Commented] (HDFS-15374) Add documentation for fedbalance tool

[ https://issues.apache.org/jira/browse/HDFS-15374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141662#comment-17141662 ] Yiqun Lin commented on HDFS-15374: -- The patch almost looks great now, I find one problem when I use mvn

[jira] [Commented] (HDFS-15374) Add documentation for fedbalance tool

[ https://issues.apache.org/jira/browse/HDFS-15374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140990#comment-17140990 ] Yiqun Lin commented on HDFS-15374: -- [~LiJinglun], thanks for updating the patch! Minor comments from

[jira] [Commented] (HDFS-15410) Add separated config file fedbalance-default.xml for fedbalance tool

[ https://issues.apache.org/jira/browse/HDFS-15410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140960#comment-17140960 ] Yiqun Lin commented on HDFS-15410: -- Besides [~elgoiri]'s review comment, some more reivew comments from

[jira] [Commented] (HDFS-15374) Add documentation for fedbalance tool

[ https://issues.apache.org/jira/browse/HDFS-15374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139105#comment-17139105 ] Yiqun Lin commented on HDFS-15374: -- Hi [~LiJinglun]， can you attach the latest patch here? I am more 

[jira] [Updated] (HDFS-15346) FedBalance tool implementation

[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15346: - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Updated] (HDFS-15346) FedBalance tool implementation

[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15346: - Summary: FedBalance tool implementation (was: DistCpFedBalance implementation) > FedBalance tool

[jira] [Commented] (HDFS-15346) DistCpFedBalance implementation

[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17136480#comment-17136480 ] Yiqun Lin commented on HDFS-15346: -- LGTM, +1. Will commit this the day after tomorrow once there is no

[jira] [Commented] (HDFS-15294) Federation balance tool

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17136263#comment-17136263 ] Yiqun Lin commented on HDFS-15294: -- As this feature tool is designed as a common tool like distcp, I

[jira] [Updated] (HDFS-15410) Add separated config file fedbalance-default.xml for fedbalance tool

[ https://issues.apache.org/jira/browse/HDFS-15410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15410: - Summary: Add separated config file fedbalance-default.xml for fedbalance tool (was: RBF: Add separated

[jira] [Updated] (HDFS-15374) Add documentation for fedbalance tool

[ https://issues.apache.org/jira/browse/HDFS-15374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15374: - Summary: Add documentation for fedbalance tool (was: RBF: Add documentation for fedbalance tool) > Add

[jira] [Updated] (HDFS-15346) DistCpFedBalance implementation

[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15346: - Summary: DistCpFedBalance implementation (was: RBF: DistCpFedBalance implementation) >

[jira] [Updated] (HDFS-15294) Federation balance tool

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15294: - Summary: Federation balance tool (was: RBF: Balance data across federation namespaces with DistCp and

[jira] [Updated] (HDFS-15410) RBF: Add separated config file fedbalance-default.xml for fedbalance tool

[ https://issues.apache.org/jira/browse/HDFS-15410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15410: - Summary: RBF: Add separated config file fedbalance-default.xml for fedbalance tool (was: Add separated

[jira] [Commented] (HDFS-15346) RBF: DistCpFedBalance implementation

[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135819#comment-17135819 ] Yiqun Lin commented on HDFS-15346: -- [~LiJinglun], the refactor looks great. I find you decrease the

[jira] [Comment Edited] (HDFS-15346) RBF: DistCpFedBalance implementation

[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135024#comment-17135024 ] Yiqun Lin edited comment on HDFS-15346 at 6/14/20, 5:05 AM: [~LiJinglun],

[jira] [Comment Edited] (HDFS-15346) RBF: DistCpFedBalance implementation

[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135024#comment-17135024 ] Yiqun Lin edited comment on HDFS-15346 at 6/14/20, 4:59 AM: [~LiJinglun],

[jira] [Commented] (HDFS-15346) RBF: DistCpFedBalance implementation

[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135024#comment-17135024 ] Yiqun Lin commented on HDFS-15346: -- [~LiJinglun], thanks for addressing remaining comments. These two

[jira] [Comment Edited] (HDFS-15087) RBF: Balance/Rename across federation namespaces

[ https://issues.apache.org/jira/browse/HDFS-15087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134832#comment-17134832 ] Yiqun Lin edited comment on HDFS-15087 at 6/13/20, 3:16 PM: Hi

[jira] [Commented] (HDFS-15087) RBF: Balance/Rename across federation namespaces

[ https://issues.apache.org/jira/browse/HDFS-15087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134832#comment-17134832 ] Yiqun Lin commented on HDFS-15087: -- Hi [~umamaheswararao] and others, I'd like to share current status

[jira] [Commented] (HDFS-15346) RBF: DistCpFedBalance implementation

[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130903#comment-17130903 ] Yiqun Lin commented on HDFS-15346: -- [~LiJinglun] , thanks for addressing the comments, almost looks good

[jira] [Comment Edited] (HDFS-15346) RBF: DistCpFedBalance implementation

[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127489#comment-17127489 ] Yiqun Lin edited comment on HDFS-15346 at 6/7/20, 4:35 AM: --- Some more detailed

[jira] [Commented] (HDFS-15346) RBF: DistCpFedBalance implementation

[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127498#comment-17127498 ] Yiqun Lin commented on HDFS-15346: -- Review comments for unit tests: *TestDistCpProcedure.java* # Use

[jira] [Commented] (HDFS-15346) RBF: DistCpFedBalance implementation

[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127489#comment-17127489 ] Yiqun Lin commented on HDFS-15346: -- Some more detailed review comments: *HdfsConstants.java* Can we

[jira] [Commented] (HDFS-15346) RBF: DistCpFedBalance implementation

[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126332#comment-17126332 ] Yiqun Lin commented on HDFS-15346: -- Will give detailed review on this weekend, [~LiJinglun].  > RBF:

[jira] [Comment Edited] (HDFS-15346) RBF: DistCpFedBalance implementation

[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123467#comment-17123467 ] Yiqun Lin edited comment on HDFS-15346 at 6/2/20, 7:56 AM: --- [~LiJinglun], can

[jira] [Commented] (HDFS-15346) RBF: DistCpFedBalance implementation

[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123467#comment-17123467 ] Yiqun Lin commented on HDFS-15346: -- [~LiJinglun], can you fix related failure ut and generated

[jira] [Comment Edited] (HDFS-15346) RBF: DistCpFedBalance implementation

[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120981#comment-17120981 ] Yiqun Lin edited comment on HDFS-15346 at 6/1/20, 12:23 PM: Hi [~LiJinglun] ,

[jira] [Commented] (HDFS-15346) RBF: DistCpFedBalance implementation

[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120981#comment-17120981 ] Yiqun Lin commented on HDFS-15346: -- Hi [~LiJinglun] , some initial review comments from me:

  1   2   3   4   5   6   7   8   9   10   >