[jira] [Commented] (HDFS-16487) RBF: getListing uses raw mount table points

2022-02-26 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17498531#comment-17498531 ] Fengnan Li commented on HDFS-16487: --- Thanks for the discussion [~ayushtkn] [~elgoiri] ! One big part

[jira] [Assigned] (HDFS-16487) RBF: getListing uses raw mount table points

2022-02-25 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li reassigned HDFS-16487: - Assignee: Aihua Xu (was: Fengnan Li) > RBF: getListing uses raw mount table points >

[jira] [Commented] (HDFS-16487) RBF: getListing uses raw mount table points

2022-02-25 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17498302#comment-17498302 ] Fengnan Li commented on HDFS-16487: --- [~elgoiri] What is the intention of the original design to include

[jira] [Created] (HDFS-16487) RBF: getListing uses raw mount table points

2022-02-25 Thread Fengnan Li (Jira)
Fengnan Li created HDFS-16487: - Summary: RBF: getListing uses raw mount table points Key: HDFS-16487 URL: https://issues.apache.org/jira/browse/HDFS-16487 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-16486) RBF: Don't override listing if there is a physical path from subcluster

2022-02-25 Thread Fengnan Li (Jira)
Fengnan Li created HDFS-16486: - Summary: RBF: Don't override listing if there is a physical path from subcluster Key: HDFS-16486 URL: https://issues.apache.org/jira/browse/HDFS-16486 Project: Hadoop HDFS

[jira] [Created] (HDFS-16483) RBF: DataNode talk to Router requesting block info in WebHDFS

2022-02-24 Thread Fengnan Li (Jira)
Fengnan Li created HDFS-16483: - Summary: RBF: DataNode talk to Router requesting block info in WebHDFS Key: HDFS-16483 URL: https://issues.apache.org/jira/browse/HDFS-16483 Project: Hadoop HDFS

[jira] [Updated] (HDFS-16436) RBF: CheckSafeMode before Read Operation

2022-01-24 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-16436: -- Description: In Router's

[jira] [Created] (HDFS-16436) RBF: CheckSafeMode before Read Operation

2022-01-24 Thread Fengnan Li (Jira)
Fengnan Li created HDFS-16436: - Summary: RBF: CheckSafeMode before Read Operation Key: HDFS-16436 URL: https://issues.apache.org/jira/browse/HDFS-16436 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-16218) RBF: RouterFedbalance should load HDFS config

2021-09-15 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17415800#comment-17415800 ] Fengnan Li commented on HDFS-16218: --- [~aajisaka] [~elgoiri] I updated the code to use HdfsConfiguration

[jira] [Resolved] (HDFS-16188) RBF: Router to support resolving monitored namenodes with DNS

2021-09-10 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li resolved HDFS-16188. --- Resolution: Fixed > RBF: Router to support resolving monitored namenodes with DNS >

[jira] [Assigned] (HDFS-16218) RBF: RouterFedbalance should load HDFS config

2021-09-10 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li reassigned HDFS-16218: - Assignee: Fengnan Li > RBF: RouterFedbalance should load HDFS config >

[jira] [Commented] (HDFS-16218) RBF: RouterFedbalance should load HDFS config

2021-09-10 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17413437#comment-17413437 ] Fengnan Li commented on HDFS-16218: --- [~elgoiri] Sure. > RBF: RouterFedbalance should load HDFS config

[jira] [Resolved] (HDFS-16157) Support configuring DNS record to get list of journal nodes.

2021-08-25 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li resolved HDFS-16157. --- Resolution: Resolved > Support configuring DNS record to get list of journal nodes. >

[jira] [Assigned] (HDFS-15599) RBF: Add API to expose resolved destinations (namespace) in Router

2021-05-19 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li reassigned HDFS-15599: - Assignee: Qifan Shi > RBF: Add API to expose resolved destinations (namespace) in Router >

[jira] [Assigned] (HDFS-15599) RBF: Add API to expose resolved destinations (namespace) in Router

2021-05-19 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li reassigned HDFS-15599: - Assignee: (was: Fengnan Li) > RBF: Add API to expose resolved destinations (namespace) in

[jira] [Assigned] (HDFS-15675) TestRouterRpcMultiDestination#testErasureCoding fails on trunk

2021-05-19 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li reassigned HDFS-15675: - Assignee: Fengnan Li > TestRouterRpcMultiDestination#testErasureCoding fails on trunk >

[jira] [Assigned] (HDFS-15857) Space is missed in the print result of ECAdmin.RemoveECPolicyCommand

2021-05-19 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li reassigned HDFS-15857: - Assignee: Fengnan Li > Space is missed in the print result of ECAdmin.RemoveECPolicyCommand >

[jira] [Resolved] (HDFS-15878) RBF: Flaky test TestRouterWebHDFSContractCreate>AbstractContractCreateTest#testSyncable in Trunk

2021-05-07 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li resolved HDFS-15878. --- Resolution: Not A Problem > RBF: Flaky test >

[jira] [Reopened] (HDFS-15878) RBF: Flaky test TestRouterWebHDFSContractCreate>AbstractContractCreateTest#testSyncable in Trunk

2021-05-07 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li reopened HDFS-15878: --- Reopen to change the closing status. > RBF: Flaky test >

[jira] [Commented] (HDFS-15878) RBF: Flaky test TestRouterWebHDFSContractCreate>AbstractContractCreateTest#testSyncable in Trunk

2021-05-07 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17340967#comment-17340967 ] Fengnan Li commented on HDFS-15878: --- [~hexiaoqiao] [~ayushtkn]  Updated the status as suggested.

[jira] [Resolved] (HDFS-15878) RBF: Flaky test TestRouterWebHDFSContractCreate>AbstractContractCreateTest#testSyncable in Trunk

2021-05-04 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li resolved HDFS-15878. --- Resolution: Resolved > RBF: Flaky test >

[jira] [Commented] (HDFS-15878) RBF: Flaky test TestRouterWebHDFSContractCreate>AbstractContractCreateTest#testSyncable in Trunk

2021-05-04 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17339192#comment-17339192 ] Fengnan Li commented on HDFS-15878: --- Thanks [~ayushtkn] for the answer. I was thinking you guys have

[jira] [Commented] (HDFS-15757) RBF: Improving Router Connection Management

2021-05-03 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17338633#comment-17338633 ] Fengnan Li commented on HDFS-15757: --- [~hexiaoqiao] Have you got time to test this patch? We found

[jira] [Commented] (HDFS-15878) RBF: Flaky test TestRouterWebHDFSContractCreate>AbstractContractCreateTest#testSyncable in Trunk

2021-05-03 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17338632#comment-17338632 ] Fengnan Li commented on HDFS-15878: --- The failure didn't show up in this page:

[jira] [Created] (HDFS-16005) RBF: AccessControlException is counted as proxy failure

2021-05-02 Thread Fengnan Li (Jira)
Fengnan Li created HDFS-16005: - Summary: RBF: AccessControlException is counted as proxy failure Key: HDFS-16005 URL: https://issues.apache.org/jira/browse/HDFS-16005 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-15810) RBF: RBFMetrics's TotalCapacity out of bounds

2021-04-26 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-15810: -- Attachment: Screen Shot 2021-04-26 at 5.25.12 PM.png > RBF: RBFMetrics's TotalCapacity out of bounds >

[jira] [Commented] (HDFS-15561) RBF: Fix NullPointException when start dfsrouter

2021-04-25 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17331422#comment-17331422 ] Fengnan Li commented on HDFS-15561: --- [~weichiu] [~hexiaoqiao] Attached a new patch, please review.

[jira] [Commented] (HDFS-15878) RBF: Flaky test TestRouterWebHDFSContractCreate>AbstractContractCreateTest#testSyncable in Trunk

2021-04-23 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17330958#comment-17330958 ] Fengnan Li commented on HDFS-15878: --- [~weichiu] can you help verify the tests have been successful?

[jira] [Updated] (HDFS-15561) RBF: Fix NullPointException when start dfsrouter

2021-04-19 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-15561: -- Summary: RBF: Fix NullPointException when start dfsrouter (was: Fix NullPointException when start

[jira] [Assigned] (HDFS-15561) Fix NullPointException when start dfsrouter

2021-04-18 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li reassigned HDFS-15561: - Assignee: Fengnan Li > Fix NullPointException when start dfsrouter >

[jira] [Commented] (HDFS-15561) Fix NullPointException when start dfsrouter

2021-04-18 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324706#comment-17324706 ] Fengnan Li commented on HDFS-15561: --- [~weichiu] Sure, I will take it. Thanks. > Fix NullPointException

[jira] [Issue Comment Deleted] (HDFS-15561) Fix NullPointException when start dfsrouter

2021-04-18 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-15561: -- Comment: was deleted (was: [~lamberken] Are you still working on this one?  [~weichiu] I can take

[jira] [Commented] (HDFS-15561) Fix NullPointException when start dfsrouter

2021-04-18 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324705#comment-17324705 ] Fengnan Li commented on HDFS-15561: --- [~lamberken] Are you still working on this one?  [~weichiu] I can

[jira] [Commented] (HDFS-15878) Flaky test TestRouterWebHDFSContractCreate>AbstractContractCreateTest#testSyncable in Trunk

2021-04-16 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324127#comment-17324127 ] Fengnan Li commented on HDFS-15878: --- [~inigoiri] How can we verify the tests are fixed? Is there some

[jira] [Updated] (HDFS-15810) RBF: RBFMetrics's TotalCapacity out of bounds

2021-04-14 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-15810: -- Status: Patch Available (was: Open) > RBF: RBFMetrics's TotalCapacity out of bounds >

[jira] [Assigned] (HDFS-15810) RBF: RBFMetrics's TotalCapacity out of bounds

2021-04-14 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li reassigned HDFS-15810: - Assignee: Fengnan Li > RBF: RBFMetrics's TotalCapacity out of bounds >

[jira] [Commented] (HDFS-15810) RBF: RBFMetrics's TotalCapacity out of bounds

2021-04-14 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17321352#comment-17321352 ] Fengnan Li commented on HDFS-15810: --- Sure. I will give it a try with BigInteger. > RBF: RBFMetrics's

[jira] [Commented] (HDFS-15810) RBF: RBFMetrics's TotalCapacity out of bounds

2021-04-14 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17321315#comment-17321315 ] Fengnan Li commented on HDFS-15810: --- Can we use double which has much bigger MAX than long? > RBF:

[jira] [Work started] (HDFS-15423) RBF: WebHDFS create shouldn't choose DN from all sub-clusters

2021-04-13 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-15423 started by Fengnan Li. - > RBF: WebHDFS create shouldn't choose DN from all sub-clusters >

[jira] [Commented] (HDFS-15423) RBF: WebHDFS create shouldn't choose DN from all sub-clusters

2021-04-13 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320443#comment-17320443 ] Fengnan Li commented on HDFS-15423: --- Thanks very much [~ayushtkn] I have opened:

[jira] [Commented] (HDFS-15423) RBF: WebHDFS create shouldn't choose DN from all sub-clusters

2021-04-13 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320410#comment-17320410 ] Fengnan Li commented on HDFS-15423: --- Indeed. Let's wait for one day since by reverting the history

[jira] [Commented] (HDFS-15423) RBF: WebHDFS create shouldn't choose DN from all sub-clusters

2021-04-13 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320354#comment-17320354 ] Fengnan Li commented on HDFS-15423: --- [~elgoiri] [~ferhui] The dependent call was removed in this task:

[jira] [Commented] (HDFS-15423) RBF: WebHDFS create shouldn't choose DN from all sub-clusters

2021-04-12 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319891#comment-17319891 ] Fengnan Li commented on HDFS-15423: --- [~elgoiri] Sure, I will create a new one. > RBF: WebHDFS create

[jira] [Commented] (HDFS-15423) RBF: WebHDFS create shouldn't choose DN from all sub-clusters

2021-04-12 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319724#comment-17319724 ] Fengnan Li commented on HDFS-15423: --- Thanks [~elgoiri] [~ayushtkn] for the review! Let's see whether it

[jira] [Commented] (HDFS-15878) Flaky test TestRouterWebHDFSContractCreate>AbstractContractCreateTest#testSyncable in Trunk

2021-04-12 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319573#comment-17319573 ] Fengnan Li commented on HDFS-15878: --- Let's wait after HDFS-15423 is committed. Thanks. > Flaky test >

[jira] [Commented] (HDFS-15878) Flaky test TestRouterWebHDFSContractCreate>AbstractContractCreateTest#testSyncable in Trunk

2021-04-09 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318339#comment-17318339 ] Fengnan Li commented on HDFS-15878: --- I think this will be fixed by

[jira] [Updated] (HDFS-15878) Flaky test TestRouterWebHDFSContractCreate>AbstractContractCreateTest#testSyncable in Trunk

2021-04-09 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-15878: -- Component/s: rbf hdfs > Flaky test >

[jira] [Assigned] (HDFS-15878) Flaky test TestRouterWebHDFSContractCreate>AbstractContractCreateTest#testSyncable in Trunk

2021-04-09 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li reassigned HDFS-15878: - Assignee: Fengnan Li > Flaky test >

[jira] [Commented] (HDFS-15675) TestRouterRpcMultiDestination#testErasureCoding fails on trunk

2021-04-09 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318315#comment-17318315 ] Fengnan Li commented on HDFS-15675: --- Is this still happening? If so I would like to take it. >

[jira] [Commented] (HDFS-15756) RBF: Cannot get updated delegation token from zookeeper

2021-04-08 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317683#comment-17317683 ] Fengnan Li commented on HDFS-15756: --- This was discussed in

[jira] [Assigned] (HDFS-15836) RBF: Fix TestRouterHDFSContractCreate and TestRouterHDFSContractCreateSecure

2021-02-15 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li reassigned HDFS-15836: - Assignee: Akira Ajisaka > RBF: Fix TestRouterHDFSContractCreate and

[jira] [Commented] (HDFS-15836) RBF: Fix TestRouterHDFSContractCreate and TestRouterHDFSContractCreateSecure

2021-02-15 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284992#comment-17284992 ] Fengnan Li commented on HDFS-15836: --- +1 for the fix. Thanks [~aajisaka] > RBF: Fix

[jira] [Created] (HDFS-15833) Make ObserverReadProxyProvider able to talk to DNS of Observers

2021-02-10 Thread Fengnan Li (Jira)
Fengnan Li created HDFS-15833: - Summary: Make ObserverReadProxyProvider able to talk to DNS of Observers Key: HDFS-15833 URL: https://issues.apache.org/jira/browse/HDFS-15833 Project: Hadoop HDFS

[jira] [Created] (HDFS-15832) Using DNS to access Zookeeper cluster

2021-02-10 Thread Fengnan Li (Jira)
Fengnan Li created HDFS-15832: - Summary: Using DNS to access Zookeeper cluster Key: HDFS-15832 URL: https://issues.apache.org/jira/browse/HDFS-15832 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-15831) Adopt more DNS resolving for HDFS

2021-02-10 Thread Fengnan Li (Jira)
Fengnan Li created HDFS-15831: - Summary: Adopt more DNS resolving for HDFS Key: HDFS-15831 URL: https://issues.apache.org/jira/browse/HDFS-15831 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-15757) RBF: Improving Router Connection Management

2021-02-04 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279190#comment-17279190 ] Fengnan Li commented on HDFS-15757: --- [~hexiaoqiao] Thanks for the question. There are three latencies:

[jira] [Commented] (HDFS-15757) RBF: Improving Router Connection Management

2021-02-02 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277412#comment-17277412 ] Fengnan Li commented on HDFS-15757: --- [~elgoiri] [~hexiaoqiao] Addressed comments in the PR. What's

[jira] [Commented] (HDFS-15757) RBF: Improving Router Connection Management

2021-02-01 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276730#comment-17276730 ] Fengnan Li commented on HDFS-15757: --- [~elgoiri] [~hexiaoqiao] Thanks for the review and take a look at

[jira] [Updated] (HDFS-15757) RBF: Improving Router Connection Management

2021-02-01 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-15757: -- Attachment: RBF_ Improving Router Connection Management_v3.pdf > RBF: Improving Router Connection

[jira] [Commented] (HDFS-15757) RBF: Improving Router Connection Management

2021-01-29 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17275455#comment-17275455 ] Fengnan Li commented on HDFS-15757: --- Updated the latest patch in github. We saw ~50% less connections

[jira] [Updated] (HDFS-14558) RBF: Isolation/Fairness documentation

2021-01-11 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-14558: -- Attachment: HDFS-14558.003.patch > RBF: Isolation/Fairness documentation >

[jira] [Commented] (HDFS-14558) RBF: Isolation/Fairness documentation

2021-01-11 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263129#comment-17263129 ] Fengnan Li commented on HDFS-14558: --- Thanks for the pointer [~linyiqun]. Edited accordingly. > RBF:

[jira] [Updated] (HDFS-14558) RBF: Isolation/Fairness documentation

2021-01-11 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-14558: -- Attachment: HDFS-14558.003.patch > RBF: Isolation/Fairness documentation >

[jira] [Updated] (HDFS-14558) RBF: Isolation/Fairness documentation

2021-01-11 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-14558: -- Attachment: (was: HDFS-14558.003.patch) > RBF: Isolation/Fairness documentation >

[jira] [Updated] (HDFS-14558) RBF: Isolation/Fairness documentation

2021-01-10 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-14558: -- Attachment: HDFS-14558.002.patch > RBF: Isolation/Fairness documentation >

[jira] [Commented] (HDFS-14558) RBF: Isolation/Fairness documentation

2021-01-10 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262262#comment-17262262 ] Fengnan Li commented on HDFS-14558: --- Thanks a lot for the review [~linyiqun] I uploaded an updated

[jira] [Commented] (HDFS-15423) RBF: WebHDFS create shouldn't choose DN from all sub-clusters

2021-01-07 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260857#comment-17260857 ] Fengnan Li commented on HDFS-15423: --- [~csun] [~elgoiri] [~hexiaoqiao] Please review the PR. Thanks! >

[jira] [Commented] (HDFS-15757) RBF: Improving Router Connection Management

2021-01-05 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259086#comment-17259086 ] Fengnan Li commented on HDFS-15757: --- [~elgoiri] I actually have done some very simple POC for it and I

[jira] [Updated] (HDFS-15757) RBF: Improving Router Connection Management

2021-01-04 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-15757: -- Attachment: RBF_ Improving Router Connection Management_v2.pdf > RBF: Improving Router Connection

[jira] [Updated] (HDFS-15757) RBF: Improving Router Connection Management

2021-01-04 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-15757: -- Attachment: (was: RBF_ Improving Router Connection Management_v2.pdf) > RBF: Improving Router

[jira] [Updated] (HDFS-15757) RBF: Improving Router Connection Management

2021-01-04 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-15757: -- Attachment: RBF_ Improving Router Connection Management_v2.pdf > RBF: Improving Router Connection

[jira] [Commented] (HDFS-15757) RBF: Improving Router Connection Management

2021-01-04 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258611#comment-17258611 ] Fengnan Li commented on HDFS-15757: --- Uploaded v2 with more metrics and some changes. I will start some

[jira] [Updated] (HDFS-15757) RBF: Improving Router Connection Management

2021-01-04 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-15757: -- Attachment: (was: RBF_ Improving Router Connection Management_v2.pdf) > RBF: Improving Router

[jira] [Updated] (HDFS-15757) RBF: Improving Router Connection Management

2021-01-04 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-15757: -- Attachment: RBF_ Improving Router Connection Management_v2.pdf > RBF: Improving Router Connection

[jira] [Commented] (HDFS-15757) RBF: Improving Router Connection Management

2021-01-04 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258376#comment-17258376 ] Fengnan Li commented on HDFS-15757: --- Thanks for the review [~elgoiri] There are two metrics we will try

[jira] [Commented] (HDFS-15757) RBF: Improving Router Connection Management

2021-01-01 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17257230#comment-17257230 ] Fengnan Li commented on HDFS-15757: --- [~inigoiri] [~hexiaoqiao][~ayushtkn] Please take a look. Thanks!

[jira] [Created] (HDFS-15757) RBF: Improving Router Connection Management

2021-01-01 Thread Fengnan Li (Jira)
Fengnan Li created HDFS-15757: - Summary: RBF: Improving Router Connection Management Key: HDFS-15757 URL: https://issues.apache.org/jira/browse/HDFS-15757 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-15757) RBF: Improving Router Connection Management

2021-01-01 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-15757: -- Attachment: RBF_ Router Connection Management.pdf > RBF: Improving Router Connection Management >

[jira] [Created] (HDFS-15754) Create packet metrics for DataNode

2020-12-29 Thread Fengnan Li (Jira)
Fengnan Li created HDFS-15754: - Summary: Create packet metrics for DataNode Key: HDFS-15754 URL: https://issues.apache.org/jira/browse/HDFS-15754 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Assigned] (HDFS-14558) RBF: Isolation/Fairness documentation

2020-12-09 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li reassigned HDFS-14558: - Assignee: Fengnan Li (was: CR Hota) > RBF: Isolation/Fairness documentation >

[jira] [Commented] (HDFS-14558) RBF: Isolation/Fairness documentation

2020-12-09 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247059#comment-17247059 ] Fengnan Li commented on HDFS-14558: --- [~ferhui] Thanks for the ping. I will provide an updated patch

[jira] [Commented] (HDFS-15383) RBF: Disable watch in ZKDelegationSecretManager for performance

2020-12-09 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247035#comment-17247035 ] Fengnan Li commented on HDFS-15383: --- [~John Smith] It is a good question. First of all, when the token

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2020-11-12 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231064#comment-17231064 ] Fengnan Li commented on HDFS-14090: --- [^HDFS-14090.025.patch] to fix tests and address comments.

[jira] [Updated] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2020-11-12 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-14090: -- Attachment: HDFS-14090.025.patch > RBF: Improved isolation for downstream name nodes. {Static} >

[jira] [Comment Edited] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2020-11-11 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17230394#comment-17230394 ] Fengnan Li edited comment on HDFS-14090 at 11/12/20, 7:07 AM: -- Uploaded

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2020-11-11 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17230394#comment-17230394 ] Fengnan Li commented on HDFS-14090: --- Uploaded [^HDFS-14090.024.patch] to add configs for it. I feel

[jira] [Updated] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2020-11-11 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-14090: -- Attachment: HDFS-14090.024.patch > RBF: Improved isolation for downstream name nodes. {Static} >

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2020-11-11 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17230344#comment-17230344 ] Fengnan Li commented on HDFS-14090: --- Thanks for the review [~linyiqun] and here is the late response.

[jira] [Updated] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2020-11-02 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-14090: -- Attachment: HDFS-14090.023.patch > RBF: Improved isolation for downstream name nodes. {Static} >

[jira] [Updated] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2020-11-02 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-14090: -- Attachment: HDFS-14090.022.patch > RBF: Improved isolation for downstream name nodes. {Static} >

[jira] [Updated] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2020-11-01 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-14090: -- Attachment: HDFS-14090.021.patch > RBF: Improved isolation for downstream name nodes. {Static} >

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2020-11-01 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224360#comment-17224360 ] Fengnan Li commented on HDFS-14090: --- Thanks [~elgoiri] let's see whether [^HDFS-14090.020.patch] can

[jira] [Updated] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2020-11-01 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-14090: -- Attachment: HDFS-14090.020.patch > RBF: Improved isolation for downstream name nodes. {Static} >

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2020-11-01 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224314#comment-17224314 ] Fengnan Li commented on HDFS-14090: --- Uploaded [^HDFS-14090.019.patch] to fix styling issues.

[jira] [Updated] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2020-11-01 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-14090: -- Attachment: HDFS-14090.019.patch > RBF: Improved isolation for downstream name nodes. {Static} >

[jira] [Updated] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2020-10-30 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-14090: -- Attachment: HDFS-14090.018.patch > RBF: Improved isolation for downstream name nodes. {Static} >

[jira] [Updated] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2020-10-30 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-14090: -- Attachment: HDFS-14090.017.patch > RBF: Improved isolation for downstream name nodes. {Static} >

[jira] [Updated] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2020-10-27 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-14090: -- Attachment: HDFS-14090.016.patch > RBF: Improved isolation for downstream name nodes. {Static} >

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2020-10-27 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17221751#comment-17221751 ] Fengnan Li commented on HDFS-14090: --- Uploaded [^HDFS-14090.016.patch] to fix styling and unit tests >

[jira] [Assigned] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2020-10-20 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li reassigned HDFS-14090: - Assignee: Fengnan Li (was: CR Hota) > RBF: Improved isolation for downstream name nodes.

  1   2   3   4   >