[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2020-03-10 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055839#comment-17055839 ] Xiaoqiao He commented on HDFS-15160: Thanks [~sodonnell] for your works, it is great improvement for

[jira] [Updated] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15113: --- Attachment: HDFS-15113.005.patch > Missing IBR when NameNode restart if open processCommand async

[jira] [Comment Edited] (HDFS-15205) FSImage sort section logic is wrong

2020-03-07 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17053968#comment-17053968 ] Xiaoqiao He edited comment on HDFS-15205 at 3/7/20, 10:21 AM: -- Hi

[jira] [Commented] (HDFS-15205) FSImage sort section logic is wrong

2020-03-07 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17053968#comment-17053968 ] Xiaoqiao He commented on HDFS-15205: Hi [~sodonnell],[~angerszhuuu], After re-check and dig code, I

[jira] [Assigned] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-14 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-15180: -- Assignee: Aiphago (was: zhuqi) > DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-14 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059203#comment-17059203 ] Xiaoqiao He commented on HDFS-15180: Thanks [~Aiphag0] for your works and the POC patch. Hi [~zhuqi],

[jira] [Commented] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2020-04-18 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086389#comment-17086389 ] Xiaoqiao He commented on HDFS-14186: Hi [~zhengchenyu], The thought of [^HDFS-14186.001.patch] try to

[jira] [Commented] (HDFS-15274) NN doesn't remove the blocks from the failed DatanodeStorageInfo

2020-04-13 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17082808#comment-17082808 ] Xiaoqiao He commented on HDFS-15274: Hi [~marvelrock], Thanks for involve me here. Trigger Jenkins

[jira] [Updated] (HDFS-12862) CacheDirective becomes invalid when NN restart or failover

2020-04-11 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-12862: --- Fix Version/s: 3.2.2 Resolution: Fixed Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-15272) Backport HDFS-12862 to branch-3.1

2020-04-12 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15272: --- Attachment: HDFS-15272.branch-3.1.001.patch > Backport HDFS-12862 to branch-3.1 >

[jira] [Updated] (HDFS-15272) Backport HDFS-12862 to branch-3.1

2020-04-12 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15272: --- Status: Patch Available (was: Open) > Backport HDFS-12862 to branch-3.1 >

[jira] [Created] (HDFS-15273) CacheReplicationMonitor hold lock for long time and lead to NN out of service

2020-04-12 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HDFS-15273: -- Summary: CacheReplicationMonitor hold lock for long time and lead to NN out of service Key: HDFS-15273 URL: https://issues.apache.org/jira/browse/HDFS-15273 Project:

[jira] [Commented] (HDFS-12862) CacheDirective becomes invalid when NN restart or failover

2020-04-11 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17081647#comment-17081647 ] Xiaoqiao He commented on HDFS-12862: Thanks [~brahmareddy] and [~weichiu] for reminder. Files another

[jira] [Created] (HDFS-15272) Backport HDFS-12862 to branch-3.1

2020-04-11 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HDFS-15272: -- Summary: Backport HDFS-12862 to branch-3.1 Key: HDFS-15272 URL: https://issues.apache.org/jira/browse/HDFS-15272 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-15082) RBF: Check each component length of destination path when add/update mount entry

2020-04-12 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17081657#comment-17081657 ] Xiaoqiao He commented on HDFS-15082: Thanks [~ayushtkn] for your comments. Yes, since we reused

[jira] [Commented] (HDFS-15272) Backport HDFS-12862 to branch-3.1

2020-04-12 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17081745#comment-17081745 ] Xiaoqiao He commented on HDFS-15272: HDFS-14599 fixed this fail unit test, but not backport 3.1 and

[jira] [Commented] (HDFS-14599) HDFS-12487 breaks test TestDiskBalancer.testDiskBalancerWithFedClusterWithOneNameServiceEmpty

2020-04-12 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17081742#comment-17081742 ] Xiaoqiao He commented on HDFS-14599: Hi [~weichiu],[~elgoiri]. TestDiskBalancer is still broken by

[jira] [Commented] (HDFS-15272) Backport HDFS-12862 to branch-3.1

2020-04-12 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17081738#comment-17081738 ] Xiaoqiao He commented on HDFS-15272: TestDiskBalancer keeps failing whether apply this patch or not.

[jira] [Updated] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15113: --- Attachment: HDFS-15113.addendum.patch > Missing IBR when NameNode restart if open processCommand

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059699#comment-17059699 ] Xiaoqiao He commented on HDFS-15113: Thanks [~weichiu] for your comments and sorry for missing this

[jira] [Commented] (HDFS-15238) RBF:NamenodeHeartbeatService caused memory to grow rapidly

2020-03-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066869#comment-17066869 ] Xiaoqiao He commented on HDFS-15238: Thanks [~xuzq_zander] for your works. Good catch here. +1 for

[jira] [Commented] (HDFS-15242) Add metrics for operations hold lock times of FsDatasetImpl

2020-03-26 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17067915#comment-17067915 ] Xiaoqiao He commented on HDFS-15242: Thanks [~elgoiri] for your reviews. v003 fix the typo. PTAL. >

[jira] [Updated] (HDFS-15242) Add metrics for operations hold lock times of FsDatasetImpl

2020-03-26 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15242: --- Attachment: HDFS-15242.003.patch > Add metrics for operations hold lock times of FsDatasetImpl >

[jira] [Updated] (HDFS-15242) Add metrics for operations hold lock times of FsDatasetImpl

2020-03-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15242: --- Attachment: HDFS-15242.002.patch > Add metrics for operations hold lock times of FsDatasetImpl >

[jira] [Commented] (HDFS-15242) Add metrics for operations hold lock times of FsDatasetImpl

2020-03-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17067344#comment-17067344 ] Xiaoqiao He commented on HDFS-15242: Thanks [~weichiu],[~elgoiri] for your reviews. rebase and upload

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-03-27 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-13183: --- Attachment: HDFS-13183.004.patch > Standby NameNode process getBlocks request to reduce Active load

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-03-27 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068809#comment-17068809 ] Xiaoqiao He commented on HDFS-13183: Considering this feature is deployed and used by many users, I

[jira] [Commented] (HDFS-15075) Remove process command timing from BPServiceActor

2020-03-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1703#comment-1703 ] Xiaoqiao He commented on HDFS-15075: Hi [~weichiu],[~elgoiri], add metrics for {{FsDatasetImpl}}

[jira] [Created] (HDFS-15242) Add metrics for operations hold lock times of FsDatasetImpl

2020-03-25 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HDFS-15242: -- Summary: Add metrics for operations hold lock times of FsDatasetImpl Key: HDFS-15242 URL: https://issues.apache.org/jira/browse/HDFS-15242 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15242) Add metrics for operations hold lock times of FsDatasetImpl

2020-03-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15242: --- Attachment: HDFS-15242.001.patch Status: Patch Available (was: Open) submit init patch v001

[jira] [Updated] (HDFS-14385) RBF: Optimize MiniRouterDFSCluster with optional light weight MiniDFSCluster

2020-03-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14385: --- Attachment: HDFS-14385.002.patch > RBF: Optimize MiniRouterDFSCluster with optional light weight

[jira] [Commented] (HDFS-14385) RBF: Optimize MiniRouterDFSCluster with optional light weight MiniDFSCluster

2020-03-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069301#comment-17069301 ] Xiaoqiao He commented on HDFS-14385: Thanks [~elgoiri] pick this JIRA up, v002 rebase to trunk. PTAL.

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-03-27 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-13183: --- Attachment: HDFS-13183.005.patch > Standby NameNode process getBlocks request to reduce Active load

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-03-27 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069207#comment-17069207 ] Xiaoqiao He commented on HDFS-13183: v005 try to fix the findbugs and checkstyle. > Standby NameNode

[jira] [Updated] (HDFS-14385) RBF: Optimize MiniRouterDFSCluster with optional light weight MiniDFSCluster

2020-03-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14385: --- Attachment: HDFS-14385.003.patch > RBF: Optimize MiniRouterDFSCluster with optional light weight

[jira] [Commented] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

2020-03-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070292#comment-17070292 ] Xiaoqiao He commented on HDFS-15051: Thanks [~elgoiri],[~ayushtkn] for your reviews. v009 try to

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-03-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070299#comment-17070299 ] Xiaoqiao He commented on HDFS-13183: [~ayushtkn] I totally agree that SBN read/Observer is more

[jira] [Commented] (HDFS-14385) RBF: Optimize MiniRouterDFSCluster with optional light weight MiniDFSCluster

2020-03-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070288#comment-17070288 ] Xiaoqiao He commented on HDFS-14385: Thanks [~elgoiri], v003 try to fix checkstyle and bugs. Pending

[jira] [Updated] (HDFS-15169) RBF: Router FSCK should consider the mount table

2020-03-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15169: --- Attachment: HDFS-15169.004.patch > RBF: Router FSCK should consider the mount table >

[jira] [Updated] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

2020-03-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15051: --- Attachment: HDFS-15051.009.patch > RBF: Propose to revoke WRITE MountTableEntry privilege to super

[jira] [Commented] (HDFS-15169) RBF: Router FSCK should consider the mount table

2020-03-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070291#comment-17070291 ] Xiaoqiao He commented on HDFS-15169: Thanks [~ayushtkn], Great catch. It is exactly a bug that we do

[jira] [Updated] (HDFS-14385) RBF: Optimize MiniRouterDFSCluster with optional light weight MiniDFSCluster

2020-03-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14385: --- Attachment: HDFS-14385.004.patch > RBF: Optimize MiniRouterDFSCluster with optional light weight

[jira] [Commented] (HDFS-14385) RBF: Optimize MiniRouterDFSCluster with optional light weight MiniDFSCluster

2020-03-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070358#comment-17070358 ] Xiaoqiao He commented on HDFS-14385: v004 try to fix checkstyle and failed unit tests. > RBF:

[jira] [Commented] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

2020-03-27 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068824#comment-17068824 ] Xiaoqiao He commented on HDFS-15051: [~ayushtkn],[~elgoiri] any thought or suggestions here? > RBF:

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-03-27 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-13183: --- Affects Version/s: (was: 3.0.2) (was: 2.8.4)

[jira] [Updated] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

2020-03-31 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15051: --- Attachment: HDFS-15051.010.patch > RBF: Propose to revoke WRITE MountTableEntry privilege to super

[jira] [Updated] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

2020-03-31 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15051: --- Attachment: (was: HDFS-15051.010.patch) > RBF: Propose to revoke WRITE MountTableEntry privilege

[jira] [Updated] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

2020-03-31 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15051: --- Attachment: HDFS-15051.010.patch > RBF: Propose to revoke WRITE MountTableEntry privilege to super

[jira] [Commented] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

2020-03-31 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17072393#comment-17072393 ] Xiaoqiao He commented on HDFS-15051: Thanks [~ayushtkn] and [~elgoiri] for your comments. v010 add

[jira] [Commented] (HDFS-15169) RBF: Router FSCK should consider the mount table

2020-03-31 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17072403#comment-17072403 ] Xiaoqiao He commented on HDFS-15169: Thanks [~ayushtkn] for your helpful review comments.

[jira] [Commented] (HDFS-15169) RBF: Router FSCK should consider the mount table

2020-03-27 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068823#comment-17068823 ] Xiaoqiao He commented on HDFS-15169: Thanks [~elgoiri] for your reviews. v003 try to refactor the

[jira] [Updated] (HDFS-15169) RBF: Router FSCK should consider the mount table

2020-03-27 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15169: --- Attachment: HDFS-15169.003.patch > RBF: Router FSCK should consider the mount table >

[jira] [Updated] (HDFS-15169) RBF: Router FSCK should consider the mount table

2020-03-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15169: --- Attachment: HDFS-15169.005.patch > RBF: Router FSCK should consider the mount table >

[jira] [Commented] (HDFS-15169) RBF: Router FSCK should consider the mount table

2020-03-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070339#comment-17070339 ] Xiaoqiao He commented on HDFS-15169: v005 try to fix findbugs and checkstyle. And update all mount

[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

2020-03-26 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17067442#comment-17067442 ] Xiaoqiao He commented on HDFS-12733: Thanks [~elgoiri],[~ayushtkn] for your great feedback. v008 does

[jira] [Updated] (HDFS-15082) RBF: Check each component length of destination path when add/update mount entry

2020-03-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15082: --- Attachment: HDFS-15082.003.patch > RBF: Check each component length of destination path when

[jira] [Commented] (HDFS-15082) RBF: Check each component length of destination path when add/update mount entry

2020-03-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066381#comment-17066381 ] Xiaoqiao He commented on HDFS-15082: Thanks [~elgoiri] for picking up this issue. submit v003 (total

[jira] [Updated] (HDFS-15075) Remove process command timing from BPServiceActor

2020-03-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15075: --- Attachment: HDFS-15075.008.patch > Remove process command timing from BPServiceActor >

[jira] [Commented] (HDFS-15075) Remove process command timing from BPServiceActor

2020-03-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066456#comment-17066456 ] Xiaoqiao He commented on HDFS-15075: Thanks [~weichiu],[~elgoiri] for your suggestions, v008 try to

[jira] [Commented] (HDFS-15082) RBF: Check each component length of destination path when add/update mount entry

2020-03-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066464#comment-17066464 ] Xiaoqiao He commented on HDFS-15082: Hi [~elgoiri], I try to test failed unit test

[jira] [Updated] (HDFS-15169) RBF: Router FSCK should consider the mount table

2020-03-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15169: --- Attachment: HDFS-15169.002.patch > RBF: Router FSCK should consider the mount table >

[jira] [Commented] (HDFS-15169) RBF: Router FSCK should consider the mount table

2020-03-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066635#comment-17066635 ] Xiaoqiao He commented on HDFS-15169: Thanks [~elgoiri] for your reviews. v002 add unit test for fsck

[jira] [Updated] (HDFS-15075) Remove process command timing from BPServiceActor

2020-03-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15075: --- Attachment: HDFS-15075.009.patch > Remove process command timing from BPServiceActor >

[jira] [Commented] (HDFS-15075) Remove process command timing from BPServiceActor

2020-03-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066637#comment-17066637 ] Xiaoqiao He commented on HDFS-15075: update to v009, and fix findbugs. > Remove process command

[jira] [Updated] (HDFS-15205) FSImage sort section logic is wrong

2020-04-23 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15205: --- Target Version/s: (was: 3.1.4, 3.2.2, 3.3.1) > FSImage sort section logic is wrong >

[jira] [Commented] (HDFS-15205) FSImage sort section logic is wrong

2020-04-23 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17090316#comment-17090316 ] Xiaoqiao He commented on HDFS-15205: Thanks [~gabor.bota] for your reminding. Remove all target

[jira] [Commented] (HDFS-15273) CacheReplicationMonitor hold lock for long time and lead to NN out of service

2020-05-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099603#comment-17099603 ] Xiaoqiao He commented on HDFS-15273: Hi [~weichiu], there are a different set of test data, which try

[jira] [Commented] (HDFS-15310) RBF: Not proxy client's clientId and callId caused RetryCache invalid in NameNode.

2020-05-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099643#comment-17099643 ] Xiaoqiao He commented on HDFS-15310: Thanks [~ayushtkn] for re-launching this discussion. It is very

[jira] [Commented] (HDFS-15310) RBF:Not proxy client's clientId and callId caused RetryCache invalid in NameNode.

2020-04-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096118#comment-17096118 ] Xiaoqiao He commented on HDFS-15310: [~xuzq_zander] I'm quite certain that it is serious bug. Please

[jira] [Updated] (HDFS-15082) RBF: Check each component length of destination path when add/update mount entry

2020-05-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15082: --- Attachment: HDFS-15082.005.patch > RBF: Check each component length of destination path when

[jira] [Commented] (HDFS-15082) RBF: Check each component length of destination path when add/update mount entry

2020-05-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109120#comment-17109120 ] Xiaoqiao He commented on HDFS-15082: v005 try to fix checkstyle and trigger yetus again. > RBF:

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-17 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109826#comment-17109826 ] Xiaoqiao He commented on HDFS-13183: code rebase and trigger yetus again. > Standby NameNode process

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-17 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-13183: --- Attachment: HDFS-13183.007.patch > Standby NameNode process getBlocks request to reduce Active load

[jira] [Commented] (HDFS-15356) Unify configuration `dfs.ha.allow.stale.reads` to DFSConfigKeys

2020-05-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108339#comment-17108339 ] Xiaoqiao He commented on HDFS-15356: Hi [~ayushtkn], This is introduced by HDFS-2693 with a long

[jira] [Commented] (HDFS-15356) Unify configuration `dfs.ha.allow.stale.reads` to DFSConfigKeys

2020-05-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108355#comment-17108355 ] Xiaoqiao He commented on HDFS-15356: Thanks [~ayushtkn], v002 try to fix checkstyle. > Unify

[jira] [Updated] (HDFS-15356) Unify configuration `dfs.ha.allow.stale.reads` to DFSConfigKeys

2020-05-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15356: --- Attachment: HDFS-15356.002.patch > Unify configuration `dfs.ha.allow.stale.reads` to DFSConfigKeys >

[jira] [Updated] (HDFS-15356) Unify configuration `dfs.ha.allow.stale.reads` to DFSConfigKeys

2020-05-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15356: --- Attachment: HDFS-15356.003.patch > Unify configuration `dfs.ha.allow.stale.reads` to DFSConfigKeys >

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108881#comment-17108881 ] Xiaoqiao He commented on HDFS-13183: Try to run failed unit test at local, both of them passed except

[jira] [Commented] (HDFS-15356) Unify configuration `dfs.ha.allow.stale.reads` to DFSConfigKeys

2020-05-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108876#comment-17108876 ] Xiaoqiao He commented on HDFS-15356: Thanks [~ayushtkn], v003 try to fix the missing character.

[jira] [Updated] (HDFS-15082) RBF: Check each component length of destination path when add/update mount entry

2020-05-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15082: --- Attachment: HDFS-15082.004.patch > RBF: Check each component length of destination path when

[jira] [Commented] (HDFS-15082) RBF: Check each component length of destination path when add/update mount entry

2020-05-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109076#comment-17109076 ] Xiaoqiao He commented on HDFS-15082: Thanks [~ayushtkn] and [~elgoiri]. v004 try to set separate

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-18 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110422#comment-17110422 ] Xiaoqiao He commented on HDFS-13183: Thanks [~weichiu] for your helps and push this feature forward.

[jira] [Commented] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

2020-05-18 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110431#comment-17110431 ] Xiaoqiao He commented on HDFS-15202: [^HDFS-15202-Addendum-01.patch] works fine for me. +1 from my

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-18 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110450#comment-17110450 ] Xiaoqiao He commented on HDFS-13183: Thanks [~weichiu] for your reminder here. branch-3.3 compile

[jira] [Commented] (HDFS-14960) TestBalancerWithNodeGroup should not succeed with DFSNetworkTopology

2020-05-18 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110846#comment-17110846 ] Xiaoqiao He commented on HDFS-14960: [~elgoiri] IMO, it could be related to the first merge of

[jira] [Updated] (HDFS-12733) Option to disable to namenode local edits

2020-05-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-12733: --- Attachment: HDFS-12733.009.patch > Option to disable to namenode local edits >

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-13183: --- Attachment: HDFS-13183.006.patch > Standby NameNode process getBlocks request to reduce Active load

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108132#comment-17108132 ] Xiaoqiao He commented on HDFS-13183: Thanks [~weichiu] for your comments. {quote}does it work in

[jira] [Created] (HDFS-15356) Unify configuration `dfs.ha.allow.stale.reads` to DFSConfigKeys

2020-05-15 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HDFS-15356: -- Summary: Unify configuration `dfs.ha.allow.stale.reads` to DFSConfigKeys Key: HDFS-15356 URL: https://issues.apache.org/jira/browse/HDFS-15356 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15356) Unify configuration `dfs.ha.allow.stale.reads` to DFSConfigKeys

2020-05-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15356: --- Attachment: HDFS-15356.001.patch Status: Patch Available (was: Open) submit init v001 and

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063403#comment-17063403 ] Xiaoqiao He commented on HDFS-15180: Try to trigger Jenkins. > DataNode FsDatasetImpl Fine-Grained

[jira] [Updated] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15180: --- Status: Patch Available (was: Open) > DataNode FsDatasetImpl Fine-Grained Locking via BlockPool. >

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063805#comment-17063805 ] Xiaoqiao He commented on HDFS-15180: Not sure why Jenkins report not attach here. Just forward the

[jira] [Comment Edited] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063805#comment-17063805 ] Xiaoqiao He edited comment on HDFS-15180 at 3/21/20, 7:57 AM: -- Not sure why

[jira] [Updated] (HDFS-15075) Remove process command timing from BPServiceActor

2020-03-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15075: --- Attachment: HDFS-15075.005.patch > Remove process command timing from BPServiceActor >

[jira] [Commented] (HDFS-15075) Remove process command timing from BPServiceActor

2020-03-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063838#comment-17063838 ] Xiaoqiao He commented on HDFS-15075: Considering HDFS-15113 has pushed to trunk, should we continue

[jira] [Updated] (HDFS-15169) RBF: Router FSCK should consider the mount table

2020-03-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15169: --- Attachment: HDFS-15169.001.patch Assignee: Xiaoqiao He Status: Patch Available (was:

[jira] [Commented] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

2020-03-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064210#comment-17064210 ] Xiaoqiao He commented on HDFS-15051: Thanks [~ayushtkn] pick up this JIRA. {quote}If the immediate

[jira] [Commented] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

2020-03-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064211#comment-17064211 ] Xiaoqiao He commented on HDFS-15051: Thanks [~ayushtkn] pick up this JIRA. {quote}If the immediate

[jira] [Updated] (HDFS-15075) Remove process command timing from BPServiceActor

2020-03-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15075: --- Attachment: HDFS-15075.006.patch > Remove process command timing from BPServiceActor >

<    1   2   3   4   5   6   7   8   9   10   >