[jira] [Updated] (HDFS-10606) TrashPolicyDefault supports time of auto clean up can configured

2019-08-17 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10606: --- Attachment: HDFS-10606.001.patch > TrashPolicyDefault supports time of auto clean up can configured

[jira] [Commented] (HDFS-14725) Backport HDFS-12914 to branch-2 (Block report leases cause missing blocks until next report)

2019-08-17 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909684#comment-16909684 ] He Xiaoqiao commented on HDFS-14725: [~jojochuang], Thanks for your reviews.

[jira] [Updated] (HDFS-14725) Backport HDFS-12914 to branch-2 (Block report leases cause missing blocks until next report)

2019-08-17 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14725: --- Attachment: HDFS-14725.branch-2.8.001.patch > Backport HDFS-12914 to branch-2 (Block report leases

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes.

2019-08-17 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909682#comment-16909682 ] He Xiaoqiao commented on HDFS-14090: Thanks [~crh] for your contributions and pings. Actually this

[jira] [Comment Edited] (HDFS-14703) NameNode Fine-Grained Locking via Metadata Partitioning

2019-08-17 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909681#comment-16909681 ] He Xiaoqiao edited comment on HDFS-14703 at 8/17/19 12:41 PM: -- Thanks [~shv]

[jira] [Commented] (HDFS-14703) NameNode Fine-Grained Locking via Metadata Partitioning

2019-08-17 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909681#comment-16909681 ] He Xiaoqiao commented on HDFS-14703: Thanks [~shv] for your POC patches. I have to state that this is

[jira] [Commented] (HDFS-14722) RBF: GetMountPointStatus should return mountTable information when getFileInfoAll throw IOException

2019-08-13 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905921#comment-16905921 ] He Xiaoqiao commented on HDFS-14722: thanks [~xuzq_zander] for your contribution and trigger the

[jira] [Updated] (HDFS-14722) RBF: GetMountPointStatus should return mountTable information when getFileInfoAll throw IOException

2019-08-13 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14722: --- Status: Patch Available (was: Open) > RBF: GetMountPointStatus should return mountTable information

[jira] [Comment Edited] (HDFS-14725) Backport HDFS-12914 to branch-2 (Block report leases cause missing blocks until next report)

2019-08-12 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905801#comment-16905801 ] He Xiaoqiao edited comment on HDFS-14725 at 8/13/19 4:20 AM: - Check failied

[jira] [Commented] (HDFS-14725) Backport HDFS-12914 to branch-2 (Block report leases cause missing blocks until next report)

2019-08-12 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905801#comment-16905801 ] He Xiaoqiao commented on HDFS-14725: Check failied unit test {{TestDecommissioningStatus}} and

[jira] [Updated] (HDFS-14725) Backport HDFS-12914 to branch-2 (Block report leases cause missing blocks until next report)

2019-08-12 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14725: --- Attachment: HDFS-14725.branch-2.003.patch > Backport HDFS-12914 to branch-2 (Block report leases

[jira] [Issue Comment Deleted] (HDFS-12914) Block report leases cause missing blocks until next report

2019-08-12 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-12914: --- Comment: was deleted (was: Thanks [~jojochuang] for your filing new JIRA, I think this JIRA should

[jira] [Updated] (HDFS-14725) Backport HDFS-12914 to branch-2 (Block report leases cause missing blocks until next report)

2019-08-12 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14725: --- Attachment: HDFS-14725.branch-2.002.patch > Backport HDFS-12914 to branch-2 (Block report leases

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-08-12 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905455#comment-16905455 ] He Xiaoqiao commented on HDFS-12914: Thanks [~jojochuang] for your filing new JIRA, I think this JIRA

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-08-12 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905454#comment-16905454 ] He Xiaoqiao commented on HDFS-12914: The status of this JIRA will set to resolved if no more objects.

[jira] [Updated] (HDFS-14725) Backport HDFS-12914 to branch-2 (Block report leases cause missing blocks until next report)

2019-08-12 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14725: --- Attachment: HDFS-14725.branch-2.001.patch Status: Patch Available (was: Open) submit the

[jira] [Comment Edited] (HDFS-14724) Fix JDK7 compatibility in branch-2

2019-08-12 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905386#comment-16905386 ] He Xiaoqiao edited comment on HDFS-14724 at 8/12/19 5:10 PM: -

[jira] [Commented] (HDFS-14724) Fix JDK7 compatibility in branch-2

2019-08-12 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905386#comment-16905386 ] He Xiaoqiao commented on HDFS-14724: [~jojochuang],[~xkrogen], just check {{HATestUtil}} which is

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-08-12 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905378#comment-16905378 ] He Xiaoqiao commented on HDFS-12914: [~jojochuang] Thanks for your continue tracking this JIRA and

[jira] [Commented] (HDFS-14723) Add helper method FSNamesystem#setBlockManagerForTesting() in branch-2

2019-08-12 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905374#comment-16905374 ] He Xiaoqiao commented on HDFS-14723: +1 (non-binding). Thanks [~jojochuang] for your tracking. > Add

[jira] [Comment Edited] (HDFS-14703) NameNode Fine-Grained Locking via Metadata Partitioning

2019-08-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901887#comment-16901887 ] He Xiaoqiao edited comment on HDFS-14703 at 8/7/19 1:04 PM: Thanks [~shv] for

[jira] [Commented] (HDFS-14703) NameNode Fine-Grained Locking via Metadata Partitioning

2019-08-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901887#comment-16901887 ] He Xiaoqiao commented on HDFS-14703: Thanks [~shv] for file this JIRA and plan to push this feature

[jira] [Commented] (HDFS-14702) Datanode.ReplicaMap memory leak

2019-08-05 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900585#comment-16900585 ] He Xiaoqiao commented on HDFS-14702: [~crh], Thanks for your feedback, just notice that HDFS-8859 try

[jira] [Updated] (HDFS-14702) Datanode.ReplicaMap memory leak

2019-08-05 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14702: --- Attachment: datanode.dump.png > Datanode.ReplicaMap memory leak > --- >

[jira] [Created] (HDFS-14702) Datanode.ReplicaMap memory leak

2019-08-05 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-14702: -- Summary: Datanode.ReplicaMap memory leak Key: HDFS-14702 URL: https://issues.apache.org/jira/browse/HDFS-14702 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

2019-08-04 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899610#comment-16899610 ] He Xiaoqiao commented on HDFS-12914: Thanks [~jojochuang] for pushing this backport branch-2, Just

[jira] [Commented] (HDFS-13700) The process of loading image can be done in a pipeline model

2019-08-04 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899605#comment-16899605 ] He Xiaoqiao commented on HDFS-13700: HDFS-14617 try to upgrade fsimage loading to pararallel, which

[jira] [Created] (HDFS-14698) Upgrade OfflineImageViewer to be compatible with new FSImage format

2019-08-04 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-14698: -- Summary: Upgrade OfflineImageViewer to be compatible with new FSImage format Key: HDFS-14698 URL: https://issues.apache.org/jira/browse/HDFS-14698 Project: Hadoop HDFS

[jira] [Commented] (HDFS-14513) FSImage which is saving should be clean while NameNode shutdown

2019-08-04 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899595#comment-16899595 ] He Xiaoqiao commented on HDFS-14513: HDFS-14697 try to backport this issue to other versions. FYI. >

[jira] [Updated] (HDFS-14697) Backport HDFS-14513 to branch-2

2019-08-04 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14697: --- Attachment: HDFS-14697.branch-2.001.patch Status: Patch Available (was: Open) upload

[jira] [Created] (HDFS-14697) Backport HDFS-14513 to branch-2

2019-08-04 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-14697: -- Summary: Backport HDFS-14513 to branch-2 Key: HDFS-14697 URL: https://issues.apache.org/jira/browse/HDFS-14697 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Comment Edited] (HDFS-14617) Improve fsimage load time by writing sub-sections to the fsimage index

2019-08-04 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899581#comment-16899581 ] He Xiaoqiao edited comment on HDFS-14617 at 8/4/19 7:54 AM: [~jojochuang]

[jira] [Commented] (HDFS-14617) Improve fsimage load time by writing sub-sections to the fsimage index

2019-08-04 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899581#comment-16899581 ] He Xiaoqiao commented on HDFS-14617: [~jojochuang] Thanks for your check, and sorry for uploading the

[jira] [Updated] (HDFS-14617) Improve fsimage load time by writing sub-sections to the fsimage index

2019-08-04 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14617: --- Attachment: flamegraph.serial.svg flamegraph.parallel.svg > Improve fsimage load

[jira] [Commented] (HDFS-14513) FSImage which is saving should be clean while NameNode shutdown

2019-08-03 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899564#comment-16899564 ] He Xiaoqiao commented on HDFS-14513: [~xkrogen] Thanks for tracing this issue, totally agree to

[jira] [Commented] (HDFS-13529) Fix default trash policy emptier trigger time correctly

2019-08-01 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16898544#comment-16898544 ] He Xiaoqiao commented on HDFS-13529: Thanks [~jojochuang] for your help and commit. > Fix default

[jira] [Commented] (HDFS-14461) RBF: Fix intermittently failing kerberos related unit test

2019-08-01 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16898543#comment-16898543 ] He Xiaoqiao commented on HDFS-14461: Thanks [~eyang] for your kind response and sorry for the late

[jira] [Commented] (HDFS-13901) INode access time is ignored because of race between open and rename

2019-08-01 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16898540#comment-16898540 ] He Xiaoqiao commented on HDFS-13901: Thanks [~LiJinglun] for your works. Just check the logic and it

[jira] [Commented] (HDFS-14680) StorageInfoDefragmenter should handle exceptions gently

2019-08-01 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16898520#comment-16898520 ] He Xiaoqiao commented on HDFS-14680: Thanks [~zhangchen] for your pings and sorry for late response

[jira] [Commented] (HDFS-14672) Backport HDFS-12703 to branch-2

2019-07-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16894758#comment-16894758 ] He Xiaoqiao commented on HDFS-14672: [^HDFS-12703.branch-2.003.patch] fix checkstyle, and the failed

[jira] [Updated] (HDFS-14672) Backport HDFS-12703 to branch-2

2019-07-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14672: --- Attachment: HDFS-12703.branch-2.003.patch > Backport HDFS-12703 to branch-2 >

[jira] [Commented] (HDFS-14461) RBF: Fix intermittently failing kerberos related unit test

2019-07-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16894757#comment-16894757 ] He Xiaoqiao commented on HDFS-14461: Hi every folks, based on Jenkins reports about

[jira] [Commented] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks

2019-07-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16894250#comment-16894250 ] He Xiaoqiao commented on HDFS-11246: [~daryn],[~ayushtkn],[~linyiqun] are you interested in helping

[jira] [Commented] (HDFS-10927) Lease Recovery: File not getting closed on HDFS when block write operation fails

2019-07-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16894247#comment-16894247 ] He Xiaoqiao commented on HDFS-10927: [~zhangchen],[~jojochuang] Thanks for your detailed comments and

[jira] [Commented] (HDFS-14672) Backport HDFS-12703 to branch-2

2019-07-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16894244#comment-16894244 ] He Xiaoqiao commented on HDFS-14672: {quote}Re-launcher Jenkins to verify patch

[jira] [Comment Edited] (HDFS-14672) Backport HDFS-12703 to branch-2

2019-07-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16894244#comment-16894244 ] He Xiaoqiao edited comment on HDFS-14672 at 7/27/19 3:41 AM: - Thanks

[jira] [Updated] (HDFS-14672) Backport HDFS-12703 to branch-2

2019-07-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14672: --- Attachment: HDFS-12703.branch-2.002.patch > Backport HDFS-12703 to branch-2 >

[jira] [Commented] (HDFS-14461) RBF: Fix intermittently failing kerberos related unit test

2019-07-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16894243#comment-16894243 ] He Xiaoqiao commented on HDFS-14461: failed unit tests are related with this patch, I will check it

[jira] [Commented] (HDFS-14632) Reduce useless #getNumLiveDataNodes call in SafeModeMonitor

2019-07-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16894242#comment-16894242 ] He Xiaoqiao commented on HDFS-14632: It is clean to cherry pick [^HDFS-14632.006.patch] to branch-3.2

[jira] [Comment Edited] (HDFS-14672) Backport HDFS-12703 to branch-2

2019-07-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893990#comment-16893990 ] He Xiaoqiao edited comment on HDFS-14672 at 7/26/19 5:21 PM: - Re-launcher

[jira] [Updated] (HDFS-14672) Backport HDFS-12703 to branch-2

2019-07-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14672: --- Status: Patch Available (was: Open) re-launcher Jenkins to verify patch

[jira] [Updated] (HDFS-14672) Backport HDFS-12703 to branch-2

2019-07-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14672: --- Status: Open (was: Patch Available) > Backport HDFS-12703 to branch-2 >

[jira] [Commented] (HDFS-14461) RBF: Fix intermittently failing kerberos related unit test

2019-07-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893727#comment-16893727 ] He Xiaoqiao commented on HDFS-14461: Thanks [~eyang] and [~crh] for reviews. {quote}I think it goes

[jira] [Updated] (HDFS-14461) RBF: Fix intermittently failing kerberos related unit test

2019-07-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14461: --- Attachment: HDFS-14461.002.patch > RBF: Fix intermittently failing kerberos related unit test >

[jira] [Commented] (HDFS-14672) Backport HDFS-12703 to branch-2

2019-07-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893717#comment-16893717 ] He Xiaoqiao commented on HDFS-14672: Ping [~xkrogen], it seems branch-2 build failed currently.

[jira] [Updated] (HDFS-14672) Backport HDFS-12703 to branch-2

2019-07-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14672: --- Attachment: HDFS-12703.branch-2.001.patch Status: Patch Available (was: Open) submit init

[jira] [Commented] (HDFS-12703) Exceptions are fatal to decommissioning monitor

2019-07-25 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893313#comment-16893313 ] He Xiaoqiao commented on HDFS-12703: OK, Thanks [~xkrogen] for checking, I just file new JIRA

[jira] [Created] (HDFS-14672) Backport HDFS-12703 to branch-2

2019-07-25 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-14672: -- Summary: Backport HDFS-12703 to branch-2 Key: HDFS-14672 URL: https://issues.apache.org/jira/browse/HDFS-14672 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-14461) RBF: Fix intermittently failing kerberos related unit test

2019-07-25 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892930#comment-16892930 ] He Xiaoqiao commented on HDFS-14461: [~elgoiri],[~eyang] would you mind take a review? it seems

[jira] [Comment Edited] (HDFS-14461) RBF: Fix intermittently failing kerberos related unit test

2019-07-25 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892591#comment-16892591 ] He Xiaoqiao edited comment on HDFS-14461 at 7/25/19 4:30 PM: - Thanks [~eyang]

[jira] [Updated] (HDFS-14461) RBF: Fix intermittently failing kerberos related unit test

2019-07-25 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14461: --- Status: Patch Available (was: Open) > RBF: Fix intermittently failing kerberos related unit test >

[jira] [Commented] (HDFS-14657) Refine NameSystem lock usage during processing FBR

2019-07-25 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892889#comment-16892889 ] He Xiaoqiao commented on HDFS-14657: [~jojochuang] IIUC, they are different issues, this JIRA try to

[jira] [Comment Edited] (HDFS-14461) RBF: Fix intermittently failing kerberos related unit test

2019-07-25 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892591#comment-16892591 ] He Xiaoqiao edited comment on HDFS-14461 at 7/25/19 9:53 AM: - Thanks [~eyang]

[jira] [Comment Edited] (HDFS-14461) RBF: Fix intermittently failing kerberos related unit test

2019-07-25 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892591#comment-16892591 ] He Xiaoqiao edited comment on HDFS-14461 at 7/25/19 9:45 AM: - Thanks [~eyang]

[jira] [Commented] (HDFS-14461) RBF: Fix intermittently failing kerberos related unit test

2019-07-25 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892600#comment-16892600 ] He Xiaoqiao commented on HDFS-14461: BTW, I notice that community try to transfer PR review from JIRA

[jira] [Commented] (HDFS-14461) RBF: Fix intermittently failing kerberos related unit test

2019-07-25 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892591#comment-16892591 ] He Xiaoqiao commented on HDFS-14461: Thanks [~eyang] for your help, after dig the logic, and there

[jira] [Updated] (HDFS-14461) RBF: Fix intermittently failing kerberos related unit test

2019-07-25 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14461: --- Attachment: HDFS-14461.001.patch > RBF: Fix intermittently failing kerberos related unit test >

[jira] [Comment Edited] (HDFS-14090) RBF: Improved isolation for downstream name nodes.

2019-07-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891583#comment-16891583 ] He Xiaoqiao edited comment on HDFS-14090 at 7/24/19 4:00 AM: - Thanks [~crh]

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes.

2019-07-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891583#comment-16891583 ] He Xiaoqiao commented on HDFS-14090: Thanks [~crh] for your contribution, [^HDFS-14090.006.patch]

[jira] [Commented] (HDFS-12820) Decommissioned datanode is counted in service cause datanode allcating failure

2019-07-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890873#comment-16890873 ] He Xiaoqiao commented on HDFS-12820: It does not matter, I will close this issue. Thanks [~zhangchen]

[jira] [Resolved] (HDFS-12820) Decommissioned datanode is counted in service cause datanode allcating failure

2019-07-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao resolved HDFS-12820. Resolution: Not A Problem > Decommissioned datanode is counted in service cause datanode allcating

[jira] [Comment Edited] (HDFS-12820) Decommissioned datanode is counted in service cause datanode allcating failure

2019-07-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890858#comment-16890858 ] He Xiaoqiao edited comment on HDFS-12820 at 7/23/19 10:16 AM: -- [~zhangchen]

[jira] [Commented] (HDFS-12820) Decommissioned datanode is counted in service cause datanode allcating failure

2019-07-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890858#comment-16890858 ] He Xiaoqiao commented on HDFS-12820: [~zhangchen] IIUC, {{nodeInService}} and other attributes should

[jira] [Commented] (HDFS-14461) RBF: Fix intermittently failing kerberos related unit test

2019-07-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890851#comment-16890851 ] He Xiaoqiao commented on HDFS-14461: [~eyang], just check the failed unit test

[jira] [Commented] (HDFS-14617) Improve fsimage load time by writing sub-sections to the fsimage index

2019-07-19 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888967#comment-16888967 ] He Xiaoqiao commented on HDFS-14617: Apply this patch to branch-2.7.1, and get a good speed up, I

[jira] [Updated] (HDFS-14617) Improve fsimage load time by writing sub-sections to the fsimage index

2019-07-19 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14617: --- Attachment: SerialLoading.svg ParallelLoading.svg > Improve fsimage load time by

[jira] [Commented] (HDFS-14208) A large number missingblocks happend after failover to active.

2019-07-19 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888725#comment-16888725 ] He Xiaoqiao commented on HDFS-14208: [~xuzq_zander] Would you like to check if HDFS-12914 could help

[jira] [Comment Edited] (HDFS-14657) Refine NameSystem lock usage during processing FBR

2019-07-19 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888568#comment-16888568 ] He Xiaoqiao edited comment on HDFS-14657 at 7/19/19 6:27 AM: - Thanks

[jira] [Commented] (HDFS-14657) Refine NameSystem lock usage during processing FBR

2019-07-19 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888568#comment-16888568 ] He Xiaoqiao commented on HDFS-14657: Thanks [~zhangchen] for filing this JIAR, it is very interesting

[jira] [Comment Edited] (HDFS-14576) Avoid block report retry and slow down namenode startup

2019-07-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888159#comment-16888159 ] He Xiaoqiao edited comment on HDFS-14576 at 7/19/19 4:33 AM: - Thanks

[jira] [Commented] (HDFS-10927) Lease Recovery: File not getting closed on HDFS when block write operation fails

2019-07-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888514#comment-16888514 ] He Xiaoqiao commented on HDFS-10927: Thanks [~jojochuang] for your comments. I try to dig the logic

[jira] [Commented] (HDFS-14461) RBF: Fix intermittently failing kerberos related unit test

2019-07-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888492#comment-16888492 ] He Xiaoqiao commented on HDFS-14461: Thanks [~eyang],[~fengnanli], I will try to fix this issue next

[jira] [Commented] (HDFS-13693) Remove unnecessary search in INodeDirectory.addChild during image loading

2019-07-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888488#comment-16888488 ] He Xiaoqiao commented on HDFS-13693: Thanks [~leosun08] for your contribution.

[jira] [Commented] (HDFS-10927) Lease Recovery: File not getting closed on HDFS when block write operation fails

2019-07-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888162#comment-16888162 ] He Xiaoqiao commented on HDFS-10927: Thanks [~xkrogen] for your quick response. I believe HDFS-11472

[jira] [Commented] (HDFS-14576) Avoid block report retry and slow down namenode startup

2019-07-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888159#comment-16888159 ] He Xiaoqiao commented on HDFS-14576: Thanks [~zhangchen] for your furthermore discussion. I agree

[jira] [Commented] (HDFS-10927) Lease Recovery: File not getting closed on HDFS when block write operation fails

2019-07-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888143#comment-16888143 ] He Xiaoqiao commented on HDFS-10927: [~zhangchen],[~ngoswami], Please help to check HDFS-11472, it

[jira] [Commented] (HDFS-10927) Lease Recovery: File not getting closed on HDFS when block write operation fails

2019-07-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888051#comment-16888051 ] He Xiaoqiao commented on HDFS-10927: OK, it does not matter, I think we should correct

[jira] [Commented] (HDFS-10927) Lease Recovery: File not getting closed on HDFS when block write operation fails

2019-07-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887740#comment-16887740 ] He Xiaoqiao commented on HDFS-10927: Thanks for your reporting, this is interesting issue. It is

[jira] [Commented] (HDFS-14576) Avoid block report retry and slow down namenode startup

2019-07-17 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887652#comment-16887652 ] He Xiaoqiao commented on HDFS-14576: [~zhangchen], Thanks for your involve in. I have optimized for

[jira] [Commented] (HDFS-14631) The DirectoryScanner doesn't fix the wrongly placed replica.

2019-07-17 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887634#comment-16887634 ] He Xiaoqiao commented on HDFS-14631: [~LiJinglun], [^HDFS-14631.002.patch] looks almost good to me.

[jira] [Commented] (HDFS-14461) RBF: Fix intermittently failing kerberos related unit test

2019-07-17 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887625#comment-16887625 ] He Xiaoqiao commented on HDFS-14461: [~eyang], Thanks for your detailed comments and help. I would

[jira] [Commented] (HDFS-14461) RBF: Fix intermittently failing kerberos related unit test

2019-07-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16886683#comment-16886683 ] He Xiaoqiao commented on HDFS-14461: This failed unit test could be related with changes of

[jira] [Commented] (HDFS-14576) Avoid block report retry and slow down namenode startup

2019-07-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16886681#comment-16886681 ] He Xiaoqiao commented on HDFS-14576: Thanks [~zhangchen] for your detailed comment, As you said

[jira] [Commented] (HDFS-14318) dn cannot be recognized and must be restarted to recognize the Repaired disk

2019-07-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16886163#comment-16886163 ] He Xiaoqiao commented on HDFS-14318: [~ayushtkn] Please help to assign this JIRA to [~hunhun] since I

[jira] [Commented] (HDFS-14318) dn cannot be recognized and must be restarted to recognize the Repaired disk

2019-07-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16886158#comment-16886158 ] He Xiaoqiao commented on HDFS-14318: [~hunhun], Thanks for your report and patch, give some review

[jira] [Commented] (HDFS-13693) Remove unnecessary search in INodeDirectory.addChild during image loading

2019-07-15 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884962#comment-16884962 ] He Xiaoqiao commented on HDFS-13693: Thanks [~leosun08] for your comments. I believe we both talks

[jira] [Commented] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks

2019-07-15 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884936#comment-16884936 ] He Xiaoqiao commented on HDFS-11246: [~daryn],[~ayushtkn] pending some furthermore comments and

[jira] [Assigned] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks

2019-07-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao reassigned HDFS-11246: -- Assignee: He Xiaoqiao (was: Kuhu Shukla) > FSNameSystem#logAuditEvent should be called

[jira] [Commented] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks

2019-07-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884848#comment-16884848 ] He Xiaoqiao commented on HDFS-11246: Hi, [~kshukla] I just assign this issue to myself. Please feel

[jira] [Commented] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks

2019-07-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884847#comment-16884847 ] He Xiaoqiao commented on HDFS-11246: submit new patch [^HDFS-11246.009.patch] and fix failure unit

<    1   2   3   4   5   6   7   8   9   >