[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932810#comment-16932810 ] Erik Krogen commented on HDFS-14655: v6 LGTM! If you want, I think the thread counting can be

[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932729#comment-16932729 ] Erik Krogen commented on HDFS-14655: Thanks for adding a test [~ayushtkn]! I'm worried about using

[jira] [Commented] (HDFS-14569) Result of crypto -listZones is not formatted properly

[ https://issues.apache.org/jira/browse/HDFS-14569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932699#comment-16932699 ] Erik Krogen commented on HDFS-14569: I backported this small change to branch-3.2, branch-3.1, and

[jira] [Updated] (HDFS-14569) Result of crypto -listZones is not formatted properly

[ https://issues.apache.org/jira/browse/HDFS-14569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14569: --- Fix Version/s: 3.2.2 3.1.4 2.10.0 > Result of crypto

[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927910#comment-16927910 ] Erik Krogen commented on HDFS-14655: Agreed, I think we are saying the same thing. I'm +1 on v004

[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927896#comment-16927896 ] Erik Krogen commented on HDFS-14655: Hm. I believe that when you call {{cancel()}} on the

[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925848#comment-16925848 ] Erik Krogen commented on HDFS-14655: Looks better to me, thanks [~ayushtkn]! I do think we should

[jira] [Comment Edited] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925848#comment-16925848 ] Erik Krogen edited comment on HDFS-14655 at 9/9/19 3:43 PM: Looks better to

[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924650#comment-16924650 ] Erik Krogen commented on HDFS-14655: v2 looks good to me except that I don't think

[jira] [Commented] (HDFS-14412) Enable Dynamometer to use the local build of Hadoop by default

[ https://issues.apache.org/jira/browse/HDFS-14412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924490#comment-16924490 ] Erik Krogen commented on HDFS-14412: [~pingsutw] you're right, it looks like currently it's set up

[jira] [Created] (HDFS-14829) [Dynamometer] Update TestDynamometerInfra to be Hadoop 3.2+ compatible

Erik Krogen created HDFS-14829: -- Summary: [Dynamometer] Update TestDynamometerInfra to be Hadoop 3.2+ compatible Key: HDFS-14829 URL: https://issues.apache.org/jira/browse/HDFS-14829 Project: Hadoop

[jira] [Updated] (HDFS-14817) [Dynamometer] start-dynamometer-cluster.sh shows its usage even if correct arguments are given.

[ https://issues.apache.org/jira/browse/HDFS-14817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14817: --- Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch Available) >

[jira] [Commented] (HDFS-14817) [Dynamometer] start-dynamometer-cluster.sh shows its usage even if correct arguments are given.

[ https://issues.apache.org/jira/browse/HDFS-14817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924448#comment-16924448 ] Erik Krogen commented on HDFS-14817: The v3 patch LGTM, thanks [~soyamiyoshi]! I just committed this

[jira] [Updated] (HDFS-14819) [Dynamometer] Cannot parse audit logs with ‘=‘ in unexpected places when starting a workload.

[ https://issues.apache.org/jira/browse/HDFS-14819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14819: --- Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-14825) [Dynamometer] Workload doesn't start unless an absolute path of Mapper class given

[ https://issues.apache.org/jira/browse/HDFS-14825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924425#comment-16924425 ] Erik Krogen commented on HDFS-14825: Thanks for filing this [~soyamiyoshi]! I agree that the PR you

[jira] [Commented] (HDFS-14806) Bootstrap standby may fail if used in-progress tailing

[ https://issues.apache.org/jira/browse/HDFS-14806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923716#comment-16923716 ] Erik Krogen commented on HDFS-14806: Nice work!! Very elegant :) > Bootstrap standby may fail if

[jira] [Commented] (HDFS-14806) Bootstrap standby may fail if used in-progress tailing

[ https://issues.apache.org/jira/browse/HDFS-14806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923708#comment-16923708 ] Erik Krogen commented on HDFS-14806: {quote} The part I was confused was the "load all of the edits".

[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923658#comment-16923658 ] Erik Krogen commented on HDFS-14655: [~chliang] I don't think we want a fixed thread pool, something

[jira] [Comment Edited] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923651#comment-16923651 ] Erik Krogen edited comment on HDFS-14655 at 9/5/19 5:49 PM: -[~ayushtkn]

[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923651#comment-16923651 ] Erik Krogen commented on HDFS-14655: [~ayushtkn] isn't 1 thread insufficient to perform the calls in

[jira] [Issue Comment Deleted] (HDFS-14806) Bootstrap standby may fail if used in-progress tailing

[ https://issues.apache.org/jira/browse/HDFS-14806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14806: --- Comment: was deleted (was: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14817) [Dynamometer] start-dynamometer-cluster.sh shows its usage even if correct arguments are given.

[ https://issues.apache.org/jira/browse/HDFS-14817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923629#comment-16923629 ] Erik Krogen commented on HDFS-14817: Hi [~soyamiyoshi], thanks for reporting this! We actually

[jira] [Commented] (HDFS-14819) [Dynamometer] Cannot parse audit logs with ‘=‘ in unexpected places when starting a workload.

[ https://issues.apache.org/jira/browse/HDFS-14819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923621#comment-16923621 ] Erik Krogen commented on HDFS-14819: Hi [~soyamiyoshi], thanks a lot for reporting this! The change

[jira] [Commented] (HDFS-14806) Bootstrap standby may fail if used in-progress tailing

[ https://issues.apache.org/jira/browse/HDFS-14806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922841#comment-16922841 ] Erik Krogen commented on HDFS-14806: With the streaming mechanism, the bootstrapper sends one RPC (to

[jira] [Comment Edited] (HDFS-14806) Bootstrap standby may fail if used in-progress tailing

[ https://issues.apache.org/jira/browse/HDFS-14806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922707#comment-16922707 ] Erik Krogen edited comment on HDFS-14806 at 9/4/19 5:51 PM: I think what

[jira] [Updated] (HDFS-14806) Bootstrap standby may fail if used in-progress tailing

[ https://issues.apache.org/jira/browse/HDFS-14806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14806: --- Attachment: HDFS-14806.002.patch > Bootstrap standby may fail if used in-progress tailing >

[jira] [Commented] (HDFS-14806) Bootstrap standby may fail if used in-progress tailing

[ https://issues.apache.org/jira/browse/HDFS-14806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922707#comment-16922707 ] Erik Krogen commented on HDFS-14806: I think what you've shared will technically work, but isn't

[jira] [Commented] (HDFS-14276) [SBN read] Reduce tailing overhead

[ https://issues.apache.org/jira/browse/HDFS-14276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922622#comment-16922622 ] Erik Krogen commented on HDFS-14276: Hey [~ayushtkn], +1 on the branch-2 patch, thanks for taking

[jira] [Commented] (HDFS-14773) SWEBHDFS closes the connection before a client can read the error response for a DSQuotaExceededException

[ https://issues.apache.org/jira/browse/HDFS-14773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914695#comment-16914695 ] Erik Krogen commented on HDFS-14773: Great find [~simbadzina]! [~jojochuang], [~kihwal], or [~csun],

[jira] [Commented] (HDFS-13977) NameNode can kill itself if it tries to send too many txns to a QJM simultaneously

[ https://issues.apache.org/jira/browse/HDFS-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914556#comment-16914556 ] Erik Krogen commented on HDFS-13977: Great, thanks for the review! I committed this to trunk,

[jira] [Updated] (HDFS-13977) NameNode can kill itself if it tries to send too many txns to a QJM simultaneously

[ https://issues.apache.org/jira/browse/HDFS-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-13977: --- Attachment: HDFS-13977-branch-2.003.patch > NameNode can kill itself if it tries to send too many

[jira] [Updated] (HDFS-13977) NameNode can kill itself if it tries to send too many txns to a QJM simultaneously

[ https://issues.apache.org/jira/browse/HDFS-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-13977: --- Fix Version/s: 3.1.3 3.2.1 3.3.0 > NameNode can kill itself if

[jira] [Commented] (HDFS-14748) Make DataNodePeerMetrics#minOutlierDetectionSamples configurable

[ https://issues.apache.org/jira/browse/HDFS-14748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914362#comment-16914362 ] Erik Krogen commented on HDFS-14748: I don't see any reason this can't be configurable. Can you

[jira] [Commented] (HDFS-14276) [SBN read] Reduce tailing overhead

[ https://issues.apache.org/jira/browse/HDFS-14276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913535#comment-16913535 ] Erik Krogen commented on HDFS-14276: Awesome! Thanks [~ayushtkn] :) > [SBN read] Reduce tailing

[jira] [Commented] (HDFS-14760) Log INFO mode if snapshot usage and actual usage differ

[ https://issues.apache.org/jira/browse/HDFS-14760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913524#comment-16913524 ] Erik Krogen commented on HDFS-14760: Sure, makes sense to me CR! > Log INFO mode if snapshot usage

[jira] [Commented] (HDFS-14755) [Dynamometer] Hadoop-2 DataNode fail to start

[ https://issues.apache.org/jira/browse/HDFS-14755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913503#comment-16913503 ] Erik Krogen commented on HDFS-14755: +1 on the PR. I just committed this to trunk. Thanks

[jira] [Updated] (HDFS-14755) [Dynamometer] Hadoop-2 DataNode fail to start

[ https://issues.apache.org/jira/browse/HDFS-14755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14755: --- Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch Available) >

[jira] [Commented] (HDFS-14763) Fix package name of audit log class in Dynamometer document

[ https://issues.apache.org/jira/browse/HDFS-14763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913476#comment-16913476 ] Erik Krogen commented on HDFS-14763: Thanks [~tasanuma]! > Fix package name of audit log class in

[jira] [Commented] (HDFS-13977) NameNode can kill itself if it tries to send too many txns to a QJM simultaneously

[ https://issues.apache.org/jira/browse/HDFS-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913468#comment-16913468 ] Erik Krogen commented on HDFS-13977: Good catch on the "less than" [~vagarychen]! Thanks. The check

[jira] [Updated] (HDFS-13977) NameNode can kill itself if it tries to send too many txns to a QJM simultaneously

[ https://issues.apache.org/jira/browse/HDFS-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-13977: --- Attachment: HDFS-13977.003.patch > NameNode can kill itself if it tries to send too many txns to a

[jira] [Assigned] (HDFS-14276) [SBN read] Reduce tailing overhead

[ https://issues.apache.org/jira/browse/HDFS-14276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen reassigned HDFS-14276: -- Assignee: Ayush Saxena (was: Wei-Chiu Chuang) > [SBN read] Reduce tailing overhead >

[jira] [Commented] (HDFS-14276) [SBN read] Reduce tailing overhead

[ https://issues.apache.org/jira/browse/HDFS-14276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912705#comment-16912705 ] Erik Krogen commented on HDFS-14276: Thanks [~ayushtkn]! Are you interested in helping backport this

[jira] [Commented] (HDFS-14726) Fix JN incompatibility issue in branch-2 due to backport of HDFS-10519

[ https://issues.apache.org/jira/browse/HDFS-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912518#comment-16912518 ] Erik Krogen commented on HDFS-14726: That all makes sense to me. +1 from me pending Jenkins. > Fix

[jira] [Updated] (HDFS-13977) NameNode can kill itself if it tries to send too many txns to a QJM simultaneously

[ https://issues.apache.org/jira/browse/HDFS-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-13977: --- Attachment: HDFS-13977.002.patch > NameNode can kill itself if it tries to send too many txns to a

[jira] [Commented] (HDFS-13977) NameNode can kill itself if it tries to send too many txns to a QJM simultaneously

[ https://issues.apache.org/jira/browse/HDFS-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912452#comment-16912452 ] Erik Krogen commented on HDFS-13977: Makes sense to me [~shv]. Updated in v002 patch. > NameNode can

[jira] [Commented] (HDFS-14726) Fix JN incompatibility issue in branch-2 due to backport of HDFS-10519

[ https://issues.apache.org/jira/browse/HDFS-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912440#comment-16912440 ] Erik Krogen commented on HDFS-14726: Thanks [~vagarychen]! I actually looked more closely at this and

[jira] [Commented] (HDFS-14760) Log INFO mode if snapshot usage and actual usage differ

[ https://issues.apache.org/jira/browse/HDFS-14760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912393#comment-16912393 ] Erik Krogen commented on HDFS-14760: I think at least WARN level is warranted, given that this is an

[jira] [Commented] (HDFS-14755) [Dynamometer] Hadoop-2 DataNode fail to start

[ https://issues.apache.org/jira/browse/HDFS-14755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911483#comment-16911483 ] Erik Krogen commented on HDFS-14755: Interesting! That's good to know. I'll move specific review

[jira] [Commented] (HDFS-14276) [SBN read] Reduce tailing overhead

[ https://issues.apache.org/jira/browse/HDFS-14276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911469#comment-16911469 ] Erik Krogen commented on HDFS-14276: Hi [~ayushtkn], I just took a look at v01, LGTM. +1 > [SBN

[jira] [Comment Edited] (HDFS-13977) NameNode can kill itself if it tries to send too many txns to a QJM simultaneously

[ https://issues.apache.org/jira/browse/HDFS-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911452#comment-16911452 ] Erik Krogen edited comment on HDFS-13977 at 8/20/19 3:22 PM: - Thanks for

[jira] [Updated] (HDFS-13977) NameNode can kill itself if it tries to send too many txns to a QJM simultaneously

[ https://issues.apache.org/jira/browse/HDFS-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-13977: --- Attachment: HDFS-13977.001.patch > NameNode can kill itself if it tries to send too many txns to a

[jira] [Commented] (HDFS-13977) NameNode can kill itself if it tries to send too many txns to a QJM simultaneously

[ https://issues.apache.org/jira/browse/HDFS-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911452#comment-16911452 ] Erik Krogen commented on HDFS-13977: Thanks for taking a look [~shv] and [~jojochuang]! {quote} I

[jira] [Commented] (HDFS-14755) [Dynamometer] Hadoop-2 DataNode fail to start

[ https://issues.apache.org/jira/browse/HDFS-14755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911445#comment-16911445 ] Erik Krogen commented on HDFS-14755: Hi [~tasanuma], thanks for raising an issue. The version of

[jira] [Updated] (HDFS-13977) NameNode can kill itself if it tries to send too many txns to a QJM simultaneously

[ https://issues.apache.org/jira/browse/HDFS-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-13977: --- Status: Patch Available (was: In Progress) > NameNode can kill itself if it tries to send too many

[jira] [Commented] (HDFS-13977) NameNode can kill itself if it tries to send too many txns to a QJM simultaneously

[ https://issues.apache.org/jira/browse/HDFS-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909312#comment-16909312 ] Erik Krogen commented on HDFS-13977: Digging into this, I was surprised to learn that {{FSEditLog}}

[jira] [Updated] (HDFS-13977) NameNode can kill itself if it tries to send too many txns to a QJM simultaneously

[ https://issues.apache.org/jira/browse/HDFS-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-13977: --- Attachment: HDFS-13977.000.patch > NameNode can kill itself if it tries to send too many txns to a

[jira] [Work started] (HDFS-13977) NameNode can kill itself if it tries to send too many txns to a QJM simultaneously

[ https://issues.apache.org/jira/browse/HDFS-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-13977 started by Erik Krogen. -- > NameNode can kill itself if it tries to send too many txns to a QJM >

[jira] [Comment Edited] (HDFS-14667) Backport [HDFS-14403] "Cost-based FairCallQueue" to branch-2

[ https://issues.apache.org/jira/browse/HDFS-14667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907617#comment-16907617 ] Erik Krogen edited comment on HDFS-14667 at 8/14/19 8:57 PM: - Just attached

[jira] [Comment Edited] (HDFS-14403) Cost-Based RPC FairCallQueue

[ https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907612#comment-16907612 ] Erik Krogen edited comment on HDFS-14403 at 8/14/19 8:56 PM: - Just backported

[jira] [Updated] (HDFS-14667) Backport [HDFS-14403] "Cost-based FairCallQueue" to branch-2

[ https://issues.apache.org/jira/browse/HDFS-14667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14667: --- Attachment: HDFS-14403-branch-2.000.patch > Backport [HDFS-14403] "Cost-based FairCallQueue" to

[jira] [Updated] (HDFS-14667) Backport [HDFS-14403] "Cost-based FairCallQueue" to branch-2

[ https://issues.apache.org/jira/browse/HDFS-14667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14667: --- Status: Patch Available (was: In Progress) Just attached branch-2 patch. The only change was to

[jira] [Commented] (HDFS-14667) Backport [HDFS-14403] "Cost-based FairCallQueue" to branch-2

[ https://issues.apache.org/jira/browse/HDFS-14667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907611#comment-16907611 ] Erik Krogen commented on HDFS-14667: I found that the 3.x backports were very simple with only minor

[jira] [Commented] (HDFS-14403) Cost-Based RPC FairCallQueue

[ https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907612#comment-16907612 ] Erik Krogen commented on HDFS-14403: Just backported this into branch-3.2 ~ branch-3.0 as part of

[jira] [Updated] (HDFS-14403) Cost-Based RPC FairCallQueue

[ https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14403: --- Fix Version/s: 3.1.3 3.2.1 3.0.4 > Cost-Based RPC

[jira] [Work started] (HDFS-14667) Backport [HDFS-14403] "Cost-based FairCallQueue" to branch-2

[ https://issues.apache.org/jira/browse/HDFS-14667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-14667 started by Erik Krogen. -- > Backport [HDFS-14403] "Cost-based FairCallQueue" to branch-2 >

[jira] [Commented] (HDFS-14277) [SBN read] Observer benchmark results

[ https://issues.apache.org/jira/browse/HDFS-14277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907599#comment-16907599 ] Erik Krogen commented on HDFS-14277: I was hoping there would be a different config we could leverage

[jira] [Commented] (HDFS-13977) NameNode can kill itself if it tries to send too many txns to a QJM simultaneously

[ https://issues.apache.org/jira/browse/HDFS-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906551#comment-16906551 ] Erik Krogen commented on HDFS-13977: I took another look at this and HDFS-10220 seems it will

[jira] [Comment Edited] (HDFS-14090) RBF: Improved isolation for downstream name nodes.

[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906493#comment-16906493 ] Erik Krogen edited comment on HDFS-14090 at 8/13/19 6:27 PM: - [~crh] thanks

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes.

[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906493#comment-16906493 ] Erik Krogen commented on HDFS-14090: [~crh] thanks for keeping me honest here :) Finally got around

[jira] [Commented] (HDFS-14412) Enable Dynamometer to use the local build of Hadoop by default

[ https://issues.apache.org/jira/browse/HDFS-14412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906343#comment-16906343 ] Erik Krogen commented on HDFS-14412: [~pingsutw] made a good point on HDFS-14717: {quote} But it's

[jira] [Commented] (HDFS-14717) Junit not found in hadoop-dynamometer-infra

[ https://issues.apache.org/jira/browse/HDFS-14717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906337#comment-16906337 ] Erik Krogen commented on HDFS-14717: +1 from me. I took the liberty of fixing up the last checkstyle

[jira] [Updated] (HDFS-14717) Junit not found in hadoop-dynamometer-infra

[ https://issues.apache.org/jira/browse/HDFS-14717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14717: --- Attachment: HDFS-14717.003.patch > Junit not found in hadoop-dynamometer-infra >

[jira] [Updated] (HDFS-14717) Junit not found in hadoop-dynamometer-infra

[ https://issues.apache.org/jira/browse/HDFS-14717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14717: --- Resolution: Fixed Fix Version/s: 3.3.0 Status: Resolved (was: Patch Available) >

[jira] [Commented] (HDFS-14370) Edit log tailing fast-path should allow for backoff

[ https://issues.apache.org/jira/browse/HDFS-14370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906316#comment-16906316 ] Erik Krogen commented on HDFS-14370: Committed this to branch-2 now that HDFS-14204 has been

[jira] [Commented] (HDFS-14276) [SBN read] Reduce tailing overhead

[ https://issues.apache.org/jira/browse/HDFS-14276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906314#comment-16906314 ] Erik Krogen commented on HDFS-14276: [~ayushtkn] if you're still interested in this I think it's safe

[jira] [Updated] (HDFS-14370) Edit log tailing fast-path should allow for backoff

[ https://issues.apache.org/jira/browse/HDFS-14370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14370: --- Resolution: Fixed Status: Resolved (was: Patch Available) > Edit log tailing fast-path

[jira] [Updated] (HDFS-14370) Edit log tailing fast-path should allow for backoff

[ https://issues.apache.org/jira/browse/HDFS-14370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14370: --- Fix Version/s: 2.10.0 > Edit log tailing fast-path should allow for backoff >

[jira] [Commented] (HDFS-14726) Fix JN incompatibility issue in branch-2 due to backport of HDFS-10519

[ https://issues.apache.org/jira/browse/HDFS-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905633#comment-16905633 ] Erik Krogen commented on HDFS-14726: Thanks for filing this [~vagarychen]. The idea seems good to me.

[jira] [Updated] (HDFS-14726) Fix JN incompatibility issue in branch-2 due to backport of HDFS-10519

[ https://issues.apache.org/jira/browse/HDFS-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14726: --- Target Version/s: 2.10.0 > Fix JN incompatibility issue in branch-2 due to backport of HDFS-10519 >

[jira] [Commented] (HDFS-14724) Fix JDK7 compatibility in branch-2

[ https://issues.apache.org/jira/browse/HDFS-14724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905385#comment-16905385 ] Erik Krogen commented on HDFS-14724: Thanks for reporting this [~jojochuang]. [~vagarychen], we can

[jira] [Commented] (HDFS-14723) Add helper method FSNamesystem#setBlockManagerForTesting() in branch-2

[ https://issues.apache.org/jira/browse/HDFS-14723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905384#comment-16905384 ] Erik Krogen commented on HDFS-14723: +1 from me. Let's get the branch back to a good state. > Add

[jira] [Commented] (HDFS-14717) Junit not found in hadoop-dynamometer-infra

[ https://issues.apache.org/jira/browse/HDFS-14717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905298#comment-16905298 ] Erik Krogen commented on HDFS-14717: [~pingsutw], good catch! Thanks for fixing this. It looks like

[jira] [Updated] (HDFS-14034) Support getQuotaUsage API in WebHDFS

[ https://issues.apache.org/jira/browse/HDFS-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14034: --- Fix Version/s: 3.1.3 3.0.4 > Support getQuotaUsage API in WebHDFS >

[jira] [Updated] (HDFS-14034) Support getQuotaUsage API in WebHDFS

[ https://issues.apache.org/jira/browse/HDFS-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14034: --- Resolution: Fixed Status: Resolved (was: Patch Available) > Support getQuotaUsage API in

[jira] [Commented] (HDFS-14034) Support getQuotaUsage API in WebHDFS

[ https://issues.apache.org/jira/browse/HDFS-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903207#comment-16903207 ] Erik Krogen commented on HDFS-14034: I cherry-picked this to branch-3.2, branch-3.1, and branch-3.0.

[jira] [Updated] (HDFS-14034) Support getQuotaUsage API in WebHDFS

[ https://issues.apache.org/jira/browse/HDFS-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14034: --- Fix Version/s: 2.10.0 > Support getQuotaUsage API in WebHDFS >

[jira] [Updated] (HDFS-14034) Support getQuotaUsage API in WebHDFS

[ https://issues.apache.org/jira/browse/HDFS-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14034: --- Fix Version/s: 3.2.1 > Support getQuotaUsage API in WebHDFS > >

[jira] [Commented] (HDFS-12914) Block report leases cause missing blocks until next report

[ https://issues.apache.org/jira/browse/HDFS-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902478#comment-16902478 ] Erik Krogen commented on HDFS-12914: [~jojochuang] I think this is breaking

[jira] [Updated] (HDFS-14631) The DirectoryScanner doesn't fix the wrongly placed replica.

[ https://issues.apache.org/jira/browse/HDFS-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14631: --- Fix Version/s: 2.9.3 2.10.0 > The DirectoryScanner doesn't fix the wrongly placed

[jira] [Updated] (HDFS-14631) The DirectoryScanner doesn't fix the wrongly placed replica.

[ https://issues.apache.org/jira/browse/HDFS-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14631: --- Resolution: Fixed Status: Resolved (was: Patch Available) > The DirectoryScanner doesn't

[jira] [Commented] (HDFS-14631) The DirectoryScanner doesn't fix the wrongly placed replica.

[ https://issues.apache.org/jira/browse/HDFS-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902464#comment-16902464 ] Erik Krogen commented on HDFS-14631: {{TestDirectoryStructure.testScanDirectoryStructureWarn}} and

[jira] [Issue Comment Deleted] (HDFS-14370) Edit log tailing fast-path should allow for backoff

[ https://issues.apache.org/jira/browse/HDFS-14370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14370: --- Comment: was deleted (was: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-14370) Edit log tailing fast-path should allow for backoff

[ https://issues.apache.org/jira/browse/HDFS-14370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14370: --- Fix Version/s: 3.1.3 3.2.1 3.3.0 3.0.4 >

[jira] [Commented] (HDFS-14370) Edit log tailing fast-path should allow for backoff

[ https://issues.apache.org/jira/browse/HDFS-14370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902228#comment-16902228 ] Erik Krogen commented on HDFS-14370: Thanks [~ayushtkn]. Addressed this last comment in v005 and went

[jira] [Updated] (HDFS-14370) Edit log tailing fast-path should allow for backoff

[ https://issues.apache.org/jira/browse/HDFS-14370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14370: --- Attachment: HDFS-14370.005.patch > Edit log tailing fast-path should allow for backoff >

[jira] [Updated] (HDFS-14631) The DirectoryScanner doesn't fix the wrongly placed replica.

[ https://issues.apache.org/jira/browse/HDFS-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14631: --- Fix Version/s: (was: 2.9.3) > The DirectoryScanner doesn't fix the wrongly placed replica. >

[jira] [Commented] (HDFS-14662) Document the usage of the new Balancer "asService" parameter

[ https://issues.apache.org/jira/browse/HDFS-14662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902203#comment-16902203 ] Erik Krogen commented on HDFS-14662: +1 from me, sorry for the delay! Thanks [~zhangchen] > Document

[jira] [Commented] (HDFS-14631) The DirectoryScanner doesn't fix the wrongly placed replica.

[ https://issues.apache.org/jira/browse/HDFS-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901463#comment-16901463 ] Erik Krogen commented on HDFS-14631: [~LiJinglun] Do you know if this is also relevant to the 2.x

[jira] [Commented] (HDFS-14370) Edit log tailing fast-path should allow for backoff

[ https://issues.apache.org/jira/browse/HDFS-14370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901273#comment-16901273 ] Erik Krogen commented on HDFS-14370: Thanks for looking [~ayushtkn]. I've updated the documentation

[jira] [Updated] (HDFS-14370) Edit log tailing fast-path should allow for backoff

[ https://issues.apache.org/jira/browse/HDFS-14370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14370: --- Attachment: HDFS-14370.004.patch > Edit log tailing fast-path should allow for backoff >

<    1   2   3   4   5   6   7   8   9   10   >