[GitHub] [hadoop] hadoop-yetus commented on pull request #5476: YARN-11446. [Federation] Add updateSchedulerConfiguration, getSchedulerConfiguration REST APIs for Router.

2023-03-17 Thread via GitHub
hadoop-yetus commented on PR #5476: URL: https://github.com/apache/hadoop/pull/5476#issuecomment-1474733985 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18669) Remove Log4Json Layout

2023-03-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702064#comment-17702064 ] ASF GitHub Bot commented on HADOOP-18669: - virajjasani commented on PR #5493: URL:

[jira] [Commented] (HADOOP-18669) Remove Log4Json Layout

2023-03-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702063#comment-17702063 ] ASF GitHub Bot commented on HADOOP-18669: - virajjasani opened a new pull request, #5493: URL:

[jira] [Updated] (HADOOP-18669) Remove Log4Json Layout

2023-03-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18669: Labels: pull-request-available (was: ) > Remove Log4Json Layout >

[GitHub] [hadoop] virajjasani commented on pull request #5493: HADOOP-18669. Remove Log4Json Layout

2023-03-17 Thread via GitHub
virajjasani commented on PR #5493: URL: https://github.com/apache/hadoop/pull/5493#issuecomment-1474732127 @jojochuang could you please review this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] virajjasani opened a new pull request, #5493: HADOOP-18669. Remove Log4Json Layout

2023-03-17 Thread via GitHub
virajjasani opened a new pull request, #5493: URL: https://github.com/apache/hadoop/pull/5493 Log4Json extends org.apache.log4j.Layout to provide log layout for Json. This utility is not being used anywhere in Hadoop. It is IA.Private (by default). Log4j2 has introduced drastic

[jira] [Created] (HADOOP-18669) Remove Log4Json Layout

2023-03-17 Thread Viraj Jasani (Jira)
Viraj Jasani created HADOOP-18669: - Summary: Remove Log4Json Layout Key: HADOOP-18669 URL: https://issues.apache.org/jira/browse/HADOOP-18669 Project: Hadoop Common Issue Type: Sub-task

[GitHub] [hadoop] hadoop-yetus commented on pull request #5420: YARN-11442. Refactor FederationInterceptorREST Code.

2023-03-17 Thread via GitHub
hadoop-yetus commented on PR #5420: URL: https://github.com/apache/hadoop/pull/5420#issuecomment-1474663753 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5476: YARN-11446. [Federation] Add updateSchedulerConfiguration, getSchedulerConfiguration REST APIs for Router.

2023-03-17 Thread via GitHub
hadoop-yetus commented on PR #5476: URL: https://github.com/apache/hadoop/pull/5476#issuecomment-1474626963 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5486: HDFS-16949 Introduce inverse quantiles for metrics where higher numer…

2023-03-17 Thread via GitHub
hadoop-yetus commented on PR #5486: URL: https://github.com/apache/hadoop/pull/5486#issuecomment-1474623885 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5486: HDFS-16949 Introduce inverse quantiles for metrics where higher numer…

2023-03-17 Thread via GitHub
hadoop-yetus commented on PR #5486: URL: https://github.com/apache/hadoop/pull/5486#issuecomment-1474611041 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5486: HDFS-16949 Introduce inverse quantiles for metrics where higher numer…

2023-03-17 Thread via GitHub
hadoop-yetus commented on PR #5486: URL: https://github.com/apache/hadoop/pull/5486#issuecomment-1474591321 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Updated] (HADOOP-18668) Path capability probe for truncate is only honored by RawLocalFileSystem

2023-03-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18668: Labels: pull-request-available (was: ) > Path capability probe for truncate is only

[jira] [Commented] (HADOOP-18668) Path capability probe for truncate is only honored by RawLocalFileSystem

2023-03-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702030#comment-17702030 ] ASF GitHub Bot commented on HADOOP-18668: - virajjasani opened a new pull request, #5492: URL:

[GitHub] [hadoop] virajjasani opened a new pull request, #5492: HADOOP-18668. Path capability probe for truncate is only honored by RawLocalFileSystem

2023-03-17 Thread via GitHub
virajjasani opened a new pull request, #5492: URL: https://github.com/apache/hadoop/pull/5492 FileSystem#hasPathCapability returns true for probing "fs.capability.paths.truncate" only by RawLocalFileSystem. It should be honored by all file system implementations that support truncate.

[jira] [Commented] (HADOOP-18207) Introduce a hadoop-logging module

2023-03-17 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702028#comment-17702028 ] Viraj Jasani commented on HADOOP-18207: --- Basically the idea is to put all the code that ever

[GitHub] [hadoop] hadoop-yetus commented on pull request #5486: HDFS-16949 Introduce inverse quantiles for metrics where higher numer…

2023-03-17 Thread via GitHub
hadoop-yetus commented on PR #5486: URL: https://github.com/apache/hadoop/pull/5486#issuecomment-1474533849 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] slfan1989 commented on pull request #5472: YARN-11445. [Federation] Add getClusterInfo, getClusterUserInfo REST APIs for Router.

2023-03-17 Thread via GitHub
slfan1989 commented on PR #5472: URL: https://github.com/apache/hadoop/pull/5472#issuecomment-1474526013 @goiri Thank you very much for your help in reviewing the code! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Resolved] (HADOOP-18631) Migrate Async appenders to log4j properties

2023-03-17 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani resolved HADOOP-18631. --- Resolution: Fixed > Migrate Async appenders to log4j properties >

[jira] [Reopened] (HADOOP-18631) Migrate Async appenders to log4j properties

2023-03-17 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani reopened HADOOP-18631: --- > Migrate Async appenders to log4j properties > --- >

[jira] [Commented] (HADOOP-18631) Migrate Async appenders to log4j properties

2023-03-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702019#comment-17702019 ] ASF GitHub Bot commented on HADOOP-18631: - jojochuang merged PR #5451: URL:

[jira] [Commented] (HADOOP-18631) Migrate Async appenders to log4j properties

2023-03-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702018#comment-17702018 ] ASF GitHub Bot commented on HADOOP-18631: - jojochuang commented on PR #5451: URL:

[GitHub] [hadoop] jojochuang merged pull request #5451: HADOOP-18631 (ADDENDUM) Use LogCapturer to match audit log pattern and remove hdfs async audit log configs

2023-03-17 Thread via GitHub
jojochuang merged PR #5451: URL: https://github.com/apache/hadoop/pull/5451 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] jojochuang commented on pull request #5451: HADOOP-18631 (ADDENDUM) Use LogCapturer to match audit log pattern and remove hdfs async audit log configs

2023-03-17 Thread via GitHub
jojochuang commented on PR #5451: URL: https://github.com/apache/hadoop/pull/5451#issuecomment-1474472672 Thanks Ayush I'll merge it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Commented] (HADOOP-18207) Introduce a hadoop-logging module

2023-03-17 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702017#comment-17702017 ] Wei-Chiu Chuang commented on HADOOP-18207: -- Don't understand this. Isn't this what slf4j is

[GitHub] [hadoop] virajjasani commented on pull request #5464: HDFS-16944 Add audit log for RouterAdminServer to save privileged operation log seperately.

2023-03-17 Thread via GitHub
virajjasani commented on PR #5464: URL: https://github.com/apache/hadoop/pull/5464#issuecomment-1474436169 Wow, quite a history behind ACE, thanks a lot for summarizing everything here :) I was wondering in the past also as to why is it that hdfs audit logs only care for auth

[GitHub] [hadoop] ayushtkn commented on pull request #5487: HDFS-16957. RBF: Exit status of dfsrouteradmin -rm should be non-zero for unsuccessful attempt

2023-03-17 Thread via GitHub
ayushtkn commented on PR #5487: URL: https://github.com/apache/hadoop/pull/5487#issuecomment-1474388737 Hmm, that changed something wrapped with the bug. There failure was claimed as successful or something like that…. But this behaviour including that also is there since branch-3.1,

[GitHub] [hadoop] virajjasani commented on pull request #5487: HDFS-16957. RBF: Exit status of dfsrouteradmin -rm should be non-zero for unsuccessful attempt

2023-03-17 Thread via GitHub
virajjasani commented on PR #5487: URL: https://github.com/apache/hadoop/pull/5487#issuecomment-1474378808 Looks like this is the commit that has changed behavior for `-add` and `-update` https://github.com/apache/hadoop/commit/9315db5f5da09c2ef86be168465c16932afa2d85 (even though

[GitHub] [hadoop] virajjasani commented on pull request #5487: HDFS-16957. RBF: Exit status of dfsrouteradmin -rm should be non-zero for unsuccessful attempt

2023-03-17 Thread via GitHub
virajjasani commented on PR #5487: URL: https://github.com/apache/hadoop/pull/5487#issuecomment-1474376435 > > Do we have this exit code output being 0 in 3.3.X? > > If it hasn't been released it is fine but I suspect it has. > > It is there since very starting, even in branch-2.9

[GitHub] [hadoop] ayushtkn commented on pull request #5464: HDFS-16944 Add audit log for RouterAdminServer to save privileged operation log seperately.

2023-03-17 Thread via GitHub
ayushtkn commented on PR #5464: URL: https://github.com/apache/hadoop/pull/5464#issuecomment-1474357461 The only policy around Audit logs that I am aware of, they shouldn't change and the parsers should be able to parse them, So, if we make the format similar to that of the HDFS ones, that

[GitHub] [hadoop] rdingankar commented on a diff in pull request #5486: HDFS-16949 Introduce inverse quantiles for metrics where higher numer…

2023-03-17 Thread via GitHub
rdingankar commented on code in PR #5486: URL: https://github.com/apache/hadoop/pull/5486#discussion_r1140658864 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/util/InverseQuantiles.java: ## @@ -0,0 +1,44 @@ +package

[GitHub] [hadoop] ayushtkn commented on pull request #5487: HDFS-16957. RBF: Exit status of dfsrouteradmin -rm should be non-zero for unsuccessful attempt

2023-03-17 Thread via GitHub
ayushtkn commented on PR #5487: URL: https://github.com/apache/hadoop/pull/5487#issuecomment-1474345648 > Do we have this exit code output being 0 in 3.3.X? If it hasn't been released it is fine but I suspect it has. It is there since very starting, even in branch-2.9

[GitHub] [hadoop] goiri merged pull request #5472: YARN-11445. [Federation] Add getClusterInfo, getClusterUserInfo REST APIs for Router.

2023-03-17 Thread via GitHub
goiri merged PR #5472: URL: https://github.com/apache/hadoop/pull/5472 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] goiri commented on pull request #5487: HDFS-16957. RBF: Exit status of dfsrouteradmin -rm should be non-zero for unsuccessful attempt

2023-03-17 Thread via GitHub
goiri commented on PR #5487: URL: https://github.com/apache/hadoop/pull/5487#issuecomment-1474278496 I have to say that I'm even willing to break our own "compatibility" given that we are breaking compatibility with the rest of the world that assumes that a failed command should be -1.

[GitHub] [hadoop] goiri commented on pull request #5487: HDFS-16957. RBF: Exit status of dfsrouteradmin -rm should be non-zero for unsuccessful attempt

2023-03-17 Thread via GitHub
goiri commented on PR #5487: URL: https://github.com/apache/hadoop/pull/5487#issuecomment-1474277019 Do we have this exit code output being 0 in 3.3.X? If it hasn't been released it is fine but I suspect it has. -- This is an automated message from the Apache Git Service. To respond to

[jira] [Commented] (HADOOP-18668) Path capability probe for truncate is only honored by RawLocalFileSystem

2023-03-17 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17701929#comment-17701929 ] Viraj Jasani commented on HADOOP-18668: --- Thanks Steve! All filesystems that supports truncate:

[jira] [Updated] (HADOOP-18668) Path capability probe for truncate is only honored by RawLocalFileSystem

2023-03-17 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani updated HADOOP-18668: -- Component/s: fs httpfs viewfs > Path capability probe for

[jira] [Updated] (HADOOP-18668) Path capability probe for truncate is only honored by RawLocalFileSystem

2023-03-17 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani updated HADOOP-18668: -- Affects Version/s: 3.3.4 > Path capability probe for truncate is only honored by

[GitHub] [hadoop] rdingankar commented on a diff in pull request #5486: HDFS-16949 Introduce inverse quantiles for metrics where higher numer…

2023-03-17 Thread via GitHub
rdingankar commented on code in PR #5486: URL: https://github.com/apache/hadoop/pull/5486#discussion_r1139490394 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/util/SampleQuantiles.java: ## @@ -243,7 +245,12 @@ synchronized public Map snapshot()

[GitHub] [hadoop] rdingankar commented on a diff in pull request #5486: HDFS-16949 Introduce inverse quantiles for metrics where higher numer…

2023-03-17 Thread via GitHub
rdingankar commented on code in PR #5486: URL: https://github.com/apache/hadoop/pull/5486#discussion_r1140539922 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/lib/MutableQuantiles.java: ## @@ -104,8 +105,7 @@ public MutableQuantiles(String

[GitHub] [hadoop] virajjasani commented on pull request #5464: HDFS-16944 Add audit log for RouterAdminServer to save privileged operation log seperately.

2023-03-17 Thread via GitHub
virajjasani commented on PR #5464: URL: https://github.com/apache/hadoop/pull/5464#issuecomment-1474195335 While hdfs audit logs report whether the given operation had successful authorization (i.e. whether `AccessControlException` was thrown), but perhaps RMAuditLogger seems to have

[GitHub] [hadoop] virajjasani commented on pull request #5464: HDFS-16944 Add audit log for RouterAdminServer to save privileged operation log seperately.

2023-03-17 Thread via GitHub
virajjasani commented on PR #5464: URL: https://github.com/apache/hadoop/pull/5464#issuecomment-1474184981 Agree to the above suggestion of having a new audit logger class and use it for all operations. Also Ayush, do you think we should rather have audit logs that indicate the

[GitHub] [hadoop] mkuchenbecker commented on a diff in pull request #5486: HDFS-16949 Introduce inverse quantiles for metrics where higher numer…

2023-03-17 Thread via GitHub
mkuchenbecker commented on code in PR #5486: URL: https://github.com/apache/hadoop/pull/5486#discussion_r1140468345 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/lib/MutableQuantiles.java: ## @@ -104,8 +105,7 @@ public MutableQuantiles(String

[GitHub] [hadoop] rdingankar commented on a diff in pull request #5486: HDFS-16949 Introduce inverse quantiles for metrics where higher numer…

2023-03-17 Thread via GitHub
rdingankar commented on code in PR #5486: URL: https://github.com/apache/hadoop/pull/5486#discussion_r1140468047 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/util/InverseQuantiles.java: ## @@ -0,0 +1,44 @@ +package

[GitHub] [hadoop] hadoop-yetus commented on pull request #5491: HDFS-16951. Add description of GETSERVERDEFAULTS to WebHDFS doc

2023-03-17 Thread via GitHub
hadoop-yetus commented on PR #5491: URL: https://github.com/apache/hadoop/pull/5491#issuecomment-1474074242 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18666) A whitelist of endpoints to skip Kerberos authentication doesn't work for ResourceManager and Job History Server

2023-03-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17701870#comment-17701870 ] ASF GitHub Bot commented on HADOOP-18666: - eubnara commented on PR #5480: URL:

[GitHub] [hadoop] eubnara commented on pull request #5480: HADOOP-18666. A whitelist of endpoints to skip Kerberos authentication doesn't work for ResourceManager and Job History Server

2023-03-17 Thread via GitHub
eubnara commented on PR #5480: URL: https://github.com/apache/hadoop/pull/5480#issuecomment-1474057002 I think this build failure is caused by downloading Node.js. It may not be related to this PR.

[GitHub] [hadoop] hadoop-yetus commented on pull request #5489: HDFS-16958. EC: Fix bug in processing EC excess redundancy.

2023-03-17 Thread via GitHub
hadoop-yetus commented on PR #5489: URL: https://github.com/apache/hadoop/pull/5489#issuecomment-1473994145 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-17844) Upgrade JSON smart to 2.4.7

2023-03-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17701778#comment-17701778 ] ASF GitHub Bot commented on HADOOP-17844: - steveloughran commented on PR #3299: URL:

[GitHub] [hadoop] steveloughran commented on pull request #3299: HADOOP-17844. Upgrade JSON smart to 2.4.7

2023-03-17 Thread via GitHub
steveloughran commented on PR #3299: URL: https://github.com/apache/hadoop/pull/3299#issuecomment-1473898361 this is 3.3.5; looks like nimbus-jose has it; the client jar simply includes that ``` version=2.4.7 ./share/hadoop/common/lib/json-smart-2.4.7.jar version=1.3.2

[GitHub] [hadoop] hadoop-yetus commented on pull request #5490: YARN-11447 A bug occurs during the active/standby switchover of RM, c…

2023-03-17 Thread via GitHub
hadoop-yetus commented on PR #5490: URL: https://github.com/apache/hadoop/pull/5490#issuecomment-1473855097 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18578) Bump netty to the latest 4.1.86

2023-03-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17701732#comment-17701732 ] ASF GitHub Bot commented on HADOOP-18578: - steveloughran closed pull request #5229:

[jira] [Commented] (HADOOP-18578) Bump netty to the latest 4.1.86

2023-03-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17701731#comment-17701731 ] ASF GitHub Bot commented on HADOOP-18578: - steveloughran commented on PR #5229: URL:

[GitHub] [hadoop] steveloughran closed pull request #5229: HADOOP-18578. Bump netty to the latest 4.1.86

2023-03-17 Thread via GitHub
steveloughran closed pull request #5229: HADOOP-18578. Bump netty to the latest 4.1.86 URL: https://github.com/apache/hadoop/pull/5229 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hadoop] steveloughran commented on pull request #5229: HADOOP-18578. Bump netty to the latest 4.1.86

2023-03-17 Thread via GitHub
steveloughran commented on PR #5229: URL: https://github.com/apache/hadoop/pull/5229#issuecomment-1473838489 @degant it won't be in the release about to ship (3.3.5) because if we kept having to abort an RC to deal with a transient CVE we would never be able to ship anything. And doing

[jira] [Resolved] (HADOOP-18578) Bump netty to the latest 4.1.86

2023-03-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18578. - Fix Version/s: 3.4.0 Resolution: Duplicate > Bump netty to the latest 4.1.86 >

[GitHub] [hadoop] hadoop-yetus commented on pull request #5491: HDFS-16951. Add description of GETSERVERDEFAULTS to WebHDFS doc

2023-03-17 Thread via GitHub
hadoop-yetus commented on PR #5491: URL: https://github.com/apache/hadoop/pull/5491#issuecomment-1473815684 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] ayushtkn commented on a diff in pull request #5483: HDFS-16954. RBF: rename a dir that has multiple destinations to a dir that just…

2023-03-17 Thread via GitHub
ayushtkn commented on code in PR #5483: URL: https://github.com/apache/hadoop/pull/5483#discussion_r1140203626 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/RouterClientProtocol.java: ## @@ -641,6 +646,11 @@ public void

[GitHub] [hadoop] zhangshuyan0 closed pull request #5489: HDFS-16958. EC: Fix bug in processing EC excess redundancy.

2023-03-17 Thread via GitHub
zhangshuyan0 closed pull request #5489: HDFS-16958. EC: Fix bug in processing EC excess redundancy. URL: https://github.com/apache/hadoop/pull/5489 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Commented] (HADOOP-18666) A whitelist of endpoints to skip Kerberos authentication doesn't work for ResourceManager and Job History Server

2023-03-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17701689#comment-17701689 ] ASF GitHub Bot commented on HADOOP-18666: - hadoop-yetus commented on PR #5480: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5480: HADOOP-18666. A whitelist of endpoints to skip Kerberos authentication doesn't work for ResourceManager and Job History Server

2023-03-17 Thread via GitHub
hadoop-yetus commented on PR #5480: URL: https://github.com/apache/hadoop/pull/5480#issuecomment-1473757077 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18668) Path capability probe for truncate is only honored by RawLocalFileSystem

2023-03-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17701677#comment-17701677 ] Steve Loughran commented on HADOOP-18668: - can you mark versions; component as "fs" + all

[GitHub] [hadoop] zhtttylz opened a new pull request, #5491: HDFS-16951. Add description of GETSERVERDEFAULTS to WebHDFS doc

2023-03-17 Thread via GitHub
zhtttylz opened a new pull request, #5491: URL: https://github.com/apache/hadoop/pull/5491 JIRA:HDFS-16951. Add description of GETSERVERDEFAULTS to WebHDFS doc -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Commented] (HADOOP-18655) Upgrade Kerby to 2.0.3 due to CVE-2023-25613

2023-03-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17701656#comment-17701656 ] ASF GitHub Bot commented on HADOOP-18655: - steveloughran commented on PR #5484: URL:

[GitHub] [hadoop] steveloughran commented on pull request #5484: HADOOP-18655. Upgrade Kerby to 2.0.3

2023-03-17 Thread via GitHub
steveloughran commented on PR #5484: URL: https://github.com/apache/hadoop/pull/5484#issuecomment-1473658777 not resolving without a solr update first. either we abandon this patch *or* whatever solr update went in is backported. That's more intimate with YARN and so they'll need to get

[GitHub] [hadoop] zhangxiping1 opened a new pull request, #5490: YARN-11447 A bug occurs during the active/standby switchover of RM, c…

2023-03-17 Thread via GitHub
zhangxiping1 opened a new pull request, #5490: URL: https://github.com/apache/hadoop/pull/5490 A bug occurs during the active/standby switchover of RM, causing RM to work abnormally -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [hadoop] zhangshuyan0 opened a new pull request, #5489: HDFS-16958. Fix bug in processing EC excess redundancy.

2023-03-17 Thread via GitHub
zhangshuyan0 opened a new pull request, #5489: URL: https://github.com/apache/hadoop/pull/5489 ### Description of PR When processing excess redundancy, the number of internal blocks is computed by traversing `nonExcess`. This way is not accurate, because `nonExcess` excludes replicas in

[jira] [Commented] (HADOOP-18666) A whitelist of endpoints to skip Kerberos authentication doesn't work for ResourceManager and Job History Server

2023-03-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17701589#comment-17701589 ] ASF GitHub Bot commented on HADOOP-18666: - eubnara commented on PR #5480: URL:

[jira] [Commented] (HADOOP-18012) ABFS: Enable config controlled ETag check for Rename idempotency

2023-03-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17701590#comment-17701590 ] ASF GitHub Bot commented on HADOOP-18012: - hadoop-yetus commented on PR #5488: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5488: HADOOP-18012. ABFS: Using Source Path eTags for Rename Idemptonency checks

2023-03-17 Thread via GitHub
hadoop-yetus commented on PR #5488: URL: https://github.com/apache/hadoop/pull/5488#issuecomment-1473450418 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] eubnara commented on pull request #5480: HADOOP-18666. A whitelist of endpoints to skip Kerberos authentication doesn't work for ResourceManager and Job History Server

2023-03-17 Thread via GitHub
eubnara commented on PR #5480: URL: https://github.com/apache/hadoop/pull/5480#issuecomment-1473449511 If I commented out following lines, the unit test fails. ![image](https://user-images.githubusercontent.com/12639125/225859396-5b884f6d-2efd-43e1-bf43-faa6fd581797.png)

[jira] [Commented] (HADOOP-18666) A whitelist of endpoints to skip Kerberos authentication doesn't work for ResourceManager and Job History Server

2023-03-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17701586#comment-17701586 ] ASF GitHub Bot commented on HADOOP-18666: - eubnara commented on PR #5480: URL:

[GitHub] [hadoop] eubnara commented on pull request #5480: HADOOP-18666. A whitelist of endpoints to skip Kerberos authentication doesn't work for ResourceManager and Job History Server

2023-03-17 Thread via GitHub
eubnara commented on PR #5480: URL: https://github.com/apache/hadoop/pull/5480#issuecomment-1473445635 @tasanuma I added an unit test. Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] hadoop-yetus commented on pull request #5486: HDFS-16949 Introduce inverse quantiles for metrics where higher numer…

2023-03-17 Thread via GitHub
hadoop-yetus commented on PR #5486: URL: https://github.com/apache/hadoop/pull/5486#issuecomment-1473408629 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5486: HDFS-16949 Introduce inverse quantiles for metrics where higher numer…

2023-03-17 Thread via GitHub
hadoop-yetus commented on PR #5486: URL: https://github.com/apache/hadoop/pull/5486#issuecomment-1473374924 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5486: HDFS-16949 Introduce inverse quantiles for metrics where higher numer…

2023-03-17 Thread via GitHub
hadoop-yetus commented on PR #5486: URL: https://github.com/apache/hadoop/pull/5486#issuecomment-1473344603 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5486: HDFS-16949 Introduce inverse quantiles for metrics where higher numer…

2023-03-17 Thread via GitHub
hadoop-yetus commented on PR #5486: URL: https://github.com/apache/hadoop/pull/5486#issuecomment-1473306928 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18425) [ABFS]: RenameFilePath Source File Not Found (404) error in retry loop

2023-03-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17701538#comment-17701538 ] ASF GitHub Bot commented on HADOOP-18425: - sreeb-msft commented on PR #5485: URL:

[GitHub] [hadoop] sreeb-msft commented on pull request #5485: HADOOP-18425. ABFS rename resilience through etags

2023-03-17 Thread via GitHub
sreeb-msft commented on PR #5485: URL: https://github.com/apache/hadoop/pull/5485#issuecomment-1473280328 Hello, here is the PR relevant to [HADOOP-18012](https://issues.apache.org/jira/browse/HADOOP-18012). The code change is slightly different, but could similar tests be useful in this

[jira] [Commented] (HADOOP-18012) ABFS: Enable config controlled ETag check for Rename idempotency

2023-03-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17701537#comment-17701537 ] ASF GitHub Bot commented on HADOOP-18012: - sreeb-msft opened a new pull request, #5488: URL:

[GitHub] [hadoop] sreeb-msft opened a new pull request, #5488: HADOOP-18012. ABFS: Using Source Path eTags for Rename Idemptonency checks

2023-03-17 Thread via GitHub
sreeb-msft opened a new pull request, #5488: URL: https://github.com/apache/hadoop/pull/5488 RenameFilePath on its first try receives a Request timed out error with code 500. On retrying the same operation, a Source file not found (404) error is received. Possible temporary

[jira] [Updated] (HADOOP-18012) ABFS: Enable config controlled ETag check for Rename idempotency

2023-03-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18012: Labels: pull-request-available (was: ) > ABFS: Enable config controlled ETag check for