[jira] [Work logged] (HADOOP-18364) All method metrics related to the rpc protocol should be initialized

2022-07-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18364?focusedWorklogId=795146&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795146 ] ASF GitHub Bot logged work on HADOOP-18364: --- Author: ASF GitHub B

[GitHub] [hadoop] zhangshuyan0 commented on a diff in pull request #4624: HADOOP-18364. All method metrics related to the RPC protocol should be …

2022-07-25 Thread GitBox
zhangshuyan0 commented on code in PR #4624: URL: https://github.com/apache/hadoop/pull/4624#discussion_r929593106 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/lib/MutableRatesWithAggregation.java: ## @@ -71,11 +74,20 @@ public void init(Class p

[GitHub] [hadoop] slfan1989 commented on pull request #4559: HDFS-16658. Change logLevel from DEBUG to INFO if logEveryBlock is true

2022-07-25 Thread GitBox
slfan1989 commented on PR #4559: URL: https://github.com/apache/hadoop/pull/4559#issuecomment-1195078382 @ZanderXu Thank you for your contribution, pr looks good, but I want to know if it can be solved using dynamic debug log? I remember that hadoop provides a switch that can directly

[GitHub] [hadoop] skysiders opened a new pull request, #4629: YARN-11231 modify destinationTmp permission from 755 to 777

2022-07-25 Thread GitBox
skysiders opened a new pull request, #4629: URL: https://github.com/apache/hadoop/pull/4629 ### Description of PR YARN-11231 FSDownload calls createDir in the call method to create the destinationTmp directory, which is later used as the parent directory to create the directory d

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #4618: YARN-11180. Refactor some code of getNewApplication, submitApplication etc.

2022-07-25 Thread GitBox
slfan1989 commented on code in PR #4618: URL: https://github.com/apache/hadoop/pull/4618#discussion_r929582201 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/clientrm/FederationClientInterceptor.java: ##

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #4618: YARN-11180. Refactor some code of getNewApplication, submitApplication etc.

2022-07-25 Thread GitBox
slfan1989 commented on code in PR #4618: URL: https://github.com/apache/hadoop/pull/4618#discussion_r929581152 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/clientrm/FederationClientInterceptor.java: ##

[jira] [Assigned] (HADOOP-18362) Running org.apache.hadoop.ha.TestZKFailoverController when "hadoop.security.groups.cache.secs" is zero or negative numbers will throw ambiguous exception

2022-07-25 Thread Jingxuan Fu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingxuan Fu reassigned HADOOP-18362: Assignee: Jingxuan Fu > Running org.apache.hadoop.ha.TestZKFailoverController when > "h

[GitHub] [hadoop] slfan1989 commented on pull request #4406: HDFS-16619. Fix HttpHeaders.Values And HttpHeaders.Names Deprecated Import

2022-07-25 Thread GitBox
slfan1989 commented on PR #4406: URL: https://github.com/apache/hadoop/pull/4406#issuecomment-1195061259 @jojochuang Can you help review this pr? thank you very much! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Updated] (HADOOP-18362) Running org.apache.hadoop.ha.TestZKFailoverController when "hadoop.security.groups.cache.secs" is zero or negative numbers will throw ambiguous exception

2022-07-25 Thread Jingxuan Fu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingxuan Fu updated HADOOP-18362: - Description: {quote} {code:java}   hadoop.security.groups.cache.secs   300       This is the

[jira] [Work logged] (HADOOP-18362) Running org.apache.hadoop.ha.TestZKFailoverController when "hadoop.security.groups.cache.secs" is zero or negative numbers will throw ambiguous exception

2022-07-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18362?focusedWorklogId=795125&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795125 ] ASF GitHub Bot logged work on HADOOP-18362: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4625: HADOOP-18362. Solve ZKFailoverController throw ambiguous exception

2022-07-25 Thread GitBox
hadoop-yetus commented on PR #4625: URL: https://github.com/apache/hadoop/pull/4625#issuecomment-1195007128 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] jojochuang commented on a diff in pull request #4626: HDFS-16676. DatanodeAdminManager$Monitor reports a node as invalid continuously

2022-07-25 Thread GitBox
jojochuang commented on code in PR #4626: URL: https://github.com/apache/hadoop/pull/4626#discussion_r929524721 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeAdminDefaultMonitor.java: ## @@ -201,6 +201,7 @@ private void ch

[jira] [Work logged] (HADOOP-18362) Running org.apache.hadoop.ha.TestZKFailoverController when "hadoop.security.groups.cache.secs" is zero or negative numbers will throw ambiguous exception

2022-07-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18362?focusedWorklogId=795122&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795122 ] ASF GitHub Bot logged work on HADOOP-18362: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4625: HADOOP-18362. Solve ZKFailoverController throw ambiguous exception

2022-07-25 Thread GitBox
hadoop-yetus commented on PR #4625: URL: https://github.com/apache/hadoop/pull/4625#issuecomment-1195002259 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] PrabhuJoseph commented on pull request #4626: HDFS-16676. DatanodeAdminManager$Monitor reports a node as invalid continuously

2022-07-25 Thread GitBox
PrabhuJoseph commented on PR #4626: URL: https://github.com/apache/hadoop/pull/4626#issuecomment-1194967117 Thanks @ashutoshcipher for the patch. Can you include a test case. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hadoop] PrabhuJoseph merged pull request #4563: YARN-11210. Fix YARN RMAdminCLI retry logic for non-retryable kerbero…

2022-07-25 Thread GitBox
PrabhuJoseph merged PR #4563: URL: https://github.com/apache/hadoop/pull/4563 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@

[GitHub] [hadoop] PrabhuJoseph commented on pull request #4563: YARN-11210. Fix YARN RMAdminCLI retry logic for non-retryable kerbero…

2022-07-25 Thread GitBox
PrabhuJoseph commented on PR #4563: URL: https://github.com/apache/hadoop/pull/4563#issuecomment-1194965682 Thanks @KevinWikant for the patch and @ashutoshcipher for additional review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Work logged] (HADOOP-18362) Running org.apache.hadoop.ha.TestZKFailoverController when "hadoop.security.groups.cache.secs" is zero or negative numbers will throw ambiguous exception

2022-07-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18362?focusedWorklogId=795108&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795108 ] ASF GitHub Bot logged work on HADOOP-18362: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-18362) Running org.apache.hadoop.ha.TestZKFailoverController when "hadoop.security.groups.cache.secs" is zero or negative numbers will throw ambiguous exception

2022-07-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18362?focusedWorklogId=795106&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795106 ] ASF GitHub Bot logged work on HADOOP-18362: --- Author: ASF GitHub B

[GitHub] [hadoop] MEILIDEKCL closed pull request #4625: HADOOP-18362. Solve ZKFailoverController throw ambiguous exception

2022-07-25 Thread GitBox
MEILIDEKCL closed pull request #4625: HADOOP-18362. Solve ZKFailoverController throw ambiguous exception URL: https://github.com/apache/hadoop/pull/4625 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hadoop] ZanderXu commented on pull request #4155: HDFS-16533. COMPOSITE_CRC failed between replicated file and striped file due to invalid requested length

2022-07-25 Thread GitBox
ZanderXu commented on PR #4155: URL: https://github.com/apache/hadoop/pull/4155#issuecomment-1194902292 @jojochuang Thank you very much for your review and suggestions. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

[jira] [Work logged] (HADOOP-18345) Enhance client protocol to propagate last seen state IDs for multiple nameservices.

2022-07-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18345?focusedWorklogId=795096&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795096 ] ASF GitHub Bot logged work on HADOOP-18345: --- Author: ASF GitHub B

[GitHub] [hadoop] simbadzina commented on pull request #4584: HADOOP-18345: Enhance client protocol to propagate last seen state IDs for multiple nameservices.

2022-07-25 Thread GitBox
simbadzina commented on PR #4584: URL: https://github.com/apache/hadoop/pull/4584#issuecomment-1194894453 Yes, it should be optional. Thanks for spotting the error. I'll fix that. I'm considering making the field a byte array in the client protocol. Only routers need to parse it.

[jira] [Work logged] (HADOOP-18345) Enhance client protocol to propagate last seen state IDs for multiple nameservices.

2022-07-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18345?focusedWorklogId=795084&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795084 ] ASF GitHub Bot logged work on HADOOP-18345: --- Author: ASF GitHub B

[GitHub] [hadoop] xkrogen commented on a diff in pull request #4584: HADOOP-18345: Enhance client protocol to propagate last seen state IDs for multiple nameservices.

2022-07-25 Thread GitBox
xkrogen commented on code in PR #4584: URL: https://github.com/apache/hadoop/pull/4584#discussion_r929398786 ## hadoop-common-project/hadoop-common/src/main/proto/RpcHeader.proto: ## @@ -157,6 +158,7 @@ message RpcResponseHeaderProto { optional bytes clientId = 7; // Globally

[GitHub] [hadoop] hadoop-yetus commented on pull request #4628: HDFS-16689. Standby NameNode crashes when transitioning to Active with in-progress tailer.

2022-07-25 Thread GitBox
hadoop-yetus commented on PR #4628: URL: https://github.com/apache/hadoop/pull/4628#issuecomment-1194775595 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Work logged] (HADOOP-18364) All method metrics related to the rpc protocol should be initialized

2022-07-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18364?focusedWorklogId=795082&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795082 ] ASF GitHub Bot logged work on HADOOP-18364: --- Author: ASF GitHub B

[GitHub] [hadoop] xkrogen commented on a diff in pull request #4624: HADOOP-18364. All method metrics related to the RPC protocol should be …

2022-07-25 Thread GitBox
xkrogen commented on code in PR #4624: URL: https://github.com/apache/hadoop/pull/4624#discussion_r929389912 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/lib/MutableRatesWithAggregation.java: ## @@ -71,11 +74,20 @@ public void init(Class protoc

[jira] [Work logged] (HADOOP-18190) s3a prefetching streams to collect iostats on prefetching operations

2022-07-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18190?focusedWorklogId=795080&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795080 ] ASF GitHub Bot logged work on HADOOP-18190: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4458: HADOOP-18190. Adds iostats for prefetching

2022-07-25 Thread GitBox
hadoop-yetus commented on PR #4458: URL: https://github.com/apache/hadoop/pull/4458#issuecomment-1194768803 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #4618: YARN-11180. Refactor some code of getNewApplication, submitApplication etc.

2022-07-25 Thread GitBox
slfan1989 commented on code in PR #4618: URL: https://github.com/apache/hadoop/pull/4618#discussion_r929382545 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/clientrm/FederationClientInterceptor.java: ##

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #4618: YARN-11180. Refactor some code of getNewApplication, submitApplication etc.

2022-07-25 Thread GitBox
slfan1989 commented on code in PR #4618: URL: https://github.com/apache/hadoop/pull/4618#discussion_r929382239 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/test/java/org/apache/hadoop/yarn/server/router/clientrm/TestFederationClientInterceptor.java

[jira] [Work logged] (HADOOP-17461) Add thread-level IOStatistics Context

2022-07-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17461?focusedWorklogId=795074&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795074 ] ASF GitHub Bot logged work on HADOOP-17461: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4566: HADOOP-17461. IOStatisticsContext + committer integration

2022-07-25 Thread GitBox
hadoop-yetus commented on PR #4566: URL: https://github.com/apache/hadoop/pull/4566#issuecomment-1194744613 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Work logged] (HADOOP-18364) All method metrics related to the rpc protocol should be initialized

2022-07-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18364?focusedWorklogId=795069&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795069 ] ASF GitHub Bot logged work on HADOOP-18364: --- Author: ASF GitHub B

[GitHub] [hadoop] sunchao commented on a diff in pull request #4624: HADOOP-18364. All method metrics related to the RPC protocol should be …

2022-07-25 Thread GitBox
sunchao commented on code in PR #4624: URL: https://github.com/apache/hadoop/pull/4624#discussion_r929362325 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/lib/MutableRatesWithAggregation.java: ## @@ -71,11 +74,20 @@ public void init(Class protoc

[jira] [Work logged] (HADOOP-18363) Fix bug preventing hadoop-metrics2 from emitting metrics to > 1 Ganglia servers.

2022-07-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18363?focusedWorklogId=795064&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795064 ] ASF GitHub Bot logged work on HADOOP-18363: --- Author: ASF GitHub B

[jira] [Commented] (HADOOP-18354) Upgrade reload4j due to XXE vulnerability

2022-07-25 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17571116#comment-17571116 ] Wei-Chiu Chuang commented on HADOOP-18354: -- I don't think we'll have 3.3.9 any

[GitHub] [hadoop] hadoop-yetus commented on pull request #4627: HADOOP-18363. Fix bug preventing hadoop-metrics2 from emitting metrics to > 1 Ganglia servers

2022-07-25 Thread GitBox
hadoop-yetus commented on PR #4627: URL: https://github.com/apache/hadoop/pull/4627#issuecomment-1194693092 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Updated] (HADOOP-18354) Upgrade reload4j due to XXE vulnerability

2022-07-25 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-18354: - Fix Version/s: 3.3.4 (was: 3.3.9) > Upgrade reload4j due to XXE

[jira] [Work logged] (HADOOP-18079) Upgrade Netty to 4.1.77.Final

2022-07-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18079?focusedWorklogId=795058&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795058 ] ASF GitHub Bot logged work on HADOOP-18079: --- Author: ASF GitHub B

[GitHub] [hadoop] jojochuang commented on pull request #4592: HADOOP-18079. Upgrade Netty to 4.1.77. (#3977)

2022-07-25 Thread GitBox
jojochuang commented on PR #4592: URL: https://github.com/apache/hadoop/pull/4592#issuecomment-1194679018 The shadeclient error does not repro locally. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[jira] [Commented] (HADOOP-18227) Add input stream IOstats for vectored IO api in S3A.

2022-07-25 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17571096#comment-17571096 ] Mukund Thakur commented on HADOOP-18227: Adding these stats. Any other we need

[jira] [Updated] (HADOOP-18227) Add input stream IOstats for vectored IO api in S3A.

2022-07-25 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18227: --- Component/s: fs/s3 > Add input stream IOstats for vectored IO api in S3A. > ---

[jira] [Updated] (HADOOP-18227) Add input stream IOstats for vectored IO api in S3A.

2022-07-25 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18227: --- Summary: Add input stream IOstats for vectored IO api in S3A. (was: Add IOstats and auditi

[GitHub] [hadoop] jojochuang merged pull request #4155: HDFS-16533. COMPOSITE_CRC failed between replicated file and striped file due to invalid requested length

2022-07-25 Thread GitBox
jojochuang merged PR #4155: URL: https://github.com/apache/hadoop/pull/4155 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@ha

[GitHub] [hadoop] KevinWikant commented on pull request #4563: YARN-11210. Fix YARN RMAdminCLI retry logic for non-retryable kerbero…

2022-07-25 Thread GitBox
KevinWikant commented on PR #4563: URL: https://github.com/apache/hadoop/pull/4563#issuecomment-1194540951 @PrabhuJoseph I have addressed all the checkstyle issues except for the SaslRpcClient Indentation issue which, as I mentioned, would result in inconsistent indentation if addressed:

[GitHub] [hadoop] hadoop-yetus commented on pull request #4623: HDFS-16682. [SBN Read] make estimated transactions configurable

2022-07-25 Thread GitBox
hadoop-yetus commented on PR #4623: URL: https://github.com/apache/hadoop/pull/4623#issuecomment-1194508990 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18366) ITestS3Select.testSelectSeekFullLandsat is timing out

2022-07-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17571061#comment-17571061 ] Steve Loughran commented on HADOOP-18366: - i haven't seen this BTW > ITestS3Se

[jira] [Commented] (HADOOP-18366) ITestS3Select.testSelectSeekFullLandsat is timing out

2022-07-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17571060#comment-17571060 ] Steve Loughran commented on HADOOP-18366: - i blame the networking :) actually,

[jira] [Commented] (HADOOP-18313) AliyunOSS: AliyunOSSBlockOutputStream should not mark the temporary file for deletion

2022-07-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17571058#comment-17571058 ] Steve Loughran commented on HADOOP-18313: - yes, add it > AliyunOSS: AliyunOSSB

[jira] [Work logged] (HADOOP-17461) Add thread-level IOStatistics Context

2022-07-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17461?focusedWorklogId=795019&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795019 ] ASF GitHub Bot logged work on HADOOP-17461: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on pull request #4352: HADOOP-17461. Thread-level IOStatistics in S3A

2022-07-25 Thread GitBox
steveloughran commented on PR #4352: URL: https://github.com/apache/hadoop/pull/4352#issuecomment-1194488631 ok, one more change, as I write up something on integration. The RawLocal streams should support IOContext too. why so? makes testing integration easier, e.g. for distcp, spark

[GitHub] [hadoop] goiri merged pull request #4426: YARN-10883. [Router] Router Audit Log Add Client IP Address.

2022-07-25 Thread GitBox
goiri merged PR #4426: URL: https://github.com/apache/hadoop/pull/4426 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.

[GitHub] [hadoop] hadoop-yetus commented on pull request #4622: YARN-11063. Support auto queue creation template wildcards for arbitr…

2022-07-25 Thread GitBox
hadoop-yetus commented on PR #4622: URL: https://github.com/apache/hadoop/pull/4622#issuecomment-1194469649 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] hadoop-yetus commented on pull request #4622: YARN-11063. Support auto queue creation template wildcards for arbitr…

2022-07-25 Thread GitBox
hadoop-yetus commented on PR #4622: URL: https://github.com/apache/hadoop/pull/4622#issuecomment-1194465848 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] cnauroth merged pull request #4026: MAPREDUCE-7372 MapReduce set permission too late in copyJar method

2022-07-25 Thread GitBox
cnauroth merged PR #4026: URL: https://github.com/apache/hadoop/pull/4026 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@hado

[GitHub] [hadoop] cnauroth commented on pull request #4026: MAPREDUCE-7372 MapReduce set permission too late in copyJar method

2022-07-25 Thread GitBox
cnauroth commented on PR #4026: URL: https://github.com/apache/hadoop/pull/4026#issuecomment-1194427833 I can commit this today. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

[jira] [Work logged] (HADOOP-18190) s3a prefetching streams to collect iostats on prefetching operations

2022-07-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18190?focusedWorklogId=795005&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795005 ] ASF GitHub Bot logged work on HADOOP-18190: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4458: HADOOP-18190. Adds iostats for prefetching

2022-07-25 Thread GitBox
hadoop-yetus commented on PR #4458: URL: https://github.com/apache/hadoop/pull/4458#issuecomment-1194423651 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] hadoop-yetus commented on pull request #4626: HDFS-16676. DatanodeAdminManager$Monitor reports a node as invalid continuously

2022-07-25 Thread GitBox
hadoop-yetus commented on PR #4626: URL: https://github.com/apache/hadoop/pull/4626#issuecomment-1194417858 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Work logged] (HADOOP-18357) Retarget solution file to VS2019

2022-07-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18357?focusedWorklogId=794997&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-794997 ] ASF GitHub Bot logged work on HADOOP-18357: --- Author: ASF GitHub B

[GitHub] [hadoop] goiri commented on a diff in pull request #4616: HADOOP-18357. Retarget solution file to VS2019

2022-07-25 Thread GitBox
goiri commented on code in PR #4616: URL: https://github.com/apache/hadoop/pull/4616#discussion_r929146402 ## hadoop-common-project/hadoop-common/src/main/native/native.vcxproj: ## @@ -39,12 +37,14 @@ false true Unicode +v142 Review Comment: Can we check i

[GitHub] [hadoop] GauthamBanasandra merged pull request #4615: HDFS-16681. Do not pass GCC flags for MSVC in libhdfspp

2022-07-25 Thread GitBox
GauthamBanasandra merged PR #4615: URL: https://github.com/apache/hadoop/pull/4615 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubsc

[jira] [Work logged] (HADOOP-18357) Retarget solution file to VS2019

2022-07-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18357?focusedWorklogId=794988&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-794988 ] ASF GitHub Bot logged work on HADOOP-18357: --- Author: ASF GitHub B

[GitHub] [hadoop] GauthamBanasandra commented on a diff in pull request #4616: HADOOP-18357. Retarget solution file to VS2019

2022-07-25 Thread GitBox
GauthamBanasandra commented on code in PR #4616: URL: https://github.com/apache/hadoop/pull/4616#discussion_r929126701 ## hadoop-common-project/hadoop-common/src/main/native/native.vcxproj.filters: ## @@ -48,19 +46,16 @@ Source Files - - Source Files

[jira] [Work logged] (HADOOP-18357) Retarget solution file to VS2019

2022-07-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18357?focusedWorklogId=794987&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-794987 ] ASF GitHub Bot logged work on HADOOP-18357: --- Author: ASF GitHub B

[GitHub] [hadoop] GauthamBanasandra commented on a diff in pull request #4616: HADOOP-18357. Retarget solution file to VS2019

2022-07-25 Thread GitBox
GauthamBanasandra commented on code in PR #4616: URL: https://github.com/apache/hadoop/pull/4616#discussion_r929121380 ## hadoop-common-project/hadoop-common/src/main/native/native.vcxproj: ## @@ -142,16 +140,16 @@ /D HADOOP_ISAL_LIBRARY=L\"isa-l.dll\" -

[jira] [Work logged] (HADOOP-18357) Retarget solution file to VS2019

2022-07-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18357?focusedWorklogId=794986&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-794986 ] ASF GitHub Bot logged work on HADOOP-18357: --- Author: ASF GitHub B

[GitHub] [hadoop] GauthamBanasandra commented on a diff in pull request #4616: HADOOP-18357. Retarget solution file to VS2019

2022-07-25 Thread GitBox
GauthamBanasandra commented on code in PR #4616: URL: https://github.com/apache/hadoop/pull/4616#discussion_r929120970 ## hadoop-common-project/hadoop-common/src/main/native/native.vcxproj: ## @@ -39,12 +37,14 @@ false true Unicode +v142 Review Comment: I

[jira] [Work logged] (HADOOP-18363) Fix bug preventing hadoop-metrics2 from emitting metrics to > 1 Ganglia servers.

2022-07-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18363?focusedWorklogId=794985&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-794985 ] ASF GitHub Bot logged work on HADOOP-18363: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4627: HADOOP-18363. Fix bug preventing hadoop-metrics2 from emitting metrics to > 1 Ganglia servers

2022-07-25 Thread GitBox
hadoop-yetus commented on PR #4627: URL: https://github.com/apache/hadoop/pull/4627#issuecomment-1194365408 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #4563: YARN-11210. Fix YARN RMAdminCLI retry logic for non-retryable kerbero…

2022-07-25 Thread GitBox
hadoop-yetus commented on PR #4563: URL: https://github.com/apache/hadoop/pull/4563#issuecomment-1194363279 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] goiri merged pull request #4610: YARN-11161. Support getAttributesToNodes, getClusterNodeAttributes, getNodesToAttributes API's for Federation

2022-07-25 Thread GitBox
goiri merged PR #4610: URL: https://github.com/apache/hadoop/pull/4610 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.

[GitHub] [hadoop] goiri commented on a diff in pull request #4594: YARN-6572. Refactoring Router services to use common util classes for pipeline creations.

2022-07-25 Thread GitBox
goiri commented on code in PR #4594: URL: https://github.com/apache/hadoop/pull/4594#discussion_r929108932 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/webapp/RouterWebServices.java: ## @@ -206

[GitHub] [hadoop] goiri commented on a diff in pull request #4614: YARN-11212. [Federation] Add getNodeToLabels REST APIs for Router.

2022-07-25 Thread GitBox
goiri commented on code in PR #4614: URL: https://github.com/apache/hadoop/pull/4614#discussion_r929104887 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/webapp/FederationInterceptorREST.java: ##

[GitHub] [hadoop] goiri commented on a diff in pull request #4618: YARN-11180. Refactor some code of getNewApplication, submitApplication etc.

2022-07-25 Thread GitBox
goiri commented on code in PR #4618: URL: https://github.com/apache/hadoop/pull/4618#discussion_r929101762 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/clientrm/FederationClientInterceptor.java: ##

[GitHub] [hadoop] goiri commented on pull request #4426: YARN-10883. [Router] Router Audit Log Add Client IP Address.

2022-07-25 Thread GitBox
goiri commented on PR #4426: URL: https://github.com/apache/hadoop/pull/4426#issuecomment-1194345556 @ayushtkn do you mind taking a look at this too? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Work logged] (HADOOP-18342) Upgrade to Avro 1.11.0

2022-07-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18342?focusedWorklogId=794961&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-794961 ] ASF GitHub Bot logged work on HADOOP-18342: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-18342) Upgrade to Avro 1.11.0

2022-07-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18342?focusedWorklogId=794965&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-794965 ] ASF GitHub Bot logged work on HADOOP-18342: --- Author: ASF GitHub B

[GitHub] [hadoop] xkrogen commented on pull request #4581: HADOOP-18342: upgrade to avro 1.11.0

2022-07-25 Thread GitBox
xkrogen commented on PR #4581: URL: https://github.com/apache/hadoop/pull/4581#issuecomment-1194312076 Just to be clear, I am not generally -1 on Avro upgrades. #4580 would have bumped the Avro major version in a maintenance release of Hadoop; a major Avro version bump is way too big of a c

[jira] [Work logged] (HADOOP-18342) Upgrade to Avro 1.11.0

2022-07-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18342?focusedWorklogId=794960&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-794960 ] ASF GitHub Bot logged work on HADOOP-18342: --- Author: ASF GitHub B

[GitHub] [hadoop] pjfanning closed pull request #4581: HADOOP-18342: upgrade to avro 1.11.0

2022-07-25 Thread GitBox
pjfanning closed pull request #4581: HADOOP-18342: upgrade to avro 1.11.0 URL: https://github.com/apache/hadoop/pull/4581 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

[GitHub] [hadoop] pjfanning commented on pull request #4581: HADOOP-18342: upgrade to avro 1.11.0

2022-07-25 Thread GitBox
pjfanning commented on PR #4581: URL: https://github.com/apache/hadoop/pull/4581#issuecomment-1194309623 I'll close this then -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hadoop] ZanderXu opened a new pull request, #4628: HDFS-16689. Standby NameNode crashes when transitioning to Active with in-progress tailer.

2022-07-25 Thread GitBox
ZanderXu opened a new pull request, #4628: URL: https://github.com/apache/hadoop/pull/4628 ### Description of PR Standby NameNode crashes when transitioning to Active with a in-progress tailer. And the error message as blew: ```java Caused by: java.lang.IllegalStateException: Ca

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #4314: YARN-11153. Make proxy server support YARN federation.

2022-07-25 Thread GitBox
slfan1989 commented on code in PR #4314: URL: https://github.com/apache/hadoop/pull/4314#discussion_r928791799 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/test/java/org/apache/hadoop/yarn/server/webproxy/TestWebAppProxyServletFed.java:

[jira] [Work logged] (HADOOP-17461) Add thread-level IOStatistics Context

2022-07-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17461?focusedWorklogId=794943&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-794943 ] ASF GitHub Bot logged work on HADOOP-17461: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4352: HADOOP-17461. Thread-level IOStatistics in S3A

2022-07-25 Thread GitBox
hadoop-yetus commented on PR #4352: URL: https://github.com/apache/hadoop/pull/4352#issuecomment-1194187132 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] ashutoshcipher commented on pull request #4618: YARN-11180. Refactor some code of getNewApplication, submitApplication etc.

2022-07-25 Thread GitBox
ashutoshcipher commented on PR #4618: URL: https://github.com/apache/hadoop/pull/4618#issuecomment-1194146730 LGTM +1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

[GitHub] [hadoop] ashutoshcipher commented on pull request #4626: HDFS-16676. DatanodeAdminManager$Monitor reports a node as invalid continuously

2022-07-25 Thread GitBox
ashutoshcipher commented on PR #4626: URL: https://github.com/apache/hadoop/pull/4626#issuecomment-1194143412 Thanks @slfan1989 for your review and approval :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[GitHub] [hadoop] ashutoshcipher commented on a diff in pull request #4626: HDFS-16676. DatanodeAdminManager$Monitor reports a node as invalid continuously

2022-07-25 Thread GitBox
ashutoshcipher commented on code in PR #4626: URL: https://github.com/apache/hadoop/pull/4626#discussion_r928961283 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeAdminDefaultMonitor.java: ## @@ -201,6 +201,7 @@ private voi

[GitHub] [hadoop] ashutoshcipher commented on a diff in pull request #4626: HDFS-16676. DatanodeAdminManager$Monitor reports a node as invalid continuously

2022-07-25 Thread GitBox
ashutoshcipher commented on code in PR #4626: URL: https://github.com/apache/hadoop/pull/4626#discussion_r928963626 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeAdminDefaultMonitor.java: ## @@ -265,6 +266,7 @@ private voi

[GitHub] [hadoop] ashutoshcipher commented on a diff in pull request #4626: HDFS-16676. DatanodeAdminManager$Monitor reports a node as invalid continuously

2022-07-25 Thread GitBox
ashutoshcipher commented on code in PR #4626: URL: https://github.com/apache/hadoop/pull/4626#discussion_r928961283 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeAdminDefaultMonitor.java: ## @@ -201,6 +201,7 @@ private voi

[GitHub] [hadoop] slfan1989 commented on pull request #4614: YARN-11212. [Federation] Add getNodeToLabels REST APIs for Router.

2022-07-25 Thread GitBox
slfan1989 commented on PR #4614: URL: https://github.com/apache/hadoop/pull/4614#issuecomment-1194129033 @goiri please help me review the code again, thank you very much! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [hadoop] slfan1989 commented on pull request #4618: YARN-11180. Refactor some code of getNewApplication, submitApplication etc.

2022-07-25 Thread GitBox
slfan1989 commented on PR #4618: URL: https://github.com/apache/hadoop/pull/4618#issuecomment-1194126724 @goiri Please help me review the code again, thank you very much. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #4626: HDFS-16676. DatanodeAdminManager$Monitor reports a node as invalid continuously

2022-07-25 Thread GitBox
slfan1989 commented on code in PR #4626: URL: https://github.com/apache/hadoop/pull/4626#discussion_r928949967 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeAdminDefaultMonitor.java: ## @@ -201,6 +201,7 @@ private void che

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #4626: HDFS-16676. DatanodeAdminManager$Monitor reports a node as invalid continuously

2022-07-25 Thread GitBox
slfan1989 commented on code in PR #4626: URL: https://github.com/apache/hadoop/pull/4626#discussion_r928949038 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeAdminDefaultMonitor.java: ## @@ -265,6 +266,7 @@ private void che

[jira] [Commented] (HADOOP-18366) ITestS3Select.testSelectSeekFullLandsat is timing out

2022-07-25 Thread Ahmar Suhail (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17570930#comment-17570930 ] Ahmar Suhail commented on HADOOP-18366: --- I'm not sure if this is a known issue, I

[jira] [Updated] (HADOOP-18366) ITestS3Select.testSelectSeekFullLandsat is timing out

2022-07-25 Thread Ahmar Suhail (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmar Suhail updated HADOOP-18366: -- Environment: (was: ITestS3Select.testSelectSeekFullLandsat is timing out. When I run it s

[jira] [Created] (HADOOP-18366) ITestS3Select.testSelectSeekFullLandsat is timing out

2022-07-25 Thread Ahmar Suhail (Jira)
Ahmar Suhail created HADOOP-18366: - Summary: ITestS3Select.testSelectSeekFullLandsat is timing out Key: HADOOP-18366 URL: https://issues.apache.org/jira/browse/HADOOP-18366 Project: Hadoop Common

  1   2   >