[GitHub] [hadoop] tomscut commented on pull request #3354: HDFS-16194. Add a public method DatanodeID#getDisplayName

2021-09-01 Thread GitBox
tomscut commented on pull request #3354: URL: https://github.com/apache/hadoop/pull/3354#issuecomment-911232984 > LGTM. +1 Thanks @Hexiaoqiao for your review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hadoop] tomscut commented on pull request #3354: HDFS-16194. Add a public method DatanodeID#getDisplayName

2021-09-01 Thread GitBox
tomscut commented on pull request #3354: URL: https://github.com/apache/hadoop/pull/3354#issuecomment-911177574 Hi @tasanuma @Hexiaoqiao , could you please review the code? Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[GitHub] [hadoop] jianghuazhu commented on pull request #3365: YARN-10931.Remove some invalid characters in NMClientAsyncImpl#ContainerState.

2021-09-01 Thread GitBox
jianghuazhu commented on pull request #3365: URL: https://github.com/apache/hadoop/pull/3365#issuecomment-911073362 It seems that UT has failed to execute, but from the details, I can't see where the problem is. Can someone help analyze it together. thank you very much. -- This is

[GitHub] [hadoop] jianghuazhu commented on pull request #3368: HDFS-16204.Improve FSDirEncryptionZoneOp related parameter comments.

2021-09-01 Thread GitBox
jianghuazhu commented on pull request #3368: URL: https://github.com/apache/hadoop/pull/3368#issuecomment-911037081 @jojochuang @virajjasani , can you help review the code. thank you very much. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] jianghuazhu commented on pull request #3368: HDFS-16204.Improve FSDirEncryptionZoneOp related parameter comments.

2021-09-01 Thread GitBox
jianghuazhu commented on pull request #3368: URL: https://github.com/apache/hadoop/pull/3368#issuecomment-911034682 Found multiple abnormalities in jenkins, for example: org.apache.hadoop.hdfs.TestLeaseRecovery org.apache.hadoop.hdfs.TestLeaseRecovery2 org.apache.hadoop.hdfs.server.

[jira] [Work logged] (HADOOP-17804) Prometheus metrics only include the last set of labels

2021-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17804?focusedWorklogId=645662&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-645662 ] ASF GitHub Bot logged work on HADOOP-17804: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3369: HADOOP-17804. Expose prometheus metrics only after a flush and dedupe with tag values

2021-09-01 Thread GitBox
hadoop-yetus commented on pull request #3369: URL: https://github.com/apache/hadoop/pull/3369#issuecomment-911024354 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] jojochuang commented on pull request #3322: HDFS-6874. Add GETFILEBLOCKLOCATIONS operation to HttpFS.

2021-09-01 Thread GitBox
jojochuang commented on pull request #3322: URL: https://github.com/apache/hadoop/pull/3322#issuecomment-910991818 Hey Ahmed. Thanks a lot but I think this is going to require another few iterations. Will ping you when I feel like it gets the quality I like. -- This is an automated me

[GitHub] [hadoop] tomscut commented on pull request #3313: HDFS-16179. Update loglevel for BlockManager#chooseExcessRedundancySt…

2021-09-01 Thread GitBox
tomscut commented on pull request #3313: URL: https://github.com/apache/hadoop/pull/3313#issuecomment-910966903 @ferhui @whbing I found if balancer is started, the log will be printed. If balancer is stopped, the log will not be printed. -- This is an automated message from the Apache Gi

[GitHub] [hadoop] LeonGao91 commented on a change in pull request #3346: HDFS-16188. RBF: Router to support resolving monitored namenodes with DNS

2021-09-01 Thread GitBox
LeonGao91 commented on a change in pull request #3346: URL: https://github.com/apache/hadoop/pull/3346#discussion_r700643861 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/net/TestNetUtils.java ## @@ -765,6 +765,25 @@ public void testTrimCrea

[GitHub] [hadoop] goiri commented on a change in pull request #3346: HDFS-16188. RBF: Router to support resolving monitored namenodes with DNS

2021-09-01 Thread GitBox
goiri commented on a change in pull request #3346: URL: https://github.com/apache/hadoop/pull/3346#discussion_r700608519 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/net/TestNetUtils.java ## @@ -765,6 +765,25 @@ public void testTrimCreateSo

[GitHub] [hadoop] LeonGao91 commented on a change in pull request #3346: HDFS-16188. RBF: Router to support resolving monitored namenodes with DNS

2021-09-01 Thread GitBox
LeonGao91 commented on a change in pull request #3346: URL: https://github.com/apache/hadoop/pull/3346#discussion_r700598481 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/NamenodeHeartbeatService.java ## @@ -120

[jira] [Work logged] (HADOOP-17886) Upgrade ant to 1.10.11

2021-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17886?focusedWorklogId=645589&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-645589 ] ASF GitHub Bot logged work on HADOOP-17886: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3371: HADOOP-17886. Upgrade ant to 1.10.11

2021-09-01 Thread GitBox
hadoop-yetus commented on pull request #3371: URL: https://github.com/apache/hadoop/pull/3371#issuecomment-910781454 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] hadoop-yetus commented on pull request #3200: HDFS-15160. branch-3.2. ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock.

2021-09-01 Thread GitBox
hadoop-yetus commented on pull request #3200: URL: https://github.com/apache/hadoop/pull/3200#issuecomment-910738631 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] hadoop-yetus commented on pull request #3368: HDFS-16204.Improve FSDirEncryptionZoneOp related parameter comments.

2021-09-01 Thread GitBox
hadoop-yetus commented on pull request #3368: URL: https://github.com/apache/hadoop/pull/3368#issuecomment-910728557 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] goiri commented on a change in pull request #3346: HDFS-16188. RBF: Router to support resolving monitored namenodes with DNS

2021-09-01 Thread GitBox
goiri commented on a change in pull request #3346: URL: https://github.com/apache/hadoop/pull/3346#discussion_r700548545 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/NamenodeHeartbeatService.java ## @@ -120,40

[GitHub] [hadoop] goiri commented on a change in pull request #3346: HDFS-16188. RBF: Router to support resolving monitored namenodes with DNS

2021-09-01 Thread GitBox
goiri commented on a change in pull request #3346: URL: https://github.com/apache/hadoop/pull/3346#discussion_r700547922 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/NamenodeHeartbeatService.java ## @@ -113,47

[jira] [Work logged] (HADOOP-17886) Upgrade ant to 1.10.11

2021-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17886?focusedWorklogId=645543&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-645543 ] ASF GitHub Bot logged work on HADOOP-17886: --- Author: ASF GitHub B

[jira] [Updated] (HADOOP-17886) Upgrade ant to 1.10.11

2021-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17886: Labels: pull-request-available (was: ) > Upgrade ant to 1.10.11 > --

[GitHub] [hadoop] amahussein opened a new pull request #3371: HADOOP-17886. Upgrade ant to 1.10.11

2021-09-01 Thread GitBox
amahussein opened a new pull request #3371: URL: https://github.com/apache/hadoop/pull/3371 [HADOOP-17886](https://issues.apache.org/jira/browse/HADOOP-17886) Upgrade ant to 1.10.11 Vulnerabilities reported in org.apache.ant:ant 1.10.9 CVE-2021-36374 moderate severity

[jira] [Work logged] (HADOOP-17885) Upgrade JSON smart to 1.3.3 on branch-2.10

2021-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17885?focusedWorklogId=645542&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-645542 ] ASF GitHub Bot logged work on HADOOP-17885: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3370: HADOOP-17885. Upgrade JSON smart to 1.3.3 on branch-2.10

2021-09-01 Thread GitBox
hadoop-yetus commented on pull request #3370: URL: https://github.com/apache/hadoop/pull/3370#issuecomment-910693210 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 13m 34

[jira] [Work logged] (HADOOP-17885) Upgrade JSON smart to 1.3.3 on branch-2.10

2021-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17885?focusedWorklogId=645523&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-645523 ] ASF GitHub Bot logged work on HADOOP-17885: --- Author: ASF GitHub B

[jira] [Updated] (HADOOP-17885) Upgrade JSON smart to 1.3.3 on branch-2.10

2021-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17885: Labels: pull-request-available (was: ) > Upgrade JSON smart to 1.3.3 on branch-2.10 > --

[jira] [Work started] (HADOOP-17886) Upgrade ant to 1.10.11

2021-09-01 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-17886 started by Ahmed Hussein. -- > Upgrade ant to 1.10.11 > -- > > Key:

[GitHub] [hadoop] amahussein opened a new pull request #3370: HADOOP-17885. Upgrade JSON smart to 1.3.3 on branch-2.10

2021-09-01 Thread GitBox
amahussein opened a new pull request #3370: URL: https://github.com/apache/hadoop/pull/3370 [HADOOP-17885](https://issues.apache.org/jira/browse/HADOOP-17885) Upgrade JSON smart to 1.3.3 on branch-2.10 Currently branch-2.10 is using JSON Smart 1.3.1 version which is vulnerable to CV

[jira] [Work started] (HADOOP-17885) Upgrade JSON smart to 1.3.3 on branch-2.10

2021-09-01 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-17885 started by Ahmed Hussein. -- > Upgrade JSON smart to 1.3.3 on branch-2.10 > ---

[jira] [Created] (HADOOP-17886) Upgrade ant to 1.10.11

2021-09-01 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HADOOP-17886: -- Summary: Upgrade ant to 1.10.11 Key: HADOOP-17886 URL: https://issues.apache.org/jira/browse/HADOOP-17886 Project: Hadoop Common Issue Type: Bug Affe

[jira] [Created] (HADOOP-17885) Upgrade JSON smart to 1.3.3 on branch-2.10

2021-09-01 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HADOOP-17885: -- Summary: Upgrade JSON smart to 1.3.3 on branch-2.10 Key: HADOOP-17885 URL: https://issues.apache.org/jira/browse/HADOOP-17885 Project: Hadoop Common Issu

[jira] [Work logged] (HADOOP-17804) Prometheus metrics only include the last set of labels

2021-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17804?focusedWorklogId=645421&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-645421 ] ASF GitHub Bot logged work on HADOOP-17804: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3369: HADOOP-17804. Expose prometheus metrics only after a flush and dedupe with tag values

2021-09-01 Thread GitBox
hadoop-yetus commented on pull request #3369: URL: https://github.com/apache/hadoop/pull/3369#issuecomment-910503718 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] hadoop-yetus commented on pull request #3366: HDFS-16203. Discover datanodes with unbalanced block pool usage by th…

2021-09-01 Thread GitBox
hadoop-yetus commented on pull request #3366: URL: https://github.com/apache/hadoop/pull/3366#issuecomment-910496049 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] goiri commented on a change in pull request #3325: YARN-10893. Adding metrics for getClusterMetrics and getApplications APIs in FederationClientInterceptor

2021-09-01 Thread GitBox
goiri commented on a change in pull request #3325: URL: https://github.com/apache/hadoop/pull/3325#discussion_r700376659 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/clientrm/FederationCli

[GitHub] [hadoop] goiri commented on a change in pull request #3252: YARN-10829. Follow up: Adding null checks before merging ResourceUsage Report

2021-09-01 Thread GitBox
goiri commented on a change in pull request #3252: URL: https://github.com/apache/hadoop/pull/3252#discussion_r700373788 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/clientrm/RouterYarnCli

[jira] [Commented] (HADOOP-15129) Datanode caches namenode DNS lookup failure and cannot startup

2021-09-01 Thread Chris Nauroth (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17408264#comment-17408264 ] Chris Nauroth commented on HADOOP-15129: [~ywskycn], thank you for the +1. I'm

[GitHub] [hadoop] JackWangCS commented on a change in pull request #3361: YARN-10929. Refrain from creating new Configuration object in AbstractManagedParentQueue#initializeLeafQueueConfigs

2021-09-01 Thread GitBox
JackWangCS commented on a change in pull request #3361: URL: https://github.com/apache/hadoop/pull/3361#discussion_r700368168 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager

[GitHub] [hadoop] akshatb1 commented on pull request #3325: YARN-10893. Adding metrics for getClusterMetrics and getApplications APIs in FederationClientInterceptor

2021-09-01 Thread GitBox
akshatb1 commented on pull request #3325: URL: https://github.com/apache/hadoop/pull/3325#issuecomment-910427859 @goiri @bibinchundatt Could you kindly help in reviewing this PR? Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[jira] [Comment Edited] (HADOOP-17847) S3AInstrumentation Closing output stream statistics while data is still marked as pending upload in OutputStreamStatistics

2021-09-01 Thread Chris Nix (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17404352#comment-17404352 ] Chris Nix edited comment on HADOOP-17847 at 9/1/21, 3:41 PM:

[jira] [Commented] (HADOOP-17881) S3A DeleteOperation to parallelize POSTing of bulk deletes

2021-09-01 Thread Bogdan Stolojan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17408240#comment-17408240 ] Bogdan Stolojan commented on HADOOP-17881: -- This is a cool idea (y) > S3A Del

[GitHub] [hadoop] hadoop-yetus commented on pull request #3346: HDFS-16188. RBF: Router to support resolving monitored namenodes with DNS

2021-09-01 Thread GitBox
hadoop-yetus commented on pull request #3346: URL: https://github.com/apache/hadoop/pull/3346#issuecomment-910391558 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[jira] [Created] (HADOOP-17884) FsShell to use openFile(sequential) for reads

2021-09-01 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-17884: --- Summary: FsShell to use openFile(sequential) for reads Key: HADOOP-17884 URL: https://issues.apache.org/jira/browse/HADOOP-17884 Project: Hadoop Common

[jira] [Created] (HADOOP-17883) openFile() to add standard options for read policies, start/end ranges

2021-09-01 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-17883: --- Summary: openFile() to add standard options for read policies, start/end ranges Key: HADOOP-17883 URL: https://issues.apache.org/jira/browse/HADOOP-17883 Projec

[jira] [Created] (HADOOP-17882) distcp to use openFile() with sequential IO; ranges of reads

2021-09-01 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-17882: --- Summary: distcp to use openFile() with sequential IO; ranges of reads Key: HADOOP-17882 URL: https://issues.apache.org/jira/browse/HADOOP-17882 Project: Hadoop

[jira] [Updated] (HADOOP-16202) Stabilize openFile() and adopt internally

2021-09-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16202: Parent: (was: HADOOP-16829) Issue Type: Bug (was: Sub-task) > Stabilize open

[jira] [Commented] (HADOOP-17847) S3AInstrumentation Closing output stream statistics while data is still marked as pending upload in OutputStreamStatistics

2021-09-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17408221#comment-17408221 ] Steve Loughran commented on HADOOP-17847: - That error there is to force halt ap

[GitHub] [hadoop] amahussein commented on pull request #3322: HDFS-6874. Add GETFILEBLOCKLOCATIONS operation to HttpFS.

2021-09-01 Thread GitBox
amahussein commented on pull request #3322: URL: https://github.com/apache/hadoop/pull/3322#issuecomment-910371397 Hey @jojochuang Thanks for the recent fixes. Are you still working on making changes to the PR or should I start doing a quick review? Have you checked whether th

[jira] [Updated] (HADOOP-17482) Remove Commons Logger from FileSystem Class

2021-09-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17482: Hadoop Flags: Incompatible change,Reviewed (was: Reviewed) Release Note: The protecte

[jira] [Commented] (HADOOP-17482) Remove Commons Logger from FileSystem Class

2021-09-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17408216#comment-17408216 ] Steve Loughran commented on HADOOP-17482: - probably time to backport; if things

[GitHub] [hadoop] hadoop-yetus commented on pull request #3334: HDFS-16186 Datanode kicks out hard disk logic optimization

2021-09-01 Thread GitBox
hadoop-yetus commented on pull request #3334: URL: https://github.com/apache/hadoop/pull/3334#issuecomment-910357492 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[jira] [Work logged] (HADOOP-17804) Prometheus metrics only include the last set of labels

2021-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17804?focusedWorklogId=645280&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-645280 ] ASF GitHub Bot logged work on HADOOP-17804: --- Author: ASF GitHub B

[jira] [Updated] (HADOOP-17804) Prometheus metrics only include the last set of labels

2021-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17804: Labels: pull-request-available (was: ) > Prometheus metrics only include the last set of

[GitHub] [hadoop] Kimahriman opened a new pull request #3369: HADOOP-17804. Expose prometheus metrics only after a flush and dedupe with tag values

2021-09-01 Thread GitBox
Kimahriman opened a new pull request #3369: URL: https://github.com/apache/hadoop/pull/3369 ### Description of PR Fixes a bug with the Prometheus metrics sink where metrics were deduped on their name alone, and didn't include the tag values for deduplication purposes. Prometheus

[jira] [Work logged] (HADOOP-17223) update org.apache.httpcomponents:httpclient to 4.5.13 and httpcore to 4.4.13

2021-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17223?focusedWorklogId=645279&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-645279 ] ASF GitHub Bot logged work on HADOOP-17223: --- Author: ASF GitHub B

[GitHub] [hadoop] amahussein commented on pull request #3363: HADOOP-17223. backport to branch-2.10 bumping httpclient and httpcore

2021-09-01 Thread GitBox
amahussein commented on pull request #3363: URL: https://github.com/apache/hadoop/pull/3363#issuecomment-910316984 > Thank you @amahussein for the PR. Given the PR includes 2 issues, I don't want to squash the commits. I'll apply the patch locally and push them, and then close this issue.

[jira] [Created] (HADOOP-17881) S3A DeleteOperation to parallelize POSTing of bulk deletes

2021-09-01 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-17881: --- Summary: S3A DeleteOperation to parallelize POSTing of bulk deletes Key: HADOOP-17881 URL: https://issues.apache.org/jira/browse/HADOOP-17881 Project: Hadoop Com

[jira] [Work logged] (HADOOP-17874) ExceptionsHandler to add terse/suppressed Exceptions in thread-safe manner

2021-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17874?focusedWorklogId=645267&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-645267 ] ASF GitHub Bot logged work on HADOOP-17874: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3343: HADOOP-17874. ExceptionsHandler to add terse/suppressed Exceptions in thread-safe manner

2021-09-01 Thread GitBox
hadoop-yetus commented on pull request #3343: URL: https://github.com/apache/hadoop/pull/3343#issuecomment-910291409 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] hadoop-yetus commented on pull request #3351: HDFS-16191. [FGL] Fix FSImage loading issues on dynamic partitions

2021-09-01 Thread GitBox
hadoop-yetus commented on pull request #3351: URL: https://github.com/apache/hadoop/pull/3351#issuecomment-910276442 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] hadoop-yetus commented on pull request #3367: HDFS-16202. Use constants HdfsClientConfigKeys.Failover.PREFIX instead of "dfs.client.failover."

2021-09-01 Thread GitBox
hadoop-yetus commented on pull request #3367: URL: https://github.com/apache/hadoop/pull/3367#issuecomment-910255216 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] hadoop-yetus commented on pull request #3359: HDFS-16198. Short circuit read leaks Slot objects when InvalidToken exception is thrown

2021-09-01 Thread GitBox
hadoop-yetus commented on pull request #3359: URL: https://github.com/apache/hadoop/pull/3359#issuecomment-910252199 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] jianghuazhu opened a new pull request #3368: HDFS-16204.Improve FSDirEncryptionZoneOp related parameter comments.

2021-09-01 Thread GitBox
jianghuazhu opened a new pull request #3368: URL: https://github.com/apache/hadoop/pull/3368 ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HAD

[GitHub] [hadoop] hadoop-yetus commented on pull request #3359: HDFS-16198. Short circuit read leaks Slot objects when InvalidToken exception is thrown

2021-09-01 Thread GitBox
hadoop-yetus commented on pull request #3359: URL: https://github.com/apache/hadoop/pull/3359#issuecomment-910231688 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] ferhui merged pull request #2894: HDFS-15966. Empty the statistical parameters when emptying the redundant queue

2021-09-01 Thread GitBox
ferhui merged pull request #2894: URL: https://github.com/apache/hadoop/pull/2894 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-un

[GitHub] [hadoop] brumi1024 commented on a change in pull request #3361: YARN-10929. Refrain from creating new Configuration object in AbstractManagedParentQueue#initializeLeafQueueConfigs

2021-09-01 Thread GitBox
brumi1024 commented on a change in pull request #3361: URL: https://github.com/apache/hadoop/pull/3361#discussion_r700119052 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/

[GitHub] [hadoop] tomscut opened a new pull request #3366: HDFS-16203. Discover datanodes with unbalanced block pool usage by th…

2021-09-01 Thread GitBox
tomscut opened a new pull request #3366: URL: https://github.com/apache/hadoop/pull/3366 JIRA: [HDFS-16203](https://issues.apache.org/jira/browse/HDFS-16203) **Discover datanodes with unbalanced volume usage by the standard deviation.** **In some scenarios, we may cause unbala

[GitHub] [hadoop] virajjasani commented on pull request #3343: HADOOP-17874. ExceptionsHandler to add terse/suppressed Exceptions in thread-safe manner

2021-09-01 Thread GitBox
virajjasani commented on pull request #3343: URL: https://github.com/apache/hadoop/pull/3343#issuecomment-910156097 @steveloughran I have just pushed an addendum to get rid of creating entire map and reassigning the newly created map to volatile instance, and rather simplified it by using

[jira] [Work logged] (HADOOP-17874) ExceptionsHandler to add terse/suppressed Exceptions in thread-safe manner

2021-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17874?focusedWorklogId=645206&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-645206 ] ASF GitHub Bot logged work on HADOOP-17874: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3359: HDFS-16198. Short circuit read leaks Slot objects when InvalidToken exception is thrown

2021-09-01 Thread GitBox
hadoop-yetus commented on pull request #3359: URL: https://github.com/apache/hadoop/pull/3359#issuecomment-910149907 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] jianghuazhu commented on pull request #3365: YARN-10931.Remove some invalid characters in NMClientAsyncImpl#ContainerState.

2021-09-01 Thread GitBox
jianghuazhu commented on pull request #3365: URL: https://github.com/apache/hadoop/pull/3365#issuecomment-910122152 @tangzhankun @zhuqi-lucas , can you help review the code. thank you very much. -- This is an automated message from the Apache Git Service. To respond to the message

[jira] [Work logged] (HADOOP-17223) update org.apache.httpcomponents:httpclient to 4.5.13 and httpcore to 4.4.13

2021-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17223?focusedWorklogId=645186&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-645186 ] ASF GitHub Bot logged work on HADOOP-17223: --- Author: ASF GitHub B

[GitHub] [hadoop] singer-bin commented on pull request #3334: HDFS-16186 Datanode kicks out hard disk logic optimization

2021-09-01 Thread GitBox
singer-bin commented on pull request #3334: URL: https://github.com/apache/hadoop/pull/3334#issuecomment-910098401 @jianghuazhu Hello, I’m a novice, I’m not sure if the patch failed is related to my code, can you help me? -- This is an automated message from the Apache Git Service. To re

[GitHub] [hadoop] aajisaka commented on a change in pull request #2724: HDFS-15862. Rename file back to original in TestViewfsWithNfs3.testNfsRenameSingleNN()

2021-09-01 Thread GitBox
aajisaka commented on a change in pull request #2724: URL: https://github.com/apache/hadoop/pull/2724#discussion_r700048007 ## File path: hadoop-hdfs-project/hadoop-hdfs-nfs/src/test/java/org/apache/hadoop/hdfs/nfs/nfs3/TestViewfsWithNfs3.java ## @@ -316,6 +316,10 @@ public vo

[GitHub] [hadoop] LeonGao91 commented on a change in pull request #3346: HDFS-16188. RBF: Router to support resolving monitored namenodes with DNS

2021-09-01 Thread GitBox
LeonGao91 commented on a change in pull request #3346: URL: https://github.com/apache/hadoop/pull/3346#discussion_r699903225 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/NamenodeHeartbeatService.java ## @@ -113

[GitHub] [hadoop] aajisaka commented on pull request #3363: HADOOP-17223. backport to branch-2.10 bumping httpclient and httpcore

2021-09-01 Thread GitBox
aajisaka commented on pull request #3363: URL: https://github.com/apache/hadoop/pull/3363#issuecomment-910107291 Thank you @amahussein for the PR. Given the PR includes 2 issues, I don't want to squash the commits. I'll apply the patch locally and push them, and then close this issue. --

[jira] [Work logged] (HADOOP-17868) Add more test for the BuiltInGzipCompressor

2021-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17868?focusedWorklogId=645177&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-645177 ] ASF GitHub Bot logged work on HADOOP-17868: --- Author: ASF GitHub B

[GitHub] [hadoop] sunchao commented on a change in pull request #3336: HADOOP-17868. Add more tests for BuiltInGzipCompressor

2021-09-01 Thread GitBox
sunchao commented on a change in pull request #3336: URL: https://github.com/apache/hadoop/pull/3336#discussion_r699512553 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/compress/TestCodec.java ## @@ -725,6 +726,172 @@ public void testGzip

[GitHub] [hadoop] hadoop-yetus commented on pull request #3346: HDFS-16188. RBF: Router to support resolving monitored namenodes with DNS

2021-09-01 Thread GitBox
hadoop-yetus commented on pull request #3346: URL: https://github.com/apache/hadoop/pull/3346#issuecomment-909081414 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

[GitHub] [hadoop] goiri commented on a change in pull request #3346: HDFS-16188. RBF: Router to support resolving monitored namenodes with DNS

2021-09-01 Thread GitBox
goiri commented on a change in pull request #3346: URL: https://github.com/apache/hadoop/pull/3346#discussion_r699774160 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/NamenodeHeartbeatService.java ## @@ -113,47

[GitHub] [hadoop] hadoop-yetus commented on pull request #3361: YARN-10929. Refrain from creating new Configuration object in AbstractManagedParentQueue#initializeLeafQueueConfigs

2021-09-01 Thread GitBox
hadoop-yetus commented on pull request #3361: URL: https://github.com/apache/hadoop/pull/3361#issuecomment-909528233 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] hadoop-yetus commented on pull request #3358: YARN-10930. Introduce universal capacity resource vector

2021-09-01 Thread GitBox
hadoop-yetus commented on pull request #3358: URL: https://github.com/apache/hadoop/pull/3358#issuecomment-909173124 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] hadoop-yetus commented on pull request #3364: HDFS-16200: Improve NameNode failover

2021-09-01 Thread GitBox
hadoop-yetus commented on pull request #3364: URL: https://github.com/apache/hadoop/pull/3364#issuecomment-909799030 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] virajjasani commented on a change in pull request #3359: HDFS-16198. Short circuit read leaks Slot objects when InvalidToken exception is thrown

2021-09-01 Thread GitBox
virajjasani commented on a change in pull request #3359: URL: https://github.com/apache/hadoop/pull/3359#discussion_r699484858 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockTokenWithShortCircuitRead.java ## @

[GitHub] [hadoop] tomscut commented on pull request #3288: HDFS-16158. Discover datanodes with unbalanced volume usage by the st…

2021-09-01 Thread GitBox
tomscut commented on pull request #3288: URL: https://github.com/apache/hadoop/pull/3288#issuecomment-909761516 Hi @jojochuang , this PR has a lot of changes, which can make rolling updates difficult. I re-implemented this feature and will submit another PR later. Thank you for your review

[GitHub] [hadoop] aajisaka commented on pull request #2500: MAPREDUCE-7311. Clear filesystem statistics after tests in TestTaskProgressReporter

2021-09-01 Thread GitBox
aajisaka commented on pull request #2500: URL: https://github.com/apache/hadoop/pull/2500#issuecomment-909881265 Merged. Thank you @lzx404243 for stabilizing tests. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hadoop] hadoop-yetus commented on pull request #3360: YARN-10909. AbstractCSQueue: add @VisibleForTesting annotation for test code

2021-09-01 Thread GitBox
hadoop-yetus commented on pull request #3360: URL: https://github.com/apache/hadoop/pull/3360#issuecomment-909482331 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[jira] [Work logged] (HADOOP-17868) Add more test for the BuiltInGzipCompressor

2021-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17868?focusedWorklogId=645101&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-645101 ] ASF GitHub Bot logged work on HADOOP-17868: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran merged pull request #3338: HADOOP-17870 Make Http Filesystem allow non-absolute uri based paths.

2021-09-01 Thread GitBox
steveloughran merged pull request #3338: URL: https://github.com/apache/hadoop/pull/3338 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-is

[GitHub] [hadoop] hadoop-yetus commented on pull request #3200: HDFS-15160. branch-3.2. ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock.

2021-09-01 Thread GitBox
hadoop-yetus commented on pull request #3200: URL: https://github.com/apache/hadoop/pull/3200#issuecomment-909105949 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

[jira] [Work logged] (HADOOP-17870) HTTP Filesystem to qualify paths in open()/getFileStatus()

2021-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17870?focusedWorklogId=645102&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-645102 ] ASF GitHub Bot logged work on HADOOP-17870: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-17873) ABFS: Fix transient failures in ITestAbfsStreamStatistics and ITestAbfsRestOperationException

2021-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17873?focusedWorklogId=645090&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-645090 ] ASF GitHub Bot logged work on HADOOP-17873: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on pull request #3341: HADOOP-17873. ABFS: Fix transient failures in ITestAbfsStreamStatistics and ITestAbfsRestOperationException

2021-09-01 Thread GitBox
steveloughran commented on pull request #3341: URL: https://github.com/apache/hadoop/pull/3341#issuecomment-909207833 > they are the same across different tests/test classes run in parallel > we do reset currently during test run but it hasn't helped, so marking in pom for sequential se

[GitHub] [hadoop] viirya commented on a change in pull request #3336: HADOOP-17868. Add more tests for BuiltInGzipCompressor

2021-09-01 Thread GitBox
viirya commented on a change in pull request #3336: URL: https://github.com/apache/hadoop/pull/3336#discussion_r699650509 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/compress/TestCodec.java ## @@ -725,6 +726,172 @@ public void testGzipC

[GitHub] [hadoop] tomscut closed pull request #3288: HDFS-16158. Discover datanodes with unbalanced volume usage by the st…

2021-09-01 Thread GitBox
tomscut closed pull request #3288: URL: https://github.com/apache/hadoop/pull/3288 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-u

[GitHub] [hadoop] hadoop-yetus commented on pull request #3357: HDFS-16197.Simplify getting NNStorage in FSNamesystem.

2021-09-01 Thread GitBox
hadoop-yetus commented on pull request #3357: URL: https://github.com/apache/hadoop/pull/3357#issuecomment-909077338 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Updated] (HADOOP-17223) update org.apache.httpcomponents:httpclient to 4.5.13 and httpcore to 4.4.13

2021-09-01 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17223: --- Fix Version/s: 2.10.2 Target Version/s: 3.3.1, 3.2.2, 3.4.0 (was: 3.2.2, 3.3.1, 3.4.

[jira] [Commented] (HADOOP-15584) move httpcomponents version in pom.xml

2021-09-01 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17408033#comment-17408033 ] Akira Ajisaka commented on HADOOP-15584: Backported to branch-2.10. > move htt

[jira] [Updated] (HADOOP-15584) move httpcomponents version in pom.xml

2021-09-01 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-15584: --- Fix Version/s: 2.10.2 > move httpcomponents version in pom.xml > --

[jira] [Work logged] (HADOOP-17878) Add config for Aliyun OSS cnam support

2021-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17878?focusedWorklogId=645033&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-645033 ] ASF GitHub Bot logged work on HADOOP-17878: --- Author: ASF GitHub B

[GitHub] [hadoop] stczwd commented on pull request #3345: HDFS-16189: add config for aliyun oss cname support

2021-09-01 Thread GitBox
stczwd commented on pull request #3345: URL: https://github.com/apache/hadoop/pull/3345#issuecomment-909068132 cc @steveloughran @jianghuazhu @ferhui -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

  1   2   >