[jira] [Resolved] (HADOOP-17008) Release Hadoop 3.3.0

2021-06-01 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-17008. -- Resolution: Done > Release Hadoop 3.3.0 > > > Ke

[jira] [Work logged] (HADOOP-17152) Implement wrapper for guava newArrayList and newLinkedList

2021-06-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17152?focusedWorklogId=604972&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-604972 ] ASF GitHub Bot logged work on HADOOP-17152: --- Author: ASF GitHub B

[GitHub] [hadoop] virajjasani commented on pull request #3061: HADOOP-17152. Provide Hadoop's own Lists utility to reduce dependency on Guava

2021-06-01 Thread GitBox
virajjasani commented on pull request #3061: URL: https://github.com/apache/hadoop/pull/3061#issuecomment-852777497 @jojochuang HADOOP-17098 provides best reasons for this. Shading Guava in HADOOP-17288 solves the conflicts of Guava library in Hadoop upstream, downstreams, and the ot

[jira] [Work logged] (HADOOP-17727) Modularize docker images

2021-06-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17727?focusedWorklogId=604959&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-604959 ] ASF GitHub Bot logged work on HADOOP-17727: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3043: HADOOP-17727. Modularize docker images

2021-06-01 Thread GitBox
hadoop-yetus commented on pull request #3043: URL: https://github.com/apache/hadoop/pull/3043#issuecomment-852759468 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at https://ci-hadoop.apac

[jira] [Work logged] (HADOOP-17727) Modularize docker images

2021-06-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17727?focusedWorklogId=604956&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-604956 ] ASF GitHub Bot logged work on HADOOP-17727: --- Author: ASF GitHub B

[GitHub] [hadoop] GauthamBanasandra commented on pull request #3043: HADOOP-17727. Modularize docker images

2021-06-01 Thread GitBox
GauthamBanasandra commented on pull request #3043: URL: https://github.com/apache/hadoop/pull/3043#issuecomment-852758032 Thanks for the suggestion @jojochuang . I've added `**/*.json` to RAT's exclusion list. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] GauthamBanasandra commented on pull request #3038: HADOOP-17724. Add Dockerfile for Debian 10

2021-06-01 Thread GitBox
GauthamBanasandra commented on pull request #3038: URL: https://github.com/apache/hadoop/pull/3038#issuecomment-852735947 Yes, definitely @jojochuang . I'll mark this PR as draft till then. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Work logged] (HADOOP-17724) Add Dockerfile for Debian 10

2021-06-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17724?focusedWorklogId=604955&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-604955 ] ASF GitHub Bot logged work on HADOOP-17724: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-17724) Add Dockerfile for Debian 10

2021-06-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17724?focusedWorklogId=604952&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-604952 ] ASF GitHub Bot logged work on HADOOP-17724: --- Author: ASF GitHub B

[GitHub] [hadoop] jojochuang commented on pull request #3038: HADOOP-17724. Add Dockerfile for Debian 10

2021-06-01 Thread GitBox
jojochuang commented on pull request #3038: URL: https://github.com/apache/hadoop/pull/3038#issuecomment-852726400 Should we rework this one after the docker file modularization work is complete? -- This is an automated message from the Apache Git Service. To respond to the message, plea

[jira] [Work logged] (HADOOP-17727) Modularize docker images

2021-06-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17727?focusedWorklogId=604951&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-604951 ] ASF GitHub Bot logged work on HADOOP-17727: --- Author: ASF GitHub B

[GitHub] [hadoop] jojochuang commented on pull request #3043: HADOOP-17727. Modularize docker images

2021-06-01 Thread GitBox
jojochuang commented on pull request #3043: URL: https://github.com/apache/hadoop/pull/3043#issuecomment-852725927 > Unfortunately, the ASF license check warnings are originating from the JSON files and since there's no way to add comments to a JSON file, we can't add the license. could

[GitHub] [hadoop] whbing commented on a change in pull request #2918: HDFS-15987. Improve oiv tool to parse fsimage file in parallel with d…

2021-06-01 Thread GitBox
whbing commented on a change in pull request #2918: URL: https://github.com/apache/hadoop/pull/2918#discussion_r643645858 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/offlineImageViewer/OfflineImageViewerPB.java ## @@ -132,6 +133,7 @

[GitHub] [hadoop] whbing commented on a change in pull request #2918: HDFS-15987. Improve oiv tool to parse fsimage file in parallel with d…

2021-06-01 Thread GitBox
whbing commented on a change in pull request #2918: URL: https://github.com/apache/hadoop/pull/2918#discussion_r643635111 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/offlineImageViewer/PBImageDelimitedTextWriter.java ## @@ -146,7 +1

[GitHub] [hadoop] tomscut commented on a change in pull request #3062: HDFS-16048. RBF: Print network topology on the router web

2021-06-01 Thread GitBox
tomscut commented on a change in pull request #3062: URL: https://github.com/apache/hadoop/pull/3062#discussion_r643597149 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/RouterNetworkTopologyServlet.java ## @@ -0

[jira] [Work logged] (HADOOP-15566) Support OpenTelemetry

2021-06-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15566?focusedWorklogId=604757&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-604757 ] ASF GitHub Bot logged work on HADOOP-15566: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #2816: HADOOP-15566 initial changes for opentelemetry - WIP

2021-06-01 Thread GitBox
hadoop-yetus commented on pull request #2816: URL: https://github.com/apache/hadoop/pull/2816#issuecomment-852415404 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] hadoop-yetus commented on pull request #3065: HDFS-13671. Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-01 Thread GitBox
hadoop-yetus commented on pull request #3065: URL: https://github.com/apache/hadoop/pull/3065#issuecomment-852363993 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] goiri commented on a change in pull request #3062: HDFS-16048. RBF: Print network topology on the router web

2021-06-01 Thread GitBox
goiri commented on a change in pull request #3062: URL: https://github.com/apache/hadoop/pull/3062#discussion_r643394337 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/RouterNetworkTopologyServlet.java ## @@ -0,0

[jira] [Work logged] (HADOOP-15566) Support OpenTelemetry

2021-06-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15566?focusedWorklogId=604625&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-604625 ] ASF GitHub Bot logged work on HADOOP-15566: --- Author: ASF GitHub B

[GitHub] [hadoop] ArkenKiran commented on pull request #2816: HADOOP-15566 initial changes for opentelemetry - WIP

2021-06-01 Thread GitBox
ArkenKiran commented on pull request #2816: URL: https://github.com/apache/hadoop/pull/2816#issuecomment-852289733 @steveloughran I have made changes to use opentelemetry-autoinitialse which needs the exporter only in runtime. while using the opentelemetry-jaeger-exporter I see some confli

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2021-06-01 Thread GitBox
hadoop-yetus removed a comment on pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#issuecomment-848333030 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2021-06-01 Thread GitBox
hadoop-yetus removed a comment on pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#issuecomment-846286608 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2021-06-01 Thread GitBox
hadoop-yetus removed a comment on pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#issuecomment-848166747 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[jira] [Updated] (HADOOP-17337) S3A NetworkBinding has a runtime class dependency on a third-party shaded class

2021-06-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17337: Parent: HADOOP-17566 Issue Type: Sub-task (was: Bug) > S3A NetworkBinding has a

[jira] [Commented] (HADOOP-16829) Über-jira: S3A Hadoop 3.3.1 features

2021-06-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17355220#comment-17355220 ] Steve Loughran commented on HADOOP-16829: - ahh, bad i18n in the script writers.

[jira] [Work logged] (HADOOP-17727) Modularize docker images

2021-06-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17727?focusedWorklogId=604539&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-604539 ] ASF GitHub Bot logged work on HADOOP-17727: --- Author: ASF GitHub B

[GitHub] [hadoop] GauthamBanasandra edited a comment on pull request #3043: HADOOP-17727. Modularize docker images

2021-06-01 Thread GitBox
GauthamBanasandra edited a comment on pull request #3043: URL: https://github.com/apache/hadoop/pull/3043#issuecomment-852178467 Thanks for the review @jojochuang . > we'll need to verify other docker images manually. Yes, I'm running the builds for the rest of them manually.

[jira] [Work logged] (HADOOP-17727) Modularize docker images

2021-06-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17727?focusedWorklogId=604538&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-604538 ] ASF GitHub Bot logged work on HADOOP-17727: --- Author: ASF GitHub B

[GitHub] [hadoop] GauthamBanasandra commented on pull request #3043: HADOOP-17727. Modularize docker images

2021-06-01 Thread GitBox
GauthamBanasandra commented on pull request #3043: URL: https://github.com/apache/hadoop/pull/3043#issuecomment-852178467 Thanks for the review @jojochuang . > we'll need to verify other docker images manually. Yes, I'm running the builds for the rest of them manually. I'll attach the

[GitHub] [hadoop] Hexiaoqiao commented on a change in pull request #2918: HDFS-15987. Improve oiv tool to parse fsimage file in parallel with d…

2021-06-01 Thread GitBox
Hexiaoqiao commented on a change in pull request #2918: URL: https://github.com/apache/hadoop/pull/2918#discussion_r643135023 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/offlineImageViewer/PBImageTextWriter.java ## @@ -640,6 +657,19

[jira] [Work logged] (HADOOP-17727) Modularize docker images

2021-06-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17727?focusedWorklogId=604460&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-604460 ] ASF GitHub Bot logged work on HADOOP-17727: --- Author: ASF GitHub B

[GitHub] [hadoop] jojochuang commented on pull request #3043: HADOOP-17727. Modularize docker images

2021-06-01 Thread GitBox
jojochuang commented on pull request #3043: URL: https://github.com/apache/hadoop/pull/3043#issuecomment-852070807 Looks good to me. The precommit only verifies ubuntu x86, so we'll need to verify other docker images manually. Can you also address the asf license check warning? -- Thi

[GitHub] [hadoop] AlphaGouGe opened a new pull request #3065: HDFS-13671. Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-01 Thread GitBox
AlphaGouGe opened a new pull request #3065: URL: https://github.com/apache/hadoop/pull/3065 https://issues.apache.org/jira/browse/HDFS-13671 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

[jira] [Commented] (HADOOP-17741) RPC authentication based on user and IP

2021-06-01 Thread Xiangyi Zhu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17354996#comment-17354996 ] Xiangyi Zhu commented on HADOOP-17741: -- [~hexiaoqiao],[Ayush Saxena,|https://issu

[jira] [Created] (HADOOP-17741) RPC authentication based on user and IP

2021-06-01 Thread Xiangyi Zhu (Jira)
Xiangyi Zhu created HADOOP-17741: Summary: RPC authentication based on user and IP Key: HADOOP-17741 URL: https://issues.apache.org/jira/browse/HADOOP-17741 Project: Hadoop Common Issue Type:

[jira] [Commented] (HADOOP-16878) FileUtil.copy() to throw IOException if the source and destination are the same

2021-06-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17354995#comment-17354995 ] Steve Loughran commented on HADOOP-16878: - I think we should roll back for now

[jira] [Work logged] (HADOOP-17152) Implement wrapper for guava newArrayList and newLinkedList

2021-06-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17152?focusedWorklogId=604427&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-604427 ] ASF GitHub Bot logged work on HADOOP-17152: --- Author: ASF GitHub B

[GitHub] [hadoop] virajjasani commented on pull request #3061: HADOOP-17152. Provide Hadoop's own Lists utility to reduce dependency on Guava

2021-06-01 Thread GitBox
virajjasani commented on pull request #3061: URL: https://github.com/apache/hadoop/pull/3061#issuecomment-852014244 Thanks for the review @bogthe. I understand about providing comments for immutable alternatives but specifically in the case of `List`, Hadoop does not require any. I have ch

[GitHub] [hadoop] ferhui commented on pull request #2894: HDFS-15966. Empty the statistical parameters when emptying the redundant queue

2021-06-01 Thread GitBox
ferhui commented on pull request #2894: URL: https://github.com/apache/hadoop/pull/2894#issuecomment-851982812 @langlaile1221 it looks good, thanks for contribution. Could you please push an empty commit to trigger CI? -- This is an automated message from the Apache Git Service. To respo

[GitHub] [hadoop] langlaile1221 opened a new pull request #2894: HDFS-15966. Empty the statistical parameters when emptying the redundant queue

2021-06-01 Thread GitBox
langlaile1221 opened a new pull request #2894: URL: https://github.com/apache/hadoop/pull/2894 Clear the two indicators highestPriorityLowRedundancyReplicatedBlocks and highestPriorityLowRedundancyReplicatedBlocks when emptying the redundant queue. -- This is an automated message from th

[GitHub] [hadoop] ferhui closed pull request #2894: HDFS-15966. Empty the statistical parameters when emptying the redundant queue

2021-06-01 Thread GitBox
ferhui closed pull request #2894: URL: https://github.com/apache/hadoop/pull/2894 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please c

[jira] [Updated] (HADOOP-16878) FileUtil.copy() to throw IOException if the source and destination are the same

2021-06-01 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-16878: - Fix Version/s: (was: 3.3.1) > FileUtil.copy() to throw IOException if the source an

[jira] [Work logged] (HADOOP-17631) Configuration ${env.VAR:-FALLBACK} should eval FALLBACK when restrictSystemProps=true

2021-06-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17631?focusedWorklogId=604356&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-604356 ] ASF GitHub Bot logged work on HADOOP-17631: --- Author: ASF GitHub B

[GitHub] [hadoop] mukund-thakur commented on pull request #2977: HADOOP-17631. Configuration ${env.VAR:-FALLBACK} to eval FALLBACK when restrictSystemProps=true

2021-06-01 Thread GitBox
mukund-thakur commented on pull request #2977: URL: https://github.com/apache/hadoop/pull/2977#issuecomment-851907260 The logic is bit complex but as far as I understand looks good to me. +1 Nice tests as well. -- This is an automated message from the Apache Git Service. To respond t

[GitHub] [hadoop] jojochuang merged pull request #3036: HDFS-15998. Fix NullPointException In listOpenFiles

2021-06-01 Thread GitBox
jojochuang merged pull request #3036: URL: https://github.com/apache/hadoop/pull/3036 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, plea

[jira] [Work logged] (HADOOP-17727) Modularize docker images

2021-06-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17727?focusedWorklogId=604350&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-604350 ] ASF GitHub Bot logged work on HADOOP-17727: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3043: HADOOP-17727. Modularize docker images

2021-06-01 Thread GitBox
hadoop-yetus commented on pull request #3043: URL: https://github.com/apache/hadoop/pull/3043#issuecomment-851891110 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[jira] [Work logged] (HADOOP-17727) Modularize docker images

2021-06-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17727?focusedWorklogId=604341&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-604341 ] ASF GitHub Bot logged work on HADOOP-17727: --- Author: ASF GitHub B

[GitHub] [hadoop] GauthamBanasandra commented on a change in pull request #3043: HADOOP-17727. Modularize docker images

2021-06-01 Thread GitBox
GauthamBanasandra commented on a change in pull request #3043: URL: https://github.com/apache/hadoop/pull/3043#discussion_r642835029 ## File path: dev-support/docker/Dockerfile_centos_7 ## @@ -23,79 +23,28 @@ WORKDIR /root SHELL ["/bin/bash", "-o", "pipefail", "-c"] +#