[jira] [Commented] (HADOOP-18167) Add metrics to track delegation token secret manager operations

2022-03-22 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511016#comment-17511016 ] Hadoop QA commented on HADOOP-18167: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Work logged] (HADOOP-18169) getDelegationTokens in ViewFs should also fetch the token from the fallback FS

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18169?focusedWorklogId=746342=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-746342 ] ASF GitHub Bot logged work on HADOOP-18169: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4094: HADOOP-18169. getDelegationTokens in ViewFs should also fetch the token from fallback FS

2022-03-22 Thread GitBox
hadoop-yetus commented on pull request #4094: URL: https://github.com/apache/hadoop/pull/4094#issuecomment-1075901869 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-18088) Replace log4j 1.x with reload4j

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18088?focusedWorklogId=746335=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-746335 ] ASF GitHub Bot logged work on HADOOP-18088: --- Author: ASF GitHub Bot

[GitHub] [hadoop] iwasakims commented on pull request #4084: HADOOP-18088. Replace log4j 1.x with reload4j.

2022-03-22 Thread GitBox
iwasakims commented on pull request #4084: URL: https://github.com/apache/hadoop/pull/4084#issuecomment-1075889761 Thanks, @steveloughran. merged this to branch-3.2. If I need to cut 3.2.3 RC2, cherry-picking this to branch-3.2.3 could be an option. -- This is an automated message from

[jira] [Work logged] (HADOOP-18088) Replace log4j 1.x with reload4j

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18088?focusedWorklogId=746333=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-746333 ] ASF GitHub Bot logged work on HADOOP-18088: --- Author: ASF GitHub Bot

[GitHub] [hadoop] iwasakims merged pull request #4084: HADOOP-18088. Replace log4j 1.x with reload4j.

2022-03-22 Thread GitBox
iwasakims merged pull request #4084: URL: https://github.com/apache/hadoop/pull/4084 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] Hexiaoqiao commented on pull request #2918: HDFS-15987. Improve oiv tool to parse fsimage file in parallel with d…

2022-03-22 Thread GitBox
Hexiaoqiao commented on pull request #2918: URL: https://github.com/apache/hadoop/pull/2918#issuecomment-1075880371 revert and re-check in to correct the git message. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Work logged] (HADOOP-18167) Add metrics to track delegation token secret manager operations

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18167?focusedWorklogId=746323=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-746323 ] ASF GitHub Bot logged work on HADOOP-18167: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4092: HADOOP-18167. Add metrics to track delegation token secret manager op…

2022-03-22 Thread GitBox
hadoop-yetus commented on pull request #4092: URL: https://github.com/apache/hadoop/pull/4092#issuecomment-1075876286 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Updated] (HADOOP-18167) Add metrics to track delegation token secret manager operations

2022-03-22 Thread Hector Sandoval Chaverri (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hector Sandoval Chaverri updated HADOOP-18167: -- Attachment: HADOOP-18167-branch-2.10.patch Status: Patch

[jira] [Work logged] (HADOOP-18169) getDelegationTokens in ViewFs should also fetch the token from the fallback FS

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18169?focusedWorklogId=746312=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-746312 ] ASF GitHub Bot logged work on HADOOP-18169: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4094: HADOOP-18169. getDelegationTokens in ViewFs should also fetch the token from fallback FS

2022-03-22 Thread GitBox
hadoop-yetus commented on pull request #4094: URL: https://github.com/apache/hadoop/pull/4094#issuecomment-1075861113 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-18169) getDelegationTokens in ViewFs should also fetch the token from the fallback FS

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18169?focusedWorklogId=746304=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-746304 ] ASF GitHub Bot logged work on HADOOP-18169: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4094: HADOOP-18169. getDelegationTokens in ViewFs should also fetch the token from fallback FS

2022-03-22 Thread GitBox
hadoop-yetus commented on pull request #4094: URL: https://github.com/apache/hadoop/pull/4094#issuecomment-1075837818 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] xinglin commented on a change in pull request #4089: HDFS-16515. Improve ec exception message

2022-03-22 Thread GitBox
xinglin commented on a change in pull request #4089: URL: https://github.com/apache/hadoop/pull/4089#discussion_r832768475 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirErasureCodingOp.java ## @@ -168,8 +168,8 @@

[GitHub] [hadoop] xinglin commented on a change in pull request #4091: HDFS-16517 Distance metric is wrong for non-DN machines in 2.10.

2022-03-22 Thread GitBox
xinglin commented on a change in pull request #4091: URL: https://github.com/apache/hadoop/pull/4091#discussion_r832726638 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/net/NetworkTopology.java ## @@ -823,7 +823,7 @@ private static int

[GitHub] [hadoop] hadoop-yetus commented on pull request #4091: HDFS-16517 Distance metric is wrong for non-DN machines in 2.10.

2022-03-22 Thread GitBox
hadoop-yetus commented on pull request #4091: URL: https://github.com/apache/hadoop/pull/4091#issuecomment-1075730771 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-18169) getDelegationTokens in ViewFs should also fetch the token from the fallback FS

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18169?focusedWorklogId=746204=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-746204 ] ASF GitHub Bot logged work on HADOOP-18169: --- Author: ASF GitHub Bot

[GitHub] [hadoop] abhishekdas99 commented on a change in pull request #4094: HADOOP-18169. getDelegationTokens in ViewFs should also fetch the token from fallback FS

2022-03-22 Thread GitBox
abhishekdas99 commented on a change in pull request #4094: URL: https://github.com/apache/hadoop/pull/4094#discussion_r832668185 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/viewfs/TestViewFsLinkFallback.java ## @@ -182,6 +184,26 @@ public

[jira] [Commented] (HADOOP-18167) Add metrics to track delegation token secret manager operations

2022-03-22 Thread Hector Sandoval Chaverri (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17510910#comment-17510910 ] Hector Sandoval Chaverri commented on HADOOP-18167: --- Hi [~ste...@apache.org], I saw

[jira] [Work logged] (HADOOP-18167) Add metrics to track delegation token secret manager operations

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18167?focusedWorklogId=746153=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-746153 ] ASF GitHub Bot logged work on HADOOP-18167: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4092: HADOOP-18167. Add metrics to track delegation token secret manager op…

2022-03-22 Thread GitBox
hadoop-yetus commented on pull request #4092: URL: https://github.com/apache/hadoop/pull/4092#issuecomment-1075642781 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #4093: YARN-11093: fix for reading files in timeline server in chronological order in case of fs-support-append to false

2022-03-22 Thread GitBox
hadoop-yetus commented on pull request #4093: URL: https://github.com/apache/hadoop/pull/4093#issuecomment-1075605670 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-18169) getDelegationTokens in ViewFs should also fetch the token from the fallback FS

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18169?focusedWorklogId=746103=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-746103 ] ASF GitHub Bot logged work on HADOOP-18169: --- Author: ASF GitHub Bot

[GitHub] [hadoop] xinglin commented on pull request #4094: HADOOP-18169. getDelegationTokens in ViewFs should also fetch the token from fallback FS

2022-03-22 Thread GitBox
xinglin commented on pull request #4094: URL: https://github.com/apache/hadoop/pull/4094#issuecomment-1075602418 > Could you add a pointer to where/how the corresponding logic lives in the non-abstract filesystem object, just to easily verify the logic is the same The logic is in

[GitHub] [hadoop] hadoop-yetus commented on pull request #4089: HDFS-16515. Improve ec exception message

2022-03-22 Thread GitBox
hadoop-yetus commented on pull request #4089: URL: https://github.com/apache/hadoop/pull/4089#issuecomment-1075580681 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #4091: HDFS-16517 Distance metric is wrong for non-DN machines in 2.10.

2022-03-22 Thread GitBox
hadoop-yetus commented on pull request #4091: URL: https://github.com/apache/hadoop/pull/4091#issuecomment-1075543846 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-18160) `org.wildfly.openssl` should not be shaded by Hadoop build

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18160?focusedWorklogId=746042=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-746042 ] ASF GitHub Bot logged work on HADOOP-18160: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-18160) `org.wildfly.openssl` should not be shaded by Hadoop build

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18160?focusedWorklogId=746044=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-746044 ] ASF GitHub Bot logged work on HADOOP-18160: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #4074: HADOOP-18160 Avoid shading wildfly.openssl runtime dependency

2022-03-22 Thread GitBox
hadoop-yetus removed a comment on pull request #4074: URL: https://github.com/apache/hadoop/pull/4074#issuecomment-1069297089 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hadoop] hadoop-yetus commented on pull request #4091: HDFS-16517 Distance metric is wrong for non-DN machines in 2.10.

2022-03-22 Thread GitBox
hadoop-yetus commented on pull request #4091: URL: https://github.com/apache/hadoop/pull/4091#issuecomment-1075521316 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] steveloughran commented on pull request #4074: HADOOP-18160 Avoid shading wildfly.openssl runtime dependency

2022-03-22 Thread GitBox
steveloughran commented on pull request #4074: URL: https://github.com/apache/hadoop/pull/4074#issuecomment-1075521131 ok, merged in to branch-3.3 and trunk. thank you! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [hadoop] hadoop-yetus commented on pull request #3470: YARN-10965. Centralize queue resource calculation based on CapacityVectors

2022-03-22 Thread GitBox
hadoop-yetus commented on pull request #3470: URL: https://github.com/apache/hadoop/pull/3470#issuecomment-1075518999 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Assigned] (HADOOP-18160) `org.wildfly.openssl` should not be shaded by Hadoop build

2022-03-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-18160: --- Assignee: André F. > `org.wildfly.openssl` should not be shaded by Hadoop build >

[jira] [Resolved] (HADOOP-18160) `org.wildfly.openssl` should not be shaded by Hadoop build

2022-03-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18160. - Fix Version/s: 3.3.3 Resolution: Fixed > `org.wildfly.openssl` should not be

[jira] [Work logged] (HADOOP-18169) getDelegationTokens in ViewFs should also fetch the token from the fallback FS

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18169?focusedWorklogId=746014=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-746014 ] ASF GitHub Bot logged work on HADOOP-18169: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4060: YARN-11084. Introduce new config to specify AM default node-label whe…

2022-03-22 Thread GitBox
hadoop-yetus commented on pull request #4060: URL: https://github.com/apache/hadoop/pull/4060#issuecomment-1075471974 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] mccormickt12 commented on a change in pull request #4094: HADOOP-18169. getDelegationTokens in ViewFs should also fetch the token from fallback FS

2022-03-22 Thread GitBox
mccormickt12 commented on a change in pull request #4094: URL: https://github.com/apache/hadoop/pull/4094#discussion_r832492192 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/ViewFs.java ## @@ -746,6 +746,17 @@ public void

[jira] [Updated] (HADOOP-18169) getDelegationTokens in ViewFs should also fetch the token from the fallback FS

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18169: Labels: pull-request-available (was: ) > getDelegationTokens in ViewFs should also

[jira] [Work logged] (HADOOP-18169) getDelegationTokens in ViewFs should also fetch the token from the fallback FS

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18169?focusedWorklogId=745998=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-745998 ] ASF GitHub Bot logged work on HADOOP-18169: --- Author: ASF GitHub Bot

[GitHub] [hadoop] xinglin opened a new pull request #4094: HADOOP-18169. getDelegationTokens in ViewFs should also fetch the token from fallback FS

2022-03-22 Thread GitBox
xinglin opened a new pull request #4094: URL: https://github.com/apache/hadoop/pull/4094 ### Description of PR ### How was this patch tested? mvn test -Dtest="TestViewFs*" in both hadoop-common-project and hadoop-hdfs-project. -- This is an automated

[jira] [Work logged] (HADOOP-14661) S3A to support Requester Pays Buckets

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14661?focusedWorklogId=745990=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-745990 ] ASF GitHub Bot logged work on HADOOP-14661: --- Author: ASF GitHub Bot

[GitHub] [hadoop] dannycjones commented on pull request #3962: HADOOP-14661. Add S3 requester pays bucket support to S3A

2022-03-22 Thread GitBox
dannycjones commented on pull request #3962: URL: https://github.com/apache/hadoop/pull/3962#issuecomment-1075435015 @steveloughran I caught those after I pushed most of the other fixes from the last feedback and pushed a second commit ae8e812e11148bcf007d51fbf94356229df4fae1.

[GitHub] [hadoop] GauthamBanasandra merged pull request #4086: HDFS-16471. Make HDFS ls tool cross platform

2022-03-22 Thread GitBox
GauthamBanasandra merged pull request #4086: URL: https://github.com/apache/hadoop/pull/4086 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Updated] (HADOOP-18169) getDelegationTokens in ViewFs should also fetch the token from the fallback FS

2022-03-22 Thread Xing Lin (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xing Lin updated HADOOP-18169: -- Summary: getDelegationTokens in ViewFs should also fetch the token from the fallback FS (was:

[jira] [Updated] (HADOOP-18169) getDelegationTokens in ViewFs should also fetch the token from the fallback FS

2022-03-22 Thread Xing Lin (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xing Lin updated HADOOP-18169: -- Description: getDelegationTokens in ViewFs does not include the delegationToken from the fallback

[jira] [Created] (HADOOP-18169) getDelegationToken in ViewFs should also fetch the token from the fallback FS

2022-03-22 Thread Xing Lin (Jira)
Xing Lin created HADOOP-18169: - Summary: getDelegationToken in ViewFs should also fetch the token from the fallback FS Key: HADOOP-18169 URL: https://issues.apache.org/jira/browse/HADOOP-18169 Project:

[GitHub] [hadoop] guptashailesh92 opened a new pull request #4093: YARN-11093: fix for reading files in timeline server in chronological order in case of fs-support-append to false

2022-03-22 Thread GitBox
guptashailesh92 opened a new pull request #4093: URL: https://github.com/apache/hadoop/pull/4093 ### Description of PR In our setup, we are using Hive and Tez and using offline tez-ui mode, where we copy the ATS events files to other place and start tez-ui. To keep the event

[jira] [Work logged] (HADOOP-18160) `org.wildfly.openssl` should not be shaded by Hadoop build

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18160?focusedWorklogId=745961=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-745961 ] ASF GitHub Bot logged work on HADOOP-18160: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran merged pull request #4074: HADOOP-18160 Avoid shading wildfly.openssl runtime dependency

2022-03-22 Thread GitBox
steveloughran merged pull request #4074: URL: https://github.com/apache/hadoop/pull/4074 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Updated] (HADOOP-18167) Add metrics to track delegation token secret manager operations

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18167: Labels: pull-request-available (was: ) > Add metrics to track delegation token secret

[jira] [Work logged] (HADOOP-18167) Add metrics to track delegation token secret manager operations

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18167?focusedWorklogId=745957=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-745957 ] ASF GitHub Bot logged work on HADOOP-18167: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hchaverri opened a new pull request #4092: HADOOP-18167. Add metrics to track delegation token secret manager op…

2022-03-22 Thread GitBox
hchaverri opened a new pull request #4092: URL: https://github.com/apache/hadoop/pull/4092 …erations ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA

[jira] [Work logged] (HADOOP-18154) S3A Authentication to support WebIdentity

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18154?focusedWorklogId=745954=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-745954 ] ASF GitHub Bot logged work on HADOOP-18154: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #4070: HADOOP-18154. S3A Authentication to support WebIdentity

2022-03-22 Thread GitBox
steveloughran commented on pull request #4070: URL: https://github.com/apache/hadoop/pull/4070#issuecomment-1075401037 Looking at the `WebIdentityTokenCredentialsProvider` I see that if it doesn't get the parameters then it will fall back to environment variables. We absolutely do not

[GitHub] [hadoop] omalley opened a new pull request #4091: HDFS-16517 Distance metric is wrong for non-DN machines in 2.10.

2022-03-22 Thread GitBox
omalley opened a new pull request #4091: URL: https://github.com/apache/hadoop/pull/4091 ### Description of PR The distance metric used for machines in 2.10 that aren't in the NetworkTopology, because they aren't running DataNodes, is wrong. It means that off-rack and on-rack, but

[jira] [Work logged] (HADOOP-18160) `org.wildfly.openssl` should not be shaded by Hadoop build

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18160?focusedWorklogId=745949=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-745949 ] ASF GitHub Bot logged work on HADOOP-18160: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #4074: HADOOP-18160 Avoid shading wildfly.openssl runtime dependency

2022-03-22 Thread GitBox
hadoop-yetus removed a comment on pull request #4074: URL: https://github.com/apache/hadoop/pull/4074#issuecomment-1069468112 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[jira] [Work logged] (HADOOP-18154) S3A Authentication to support WebIdentity

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18154?focusedWorklogId=745945=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-745945 ] ASF GitHub Bot logged work on HADOOP-18154: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #4070: HADOOP-18154. S3A Authentication to support WebIdentity

2022-03-22 Thread GitBox
hadoop-yetus removed a comment on pull request #4070: URL: https://github.com/apache/hadoop/pull/4070#issuecomment-1068327215 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Work logged] (HADOOP-18145) Fileutil's unzip method causes unzipped files to lose their original permissions

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18145?focusedWorklogId=745931=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-745931 ] ASF GitHub Bot logged work on HADOOP-18145: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on a change in pull request #4036: HADOOP-18145.Decompress the ZIP file and retain the original file per…

2022-03-22 Thread GitBox
steveloughran commented on a change in pull request #4036: URL: https://github.com/apache/hadoop/pull/4036#discussion_r832391092 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFileUtil.java ## @@ -706,35 +706,40 @@ public void

[jira] [Work logged] (HADOOP-18145) Fileutil's unzip method causes unzipped files to lose their original permissions

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18145?focusedWorklogId=745930=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-745930 ] ASF GitHub Bot logged work on HADOOP-18145: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #4036: HADOOP-18145.Decompress the ZIP file and retain the original file per…

2022-03-22 Thread GitBox
hadoop-yetus removed a comment on pull request #4036: URL: https://github.com/apache/hadoop/pull/4036#issuecomment-1055349079 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[jira] [Comment Edited] (HADOOP-18168) ITestMarkerTool.testRunLimitedLandsatAudit failing -bucket purged?

2022-03-22 Thread Daniel Carl Jones (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17510511#comment-17510511 ] Daniel Carl Jones edited comment on HADOOP-18168 at 3/22/22, 4:42 PM:

[jira] [Work logged] (HADOOP-15566) Support OpenTelemetry

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15566?focusedWorklogId=745914=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-745914 ] ASF GitHub Bot logged work on HADOOP-15566: --- Author: ASF GitHub Bot

[GitHub] [hadoop] kiran-maturi commented on a change in pull request #3445: HADOOP-15566 Opentelemetry changes using java agent

2022-03-22 Thread GitBox
kiran-maturi commented on a change in pull request #3445: URL: https://github.com/apache/hadoop/pull/3445#discussion_r832373680 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/tracing/TestTracer.java ## @@ -0,0 +1,33 @@ +/** + * Licensed to

[jira] [Comment Edited] (HADOOP-18168) ITestMarkerTool.testRunLimitedLandsatAudit failing -bucket purged?

2022-03-22 Thread Daniel Carl Jones (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17510511#comment-17510511 ] Daniel Carl Jones edited comment on HADOOP-18168 at 3/22/22, 4:17 PM:

[GitHub] [hadoop] rguillome commented on pull request #426: correct configuration tag in mapred-site.xml

2022-03-22 Thread GitBox
rguillome commented on pull request #426: URL: https://github.com/apache/hadoop/pull/426#issuecomment-1075277247 Corrected in 3.1.2 (https://issues.apache.org/jira/browse/MAPREDUCE-7165) -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hadoop] rguillome closed pull request #426: correct configuration tag in mapred-site.xml

2022-03-22 Thread GitBox
rguillome closed pull request #426: URL: https://github.com/apache/hadoop/pull/426 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] Hexiaoqiao closed pull request #2918: HDFS-15987. Improve oiv tool to parse fsimage file in parallel with d…

2022-03-22 Thread GitBox
Hexiaoqiao closed pull request #2918: URL: https://github.com/apache/hadoop/pull/2918 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] Hexiaoqiao commented on pull request #2918: HDFS-15987. Improve oiv tool to parse fsimage file in parallel with d…

2022-03-22 Thread GitBox
Hexiaoqiao commented on pull request #2918: URL: https://github.com/apache/hadoop/pull/2918#issuecomment-1075257224 Committed to trunk. Thanks @whbing for your contributions! Thanks all to reviews! -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] Hexiaoqiao commented on a change in pull request #4085: HDFS-16511. Change some frequent method lock type in ReplicaMap.

2022-03-22 Thread GitBox
Hexiaoqiao commented on a change in pull request #4085: URL: https://github.com/apache/hadoop/pull/4085#discussion_r832238320 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/TestFsDatasetImpl.java ## @@ -602,6

[jira] [Work logged] (HADOOP-18145) Fileutil's unzip method causes unzipped files to lose their original permissions

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18145?focusedWorklogId=745847=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-745847 ] ASF GitHub Bot logged work on HADOOP-18145: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on a change in pull request #4036: HADOOP-18145.Decompress the ZIP file and retain the original file per…

2022-03-22 Thread GitBox
steveloughran commented on a change in pull request #4036: URL: https://github.com/apache/hadoop/pull/4036#discussion_r832236126 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileUtil.java ## @@ -667,6 +670,9 @@ public static void

[jira] [Commented] (HADOOP-18168) ITestMarkerTool.testRunLimitedLandsatAudit failing -bucket purged?

2022-03-22 Thread Daniel Carl Jones (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17510511#comment-17510511 ] Daniel Carl Jones commented on HADOOP-18168: Bucket definitely looks empty right now

[jira] [Commented] (HADOOP-14837) Handle S3A "glacier" data

2022-03-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17510508#comment-17510508 ] Steve Loughran commented on HADOOP-14837: - good questions, -I have no idea what the right

[jira] [Resolved] (HADOOP-13704) S3A getContentSummary() to move to listFiles(recursive) to count children; instrument use

2022-03-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13704. - Fix Version/s: 3.3.3 Resolution: Fixed fixed in 3.3.3. thanks! > S3A

[jira] [Assigned] (HADOOP-13704) S3A getContentSummary() to move to listFiles(recursive) to count children; instrument use

2022-03-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-13704: --- Assignee: Ahmar Suhail > S3A getContentSummary() to move to listFiles(recursive)

[jira] [Work logged] (HADOOP-13704) S3A getContentSummary() to move to listFiles(recursive) to count children; instrument use

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13704?focusedWorklogId=745833=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-745833 ] ASF GitHub Bot logged work on HADOOP-13704: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-13704) S3A getContentSummary() to move to listFiles(recursive) to count children; instrument use

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13704?focusedWorklogId=745834=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-745834 ] ASF GitHub Bot logged work on HADOOP-13704: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-13704) S3A getContentSummary() to move to listFiles(recursive) to count children; instrument use

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13704?focusedWorklogId=745832=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-745832 ] ASF GitHub Bot logged work on HADOOP-13704: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3978: HADOOP-13704. Optimised getContentSummary()

2022-03-22 Thread GitBox
hadoop-yetus removed a comment on pull request #3978: URL: https://github.com/apache/hadoop/pull/3978#issuecomment-1046907425 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[GitHub] [hadoop] steveloughran closed pull request #3978: HADOOP-13704. Optimised getContentSummary()

2022-03-22 Thread GitBox
steveloughran closed pull request #3978: URL: https://github.com/apache/hadoop/pull/3978 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] steveloughran commented on pull request #3978: HADOOP-13704. Optimised getContentSummary()

2022-03-22 Thread GitBox
steveloughran commented on pull request #3978: URL: https://github.com/apache/hadoop/pull/3978#issuecomment-1075201852 patch is in, though i realise i forgot to add the pr# to the header, which is automatic when done through the UI. never mind, at least the JIRA Is in. closing this PR as

[jira] [Commented] (HADOOP-18168) ITestMarkerTool.testRunLimitedLandsatAudit failing -bucket purged?

2022-03-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17510496#comment-17510496 ] Steve Loughran commented on HADOOP-18168: - {code} [INFO] Running

[jira] [Created] (HADOOP-18168) ITestMarkerTool.testRunLimitedLandsatAudit failing -bucket purged?

2022-03-22 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18168: --- Summary: ITestMarkerTool.testRunLimitedLandsatAudit failing -bucket purged? Key: HADOOP-18168 URL: https://issues.apache.org/jira/browse/HADOOP-18168 Project:

[GitHub] [hadoop] singer-bin commented on pull request #4069: HDFS-16457.Make fs.getspaceused.classname reconfigurable

2022-03-22 Thread GitBox
singer-bin commented on pull request #4069: URL: https://github.com/apache/hadoop/pull/4069#issuecomment-1075198028 Can you review my code, thanks a lot. @jojochuang -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [hadoop] singer-bin commented on pull request #4069: HDFS-16457.Make fs.getspaceused.classname reconfigurable

2022-03-22 Thread GitBox
singer-bin commented on pull request #4069: URL: https://github.com/apache/hadoop/pull/4069#issuecomment-1075184346 The failed check has nothing to do with my changes, the last check passed. @jojochuang ,As can be seen from the generated log, my ut passed. -- This is an automated

[jira] [Work logged] (HADOOP-13704) S3A getContentSummary() to move to listFiles(recursive) to count children; instrument use

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13704?focusedWorklogId=745807=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-745807 ] ASF GitHub Bot logged work on HADOOP-13704: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3978: HADOOP-13704. Optimised getContentSummary()

2022-03-22 Thread GitBox
hadoop-yetus removed a comment on pull request #3978: URL: https://github.com/apache/hadoop/pull/3978#issuecomment-1044978246 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Work logged] (HADOOP-16202) Stabilize openFile() and adopt internally

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16202?focusedWorklogId=745805=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-745805 ] ASF GitHub Bot logged work on HADOOP-16202: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2584: HADOOP-16202. Enhance openFile() for better read performance against object stores

2022-03-22 Thread GitBox
steveloughran commented on pull request #2584: URL: https://github.com/apache/hadoop/pull/2584#issuecomment-1075138032 checkstyle ``` ./hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java:120:import

[jira] [Work logged] (HADOOP-15566) Support OpenTelemetry

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15566?focusedWorklogId=745801=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-745801 ] ASF GitHub Bot logged work on HADOOP-15566: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-16202) Stabilize openFile() and adopt internally

2022-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16202?focusedWorklogId=745799=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-745799 ] ASF GitHub Bot logged work on HADOOP-16202: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3445: HADOOP-15566 Opentelemetry changes using java agent

2022-03-22 Thread GitBox
hadoop-yetus commented on pull request #3445: URL: https://github.com/apache/hadoop/pull/3445#issuecomment-1075137411 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2584: HADOOP-16202. Enhance openFile() for better read performance against object stores

2022-03-22 Thread GitBox
hadoop-yetus removed a comment on pull request #2584: URL: https://github.com/apache/hadoop/pull/2584#issuecomment-1025800148 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hadoop] 9uapaw commented on pull request #4066: YARN-11087. Introduce the config to control the refresh interval in R…

2022-03-22 Thread GitBox
9uapaw commented on pull request #4066: URL: https://github.com/apache/hadoop/pull/4066#issuecomment-1075102697 Thanks for the PR @zuston. Committed to trunk. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop] 9uapaw closed pull request #4066: YARN-11087. Introduce the config to control the refresh interval in R…

2022-03-22 Thread GitBox
9uapaw closed pull request #4066: URL: https://github.com/apache/hadoop/pull/4066 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

  1   2   >