[jira] [Created] (HADOOP-18132) S3 exponential backoff

2022-02-18 Thread Holden Karau (Jira)
Holden Karau created HADOOP-18132: - Summary: S3 exponential backoff Key: HADOOP-18132 URL: https://issues.apache.org/jira/browse/HADOOP-18132 Project: Hadoop Common Issue Type: Improvement

[GitHub] [hadoop] goiri commented on a change in pull request #3999: HDFS-16459. RBF: register RBFMetrics in MetricsSystem for promethuessink

2022-02-18 Thread GitBox
goiri commented on a change in pull request #3999: URL: https://github.com/apache/hadoop/pull/3999#discussion_r810292664 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/metrics/RBFMetrics.java ## @@ -100,6 +105,9 @@ p

[jira] [Work logged] (HADOOP-18110) ViewFileSystem: Add Support for Localized Trash Root

2022-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18110?focusedWorklogId=729810&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-729810 ] ASF GitHub Bot logged work on HADOOP-18110: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-18110) ViewFileSystem: Add Support for Localized Trash Root

2022-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18110?focusedWorklogId=729811&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-729811 ] ASF GitHub Bot logged work on HADOOP-18110: --- Author: ASF GitHub B

[GitHub] [hadoop] xinglin closed pull request #3994: HADOOP-18110. ViewFileSystem: Add Support for Localized Trash Root

2022-02-18 Thread GitBox
xinglin closed pull request #3994: URL: https://github.com/apache/hadoop/pull/3994 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-u

[GitHub] [hadoop] xinglin commented on pull request #3994: HADOOP-18110. ViewFileSystem: Add Support for Localized Trash Root

2022-02-18 Thread GitBox
xinglin commented on pull request #3994: URL: https://github.com/apache/hadoop/pull/3994#issuecomment-1045055426 merged into branch-2.10 by Owen. Thank you! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[jira] [Updated] (HADOOP-18131) Upgrade maven enforcer plugin and relevant dependencies

2022-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18131: Labels: pull-request-available (was: ) > Upgrade maven enforcer plugin and relevant depe

[jira] [Work logged] (HADOOP-18131) Upgrade maven enforcer plugin and relevant dependencies

2022-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18131?focusedWorklogId=729798&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-729798 ] ASF GitHub Bot logged work on HADOOP-18131: --- Author: ASF GitHub B

[GitHub] [hadoop] virajjasani opened a new pull request #4000: HADOOP-18131. Upgrade maven enforcer plugin and relevant dependencies

2022-02-18 Thread GitBox
virajjasani opened a new pull request #4000: URL: https://github.com/apache/hadoop/pull/4000 ### Description of PR Maven enforcer plugin's latest version 3.0.0 has some noticeable improvements (e.g. MENFORCER-350, MENFORCER-388, MENFORCER-353) and fixes for us to incorporate. Besides, s

[jira] [Created] (HADOOP-18131) Upgrade maven enforcer plugin and relevant dependencies

2022-02-18 Thread Viraj Jasani (Jira)
Viraj Jasani created HADOOP-18131: - Summary: Upgrade maven enforcer plugin and relevant dependencies Key: HADOOP-18131 URL: https://issues.apache.org/jira/browse/HADOOP-18131 Project: Hadoop Common

[jira] [Work logged] (HADOOP-13704) S3A getContentSummary() to move to listFiles(recursive) to count children; instrument use

2022-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13704?focusedWorklogId=729783&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-729783 ] ASF GitHub Bot logged work on HADOOP-13704: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3978: HADOOP-13704. Optimised getContentSummary()

2022-02-18 Thread GitBox
hadoop-yetus commented on pull request #3978: URL: https://github.com/apache/hadoop/pull/3978#issuecomment-1044978246 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Work logged] (HADOOP-16742) Possible NPE in S3A MultiObjectDeleteSupport error handling

2022-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16742?focusedWorklogId=729769&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-729769 ] ASF GitHub Bot logged work on HADOOP-16742: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #1688: HADOOP-16742. Possible NPE in S3A MultiObjectDeleteSupport error handling.

2022-02-18 Thread GitBox
hadoop-yetus removed a comment on pull request #1688: URL: https://github.com/apache/hadoop/pull/1688#issuecomment-667200893 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec |

[jira] [Work logged] (HADOOP-18129) Change URI[] in INodeLink to String[] to reduce memory footprint of ViewFileSystem

2022-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18129?focusedWorklogId=729765&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-729765 ] ASF GitHub Bot logged work on HADOOP-18129: --- Author: ASF GitHub B

[GitHub] [hadoop] ibuenros commented on a change in pull request #3996: HADOOP-18129: Change URI to String in INodeLink to reduce memory footprint of ViewFileSystem

2022-02-18 Thread GitBox
ibuenros commented on a change in pull request #3996: URL: https://github.com/apache/hadoop/pull/3996#discussion_r810219824 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/InodeTree.java ## @@ -294,11 +294,11 @@ void addLink(final St

[GitHub] [hadoop] xkrogen edited a comment on pull request #3976: HDFS-16452. msync RPC should send to acitve namenode directly

2022-02-18 Thread GitBox
xkrogen edited a comment on pull request #3976: URL: https://github.com/apache/hadoop/pull/3976#issuecomment-1044778317 Quick disclaimer, it has been a while since I have looked at any proxy-provider code. This PR looks in the wrong direction to me. As you mentioned, `failoverProxy`

[GitHub] [hadoop] xkrogen commented on pull request #3976: HDFS-16452. msync RPC should send to acitve namenode directly

2022-02-18 Thread GitBox
xkrogen commented on pull request #3976: URL: https://github.com/apache/hadoop/pull/3976#issuecomment-1044778317 Quick disclaimer, it has been a while since I have looked at any proxy-provider code. This PR looks in the wrong direction to me. As you mentioned, `failoverProxy` is use

[GitHub] [hadoop] hadoop-yetus commented on pull request #3998: [SPS]: Fix bug for unit test of reconfiguring SPS mode

2022-02-18 Thread GitBox
hadoop-yetus commented on pull request #3998: URL: https://github.com/apache/hadoop/pull/3998#issuecomment-1044753030 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Commented] (HADOOP-18095) s3a connector to fully support AWS partitions,

2022-02-18 Thread Daniel Carl Jones (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17494687#comment-17494687 ] Daniel Carl Jones commented on HADOOP-18095: There's quite a few items to t

[GitHub] [hadoop] steveloughran commented on pull request #3881: HDFS-16422. Fix thread safety of EC decoding during concurrent preads

2022-02-18 Thread GitBox
steveloughran commented on pull request #3881: URL: https://github.com/apache/hadoop/pull/3881#issuecomment-1044709832 hey, please remember to keep the JIRA ID on the commit message. thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Work logged] (HADOOP-16202) Stabilize openFile() and adopt internally

2022-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16202?focusedWorklogId=729664&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-729664 ] ASF GitHub Bot logged work on HADOOP-16202: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #2584: HADOOP-16202. Enhance openFile()

2022-02-18 Thread GitBox
hadoop-yetus commented on pull request #2584: URL: https://github.com/apache/hadoop/pull/2584#issuecomment-1044553287 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Work logged] (HADOOP-18129) Change URI[] in INodeLink to String[] to reduce memory footprint of ViewFileSystem

2022-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18129?focusedWorklogId=729662&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-729662 ] ASF GitHub Bot logged work on HADOOP-18129: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3996: HADOOP-18129: Change URI to String in INodeLink to reduce memory footprint of ViewFileSystem

2022-02-18 Thread GitBox
hadoop-yetus commented on pull request #3996: URL: https://github.com/apache/hadoop/pull/3996#issuecomment-1044534637 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] jianghuazhu commented on a change in pull request #3861: HDFS-16316.Improve DirectoryScanner: add regular file check related block.

2022-02-18 Thread GitBox
jianghuazhu commented on a change in pull request #3861: URL: https://github.com/apache/hadoop/pull/3861#discussion_r80908 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DirectoryScanner.java ## @@ -540,21 +541,30 @@ priv

[GitHub] [hadoop] hadoop-yetus commented on pull request #3470: YARN-10965. Centralize queue resource calculation based on CapacityVectors

2022-02-18 Thread GitBox
hadoop-yetus commented on pull request #3470: URL: https://github.com/apache/hadoop/pull/3470#issuecomment-1044530439 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] hadoop-yetus commented on pull request #3978: HADOOP-13704. Optimised getContentSummary()

2022-02-18 Thread GitBox
hadoop-yetus commented on pull request #3978: URL: https://github.com/apache/hadoop/pull/3978#issuecomment-1044495276 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Work logged] (HADOOP-13704) S3A getContentSummary() to move to listFiles(recursive) to count children; instrument use

2022-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13704?focusedWorklogId=729642&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-729642 ] ASF GitHub Bot logged work on HADOOP-13704: --- Author: ASF GitHub B

[jira] [Commented] (HADOOP-18120) Hadoop auth does not handle HTTP Headers in a case-insensitive way

2022-02-18 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17494584#comment-17494584 ] Hadoop QA commented on HADOOP-18120: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[jira] [Work logged] (HADOOP-18117) Add an option to preserve root directory permissions

2022-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18117?focusedWorklogId=729627&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-729627 ] ASF GitHub Bot logged work on HADOOP-18117: --- Author: ASF GitHub B

[GitHub] [hadoop] mohan3d commented on pull request #3970: HADOOP-18117. Add an option to preserve root directory permissions

2022-02-18 Thread GitBox
mohan3d commented on pull request #3970: URL: https://github.com/apache/hadoop/pull/3970#issuecomment-109217 Thanks @ferhui! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

[GitHub] [hadoop] hadoop-yetus commented on pull request #3999: HDFS-16459. RBF: register RBFMetrics in MetricsSystem for promethuessink

2022-02-18 Thread GitBox
hadoop-yetus commented on pull request #3999: URL: https://github.com/apache/hadoop/pull/3999#issuecomment-105288 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] hadoop-yetus commented on pull request #3804: YARN-11049. MutableConfScheduler is referred as plain String instead of class name

2022-02-18 Thread GitBox
hadoop-yetus commented on pull request #3804: URL: https://github.com/apache/hadoop/pull/3804#issuecomment-104610 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] hadoop-yetus commented on pull request #3997: YARN-11077. containersToClean not need to use TreeSet In RMNodeImpl

2022-02-18 Thread GitBox
hadoop-yetus commented on pull request #3997: URL: https://github.com/apache/hadoop/pull/3997#issuecomment-102621 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] hadoop-yetus commented on pull request #3812: YARN-11052. Improve code quality in TestRMWebServicesNodeLabels

2022-02-18 Thread GitBox
hadoop-yetus commented on pull request #3812: URL: https://github.com/apache/hadoop/pull/3812#issuecomment-1044439883 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Work logged] (HADOOP-18117) Add an option to preserve root directory permissions

2022-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18117?focusedWorklogId=729593&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-729593 ] ASF GitHub Bot logged work on HADOOP-18117: --- Author: ASF GitHub B

[jira] [Resolved] (HADOOP-18117) Add an option to preserve root directory permissions

2022-02-18 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HADOOP-18117. -- Fix Version/s: 3.4.0 Resolution: Fixed > Add an option to preserve root directory permissions

[GitHub] [hadoop] ferhui merged pull request #3970: HADOOP-18117. Add an option to preserve root directory permissions

2022-02-18 Thread GitBox
ferhui merged pull request #3970: URL: https://github.com/apache/hadoop/pull/3970 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-un

[jira] [Work logged] (HADOOP-18117) Add an option to preserve root directory permissions

2022-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18117?focusedWorklogId=729592&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-729592 ] ASF GitHub Bot logged work on HADOOP-18117: --- Author: ASF GitHub B

[GitHub] [hadoop] ferhui commented on pull request #3970: HADOOP-18117. Add an option to preserve root directory permissions

2022-02-18 Thread GitBox
ferhui commented on pull request #3970: URL: https://github.com/apache/hadoop/pull/3970#issuecomment-1044355446 Since there are no other comments within these days, I merge this. @mohan3d Thanks for your contribution. -- This is an automated message from the Apache Git Service. To resp

[jira] [Commented] (HADOOP-18128) outputstream.md typo issue

2022-02-18 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17494533#comment-17494533 ] Hui Fei commented on HADOOP-18128: -- [~Leo Pard] Have assigned this issue to you! Feel

[jira] [Assigned] (HADOOP-18128) outputstream.md typo issue

2022-02-18 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei reassigned HADOOP-18128: Assignee: leo sun > outputstream.md typo issue > -- > >

[GitHub] [hadoop] hadoop-yetus commented on pull request #3980: Hadoop-17563 bouncycastle 1.70

2022-02-18 Thread GitBox
hadoop-yetus commented on pull request #3980: URL: https://github.com/apache/hadoop/pull/3980#issuecomment-1044286669 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] hadoop-yetus commented on pull request #3995: YARN-10049. FIFOOrderingPolicy Improvements

2022-02-18 Thread GitBox
hadoop-yetus commented on pull request #3995: URL: https://github.com/apache/hadoop/pull/3995#issuecomment-1044275066 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] ferhui commented on a change in pull request #3861: HDFS-16316.Improve DirectoryScanner: add regular file check related block.

2022-02-18 Thread GitBox
ferhui commented on a change in pull request #3861: URL: https://github.com/apache/hadoop/pull/3861#discussion_r809627226 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DirectoryScanner.java ## @@ -540,21 +541,30 @@ private v

[jira] [Commented] (HADOOP-18095) s3a connector to fully support AWS partitions,

2022-02-18 Thread Daniel Carl Jones (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17494504#comment-17494504 ] Daniel Carl Jones commented on HADOOP-18095: I've been able to try the inte

[GitHub] [hadoop] Neilxzn opened a new pull request #3999: HDFS-16459. RBF: register RBFMetrics in MetricsSystem for promethuessink

2022-02-18 Thread GitBox
Neilxzn opened a new pull request #3999: URL: https://github.com/apache/hadoop/pull/3999 ### Description of PR https://issues.apache.org/jira/browse/HDFS-16459 Router' RBFMetrics was not register in MetricsSystem. We can't find these metrics from PrometheusSink. Maybe we shou

[GitHub] [hadoop] hadoop-yetus commented on pull request #3938: YARN-11069. Dynamic Queue ACL handling in Legacy and Flexible Auto Created Queues

2022-02-18 Thread GitBox
hadoop-yetus commented on pull request #3938: URL: https://github.com/apache/hadoop/pull/3938#issuecomment-1044195785 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] tomscut opened a new pull request #3998: [SPS]: Fix bug for unit test of reconfiguring SPS mode

2022-02-18 Thread GitBox
tomscut opened a new pull request #3998: URL: https://github.com/apache/hadoop/pull/3998 JIRA: [HDFS-16458](https://issues.apache.org/jira/browse/HDFS-16458). TestNameNodeReconfigure#verifySPSEnabled was compared with itself(`isSPSRunning`) at assertEquals. In addition, after