[GitHub] [hadoop] hadoop-yetus commented on pull request #3355: YARN-10901. Fix permission checking error on an existing directory in…

2021-08-30 Thread GitBox
hadoop-yetus commented on pull request #3355: URL: https://github.com/apache/hadoop/pull/3355#issuecomment-908951225 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] hadoop-yetus commented on pull request #2724: HDFS-15862. Rename file back to original in TestViewfsWithNfs3.testNfsRenameSingleNN()

2021-08-30 Thread GitBox
hadoop-yetus commented on pull request #2724: URL: https://github.com/apache/hadoop/pull/2724#issuecomment-908942305 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Work logged] (HADOOP-17862) ABFS: Fix unchecked cast compiler warning for AbfsListStatusRemoteIterator

2021-08-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17862?focusedWorklogId=643874&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-643874 ] ASF GitHub Bot logged work on HADOOP-17862: --- Author: ASF GitHub B

[GitHub] [hadoop] bilaharith commented on a change in pull request #3331: HADOOP-17862. ABFS: Fix unchecked cast compiler warning for AbfsListStatusRemoteIterator

2021-08-30 Thread GitBox
bilaharith commented on a change in pull request #3331: URL: https://github.com/apache/hadoop/pull/3331#discussion_r699008293 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAbfsListStatusRemoteIterator.java ## @@ -23,15 +23,18 @@ impo

[jira] [Work logged] (HADOOP-17862) ABFS: Fix unchecked cast compiler warning for AbfsListStatusRemoteIterator

2021-08-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17862?focusedWorklogId=643871&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-643871 ] ASF GitHub Bot logged work on HADOOP-17862: --- Author: ASF GitHub B

[GitHub] [hadoop] bilaharith commented on a change in pull request #3331: HADOOP-17862. ABFS: Fix unchecked cast compiler warning for AbfsListStatusRemoteIterator

2021-08-30 Thread GitBox
bilaharith commented on a change in pull request #3331: URL: https://github.com/apache/hadoop/pull/3331#discussion_r699008293 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAbfsListStatusRemoteIterator.java ## @@ -23,15 +23,18 @@ impo

[GitHub] [hadoop] ZhendongBai edited a comment on pull request #3349: build 2.10.x with docker only.

2021-08-30 Thread GitBox
ZhendongBai edited a comment on pull request #3349: URL: https://github.com/apache/hadoop/pull/3349#issuecomment-908915018 > @ZhendongBai could you please mention the HADOOP JIRA in the title of this PR? @GauthamBanasandra thanks a lot for your review, and just now I create a Haooop

[GitHub] [hadoop] ZhendongBai commented on pull request #3349: build 2.10.x with docker only.

2021-08-30 Thread GitBox
ZhendongBai commented on pull request #3349: URL: https://github.com/apache/hadoop/pull/3349#issuecomment-908915018 > @ZhendongBai could you please mention the HADOOP JIRA in the title of this PR? @GauthamBanasandra thanks a lot for your review, and just now I create a Haooop Jira w

[jira] [Comment Edited] (HADOOP-17880) build hadoop 2.10.0 with docker machine failed

2021-08-30 Thread baizhendong (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17407078#comment-17407078 ] baizhendong edited comment on HADOOP-17880 at 8/31/21, 5:32 AM: -

[jira] [Commented] (HADOOP-17880) build hadoop 2.10.0 with docker machine failed

2021-08-30 Thread baizhendong (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17407078#comment-17407078 ] baizhendong commented on HADOOP-17880: -- I commit a  PR for this question https://g

[jira] [Created] (HADOOP-17880) build hadoop 2.10.0 with docker machine failed

2021-08-30 Thread baizhendong (Jira)
baizhendong created HADOOP-17880: Summary: build hadoop 2.10.0 with docker machine failed Key: HADOOP-17880 URL: https://issues.apache.org/jira/browse/HADOOP-17880 Project: Hadoop Common Issu

[GitHub] [hadoop] lzx404243 commented on pull request #2500: MAPREDUCE-7311. Clear filesystem statistics after tests in TestTaskProgressReporter

2021-08-30 Thread GitBox
lzx404243 commented on pull request #2500: URL: https://github.com/apache/hadoop/pull/2500#issuecomment-908911221 > If the test case fails before L327, the statistics is not cleared. Would you create an `@After` method and clear the statistics there? That way the statistics is alway cleare

[GitHub] [hadoop] umamaheswararao commented on pull request #3353: HDFS-16192: ViewDistributedFileSystem#rename wrongly using src in the place of dst.

2021-08-30 Thread GitBox
umamaheswararao commented on pull request #3353: URL: https://github.com/apache/hadoop/pull/3353#issuecomment-908904407 Thanks a lot @jojochuang for the reviews!!! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[GitHub] [hadoop] lzx404243 commented on pull request #2724: HDFS-15862. Rename file back to original in TestViewfsWithNfs3.testNfsRenameSingleNN()

2021-08-30 Thread GitBox
lzx404243 commented on pull request #2724: URL: https://github.com/apache/hadoop/pull/2724#issuecomment-908901777 @aajisaka Thanks for the feedback! I've made the corresponding changes following your suggestion. Please let me know what you think. Thanks! -- This is an automate

[GitHub] [hadoop] GauthamBanasandra commented on pull request #3349: build 2.10.x with docker only.

2021-08-30 Thread GitBox
GauthamBanasandra commented on pull request #3349: URL: https://github.com/apache/hadoop/pull/3349#issuecomment-908895674 @ZhendongBai could you please mention the HADOOP JIRA in the title of this PR? -- This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Work logged] (HADOOP-17833) Improve Magic Committer Performance

2021-08-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17833?focusedWorklogId=643846&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-643846 ] ASF GitHub Bot logged work on HADOOP-17833: --- Author: ASF GitHub B

[GitHub] [hadoop] jojochuang merged pull request #3353: HDFS-16192: ViewDistributedFileSystem#rename wrongly using src in the place of dst.

2021-08-30 Thread GitBox
jojochuang merged pull request #3353: URL: https://github.com/apache/hadoop/pull/3353 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issue

[GitHub] [hadoop] dongjoon-hyun commented on pull request #3289: HADOOP-17833. Improve Magic Committer performance

2021-08-30 Thread GitBox
dongjoon-hyun commented on pull request #3289: URL: https://github.com/apache/hadoop/pull/3289#issuecomment-90070 Thank you, @steveloughran ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hadoop] hadoop-yetus commented on pull request #3353: HDFS-16192: ViewDistributedFileSystem#rename wrongly using src in the place of dst.

2021-08-30 Thread GitBox
hadoop-yetus commented on pull request #3353: URL: https://github.com/apache/hadoop/pull/3353#issuecomment-908877023 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] jianghuazhu opened a new pull request #3357: HDFS-16197.Simplify getting NNStorage in FSNamesystem.

2021-08-30 Thread GitBox
jianghuazhu opened a new pull request #3357: URL: https://github.com/apache/hadoop/pull/3357 ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HAD

[GitHub] [hadoop] LeonGao91 commented on a change in pull request #3346: HDFS-16188. RBF: Router to support resolving monitored namenodes with DNS

2021-08-30 Thread GitBox
LeonGao91 commented on a change in pull request #3346: URL: https://github.com/apache/hadoop/pull/3346#discussion_r698915443 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/NNHAServiceTarget.java ## @@ -56,9 +56,25 @@ private final S

[GitHub] [hadoop] LeonGao91 commented on a change in pull request #3346: HDFS-16188. RBF: Router to support resolving monitored namenodes with DNS

2021-08-30 Thread GitBox
LeonGao91 commented on a change in pull request #3346: URL: https://github.com/apache/hadoop/pull/3346#discussion_r698915014 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/NNHAServiceTarget.java ## @@ -56,9 +56,25 @@ private final S

[GitHub] [hadoop] LeonGao91 commented on a change in pull request #3346: HDFS-16188. RBF: Router to support resolving monitored namenodes with DNS

2021-08-30 Thread GitBox
LeonGao91 commented on a change in pull request #3346: URL: https://github.com/apache/hadoop/pull/3346#discussion_r698897540 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/NamenodeHeartbeatService.java ## @@ -113

[GitHub] [hadoop] jojochuang commented on a change in pull request #3353: HDFS-16192: ViewDistributedFileSystem#rename wrongly using src in the place of dst.

2021-08-30 Thread GitBox
jojochuang commented on a change in pull request #3353: URL: https://github.com/apache/hadoop/pull/3353#discussion_r698896805 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestViewDistributedFileSystem.java ## @@ -89,4 +91,30 @@ public void

[jira] [Work logged] (HADOOP-17868) Add more test for the BuiltInGzipCompressor

2021-08-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17868?focusedWorklogId=643754&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-643754 ] ASF GitHub Bot logged work on HADOOP-17868: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3336: HADOOP-17868. Add more tests for BuiltInGzipCompressor

2021-08-30 Thread GitBox
hadoop-yetus commented on pull request #3336: URL: https://github.com/apache/hadoop/pull/3336#issuecomment-908748422 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] goiri commented on a change in pull request #3346: HDFS-16188. RBF: Router to support resolving monitored namenodes with DNS

2021-08-30 Thread GitBox
goiri commented on a change in pull request #3346: URL: https://github.com/apache/hadoop/pull/3346#discussion_r698849492 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/NamenodeHeartbeatService.java ## @@ -113,47

[jira] [Work logged] (HADOOP-17869) fs.s3a.connection.maximum should be bigger than fs.s3a.threads.max

2021-08-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17869?focusedWorklogId=643685&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-643685 ] ASF GitHub Bot logged work on HADOOP-17869: --- Author: ASF GitHub B

[GitHub] [hadoop] dongjoon-hyun commented on pull request #3337: HADOOP-17869. `fs.s3a.connection.maximum` should be bigger than `fs.s3a.threads.max`

2021-08-30 Thread GitBox
dongjoon-hyun commented on pull request #3337: URL: https://github.com/apache/hadoop/pull/3337#issuecomment-908629251 Thank you so much, @steveloughran and @sunchao ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

[GitHub] [hadoop] hadoop-yetus commented on pull request #2128: HDFS-15452.Dynamically initialize the capacity of BlocksMap.

2021-08-30 Thread GitBox
hadoop-yetus commented on pull request #2128: URL: https://github.com/apache/hadoop/pull/2128#issuecomment-908618472 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[jira] [Work logged] (HADOOP-17868) Add more test for the BuiltInGzipCompressor

2021-08-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17868?focusedWorklogId=643673&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-643673 ] ASF GitHub Bot logged work on HADOOP-17868: --- Author: ASF GitHub B

[GitHub] [hadoop] viirya commented on a change in pull request #3336: HADOOP-17868. Add more tests for BuiltInGzipCompressor

2021-08-30 Thread GitBox
viirya commented on a change in pull request #3336: URL: https://github.com/apache/hadoop/pull/3336#discussion_r698731273 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/compress/TestCodec.java ## @@ -725,6 +726,173 @@ public void testGzipC

[jira] [Work logged] (HADOOP-17870) HTTP Filesystem to qualify paths in open()/getFileStatus()

2021-08-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17870?focusedWorklogId=643672&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-643672 ] ASF GitHub Bot logged work on HADOOP-17870: --- Author: ASF GitHub B

[GitHub] [hadoop] yellowflash commented on pull request #3338: HADOOP-17870 Make Http Filesystem allow non-absolute uri based paths.

2021-08-30 Thread GitBox
yellowflash commented on pull request #3338: URL: https://github.com/apache/hadoop/pull/3338#issuecomment-908602841 > @yellowflash -before I merge, how do you want to be credited.? > > do you want: > > ``` > Contributed by yellowflash > ``` > > Or is there any othe

[GitHub] [hadoop] goiri commented on pull request #3349: build 2.10.x with docker only.

2021-08-30 Thread GitBox
goiri commented on pull request #3349: URL: https://github.com/apache/hadoop/pull/3349#issuecomment-908583468 @GauthamBanasandra can you take a look at this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Work logged] (HADOOP-17868) Add more test for the BuiltInGzipCompressor

2021-08-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17868?focusedWorklogId=643647&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-643647 ] ASF GitHub Bot logged work on HADOOP-17868: --- Author: ASF GitHub B

[GitHub] [hadoop] sunchao commented on a change in pull request #3336: HADOOP-17868. Add more tests for BuiltInGzipCompressor

2021-08-30 Thread GitBox
sunchao commented on a change in pull request #3336: URL: https://github.com/apache/hadoop/pull/3336#discussion_r698693663 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/compress/TestCodec.java ## @@ -725,6 +726,173 @@ public void testGzip

[GitHub] [hadoop] hadoop-yetus commented on pull request #3330: YARN-10522. Document for Flexible Auto Queue Creation in Capacity Scheduler.

2021-08-30 Thread GitBox
hadoop-yetus commented on pull request #3330: URL: https://github.com/apache/hadoop/pull/3330#issuecomment-908574895 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Work logged] (HADOOP-17873) ABFS: Fix transient failures in ITestAbfsStreamStatistics and ITestAbfsRestOperationException

2021-08-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17873?focusedWorklogId=643643&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-643643 ] ASF GitHub Bot logged work on HADOOP-17873: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on pull request #3341: HADOOP-17873. ABFS: Fix transient failures in ITestAbfsStreamStatistics and ITestAbfsRestOperationException

2021-08-30 Thread GitBox
steveloughran commented on pull request #3341: URL: https://github.com/apache/hadoop/pull/3341#issuecomment-908572186 happy with all the code changes. Now, with the resetting, can the changes to the pom be removed? It isn't needed to fix this problem. -- This is an automated message from

[jira] [Work logged] (HADOOP-17873) ABFS: Fix transient failures in ITestAbfsStreamStatistics and ITestAbfsRestOperationException

2021-08-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17873?focusedWorklogId=643641&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-643641 ] ASF GitHub Bot logged work on HADOOP-17873: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3341: HADOOP-17873. ABFS: Fix transient failures in ITestAbfsStreamStatistics and ITestAbfsRestOperationException

2021-08-30 Thread GitBox
hadoop-yetus removed a comment on pull request #3341: URL: https://github.com/apache/hadoop/pull/3341#issuecomment-906626627 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[jira] [Work logged] (HADOOP-17833) Improve Magic Committer Performance

2021-08-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17833?focusedWorklogId=643639&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-643639 ] ASF GitHub Bot logged work on HADOOP-17833: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on pull request #3289: HADOOP-17833. Improve Magic Committer performance

2021-08-30 Thread GitBox
steveloughran commented on pull request #3289: URL: https://github.com/apache/hadoop/pull/3289#issuecomment-908567988 This is at a point where it's ready for some review and any benchmarking people can do. I've cut out a lot of HTTP IO per file create and load @mukund-thakur @mehakme

[jira] [Work logged] (HADOOP-17868) Add more test for the BuiltInGzipCompressor

2021-08-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17868?focusedWorklogId=643627&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-643627 ] ASF GitHub Bot logged work on HADOOP-17868: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3336: HADOOP-17868. Add more tests for BuiltInGzipCompressor

2021-08-30 Thread GitBox
hadoop-yetus removed a comment on pull request #3336: URL: https://github.com/apache/hadoop/pull/3336#issuecomment-906303577 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[jira] [Updated] (HADOOP-17870) HTTP Filesystem to qualify paths in open()/getFileStatus()

2021-08-30 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17870: Summary: HTTP Filesystem to qualify paths in open()/getFileStatus() (was: HTTP Filesyste

[jira] [Work logged] (HADOOP-17870) HTTP Filesystem dont take Path's with no scheme/authority

2021-08-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17870?focusedWorklogId=643619&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-643619 ] ASF GitHub Bot logged work on HADOOP-17870: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on pull request #3338: HADOOP-17870 Make Http Filesystem allow non-absolute uri based paths.

2021-08-30 Thread GitBox
steveloughran commented on pull request #3338: URL: https://github.com/apache/hadoop/pull/3338#issuecomment-908553090 @yellowflash -before I merge, how do you want to be credited.? do you want: ``` Contributed by yellowflash ``` Or is there any other name you'd like to

[jira] [Work logged] (HADOOP-17870) HTTP Filesystem dont take Path's with no scheme/authority

2021-08-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17870?focusedWorklogId=643616&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-643616 ] ASF GitHub Bot logged work on HADOOP-17870: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3338: HADOOP-17870 Make Http Filesystem allow non-absolute uri based paths.

2021-08-30 Thread GitBox
hadoop-yetus removed a comment on pull request #3338: URL: https://github.com/apache/hadoop/pull/3338#issuecomment-906577293 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Work logged] (HADOOP-17869) fs.s3a.connection.maximum should be bigger than fs.s3a.threads.max

2021-08-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17869?focusedWorklogId=643608&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-643608 ] ASF GitHub Bot logged work on HADOOP-17869: --- Author: ASF GitHub B

[jira] [Assigned] (HADOOP-17869) fs.s3a.connection.maximum should be bigger than fs.s3a.threads.max

2021-08-30 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-17869: --- Assignee: Dongjoon Hyun > fs.s3a.connection.maximum should be bigger than fs.s3a.t

[GitHub] [hadoop] steveloughran commented on pull request #3337: HADOOP-17869. `fs.s3a.connection.maximum` should be bigger than `fs.s3a.threads.max`

2021-08-30 Thread GitBox
steveloughran commented on pull request #3337: URL: https://github.com/apache/hadoop/pull/3337#issuecomment-908542912 ok, in trunk & 3.3. Thanks for this -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[jira] [Resolved] (HADOOP-17869) fs.s3a.connection.maximum should be bigger than fs.s3a.threads.max

2021-08-30 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17869. - Fix Version/s: 3.3.2 Resolution: Fixed > fs.s3a.connection.maximum should be big

[jira] [Work logged] (HADOOP-17869) fs.s3a.connection.maximum should be bigger than fs.s3a.threads.max

2021-08-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17869?focusedWorklogId=643605&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-643605 ] ASF GitHub Bot logged work on HADOOP-17869: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran merged pull request #3337: HADOOP-17869. `fs.s3a.connection.maximum` should be bigger than `fs.s3a.threads.max`

2021-08-30 Thread GitBox
steveloughran merged pull request #3337: URL: https://github.com/apache/hadoop/pull/3337 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-is

[GitHub] [hadoop] brumi1024 commented on a change in pull request #3330: YARN-10522. Document for Flexible Auto Queue Creation in Capacity Scheduler.

2021-08-30 Thread GitBox
brumi1024 commented on a change in pull request #3330: URL: https://github.com/apache/hadoop/pull/3330#discussion_r698465402 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md ## @@ -681,6 +689,55 @@ list of current scheduling

[GitHub] [hadoop] hadoop-yetus commented on pull request #3333: YARN-10576. Update Capacity Scheduler documentation about JSON-based …

2021-08-30 Thread GitBox
hadoop-yetus commented on pull request #: URL: https://github.com/apache/hadoop/pull/#issuecomment-908517290 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Commented] (HADOOP-17879) Unable to use custom SAS tokens for accessing files from ADLS gen2 storage accounts with hierarchical namespace enabled.

2021-08-30 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17406817#comment-17406817 ] Steve Loughran commented on HADOOP-17879: - +[~snehav] > Unable to use custom S

[GitHub] [hadoop] brumi1024 commented on pull request #3355: YARN-10901. Fix permission checking error on an existing directory in…

2021-08-30 Thread GitBox
brumi1024 commented on pull request #3355: URL: https://github.com/apache/hadoop/pull/3355#issuecomment-908461551 Thanks @tomicooler for working on this. The commit LGTM, +1 from my side, once you fix the checkstyle issues. :) -- This is an automated message from the Apache Git Service.

[GitHub] [hadoop] umamaheswararao commented on a change in pull request #3353: HDFS-16192: ViewDistributedFileSystem#rename wrongly using src in the place of dst.

2021-08-30 Thread GitBox
umamaheswararao commented on a change in pull request #3353: URL: https://github.com/apache/hadoop/pull/3353#discussion_r698559465 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestViewDistributedFileSystem.java ## @@ -89,4 +91,30 @@ public

[GitHub] [hadoop] umamaheswararao commented on a change in pull request #3353: HDFS-16192: ViewDistributedFileSystem#rename wrongly using src in the place of dst.

2021-08-30 Thread GitBox
umamaheswararao commented on a change in pull request #3353: URL: https://github.com/apache/hadoop/pull/3353#discussion_r698559465 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestViewDistributedFileSystem.java ## @@ -89,4 +91,30 @@ public

[GitHub] [hadoop] hadoop-yetus commented on pull request #3346: HDFS-16188. RBF: Router to support resolving monitored namenodes with DNS

2021-08-30 Thread GitBox
hadoop-yetus commented on pull request #3346: URL: https://github.com/apache/hadoop/pull/3346#issuecomment-908382301 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] hadoop-yetus commented on pull request #3346: HDFS-16188. RBF: Router to support resolving monitored namenodes with DNS

2021-08-30 Thread GitBox
hadoop-yetus commented on pull request #3346: URL: https://github.com/apache/hadoop/pull/3346#issuecomment-908343565 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] brumi1024 commented on a change in pull request #3330: YARN-10522. Document for Flexible Auto Queue Creation in Capacity Scheduler.

2021-08-30 Thread GitBox
brumi1024 commented on a change in pull request #3330: URL: https://github.com/apache/hadoop/pull/3330#discussion_r698465402 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md ## @@ -681,6 +689,55 @@ list of current scheduling

[GitHub] [hadoop] hadoop-yetus commented on pull request #3340: HDFS-16187. SnapshotDiff behaviour with Xattrs and Acls is not consistent across NN restarts with checkpointing

2021-08-30 Thread GitBox
hadoop-yetus commented on pull request #3340: URL: https://github.com/apache/hadoop/pull/3340#issuecomment-908300284 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] 9uapaw commented on a change in pull request #3330: YARN-10522. Document for Flexible Auto Queue Creation in Capacity Scheduler.

2021-08-30 Thread GitBox
9uapaw commented on a change in pull request #3330: URL: https://github.com/apache/hadoop/pull/3330#discussion_r698439586 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md ## @@ -681,6 +689,55 @@ list of current scheduling ed

[GitHub] [hadoop] tomicooler commented on a change in pull request #3342: YARN-10897. Introduce QueuePath class

2021-08-30 Thread GitBox
tomicooler commented on a change in pull request #3342: URL: https://github.com/apache/hadoop/pull/3342#discussion_r698384110 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager

[GitHub] [hadoop] hadoop-yetus commented on pull request #3356: YARN-10928. Support default queue config for minimum-user-limit-percent/user-limit-factor

2021-08-30 Thread GitBox
hadoop-yetus commented on pull request #3356: URL: https://github.com/apache/hadoop/pull/3356#issuecomment-908279368 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] tomicooler commented on a change in pull request #3342: YARN-10897. Introduce QueuePath class

2021-08-30 Thread GitBox
tomicooler commented on a change in pull request #3342: URL: https://github.com/apache/hadoop/pull/3342#discussion_r698373686 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager

[GitHub] [hadoop] tomicooler commented on a change in pull request #3342: YARN-10897. Introduce QueuePath class

2021-08-30 Thread GitBox
tomicooler commented on a change in pull request #3342: URL: https://github.com/apache/hadoop/pull/3342#discussion_r698373686 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager

[GitHub] [hadoop] brumi1024 commented on a change in pull request #3330: YARN-10522. Document for Flexible Auto Queue Creation in Capacity Scheduler.

2021-08-30 Thread GitBox
brumi1024 commented on a change in pull request #3330: URL: https://github.com/apache/hadoop/pull/3330#discussion_r698356952 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md ## @@ -681,6 +689,55 @@ list of current scheduling

[GitHub] [hadoop] 9uapaw commented on a change in pull request #3330: YARN-10522. Document for Flexible Auto Queue Creation in Capacity Scheduler.

2021-08-30 Thread GitBox
9uapaw commented on a change in pull request #3330: URL: https://github.com/apache/hadoop/pull/3330#discussion_r698351029 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md ## @@ -681,6 +689,55 @@ list of current scheduling ed

[GitHub] [hadoop] 9uapaw commented on a change in pull request #3333: YARN-10576. Update Capacity Scheduler documentation about JSON-based …

2021-08-30 Thread GitBox
9uapaw commented on a change in pull request #: URL: https://github.com/apache/hadoop/pull/#discussion_r698269656 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md ## @@ -288,7 +288,27 @@ Below example covers single m

[GitHub] [hadoop] 9uapaw commented on a change in pull request #3342: YARN-10897. Introduce QueuePath class

2021-08-30 Thread GitBox
9uapaw commented on a change in pull request #3342: URL: https://github.com/apache/hadoop/pull/3342#discussion_r698338724 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/sch

[GitHub] [hadoop] 9uapaw commented on a change in pull request #3342: YARN-10897. Introduce QueuePath class

2021-08-30 Thread GitBox
9uapaw commented on a change in pull request #3342: URL: https://github.com/apache/hadoop/pull/3342#discussion_r698338724 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/sch

[GitHub] [hadoop] 9uapaw commented on a change in pull request #3342: YARN-10897. Introduce QueuePath class

2021-08-30 Thread GitBox
9uapaw commented on a change in pull request #3342: URL: https://github.com/apache/hadoop/pull/3342#discussion_r698335410 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/sch

[GitHub] [hadoop] 9uapaw commented on a change in pull request #3342: YARN-10897. Introduce QueuePath class

2021-08-30 Thread GitBox
9uapaw commented on a change in pull request #3342: URL: https://github.com/apache/hadoop/pull/3342#discussion_r698335050 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/sch

[GitHub] [hadoop] hadoop-yetus commented on pull request #3355: YARN-10901. Fix permission checking error on an existing directory in…

2021-08-30 Thread GitBox
hadoop-yetus commented on pull request #3355: URL: https://github.com/apache/hadoop/pull/3355#issuecomment-908189540 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] jojochuang commented on a change in pull request #3353: HDFS-16192: ViewDistributedFileSystem#rename wrongly using src in the place of dst.

2021-08-30 Thread GitBox
jojochuang commented on a change in pull request #3353: URL: https://github.com/apache/hadoop/pull/3353#discussion_r698329987 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestViewDistributedFileSystem.java ## @@ -89,4 +91,30 @@ public void

[GitHub] [hadoop] FrankinRUC opened a new pull request #3356: YARN-10928. Support default queue config for minimum-user-limit-percent/user-limit-factor

2021-08-30 Thread GitBox
FrankinRUC opened a new pull request #3356: URL: https://github.com/apache/hadoop/pull/3356 ### Description of PR There are many user cases that one user owns many queues in his organization's cluster for different business usages in practice. These queues often share the sa

[GitHub] [hadoop] tomicooler commented on a change in pull request #3342: YARN-10897. Introduce QueuePath class

2021-08-30 Thread GitBox
tomicooler commented on a change in pull request #3342: URL: https://github.com/apache/hadoop/pull/3342#discussion_r698311057 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager

[jira] [Updated] (HADOOP-17879) Unable to use custom SAS tokens for accessing files from ADLS gen2 storage accounts with hierarchical namespace enabled.

2021-08-30 Thread Arun Ravi M V (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Ravi M V updated HADOOP-17879: --- Description: I have some parquet files in abfss://c...@sa1.dfs.core.windows.net/folder1/. I

[jira] [Work logged] (HADOOP-17870) HTTP Filesystem dont take Path's with no scheme/authority

2021-08-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17870?focusedWorklogId=643327&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-643327 ] ASF GitHub Bot logged work on HADOOP-17870: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3338: HADOOP-17870 Make Http Filesystem allow non-absolute uri based paths.

2021-08-30 Thread GitBox
hadoop-yetus commented on pull request #3338: URL: https://github.com/apache/hadoop/pull/3338#issuecomment-908137993 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Commented] (HADOOP-14269) Create module-info.java for each module

2021-08-30 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17406613#comment-17406613 ] Viraj Jasani commented on HADOOP-14269: --- [~aajisaka] [~tasanuma] Are we still pla

[GitHub] [hadoop] tomicooler opened a new pull request #3355: YARN-10901. Fix permission checking error on an existing directory in…

2021-08-30 Thread GitBox
tomicooler opened a new pull request #3355: URL: https://github.com/apache/hadoop/pull/3355 … LogAggregationFileController. Create a temporary file with proper ownership to see if the underlying file system supports chmod. When the log directory was already created, but with

[jira] [Work logged] (HADOOP-17868) Add more test for the BuiltInGzipCompressor

2021-08-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17868?focusedWorklogId=643321&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-643321 ] ASF GitHub Bot logged work on HADOOP-17868: --- Author: ASF GitHub B

[GitHub] [hadoop] viirya commented on pull request #3336: HADOOP-17868. Add more tests for BuiltInGzipCompressor

2021-08-30 Thread GitBox
viirya commented on pull request #3336: URL: https://github.com/apache/hadoop/pull/3336#issuecomment-908123524 @steveloughran @sunchao Please take another look. Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Updated] (HADOOP-17879) Unable to use custom SAS tokens for accessing files from ADLS gen2 storage accounts with hierarchical namespace enabled.

2021-08-30 Thread Arun Ravi M V (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Ravi M V updated HADOOP-17879: --- Description: I have some parquet files in abfss://c...@sa1.dfs.core.windows.net/folder1/. I

[GitHub] [hadoop] 9uapaw commented on a change in pull request #3330: YARN-10522. Document for Flexible Auto Queue Creation in Capacity Scheduler.

2021-08-30 Thread GitBox
9uapaw commented on a change in pull request #3330: URL: https://github.com/apache/hadoop/pull/3330#discussion_r698268877 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md ## @@ -123,17 +123,25 @@ Configuration | Property

[jira] [Created] (HADOOP-17879) Unable to use custom SAS tokens for accessing files from ADLS gen2 storage accounts with hierarchical namespace enabled.

2021-08-30 Thread Arun Ravi M V (Jira)
Arun Ravi M V created HADOOP-17879: -- Summary: Unable to use custom SAS tokens for accessing files from ADLS gen2 storage accounts with hierarchical namespace enabled. Key: HADOOP-17879 URL: https://issues.apache.

[jira] [Work started] (HADOOP-17874) ExceptionsHandler to add terse/suppressed Exceptions in thread-safe manner

2021-08-30 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-17874 started by Viraj Jasani. - > ExceptionsHandler to add terse/suppressed Exceptions in thread-safe manner

[jira] [Updated] (HADOOP-17874) ExceptionsHandler to add terse/suppressed Exceptions in thread-safe manner

2021-08-30 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani updated HADOOP-17874: -- Status: Patch Available (was: In Progress) > ExceptionsHandler to add terse/suppressed Excep

[GitHub] [hadoop] virajjasani commented on pull request #3329: HDFS-16184. De-flake TestBlockScanner#testSkipRecentAccessFile

2021-08-30 Thread GitBox
virajjasani commented on pull request #3329: URL: https://github.com/apache/hadoop/pull/3329#issuecomment-908105941 > Merged. Thanks for your contribution, @virajjasani. Thanks for your review, @ayushtkn. > > > Also, it's good to see two consecutive +1s from QA bot for hadoop-hdfs.