[GitHub] [hadoop] lipppppp opened a new pull request #3141: HDFS-16087. Fix stuck issue in rbfbalance tool.

2021-06-24 Thread GitBox
lipp opened a new pull request #3141: URL: https://github.com/apache/hadoop/pull/3141 The balance process will be stuck at DisableWrite stage when running the rbfbalance command. This patch can solve this problem. Please review, thanks. -- This is an automated message from the

[GitHub] [hadoop] jojochuang commented on pull request #3134: HDFS-16085. Move the getPermissionChecker out of the read lock

2021-06-24 Thread GitBox
jojochuang commented on pull request #3134: URL: https://github.com/apache/hadoop/pull/3134#issuecomment-868222185 Sorry i was late but this looks nice and good. Thanks a lot! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hadoop] goiri commented on a change in pull request #3135: YARN-10829. Support getApplications API in FederationClientInterceptor

2021-06-24 Thread GitBox
goiri commented on a change in pull request #3135: URL: https://github.com/apache/hadoop/pull/3135#discussion_r658485767 ## File path:

[GitHub] [hadoop] akshatb1 commented on pull request #3135: YARN-10829. Support getApplications API in FederationClientInterceptor

2021-06-24 Thread GitBox
akshatb1 commented on pull request #3135: URL: https://github.com/apache/hadoop/pull/3135#issuecomment-868212273 @goiri Thanks for providing your comments. I have addressed the comments. Could you kindly help in re-reviewing? -- This is an automated message from the Apache Git Service.

[GitHub] [hadoop] akshatb1 commented on a change in pull request #3135: YARN-10829. Support getApplications API in FederationClientInterceptor

2021-06-24 Thread GitBox
akshatb1 commented on a change in pull request #3135: URL: https://github.com/apache/hadoop/pull/3135#discussion_r658481483 ## File path:

[GitHub] [hadoop] akshatb1 commented on a change in pull request #3135: YARN-10829. Support getApplications API in FederationClientInterceptor

2021-06-24 Thread GitBox
akshatb1 commented on a change in pull request #3135: URL: https://github.com/apache/hadoop/pull/3135#discussion_r658481270 ## File path:

[GitHub] [hadoop] akshatb1 commented on a change in pull request #3135: YARN-10829. Support getApplications API in FederationClientInterceptor

2021-06-24 Thread GitBox
akshatb1 commented on a change in pull request #3135: URL: https://github.com/apache/hadoop/pull/3135#discussion_r658481181 ## File path:

[GitHub] [hadoop] akshatb1 commented on a change in pull request #3135: YARN-10829. Support getApplications API in FederationClientInterceptor

2021-06-24 Thread GitBox
akshatb1 commented on a change in pull request #3135: URL: https://github.com/apache/hadoop/pull/3135#discussion_r658481021 ## File path:

[GitHub] [hadoop] akshatb1 commented on a change in pull request #3135: YARN-10829. Support getApplications API in FederationClientInterceptor

2021-06-24 Thread GitBox
akshatb1 commented on a change in pull request #3135: URL: https://github.com/apache/hadoop/pull/3135#discussion_r658480938 ## File path:

[GitHub] [hadoop] akshatb1 commented on a change in pull request #3135: YARN-10829. Support getApplications API in FederationClientInterceptor

2021-06-24 Thread GitBox
akshatb1 commented on a change in pull request #3135: URL: https://github.com/apache/hadoop/pull/3135#discussion_r658480857 ## File path:

[GitHub] [hadoop] akshatb1 commented on a change in pull request #3135: YARN-10829. Support getApplications API in FederationClientInterceptor

2021-06-24 Thread GitBox
akshatb1 commented on a change in pull request #3135: URL: https://github.com/apache/hadoop/pull/3135#discussion_r658480814 ## File path:

[GitHub] [hadoop] akshatb1 commented on a change in pull request #3135: YARN-10829. Support getApplications API in FederationClientInterceptor

2021-06-24 Thread GitBox
akshatb1 commented on a change in pull request #3135: URL: https://github.com/apache/hadoop/pull/3135#discussion_r658480609 ## File path:

[GitHub] [hadoop] akshatb1 commented on a change in pull request #3135: YARN-10829. Support getApplications API in FederationClientInterceptor

2021-06-24 Thread GitBox
akshatb1 commented on a change in pull request #3135: URL: https://github.com/apache/hadoop/pull/3135#discussion_r658480192 ## File path:

[GitHub] [hadoop] akshatb1 commented on a change in pull request #3135: YARN-10829. Support getApplications API in FederationClientInterceptor

2021-06-24 Thread GitBox
akshatb1 commented on a change in pull request #3135: URL: https://github.com/apache/hadoop/pull/3135#discussion_r658479936 ## File path:

[GitHub] [hadoop] akshatb1 commented on a change in pull request #3135: YARN-10829. Support getApplications API in FederationClientInterceptor

2021-06-24 Thread GitBox
akshatb1 commented on a change in pull request #3135: URL: https://github.com/apache/hadoop/pull/3135#discussion_r658479871 ## File path:

[GitHub] [hadoop] akshatb1 commented on a change in pull request #3135: YARN-10829. Support getApplications API in FederationClientInterceptor

2021-06-24 Thread GitBox
akshatb1 commented on a change in pull request #3135: URL: https://github.com/apache/hadoop/pull/3135#discussion_r658479728 ## File path:

[GitHub] [hadoop] akshatb1 commented on a change in pull request #3135: YARN-10829. Support getApplications API in FederationClientInterceptor

2021-06-24 Thread GitBox
akshatb1 commented on a change in pull request #3135: URL: https://github.com/apache/hadoop/pull/3135#discussion_r658479600 ## File path:

[GitHub] [hadoop] hadoop-yetus commented on pull request #3086: HDFS-16039. RBF: Some indicators of RBFMetrics count inaccurately

2021-06-24 Thread GitBox
hadoop-yetus commented on pull request #3086: URL: https://github.com/apache/hadoop/pull/3086#issuecomment-868207854 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Commented] (HADOOP-17755) EOF reached error reading ORC file on S3A

2021-06-24 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17369235#comment-17369235 ] Arghya Saha commented on HADOOP-17755: -- [~ste...@apache.org] Sorry, Let me share the information

[GitHub] [hadoop] tomscut commented on pull request #3136: HDFS-16086. Add volume information to datanode log for tracing

2021-06-24 Thread GitBox
tomscut commented on pull request #3136: URL: https://github.com/apache/hadoop/pull/3136#issuecomment-868171074 These UTs works fine locally and are unrelated to the change. Hi @tasanuma @aajisaka @jojochuang @Hexiaoqiao , could you please review the code when you have time.

[GitHub] [hadoop] tomscut opened a new pull request #3140: HDFS-16088. Standby NameNode process getLiveDatanodeStorageReport req…

2021-06-24 Thread GitBox
tomscut opened a new pull request #3140: URL: https://github.com/apache/hadoop/pull/3140 JIRA: [HDFS-16088](https://issues.apache.org/jira/browse/HDFS-16088) As with [HDFS-13183](https://issues.apache.org/jira/browse/HDFS-13183) , NameNodeConnector#getLiveDatanodeStorageReport() can

[GitHub] [hadoop] jojochuang commented on a change in pull request #3063: HDFS-16043. HDFS: Delete performance optimization

2021-06-24 Thread GitBox
jojochuang commented on a change in pull request #3063: URL: https://github.com/apache/hadoop/pull/3063#discussion_r658412280 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java ## @@ -4909,6 +4930,73 @@

[GitHub] [hadoop] jojochuang commented on a change in pull request #3063: HDFS-16043. HDFS: Delete performance optimization

2021-06-24 Thread GitBox
jojochuang commented on a change in pull request #3063: URL: https://github.com/apache/hadoop/pull/3063#discussion_r658381800 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java ## @@ -4909,6 +4930,73 @@

[GitHub] [hadoop] hadoop-yetus commented on pull request #3063: HDFS-16043. HDFS: Delete performance optimization

2021-06-24 Thread GitBox
hadoop-yetus commented on pull request #3063: URL: https://github.com/apache/hadoop/pull/3063#issuecomment-867991046 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17290) ABFS: Add Identifiers to Client Request Header

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17290?focusedWorklogId=614709=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614709 ] ASF GitHub Bot logged work on HADOOP-17290: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2520: HADOOP-17290. ABFS: Add Identifiers to Client Request Header

2021-06-24 Thread GitBox
hadoop-yetus commented on pull request #2520: URL: https://github.com/apache/hadoop/pull/2520#issuecomment-867930679 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3135: YARN-10829. Support getApplications API in FederationClientInterceptor

2021-06-24 Thread GitBox
hadoop-yetus commented on pull request #3135: URL: https://github.com/apache/hadoop/pull/3135#issuecomment-867925282 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17764) S3AInputStream read does not re-open the input stream on the second read retry attempt

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17764?focusedWorklogId=614703=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614703 ] ASF GitHub Bot logged work on HADOOP-17764: --- Author: ASF GitHub Bot

[GitHub] [hadoop] majdyz commented on pull request #3109: HADOOP-17764. S3AInputStream read does not re-open the input stream on the second read retry attempt

2021-06-24 Thread GitBox
majdyz commented on pull request #3109: URL: https://github.com/apache/hadoop/pull/3109#issuecomment-867921545 I have re-run all the `hadoop-aws` tests, only 2 failure tests so far, turns out to be an IAM configuration issue on my end for the rest of error. I explicitly allow `osm-pds`

[jira] [Comment Edited] (HADOOP-15327) Upgrade MR ShuffleHandler to use Netty4

2021-06-24 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17367912#comment-17367912 ] Szilard Nemeth edited comment on HADOOP-15327 at 6/24/21, 7:52 PM: ---

[jira] [Work logged] (HADOOP-17290) ABFS: Add Identifiers to Client Request Header

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17290?focusedWorklogId=614684=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614684 ] ASF GitHub Bot logged work on HADOOP-17290: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sumangala-patki commented on a change in pull request #2520: HADOOP-17290. ABFS: Add Identifiers to Client Request Header

2021-06-24 Thread GitBox
sumangala-patki commented on a change in pull request #2520: URL: https://github.com/apache/hadoop/pull/2520#discussion_r658213074 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsInputStream.java ## @@ -451,15 +472,15 @@

[jira] [Work logged] (HADOOP-17290) ABFS: Add Identifiers to Client Request Header

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17290?focusedWorklogId=614682=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614682 ] ASF GitHub Bot logged work on HADOOP-17290: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17290) ABFS: Add Identifiers to Client Request Header

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17290?focusedWorklogId=614681=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614681 ] ASF GitHub Bot logged work on HADOOP-17290: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17290) ABFS: Add Identifiers to Client Request Header

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17290?focusedWorklogId=614683=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614683 ] ASF GitHub Bot logged work on HADOOP-17290: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sumangala-patki commented on a change in pull request #2520: HADOOP-17290. ABFS: Add Identifiers to Client Request Header

2021-06-24 Thread GitBox
sumangala-patki commented on a change in pull request #2520: URL: https://github.com/apache/hadoop/pull/2520#discussion_r658212957 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsRestOperation.java ## @@ -221,17 +226,27 @@

[GitHub] [hadoop] sumangala-patki commented on a change in pull request #2520: HADOOP-17290. ABFS: Add Identifiers to Client Request Header

2021-06-24 Thread GitBox
sumangala-patki commented on a change in pull request #2520: URL: https://github.com/apache/hadoop/pull/2520#discussion_r658212696 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/constants/HdfsOperationConstants.java ## @@ -0,0 +1,50 @@

[GitHub] [hadoop] sumangala-patki commented on a change in pull request #2520: HADOOP-17290. ABFS: Add Identifiers to Client Request Header

2021-06-24 Thread GitBox
sumangala-patki commented on a change in pull request #2520: URL: https://github.com/apache/hadoop/pull/2520#discussion_r658212519 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystem.java ## @@ -1283,6 +1373,11 @@ public

[jira] [Work logged] (HADOOP-17290) ABFS: Add Identifiers to Client Request Header

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17290?focusedWorklogId=614680=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614680 ] ASF GitHub Bot logged work on HADOOP-17290: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sumangala-patki commented on a change in pull request #2520: HADOOP-17290. ABFS: Add Identifiers to Client Request Header

2021-06-24 Thread GitBox
sumangala-patki commented on a change in pull request #2520: URL: https://github.com/apache/hadoop/pull/2520#discussion_r658212324 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystem.java ## @@ -1071,7 +1155,10 @@ private

[jira] [Work logged] (HADOOP-17290) ABFS: Add Identifiers to Client Request Header

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17290?focusedWorklogId=614676=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614676 ] ASF GitHub Bot logged work on HADOOP-17290: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17290) ABFS: Add Identifiers to Client Request Header

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17290?focusedWorklogId=614678=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614678 ] ASF GitHub Bot logged work on HADOOP-17290: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sumangala-patki commented on a change in pull request #2520: HADOOP-17290. ABFS: Add Identifiers to Client Request Header

2021-06-24 Thread GitBox
sumangala-patki commented on a change in pull request #2520: URL: https://github.com/apache/hadoop/pull/2520#discussion_r658211715 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystem.java ## @@ -335,7 +361,10 @@ public

[GitHub] [hadoop] sumangala-patki commented on a change in pull request #2520: HADOOP-17290. ABFS: Add Identifiers to Client Request Header

2021-06-24 Thread GitBox
sumangala-patki commented on a change in pull request #2520: URL: https://github.com/apache/hadoop/pull/2520#discussion_r658211341 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystem.java ## @@ -1049,8 +1130,11 @@ public

[jira] [Work logged] (HADOOP-17290) ABFS: Add Identifiers to Client Request Header

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17290?focusedWorklogId=614675=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614675 ] ASF GitHub Bot logged work on HADOOP-17290: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sumangala-patki commented on a change in pull request #2520: HADOOP-17290. ABFS: Add Identifiers to Client Request Header

2021-06-24 Thread GitBox
sumangala-patki commented on a change in pull request #2520: URL: https://github.com/apache/hadoop/pull/2520#discussion_r658210556 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystem.java ## @@ -1049,8 +1130,11 @@ public

[jira] [Work logged] (HADOOP-17290) ABFS: Add Identifiers to Client Request Header

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17290?focusedWorklogId=614674=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614674 ] ASF GitHub Bot logged work on HADOOP-17290: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17290) ABFS: Add Identifiers to Client Request Header

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17290?focusedWorklogId=614673=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614673 ] ASF GitHub Bot logged work on HADOOP-17290: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sumangala-patki commented on a change in pull request #2520: HADOOP-17290. ABFS: Add Identifiers to Client Request Header

2021-06-24 Thread GitBox
sumangala-patki commented on a change in pull request #2520: URL: https://github.com/apache/hadoop/pull/2520#discussion_r658209651 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystem.java ## @@ -111,10 +116,14 @@ private

[GitHub] [hadoop] sumangala-patki commented on a change in pull request #2520: HADOOP-17290. ABFS: Add Identifiers to Client Request Header

2021-06-24 Thread GitBox
sumangala-patki commented on a change in pull request #2520: URL: https://github.com/apache/hadoop/pull/2520#discussion_r658209239 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AbfsConfiguration.java ## @@ -264,6 +266,10 @@

[GitHub] [hadoop] hadoop-yetus commented on pull request #3136: HDFS-16086. Add volume information to datanode log for tracing

2021-06-24 Thread GitBox
hadoop-yetus commented on pull request #3136: URL: https://github.com/apache/hadoop/pull/3136#issuecomment-867869816 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17769) Upgrade JUnit to 4.13.2

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17769?focusedWorklogId=614624=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614624 ] ASF GitHub Bot logged work on HADOOP-17769: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3139: HADOOP-17769. Upgrade JUnit to 4.13.2. branch-3.2

2021-06-24 Thread GitBox
hadoop-yetus commented on pull request #3139: URL: https://github.com/apache/hadoop/pull/3139#issuecomment-867805373 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Updated] (HADOOP-15870) S3AInputStream.remainingInFile should use nextReadPos

2021-06-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15870: Parent Issue: HADOOP-17566 (was: HADOOP-16829) > S3AInputStream.remainingInFile should

[jira] [Work logged] (HADOOP-17769) Upgrade JUnit to 4.13.2

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17769?focusedWorklogId=614619=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614619 ] ASF GitHub Bot logged work on HADOOP-17769: --- Author: ASF GitHub Bot

[GitHub] [hadoop] amahussein opened a new pull request #3139: HADOOP-17769. Upgrade JUnit to 4.13.2. branch-3.2

2021-06-24 Thread GitBox
amahussein opened a new pull request #3139: URL: https://github.com/apache/hadoop/pull/3139 (#3130). Contributed by Ahmed Hussein. Signed-off-by: Ayush Saxena (cherry picked from commit 581f43dce15d5753deb33f72ec275d0ea67b1403) backport upgrading Junit-4.13.2 to branch-3.2

[jira] [Work logged] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13887?focusedWorklogId=614613=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614613 ] ASF GitHub Bot logged work on HADOOP-13887: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on a change in pull request #2706: HADOOP-13887. Support S3 client side encryption (S3-CSE) using AWS-SDK

2021-06-24 Thread GitBox
steveloughran commented on a change in pull request #2706: URL: https://github.com/apache/hadoop/pull/2706#discussion_r658081650 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/DefaultS3ClientFactory.java ## @@ -94,9 +105,81 @@ public AmazonS3

[GitHub] [hadoop] Hexiaoqiao commented on pull request #3063: HDFS-16043. HDFS: Delete performance optimization

2021-06-24 Thread GitBox
Hexiaoqiao commented on pull request #3063: URL: https://github.com/apache/hadoop/pull/3063#issuecomment-867788993 Please fix the checkstyle reported by Yetus first. Other looks good to me. I would like to give my +1 when fix that. Before commit to trunk we should wait for other guys give

[GitHub] [hadoop] goiri commented on a change in pull request #1018: YARN-9643. Federation: Add subClusterID in nodes page of Router web

2021-06-24 Thread GitBox
goiri commented on a change in pull request #1018: URL: https://github.com/apache/hadoop/pull/1018#discussion_r658088823 ## File path:

[GitHub] [hadoop] goiri commented on a change in pull request #3135: YARN-10829. Support getApplications API in FederationClientInterceptor

2021-06-24 Thread GitBox
goiri commented on a change in pull request #3135: URL: https://github.com/apache/hadoop/pull/3135#discussion_r658080890 ## File path:

[jira] [Work logged] (HADOOP-17764) S3AInputStream read does not re-open the input stream on the second read retry attempt

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17764?focusedWorklogId=614592=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614592 ] ASF GitHub Bot logged work on HADOOP-17764: --- Author: ASF GitHub Bot

[GitHub] [hadoop] amahussein opened a new pull request #3138: HADOOP-17769. Upgrade JUnit to 4.13.2. branch-3.3

2021-06-24 Thread GitBox
amahussein opened a new pull request #3138: URL: https://github.com/apache/hadoop/pull/3138 (#3131). Contributed by Ahmed Hussein. Signed-off-by: Ayush Saxena (cherry picked from commit 581f43dce15d5753deb33f72ec275d0ea67b1403) backport upgrading Junit-4.13.2 to branch-3.3

[GitHub] [hadoop] hadoop-yetus commented on pull request #3109: HADOOP-17764. S3AInputStream read does not re-open the input stream on the second read retry attempt

2021-06-24 Thread GitBox
hadoop-yetus commented on pull request #3109: URL: https://github.com/apache/hadoop/pull/3109#issuecomment-867763605 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17769) Upgrade JUnit to 4.13.2

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17769?focusedWorklogId=614591=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614591 ] ASF GitHub Bot logged work on HADOOP-17769: --- Author: ASF GitHub Bot

[jira] [Resolved] (HADOOP-17771) S3AFS creation fails "Unable to find a region via the region provider chain."

2021-06-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17771. - Fix Version/s: 3.3.2 Resolution: Fixed > S3AFS creation fails "Unable to find a

[jira] [Work logged] (HADOOP-17764) S3AInputStream read does not re-open the input stream on the second read retry attempt

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17764?focusedWorklogId=614589=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614589 ] ASF GitHub Bot logged work on HADOOP-17764: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3132: HADOOP-17764. S3AInputStream read does not re-open the input stream on the second read retry attempt

2021-06-24 Thread GitBox
hadoop-yetus commented on pull request #3132: URL: https://github.com/apache/hadoop/pull/3132#issuecomment-867757850 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13887?focusedWorklogId=614580=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614580 ] ASF GitHub Bot logged work on HADOOP-13887: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2706: HADOOP-13887. Support S3 client side encryption (S3-CSE) using AWS-SDK

2021-06-24 Thread GitBox
steveloughran commented on pull request #2706: URL: https://github.com/apache/hadoop/pull/2706#issuecomment-867746180 Hey, someone just broke things.Sorry. > The weird thing is it skips in IDE, but for some reason, I am not able to make it skip in mvn terminal What I

[jira] [Work logged] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13887?focusedWorklogId=614579=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614579 ] ASF GitHub Bot logged work on HADOOP-13887: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2706: HADOOP-13887. Support S3 client side encryption (S3-CSE) using AWS-SDK

2021-06-24 Thread GitBox
hadoop-yetus removed a comment on pull request #2706: URL: https://github.com/apache/hadoop/pull/2706#issuecomment-841789913 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[jira] [Work logged] (HADOOP-17771) S3AFS creation fails "Unable to find a region via the region provider chain."

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17771?focusedWorklogId=614578=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614578 ] ASF GitHub Bot logged work on HADOOP-17771: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3133: HADOOP-17771. S3AFS creation fails "Unable to find a region via the region provider chain."

2021-06-24 Thread GitBox
steveloughran commented on pull request #3133: URL: https://github.com/apache/hadoop/pull/3133#issuecomment-867742004 merged into trunk; building and testing for 3.3 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Work logged] (HADOOP-17771) S3AFS creation fails "Unable to find a region via the region provider chain."

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17771?focusedWorklogId=614576=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614576 ] ASF GitHub Bot logged work on HADOOP-17771: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran merged pull request #3133: HADOOP-17771. S3AFS creation fails "Unable to find a region via the region provider chain."

2021-06-24 Thread GitBox
steveloughran merged pull request #3133: URL: https://github.com/apache/hadoop/pull/3133 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[jira] [Work logged] (HADOOP-17771) S3AFS creation fails "Unable to find a region via the region provider chain."

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17771?focusedWorklogId=614569=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614569 ] ASF GitHub Bot logged work on HADOOP-17771: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3133: HADOOP-17771. S3AFS creation fails "Unable to find a region via the region provider chain."

2021-06-24 Thread GitBox
steveloughran commented on pull request #3133: URL: https://github.com/apache/hadoop/pull/3133#issuecomment-867732526 thanks, merging! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Work logged] (HADOOP-17764) S3AInputStream read does not re-open the input stream on the second read retry attempt

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17764?focusedWorklogId=614568=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614568 ] ASF GitHub Bot logged work on HADOOP-17764: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17764) S3AInputStream read does not re-open the input stream on the second read retry attempt

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17764?focusedWorklogId=614567=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614567 ] ASF GitHub Bot logged work on HADOOP-17764: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3109: HADOOP-17764. S3AInputStream read does not re-open the input stream on the second read retry attempt

2021-06-24 Thread GitBox
steveloughran commented on pull request #3109: URL: https://github.com/apache/hadoop/pull/3109#issuecomment-867732100 Final changes LGTM; if the test run is happy then it's ready to commit -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3109: HADOOP-17764. S3AInputStream read does not re-open the input stream on the second read retry attempt

2021-06-24 Thread GitBox
hadoop-yetus removed a comment on pull request #3109: URL: https://github.com/apache/hadoop/pull/3109#issuecomment-865842982 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[jira] [Work logged] (HADOOP-17764) S3AInputStream read does not re-open the input stream on the second read retry attempt

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17764?focusedWorklogId=614566=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614566 ] ASF GitHub Bot logged work on HADOOP-17764: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17764) S3AInputStream read does not re-open the input stream on the second read retry attempt

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17764?focusedWorklogId=614564=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614564 ] ASF GitHub Bot logged work on HADOOP-17764: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17764) S3AInputStream read does not re-open the input stream on the second read retry attempt

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17764?focusedWorklogId=614563=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614563 ] ASF GitHub Bot logged work on HADOOP-17764: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3109: HADOOP-17764. S3AInputStream read does not re-open the input stream on the second read retry attempt

2021-06-24 Thread GitBox
hadoop-yetus removed a comment on pull request #3109: URL: https://github.com/apache/hadoop/pull/3109#issuecomment-864965245 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3109: HADOOP-17764. S3AInputStream read does not re-open the input stream on the second read retry attempt

2021-06-24 Thread GitBox
hadoop-yetus removed a comment on pull request #3109: URL: https://github.com/apache/hadoop/pull/3109#issuecomment-862506761 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3109: HADOOP-17764. S3AInputStream read does not re-open the input stream on the second read retry attempt

2021-06-24 Thread GitBox
hadoop-yetus removed a comment on pull request #3109: URL: https://github.com/apache/hadoop/pull/3109#issuecomment-863309072 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[jira] [Work logged] (HADOOP-17769) Upgrade JUnit to 4.13.2

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17769?focusedWorklogId=614542=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614542 ] ASF GitHub Bot logged work on HADOOP-17769: --- Author: ASF GitHub Bot

[GitHub] [hadoop] amahussein commented on pull request #3130: HADOOP-17769. Upgrade JUnit to 4.13.2. fixes TestBlockRecovery

2021-06-24 Thread GitBox
amahussein commented on pull request #3130: URL: https://github.com/apache/hadoop/pull/3130#issuecomment-867685959 > Merged to trunk. @amahussein the cherry-pick fails for 3.3 and 3.2, Would you be able to provide patch/PR for them? Thanks @ayushtkn for merging the PR! Sure, I

[jira] [Work logged] (HADOOP-17771) S3AFS creation fails "Unable to find a region via the region provider chain."

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17771?focusedWorklogId=614527=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614527 ] ASF GitHub Bot logged work on HADOOP-17771: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mukund-thakur commented on pull request #3133: HADOOP-17771. S3AFS creation fails "Unable to find a region via the region provider chain."

2021-06-24 Thread GitBox
mukund-thakur commented on pull request #3133: URL: https://github.com/apache/hadoop/pull/3133#issuecomment-867665936 @steveloughran Thanks. Tests run fine after setting the sts region and endpoints. So we are good. -- This is an automated message from the Apache Git Service. To

[jira] [Work logged] (HADOOP-17771) S3AFS creation fails "Unable to find a region via the region provider chain."

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17771?focusedWorklogId=614517=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614517 ] ASF GitHub Bot logged work on HADOOP-17771: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3133: HADOOP-17771. S3AFS creation fails "Unable to find a region via the region provider chain."

2021-06-24 Thread GitBox
steveloughran commented on pull request #3133: URL: https://github.com/apache/hadoop/pull/3133#issuecomment-867650724 @mukund-thakur see HADOOP-16565 for the STS behaviour; no regressions there & that patch provides some diagnostics. -- This is an automated message from the Apache Git

[jira] [Work logged] (HADOOP-17771) S3AFS creation fails "Unable to find a region via the region provider chain."

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17771?focusedWorklogId=614490=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614490 ] ASF GitHub Bot logged work on HADOOP-17771: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3133: HADOOP-17771. S3AFS creation fails "Unable to find a region via the region provider chain."

2021-06-24 Thread GitBox
steveloughran commented on pull request #3133: URL: https://github.com/apache/hadoop/pull/3133#issuecomment-867617024 The STS stuff has always needed it; look in testing.md and elsewhere for references to the option. Maybe the SDK provided the fallback if the default endpoint was used.

[jira] [Work logged] (HADOOP-17771) S3AFS creation fails "Unable to find a region via the region provider chain."

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17771?focusedWorklogId=614476=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614476 ] ASF GitHub Bot logged work on HADOOP-17771: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mukund-thakur commented on pull request #3133: HADOOP-17771. S3AFS creation fails "Unable to find a region via the region provider chain."

2021-06-24 Thread GitBox
mukund-thakur commented on pull request #3133: URL: https://github.com/apache/hadoop/pull/3133#issuecomment-867605687 After taking a glance. Not debugged in detail. @steveloughran I think STS tests still require the region to be set in ~/.aws/config as the stack trace is different.

[jira] [Work logged] (HADOOP-17771) S3AFS creation fails "Unable to find a region via the region provider chain."

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17771?focusedWorklogId=614474=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614474 ] ASF GitHub Bot logged work on HADOOP-17771: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17771) S3AFS creation fails "Unable to find a region via the region provider chain."

2021-06-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17771?focusedWorklogId=614473=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614473 ] ASF GitHub Bot logged work on HADOOP-17771: --- Author: ASF GitHub Bot

  1   2   >