[GitHub] [hadoop] jojochuang commented on a change in pull request #2782: HDFS-15901.Solve the problem of DN repeated block reports occupying too many RPCs during Safemode.

2021-03-18 Thread GitBox
jojochuang commented on a change in pull request #2782: URL: https://github.com/apache/hadoop/pull/2782#discussion_r597418628 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java ## @@ -2603,6 +2603,24 @@

[GitHub] [hadoop] tasanuma commented on a change in pull request #2748: HDFS-15879. Exclude slow nodes when choose targets for blocks

2021-03-18 Thread GitBox
tasanuma commented on a change in pull request #2748: URL: https://github.com/apache/hadoop/pull/2748#discussion_r597417442 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicyExcludeSlowNodes.java ##

[GitHub] [hadoop] liuml07 commented on a change in pull request #2785: HDFS-15904 : De-flake TestBalancer#testBalancerServiceOnError()

2021-03-18 Thread GitBox
liuml07 commented on a change in pull request #2785: URL: https://github.com/apache/hadoop/pull/2785#discussion_r597410126 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancer.java ## @@ -2297,7 +2297,9 @@ public void

[GitHub] [hadoop] virajjasani commented on pull request #2785: HDFS-15904 : De-flake TestBalancer#testBalancerServiceOnError()

2021-03-18 Thread GitBox
virajjasani commented on pull request #2785: URL: https://github.com/apache/hadoop/pull/2785#issuecomment-802532273 Could you please take a look @liuml07 @tasanuma ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [hadoop] goiri commented on a change in pull request #2787: HDFS-15900. RBF: empty blockpool id on dfsrouter caused by UNAVAILABLE NameNode.

2021-03-18 Thread GitBox
goiri commented on a change in pull request #2787: URL: https://github.com/apache/hadoop/pull/2787#discussion_r597386195 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/resolver/FederationNamespaceInfo.java ## @@ -75,4

[GitHub] [hadoop] hadoop-yetus commented on pull request #2787: HDFS-15900. RBF: empty blockpool id on dfsrouter caused by UNAVAILABLE NameNode.

2021-03-18 Thread GitBox
hadoop-yetus commented on pull request #2787: URL: https://github.com/apache/hadoop/pull/2787#issuecomment-802513718 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hdaikoku commented on a change in pull request #2787: HDFS-15900. RBF: empty blockpool id on dfsrouter caused by UNAVAILABLE NameNode.

2021-03-18 Thread GitBox
hdaikoku commented on a change in pull request #2787: URL: https://github.com/apache/hadoop/pull/2787#discussion_r597352892 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/test/java/org/apache/hadoop/hdfs/server/federation/resolver/TestFederationNamespaceInfo.java ## @@

[GitHub] [hadoop] hdaikoku opened a new pull request #2787: HDFS-15900. RBF: empty blockpool id on dfsrouter caused by UNAVAILABLE NameNode.

2021-03-18 Thread GitBox
hdaikoku opened a new pull request #2787: URL: https://github.com/apache/hadoop/pull/2787 https://issues.apache.org/jira/browse/HDFS-15900 ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need to set the title of the pull request which

[GitHub] [hadoop] runitao commented on a change in pull request #2585: HDFS-15759. EC: Verify EC reconstruction correctness on DataNode

2021-03-18 Thread GitBox
runitao commented on a change in pull request #2585: URL: https://github.com/apache/hadoop/pull/2585#discussion_r597351035 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestReconstructStripedFileWithValidator.java ## @@ -0,0 +1,98 @@ +/**

[GitHub] [hadoop] runitao commented on a change in pull request #2585: HDFS-15759. EC: Verify EC reconstruction correctness on DataNode

2021-03-18 Thread GitBox
runitao commented on a change in pull request #2585: URL: https://github.com/apache/hadoop/pull/2585#discussion_r597350941 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/erasurecode/StripedBlockReconstructor.java ## @@

[jira] [Work logged] (HADOOP-17511) Add an Audit plugin point for S3A auditing/context

2021-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17511?focusedWorklogId=568709=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-568709 ] ASF GitHub Bot logged work on HADOOP-17511: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2675: HADOOP-17511. Add audit/telemetry logging to S3A connector

2021-03-18 Thread GitBox
hadoop-yetus commented on pull request #2675: URL: https://github.com/apache/hadoop/pull/2675#issuecomment-802429718 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17594) DistCp: Expose the JobId for applications executing through run method

2021-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17594?focusedWorklogId=568687=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-568687 ] ASF GitHub Bot logged work on HADOOP-17594: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2786: HADOOP-17594. DistCp: Expose the JobId for applications executing through run method

2021-03-18 Thread GitBox
hadoop-yetus commented on pull request #2786: URL: https://github.com/apache/hadoop/pull/2786#issuecomment-802398033 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-13551) Collect AwsSdkMetrics in S3A FileSystem IOStatistics

2021-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13551?focusedWorklogId=568672=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-568672 ] ASF GitHub Bot logged work on HADOOP-13551: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2778: HADOOP-13551. AWS metrics wire-up

2021-03-18 Thread GitBox
hadoop-yetus commented on pull request #2778: URL: https://github.com/apache/hadoop/pull/2778#issuecomment-802373152 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Commented] (HADOOP-13551) Collect AwsSdkMetrics in S3A FileSystem IOStatistics

2021-03-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304488#comment-17304488 ] Steve Loughran commented on HADOOP-13551: - Marking as a blocker for 3.3.1 as a previous PR

[jira] [Updated] (HADOOP-13551) Collect AwsSdkMetrics in S3A FileSystem IOStatistics

2021-03-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13551: Target Version/s: 3.3.1 (was: 3.4.0) > Collect AwsSdkMetrics in S3A FileSystem

[jira] [Updated] (HADOOP-13551) Collect AwsSdkMetrics in S3A FileSystem IOStatistics

2021-03-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13551: Priority: Blocker (was: Major) > Collect AwsSdkMetrics in S3A FileSystem IOStatistics >

[jira] [Work logged] (HADOOP-17594) DistCp: Expose the JobId for applications executing through run method

2021-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17594?focusedWorklogId=568638=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-568638 ] ASF GitHub Bot logged work on HADOOP-17594: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on a change in pull request #2786: HADOOP-17594. DistCp: Expose the JobId for applications executing through run method

2021-03-18 Thread GitBox
steveloughran commented on a change in pull request #2786: URL: https://github.com/apache/hadoop/pull/2786#discussion_r597266338 ## File path: hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/contract/AbstractContractDistCpTest.java ## @@ -43,6 +44,7 @@

[jira] [Commented] (HADOOP-17310) Touch command with -c option is broken

2021-03-18 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304471#comment-17304471 ] Stephen O'Donnell commented on HADOOP-17310: Thanks [~ayushtkn]! > Touch command with -c

[GitHub] [hadoop] hadoop-yetus commented on pull request #2785: HDFS-15904 : De-flake TestBalancer#testBalancerServiceOnError()

2021-03-18 Thread GitBox
hadoop-yetus commented on pull request #2785: URL: https://github.com/apache/hadoop/pull/2785#issuecomment-802218023 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Commented] (HADOOP-17310) Touch command with -c option is broken

2021-03-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304358#comment-17304358 ] Ayush Saxena commented on HADOOP-17310: --- Cherry-picked to branch-3.3,3.2 and 3.1 > Touch command

[jira] [Updated] (HADOOP-17310) Touch command with -c option is broken

2021-03-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HADOOP-17310: -- Fix Version/s: 3.2.3 3.1.5 3.3.1 > Touch command with

[GitHub] [hadoop] Nargeshdb commented on pull request #2736: HDFS-15868. Possible Resource Leak in EditLogFileOutputStream

2021-03-18 Thread GitBox
Nargeshdb commented on pull request #2736: URL: https://github.com/apache/hadoop/pull/2736#issuecomment-802206225 Should we expect [these tests](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2736/5/testReport/) pass or not? I checked test failures in

[GitHub] [hadoop] hadoop-yetus commented on pull request #2785: HDFS-15904 : De-flake TestBalancer#testBalancerServiceOnError()

2021-03-18 Thread GitBox
hadoop-yetus commented on pull request #2785: URL: https://github.com/apache/hadoop/pull/2785#issuecomment-802203762 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17594) DistCp: Expose the JobId for applications executing through run method

2021-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17594?focusedWorklogId=568549=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-568549 ] ASF GitHub Bot logged work on HADOOP-17594: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2786: HADOOP-17594. DistCp: Expose the JobId for applications executing through run method

2021-03-18 Thread GitBox
hadoop-yetus commented on pull request #2786: URL: https://github.com/apache/hadoop/pull/2786#issuecomment-802173032 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] Nargeshdb commented on pull request #2736: HDFS-15868. Possible Resource Leak in EditLogFileOutputStream

2021-03-18 Thread GitBox
Nargeshdb commented on pull request #2736: URL: https://github.com/apache/hadoop/pull/2736#issuecomment-802156536 @Hexiaoqiao We are investigating the test failures. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [hadoop] hadoop-yetus commented on pull request #2744: HDFS-15874: Extend TopMetrics to support callerContext aggregation.

2021-03-18 Thread GitBox
hadoop-yetus commented on pull request #2744: URL: https://github.com/apache/hadoop/pull/2744#issuecomment-802151603 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17531) DistCp: Reduce memory usage on copying huge directories

2021-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17531?focusedWorklogId=568509=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-568509 ] ASF GitHub Bot logged work on HADOOP-17531: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2732: HADOOP-17531. DistCp: Reduce memory usage on copying huge directories.

2021-03-18 Thread GitBox
hadoop-yetus removed a comment on pull request #2732: URL: https://github.com/apache/hadoop/pull/2732#issuecomment-799847248 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[jira] [Commented] (HADOOP-17310) Touch command with -c option is broken

2021-03-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304284#comment-17304284 ] Ayush Saxena commented on HADOOP-17310: --- yeps, if the issue is there as well. > Touch command

[jira] [Work logged] (HADOOP-13551) Collect AwsSdkMetrics in S3A FileSystem IOStatistics

2021-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13551?focusedWorklogId=568485=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-568485 ] ASF GitHub Bot logged work on HADOOP-13551: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2778: HADOOP-13551. AWS metrics wire-up

2021-03-18 Thread GitBox
hadoop-yetus commented on pull request #2778: URL: https://github.com/apache/hadoop/pull/2778#issuecomment-802100977 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-13551) Collect AwsSdkMetrics in S3A FileSystem IOStatistics

2021-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13551?focusedWorklogId=568480=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-568480 ] ASF GitHub Bot logged work on HADOOP-13551: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2778: HADOOP-13551. AWS metrics wire-up

2021-03-18 Thread GitBox
hadoop-yetus commented on pull request #2778: URL: https://github.com/apache/hadoop/pull/2778#issuecomment-802097951 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] GauthamBanasandra commented on pull request #2783: HDFS-15903. Refactor X-Platform lib

2021-03-18 Thread GitBox
GauthamBanasandra commented on pull request #2783: URL: https://github.com/apache/hadoop/pull/2783#issuecomment-802097264 @aajisaka could you also please review my PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Commented] (HADOOP-17310) Touch command with -c option is broken

2021-03-18 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304259#comment-17304259 ] Stephen O'Donnell commented on HADOOP-17310: Is it worth cherry-picking this down to 3.1

[jira] [Work logged] (HADOOP-17511) Add an Audit plugin point for S3A auditing/context

2021-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17511?focusedWorklogId=568469=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-568469 ] ASF GitHub Bot logged work on HADOOP-17511: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2675: HADOOP-17511. Add audit/telemetry logging to S3A connector

2021-03-18 Thread GitBox
hadoop-yetus removed a comment on pull request #2675: URL: https://github.com/apache/hadoop/pull/2675#issuecomment-801282132 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[jira] [Work logged] (HADOOP-13551) Collect AwsSdkMetrics in S3A FileSystem IOStatistics

2021-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13551?focusedWorklogId=568412=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-568412 ] ASF GitHub Bot logged work on HADOOP-13551: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on a change in pull request #2778: HADOOP-13551. AWS metrics wire-up

2021-03-18 Thread GitBox
steveloughran commented on a change in pull request #2778: URL: https://github.com/apache/hadoop/pull/2778#discussion_r596942733 ## File path: hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/statistics/ITestAWSStatisticCollection.java ## @@ -0,0 +1,82 @@ +/* +

[jira] [Work logged] (HADOOP-13551) Collect AwsSdkMetrics in S3A FileSystem IOStatistics

2021-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13551?focusedWorklogId=568411=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-568411 ] ASF GitHub Bot logged work on HADOOP-13551: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on a change in pull request #2778: HADOOP-13551. AWS metrics wire-up

2021-03-18 Thread GitBox
steveloughran commented on a change in pull request #2778: URL: https://github.com/apache/hadoop/pull/2778#discussion_r596941307 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/DefaultS3ClientFactory.java ## @@ -70,22 +67,24 @@

[jira] [Work logged] (HADOOP-17594) DistCp: Expose the JobId for applications executing through run method

2021-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17594?focusedWorklogId=568382=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-568382 ] ASF GitHub Bot logged work on HADOOP-17594: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ayushtkn commented on pull request #2786: HADOOP-17594. DistCp: Expose the JobId for applications executing through run method

2021-03-18 Thread GitBox
ayushtkn commented on pull request #2786: URL: https://github.com/apache/hadoop/pull/2786#issuecomment-801966242 Test failure not related, That is due to timeout, failed here as well https://github.com/apache/hadoop/pull/2773#issuecomment-798921190 Have increased the timeout in my

[jira] [Work logged] (HADOOP-17594) DistCp: Expose the JobId for applications executing through run method

2021-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17594?focusedWorklogId=568377=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-568377 ] ASF GitHub Bot logged work on HADOOP-17594: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2786: HADOOP-17594. DistCp: Expose the JobId for applications executing through run method

2021-03-18 Thread GitBox
hadoop-yetus commented on pull request #2786: URL: https://github.com/apache/hadoop/pull/2786#issuecomment-801963537 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17594) DistCp: Expose the JobId for applications executing through run method

2021-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17594?focusedWorklogId=568313=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-568313 ] ASF GitHub Bot logged work on HADOOP-17594: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ayushtkn commented on pull request #2786: HADOOP-17594. DistCp: Expose the JobId for applications executing through run method

2021-03-18 Thread GitBox
ayushtkn commented on pull request #2786: URL: https://github.com/apache/hadoop/pull/2786#issuecomment-801894903 Ran the S3A Test: ``` [INFO] --- [INFO] T E S T S [INFO] ---

[GitHub] [hadoop] touchida commented on a change in pull request #2585: HDFS-15759. EC: Verify EC reconstruction correctness on DataNode

2021-03-18 Thread GitBox
touchida commented on a change in pull request #2585: URL: https://github.com/apache/hadoop/pull/2585#discussion_r596823600 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/rawcoder/DecodingValidator.java ## @@ -0,0 +1,189 @@

[jira] [Work logged] (HADOOP-17594) DistCp: Expose the JobId for applications executing through run method

2021-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17594?focusedWorklogId=568304=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-568304 ] ASF GitHub Bot logged work on HADOOP-17594: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-17594) DistCp: Expose the JobId for applications executing through run method

2021-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17594: Labels: pull-request-available (was: ) > DistCp: Expose the JobId for applications

[GitHub] [hadoop] ayushtkn opened a new pull request #2786: HADOOP-17594. DistCp: Expose the JobId for applications executing through run method

2021-03-18 Thread GitBox
ayushtkn opened a new pull request #2786: URL: https://github.com/apache/hadoop/pull/2786 https://issues.apache.org/jira/browse/HADOOP-17594 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] touchida commented on a change in pull request #2585: HDFS-15759. EC: Verify EC reconstruction correctness on DataNode

2021-03-18 Thread GitBox
touchida commented on a change in pull request #2585: URL: https://github.com/apache/hadoop/pull/2585#discussion_r596820273 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestReconstructStripedFileWithValidator.java ## @@ -0,0 +1,98 @@ +/**

[GitHub] [hadoop] touchida commented on a change in pull request #2585: HDFS-15759. EC: Verify EC reconstruction correctness on DataNode

2021-03-18 Thread GitBox
touchida commented on a change in pull request #2585: URL: https://github.com/apache/hadoop/pull/2585#discussion_r596818639 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/erasurecode/StripedBlockReconstructor.java ## @@

[jira] [Created] (HADOOP-17594) DistCp: Expose the JobId for applications executing through run method

2021-03-18 Thread Ayush Saxena (Jira)
Ayush Saxena created HADOOP-17594: - Summary: DistCp: Expose the JobId for applications executing through run method Key: HADOOP-17594 URL: https://issues.apache.org/jira/browse/HADOOP-17594 Project:

[GitHub] [hadoop] touchida commented on a change in pull request #2585: HDFS-15759. EC: Verify EC reconstruction correctness on DataNode

2021-03-18 Thread GitBox
touchida commented on a change in pull request #2585: URL: https://github.com/apache/hadoop/pull/2585#discussion_r596818639 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/erasurecode/StripedBlockReconstructor.java ## @@

[GitHub] [hadoop] virajjasani opened a new pull request #2785: HDFS-15904 : De-flake TestBalancer#testBalancerServiceOnError()

2021-03-18 Thread GitBox
virajjasani opened a new pull request #2785: URL: https://github.com/apache/hadoop/pull/2785 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Work logged] (HADOOP-13551) Collect AwsSdkMetrics in S3A FileSystem IOStatistics

2021-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13551?focusedWorklogId=568224=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-568224 ] ASF GitHub Bot logged work on HADOOP-13551: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mehakmeet commented on a change in pull request #2778: HADOOP-13551. AWS metrics wire-up

2021-03-18 Thread GitBox
mehakmeet commented on a change in pull request #2778: URL: https://github.com/apache/hadoop/pull/2778#discussion_r595978487 ## File path: hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/auth/ITestCustomSigner.java ## @@ -128,24 +142,35 @@ private Configuration

[GitHub] [hadoop] hadoop-yetus commented on pull request #2784: HDFS-15850. Superuser actions should be reported to external enforcers

2021-03-18 Thread GitBox
hadoop-yetus commented on pull request #2784: URL: https://github.com/apache/hadoop/pull/2784#issuecomment-801791798 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #2784: HDFS-15850. Superuser actions should be reported to external enforcers

2021-03-18 Thread GitBox
hadoop-yetus commented on pull request #2784: URL: https://github.com/apache/hadoop/pull/2784#issuecomment-801659165 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0