[GitHub] [hadoop] hadoop-yetus commented on pull request #2072: HADOOP-17058. ABFS Support for AppendBlob in Hadoop ABFS Driver

2020-06-12 Thread GitBox
hadoop-yetus commented on pull request #2072: URL: https://github.com/apache/hadoop/pull/2072#issuecomment-643567930 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 2

[GitHub] [hadoop] ishaniahuja commented on pull request #2072: HADOOP-17058. ABFS Support for AppendBlob in Hadoop ABFS Driver

2020-06-12 Thread GitBox
ishaniahuja commented on pull request #2072: URL: https://github.com/apache/hadoop/pull/2072#issuecomment-643562997 namespace enabled, current rest version(2019-12-12), private endpoint Tests run: 83, Failures: 0, Errors: 0, Skipped: 0 Tests run: 440, Failures: 0, Errors: 0, Skipped: 4

[GitHub] [hadoop] hadoop-yetus commented on pull request #2072: HADOOP-17058. ABFS Support for AppendBlob in Hadoop ABFS Driver

2020-06-12 Thread GitBox
hadoop-yetus commented on pull request #2072: URL: https://github.com/apache/hadoop/pull/2072#issuecomment-643549888 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 2

[jira] [Commented] (HADOOP-17063) S3A deleteObjects hanging/retrying forever

2020-06-12 Thread Dyno (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17134609#comment-17134609 ] Dyno commented on HADOOP-17063: --- switch to magic looks working. thanks for your help. [~s

[GitHub] [hadoop] umamaheswararao commented on pull request #2066: HDFS-15387. FSUsage#DF should consider ViewFSOverloadScheme in processPath.

2020-06-12 Thread GitBox
umamaheswararao commented on pull request #2066: URL: https://github.com/apache/hadoop/pull/2066#issuecomment-643491971 Thank you @jojochuang for review! This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop] umamaheswararao merged pull request #2066: HDFS-15387. FSUsage#DF should consider ViewFSOverloadScheme in processPath.

2020-06-12 Thread GitBox
umamaheswararao merged pull request #2066: URL: https://github.com/apache/hadoop/pull/2066 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] hadoop-yetus commented on pull request #2069: HADOOP-16830. IOStatistics API.

2020-06-12 Thread GitBox
hadoop-yetus commented on pull request #2069: URL: https://github.com/apache/hadoop/pull/2069#issuecomment-643439735 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 20

[GitHub] [hadoop] hadoop-yetus commented on pull request #2072: HADOOP-17058. ABFS Support for AppendBlob in Hadoop ABFS Driver

2020-06-12 Thread GitBox
hadoop-yetus commented on pull request #2072: URL: https://github.com/apache/hadoop/pull/2072#issuecomment-643423265 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 36

[jira] [Commented] (HADOOP-17046) Support downstreams' existing Hadoop-rpc implementations using non-shaded protobuf classes.

2020-06-12 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17134441#comment-17134441 ] Hudson commented on HADOOP-17046: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Co

[jira] [Updated] (HADOOP-17046) Support downstreams' existing Hadoop-rpc implementations using non-shaded protobuf classes.

2020-06-12 Thread Vinayakumar B (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HADOOP-17046: --- Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed Status:

[jira] [Commented] (HADOOP-12231) setXIncludeAware errror keep logged while calling get from Configuration

2020-06-12 Thread Jeff Evans (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17134430#comment-17134430 ] Jeff Evans commented on HADOOP-12231: - Does anyone have a way to suppress this? >

[GitHub] [hadoop] hadoop-yetus commented on pull request #2026: HADOOP-17046. Support downstreams' existing Hadoop-rpc implementations using non-shaded protobuf classes

2020-06-12 Thread GitBox
hadoop-yetus commented on pull request #2026: URL: https://github.com/apache/hadoop/pull/2026#issuecomment-643405454 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 0

[GitHub] [hadoop] vinayakumarb merged pull request #2026: HADOOP-17046. Support downstreams' existing Hadoop-rpc implementations using non-shaded protobuf classes

2020-06-12 Thread GitBox
vinayakumarb merged pull request #2026: URL: https://github.com/apache/hadoop/pull/2026 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hadoop] hadoop-yetus commented on pull request #2071: YARN-10313. Add hadoop process id to the suffix of hadoop-unjar directory

2020-06-12 Thread GitBox
hadoop-yetus commented on pull request #2071: URL: https://github.com/apache/hadoop/pull/2071#issuecomment-643399198 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 22m 15

[GitHub] [hadoop] ishaniahuja opened a new pull request #2072: HADOOP-17058. ABFS Support for AppendBlob in Hadoop ABFS Driver

2020-06-12 Thread GitBox
ishaniahuja opened a new pull request #2072: URL: https://github.com/apache/hadoop/pull/2072 The PR provides support for AppendBlob in the Hadoop ABFS Driver. The change also adds changes in the existing test case for appendblob based files. The change has been tested against the HBASE run

[GitHub] [hadoop] Chandson opened a new pull request #2071: YARN-10313. Add hadoop process id to the suffix of hadoop-unjar directory

2020-06-12 Thread GitBox
Chandson opened a new pull request #2071: URL: https://github.com/apache/hadoop/pull/2071 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop] steveloughran commented on a change in pull request #2014: HADOOP-16854. ABFS: Fix for the OutOfMemoryException in AbfsOutputStream

2020-06-12 Thread GitBox
steveloughran commented on a change in pull request #2014: URL: https://github.com/apache/hadoop/pull/2014#discussion_r439326950 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAzureBlobFileSystemFlush.java ## @@ -207,6 +213,92 @@ publi

[GitHub] [hadoop] steveloughran commented on a change in pull request #2056: HADOOP-17065. Adding Network Counters in ABFS

2020-06-12 Thread GitBox
steveloughran commented on a change in pull request #2056: URL: https://github.com/apache/hadoop/pull/2056#discussion_r439319323 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AbfsStatistic.java ## @@ -57,7 +57,23 @@ FILES_DELETED("files

[GitHub] [hadoop] mehakmeet commented on a change in pull request #2063: HADOOP-17020. RawFileSystem could localize default block size to avoid sync bottleneck in config

2020-06-12 Thread GitBox
mehakmeet commented on a change in pull request #2063: URL: https://github.com/apache/hadoop/pull/2063#discussion_r439321862 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/RawLocalFileSystem.java ## @@ -518,7 +520,12 @@ public boolean dele

[GitHub] [hadoop] steveloughran commented on pull request #2063: HADOOP-17020. RawFileSystem could localize default block size to avoid sync bottleneck in config

2020-06-12 Thread GitBox
steveloughran commented on pull request #2063: URL: https://github.com/apache/hadoop/pull/2063#issuecomment-643181214 Looks good. One question though: Is the change on L520 Meant to be part of this patch? I can see it is an optimisation -But it is not listed in the JIRA If you want i

[GitHub] [hadoop] hadoop-yetus commented on pull request #2038: HADOOP-17022 Tune S3AFileSystem.listFiles() api.

2020-06-12 Thread GitBox
hadoop-yetus commented on pull request #2038: URL: https://github.com/apache/hadoop/pull/2038#issuecomment-643180766 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 21m

[GitHub] [hadoop] mukund-thakur commented on a change in pull request #2038: HADOOP-17022 Tune S3AFileSystem.listFiles() api.

2020-06-12 Thread GitBox
mukund-thakur commented on a change in pull request #2038: URL: https://github.com/apache/hadoop/pull/2038#discussion_r439283239 ## File path: hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/ITestS3AFileOperationCost.java ## @@ -168,6 +168,65 @@ public void test

[GitHub] [hadoop] mukund-thakur commented on a change in pull request #2038: HADOOP-17022 Tune S3AFileSystem.listFiles() api.

2020-06-12 Thread GitBox
mukund-thakur commented on a change in pull request #2038: URL: https://github.com/apache/hadoop/pull/2038#discussion_r439283351 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java ## @@ -4181,79 +4181,114 @@ public LocatedFileStatus