[jira] [Comment Edited] (HADOOP-14596) AWS SDK 1.11+ aborts() on close() if > 0 bytes in stream; logs error

2020-08-21 Thread Yongjun Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17182240#comment-17182240 ] Yongjun Zhang edited comment on HADOOP-14596 at 8/22/20, 3:46 AM: -- Hi

[jira] [Commented] (HADOOP-14596) AWS SDK 1.11+ aborts() on close() if > 0 bytes in stream; logs error

2020-08-21 Thread Yongjun Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17182240#comment-17182240 ] Yongjun Zhang commented on HADOOP-14596: Hi [~ste...@apache.org], Thank you for the work here!

[jira] [Commented] (HADOOP-17201) Spark job with s3acommitter stuck at the last stage

2020-08-21 Thread Dyno (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17182187#comment-17182187 ] Dyno commented on HADOOP-17201: --- what i can confirm now is - the bucket is versioned. - HADOOP-17063 is

[GitHub] [hadoop] hadoop-yetus commented on pull request #2201: HADOOP-17125. Using snappy-java in SnappyCodec

2020-08-21 Thread GitBox
hadoop-yetus commented on pull request #2201: URL: https://github.com/apache/hadoop/pull/2201#issuecomment-678534108 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 29m

[GitHub] [hadoop] hadoop-yetus commented on pull request #2234: HDFS-15529: getChildFilesystems should include fallback fs as well

2020-08-21 Thread GitBox
hadoop-yetus commented on pull request #2234: URL: https://github.com/apache/hadoop/pull/2234#issuecomment-678490021 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 26m

[GitHub] [hadoop] hadoop-yetus commented on pull request #2202: HADOOP-17191. ABFS: Run tests with all AuthTypes

2020-08-21 Thread GitBox
hadoop-yetus commented on pull request #2202: URL: https://github.com/apache/hadoop/pull/2202#issuecomment-678474705 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 30m

[jira] [Updated] (HADOOP-17217) S3A FileSystem does not correctly delete directories with fake entries

2020-08-21 Thread Kaya Kupferschmidt (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaya Kupferschmidt updated HADOOP-17217: Description: h3. Summary We are facing an issue where the Hadoop S3A Filesystem

[jira] [Updated] (HADOOP-17217) S3A FileSystem does not correctly delete directories with fake entries

2020-08-21 Thread Kaya Kupferschmidt (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaya Kupferschmidt updated HADOOP-17217: Summary: S3A FileSystem does not correctly delete directories with fake entries

[jira] [Commented] (HADOOP-17209) Erasure Coding: Native library memory leak

2020-08-21 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181914#comment-17181914 ] Stephen O'Donnell commented on HADOOP-17209: I am also +1 on this. I will commit it on

[GitHub] [hadoop] hadoop-yetus commented on pull request #2211: HDFS-15098. Add SM4 encryption method for HDFS

2020-08-21 Thread GitBox
hadoop-yetus commented on pull request #2211: URL: https://github.com/apache/hadoop/pull/2211#issuecomment-678266493 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] steveloughran commented on a change in pull request #2069: HADOOP-16830. IOStatistics API.

2020-08-21 Thread GitBox
steveloughran commented on a change in pull request #2069: URL: https://github.com/apache/hadoop/pull/2069#discussion_r474660296 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/statistics/impl/IOStatisticsBinding.java ## @@ -0,0 +1,337 @@

[GitHub] [hadoop] steveloughran commented on a change in pull request #2069: HADOOP-16830. IOStatistics API.

2020-08-21 Thread GitBox
steveloughran commented on a change in pull request #2069: URL: https://github.com/apache/hadoop/pull/2069#discussion_r474658532 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/statistics/IOStatisticsLogging.java ## @@ -0,0 +1,182 @@ +/* +

[GitHub] [hadoop] steveloughran commented on a change in pull request #2069: HADOOP-16830. IOStatistics API.

2020-08-21 Thread GitBox
steveloughran commented on a change in pull request #2069: URL: https://github.com/apache/hadoop/pull/2069#discussion_r474658220 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/statistics/impl/EvaluatingStatisticsMap.java ## @@ -0,0 +1,191

[GitHub] [hadoop] steveloughran commented on a change in pull request #2069: HADOOP-16830. IOStatistics API.

2020-08-21 Thread GitBox
steveloughran commented on a change in pull request #2069: URL: https://github.com/apache/hadoop/pull/2069#discussion_r474654134 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FSInputStream.java ## @@ -134,4 +137,23 @@ public void

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2069: HADOOP-16830. IOStatistics API.

2020-08-21 Thread GitBox
hadoop-yetus removed a comment on pull request #2069: URL: https://github.com/apache/hadoop/pull/2069#issuecomment-670674319 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2069: HADOOP-16830. IOStatistics API.

2020-08-21 Thread GitBox
hadoop-yetus removed a comment on pull request #2069: URL: https://github.com/apache/hadoop/pull/2069#issuecomment-670263296 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2069: HADOOP-16830. IOStatistics API.

2020-08-21 Thread GitBox
hadoop-yetus removed a comment on pull request #2069: URL: https://github.com/apache/hadoop/pull/2069#issuecomment-670263401 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2069: HADOOP-16830. IOStatistics API.

2020-08-21 Thread GitBox
hadoop-yetus removed a comment on pull request #2069: URL: https://github.com/apache/hadoop/pull/2069#issuecomment-669930316 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec

[jira] [Updated] (HADOOP-17217) S3A FileSystem gets confused by fake directory entries

2020-08-21 Thread Kaya Kupferschmidt (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaya Kupferschmidt updated HADOOP-17217: Description: h3. Summary We are facing an issue where the Hadoop S3A Filesystem

[jira] [Created] (HADOOP-17217) S3A FileSystem gets confused by fake directory entries

2020-08-21 Thread Kaya Kupferschmidt (Jira)
Kaya Kupferschmidt created HADOOP-17217: --- Summary: S3A FileSystem gets confused by fake directory entries Key: HADOOP-17217 URL: https://issues.apache.org/jira/browse/HADOOP-17217 Project:

[GitHub] [hadoop] hadoop-yetus commented on pull request #2235: HDFS-15484 Add new method batchRename for DistributedFileSystem and W…

2020-08-21 Thread GitBox
hadoop-yetus commented on pull request #2235: URL: https://github.com/apache/hadoop/pull/2235#issuecomment-678133552 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 33m

[jira] [Commented] (HADOOP-17209) Erasure Coding: Native library memory leak

2020-08-21 Thread Sean Chow (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181681#comment-17181681 ] Sean Chow commented on HADOOP-17209: Thanks for your review [~sodonnell] [~tasanuma] [~hexiaoqiao] 

[GitHub] [hadoop] hadoop-yetus commented on pull request #2201: HADOOP-17125. Using snappy-java in SnappyCodec

2020-08-21 Thread GitBox
hadoop-yetus commented on pull request #2201: URL: https://github.com/apache/hadoop/pull/2201#issuecomment-678079827 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

[jira] [Commented] (HADOOP-17209) Erasure Coding: Native library memory leak

2020-08-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181654#comment-17181654 ] Xiaoqiao He commented on HADOOP-17209: -- Thanks [~seanlook] for your great catch here. +1 from my