[GitHub] [hadoop] snvijaya commented on a change in pull request #2246: Hadoop 17215: Disable default create overwrite

2020-08-25 Thread GitBox
snvijaya commented on a change in pull request #2246: URL: https://github.com/apache/hadoop/pull/2246#discussion_r477040596 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java ## @@ -271,10 +272,62 @@ public

[GitHub] [hadoop] snvijaya commented on a change in pull request #2246: Hadoop 17215: Disable default create overwrite

2020-08-25 Thread GitBox
snvijaya commented on a change in pull request #2246: URL: https://github.com/apache/hadoop/pull/2246#discussion_r477040222 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java ## @@ -271,10 +272,62 @@ public

[GitHub] [hadoop] snvijaya commented on a change in pull request #2246: Hadoop 17215: Disable default create overwrite

2020-08-25 Thread GitBox
snvijaya commented on a change in pull request #2246: URL: https://github.com/apache/hadoop/pull/2246#discussion_r477039919 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java ## @@ -271,10 +272,62 @@ public

[GitHub] [hadoop] snvijaya commented on a change in pull request #2246: Hadoop 17215: Disable default create overwrite

2020-08-25 Thread GitBox
snvijaya commented on a change in pull request #2246: URL: https://github.com/apache/hadoop/pull/2246#discussion_r477039654 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java ## @@ -271,10 +272,62 @@ public

[jira] [Updated] (HADOOP-17229) Test failure as failed request body counted in byte received metric - ITestAbfsInputStreamStatistics#testAbfsHttpResponseStatistics

2020-08-25 Thread Sneha Vijayarajan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sneha Vijayarajan updated HADOOP-17229: --- Labels: abfsactive (was: ) > Test failure as failed request body counted in byte

[jira] [Updated] (HADOOP-17229) Test failure as failed request body counted in byte received metric - ITestAbfsInputStreamStatistics#testAbfsHttpResponseStatistics

2020-08-25 Thread Sneha Vijayarajan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sneha Vijayarajan updated HADOOP-17229: --- Description: Bytes received counter increments for every request response

[GitHub] [hadoop] snvijaya opened a new pull request #2246: Hadoop 17215: Disable default create overwrite

2020-08-25 Thread GitBox
snvijaya opened a new pull request #2246: URL: https://github.com/apache/hadoop/pull/2246 ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need to set the title of the pull request which starts with the corresponding JIRA issue number. (e.g.

[jira] [Commented] (HADOOP-17222) Create socket address combined with cache to speed up hdfs client choose DataNode

2020-08-25 Thread fanrui (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17184933#comment-17184933 ] fanrui commented on HADOOP-17222: - [~hexiaoqiao], thanks for your suggestions. I agree with you, if

[jira] [Updated] (HADOOP-17212) Improve and revise the performance description in the Tencent COS website document

2020-08-25 Thread Yang Yu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yu updated HADOOP-17212: - Attachment: HADOOP-17212-branch-3.3.002.patch > Improve and revise the performance description in the

[jira] [Updated] (HADOOP-17212) Improve and revise the performance description in the Tencent COS website document

2020-08-25 Thread Yang Yu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yu updated HADOOP-17212: - Attachment: (was: HADOOP-17212-branch-3.3.002.patch) > Improve and revise the performance

[jira] [Commented] (HADOOP-17212) Improve and revise the performance description in the Tencent COS website document

2020-08-25 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17184917#comment-17184917 ] Hadoop QA commented on HADOOP-17212: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-17222) Create socket address combined with cache to speed up hdfs client choose DataNode

2020-08-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17184914#comment-17184914 ] Xiaoqiao He commented on HADOOP-17222: -- {quote}1. in hadoop-common/NetUtils we have two API of

[jira] [Updated] (HADOOP-17212) Improve and revise the performance description in the Tencent COS website document

2020-08-25 Thread Yang Yu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yu updated HADOOP-17212: - Attachment: HADOOP-17212-branch-3.3.002.patch > Improve and revise the performance description in the

[GitHub] [hadoop] hadoop-yetus commented on pull request #2069: HADOOP-16830. IOStatistics API.

2020-08-25 Thread GitBox
hadoop-yetus commented on pull request #2069: URL: https://github.com/apache/hadoop/pull/2069#issuecomment-680503407 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 37m

[jira] [Commented] (HADOOP-17212) Improve and revise the performance description in the Tencent COS website document

2020-08-25 Thread Yang Yu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17184879#comment-17184879 ] Yang Yu commented on HADOOP-17212: -- [~brahmareddy] Thank you very much for your reply.   In response

[GitHub] [hadoop] hadoop-yetus commented on pull request #2069: HADOOP-16830. IOStatistics API.

2020-08-25 Thread GitBox
hadoop-yetus commented on pull request #2069: URL: https://github.com/apache/hadoop/pull/2069#issuecomment-680411751 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[jira] [Commented] (HADOOP-17216) hadoop-aws having FileNotFoundException when accessing AWS s3 occassionally

2020-08-25 Thread Cheng Wei (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17184839#comment-17184839 ] Cheng Wei commented on HADOOP-17216: Thanks [~ste...@apache.org], I will try 3.3.0 out when I get

[GitHub] [hadoop] hadoop-yetus commented on pull request #2201: HADOOP-17125. Using snappy-java in SnappyCodec

2020-08-25 Thread GitBox
hadoop-yetus commented on pull request #2201: URL: https://github.com/apache/hadoop/pull/2201#issuecomment-680407386 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

[jira] [Commented] (HADOOP-17144) Update Hadoop's lz4 to v1.9.2

2020-08-25 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17184793#comment-17184793 ] Masatake Iwasaki commented on HADOOP-17144: --- {quote}user's compressed data input will be

[jira] [Commented] (HADOOP-17225) Update jackson-mapper-asl-1.9.13 to atlassian version to mitigate: CVE-2019-10172

2020-08-25 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17184784#comment-17184784 ] Hadoop QA commented on HADOOP-17225: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[GitHub] [hadoop] sguggilam commented on pull request #2245: HADOOP-17159 Ability for forceful relogin in UserGroupInformation class

2020-08-25 Thread GitBox
sguggilam commented on pull request #2245: URL: https://github.com/apache/hadoop/pull/2245#issuecomment-680320509 @liuml07 Please review the change for branch-2.10 This is an automated message from the Apache Git Service. To

[GitHub] [hadoop] hadoop-yetus commented on pull request #2245: HADOOP-17159 Ability for forceful relogin in UserGroupInformation class

2020-08-25 Thread GitBox
hadoop-yetus commented on pull request #2245: URL: https://github.com/apache/hadoop/pull/2245#issuecomment-680320150 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 12m

[GitHub] [hadoop] hadoop-yetus commented on pull request #2201: HADOOP-17125. Using snappy-java in SnappyCodec

2020-08-25 Thread GitBox
hadoop-yetus commented on pull request #2201: URL: https://github.com/apache/hadoop/pull/2201#issuecomment-680314265 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 32m

[GitHub] [hadoop] hadoop-yetus commented on pull request #2069: HADOOP-16830. IOStatistics API.

2020-08-25 Thread GitBox
hadoop-yetus commented on pull request #2069: URL: https://github.com/apache/hadoop/pull/2069#issuecomment-680308475 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m

[jira] [Updated] (HADOOP-17229) Test failure as failed request body counted in byte received metric - ITestAbfsInputStreamStatistics#testAbfsHttpResponseStatistics

2020-08-25 Thread Sneha Vijayarajan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sneha Vijayarajan updated HADOOP-17229: --- Description: Bytes received counter increments for every request response

[jira] [Commented] (HADOOP-17223) update org.apache.httpcomponents:httpclient to 4.5.12 and httpcore to 4.4.13

2020-08-25 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17184762#comment-17184762 ] Hadoop QA commented on HADOOP-17223: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-17229) Test failure as failed request body counted in byte received metric - ITestAbfsInputStreamStatistics#testAbfsHttpResponseStatistics

2020-08-25 Thread Sneha Vijayarajan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sneha Vijayarajan updated HADOOP-17229: --- Description: (was: Intermittent test timeout for

[jira] [Created] (HADOOP-17229) Test failure as failed request body counted in byte received metric - ITestAbfsInputStreamStatistics#testAbfsHttpResponseStatistics

2020-08-25 Thread Sneha Vijayarajan (Jira)
Sneha Vijayarajan created HADOOP-17229: -- Summary: Test failure as failed request body counted in byte received metric - ITestAbfsInputStreamStatistics#testAbfsHttpResponseStatistics Key: HADOOP-17229 URL:

[GitHub] [hadoop] steveloughran commented on pull request #2069: HADOOP-16830. IOStatistics API.

2020-08-25 Thread GitBox
steveloughran commented on pull request #2069: URL: https://github.com/apache/hadoop/pull/2069#issuecomment-680292512 ...no, I haven't reviewed anyone elses work today, just been rebasing and wiring up the marker and async listing changes. To put them both together, the "s3guard

[jira] [Created] (HADOOP-17228) Backport HADOOP-13230 listing changes for preserved directory markers to 3.1.x

2020-08-25 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-17228: --- Summary: Backport HADOOP-13230 listing changes for preserved directory markers to 3.1.x Key: HADOOP-17228 URL: https://issues.apache.org/jira/browse/HADOOP-17228

[jira] [Updated] (HADOOP-17199) Backport HADOOP-13230 list/getFileStatus changes for preserved directory markers to 3.2.x

2020-08-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17199: Summary: Backport HADOOP-13230 list/getFileStatus changes for preserved directory

[jira] [Resolved] (HADOOP-17199) Backport HADOOP-13230 list/getFileStatus changes for preserved directory markers

2020-08-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17199. - Fix Version/s: 3.2.2 Target Version/s: 3.2.2 (was: 3.2.2, 3.1.5)

[GitHub] [hadoop] steveloughran merged pull request #2210: HADOOP-17199. S3A Directory Marker backport to branch-3.2

2020-08-25 Thread GitBox
steveloughran merged pull request #2210: URL: https://github.com/apache/hadoop/pull/2210 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] steveloughran commented on pull request #2210: HADOOP-17199. S3A Directory Marker backport to branch-3.2

2020-08-25 Thread GitBox
steveloughran commented on pull request #2210: URL: https://github.com/apache/hadoop/pull/2210#issuecomment-680284550 OK, I'm happy that the backport took. Merging. I will do a much more minimal backport to 3.1, as I don't plan to backport the path capabilities API first. All we

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2210: HADOOP-17199. S3A Directory Marker backport to branch-3.2

2020-08-25 Thread GitBox
hadoop-yetus removed a comment on pull request #2210: URL: https://github.com/apache/hadoop/pull/2210#issuecomment-680100978 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec

[jira] [Resolved] (HADOOP-17216) hadoop-aws having FileNotFoundException when accessing AWS s3 occassionally

2020-08-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17216. - Resolution: Duplicate > hadoop-aws having FileNotFoundException when accessing AWS s3

[jira] [Commented] (HADOOP-17216) hadoop-aws having FileNotFoundException when accessing AWS s3 occassionally

2020-08-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17184743#comment-17184743 ] Steve Loughran commented on HADOOP-17216: - This is 404 caching from a HEAD on file creation.

[GitHub] [hadoop] steveloughran commented on pull request #2179: HADOOP-17166. ABFS: making max concurrent requests and max requests that can be que…

2020-08-25 Thread GitBox
steveloughran commented on pull request #2179: URL: https://github.com/apache/hadoop/pull/2179#issuecomment-680270262 > We are working on a similar approach. The same needs extensive tests to ensure the perf side is fine. Till the fix is available this can be used to control the memory

[jira] [Commented] (HADOOP-17227) improve s3guard markers -expected

2020-08-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17184694#comment-17184694 ] Steve Loughran commented on HADOOP-17227: - + have bucket-info markers command list auth paths

[GitHub] [hadoop] hadoop-yetus commented on pull request #2241: HADOOP-17222. Create socket address combined with cache

2020-08-25 Thread GitBox
hadoop-yetus commented on pull request #2241: URL: https://github.com/apache/hadoop/pull/2241#issuecomment-680221389 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 29m

[jira] [Created] (HADOOP-17227) improve s3guard markers -expected

2020-08-25 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-17227: --- Summary: improve s3guard markers -expected Key: HADOOP-17227 URL: https://issues.apache.org/jira/browse/HADOOP-17227 Project: Hadoop Common Issue

[jira] [Updated] (HADOOP-17226) Failure of ITestAssumeRole.testRestrictedCommitActions

2020-08-25 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-17226: --- Description: Counter of progress callbacks of parallel commits was 1, not two. As the

[GitHub] [hadoop] liuml07 commented on a change in pull request #2189: HDFS-15025. Applying NVDIMM storage media to HDFS

2020-08-25 Thread GitBox
liuml07 commented on a change in pull request #2189: URL: https://github.com/apache/hadoop/pull/2189#discussion_r476679977 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/StorageType.java ## @@ -34,28 +34,35 @@

[jira] [Comment Edited] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-08-25 Thread Taro L. Saito (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17184686#comment-17184686 ] Taro L. Saito edited comment on HADOOP-17125 at 8/25/20, 7:07 PM: -- I'm

[jira] [Comment Edited] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-08-25 Thread Taro L. Saito (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17184686#comment-17184686 ] Taro L. Saito edited comment on HADOOP-17125 at 8/25/20, 7:06 PM: -- I'm

[jira] [Commented] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-08-25 Thread Taro L. Saito (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17184686#comment-17184686 ] Taro L. Saito commented on HADOOP-17125: I'm the creator of snappy-java and happy to see this

[GitHub] [hadoop] hadoop-yetus commented on pull request #2245: HADOOP-17159 Ability for forceful relogin in UserGroupInformation class

2020-08-25 Thread GitBox
hadoop-yetus commented on pull request #2245: URL: https://github.com/apache/hadoop/pull/2245#issuecomment-680199189 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 15m

[GitHub] [hadoop] brahmareddybattula commented on a change in pull request #2189: HDFS-15025. Applying NVDIMM storage media to HDFS

2020-08-25 Thread GitBox
brahmareddybattula commented on a change in pull request #2189: URL: https://github.com/apache/hadoop/pull/2189#discussion_r476644846 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/StorageType.java ## @@ -34,28 +34,35 @@

[jira] [Commented] (HADOOP-17226) Failure of ITestAssumeRole.testRestrictedCommitActions

2020-08-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17184640#comment-17184640 ] Steve Loughran commented on HADOOP-17226: - {code} [INFO] Running

[jira] [Created] (HADOOP-17226) Failure of ITestAssumeRole.testRestrictedCommitActions

2020-08-25 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-17226: --- Summary: Failure of ITestAssumeRole.testRestrictedCommitActions Key: HADOOP-17226 URL: https://issues.apache.org/jira/browse/HADOOP-17226 Project: Hadoop

[jira] [Commented] (HADOOP-17212) Improve and revise the performance description in the Tencent COS website document

2020-08-25 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17184637#comment-17184637 ] Brahma Reddy Battula commented on HADOOP-17212: --- HI, thanks your work here and pinging

[GitHub] [hadoop] JohnZZGithub commented on pull request #2185: HADOOP-15891. provide Regex Based Mount Point In Inode Tree

2020-08-25 Thread GitBox
JohnZZGithub commented on pull request #2185: URL: https://github.com/apache/hadoop/pull/2185#issuecomment-680179907 @umamaheswararao No worries, thanks a lot! This is an automated message from the Apache Git Service. To

[jira] [Updated] (HADOOP-17223) update org.apache.httpcomponents:httpclient to 4.5.12 and httpcore to 4.4.13

2020-08-25 Thread Pranav Bheda (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pranav Bheda updated HADOOP-17223: -- Attachment: (was: HADOOP-17223.001.patch) > update org.apache.httpcomponents:httpclient

[jira] [Updated] (HADOOP-17223) update org.apache.httpcomponents:httpclient to 4.5.12 and httpcore to 4.4.13

2020-08-25 Thread Pranav Bheda (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pranav Bheda updated HADOOP-17223: -- Attachment: HADOOP-17223.001.patch Status: Patch Available (was: Open) > update

[GitHub] [hadoop] hadoop-yetus commented on pull request #2210: HADOOP-17199. S3A Directory Marker backport to branch-3.2

2020-08-25 Thread GitBox
hadoop-yetus commented on pull request #2210: URL: https://github.com/apache/hadoop/pull/2210#issuecomment-680167672 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[jira] [Updated] (HADOOP-17225) Update jackson-mapper-asl-1.9.13 to atlassian version to mitigate: CVE-2019-10172

2020-08-25 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HADOOP-17225: -- Status: Patch Available (was: Open) Uploaded the patch Kindly review. >

[jira] [Updated] (HADOOP-17225) Update jackson-mapper-asl-1.9.13 to atlassian version to mitigate: CVE-2019-10172

2020-08-25 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HADOOP-17225: -- Attachment: HADOOP-17225-001.patch > Update jackson-mapper-asl-1.9.13 to

[jira] [Commented] (HADOOP-17144) Update Hadoop's lz4 to v1.9.2

2020-08-25 Thread Hemanth Boyina (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17184169#comment-17184169 ] Hemanth Boyina commented on HADOOP-17144: - thanks for the review [~iwasakims] {quote}Since user

[GitHub] [hadoop] hadoop-yetus commented on pull request #2210: HADOOP-17199. S3A Directory Marker backport to branch-3.2

2020-08-25 Thread GitBox
hadoop-yetus commented on pull request #2210: URL: https://github.com/apache/hadoop/pull/2210#issuecomment-680100978 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 10m

[GitHub] [hadoop] sguggilam opened a new pull request #2245: HADOOP-17159 Ability for forceful relogin in UserGroupInformation class

2020-08-25 Thread GitBox
sguggilam opened a new pull request #2245: URL: https://github.com/apache/hadoop/pull/2245 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop] hadoop-yetus commented on pull request #2202: HADOOP-17191. ABFS: Run tests with all AuthTypes

2020-08-25 Thread GitBox
hadoop-yetus commented on pull request #2202: URL: https://github.com/apache/hadoop/pull/2202#issuecomment-680076832 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m

[GitHub] [hadoop] steveloughran commented on pull request #2210: HADOOP-17199. S3A Directory Marker backport to branch-3.2

2020-08-25 Thread GitBox
steveloughran commented on pull request #2210: URL: https://github.com/apache/hadoop/pull/2210#issuecomment-680021531 Test runs against s3 london; all good but those DDB ones which fail with 0 read capacity. New tests are all happy.

[GitHub] [hadoop] hadoop-yetus commented on pull request #2189: HDFS-15025. Applying NVDIMM storage media to HDFS

2020-08-25 Thread GitBox
hadoop-yetus commented on pull request #2189: URL: https://github.com/apache/hadoop/pull/2189#issuecomment-680017965 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] hadoop-yetus commented on pull request #2201: HADOOP-17125. Using snappy-java in SnappyCodec

2020-08-25 Thread GitBox
hadoop-yetus commented on pull request #2201: URL: https://github.com/apache/hadoop/pull/2201#issuecomment-680009024 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 34m

[GitHub] [hadoop] hangc0276 commented on a change in pull request #2182: HDFS-15505. Fix NullPointerException when call getAdditionalDatanode method with null extendedBlock parameter

2020-08-25 Thread GitBox
hangc0276 commented on a change in pull request #2182: URL: https://github.com/apache/hadoop/pull/2182#discussion_r476416810 ## File path: hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/protocolPB/ClientNamenodeProtocolTranslatorPB.java ## @@

[jira] [Commented] (HADOOP-17144) Update Hadoop's lz4 to v1.9.2

2020-08-25 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183989#comment-17183989 ] Masatake Iwasaki commented on HADOOP-17144: --- {noformat} @@ -185,7 +185,7 @@ void

[jira] [Commented] (HADOOP-17144) Update Hadoop's lz4 to v1.9.2

2020-08-25 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183976#comment-17183976 ] Masatake Iwasaki commented on HADOOP-17144: --- Thanks for the update, [~hemanthboyina].

[GitHub] [hadoop] hadoop-yetus commented on pull request #2244: YARN-10407. Add phantomjsdriver.log to gitignore.

2020-08-25 Thread GitBox
hadoop-yetus commented on pull request #2244: URL: https://github.com/apache/hadoop/pull/2244#issuecomment-679990686 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[jira] [Commented] (HADOOP-17222) Create socket address combined with cache to speed up hdfs client choose DataNode

2020-08-25 Thread fanrui (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183973#comment-17183973 ] fanrui commented on HADOOP-17222: - Hi [~liuml07], thank you very much for your suggestions. add

[GitHub] [hadoop] 1996fanrui commented on a change in pull request #2241: HADOOP-17222. Create socket address combined with cache

2020-08-25 Thread GitBox
1996fanrui commented on a change in pull request #2241: URL: https://github.com/apache/hadoop/pull/2241#discussion_r476391343 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/net/NetUtils.java ## @@ -218,6 +211,28 @@ public static

[GitHub] [hadoop] hadoop-yetus commented on pull request #2243: HADOOP-17224. Install Intel ISA-L library in Dockerfile.

2020-08-25 Thread GitBox
hadoop-yetus commented on pull request #2243: URL: https://github.com/apache/hadoop/pull/2243#issuecomment-679978982 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 3m

[GitHub] [hadoop] bilaharith commented on pull request #2202: HADOOP-17191. ABFS: Run tests with all AuthTypes

2020-08-25 Thread GitBox
bilaharith commented on pull request #2202: URL: https://github.com/apache/hadoop/pull/2202#issuecomment-679978546 **Driver test results using accounts in Canary region** mvn -T 1C -Dparallel-tests=abfs -Dscale -DtestsThreadCount=8 clean verify [INFO] Tests run: 87, Failures: 0,

[GitHub] [hadoop] hadoop-yetus commented on pull request #2243: HADOOP-17224. Install Intel ISA-L library in Dockerfile.

2020-08-25 Thread GitBox
hadoop-yetus commented on pull request #2243: URL: https://github.com/apache/hadoop/pull/2243#issuecomment-679960889 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

[GitHub] [hadoop] tasanuma opened a new pull request #2244: YARN-10407. Add phantomjsdriver.log to gitignore.

2020-08-25 Thread GitBox
tasanuma opened a new pull request #2244: URL: https://github.com/apache/hadoop/pull/2244 ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need to set the title of the pull request which starts with the corresponding JIRA issue number. (e.g.

[jira] [Resolved] (HADOOP-17074) Optimise s3a Listing to be fully asynchronous.

2020-08-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17074. - Fix Version/s: 3.3.1 Resolution: Fixed > Optimise s3a Listing to be fully

[GitHub] [hadoop] steveloughran merged pull request #2207: HADOOP-17074 Optimise s3a Listing to be fully asynchronous.

2020-08-25 Thread GitBox
steveloughran merged pull request #2207: URL: https://github.com/apache/hadoop/pull/2207 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] tasanuma commented on pull request #2243: HADOOP-17224. Install Intel ISA-L library in Dockerfile.

2020-08-25 Thread GitBox
tasanuma commented on pull request #2243: URL: https://github.com/apache/hadoop/pull/2243#issuecomment-679934619 I also confirmed that `mvn test` in the environment doesn't skip the unit tests using ISA-L library. ``` tasanuma@696fff23ee3a:~/hadoop$ mvn test

[GitHub] [hadoop] tasanuma commented on pull request #2243: HADOOP-17224. Install Intel ISA-L library in Dockerfile.

2020-08-25 Thread GitBox
tasanuma commented on pull request #2243: URL: https://github.com/apache/hadoop/pull/2243#issuecomment-679931968 hadoop checknative with the change ``` $ ./start-build-env.sh ... tasanuma@696fff23ee3a:~/hadoop$ mvn clean package -Pdist,native -Dtar -DskipTests ...

[GitHub] [hadoop] steveloughran commented on pull request #2210: HADOOP-17199. S3A Directory Marker backport to branch-3.2

2020-08-25 Thread GitBox
steveloughran commented on pull request #2210: URL: https://github.com/apache/hadoop/pull/2210#issuecomment-679922156 Test failures are in TestReadWriteDiskValidator; absolutely unrelated This is an automated message from

[jira] [Commented] (HADOOP-14596) AWS SDK 1.11+ aborts() on close() if > 0 bytes in stream; logs error

2020-08-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183892#comment-17183892 ] Steve Loughran commented on HADOOP-14596: - looks like a network issue. Try turning up logging

[GitHub] [hadoop] hadoop-yetus commented on pull request #2243: HADOOP-17224. Install Intel ISA-L library in Dockerfile.

2020-08-25 Thread GitBox
hadoop-yetus commented on pull request #2243: URL: https://github.com/apache/hadoop/pull/2243#issuecomment-679897041 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 3m

[GitHub] [hadoop] hadoop-yetus commented on pull request #2202: HADOOP-17191. ABFS: Run tests with all AuthTypes

2020-08-25 Thread GitBox
hadoop-yetus commented on pull request #2202: URL: https://github.com/apache/hadoop/pull/2202#issuecomment-679889181 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 30m

[jira] [Work started] (HADOOP-17074) Optimise s3a Listing to be fully asynchronous.

2020-08-25 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-17074 started by Mukund Thakur. -- > Optimise s3a Listing to be fully asynchronous. >

[jira] [Work stopped] (HADOOP-17074) Optimise s3a Listing to be fully asynchronous.

2020-08-25 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-17074 stopped by Mukund Thakur. -- > Optimise s3a Listing to be fully asynchronous. >

[jira] [Work started] (HADOOP-17074) Optimise s3a Listing to be fully asynchronous.

2020-08-25 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-17074 started by Mukund Thakur. -- > Optimise s3a Listing to be fully asynchronous. >

[GitHub] [hadoop] hadoop-yetus commented on pull request #2202: HADOOP-17191. ABFS: Run tests with all AuthTypes

2020-08-25 Thread GitBox
hadoop-yetus commented on pull request #2202: URL: https://github.com/apache/hadoop/pull/2202#issuecomment-679879744 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m

[GitHub] [hadoop] hadoop-yetus commented on pull request #2243: HADOOP-17224. Install Intel ISA-L library in Dockerfile.

2020-08-25 Thread GitBox
hadoop-yetus commented on pull request #2243: URL: https://github.com/apache/hadoop/pull/2243#issuecomment-679874109 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

[GitHub] [hadoop] tasanuma opened a new pull request #2243: HADOOP-17224. Install Intel ISA-L library in Dockerfile.

2020-08-25 Thread GitBox
tasanuma opened a new pull request #2243: URL: https://github.com/apache/hadoop/pull/2243 ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need to set the title of the pull request which starts with the corresponding JIRA issue number. (e.g.

[jira] [Commented] (HADOOP-17222) Create socket address combined with cache to speed up hdfs client choose DataNode

2020-08-25 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183807#comment-17183807 ] Mingliang Liu commented on HADOOP-17222: {quote} it will affect all callers of

[jira] [Commented] (HADOOP-17159) Ability for forceful relogin in UserGroupInformation class

2020-08-25 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183803#comment-17183803 ] Mingliang Liu commented on HADOOP-17159: [~sandeep.guggilam] Could you provide a new PR

[jira] [Commented] (HADOOP-17222) Create socket address combined with cache to speed up hdfs client choose DataNode

2020-08-25 Thread fanrui (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183798#comment-17183798 ] fanrui commented on HADOOP-17222: - [~liuml07], thank you very much. I will do my best to do it. I

[jira] [Updated] (HADOOP-17159) Ability for forceful relogin in UserGroupInformation class

2020-08-25 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-17159: --- Fix Version/s: 3.1.5 3.4.0 3.3.1

[GitHub] [hadoop] hadoop-yetus commented on pull request #2201: HADOOP-17125. Using snappy-java in SnappyCodec

2020-08-25 Thread GitBox
hadoop-yetus commented on pull request #2201: URL: https://github.com/apache/hadoop/pull/2201#issuecomment-679845927 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

[GitHub] [hadoop] umamaheswararao commented on pull request #2185: HADOOP-15891. provide Regex Based Mount Point In Inode Tree

2020-08-25 Thread GitBox
umamaheswararao commented on pull request #2185: URL: https://github.com/apache/hadoop/pull/2185#issuecomment-679845408 Thanks a lot @JohnZZGithub for the update. Sorry for the delay. Last week we were on engineering holidays. Could not spend time on this. I will review this soon,

[jira] [Commented] (HADOOP-17222) Create socket address combined with cache to speed up hdfs client choose DataNode

2020-08-25 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183785#comment-17183785 ] Mingliang Liu commented on HADOOP-17222: [~fanrui] I have added you to Hadoop Contributor list

[jira] [Assigned] (HADOOP-17222) Create socket address combined with cache to speed up hdfs client choose DataNode

2020-08-25 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HADOOP-17222: -- Assignee: fanrui > Create socket address combined with cache to speed up hdfs

[jira] [Commented] (HADOOP-17222) Create socket address combined with cache to speed up hdfs client choose DataNode

2020-08-25 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183783#comment-17183783 ] Mingliang Liu commented on HADOOP-17222: Yes, I totally see the value of caching. That is

[jira] [Commented] (HADOOP-17222) Create socket address combined with cache to speed up hdfs client choose DataNode

2020-08-25 Thread fanrui (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183778#comment-17183778 ] fanrui commented on HADOOP-17222: - Hi [~liuml07], [~hexiaoqiao] , thank you very much for your

[GitHub] [hadoop] liuml07 commented on a change in pull request #2189: HDFS-15025. Applying NVDIMM storage media to HDFS

2020-08-25 Thread GitBox
liuml07 commented on a change in pull request #2189: URL: https://github.com/apache/hadoop/pull/2189#discussion_r476214970 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockStoragePolicySuite.java ## @@ -63,6 +63,12

[GitHub] [hadoop] hadoop-yetus commented on pull request #2201: HADOOP-17125. Using snappy-java in SnappyCodec

2020-08-25 Thread GitBox
hadoop-yetus commented on pull request #2201: URL: https://github.com/apache/hadoop/pull/2201#issuecomment-679837262 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

  1   2   >