[jira] [Updated] (HADOOP-17377) ABFS: MsiTokenProvider doesn't retry HTTP 429 from the Instance Metadata Service

2021-02-18 Thread Brandon (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon updated HADOOP-17377: - Description: *Summary* The instance metadata service has its own guidance for error handling and

[jira] [Updated] (HADOOP-17377) ABFS: MsiTokenProvider doesn't retry HTTP 429 from the Instance Metadata Service

2021-02-18 Thread Brandon (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon updated HADOOP-17377: - Description: *Summary* The instance metadata service has its own guidance for error handling and

[jira] [Updated] (HADOOP-17377) ABFS: MsiTokenProvider doesn't retry HTTP 429 from the Instance Metadata Service

2021-02-18 Thread Brandon (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon updated HADOOP-17377: - Description: *Summary* The instance metadata service has its own guidance for error handling and retry

[jira] [Updated] (HADOOP-17377) ABFS: MsiTokenProvider doesn't retry HTTP 429 from the Instance Metadata Service

2021-02-18 Thread Brandon (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon updated HADOOP-17377: - Summary: ABFS: MsiTokenProvider doesn't retry HTTP 429 from the Instance Metadata Service (was: ABFS:

[jira] [Updated] (HADOOP-17532) Yarn Job execution get failed when LZ4 Compression Codec is used

2021-02-18 Thread Bhavik Patel (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavik Patel updated HADOOP-17532: -- Attachment: HADOOP-17532.001.patch > Yarn Job execution get failed when LZ4 Compression

[jira] [Updated] (HADOOP-17532) Yarn Job execution get failed when LZ4 Compression Codec is used

2021-02-18 Thread Bhavik Patel (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavik Patel updated HADOOP-17532: -- Attachment: (was: HDFS-15838.001.patch) > Yarn Job execution get failed when LZ4

[jira] [Updated] (HADOOP-17532) Yarn Job execution get failed when LZ4 Compression Codec is used

2021-02-18 Thread Bhavik Patel (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavik Patel updated HADOOP-17532: -- Attachment: (was: HADOOP-15838.002.patch) > Yarn Job execution get failed when LZ4

[jira] [Updated] (HADOOP-17532) Yarn Job execution get failed when LZ4 Compression Codec is used

2021-02-18 Thread Bhavik Patel (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavik Patel updated HADOOP-17532: -- Status: Patch Available (was: Open) > Yarn Job execution get failed when LZ4 Compression

[jira] [Updated] (HADOOP-17532) Yarn Job execution get failed when LZ4 Compression Codec is used

2021-02-18 Thread Bhavik Patel (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavik Patel updated HADOOP-17532: -- Attachment: HADOOP-15838.002.patch > Yarn Job execution get failed when LZ4 Compression

[GitHub] [hadoop] hadoop-yetus commented on pull request #2704: HDFS-15781. Add metrics for how blocks are moved in replaceBlock.

2021-02-18 Thread GitBox
hadoop-yetus commented on pull request #2704: URL: https://github.com/apache/hadoop/pull/2704#issuecomment-781858678 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17536) Suport for customer provided encrption key

2021-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17536?focusedWorklogId=554603=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-554603 ] ASF GitHub Bot logged work on HADOOP-17536: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2707: DRAFT PR: HADOOP-17536. ABFS: Supporting customer provided encryption key

2021-02-18 Thread GitBox
hadoop-yetus commented on pull request #2707: URL: https://github.com/apache/hadoop/pull/2707#issuecomment-781856107 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17038) Support disabling buffered reads in ABFS positional reads

2021-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17038?focusedWorklogId=554584=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-554584 ] ASF GitHub Bot logged work on HADOOP-17038: --- Author: ASF GitHub Bot

[GitHub] [hadoop] surendralilhore commented on pull request #2646: HADOOP-17038 Support disabling buffered reads in ABFS positional reads.

2021-02-18 Thread GitBox
surendralilhore commented on pull request #2646: URL: https://github.com/apache/hadoop/pull/2646#issuecomment-781836878 @steveloughran , I didn't see any failure. mvn -T 1C -Dparallel-tests=both clean verify Result : [INFO]

[jira] [Updated] (HADOOP-17536) Suport for customer provided encrption key

2021-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17536: Labels: pull-request-available (was: ) > Suport for customer provided encrption key >

[jira] [Work logged] (HADOOP-17536) Suport for customer provided encrption key

2021-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17536?focusedWorklogId=554577=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-554577 ] ASF GitHub Bot logged work on HADOOP-17536: --- Author: ASF GitHub Bot

[GitHub] [hadoop] bilaharith opened a new pull request #2707: DRAFT PR: HADOOP-17536. ABFS: Supporting customer provided encryption key

2021-02-18 Thread GitBox
bilaharith opened a new pull request #2707: URL: https://github.com/apache/hadoop/pull/2707 The data for a particular customer needs to be encrypted on account level. At server side the APIs will start accepting the encryption key as part of request headers. The data will be

[jira] [Updated] (HADOOP-16870) Use spotbugs-maven-plugin instead of findbugs-maven-plugin

2021-02-18 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-16870: --- Fix Version/s: (was: 3.4.0) > Use spotbugs-maven-plugin instead of

[jira] [Assigned] (HADOOP-17536) Suport for customer provided encrption key

2021-02-18 Thread Bilahari T H (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilahari T H reassigned HADOOP-17536: - Assignee: Bilahari T H > Suport for customer provided encrption key >

[jira] [Created] (HADOOP-17536) Suport for customer provided encrption key

2021-02-18 Thread Bilahari T H (Jira)
Bilahari T H created HADOOP-17536: - Summary: Suport for customer provided encrption key Key: HADOOP-17536 URL: https://issues.apache.org/jira/browse/HADOOP-17536 Project: Hadoop Common Issue

[jira] [Work logged] (HADOOP-17528) Not closing an SFTP File System instance prevents JVM from exiting.

2021-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17528?focusedWorklogId=554563=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-554563 ] ASF GitHub Bot logged work on HADOOP-17528: --- Author: ASF GitHub Bot

[GitHub] [hadoop] aajisaka commented on pull request #2701: HADOOP-17528. Fix closing an underlying connection pool when closing SFTP File System

2021-02-18 Thread GitBox
aajisaka commented on pull request #2701: URL: https://github.com/apache/hadoop/pull/2701#issuecomment-781765147 Reverted #2454 This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Reopened] (HADOOP-16870) Use spotbugs-maven-plugin instead of findbugs-maven-plugin

2021-02-18 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reopened HADOOP-16870: Reverted this due to the error: https://github.com/spotbugs/spotbugs/issues/1161 > Use

[jira] [Work logged] (HADOOP-16870) Use spotbugs-maven-plugin instead of findbugs-maven-plugin

2021-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16870?focusedWorklogId=554562=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-554562 ] ASF GitHub Bot logged work on HADOOP-16870: --- Author: ASF GitHub Bot

[GitHub] [hadoop] aajisaka commented on pull request #2454: HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin

2021-02-18 Thread GitBox
aajisaka commented on pull request #2454: URL: https://github.com/apache/hadoop/pull/2454#issuecomment-781764580 Reverted because of the build failure in #2701 This is an automated message from the Apache Git Service. To

[jira] [Work logged] (HADOOP-17528) Not closing an SFTP File System instance prevents JVM from exiting.

2021-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17528?focusedWorklogId=554559=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-554559 ] ASF GitHub Bot logged work on HADOOP-17528: --- Author: ASF GitHub Bot

[GitHub] [hadoop] aajisaka commented on pull request #2701: HADOOP-17528. Fix closing an underlying connection pool when closing SFTP File System

2021-02-18 Thread GitBox
aajisaka commented on pull request #2701: URL: https://github.com/apache/hadoop/pull/2701#issuecomment-781763970 Thank you @mpryahin for your report. I'll revert #2454 shortly. This is an automated message from the Apache

[GitHub] [hadoop] tomscut commented on pull request #2668: HDFS-15808. Add metrics for FSNamesystem read/write lock hold long time

2021-02-18 Thread GitBox
tomscut commented on pull request #2668: URL: https://github.com/apache/hadoop/pull/2668#issuecomment-781760195 > Just reposting my comment from the jira for visibility. > > The patch looks fine, but I doubt the metric will be useful in its current form. Monotonically increasing

[GitHub] [hadoop] ferhui commented on pull request #2694: HDFS-15830. Support to make dfs.image.parallel.load reconfigurable

2021-02-18 Thread GitBox
ferhui commented on pull request #2694: URL: https://github.com/apache/hadoop/pull/2694#issuecomment-781751448 cherry-picked to branch-3.3 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] ferhui merged pull request #2694: HDFS-15830. Support to make dfs.image.parallel.load reconfigurable

2021-02-18 Thread GitBox
ferhui merged pull request #2694: URL: https://github.com/apache/hadoop/pull/2694 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hadoop] ferhui commented on pull request #2694: HDFS-15830. Support to make dfs.image.parallel.load reconfigurable

2021-02-18 Thread GitBox
ferhui commented on pull request #2694: URL: https://github.com/apache/hadoop/pull/2694#issuecomment-781742400 @sodonnel @dineshchitlangia Thanks for review ! merged to trunk This is an automated message from the Apache

[GitHub] [hadoop] LeonGao91 edited a comment on pull request #2639: HDFS-15785. Datanode to support using DNS to resolve nameservices to IP addresses to get list of namenodes.

2021-02-18 Thread GitBox
LeonGao91 edited a comment on pull request #2639: URL: https://github.com/apache/hadoop/pull/2639#issuecomment-781734960 @fengnanli @goiri Could you help to take a look the change? (Somehow Jenkins is starting to use spotbug but it is not working..)

[GitHub] [hadoop] LeonGao91 commented on pull request #2639: HDFS-15785. Datanode to support using DNS to resolve nameservices to IP addresses to get list of namenodes.

2021-02-18 Thread GitBox
LeonGao91 commented on pull request #2639: URL: https://github.com/apache/hadoop/pull/2639#issuecomment-781734960 Somehow it is starting to use spotbug and it is not working (some changes on Yatus?).. @fengnanli @goiri Could you help to take a look?

[GitHub] [hadoop] LeonGao91 commented on a change in pull request #2704: HDFS-15781. Add metrics for how blocks are moved in replaceBlock.

2021-02-18 Thread GitBox
LeonGao91 commented on a change in pull request #2704: URL: https://github.com/apache/hadoop/pull/2704#discussion_r578840318 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/metrics/DataNodeMetrics.java ## @@ -188,6 +188,15 @@

[GitHub] [hadoop] hadoop-yetus commented on pull request #2639: HDFS-15785. Datanode to support using DNS to resolve nameservices to IP addresses to get list of namenodes.

2021-02-18 Thread GitBox
hadoop-yetus commented on pull request #2639: URL: https://github.com/apache/hadoop/pull/2639#issuecomment-781703710 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] Jing9 commented on a change in pull request #2704: HDFS-15781. Add metrics for how blocks are moved in replaceBlock.

2021-02-18 Thread GitBox
Jing9 commented on a change in pull request #2704: URL: https://github.com/apache/hadoop/pull/2704#discussion_r578815508 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/metrics/DataNodeMetrics.java ## @@ -188,6 +188,15 @@

[GitHub] [hadoop] hadoop-yetus commented on pull request #2705: MAPREDUCE-7320. cleanup test data after ClusterMapReduceTestCase

2021-02-18 Thread GitBox
hadoop-yetus commented on pull request #2705: URL: https://github.com/apache/hadoop/pull/2705#issuecomment-781652200 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17511) Add an Audit plugin point for S3A auditing/context

2021-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17511?focusedWorklogId=554460=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-554460 ] ASF GitHub Bot logged work on HADOOP-17511: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2675: HADOOP-17511. Add audit/telemetry logging to S3A connector

2021-02-18 Thread GitBox
hadoop-yetus commented on pull request #2675: URL: https://github.com/apache/hadoop/pull/2675#issuecomment-781633493 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] shvachko edited a comment on pull request #2668: HDFS-15808. Add metrics for FSNamesystem read/write lock hold long time

2021-02-18 Thread GitBox
shvachko edited a comment on pull request #2668: URL: https://github.com/apache/hadoop/pull/2668#issuecomment-781609671 Just reposting my comment from the jira for visibility. The patch looks fine, but I doubt the metric will be useful in its current form. Monotonically increasing

[GitHub] [hadoop] shvachko commented on pull request #2668: HDFS-15808. Add metrics for FSNamesystem read/write lock hold long time

2021-02-18 Thread GitBox
shvachko commented on pull request #2668: URL: https://github.com/apache/hadoop/pull/2668#issuecomment-781609671 Just reposting my comment on the jira for visibility. The patch looks fine, but I doubt the metric will be useful in its current form. Monotonically increasing counter

[jira] [Work logged] (HADOOP-17527) ABFS: Fix boundary conditions in InputStream seek and skip

2021-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17527?focusedWorklogId=554394=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-554394 ] ASF GitHub Bot logged work on HADOOP-17527: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2698: HADOOP-17527. ABFS: Fix boundary conditions in InputStream seek and skip

2021-02-18 Thread GitBox
hadoop-yetus commented on pull request #2698: URL: https://github.com/apache/hadoop/pull/2698#issuecomment-781553489 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17527) ABFS: Fix boundary conditions in InputStream seek and skip

2021-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17527?focusedWorklogId=554386=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-554386 ] ASF GitHub Bot logged work on HADOOP-17527: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2698: HADOOP-17527. ABFS: Fix boundary conditions in InputStream seek and skip

2021-02-18 Thread GitBox
hadoop-yetus commented on pull request #2698: URL: https://github.com/apache/hadoop/pull/2698#issuecomment-781546390 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Updated] (HADOOP-17527) ABFS: Fix boundary conditions in InputStream seek and skip

2021-02-18 Thread Sumangala Patki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumangala Patki updated HADOOP-17527: - Description: Modify AbfsInputStream seek method to throw EOF exception on seek to

[jira] [Work logged] (HADOOP-17527) ABFS: Fix boundary conditions in InputStream seek and skip

2021-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17527?focusedWorklogId=554352=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-554352 ] ASF GitHub Bot logged work on HADOOP-17527: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sumangala-patki commented on a change in pull request #2698: HADOOP-17527. ABFS: Fix boundary conditions in InputStream seek and skip

2021-02-18 Thread GitBox
sumangala-patki commented on a change in pull request #2698: URL: https://github.com/apache/hadoop/pull/2698#discussion_r578609371 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsInputStream.java ## @@ -583,8 +583,8 @@ public

[jira] [Work logged] (HADOOP-17527) ABFS: Fix boundary conditions in InputStream seek and skip

2021-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17527?focusedWorklogId=554351=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-554351 ] ASF GitHub Bot logged work on HADOOP-17527: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sumangala-patki commented on a change in pull request #2698: HADOOP-17527. ABFS: Fix boundary conditions in InputStream seek and skip

2021-02-18 Thread GitBox
sumangala-patki commented on a change in pull request #2698: URL: https://github.com/apache/hadoop/pull/2698#discussion_r578608579 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAzureBlobFileSystemRandomRead.java ## @@ -402,6 +399,18

[GitHub] [hadoop] mehakmeet commented on a change in pull request #2706: HADOOP-13887. Support S3 client side encryption (S3-CSE) using AWS-SDK

2021-02-18 Thread GitBox
mehakmeet commented on a change in pull request #2706: URL: https://github.com/apache/hadoop/pull/2706#discussion_r578587149 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3ACSEMaterialProviderConfig.java ## @@ -0,0 +1,14 @@ +package

[GitHub] [hadoop] mehakmeet commented on a change in pull request #2706: HADOOP-13887. Support S3 client side encryption (S3-CSE) using AWS-SDK

2021-02-18 Thread GitBox
mehakmeet commented on a change in pull request #2706: URL: https://github.com/apache/hadoop/pull/2706#discussion_r578586956 ## File path: hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/ITestS3AEncryptionCSESymmetric.java ## @@ -0,0 +1,86 @@ +package

[jira] [Work logged] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

2021-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13887?focusedWorklogId=554343=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-554343 ] ASF GitHub Bot logged work on HADOOP-13887: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

2021-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13887?focusedWorklogId=554342=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-554342 ] ASF GitHub Bot logged work on HADOOP-13887: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-16810) Increase entropy to improve cryptographic randomness on precommit Linux VMs

2021-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16810?focusedWorklogId=554334=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-554334 ] ASF GitHub Bot logged work on HADOOP-16810: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2697: HADOOP-16810. Increase entropy on precommit Linux VMs

2021-02-18 Thread GitBox
hadoop-yetus commented on pull request #2697: URL: https://github.com/apache/hadoop/pull/2697#issuecomment-781479812 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

[jira] [Commented] (HADOOP-17531) DistCp: Reduce memory usage on copying huge directories

2021-02-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17286571#comment-17286571 ] Ayush Saxena commented on HADOOP-17531: --- {quote}Was the test tried out with HDFS or local fs

[GitHub] [hadoop] hadoop-yetus commented on pull request #2674: YARN-10476. Queue metrics for Unmanaged applications

2021-02-18 Thread GitBox
hadoop-yetus commented on pull request #2674: URL: https://github.com/apache/hadoop/pull/2674#issuecomment-781444596 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

2021-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13887?focusedWorklogId=554303=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-554303 ] ASF GitHub Bot logged work on HADOOP-13887: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2706: HADOOP-13887. Support S3 client side encryption (S3-CSE) using AWS-SDK

2021-02-18 Thread GitBox
hadoop-yetus commented on pull request #2706: URL: https://github.com/apache/hadoop/pull/2706#issuecomment-781440565 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Commented] (HADOOP-17510) Hadoop prints sensitive Cookie information.

2021-02-18 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17286549#comment-17286549 ] Brahma Reddy Battula commented on HADOOP-17510: --- [~prasad-acit] thanks for reporting..

[jira] [Work logged] (HADOOP-17510) Hadoop prints sensitive Cookie information.

2021-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17510?focusedWorklogId=554300=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-554300 ] ASF GitHub Bot logged work on HADOOP-17510: --- Author: ASF GitHub Bot

[GitHub] [hadoop] brahmareddybattula commented on pull request #2673: HADOOP-17510. Hadoop prints sensitive Cookie information.

2021-02-18 Thread GitBox
brahmareddybattula commented on pull request #2673: URL: https://github.com/apache/hadoop/pull/2673#issuecomment-781431859 LGTM. This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Updated] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

2021-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-13887: Labels: pull-request-available (was: ) > Encrypt S3A data client-side with AWS SDK

[jira] [Work logged] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

2021-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13887?focusedWorklogId=554269=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-554269 ] ASF GitHub Bot logged work on HADOOP-13887: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mehakmeet opened a new pull request #2706: HADOOP-13887. Support S3 client side encryption (S3-CSE) using AWS-SDK

2021-02-18 Thread GitBox
mehakmeet opened a new pull request #2706: URL: https://github.com/apache/hadoop/pull/2706 Tests: mvn -T 32 clean verify -Ddynamo -Dauth -Dscale -Dparallel-tests Region: ap-south-1 ``` [INFO] Results: [INFO] [WARNING] Tests run: 535, Failures: 0, Errors: 0, Skipped: 5

[jira] [Commented] (HADOOP-17535) abfs ITestAzureBlobFileSystemCheckAccess test failure if test doesn't have oauth keys

2021-02-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17286484#comment-17286484 ] Steve Loughran commented on HADOOP-17535: - {code} [INFO] Tests run: 3, Failures: 0, Errors: 0,

[jira] [Created] (HADOOP-17535) abfs ITestAzureBlobFileSystemCheckAccess test failure if test doesn't have oauth keys

2021-02-18 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-17535: --- Summary: abfs ITestAzureBlobFileSystemCheckAccess test failure if test doesn't have oauth keys Key: HADOOP-17535 URL: https://issues.apache.org/jira/browse/HADOOP-17535

[jira] [Work logged] (HADOOP-17527) ABFS: Fix boundary conditions in InputStream seek and skip

2021-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17527?focusedWorklogId=554236=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-554236 ] ASF GitHub Bot logged work on HADOOP-17527: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on a change in pull request #2698: HADOOP-17527. ABFS: ABFS: Fix boundary conditions in InputStream seek and skip

2021-02-18 Thread GitBox
steveloughran commented on a change in pull request #2698: URL: https://github.com/apache/hadoop/pull/2698#discussion_r578418389 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAzureBlobFileSystemRandomRead.java ## @@ -402,6 +399,18 @@

[jira] [Work logged] (HADOOP-17038) Support disabling buffered reads in ABFS positional reads

2021-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17038?focusedWorklogId=554233=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-554233 ] ASF GitHub Bot logged work on HADOOP-17038: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2646: HADOOP-17038 Support disabling buffered reads in ABFS positional reads.

2021-02-18 Thread GitBox
steveloughran commented on pull request #2646: URL: https://github.com/apache/hadoop/pull/2646#issuecomment-781343229 just done a test run and lots of tests are failing for me on trunk & branch-3. Not related to this PR, I believe, but enough to stop me backporting for now. Will

[jira] [Work logged] (HADOOP-17529) Update os-maven-plugin to version 1.7.0, to support RISC-V architecture (JDK11)

2021-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17529?focusedWorklogId=554209=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-554209 ] ASF GitHub Bot logged work on HADOOP-17529: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2700: HADOOP-17529. Upgrade os-maven-plugin to 1.7.0

2021-02-18 Thread GitBox
steveloughran commented on pull request #2700: URL: https://github.com/apache/hadoop/pull/2700#issuecomment-781293684 > I am not familiar with the module hierarchy - so please feel free to rewrite the source code yourself. well, the yarn-csi module depends on the main one, so it

[jira] [Updated] (HADOOP-17534) Upgrade Jackson databind to 2.10.5.1

2021-02-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17534: Component/s: build > Upgrade Jackson databind to 2.10.5.1 >

[jira] [Updated] (HADOOP-17534) Upgrade Jackson databind to 2.10.5.1

2021-02-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17534: Affects Version/s: 3.2.2 > Upgrade Jackson databind to 2.10.5.1 >

[GitHub] [hadoop] bibinchundatt commented on pull request #2674: YARN-10476. Queue metrics for Unmanaged applications

2021-02-18 Thread GitBox
bibinchundatt commented on pull request #2674: URL: https://github.com/apache/hadoop/pull/2674#issuecomment-781282914 +1 LGTM , @cyrus-jackson please to take care of the checkstyle too This is an automated message from the

[GitHub] [hadoop] bibinchundatt removed a comment on pull request #2674: YARN-10476. Queue metrics for Unmanaged applications

2021-02-18 Thread GitBox
bibinchundatt removed a comment on pull request #2674: URL: https://github.com/apache/hadoop/pull/2674#issuecomment-781250121 +1 This is an automated message from the Apache Git Service. To respond to the message, please

[jira] [Created] (HADOOP-17534) Upgrade Jackson databind to 2.10.5.1

2021-02-18 Thread Adam Roberts (Jira)
Adam Roberts created HADOOP-17534: - Summary: Upgrade Jackson databind to 2.10.5.1 Key: HADOOP-17534 URL: https://issues.apache.org/jira/browse/HADOOP-17534 Project: Hadoop Common Issue Type:

[jira] [Work logged] (HADOOP-17527) ABFS: Fix boundary conditions in InputStream seek and skip

2021-02-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17527?focusedWorklogId=554173=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-554173 ] ASF GitHub Bot logged work on HADOOP-17527: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2698: HADOOP-17527. ABFS: ABFS: Fix boundary conditions in InputStream seek and skip

2021-02-18 Thread GitBox
hadoop-yetus commented on pull request #2698: URL: https://github.com/apache/hadoop/pull/2698#issuecomment-781255348 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] bibinchundatt commented on pull request #2674: YARN-10476. Queue metrics for Unmanaged applications

2021-02-18 Thread GitBox
bibinchundatt commented on pull request #2674: URL: https://github.com/apache/hadoop/pull/2674#issuecomment-781250121 +1 This is an automated message from the Apache Git Service. To respond to the message, please log on to