[jira] [Commented] (HADOOP-16867) [thirdparty] Add shaded JargerTracer

2020-02-20 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17041600#comment-17041600 ] Hudson commented on HADOOP-16867: - SUCCESS: Integrated in Jenkins build Hadoop-thirdpar

[jira] [Commented] (HADOOP-16869) mvn findbugs:findbugs fails

2020-02-20 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17041508#comment-17041508 ] Hudson commented on HADOOP-16869: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Co

[jira] [Updated] (HADOOP-16869) mvn findbugs:findbugs fails

2020-02-20 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-16869: --- Fix Version/s: 3.2.2 3.1.4 3.3.0 Resolution: Fi

[GitHub] [hadoop] aajisaka merged pull request #1855: HADOOP-16869. Upgrade findbugs-maven-plugin to 3.0.5 to fix mvn findbugs:findbugs failure

2020-02-20 Thread GitBox
aajisaka merged pull request #1855: HADOOP-16869. Upgrade findbugs-maven-plugin to 3.0.5 to fix mvn findbugs:findbugs failure URL: https://github.com/apache/hadoop/pull/1855 This is an automated message from the Apache Git S

[GitHub] [hadoop] aajisaka commented on issue #1855: HADOOP-16869. Upgrade findbugs-maven-plugin to 3.0.5 to fix mvn findbugs:findbugs failure

2020-02-20 Thread GitBox
aajisaka commented on issue #1855: HADOOP-16869. Upgrade findbugs-maven-plugin to 3.0.5 to fix mvn findbugs:findbugs failure URL: https://github.com/apache/hadoop/pull/1855#issuecomment-589479655 The shaded client build error is not related the patch. https://builds.apache.org/job/hadoo

[GitHub] [hadoop] iwasakims commented on issue #1758: HDFS-15052. WebHDFS getTrashRoot leads to OOM due to FileSystem objec…

2020-02-20 Thread GitBox
iwasakims commented on issue #1758: HDFS-15052. WebHDFS getTrashRoot leads to OOM due to FileSystem objec… URL: https://github.com/apache/hadoop/pull/1758#issuecomment-589476931 Thanks. I merged this. trying to backport to relevant branches.

[GitHub] [hadoop] iwasakims merged pull request #1758: HDFS-15052. WebHDFS getTrashRoot leads to OOM due to FileSystem objec…

2020-02-20 Thread GitBox
iwasakims merged pull request #1758: HDFS-15052. WebHDFS getTrashRoot leads to OOM due to FileSystem objec… URL: https://github.com/apache/hadoop/pull/1758 This is an automated message from the Apache Git Service. To respond

[jira] [Updated] (HADOOP-16876) KMS delegation tokens are memory expensive

2020-02-20 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-16876: - Description: We recently saw a number of users reporting high memory consumption in KMS

[jira] [Updated] (HADOOP-16876) KMS delegation tokens are memory expensive

2020-02-20 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-16876: - Description: We recently saw a number of users reporting high memory consumption in KMS

[jira] [Created] (HADOOP-16876) KMS delegation tokens are memory expensive

2020-02-20 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HADOOP-16876: Summary: KMS delegation tokens are memory expensive Key: HADOOP-16876 URL: https://issues.apache.org/jira/browse/HADOOP-16876 Project: Hadoop Common

[jira] [Updated] (HADOOP-16876) KMS delegation tokens are memory expensive

2020-02-20 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-16876: - Attachment: Screen Shot 2020-02-20 at 5.04.12 PM.png > KMS delegation tokens are memory

[jira] [Commented] (HADOOP-16206) Migrate from Log4j1 to Log4j2

2020-02-20 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17041350#comment-17041350 ] Wei-Chiu Chuang commented on HADOOP-16206: -- 3.3.0 code freeze is scheduled in

[GitHub] [hadoop] hadoop-yetus commented on issue #1820: HADOOP-16830. Add public IOStatistics API + S3A implementation

2020-02-20 Thread GitBox
hadoop-yetus commented on issue #1820: HADOOP-16830. Add public IOStatistics API + S3A implementation URL: https://github.com/apache/hadoop/pull/1820#issuecomment-589293736 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|-

[GitHub] [hadoop] kihwal commented on issue #1758: HDFS-15052. WebHDFS getTrashRoot leads to OOM due to FileSystem objec…

2020-02-20 Thread GitBox
kihwal commented on issue #1758: HDFS-15052. WebHDFS getTrashRoot leads to OOM due to FileSystem objec… URL: https://github.com/apache/hadoop/pull/1758#issuecomment-589269569 The unit test failure is unrelated and caused by "BindException: Address already in use" -

[GitHub] [hadoop] hadoop-yetus commented on issue #1758: HDFS-15052. WebHDFS getTrashRoot leads to OOM due to FileSystem objec…

2020-02-20 Thread GitBox
hadoop-yetus commented on issue #1758: HDFS-15052. WebHDFS getTrashRoot leads to OOM due to FileSystem objec… URL: https://github.com/apache/hadoop/pull/1758#issuecomment-589220825 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|-

[GitHub] [hadoop] ayushtkn commented on issue #1853: HADOOP-16873 - Upgrade to Apache ZooKeeper 3.5.7

2020-02-20 Thread GitBox
ayushtkn commented on issue #1853: HADOOP-16873 - Upgrade to Apache ZooKeeper 3.5.7 URL: https://github.com/apache/hadoop/pull/1853#issuecomment-589176640 Jenkins hasn't run all the tests, We should verify all the tests, before concluding. ---

[jira] [Commented] (HADOOP-16866) Upgrade spotbugs' version

2020-02-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17041128#comment-17041128 ] Ayush Saxena commented on HADOOP-16866: --- With 3.3.0 release near. IMO we should c

[jira] [Commented] (HADOOP-16869) mvn findbugs:findbugs fails

2020-02-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17041120#comment-17041120 ] Ayush Saxena commented on HADOOP-16869: --- Thanx [~aajisaka] for the report. I am a

[GitHub] [hadoop] hadoop-yetus commented on issue #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init()

2020-02-20 Thread GitBox
hadoop-yetus commented on issue #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init() URL: https://github.com/apache/hadoop/pull/1838#issuecomment-589159533 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--

[GitHub] [hadoop] jojochuang commented on issue #1739: HDFS-14668 Support Fuse with Users from multiple Security Realms

2020-02-20 Thread GitBox
jojochuang commented on issue #1739: HDFS-14668 Support Fuse with Users from multiple Security Realms URL: https://github.com/apache/hadoop/pull/1739#issuecomment-589148560 +1 the fix is deployed and verified to work. This is

[GitHub] [hadoop] iwasakims commented on a change in pull request #1758: HDFS-15052. WebHDFS getTrashRoot leads to OOM due to FileSystem objec…

2020-02-20 Thread GitBox
iwasakims commented on a change in pull request #1758: HDFS-15052. WebHDFS getTrashRoot leads to OOM due to FileSystem objec… URL: https://github.com/apache/hadoop/pull/1758#discussion_r382037082 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/ser

[jira] [Created] (HADOOP-16875) S3Guard: add support for other MetadataStores

2020-02-20 Thread Rafael Acevedo (Jira)
Rafael Acevedo created HADOOP-16875: --- Summary: S3Guard: add support for other MetadataStores Key: HADOOP-16875 URL: https://issues.apache.org/jira/browse/HADOOP-16875 Project: Hadoop Common

[GitHub] [hadoop] steveloughran commented on issue #1851: HADOOP-16858. S3Guard fsck: Add option to remove orphaned entries

2020-02-20 Thread GitBox
steveloughran commented on issue #1851: HADOOP-16858. S3Guard fsck: Add option to remove orphaned entries URL: https://github.com/apache/hadoop/pull/1851#issuecomment-589059339 looking forward to this This is an automated mes

[GitHub] [hadoop] steveloughran commented on issue #1844: HADOOP-16706. ITestClientUrlScheme fails for accounts which don't support HTTP

2020-02-20 Thread GitBox
steveloughran commented on issue #1844: HADOOP-16706. ITestClientUrlScheme fails for accounts which don't support HTTP URL: https://github.com/apache/hadoop/pull/1844#issuecomment-589056183 thx, will rebase and merge ASAP Thi

[jira] [Commented] (HADOOP-16647) Support OpenSSL 1.1.1 LTS

2020-02-20 Thread Luca Toscano (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040978#comment-17040978 ] Luca Toscano commented on HADOOP-16647: --- Hi [~ste...@apache.org], thanks a lot fo

[GitHub] [hadoop] steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

2020-02-20 Thread GitBox
steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r381986574 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystem.jav

[GitHub] [hadoop] steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

2020-02-20 Thread GitBox
steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r381992480 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AbfsConfiguration.java

[GitHub] [hadoop] steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

2020-02-20 Thread GitBox
steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r381987083 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/utils/SASGenerator.java

[GitHub] [hadoop] steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

2020-02-20 Thread GitBox
steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r381985040 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.jav

[GitHub] [hadoop] steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

2020-02-20 Thread GitBox
steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r381987407 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/AbstractAbfsIntegration

[GitHub] [hadoop] steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

2020-02-20 Thread GitBox
steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r381986150 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsUriQueryBu

[jira] [Commented] (HADOOP-16864) ABFS: Test code with Delegation SAS generation logic

2020-02-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040967#comment-17040967 ] Steve Loughran commented on HADOOP-16864: - Container SAS or DSAS or directory S

[jira] [Updated] (HADOOP-16864) ABFS: Test code with Delegation SAS generation logic

2020-02-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16864: Release Note: (was: Container SAS or DSAS or directory SAS will be handled alike in ABF

[jira] [Commented] (HADOOP-16647) Support OpenSSL 1.1.1 LTS

2020-02-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040966#comment-17040966 ] Steve Loughran commented on HADOOP-16647: - given its a breaker for 1.1.1, and c

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

2020-02-20 Thread GitBox
hadoop-yetus removed a comment on issue #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#issuecomment-588572835 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|--

[jira] [Commented] (HADOOP-16206) Migrate from Log4j1 to Log4j2

2020-02-20 Thread Sourabh Sarvotham Parkala (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040939#comment-17040939 ] Sourabh Sarvotham Parkala commented on HADOOP-16206: [~weichiu], th

[GitHub] [hadoop] hadoop-yetus commented on issue #1823: HADOOP-16794 S3 Encryption keys not propagating correctly during copy operation

2020-02-20 Thread GitBox
hadoop-yetus commented on issue #1823: HADOOP-16794 S3 Encryption keys not propagating correctly during copy operation URL: https://github.com/apache/hadoop/pull/1823#issuecomment-588996092 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Assigned] (HADOOP-15273) distcp can't handle remote stores with different checksum algorithms

2020-02-20 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell reassigned HADOOP-15273: -- Assignee: Stephen O'Donnell (was: Steve Loughran) > distcp can't handle rem

[GitHub] [hadoop] steveloughran commented on issue #1820: HADOOP-16830. Add public IOStatistics API + S3A implementation

2020-02-20 Thread GitBox
steveloughran commented on issue #1820: HADOOP-16830. Add public IOStatistics API + S3A implementation URL: https://github.com/apache/hadoop/pull/1820#issuecomment-588845853 ``` WARNING] Tests run: 14, Failures: 0, Errors: 0, Skipped: 14, Time elapsed: 17.413 s - in org.apache.hadoop.fs

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1820: HADOOP-16830. Add public IOStatistics API + S3A implementation

2020-02-20 Thread GitBox
hadoop-yetus removed a comment on issue #1820: HADOOP-16830. Add public IOStatistics API + S3A implementation URL: https://github.com/apache/hadoop/pull/1820#issuecomment-588473900 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|-