[jira] [Work logged] (HADOOP-17311) ABFS: Logs should redact SAS signature

2020-11-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17311?focusedWorklogId=507528&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-507528 ] ASF GitHub Bot logged work on HADOOP-17311: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #2432: HADOOP-17311. ABFS: Read small files completely

2020-11-03 Thread GitBox
hadoop-yetus commented on pull request #2432: URL: https://github.com/apache/hadoop/pull/2432#issuecomment-721568332 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[jira] [Updated] (HADOOP-17344) Harmonize guava version and shade guava in yarn-csi

2020-11-03 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17344: --- Target Version/s: 3.4.0 Status: Patch Available (was: Open) > Harmonize guav

[jira] [Updated] (HADOOP-17344) Harmonize guava version and shade guava in yarn-csi

2020-11-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17344: Labels: pull-request-available (was: ) > Harmonize guava version and shade guava in yarn

[jira] [Work logged] (HADOOP-17344) Harmonize guava version and shade guava in yarn-csi

2020-11-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17344?focusedWorklogId=507525&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-507525 ] ASF GitHub Bot logged work on HADOOP-17344: --- Author: ASF GitHub B

[GitHub] [hadoop] aajisaka opened a new pull request #2434: HADOOP-17344. Harmonize guava version and shade guava in yarn-csi.

2020-11-03 Thread GitBox
aajisaka opened a new pull request #2434: URL: https://github.com/apache/hadoop/pull/2434 JIRA: https://issues.apache.org/jira/browse/HADOOP-17344 - Use hadoop-shaded-guava - Remove skip replacer setting from yarn-csi pom.xml --

[GitHub] [hadoop] hadoop-yetus commented on pull request #2377: HDFS-15624. fix the function of setting quota by storage type

2020-11-03 Thread GitBox
hadoop-yetus commented on pull request #2377: URL: https://github.com/apache/hadoop/pull/2377#issuecomment-721554987 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[jira] [Assigned] (HADOOP-17344) Harmonize guava version and shade guava in yarn-csi

2020-11-03 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reassigned HADOOP-17344: -- Assignee: Akira Ajisaka > Harmonize guava version and shade guava in yarn-csi >

[jira] [Updated] (HADOOP-17352) Update PATCH_NAMING_RULE in the personality file

2020-11-03 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17352: --- Target Version/s: 3.1.0, 3.3.1, 3.4.0, 2.10.2, 3.2.3 > Update PATCH_NAMING_RULE in the pers

[jira] [Updated] (HADOOP-17352) Update PATCH_NAMING_RULE in the personality file

2020-11-03 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17352: --- Status: Patch Available (was: Open) > Update PATCH_NAMING_RULE in the personality file > -

[jira] [Updated] (HADOOP-17349) hadoop: mvn site tests should enable shelldocs and releasedocs

2020-11-03 Thread Allen Wittenauer (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HADOOP-17349: -- Reporter: Unassigned Developer (was: Allen Wittenauer) > hadoop: mvn site tests shou

[jira] [Commented] (HADOOP-17352) Update PATCH_NAMING_RULE in the personality file

2020-11-03 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225890#comment-17225890 ] Akira Ajisaka commented on HADOOP-17352: Thanks [~aw] for moving the jira. Yes,

[jira] [Work logged] (HADOOP-17352) Update PATCH_NAMING_RULE in the personality file

2020-11-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17352?focusedWorklogId=507513&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-507513 ] ASF GitHub Bot logged work on HADOOP-17352: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #2433: HADOOP-17352. Update PATCH_NAMING_RULE in the personality file.

2020-11-03 Thread GitBox
hadoop-yetus commented on pull request #2433: URL: https://github.com/apache/hadoop/pull/2433#issuecomment-721539606 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at https://ci-hadoop.apac

[jira] [Updated] (HADOOP-17352) Update PATCH_NAMING_RULE in the personality file

2020-11-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17352: Labels: newbie pull-request-available (was: newbie) > Update PATCH_NAMING_RULE in the pe

[jira] [Work logged] (HADOOP-17352) Update PATCH_NAMING_RULE in the personality file

2020-11-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17352?focusedWorklogId=507512&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-507512 ] ASF GitHub Bot logged work on HADOOP-17352: --- Author: ASF GitHub B

[GitHub] [hadoop] aajisaka opened a new pull request #2433: HADOOP-17352. Update PATCH_NAMING_RULE in the personality file.

2020-11-03 Thread GitBox
aajisaka opened a new pull request #2433: URL: https://github.com/apache/hadoop/pull/2433 JIRA: https://issues.apache.org/jira/browse/HADOOP-17352 This is an automated message from the Apache Git Service. To respond to the me

[jira] [Assigned] (HADOOP-17352) Update PATCH_NAMING_RULE in the personality file

2020-11-03 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reassigned HADOOP-17352: -- Assignee: Akira Ajisaka > Update PATCH_NAMING_RULE in the personality file > ---

[jira] [Moved] (HADOOP-17355) hadoop personality test of shaded artifacts should link to output in report table

2020-11-03 Thread Allen Wittenauer (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer moved YETUS-550 to HADOOP-17355: - Component/s: (was: Precommit) Key:

[jira] [Updated] (HADOOP-17352) Update PATCH_NAMING_RULE in the personality file

2020-11-03 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17352: --- Summary: Update PATCH_NAMING_RULE in the personality file (was: Update PATCH_NAMING_RULE i

[jira] [Updated] (HADOOP-17352) Update PATCH_NAMING_RULE in hadoop personality

2020-11-03 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17352: --- Component/s: (was: precommit) build Description: {noformat:title=.

[jira] [Updated] (HADOOP-17353) hadoop personality: yarn-ui should be conditional

2020-11-03 Thread Allen Wittenauer (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HADOOP-17353: -- Reporter: Unassigned Developer (was: Allen Wittenauer) > hadoop personality: yarn-ui

[jira] [Assigned] (HADOOP-17353) hadoop personality: yarn-ui should be conditional

2020-11-03 Thread Allen Wittenauer (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer reassigned HADOOP-17353: - Assignee: (was: Allen Wittenauer) > hadoop personality: yarn-ui should be

[jira] [Updated] (HADOOP-17351) hadoop: shaded client test is too aggressive

2020-11-03 Thread Allen Wittenauer (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HADOOP-17351: -- Reporter: Unassigned Developer (was: Allen Wittenauer) > hadoop: shaded client test

[jira] [Updated] (HADOOP-17348) hadoop: add a test for -Pdist

2020-11-03 Thread Allen Wittenauer (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HADOOP-17348: -- Reporter: Unassigned Developer (was: Allen Wittenauer) > hadoop: add a test for -Pdi

[jira] [Updated] (HADOOP-17350) hadoop: flag native changes w/no Dockerfile change

2020-11-03 Thread Allen Wittenauer (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HADOOP-17350: -- Reporter: Unassigned Developer (was: Allen Wittenauer) > hadoop: flag native changes

[jira] [Work logged] (HADOOP-17311) ABFS: Logs should redact SAS signature

2020-11-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17311?focusedWorklogId=507504&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-507504 ] ASF GitHub Bot logged work on HADOOP-17311: --- Author: ASF GitHub B

[jira] [Comment Edited] (HADOOP-17354) Move Jenkinsfile outside of the root directory

2020-11-03 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225877#comment-17225877 ] Akira Ajisaka edited comment on HADOOP-17354 at 11/4/20, 5:59 AM: ---

[jira] [Commented] (HADOOP-17354) Move Jenkinsfile outside of the root directory

2020-11-03 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225877#comment-17225877 ] Akira Ajisaka commented on HADOOP-17354: I think the Jenkins can be moved under

[jira] [Created] (HADOOP-17354) Move Jenkinsfile outside of the root directory

2020-11-03 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HADOOP-17354: -- Summary: Move Jenkinsfile outside of the root directory Key: HADOOP-17354 URL: https://issues.apache.org/jira/browse/HADOOP-17354 Project: Hadoop Common

[jira] [Updated] (HADOOP-17354) Move Jenkinsfile outside of the root directory

2020-11-03 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17354: --- Target Version/s: 3.3.1, 3.4.0, 3.1.5, 2.10.2, 3.2.3 > Move Jenkinsfile outside of the root

[jira] [Moved] (HADOOP-17352) Update PATCH_NAMING_RULE in hadoop personality

2020-11-03 Thread Allen Wittenauer (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer moved YETUS-694 to HADOOP-17352: - Component/s: (was: Precommit)

[jira] [Moved] (HADOOP-17350) hadoop: flag native changes w/no Dockerfile change

2020-11-03 Thread Allen Wittenauer (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer moved YETUS-519 to HADOOP-17350: - Component/s: (was: Precommit) precommit

[jira] [Moved] (HADOOP-17349) hadoop: mvn site tests should enable shelldocs and releasedocs

2020-11-03 Thread Allen Wittenauer (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer moved YETUS-453 to HADOOP-17349: - Component/s: (was: Precommit) precommit

[jira] [Assigned] (HADOOP-17347) ABFS: Read small files completely

2020-11-03 Thread Bilahari T H (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilahari T H reassigned HADOOP-17347: - Assignee: Bilahari T H > ABFS: Read small files completely > -

[jira] [Moved] (HADOOP-17351) hadoop: shaded client test is too aggressive

2020-11-03 Thread Allen Wittenauer (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer moved YETUS-689 to HADOOP-17351: - Component/s: (was: Precommit) precommit

[jira] [Moved] (HADOOP-17348) hadoop: add a test for -Pdist

2020-11-03 Thread Allen Wittenauer (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer moved YETUS-266 to HADOOP-17348: - Component/s: (was: Precommit) precommit

[jira] [Moved] (HADOOP-17353) hadoop personality: yarn-ui should be conditional

2020-11-03 Thread Allen Wittenauer (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer moved YETUS-548 to HADOOP-17353: - Component/s: (was: Precommit)

[jira] [Created] (HADOOP-17347) ABFS: Read small files completely

2020-11-03 Thread Bilahari T H (Jira)
Bilahari T H created HADOOP-17347: - Summary: ABFS: Read small files completely Key: HADOOP-17347 URL: https://issues.apache.org/jira/browse/HADOOP-17347 Project: Hadoop Common Issue Type: Sub

[GitHub] [hadoop] bilaharith opened a new pull request #2432: HADOOP-17311. ABFS: Read small files completely

2020-11-03 Thread GitBox
bilaharith opened a new pull request #2432: URL: https://github.com/apache/hadoop/pull/2432 Files that are of size smaller than the read buffer size can be considered as small files. In case of such files it would be better to read the full file into the AbfsInputStream buffer. **Dr

[jira] [Comment Edited] (HADOOP-16492) Support HuaweiCloud Object Storage as a Hadoop Backend File System

2020-11-03 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225844#comment-17225844 ] Brahma Reddy Battula edited comment on HADOOP-16492 at 11/4/20, 4:53 AM:

[jira] [Comment Edited] (HADOOP-16492) Support HuaweiCloud Object Storage as a Hadoop Backend File System

2020-11-03 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225844#comment-17225844 ] Brahma Reddy Battula edited comment on HADOOP-16492 at 11/4/20, 4:50 AM:

[jira] [Comment Edited] (HADOOP-16492) Support HuaweiCloud Object Storage as a Hadoop Backend File System

2020-11-03 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225844#comment-17225844 ] Brahma Reddy Battula edited comment on HADOOP-16492 at 11/4/20, 4:50 AM:

[GitHub] [hadoop] ayushtkn commented on pull request #2424: HDFS-15643. EC: Fix checksum computation in case of native encoders.

2020-11-03 Thread GitBox
ayushtkn commented on pull request #2424: URL: https://github.com/apache/hadoop/pull/2424#issuecomment-721510244 Thanx @aajisaka and @amahussein for the reviews!!! @amahussein it would be good to give a check to the tests that failed again, post getting fixed recently. I will try to

[jira] [Commented] (HADOOP-16492) Support HuaweiCloud Object Storage as a Hadoop Backend File System

2020-11-03 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225844#comment-17225844 ] Brahma Reddy Battula commented on HADOOP-16492: --- [~zhongjun] thanks for c

[GitHub] [hadoop] ayushtkn merged pull request #2424: HDFS-15643. EC: Fix checksum computation in case of native encoders.

2020-11-03 Thread GitBox
ayushtkn merged pull request #2424: URL: https://github.com/apache/hadoop/pull/2424 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hadoop] hadoop-yetus commented on pull request #2288: HDFS-15548. Allow configuring DISK/ARCHIVE storage types on same device mount

2020-11-03 Thread GitBox
hadoop-yetus commented on pull request #2288: URL: https://github.com/apache/hadoop/pull/2288#issuecomment-721490455 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[jira] [Updated] (HADOOP-17343) Upgrade aws-java-sdk to 1.11.892

2020-11-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17343: Labels: pull-request-available (was: ) > Upgrade aws-java-sdk to 1.11.892 >

[jira] [Work logged] (HADOOP-17343) Upgrade aws-java-sdk to 1.11.892

2020-11-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17343?focusedWorklogId=507469&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-507469 ] ASF GitHub Bot logged work on HADOOP-17343: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #2429: HADOOP-17343. Upgrade aws-java-sdk to 1.11.892

2020-11-03 Thread GitBox
hadoop-yetus commented on pull request #2429: URL: https://github.com/apache/hadoop/pull/2429#issuecomment-721487909 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[jira] [Work logged] (HADOOP-17346) Fair call queue is defeated by abusive service principals

2020-11-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17346?focusedWorklogId=507464&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-507464 ] ASF GitHub Bot logged work on HADOOP-17346: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #2431: HADOOP-17346. Fair call queue is defeated by abusive service principals

2020-11-03 Thread GitBox
hadoop-yetus commented on pull request #2431: URL: https://github.com/apache/hadoop/pull/2431#issuecomment-721484027 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] hadoop-yetus commented on pull request #2430: HDFS-15562: StandbyCheckpointer will do checkpoint repeatedly while connecting observer/active namenode failed

2020-11-03 Thread GitBox
hadoop-yetus commented on pull request #2430: URL: https://github.com/apache/hadoop/pull/2430#issuecomment-721477331 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[jira] [Updated] (HADOOP-17333) MetricsRecordFiltered error

2020-11-03 Thread minchengbo (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] minchengbo updated HADOOP-17333: Priority: Major (was: Minor) > MetricsRecordFiltered error > --- > >

[jira] [Updated] (HADOOP-17333) MetricsRecordFiltered error

2020-11-03 Thread minchengbo (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] minchengbo updated HADOOP-17333: Affects Version/s: 3.3.0 > MetricsRecordFiltered error > --- > >

[jira] [Work logged] (HADOOP-17346) Fair call queue is defeated by abusive service principals

2020-11-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17346?focusedWorklogId=507383&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-507383 ] ASF GitHub Bot logged work on HADOOP-17346: --- Author: ASF GitHub B

[jira] [Updated] (HADOOP-17346) Fair call queue is defeated by abusive service principals

2020-11-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17346: Labels: pull-request-available (was: ) > Fair call queue is defeated by abusive service

[GitHub] [hadoop] amahussein opened a new pull request #2431: HADOOP-17346. Fair call queue is defeated by abusive service principals

2020-11-03 Thread GitBox
amahussein opened a new pull request #2431: URL: https://github.com/apache/hadoop/pull/2431 ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need to set the title of the pull request which starts with the corresponding JIRA issue number. (e.g.

[jira] [Created] (HADOOP-17346) Fair call queue is defeated by abusive service principals

2020-11-03 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HADOOP-17346: -- Summary: Fair call queue is defeated by abusive service principals Key: HADOOP-17346 URL: https://issues.apache.org/jira/browse/HADOOP-17346 Project: Hadoop Common

[jira] [Work started] (HADOOP-17346) Fair call queue is defeated by abusive service principals

2020-11-03 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-17346 started by Ahmed Hussein. -- > Fair call queue is defeated by abusive service principals >

[GitHub] [hadoop] aihuaxu opened a new pull request #2430: HDFS-15562: StandbyCheckpointer will do checkpoint repeatedly while connecting observer/active namenode failed

2020-11-03 Thread GitBox
aihuaxu opened a new pull request #2430: URL: https://github.com/apache/hadoop/pull/2430 Standby namenode does the checkpoint and uploads the image to the other active/observer namenodes. If other namenodes, e.g., observers are down for maintenance, currently uploading will fail and retrig

[GitHub] [hadoop] LeonGao91 commented on a change in pull request #2288: HDFS-15548. Allow configuring DISK/ARCHIVE storage types on same device mount

2020-11-03 Thread GitBox
LeonGao91 commented on a change in pull request #2288: URL: https://github.com/apache/hadoop/pull/2288#discussion_r516979069 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/MountVolumeInfo.java ## @@ -0,0 +1,101

[jira] [Commented] (HADOOP-17342) Creating a token identifier should not do kerberos name resolution

2020-11-03 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225686#comment-17225686 ] Jim Brennan commented on HADOOP-17342: -- I believe the failure in TestLdapGroupsMap

[GitHub] [hadoop] Jing9 commented on a change in pull request #2288: HDFS-15548. Allow configuring DISK/ARCHIVE storage types on same device mount

2020-11-03 Thread GitBox
Jing9 commented on a change in pull request #2288: URL: https://github.com/apache/hadoop/pull/2288#discussion_r516949905 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/MountVolumeInfo.java ## @@ -0,0 +1,101 @@

[jira] [Resolved] (HADOOP-17255) JavaKeyStoreProvider fails to create a new key if the keystore is HDFS

2020-11-03 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-17255. -- Fix Version/s: 3.2.3 2.10.2 3.1.5

[jira] [Commented] (HADOOP-17336) Backport HADOOP-16005-"NativeAzureFileSystem does not support setXAttr" and HADOOP-16785. "Improve wasb and abfs resilience on double close() calls. followup to abfs

2020-11-03 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225644#comment-17225644 ] Chen Liang commented on HADOOP-17336: - I have committed v002 patch to branch-2.10.

[jira] [Updated] (HADOOP-17336) Backport HADOOP-16005-"NativeAzureFileSystem does not support setXAttr" and HADOOP-16785. "Improve wasb and abfs resilience on double close() calls. followup to abfs cl

2020-11-03 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HADOOP-17336: Fix Version/s: 2.10.2 Resolution: Fixed Status: Resolved (was: Patch Available)

[jira] [Commented] (HADOOP-17342) Creating a token identifier should not do kerberos name resolution

2020-11-03 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225628#comment-17225628 ] Hadoop QA commented on HADOOP-17342: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[GitHub] [hadoop] jojochuang merged pull request #2291: HADOOP-17255. JavaKeyStoreProvider fails to create a new key if the keystore is HDFS

2020-11-03 Thread GitBox
jojochuang merged pull request #2291: URL: https://github.com/apache/hadoop/pull/2291 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[jira] [Work logged] (HADOOP-17255) JavaKeyStoreProvider fails to create a new key if the keystore is HDFS

2020-11-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17255?focusedWorklogId=507289&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-507289 ] ASF GitHub Bot logged work on HADOOP-17255: --- Author: ASF GitHub B

[jira] [Commented] (HADOOP-17255) JavaKeyStoreProvider fails to create a new key if the keystore is HDFS

2020-11-03 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225623#comment-17225623 ] Wei-Chiu Chuang commented on HADOOP-17255: -- {quote} * Probably there are many

[jira] [Commented] (HADOOP-17336) Backport HADOOP-16005-"NativeAzureFileSystem does not support setXAttr" and HADOOP-16785. "Improve wasb and abfs resilience on double close() calls. followup to abfs

2020-11-03 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225612#comment-17225612 ] Konstantin Shvachko commented on HADOOP-17336: -- +1 the backport looks good

[jira] [Created] (HADOOP-17345) Work with externally managed user credentials

2020-11-03 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HADOOP-17345: Summary: Work with externally managed user credentials Key: HADOOP-17345 URL: https://issues.apache.org/jira/browse/HADOOP-17345 Project: Hadoop Common

[jira] [Updated] (HADOOP-17343) Upgrade aws-java-sdk to 1.11.892

2020-11-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated HADOOP-17343: --- Affects Version/s: 3.4.0 > Upgrade aws-java-sdk to 1.11.892 > -

[jira] [Updated] (HADOOP-17344) Harmonize guava version and shade guava in yarn-csi

2020-11-03 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-17344: - Summary: Harmonize guava version and shade guava in yarn-csi (was: Harmonize guava ver

[jira] [Created] (HADOOP-17344) Harmonize guava version in yarn-csi

2020-11-03 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HADOOP-17344: Summary: Harmonize guava version in yarn-csi Key: HADOOP-17344 URL: https://issues.apache.org/jira/browse/HADOOP-17344 Project: Hadoop Common Issue T

[jira] [Assigned] (HADOOP-17343) Upgrade aws-java-sdk to 1.11.892

2020-11-03 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned HADOOP-17343: - Assignee: Dongjoon Hyun > Upgrade aws-java-sdk to 1.11.892 >

[jira] [Created] (HADOOP-17343) Upgrade aws-java-sdk to 1.11.892

2020-11-03 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created HADOOP-17343: -- Summary: Upgrade aws-java-sdk to 1.11.892 Key: HADOOP-17343 URL: https://issues.apache.org/jira/browse/HADOOP-17343 Project: Hadoop Common Issue Type: Bu

[GitHub] [hadoop] dongjoon-hyun opened a new pull request #2429: Upgrade aws-java-sdk to 1.11.892

2020-11-03 Thread GitBox
dongjoon-hyun opened a new pull request #2429: URL: https://github.com/apache/hadoop/pull/2429 This PR aims to upgrade `aws-java-sdk` from 1.1.563 (May 30, 2019) to 1.11.892 (Nov 01, 2020). This is an automated message from

[jira] [Updated] (HADOOP-17342) Creating a token identifier should not do kerberos name resolution

2020-11-03 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HADOOP-17342: - Status: Patch Available (was: Open) > Creating a token identifier should not do kerberos name

[jira] [Updated] (HADOOP-17342) Creating a token identifier should not do kerberos name resolution

2020-11-03 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HADOOP-17342: - Attachment: HADOOP-17342.001.patch > Creating a token identifier should not do kerberos name re

[jira] [Assigned] (HADOOP-17342) Creating a token identifier should not do kerberos name resolution

2020-11-03 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan reassigned HADOOP-17342: Assignee: Jim Brennan > Creating a token identifier should not do kerberos name resoluti

[jira] [Created] (HADOOP-17342) Creating a token identifier should not do kerberos name resolution

2020-11-03 Thread Jim Brennan (Jira)
Jim Brennan created HADOOP-17342: Summary: Creating a token identifier should not do kerberos name resolution Key: HADOOP-17342 URL: https://issues.apache.org/jira/browse/HADOOP-17342 Project: Hadoop

[GitHub] [hadoop] steveloughran commented on pull request #2422: HADOOP-17311. ABFS: Masking SAS signatures from logs

2020-11-03 Thread GitBox
steveloughran commented on pull request #2422: URL: https://github.com/apache/hadoop/pull/2422#issuecomment-721124815 where did the findbugs error come from? do we need to fix/roll back that change? This is an automated mess

[jira] [Work logged] (HADOOP-17311) ABFS: Logs should redact SAS signature

2020-11-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17311?focusedWorklogId=507108&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-507108 ] ASF GitHub Bot logged work on HADOOP-17311: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-17311) ABFS: Logs should redact SAS signature

2020-11-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17311?focusedWorklogId=507075&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-507075 ] ASF GitHub Bot logged work on HADOOP-17311: --- Author: ASF GitHub B

[GitHub] [hadoop] snvijaya commented on a change in pull request #2422: HADOOP-17311. ABFS: Masking SAS signatures from logs

2020-11-03 Thread GitBox
snvijaya commented on a change in pull request #2422: URL: https://github.com/apache/hadoop/pull/2422#discussion_r515748434 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsHttpOperation.java ## @@ -513,4 +509,45 @@ private void

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2399: HADOOP-17318. Support concurrent S3A commit jobs with same app attempt ID.

2020-11-03 Thread GitBox
hadoop-yetus removed a comment on pull request #2399: URL: https://github.com/apache/hadoop/pull/2399#issuecomment-719856113 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Work logged] (HADOOP-17318) S3A committer to support concurrent jobs with same app attempt ID & dest dir

2020-11-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17318?focusedWorklogId=507048&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-507048 ] ASF GitHub Bot logged work on HADOOP-17318: --- Author: ASF GitHub B

[GitHub] [hadoop] tangzhankun edited a comment on pull request #2401: YARN-10469. YARN-UI2 The accuracy of the percentage values in the same chart on the YARN 'Cluster OverView' page are inconsistent

2020-11-03 Thread GitBox
tangzhankun edited a comment on pull request #2401: URL: https://github.com/apache/hadoop/pull/2401#issuecomment-720364635 Merged it just now. @jiwq Thanks for the review. @akiyamaneko Thanks for the contribution! This

[jira] [Work logged] (HADOOP-17191) ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

2020-11-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17191?focusedWorklogId=506990&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-506990 ] ASF GitHub Bot logged work on HADOOP-17191: --- Author: ASF GitHub B

[GitHub] [hadoop] snvijaya commented on a change in pull request #2417: HADOOP-17191. ABFS: Run the tests with various combinations of configurations and publish a consolidated results

2020-11-03 Thread GitBox
snvijaya commented on a change in pull request #2417: URL: https://github.com/apache/hadoop/pull/2417#discussion_r515741344 ## File path: hadoop-tools/hadoop-azure/src/site/markdown/testing_azure.md ## @@ -357,6 +357,34 @@ The Huge File tests validate Azure storages's ability t

[GitHub] [hadoop] hadoop-yetus commented on pull request #2417: HADOOP-17191. ABFS: Run the tests with various combinations of configurations and publish a consolidated results

2020-11-03 Thread GitBox
hadoop-yetus commented on pull request #2417: URL: https://github.com/apache/hadoop/pull/2417#issuecomment-721103960 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Work logged] (HADOOP-17191) ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

2020-11-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17191?focusedWorklogId=506971&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-506971 ] ASF GitHub Bot logged work on HADOOP-17191: --- Author: ASF GitHub B

[GitHub] [hadoop] Jing9 commented on a change in pull request #2288: HDFS-15548. Allow configuring DISK/ARCHIVE storage types on same device mount

2020-11-03 Thread GitBox
Jing9 commented on a change in pull request #2288: URL: https://github.com/apache/hadoop/pull/2288#discussion_r516356685 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/MountVolumeInfo.java ## @@ -0,0 +1,101 @@

[GitHub] [hadoop] hadoop-yetus commented on pull request #2288: HDFS-15548. Allow configuring DISK/ARCHIVE storage types on same device mount

2020-11-03 Thread GitBox
hadoop-yetus commented on pull request #2288: URL: https://github.com/apache/hadoop/pull/2288#issuecomment-720987925 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] zehaoc2 commented on pull request #2328: HDFS-13009. Allow creation of encryption zone if directory is not empty. Contributed by Rushabh Shah.

2020-11-03 Thread GitBox
zehaoc2 commented on pull request #2328: URL: https://github.com/apache/hadoop/pull/2328#issuecomment-720746804 @jojochuang Thanks for commenting. We're working on providing a solution for those concerns, and will follow up in the jira once we figure that out. ---

[GitHub] [hadoop] hadoop-yetus commented on pull request #2399: HADOOP-17318. Support concurrent S3A commit jobs with same app attempt ID.

2020-11-03 Thread GitBox
hadoop-yetus commented on pull request #2399: URL: https://github.com/apache/hadoop/pull/2399#issuecomment-720614677 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[jira] [Work logged] (HADOOP-17318) S3A committer to support concurrent jobs with same app attempt ID & dest dir

2020-11-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17318?focusedWorklogId=506927&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-506927 ] ASF GitHub Bot logged work on HADOOP-17318: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #2225: HDFS-15329. Provide FileContext based ViewFSOverloadScheme implementation

2020-11-03 Thread GitBox
hadoop-yetus commented on pull request #2225: URL: https://github.com/apache/hadoop/pull/2225#issuecomment-720786035 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

  1   2   >