[jira] [Work logged] (HADOOP-17723) [build] fix the Dockerfile for ARM

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17723?focusedWorklogId=600744=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600744 ] ASF GitHub Bot logged work on HADOOP-17723: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3037: HADOOP-17723. [build] fix the Dockerfile for ARM

2021-05-21 Thread GitBox
hadoop-yetus commented on pull request #3037: URL: https://github.com/apache/hadoop/pull/3037#issuecomment-846343152 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17723) [build] fix the Dockerfile for ARM

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17723?focusedWorklogId=600742=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600742 ] ASF GitHub Bot logged work on HADOOP-17723: --- Author: ASF GitHub Bot

[GitHub] [hadoop] jojochuang commented on a change in pull request #3037: HADOOP-17723. [build] python3 migration broke Docker container image for ARM.

2021-05-21 Thread GitBox
jojochuang commented on a change in pull request #3037: URL: https://github.com/apache/hadoop/pull/3037#discussion_r63730 ## File path: dev-support/docker/Dockerfile_aarch64 ## @@ -169,6 +160,9 @@ ENV MAVEN_OPTS -Xms256m -Xmx1536m # Skip gpg verification when downloading

[jira] [Work logged] (HADOOP-17723) [build] fix the Dockerfile for ARM

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17723?focusedWorklogId=600741=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600741 ] ASF GitHub Bot logged work on HADOOP-17723: --- Author: ASF GitHub Bot

[GitHub] [hadoop] jojochuang commented on pull request #3037: HADOOP-17723. [build] python3 migration broke Docker container image for ARM.

2021-05-21 Thread GitBox
jojochuang commented on pull request #3037: URL: https://github.com/apache/hadoop/pull/3037#issuecomment-846339358 Installs python2.7, and replaced the custom PhantomJS binary (which was built for Xenial and does not run on Bionic) with the official phantomjs package for Bionic.

[jira] [Work logged] (HADOOP-17723) [build] fix the Dockerfile for ARM

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17723?focusedWorklogId=600740=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600740 ] ASF GitHub Bot logged work on HADOOP-17723: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3037: HADOOP-17723. [build] python3 migration broke Docker container image for ARM.

2021-05-21 Thread GitBox
hadoop-yetus commented on pull request #3037: URL: https://github.com/apache/hadoop/pull/3037#issuecomment-846338046 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

[jira] [Commented] (HADOOP-16377) Moving logging APIs over to slf4j

2021-05-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17349582#comment-17349582 ] Hadoop QA commented on HADOOP-16377: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-16377) Moving logging APIs over to slf4j

2021-05-21 Thread Duo Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17349581#comment-17349581 ] Duo Zhang commented on HADOOP-16377: I think this issue should be done prior to HADOOP-16206. It

[jira] [Work started] (HADOOP-17705) S3A to add Config to set AWS region

2021-05-21 Thread Mehakmeet Singh (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-17705 started by Mehakmeet Singh. > S3A to add Config to set AWS region >

[jira] [Commented] (HADOOP-16206) Migrate from Log4j1 to Log4j2

2021-05-21 Thread Duo Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17349575#comment-17349575 ] Duo Zhang commented on HADOOP-16206: So any suggestions here? Should we do the same trick in HBase,

[GitHub] [hadoop] jojochuang merged pull request #3011: HADOOP-17666. Update LICENSE for 3.3.1

2021-05-21 Thread GitBox
jojochuang merged pull request #3011: URL: https://github.com/apache/hadoop/pull/3011 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[jira] [Work logged] (HADOOP-17666) Update LICENSE for 3.3.1

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17666?focusedWorklogId=600736=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600736 ] ASF GitHub Bot logged work on HADOOP-17666: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2021-05-21 Thread GitBox
hadoop-yetus commented on pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#issuecomment-846286608 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17721) Replace Guava Sets usage by Hadoop's own Sets in hadoop-yarn-project

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17721?focusedWorklogId=600631=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600631 ] ASF GitHub Bot logged work on HADOOP-17721: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3033: HADOOP-17721. Replace Guava Sets usage by Hadoop's own Sets in hadoop-yarn-project

2021-05-21 Thread GitBox
hadoop-yetus commented on pull request #3033: URL: https://github.com/apache/hadoop/pull/3033#issuecomment-846240575 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3005: HDFS-13522. RBF: Support observer node from Router-Based Federation

2021-05-21 Thread GitBox
hadoop-yetus commented on pull request #3005: URL: https://github.com/apache/hadoop/pull/3005#issuecomment-846233389 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3039: HDFS-16032. DFSClient#delete supports Trash

2021-05-21 Thread GitBox
hadoop-yetus commented on pull request #3039: URL: https://github.com/apache/hadoop/pull/3039#issuecomment-846230648 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17723) [build] fix the Dockerfile for ARM

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17723?focusedWorklogId=600626=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600626 ] ASF GitHub Bot logged work on HADOOP-17723: --- Author: ASF GitHub Bot

[GitHub] [hadoop] busbey commented on pull request #3037: HADOOP-17723. [build] python3 migration broke Docker container image for ARM.

2021-05-21 Thread GitBox
busbey commented on pull request #3037: URL: https://github.com/apache/hadoop/pull/3037#issuecomment-846229893 Ah. Yeah looks like despite being named with the pattern we use for Yetus driven CI, the arm job is just a bash script wrapping a maven call. -- This is an automated message

[GitHub] [hadoop] hadoop-yetus commented on pull request #3005: HDFS-13522. RBF: Support observer node from Router-Based Federation

2021-05-21 Thread GitBox
hadoop-yetus commented on pull request #3005: URL: https://github.com/apache/hadoop/pull/3005#issuecomment-846208581 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17666) Update LICENSE for 3.3.1

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17666?focusedWorklogId=600603=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600603 ] ASF GitHub Bot logged work on HADOOP-17666: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3011: HADOOP-17666. Update LICENSE for 3.3.1

2021-05-21 Thread GitBox
hadoop-yetus commented on pull request #3011: URL: https://github.com/apache/hadoop/pull/3011#issuecomment-846191772 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17725) Improve error message for token providers in ABFS

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17725?focusedWorklogId=600602=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600602 ] ASF GitHub Bot logged work on HADOOP-17725: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3041: HADOOP-17725. Improve error message for token providers in ABFS

2021-05-21 Thread GitBox
hadoop-yetus commented on pull request #3041: URL: https://github.com/apache/hadoop/pull/3041#issuecomment-846190598 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3042: HDFS-16033 Fix issue of the StatisticsDataReferenceCleaner cleanUp

2021-05-21 Thread GitBox
hadoop-yetus commented on pull request #3042: URL: https://github.com/apache/hadoop/pull/3042#issuecomment-846144487 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Updated] (HADOOP-17509) Parallelize building of dependencies

2021-05-21 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-17509: - Fix Version/s: 3.3.1 > Parallelize building of dependencies >

[jira] [Work logged] (HADOOP-17725) Improve error message for token providers in ABFS

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17725?focusedWorklogId=600519=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600519 ] ASF GitHub Bot logged work on HADOOP-17725: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3041: HADOOP-17725. Improve error message for token providers in ABFS

2021-05-21 Thread GitBox
hadoop-yetus commented on pull request #3041: URL: https://github.com/apache/hadoop/pull/3041#issuecomment-846118546 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Commented] (HADOOP-17415) Use S3 content-range header to update length of an object during reads

2021-05-21 Thread Bogdan Stolojan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17349373#comment-17349373 ] Bogdan Stolojan commented on HADOOP-17415: -- Hey [~ste...@apache.org] , would like to work on

[jira] [Updated] (HADOOP-17723) [build] fix the Dockerfile for ARM

2021-05-21 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-17723: - Description: Running the create-release script for Hadoop 3.3.1 on an ARM machine,

[jira] [Updated] (HADOOP-17723) [build] fix the Dockerfile for ARM

2021-05-21 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-17723: - Summary: [build] fix the Dockerfile for ARM (was: [build] python3 migration broke

[jira] [Resolved] (HADOOP-17718) Explicitly set locale in the Dockerfile

2021-05-21 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-17718. -- Fix Version/s: 3.4.0 3.3.1 Resolution: Fixed > Explicitly

[jira] [Work logged] (HADOOP-17718) Explicitly set locale in the Dockerfile

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17718?focusedWorklogId=600487=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600487 ] ASF GitHub Bot logged work on HADOOP-17718: --- Author: ASF GitHub Bot

[GitHub] [hadoop] jojochuang commented on pull request #3034: HADOOP-17718. Explicitly set locale in the Dockerfile.

2021-05-21 Thread GitBox
jojochuang commented on pull request #3034: URL: https://github.com/apache/hadoop/pull/3034#issuecomment-846089378 Cherrypicked the commit to branch-3.3 and 3.3.1 (removed the two Docker files not available in 3.3.x) -- This is an automated message from the Apache Git Service. To

[jira] [Work logged] (HADOOP-17725) Improve error message for token providers in ABFS

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17725?focusedWorklogId=600485=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600485 ] ASF GitHub Bot logged work on HADOOP-17725: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3041: HADOOP-17725. Improve error message for token providers in ABFS

2021-05-21 Thread GitBox
hadoop-yetus commented on pull request #3041: URL: https://github.com/apache/hadoop/pull/3041#issuecomment-846087977 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Commented] (HADOOP-17547) Magic committer to downgrade abort in cleanup if list uploads fails with access denied

2021-05-21 Thread Bogdan Stolojan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17349364#comment-17349364 ] Bogdan Stolojan commented on HADOOP-17547: -- This is related to S3Guard, guessing it's not that

[jira] [Work logged] (HADOOP-17718) Explicitly set locale in the Dockerfile

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17718?focusedWorklogId=600484=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600484 ] ASF GitHub Bot logged work on HADOOP-17718: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17718) Explicitly set locale in the Dockerfile

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17718?focusedWorklogId=600483=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600483 ] ASF GitHub Bot logged work on HADOOP-17718: --- Author: ASF GitHub Bot

[GitHub] [hadoop] jojochuang commented on pull request #3034: HADOOP-17718. Explicitly set locale in the Dockerfile.

2021-05-21 Thread GitBox
jojochuang commented on pull request #3034: URL: https://github.com/apache/hadoop/pull/3034#issuecomment-846083278 Thx! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hadoop] jojochuang merged pull request #3034: HADOOP-17718. Explicitly set locale in the Dockerfile.

2021-05-21 Thread GitBox
jojochuang merged pull request #3034: URL: https://github.com/apache/hadoop/pull/3034 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [hadoop] hadoop-yetus commented on pull request #3039: HDFS-16032. DFSClient#delete supports Trash

2021-05-21 Thread GitBox
hadoop-yetus commented on pull request #3039: URL: https://github.com/apache/hadoop/pull/3039#issuecomment-846082229 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17724) Add Dockerfile for Debian 10

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17724?focusedWorklogId=600460=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600460 ] ASF GitHub Bot logged work on HADOOP-17724: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3038: HADOOP-17724. Add Dockerfile for Debian 10

2021-05-21 Thread GitBox
hadoop-yetus commented on pull request #3038: URL: https://github.com/apache/hadoop/pull/3038#issuecomment-846059797 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17723) [build] python3 migration broke Docker container image for ARM

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17723?focusedWorklogId=600447=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600447 ] ASF GitHub Bot logged work on HADOOP-17723: --- Author: ASF GitHub Bot

[GitHub] [hadoop] jojochuang commented on pull request #3037: HADOOP-17723. [build] python3 migration broke Docker container image for ARM.

2021-05-21 Thread GitBox
jojochuang commented on pull request #3037: URL: https://github.com/apache/hadoop/pull/3037#issuecomment-846040629 > > This is broken by #1738 > > That was awhile ago. Gap in our CI coverage for ARM? I guess the ARM nightly build doesn't use the docker image? Or it has been

[jira] [Work logged] (HADOOP-17725) Improve error message for token providers in ABFS

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17725?focusedWorklogId=600443=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600443 ] ASF GitHub Bot logged work on HADOOP-17725: --- Author: ASF GitHub Bot

[GitHub] [hadoop] aajisaka commented on pull request #3037: HADOOP-17723. [build] python3 migration broke Docker container image for ARM.

2021-05-21 Thread GitBox
aajisaka commented on pull request #3037: URL: https://github.com/apache/hadoop/pull/3037#issuecomment-846038595 There exists a daily ARM qbt job, but it does not use the docker image: https://ci-hadoop.apache.org/job/hadoop-qbt-linux-ARM-trunk/ -- This is an automated message from the

[jira] [Work logged] (HADOOP-17723) [build] python3 migration broke Docker container image for ARM

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17723?focusedWorklogId=600444=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600444 ] ASF GitHub Bot logged work on HADOOP-17723: --- Author: ASF GitHub Bot

[GitHub] [hadoop] vinaysbadami commented on a change in pull request #3041: HADOOP-17725. Improve error message for token providers in ABFS

2021-05-21 Thread GitBox
vinaysbadami commented on a change in pull request #3041: URL: https://github.com/apache/hadoop/pull/3041#discussion_r637013026 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/oauth2/ClientCredsTokenProvider.java ## @@ -38,19 +42,27 @@

[jira] [Work logged] (HADOOP-17725) Improve error message for token providers in ABFS

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17725?focusedWorklogId=600440=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600440 ] ASF GitHub Bot logged work on HADOOP-17725: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sadikovi commented on pull request #3041: HADOOP-17725. Improve error message for token providers in ABFS

2021-05-21 Thread GitBox
sadikovi commented on pull request #3041: URL: https://github.com/apache/hadoop/pull/3041#issuecomment-846035235 I would appreciate it if you could address the comments, thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Work logged] (HADOOP-17725) Improve error message for token providers in ABFS

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17725?focusedWorklogId=600434=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600434 ] ASF GitHub Bot logged work on HADOOP-17725: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sadikovi commented on a change in pull request #3041: HADOOP-17725. Improve error message for token providers in ABFS

2021-05-21 Thread GitBox
sadikovi commented on a change in pull request #3041: URL: https://github.com/apache/hadoop/pull/3041#discussion_r637006602 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/TestAccountConfiguration.java ## @@ -361,6 +366,56 @@ public void

[GitHub] [hadoop] yikf commented on a change in pull request #3042: HDFS-16033 Fix issue of the StatisticsDataReferenceCleaner cleanUp

2021-05-21 Thread GitBox
yikf commented on a change in pull request #3042: URL: https://github.com/apache/hadoop/pull/3042#discussion_r637005610 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java ## @@ -4004,12 +4004,13 @@ public void cleanUp() {

[GitHub] [hadoop] yikf removed a comment on pull request #3042: HDFS-16033 Fix issue of the StatisticsDataReferenceCleaner cleanUp

2021-05-21 Thread GitBox
yikf removed a comment on pull request #3042: URL: https://github.com/apache/hadoop/pull/3042#issuecomment-846029637 For reviewer, quote JDK ReferenceQueue#: ``` public Reference remove(long timeout) throws IllegalArgumentException, InterruptedException {

[GitHub] [hadoop] yikf edited a comment on pull request #3042: HDFS-16033 Fix issue of the StatisticsDataReferenceCleaner cleanUp

2021-05-21 Thread GitBox
yikf edited a comment on pull request #3042: URL: https://github.com/apache/hadoop/pull/3042#issuecomment-846029637 For reviewer, quote JDK ReferenceQueue#: ``` public Reference remove(long timeout) throws IllegalArgumentException, InterruptedException {

[GitHub] [hadoop] yikf commented on pull request #3042: HDFS-16033 Fix issue of the StatisticsDataReferenceCleaner cleanUp

2021-05-21 Thread GitBox
yikf commented on pull request #3042: URL: https://github.com/apache/hadoop/pull/3042#issuecomment-846029637 For reviewer: ``` public Reference remove(long timeout) throws IllegalArgumentException, InterruptedException { if (timeout < 0) {

[GitHub] [hadoop] yikf commented on pull request #3042: HDFS-16033 Fix issue of the StatisticsDataReferenceCleaner cleanUp

2021-05-21 Thread GitBox
yikf commented on pull request #3042: URL: https://github.com/apache/hadoop/pull/3042#issuecomment-846025374 gentle cc @steveloughran Could you help take a look when you have a time, please. -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hadoop] hadoop-yetus commented on pull request #3038: HADOOP-17724. Add Dockerfile for Debian 10

2021-05-21 Thread GitBox
hadoop-yetus commented on pull request #3038: URL: https://github.com/apache/hadoop/pull/3038#issuecomment-846021654 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

[GitHub] [hadoop] yikf opened a new pull request #3042: HDFS-16033 Fix issue of the StatisticsDataReferenceCleaner cleanUp

2021-05-21 Thread GitBox
yikf opened a new pull request #3042: URL: https://github.com/apache/hadoop/pull/3042 ### What changes were proposed in this pull request? In `StatisticsDataReferenceCleaner`, Cleaner thread will be blocked if we remove reference from ReferenceQueue unless the queue.enqueue` called but

[jira] [Work logged] (HADOOP-17724) Add Dockerfile for Debian 10

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17724?focusedWorklogId=600418=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600418 ] ASF GitHub Bot logged work on HADOOP-17724: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3005: HDFS-13522. RBF: Support observer node from Router-Based Federation

2021-05-21 Thread GitBox
hadoop-yetus commented on pull request #3005: URL: https://github.com/apache/hadoop/pull/3005#issuecomment-846020614 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17725) Improve error message for token providers in ABFS

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17725?focusedWorklogId=600409=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600409 ] ASF GitHub Bot logged work on HADOOP-17725: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-17725) Improve error message for token providers in ABFS

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17725: Labels: pull-request-available (was: ) > Improve error message for token providers in

[GitHub] [hadoop] virajjasani opened a new pull request #3041: HADOOP-17725. Improve error message for token providers in ABFS

2021-05-21 Thread GitBox
virajjasani opened a new pull request #3041: URL: https://github.com/apache/hadoop/pull/3041 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this

[GitHub] [hadoop] hadoop-yetus commented on pull request #3005: HDFS-13522. RBF: Support observer node from Router-Based Federation

2021-05-21 Thread GitBox
hadoop-yetus commented on pull request #3005: URL: https://github.com/apache/hadoop/pull/3005#issuecomment-846018323 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] mehakmeet commented on a change in pull request #2807: HADOOP-17511. Add audit/telemetry logging to S3A connector

2021-05-21 Thread GitBox
mehakmeet commented on a change in pull request #2807: URL: https://github.com/apache/hadoop/pull/2807#discussion_r636762939 ## File path: hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/audit/TestAuditSpanLifecycle.java ## @@ -0,0 +1,131 @@ +/* + * Licensed to

[jira] [Work logged] (HADOOP-17511) Add an Audit plugin point for S3A auditing/context

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17511?focusedWorklogId=600400=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600400 ] ASF GitHub Bot logged work on HADOOP-17511: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3036: HDFS-15998. Fix NullPointException In listOpenFiles

2021-05-21 Thread GitBox
hadoop-yetus commented on pull request #3036: URL: https://github.com/apache/hadoop/pull/3036#issuecomment-845992995 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Assigned] (HADOOP-17725) Improve error message for token providers in ABFS

2021-05-21 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani reassigned HADOOP-17725: - Assignee: Viraj Jasani > Improve error message for token providers in ABFS >

[jira] [Work logged] (HADOOP-17511) Add an Audit plugin point for S3A auditing/context

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17511?focusedWorklogId=600363=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600363 ] ASF GitHub Bot logged work on HADOOP-17511: --- Author: ASF GitHub Bot

[GitHub] [hadoop] bogthe commented on pull request #2807: HADOOP-17511. Add audit/telemetry logging to S3A connector

2021-05-21 Thread GitBox
bogthe commented on pull request #2807: URL: https://github.com/apache/hadoop/pull/2807#issuecomment-845947817 @steveloughran are any more changes coming in? I'm happy with the state of this CR,  to get it merged -- This is an automated message from the Apache Git Service. To respond

[jira] [Created] (HADOOP-17726) Replace Sets#newHashSet() and newTreeSet() with constructors directly

2021-05-21 Thread Viraj Jasani (Jira)
Viraj Jasani created HADOOP-17726: - Summary: Replace Sets#newHashSet() and newTreeSet() with constructors directly Key: HADOOP-17726 URL: https://issues.apache.org/jira/browse/HADOOP-17726 Project:

[jira] [Work logged] (HADOOP-17722) Replace Guava Sets usage by Hadoop's own Sets in hadoop-mapreduce-project

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17722?focusedWorklogId=600345=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600345 ] ASF GitHub Bot logged work on HADOOP-17722: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3032: HADOOP-17722. Replace Guava Sets usage by Hadoop's own Sets in hadoop-mapreduce-project

2021-05-21 Thread GitBox
hadoop-yetus commented on pull request #3032: URL: https://github.com/apache/hadoop/pull/3032#issuecomment-845929633 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17458) S3A to treat "SdkClientException: Data read has a different length than the expected" as EOFException

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17458?focusedWorklogId=600343=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600343 ] ASF GitHub Bot logged work on HADOOP-17458: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3040: HADOOP-17458 S3A to treat "SdkClientException: Data read has a different length than the expected" as EOFException

2021-05-21 Thread GitBox
hadoop-yetus commented on pull request #3040: URL: https://github.com/apache/hadoop/pull/3040#issuecomment-845928952 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17715) ABFS: Append blob tests with non HNS accounts fail

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17715?focusedWorklogId=600341=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600341 ] ASF GitHub Bot logged work on HADOOP-17715: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3028: HADOOP-17715 ABFS: Append blob tests with non HNS accounts fail

2021-05-21 Thread GitBox
hadoop-yetus commented on pull request #3028: URL: https://github.com/apache/hadoop/pull/3028#issuecomment-845924492 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17715) ABFS: Append blob tests with non HNS accounts fail

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17715?focusedWorklogId=600303=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600303 ] ASF GitHub Bot logged work on HADOOP-17715: --- Author: ASF GitHub Bot

[GitHub] [hadoop] snehavarma commented on pull request #3028: HADOOP-17715 ABFS: Append blob tests with non HNS accounts fail

2021-05-21 Thread GitBox
snehavarma commented on pull request #3028: URL: https://github.com/apache/hadoop/pull/3028#issuecomment-845891722 Testing done: It was ensured that the xml gets generated with the append blob config and runs successfully -- This is an automated message from the Apache Git Service. To

[jira] [Work logged] (HADOOP-17715) ABFS: Append blob tests with non HNS accounts fail

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17715?focusedWorklogId=600302=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600302 ] ASF GitHub Bot logged work on HADOOP-17715: --- Author: ASF GitHub Bot

[GitHub] [hadoop] snehavarma commented on a change in pull request #3028: HADOOP-17715 ABFS: Append blob tests with non HNS accounts fail

2021-05-21 Thread GitBox
snehavarma commented on a change in pull request #3028: URL: https://github.com/apache/hadoop/pull/3028#discussion_r636851737 ## File path: hadoop-tools/hadoop-azure/dev-support/testrun-scripts/runtests.sh ## @@ -40,8 +41,9 @@ values=("{account name}.dfs.core.windows.net"

[GitHub] [hadoop] jojochuang commented on a change in pull request #3036: HDFS-15998. Fix NullPointException In listOpenFiles

2021-05-21 Thread GitBox
jojochuang commented on a change in pull request #3036: URL: https://github.com/apache/hadoop/pull/3036#discussion_r636847332 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/LeaseManager.java ## @@ -300,8 +300,13 @@

[GitHub] [hadoop] jojochuang commented on a change in pull request #3036: HDFS-15998. Fix NullPointException In listOpenFiles

2021-05-21 Thread GitBox
jojochuang commented on a change in pull request #3036: URL: https://github.com/apache/hadoop/pull/3036#discussion_r636843883 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java ## @@ -2006,8 +2006,14 @@ private

[jira] [Updated] (HADOOP-17458) S3A to treat "SdkClientException: Data read has a different length than the expected" as EOFException

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17458: Labels: pull-request-available (was: ) > S3A to treat "SdkClientException: Data read

[jira] [Work logged] (HADOOP-17458) S3A to treat "SdkClientException: Data read has a different length than the expected" as EOFException

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17458?focusedWorklogId=600295=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600295 ] ASF GitHub Bot logged work on HADOOP-17458: --- Author: ASF GitHub Bot

[GitHub] [hadoop] bogthe opened a new pull request #3040: HADOOP-17458 S3A to treat "SdkClientException: Data read has a different length than the expected" as EOFException

2021-05-21 Thread GitBox
bogthe opened a new pull request #3040: URL: https://github.com/apache/hadoop/pull/3040 [HADOOP-17458](https://issues.apache.org/jira/browse/HADOOP-17458) Some network exceptions would cause `SdkClientException` to fail with a `Data read has a different length than the expected`

[jira] [Updated] (HADOOP-17725) Improve error message for token providers in ABFS

2021-05-21 Thread Ivan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan updated HADOOP-17725: -- Description: It would be good to improve error messages for token providers in ABFS. Currently, when a

[jira] [Updated] (HADOOP-17725) Improve error message for token providers in ABFS

2021-05-21 Thread Ivan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan updated HADOOP-17725: -- Description: It would be good to improve error messages for token providers in ABFS. Currently, when a

[jira] [Updated] (HADOOP-17725) Improve error message for token providers in ABFS

2021-05-21 Thread Ivan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan updated HADOOP-17725: -- Component/s: fs/azure > Improve error message for token providers in ABFS >

[jira] [Work logged] (HADOOP-17714) ABFS: testBlobBackCompatibility & WasbAbfsCompatibility tests fail when triggered with default configs

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17714?focusedWorklogId=600291=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600291 ] ASF GitHub Bot logged work on HADOOP-17714: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3035: HADOOP-17714 ABFS: testBlobBackCompatibility & WasbAbfsCompatibility tests fail when triggered with default configs

2021-05-21 Thread GitBox
hadoop-yetus commented on pull request #3035: URL: https://github.com/apache/hadoop/pull/3035#issuecomment-845873858 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Created] (HADOOP-17725) Improve error message for token providers in ABFS

2021-05-21 Thread Ivan (Jira)
Ivan created HADOOP-17725: - Summary: Improve error message for token providers in ABFS Key: HADOOP-17725 URL: https://issues.apache.org/jira/browse/HADOOP-17725 Project: Hadoop Common Issue Type:

[jira] [Work logged] (HADOOP-17724) Add Dockerfile for Debian 10

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17724?focusedWorklogId=600289=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600289 ] ASF GitHub Bot logged work on HADOOP-17724: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3038: HADOOP-17724. Add Dockerfile for Debian 10

2021-05-21 Thread GitBox
hadoop-yetus commented on pull request #3038: URL: https://github.com/apache/hadoop/pull/3038#issuecomment-845871762 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17718) Explicitly set locale in the Dockerfile

2021-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17718?focusedWorklogId=600276=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-600276 ] ASF GitHub Bot logged work on HADOOP-17718: --- Author: ASF GitHub Bot

  1   2   >