[GitHub] [hadoop] hadoop-yetus commented on pull request #2517: HDFS-15708. TestURLConnectionFactory fails by NoClassDefFoundError in branch-3.3 and branch-3.2

2020-12-03 Thread GitBox
hadoop-yetus commented on pull request #2517: URL: https://github.com/apache/hadoop/pull/2517#issuecomment-738614011 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 15m 40

[GitHub] [hadoop] crossfire opened a new pull request #2518: HDFS-15709. Socket file descriptor leak in StripedBlockChecksumRecons…

2020-12-03 Thread GitBox
crossfire opened a new pull request #2518: URL: https://github.com/apache/hadoop/pull/2518 …tructor. ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need to set the title of the pull request which starts with the corresponding JIRA issu

[jira] [Commented] (HADOOP-15775) [JDK9] Add missing javax.activation-api dependency

2020-12-03 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17243759#comment-17243759 ] Xiaoqiao He commented on HADOOP-15775: -- Hi [~aajisaka], Just check branch-3.2, it

[jira] [Work logged] (HADOOP-16524) Automatic keystore reloading for HttpServer2

2020-12-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16524?focusedWorklogId=520019&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-520019 ] ASF GitHub Bot logged work on HADOOP-16524: --- Author: ASF GitHub B

[GitHub] [hadoop] saintstack commented on a change in pull request #2470: HADOOP-16524. Reloading SSL keystore for both DataNode and NameNode

2020-12-03 Thread GitBox
saintstack commented on a change in pull request #2470: URL: https://github.com/apache/hadoop/pull/2470#discussion_r535858254 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/ssl/FileBasedKeyStoresFactory.java ## @@ -77,14 +84,118 @@

[jira] [Work logged] (HADOOP-16524) Automatic keystore reloading for HttpServer2

2020-12-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16524?focusedWorklogId=520013&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-520013 ] ASF GitHub Bot logged work on HADOOP-16524: --- Author: ASF GitHub B

[GitHub] [hadoop] saintstack commented on a change in pull request #2470: HADOOP-16524. Reloading SSL keystore for both DataNode and NameNode

2020-12-03 Thread GitBox
saintstack commented on a change in pull request #2470: URL: https://github.com/apache/hadoop/pull/2470#discussion_r535747204 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/ssl/FileBasedKeyStoresFactory.java ## @@ -77,14 +84,118 @@

[jira] [Commented] (HADOOP-16080) hadoop-aws does not work with hadoop-client-api

2020-12-03 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17243741#comment-17243741 ] Xiaoqiao He commented on HADOOP-16080: -- Thanks [~csun] and [~ste...@apache.org] fo

[GitHub] [hadoop] aajisaka edited a comment on pull request #2517: HDFS-15708. TestURLConnectionFactory fails by NoClassDefFoundError in branch-3.3 and branch-3.2

2020-12-03 Thread GitBox
aajisaka edited a comment on pull request #2517: URL: https://github.com/apache/hadoop/pull/2517#issuecomment-738584172 trunk is not affected because the scope of bouncycastle dependency in hadoop-common is compile. In branch-3.3 and 3.2, the scope is test. The scope has been changed in th

[GitHub] [hadoop] aajisaka commented on pull request #2517: HDFS-15708. TestURLConnectionFactory fails by NoClassDefFoundError in branch-3.3 and branch-3.2

2020-12-03 Thread GitBox
aajisaka commented on pull request #2517: URL: https://github.com/apache/hadoop/pull/2517#issuecomment-738584172 trunk is not affected because the scope bouncycastle dependency in hadoop-common is compile. In branch-3.3 and 3.2, the scope is test. The scope has been changed in the followin

[GitHub] [hadoop] sunchao opened a new pull request #2517: HDFS-15708. TestURLConnectionFactory fails by NoClassDefFoundError in branch-3.3 and branch-3.2

2020-12-03 Thread GitBox
sunchao opened a new pull request #2517: URL: https://github.com/apache/hadoop/pull/2517 Include `org.bouncycastle` as test dependency for `hadoop-hdfs-client`. This is an automated message from the Apache Git Service. To res

[GitHub] [hadoop] hadoop-yetus commented on pull request #2516: HDFS-15707. NNTop counts don't add up as expected.

2020-12-03 Thread GitBox
hadoop-yetus commented on pull request #2516: URL: https://github.com/apache/hadoop/pull/2516#issuecomment-738554332 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[jira] [Updated] (HADOOP-15832) Upgrade BouncyCastle to 1.60

2020-12-03 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-15832: --- Fix Version/s: 3.2.1 Target Version/s: 3.3.0, 3.2.0 (was: 3.2.0, 3.3.0) This commit

[jira] [Resolved] (HADOOP-17389) KMS should log full UGI principal

2020-12-03 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HADOOP-17389. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Merged the PR i

[jira] [Work logged] (HADOOP-16524) Automatic keystore reloading for HttpServer2

2020-12-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16524?focusedWorklogId=519946&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-519946 ] ASF GitHub Bot logged work on HADOOP-16524: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-17389) KMS should log full UGI principal

2020-12-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17389?focusedWorklogId=519945&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-519945 ] ASF GitHub Bot logged work on HADOOP-17389: --- Author: ASF GitHub B

[GitHub] [hadoop] saintstack commented on a change in pull request #2470: HADOOP-16524. Reloading SSL keystore for both DataNode and NameNode

2020-12-03 Thread GitBox
saintstack commented on a change in pull request #2470: URL: https://github.com/apache/hadoop/pull/2470#discussion_r534456483 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/http/HttpServer2.java ## @@ -569,12 +577,45 @@ private ServerConnecto

[GitHub] [hadoop] aajisaka commented on pull request #2476: HADOOP-17389. KMS should log full UGI principal.

2020-12-03 Thread GitBox
aajisaka commented on pull request #2476: URL: https://github.com/apache/hadoop/pull/2476#issuecomment-738472514 Merged. Thank you @amahussein for your contribution and thank you @jbrennan333 for your review! This is an auto

[jira] [Work logged] (HADOOP-17389) KMS should log full UGI principal

2020-12-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17389?focusedWorklogId=519944&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-519944 ] ASF GitHub Bot logged work on HADOOP-17389: --- Author: ASF GitHub B

[GitHub] [hadoop] aajisaka merged pull request #2476: HADOOP-17389. KMS should log full UGI principal.

2020-12-03 Thread GitBox
aajisaka merged pull request #2476: URL: https://github.com/apache/hadoop/pull/2476 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Resolved] (HADOOP-16080) hadoop-aws does not work with hadoop-client-api

2020-12-03 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved HADOOP-16080. --- Fix Version/s: 3.2.2 Hadoop Flags: Reviewed Assignee: Chao Sun Resolution: Fixe

[jira] [Work logged] (HADOOP-16080) hadoop-aws does not work with hadoop-client-api

2020-12-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16080?focusedWorklogId=519935&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-519935 ] ASF GitHub Bot logged work on HADOOP-16080: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2510: HADOOP-16080. hadoop-aws does not work with hadoop-client-api

2020-12-03 Thread GitBox
hadoop-yetus removed a comment on pull request #2510: URL: https://github.com/apache/hadoop/pull/2510#issuecomment-738463415 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec |

[jira] [Work logged] (HADOOP-16080) hadoop-aws does not work with hadoop-client-api

2020-12-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16080?focusedWorklogId=519933&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-519933 ] ASF GitHub Bot logged work on HADOOP-16080: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #2510: HADOOP-16080. hadoop-aws does not work with hadoop-client-api

2020-12-03 Thread GitBox
hadoop-yetus commented on pull request #2510: URL: https://github.com/apache/hadoop/pull/2510#issuecomment-738463415 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 17

[jira] [Work logged] (HADOOP-16080) hadoop-aws does not work with hadoop-client-api

2020-12-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16080?focusedWorklogId=519929&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-519929 ] ASF GitHub Bot logged work on HADOOP-16080: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-16080) hadoop-aws does not work with hadoop-client-api

2020-12-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16080?focusedWorklogId=519928&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-519928 ] ASF GitHub Bot logged work on HADOOP-16080: --- Author: ASF GitHub B

[GitHub] [hadoop] sunchao commented on pull request #2510: HADOOP-16080. hadoop-aws does not work with hadoop-client-api

2020-12-03 Thread GitBox
sunchao commented on pull request #2510: URL: https://github.com/apache/hadoop/pull/2510#issuecomment-738462983 Merged to branch-3.2. I'll create PRs for branch-3.1 and trunk later. Thanks again @aajisaka for the review. Thi

[GitHub] [hadoop] sunchao merged pull request #2510: HADOOP-16080. hadoop-aws does not work with hadoop-client-api

2020-12-03 Thread GitBox
sunchao merged pull request #2510: URL: https://github.com/apache/hadoop/pull/2510 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [hadoop] amahussein opened a new pull request #2516: HDFS-15707. NNTop counts don't add up as expected.

2020-12-03 Thread GitBox
amahussein opened a new pull request #2516: URL: https://github.com/apache/hadoop/pull/2516 ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need to set the title of the pull request which starts with the corresponding JIRA issue number. (e.g.

[jira] [Resolved] (HADOOP-17401) GCS to support per-bucket configuration

2020-12-03 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo resolved HADOOP-17401. --- Resolution: Duplicate > GCS to support per-bucket configuration > --- >

[jira] [Created] (HADOOP-17411) GCS to support per-bucket configuration

2020-12-03 Thread t oo (Jira)
t oo created HADOOP-17411: - Summary: GCS to support per-bucket configuration Key: HADOOP-17411 URL: https://issues.apache.org/jira/browse/HADOOP-17411 Project: Hadoop Common Issue Type: Sub-task

[jira] [Commented] (HADOOP-13571) ServerSocketUtil.getPort() should use loopback address, not 0.0.0.0

2020-12-03 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17243572#comment-17243572 ] Ahmed Hussein commented on HADOOP-13571: Great! Can you fix the styling issues

[GitHub] [hadoop] jojochuang merged pull request #2515: HDFS-15706. HttpFS: Log more information on request failures.

2020-12-03 Thread GitBox
jojochuang merged pull request #2515: URL: https://github.com/apache/hadoop/pull/2515 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [hadoop] hadoop-yetus commented on pull request #2515: HDFS-15706. HttpFS: Log more information on request failures.

2020-12-03 Thread GitBox
hadoop-yetus commented on pull request #2515: URL: https://github.com/apache/hadoop/pull/2515#issuecomment-738432840 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[jira] [Work logged] (HADOOP-17408) Optimize NetworkTopology while sorting of block locations

2020-12-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17408?focusedWorklogId=519910&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-519910 ] ASF GitHub Bot logged work on HADOOP-17408: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #2514: HADOOP-17408. Optimize NetworkTopology while sorting of block locations.

2020-12-03 Thread GitBox
hadoop-yetus commented on pull request #2514: URL: https://github.com/apache/hadoop/pull/2514#issuecomment-738431049 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] hadoop-yetus commented on pull request #2513: YARN-10494 CLI tool for docker-to-squashfs conversion (pure Java).

2020-12-03 Thread GitBox
hadoop-yetus commented on pull request #2513: URL: https://github.com/apache/hadoop/pull/2513#issuecomment-738410183 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] hadoop-yetus commented on pull request #2513: YARN-10494 CLI tool for docker-to-squashfs conversion (pure Java).

2020-12-03 Thread GitBox
hadoop-yetus commented on pull request #2513: URL: https://github.com/apache/hadoop/pull/2513#issuecomment-738402930 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[jira] [Work logged] (HADOOP-16202) Stabilize openFile() and adopt internally

2020-12-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16202?focusedWorklogId=519897&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-519897 ] ASF GitHub Bot logged work on HADOOP-16202: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #2168: HADOOP-16202. Enhance/Stabilize openFile()

2020-12-03 Thread GitBox
hadoop-yetus commented on pull request #2168: URL: https://github.com/apache/hadoop/pull/2168#issuecomment-738373147 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] amahussein commented on a change in pull request #2515: HDFS-15706. HttpFS: Log more information on request failures.

2020-12-03 Thread GitBox
amahussein commented on a change in pull request #2515: URL: https://github.com/apache/hadoop/pull/2515#discussion_r535658381 ## File path: hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/HttpFSExceptionProvider.java ## @@ -95,4 +99,9 @@ p

[jira] [Commented] (HADOOP-13571) ServerSocketUtil.getPort() should use loopback address, not 0.0.0.0

2020-12-03 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17243527#comment-17243527 ] Eric Badger commented on HADOOP-13571: -- Amazingly, it still applies and is applica

[jira] [Reopened] (HADOOP-17410) can't change the fix version without reopening the bug

2020-12-03 Thread Ankur Tagra (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Tagra reopened HADOOP-17410: -- > can't change the fix version without reopening the bug > --

[jira] [Resolved] (HADOOP-17410) can't change the fix version without reopening the bug

2020-12-03 Thread Ankur Tagra (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Tagra resolved HADOOP-17410. -- Resolution: Fixed > can't change the fix version without reopening the bug >

[jira] [Resolved] (HADOOP-17410) can't change the fix version without reopening the bug

2020-12-03 Thread Ankur Tagra (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Tagra resolved HADOOP-17410. -- Resolution: Fixed > can't change the fix version without reopening the bug >

[jira] [Commented] (HADOOP-17410) can't change the fix version without reopening the bug

2020-12-03 Thread Ankur Tagra (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17243511#comment-17243511 ] Ankur Tagra commented on HADOOP-17410: -- is this resolved now ?   > can't change

[jira] [Created] (HADOOP-17410) can't change the fix version without reopening the bug

2020-12-03 Thread Ankur Tagra (Jira)
Ankur Tagra created HADOOP-17410: Summary: can't change the fix version without reopening the bug Key: HADOOP-17410 URL: https://issues.apache.org/jira/browse/HADOOP-17410 Project: Hadoop Common

[GitHub] [hadoop] hadoop-yetus commented on pull request #2515: HDFS-15706. HttpFS: Log more information on request failures.

2020-12-03 Thread GitBox
hadoop-yetus commented on pull request #2515: URL: https://github.com/apache/hadoop/pull/2515#issuecomment-738282187 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[jira] [Commented] (HADOOP-13571) ServerSocketUtil.getPort() should use loopback address, not 0.0.0.0

2020-12-03 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17243492#comment-17243492 ] Hadoop QA commented on HADOOP-13571: | (/) *{color:green}+1 overall{color}* | \\ \\

[GitHub] [hadoop] hadoop-yetus commented on pull request #2511: HDFS-15704. Mitigate lease monitor's rapid infinite loop.

2020-12-03 Thread GitBox
hadoop-yetus commented on pull request #2511: URL: https://github.com/apache/hadoop/pull/2511#issuecomment-738281544 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[jira] [Updated] (HADOOP-16881) KerberosAuthentication does not disconnect HttpURLConnection leading to CLOSE_WAIT cnxns

2020-12-03 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-16881: - Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch A

[jira] [Updated] (HADOOP-16881) KerberosAuthentication does not disconnect HttpURLConnection leading to CLOSE_WAIT cnxns

2020-12-03 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-16881: - Summary: KerberosAuthentication does not disconnect HttpURLConnection leading to CLOSE_

[jira] [Resolved] (HADOOP-17392) Remote exception messages should not include the exception class

2020-12-03 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan resolved HADOOP-17392. -- Fix Version/s: 3.2.3 3.1.5 3.4.0 3.3.

[jira] [Comment Edited] (HADOOP-16881) PseudoAuthenticator does not disconnect HttpURLConnection leading to CLOSE_WAIT cnxns

2020-12-03 Thread Vivek Ratnavel Subramanian (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17243439#comment-17243439 ] Vivek Ratnavel Subramanian edited comment on HADOOP-16881 at 12/3/20, 7:57 PM: --

[GitHub] [hadoop] jojochuang commented on a change in pull request #2515: HDFS-15706. HttpFS: Log more information on request failures.

2020-12-03 Thread GitBox
jojochuang commented on a change in pull request #2515: URL: https://github.com/apache/hadoop/pull/2515#discussion_r535514879 ## File path: hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/HttpFSExceptionProvider.java ## @@ -95,4 +99,9 @@ p

[GitHub] [hadoop] amahussein opened a new pull request #2515: HDFS-15706. HttpFS: Log more information on request failures.

2020-12-03 Thread GitBox
amahussein opened a new pull request #2515: URL: https://github.com/apache/hadoop/pull/2515 ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need to set the title of the pull request which starts with the corresponding JIRA issue number. (e.g.

[jira] [Commented] (HADOOP-16881) PseudoAuthenticator does not disconnect HttpURLConnection leading to CLOSE_WAIT cnxns

2020-12-03 Thread Vivek Ratnavel Subramanian (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17243439#comment-17243439 ] Vivek Ratnavel Subramanian commented on HADOOP-16881: - [~amagyar] T

[jira] [Work logged] (HADOOP-17397) ABFS: SAS Test updates for version and permission update

2020-12-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17397?focusedWorklogId=519806&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-519806 ] ASF GitHub Bot logged work on HADOOP-17397: --- Author: ASF GitHub B

[GitHub] [hadoop] ThomasMarquardt commented on a change in pull request #2504: HADOOP-17397: ABFS: SAS Test updates for version and permission update

2020-12-03 Thread GitBox
ThomasMarquardt commented on a change in pull request #2504: URL: https://github.com/apache/hadoop/pull/2504#discussion_r535475833 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAzureBlobFileSystemDelegationSAS.java ## @@ -410,4 +417,6

[jira] [Work logged] (HADOOP-17288) Use shaded guava from thirdparty

2020-12-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17288?focusedWorklogId=519804&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-519804 ] ASF GitHub Bot logged work on HADOOP-17288: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #2505: HADOOP-17288. Use shaded guava from thirdparty. (branch-3.3)

2020-12-03 Thread GitBox
hadoop-yetus commented on pull request #2505: URL: https://github.com/apache/hadoop/pull/2505#issuecomment-738192066 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 30m 7

[jira] [Created] (HADOOP-17409) Remove S3Guard - no longer needed

2020-12-03 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-17409: --- Summary: Remove S3Guard - no longer needed Key: HADOOP-17409 URL: https://issues.apache.org/jira/browse/HADOOP-17409 Project: Hadoop Common Issue Type:

[GitHub] [hadoop] akiyamaneko commented on pull request #2439: [YARN-10484][YARN-UI2]The number of containers of a single node in the heatmap was not displayed correctly

2020-12-03 Thread GitBox
akiyamaneko commented on pull request #2439: URL: https://github.com/apache/hadoop/pull/2439#issuecomment-738178879 @sunilgovind @tangzhankun @jiwq can you help to review this? thanks a lot. This is an automated message fro

[jira] [Work logged] (HADOOP-17408) Optimize NetworkTopology while sorting of block locations

2020-12-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17408?focusedWorklogId=519789&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-519789 ] ASF GitHub Bot logged work on HADOOP-17408: --- Author: ASF GitHub B

[jira] [Updated] (HADOOP-17408) Optimize NetworkTopology while sorting of block locations

2020-12-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17408: Labels: pull-request-available (was: ) > Optimize NetworkTopology while sorting of block

[GitHub] [hadoop] amahussein opened a new pull request #2514: HADOOP-17408. Optimize NetworkTopology while sorting of block locations.

2020-12-03 Thread GitBox
amahussein opened a new pull request #2514: URL: https://github.com/apache/hadoop/pull/2514 ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need to set the title of the pull request which starts with the corresponding JIRA issue number. (e.g.

[jira] [Work logged] (HADOOP-17397) ABFS: SAS Test updates for version and permission update

2020-12-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17397?focusedWorklogId=519788&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-519788 ] ASF GitHub Bot logged work on HADOOP-17397: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on a change in pull request #2504: HADOOP-17397: ABFS: SAS Test updates for version and permission update

2020-12-03 Thread GitBox
steveloughran commented on a change in pull request #2504: URL: https://github.com/apache/hadoop/pull/2504#discussion_r535444734 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAzureBlobFileSystemDelegationSAS.java ## @@ -410,4 +417,64

[jira] [Commented] (HADOOP-13571) ServerSocketUtil.getPort() should use loopback address, not 0.0.0.0

2020-12-03 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17243379#comment-17243379 ] Ahmed Hussein commented on HADOOP-13571: [~ebadger], thanks for the patch. Can

[jira] [Updated] (HADOOP-17343) Upgrade aws-java-sdk to 1.11.901

2020-12-03 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17343: Fix Version/s: 3.2.2 > Upgrade aws-java-sdk to 1.11.901 > ---

[jira] [Commented] (HADOOP-16881) PseudoAuthenticator does not disconnect HttpURLConnection leading to CLOSE_WAIT cnxns

2020-12-03 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17243357#comment-17243357 ] Wei-Chiu Chuang commented on HADOOP-16881: -- Thanks for the patch, LGTM +1 Not

[jira] [Work logged] (HADOOP-17392) Remote exception messages should not include the exception class

2020-12-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17392?focusedWorklogId=519775&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-519775 ] ASF GitHub Bot logged work on HADOOP-17392: --- Author: ASF GitHub B

[GitHub] [hadoop] jbrennan333 merged pull request #2486: HADOOP-17392. Remote exception messages should not include the exception class

2020-12-03 Thread GitBox
jbrennan333 merged pull request #2486: URL: https://github.com/apache/hadoop/pull/2486 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Commented] (HADOOP-17392) Remote exception messages should not include the exception class

2020-12-03 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17243345#comment-17243345 ] Jim Brennan commented on HADOOP-17392: -- Thanks [~daryn] and [~ahussein]!  +1 This

[jira] [Work started] (HADOOP-17408) Optimize NetworkTopology while sorting of block locations

2020-12-03 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-17408 started by Ahmed Hussein. -- > Optimize NetworkTopology while sorting of block locations >

[jira] [Created] (HADOOP-17408) Optimize NetworkTopology while sorting of block locations

2020-12-03 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HADOOP-17408: -- Summary: Optimize NetworkTopology while sorting of block locations Key: HADOOP-17408 URL: https://issues.apache.org/jira/browse/HADOOP-17408 Project: Hadoop Common

[GitHub] [hadoop] aajisaka commented on pull request #2512: YARN-10511: Update yarn.nodemanager.env-whitelist value in Cluster Setup

2020-12-03 Thread GitBox
aajisaka commented on pull request #2512: URL: https://github.com/apache/hadoop/pull/2512#issuecomment-738069308 Merged. Thank you @adamantal for your review. This is an automated message from the Apache Git Service. To respo

[GitHub] [hadoop] aajisaka merged pull request #2512: YARN-10511: Update yarn.nodemanager.env-whitelist value in Cluster Setup

2020-12-03 Thread GitBox
aajisaka merged pull request #2512: URL: https://github.com/apache/hadoop/pull/2512 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Updated] (HADOOP-16935) Backport HADOOP-10848. Cleanup calling of sun.security.krb5.Config to branch-3.2

2020-12-03 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-16935: --- Fix Version/s: 3.2.2 > Backport HADOOP-10848. Cleanup calling of sun.security.krb5.Config t

[jira] [Resolved] (HADOOP-17397) ABFS: SAS Test updates for version and permission update

2020-12-03 Thread Thomas Marqardt (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marqardt resolved HADOOP-17397. -- Resolution: Fixed Pushed to trunk (commit 717b8350) and branch-3.3 (commit a5695057).

[jira] [Work logged] (HADOOP-17397) ABFS: SAS Test updates for version and permission update

2020-12-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17397?focusedWorklogId=519689&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-519689 ] ASF GitHub Bot logged work on HADOOP-17397: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-17397) ABFS: SAS Test updates for version and permission update

2020-12-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17397?focusedWorklogId=519690&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-519690 ] ASF GitHub Bot logged work on HADOOP-17397: --- Author: ASF GitHub B

[GitHub] [hadoop] ThomasMarquardt closed pull request #2504: HADOOP-17397: ABFS: SAS Test updates for version and permission update

2020-12-03 Thread GitBox
ThomasMarquardt closed pull request #2504: URL: https://github.com/apache/hadoop/pull/2504 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] ThomasMarquardt commented on pull request #2504: HADOOP-17397: ABFS: SAS Test updates for version and permission update

2020-12-03 Thread GitBox
ThomasMarquardt commented on pull request #2504: URL: https://github.com/apache/hadoop/pull/2504#issuecomment-738033854 Pushed to trunk (commit 717b8350) and branch-3.3 (commit a5695057). This is an automated message from the

[jira] [Updated] (HADOOP-17407) ABFS: Delete Idempotency handling can lead to NPE

2020-12-03 Thread Sneha Vijayarajan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sneha Vijayarajan updated HADOOP-17407: --- Description: Delete idempotency code returns success with a dummy success HttpOpera

[jira] [Created] (HADOOP-17407) ABFS: Delete Idempotency handling can lead to NPE

2020-12-03 Thread Sneha Vijayarajan (Jira)
Sneha Vijayarajan created HADOOP-17407: -- Summary: ABFS: Delete Idempotency handling can lead to NPE Key: HADOOP-17407 URL: https://issues.apache.org/jira/browse/HADOOP-17407 Project: Hadoop Common

[jira] [Work logged] (HADOOP-17347) ABFS: Read optimizations

2020-12-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17347?focusedWorklogId=519577&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-519577 ] ASF GitHub Bot logged work on HADOOP-17347: --- Author: ASF GitHub B

[GitHub] [hadoop] snvijaya commented on a change in pull request #2464: HADOOP-17347. ABFS: Read optimizations

2020-12-03 Thread GitBox
snvijaya commented on a change in pull request #2464: URL: https://github.com/apache/hadoop/pull/2464#discussion_r535129578 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsInputStream.java ## @@ -141,7 +154,7 @@ public synchroni

[jira] [Resolved] (HADOOP-17332) S3A marker tool mixes up -min and -max

2020-12-03 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17332. - Fix Version/s: 3.3.1 Resolution: Fixed > S3A marker tool mixes up -min and -max

[jira] [Resolved] (HADOOP-16879) s3a mkdirs() to not check dest for a dir marker

2020-12-03 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16879. - Resolution: Duplicate > s3a mkdirs() to not check dest for a dir marker > -

[jira] [Resolved] (HADOOP-16804) s3a mkdir path/ can add 404 to S3 load balancers

2020-12-03 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16804. - Resolution: Not A Problem AWS S3 is now consistent. No more 404 caching. > s3a mkdir p

[jira] [Resolved] (HADOOP-16863) Report on S3A cached 404 recovery better

2020-12-03 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16863. - Resolution: Not A Problem AWS S3 is now consistent. No more 404 caching. > Report on S

[jira] [Work logged] (HADOOP-17347) ABFS: Read optimizations

2020-12-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17347?focusedWorklogId=519573&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-519573 ] ASF GitHub Bot logged work on HADOOP-17347: --- Author: ASF GitHub B

[GitHub] [hadoop] bilaharith commented on a change in pull request #2464: HADOOP-17347. ABFS: Read optimizations

2020-12-03 Thread GitBox
bilaharith commented on a change in pull request #2464: URL: https://github.com/apache/hadoop/pull/2464#discussion_r535145966 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsInputStream.java ## @@ -161,6 +174,14 @@ private int r

[GitHub] [hadoop] hadoop-yetus commented on pull request #2512: YARN-10511: Update yarn.nodemanager.env-whitelist value in Cluster Setup

2020-12-03 Thread GitBox
hadoop-yetus commented on pull request #2512: URL: https://github.com/apache/hadoop/pull/2512#issuecomment-737779808 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] ilpianista commented on pull request #2512: YARN-10511: Update yarn.nodemanager.env-whitelist value in Cluster Setup

2020-12-03 Thread GitBox
ilpianista commented on pull request #2512: URL: https://github.com/apache/hadoop/pull/2512#issuecomment-737741053 @aajisaka I also updated https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/DockerContainers.html as well. --