[jira] [Assigned] (HADOOP-17461) Add thread-level IOStatistics Context

2022-05-18 Thread Mehakmeet Singh (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mehakmeet Singh reassigned HADOOP-17461: Assignee: Mehakmeet Singh > Add thread-level IOStatistics Context >

[jira] [Work started] (HADOOP-18242) ABFS Rename Failure when tracking metadata is in incomplete state

2022-05-18 Thread Mehakmeet Singh (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-18242 started by Mehakmeet Singh. > ABFS Rename Failure when tracking metadata is in incomplete state >

[jira] [Work logged] (HADOOP-18242) ABFS Rename Failure when tracking metadata is in incomplete state

2022-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18242?focusedWorklogId=772293&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-772293 ] ASF GitHub Bot logged work on HADOOP-18242: --- Author: ASF GitHub B

[GitHub] [hadoop] mehakmeet commented on pull request #4331: HADOOP-18242. ABFS Rename Failure when tracking metadata is in an incomplete state

2022-05-18 Thread GitBox
mehakmeet commented on PR #4331: URL: https://github.com/apache/hadoop/pull/4331#issuecomment-1131281425 CC: @mukund-thakur @steveloughran Reproducing this exact issue seems tricky. Also, need to check if this is the only error code that corresponds to this issue, if the tracking metada

[jira] [Updated] (HADOOP-18242) ABFS Rename Failure when tracking metadata is in incomplete state

2022-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18242: Labels: pull-request-available (was: ) > ABFS Rename Failure when tracking metadata is i

[jira] [Work logged] (HADOOP-18242) ABFS Rename Failure when tracking metadata is in incomplete state

2022-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18242?focusedWorklogId=772292&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-772292 ] ASF GitHub Bot logged work on HADOOP-18242: --- Author: ASF GitHub B

[GitHub] [hadoop] mehakmeet opened a new pull request, #4331: HADOOP-18242. ABFS Rename Failure when tracking metadata is in an incomplete state

2022-05-18 Thread GitBox
mehakmeet opened a new pull request, #4331: URL: https://github.com/apache/hadoop/pull/4331 ### Description of PR ABFS rename fails intermittently when the Storage-blob tracking metadata is in an incomplete state, to mitigate this issue, we can do a HEAD call on the source file and then

[GitHub] [hadoop] hadoop-yetus commented on pull request #4198: YARN-11112 Avoid renewing delegation token when app is first submitte…

2022-05-18 Thread GitBox
hadoop-yetus commented on PR #4198: URL: https://github.com/apache/hadoop/pull/4198#issuecomment-1131240229 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Work logged] (HADOOP-18241) Move to Java 11

2022-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18241?focusedWorklogId=772254&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-772254 ] ASF GitHub Bot logged work on HADOOP-18241: --- Author: ASF GitHub B

[GitHub] [hadoop] ayushtkn commented on pull request #4319: HADOOP-18241. Move to JAVA 11.

2022-05-18 Thread GitBox
ayushtkn commented on PR #4319: URL: https://github.com/apache/hadoop/pull/4319#issuecomment-1131207685 Gonna have test failures. We need HADOOP-15984 realised we don’t fully support java-11 as of now, it still has some work remaining. -- This is an automated message from the Apache G

[jira] [Work logged] (HADOOP-18238) Hadoop 3.3.1 SFTPFileSystem.close() method have problem

2022-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18238?focusedWorklogId=772250&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-772250 ] ASF GitHub Bot logged work on HADOOP-18238: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4330: HADOOP-18238.Fix reentrancy check in SFTPFileSystem.close()

2022-05-18 Thread GitBox
hadoop-yetus commented on PR #4330: URL: https://github.com/apache/hadoop/pull/4330#issuecomment-1131200856 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] aajisaka commented on pull request #4229: HDFS-16453. okhttp@2.7.5 to 4.9.3

2022-05-18 Thread GitBox
aajisaka commented on PR #4229: URL: https://github.com/apache/hadoop/pull/4229#issuecomment-1131189121 @ashutoshcipher Would you remove this line? I'm +1 if that is addressed. https://github.com/apache/hadoop/blob/516f36c6f14c917d85df681b86349d7416693000/hadoop-tools/hadoop-azure-datalak

[GitHub] [hadoop] aajisaka commented on pull request #4229: HDFS-16453. okhttp@2.7.5 to 4.9.3

2022-05-18 Thread GitBox
aajisaka commented on PR #4229: URL: https://github.com/apache/hadoop/pull/4229#issuecomment-1131184674 Failed tests are not related to the patch. - TestLocalDistributedCacheManager: Failing on trunk. Filed MAPREDUCE-7383 - TestServiceInterruptHandling, TestCryptoCodec, TestCryptoStrea

[jira] [Commented] (HADOOP-15984) Update jersey from 1.19 to 2.x

2022-05-18 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539203#comment-17539203 ] Akira Ajisaka commented on HADOOP-15984: {quote}Do you plan to merge this PR? o

[jira] [Work logged] (HADOOP-18241) Move to Java 11

2022-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18241?focusedWorklogId=772237&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-772237 ] ASF GitHub Bot logged work on HADOOP-18241: --- Author: ASF GitHub B

[jira] [Commented] (HADOOP-15984) Update jersey from 1.19 to 2.x

2022-05-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539197#comment-17539197 ] Ayush Saxena commented on HADOOP-15984: --- [~aajisaka] was trying to move to java-1

[GitHub] [hadoop] hadoop-yetus commented on pull request #4319: HADOOP-18241. Move to JAVA 11.

2022-05-18 Thread GitBox
hadoop-yetus commented on PR #4319: URL: https://github.com/apache/hadoop/pull/4319#issuecomment-1131172255 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at https://ci-hadoop.apache.org/job

[GitHub] [hadoop] cndaimin commented on pull request #4178: HDFS-16543. Keep default value of dfs.datanode.directoryscan.throttle.limit.ms.pe…

2022-05-18 Thread GitBox
cndaimin commented on PR #4178: URL: https://github.com/apache/hadoop/pull/4178#issuecomment-1131161277 @tomscut Thanks for your review. The failed UT seems not related, it runs successful locally on my computer. -- This is an automated message from the Apache Git Service. To respond to t

[jira] [Commented] (HADOOP-18212) hadoop-client-runtime latest version 3.3.2 has security issues

2022-05-18 Thread phoebe chen (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539176#comment-17539176 ] phoebe chen commented on HADOOP-18212: -- Awesome! Thanks for sharing the link.  >

[GitHub] [hadoop] hadoop-yetus commented on pull request #4323: HDFS-16582. Expose aggregate latency of slow node as perceived by the reporting node

2022-05-18 Thread GitBox
hadoop-yetus commented on PR #4323: URL: https://github.com/apache/hadoop/pull/4323#issuecomment-1131050710 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Work logged] (HADOOP-18245) Extend KMS related exceptions that get mapped to ConnectException

2022-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18245?focusedWorklogId=772213&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-772213 ] ASF GitHub Bot logged work on HADOOP-18245: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4329: HADOOP-18245 Extend KMS related exceptions that get mapped to Connect…

2022-05-18 Thread GitBox
hadoop-yetus commented on PR #4329: URL: https://github.com/apache/hadoop/pull/4329#issuecomment-1131023682 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] jianghuazhu commented on pull request #4321: HDFS-16581.Print DataNode node status.

2022-05-18 Thread GitBox
jianghuazhu commented on PR #4321: URL: https://github.com/apache/hadoop/pull/4321#issuecomment-1130997522 There are some tests that fail in CI/CD. E.g: TestReplaceDatanodeFailureReplication TestRollingUpgrade TestBlockScanner TestMover TestEditLogTailer TestRetryCacheWithHA

[GitHub] [hadoop] jianghuazhu commented on pull request #4321: HDFS-16581.Print DataNode node status.

2022-05-18 Thread GitBox
jianghuazhu commented on PR #4321: URL: https://github.com/apache/hadoop/pull/4321#issuecomment-1130986985 Here are some examples of online tests. Command: ./bin/hdfs dfsadmin -printTopology ![image](https://user-images.githubusercontent.com/6416939/169187485-0f7d8b17-8a15-43ea-a690-5e

[GitHub] [hadoop] hadoop-yetus commented on pull request #4271: YARN-11128. Fix comments in TestProportionalCapacityPreemptionPolicy*

2022-05-18 Thread GitBox
hadoop-yetus commented on PR #4271: URL: https://github.com/apache/hadoop/pull/4271#issuecomment-1130949066 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Work logged] (HADOOP-18244) Fix Hadoop-Common JavaDoc Error on branch-3.3

2022-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18244?focusedWorklogId=772200&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-772200 ] ASF GitHub Bot logged work on HADOOP-18244: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4327: HADOOP-18244. Fix Hadoop-Common JavaDoc Error on branch-3.3

2022-05-18 Thread GitBox
hadoop-yetus commented on PR #4327: URL: https://github.com/apache/hadoop/pull/4327#issuecomment-1130947497 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] tomscut commented on pull request #4178: HDFS-16543. Keep default value of dfs.datanode.directoryscan.throttle.limit.ms.pe…

2022-05-18 Thread GitBox
tomscut commented on PR #4178: URL: https://github.com/apache/hadoop/pull/4178#issuecomment-1130945355 LGTM. Please take a look at the failed unit test. Thank you. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

[jira] [Assigned] (HADOOP-18238) Hadoop 3.3.1 SFTPFileSystem.close() method have problem

2022-05-18 Thread Ashutosh Gupta (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Gupta reassigned HADOOP-18238: --- Assignee: Ashutosh Gupta > Hadoop 3.3.1 SFTPFileSystem.close() method have problem

[jira] [Updated] (HADOOP-18238) Hadoop 3.3.1 SFTPFileSystem.close() method have problem

2022-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18238: Labels: pull-request-available (was: ) > Hadoop 3.3.1 SFTPFileSystem.close() method have

[jira] [Work logged] (HADOOP-18238) Hadoop 3.3.1 SFTPFileSystem.close() method have problem

2022-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18238?focusedWorklogId=772198&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-772198 ] ASF GitHub Bot logged work on HADOOP-18238: --- Author: ASF GitHub B

[GitHub] [hadoop] ashutoshcipher opened a new pull request, #4330: HADOOP-18238.Fix reentrancy check in SFTPFileSystem.close()

2022-05-18 Thread GitBox
ashutoshcipher opened a new pull request, #4330: URL: https://github.com/apache/hadoop/pull/4330 ### Description of PR Fix reentrancy check in SFTPFileSystem.close() * JIRA: HADOOP-18238 - [x] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOO

[GitHub] [hadoop] virajjasani commented on pull request #4107: HDFS-16521. DFS API to retrieve slow datanodes

2022-05-18 Thread GitBox
virajjasani commented on PR #4107: URL: https://github.com/apache/hadoop/pull/4107#issuecomment-1130767525 A follow-up PR to expose latency of slow nodes as perceived by their reporting nodes #4323 -- This is an automated message from the Apache Git Service. To respond to the message, pl

[jira] [Commented] (HADOOP-18142) Increase precommit job timeout from 24 hr to 30 hr

2022-05-18 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539134#comment-17539134 ] Viraj Jasani commented on HADOOP-18142: --- One recent example of build timeout afte

[jira] [Assigned] (HADOOP-18245) Extend KMS related exceptions that get mapped to ConnectException

2022-05-18 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HADOOP-18245: Assignee: Ritesh H Shukla > Extend KMS related exceptions that get mapped to Con

[jira] [Work logged] (HADOOP-18105) Implement a variant of ElasticByteBufferPool which uses weak references for garbage collection.

2022-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18105?focusedWorklogId=772167&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-772167 ] ASF GitHub Bot logged work on HADOOP-18105: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4263: HADOOP-18105 Implement buffer pooling with weak references

2022-05-18 Thread GitBox
hadoop-yetus commented on PR #4263: URL: https://github.com/apache/hadoop/pull/4263#issuecomment-1130652549 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #4178: HDFS-16543. Keep default value of dfs.datanode.directoryscan.throttle.limit.ms.pe…

2022-05-18 Thread GitBox
hadoop-yetus commented on PR #4178: URL: https://github.com/apache/hadoop/pull/4178#issuecomment-1130649190 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Updated] (HADOOP-18245) Extend KMS related exceptions that get mapped to ConnectException

2022-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18245: Labels: pull-request-available (was: ) > Extend KMS related exceptions that get mapped t

[jira] [Work logged] (HADOOP-18245) Extend KMS related exceptions that get mapped to ConnectException

2022-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18245?focusedWorklogId=772159&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-772159 ] ASF GitHub Bot logged work on HADOOP-18245: --- Author: ASF GitHub B

[GitHub] [hadoop] kerneltime opened a new pull request, #4329: HADOOP-18245 Extend KMS related exceptions that get mapped to Connect…

2022-05-18 Thread GitBox
kerneltime opened a new pull request, #4329: URL: https://github.com/apache/hadoop/pull/4329 …Exception ### Description of PR Based on production workload, we found that it is not enough to map just SSLHandshakeException to ConnectException in Loadbalancing KMS Client but t

[jira] [Updated] (HADOOP-18245) Extend KMS related exceptions that get mapped to ConnectException

2022-05-18 Thread Ritesh H Shukla (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ritesh H Shukla updated HADOOP-18245: - Description: Based on production workload, we found that it is not enough to map just

[jira] [Updated] (HADOOP-18245) Extend KMS related exceptions that get mapped to ConnectException

2022-05-18 Thread Ritesh H Shukla (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ritesh H Shukla updated HADOOP-18245: - Description: Based on production workload, we found that it is not enough to map just

[GitHub] [hadoop] hadoop-yetus commented on pull request #4271: YARN-11128. Fix comments in TestProportionalCapacityPreemptionPolicy*

2022-05-18 Thread GitBox
hadoop-yetus commented on PR #4271: URL: https://github.com/apache/hadoop/pull/4271#issuecomment-1130581234 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Updated] (HADOOP-18245) Extend KMS related exceptions that get mapped to ConnectException

2022-05-18 Thread Ritesh H Shukla (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ritesh H Shukla updated HADOOP-18245: - Description: Based on production workload, we found that it is not enough to map just

[jira] [Updated] (HADOOP-18245) Extend KMS related exceptions that get mapped to ConnectException

2022-05-18 Thread Ritesh H Shukla (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ritesh H Shukla updated HADOOP-18245: - Description: Based on production workload, we found that it is not enough to map just

[jira] [Created] (HADOOP-18245) Extend KMS related exceptions that get mapped to ConnectException

2022-05-18 Thread Ritesh H Shukla (Jira)
Ritesh H Shukla created HADOOP-18245: Summary: Extend KMS related exceptions that get mapped to ConnectException Key: HADOOP-18245 URL: https://issues.apache.org/jira/browse/HADOOP-18245 Project:

[GitHub] [hadoop] slfan1989 commented on pull request #4317: YARN-10465. Support getNodeToLabels, getLabelsToNodes, getClusterNodeLabels API's for Federation

2022-05-18 Thread GitBox
slfan1989 commented on PR #4317: URL: https://github.com/apache/hadoop/pull/4317#issuecomment-1130508561 Hi, @goiri ,Thanks for your help reviewing the code, Can you help with merging into the trunk branch? I will follow up on the next JIRA (YARN-10487). -- This is an automated message

[GitHub] [hadoop] hadoop-yetus commented on pull request #4321: HDFS-16581.Print DataNode node status.

2022-05-18 Thread GitBox
hadoop-yetus commented on PR #4321: URL: https://github.com/apache/hadoop/pull/4321#issuecomment-1130477395 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Work logged] (HADOOP-18240) Upgrade Yetus to 0.14.0

2022-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18240?focusedWorklogId=772084&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-772084 ] ASF GitHub Bot logged work on HADOOP-18240: --- Author: ASF GitHub B

[GitHub] [hadoop] cnauroth commented on pull request #4328: HADOOP-18240. Upgrade Yetus to 0.14.0

2022-05-18 Thread GitBox
cnauroth commented on PR #4328: URL: https://github.com/apache/hadoop/pull/4328#issuecomment-1130394235 Actually, I just noticed the "Unprocessed flag(s)" error. Any concerns there? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[jira] [Work logged] (HADOOP-18240) Upgrade Yetus to 0.14.0

2022-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18240?focusedWorklogId=772070&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-772070 ] ASF GitHub Bot logged work on HADOOP-18240: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4328: HADOOP-18240. Upgrade Yetus to 0.14.0

2022-05-18 Thread GitBox
hadoop-yetus commented on PR #4328: URL: https://github.com/apache/hadoop/pull/4328#issuecomment-1130365756 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] virajjasani commented on pull request #4323: HDFS-16582. Expose aggregate latency of slow node as perceived by the reporting node

2022-05-18 Thread GitBox
virajjasani commented on PR #4323: URL: https://github.com/apache/hadoop/pull/4323#issuecomment-1130320367 @saintstack @jojochuang @tomscut could you please review this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[jira] [Updated] (HADOOP-18240) Upgrade Yetus to 0.14.0

2022-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18240: Labels: pull-request-available (was: ) > Upgrade Yetus to 0.14.0 > -

[jira] [Work logged] (HADOOP-18240) Upgrade Yetus to 0.14.0

2022-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18240?focusedWorklogId=772042&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-772042 ] ASF GitHub Bot logged work on HADOOP-18240: --- Author: ASF GitHub B

[GitHub] [hadoop] ashutoshcipher opened a new pull request, #4328: HADOOP-18240. Upgrade Yetus to 0.14.0

2022-05-18 Thread GitBox
ashutoshcipher opened a new pull request, #4328: URL: https://github.com/apache/hadoop/pull/4328 ### Description of PR Upgrade Yetus to 0.14.0 * JIRA: HADOOP-18240 - [x] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title

[jira] [Work logged] (HADOOP-18241) Move to Java 11

2022-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18241?focusedWorklogId=772040&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-772040 ] ASF GitHub Bot logged work on HADOOP-18241: --- Author: ASF GitHub B

[GitHub] [hadoop] GauthamBanasandra commented on a diff in pull request #4319: HADOOP-18241. Move to JAVA 11.

2022-05-18 Thread GitBox
GauthamBanasandra commented on code in PR #4319: URL: https://github.com/apache/hadoop/pull/4319#discussion_r876147427 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java: ## @@ -573,7 +573,7 @@ public static void addDeprecations(Deprec

[jira] [Work logged] (HADOOP-18241) Move to Java 11

2022-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18241?focusedWorklogId=772038&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-772038 ] ASF GitHub Bot logged work on HADOOP-18241: --- Author: ASF GitHub B

[GitHub] [hadoop] ayushtkn commented on a diff in pull request #4319: HADOOP-18241. Move to JAVA 11.

2022-05-18 Thread GitBox
ayushtkn commented on code in PR #4319: URL: https://github.com/apache/hadoop/pull/4319#discussion_r876145193 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java: ## @@ -573,7 +573,7 @@ public static void addDeprecations(DeprecationDelt

[jira] [Work logged] (HADOOP-18244) Fix Hadoop-Common JavaDoc Error on branch-3.3

2022-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18244?focusedWorklogId=772023&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-772023 ] ASF GitHub Bot logged work on HADOOP-18244: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4327: HADOOP-18244. Fix Hadoop-Common JavaDoc Error on branch-3.3

2022-05-18 Thread GitBox
hadoop-yetus commented on PR #4327: URL: https://github.com/apache/hadoop/pull/4327#issuecomment-1130244339 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Work logged] (HADOOP-18241) Move to Java 11

2022-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18241?focusedWorklogId=772020&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-772020 ] ASF GitHub Bot logged work on HADOOP-18241: --- Author: ASF GitHub B

[GitHub] [hadoop] GauthamBanasandra commented on a diff in pull request #4319: HADOOP-18241. Move to JAVA 11.

2022-05-18 Thread GitBox
GauthamBanasandra commented on code in PR #4319: URL: https://github.com/apache/hadoop/pull/4319#discussion_r876108292 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java: ## @@ -573,7 +573,7 @@ public static void addDeprecations(Deprec

[GitHub] [hadoop] brumi1024 commented on pull request #4313: YARN-11152. QueueMetrics is leaking memory when creating a new queue …

2022-05-18 Thread GitBox
brumi1024 commented on PR #4313: URL: https://github.com/apache/hadoop/pull/4313#issuecomment-1130233555 Commited to trunk. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hadoop] brumi1024 closed pull request #4313: YARN-11152. QueueMetrics is leaking memory when creating a new queue …

2022-05-18 Thread GitBox
brumi1024 closed pull request #4313: YARN-11152. QueueMetrics is leaking memory when creating a new queue … URL: https://github.com/apache/hadoop/pull/4313 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] brumi1024 commented on pull request #4313: YARN-11152. QueueMetrics is leaking memory when creating a new queue …

2022-05-18 Thread GitBox
brumi1024 commented on PR #4313: URL: https://github.com/apache/hadoop/pull/4313#issuecomment-1130225472 Thanks @9uapaw for the patch, LGTM. Will merge shortly. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [hadoop] brumi1024 closed pull request #4301: YARN-11147. ResourceUsage and QueueCapacities classes provide node la…

2022-05-18 Thread GitBox
brumi1024 closed pull request #4301: YARN-11147. ResourceUsage and QueueCapacities classes provide node la… URL: https://github.com/apache/hadoop/pull/4301 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] brumi1024 commented on pull request #4301: YARN-11147. ResourceUsage and QueueCapacities classes provide node la…

2022-05-18 Thread GitBox
brumi1024 commented on PR #4301: URL: https://github.com/apache/hadoop/pull/4301#issuecomment-1130224423 Thanks @9uapaw for the patch, and @szilard-nemeth for the review. Committed to trunk. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Work logged] (HADOOP-18231) tests in ITestS3AInputStreamPerformance are failing

2022-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18231?focusedWorklogId=772009&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-772009 ] ASF GitHub Bot logged work on HADOOP-18231: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on a diff in pull request #4305: HADOOP-18231. Adds in new test for S3PrefetchingInputStream

2022-05-18 Thread GitBox
steveloughran commented on code in PR #4305: URL: https://github.com/apache/hadoop/pull/4305#discussion_r876075971 ## hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/ITestS3PrefetchingInputStream.java: ## @@ -0,0 +1,143 @@ +/* + * Licensed to the Apache Software F

[GitHub] [hadoop] simbadzina commented on pull request #4311: HDFS-13522: IPC changes to support observer reads through routers.

2022-05-18 Thread GitBox
simbadzina commented on PR #4311: URL: https://github.com/apache/hadoop/pull/4311#issuecomment-1130213231 This RB is followed up by https://github.com/apache/hadoop/pull/4127 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Work logged] (HADOOP-18069) CVE-2021-0341 in okhttp@2.7.5 detected in hdfs-client

2022-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18069?focusedWorklogId=771993&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-771993 ] ASF GitHub Bot logged work on HADOOP-18069: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4229: HADOOP-18069. okhttp@2.7.5 to 4.9.3

2022-05-18 Thread GitBox
hadoop-yetus commented on PR #4229: URL: https://github.com/apache/hadoop/pull/4229#issuecomment-1130200771 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] saintstack merged pull request #4326: HDFS-16540. Addendum: Data locality is lost when DataNode pod restarts in kubernetes.

2022-05-18 Thread GitBox
saintstack merged PR #4326: URL: https://github.com/apache/hadoop/pull/4326 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@ha

[GitHub] [hadoop] saintstack commented on pull request #4326: HDFS-16540. Addendum: Data locality is lost when DataNode pod restarts in kubernetes.

2022-05-18 Thread GitBox
saintstack commented on PR #4326: URL: https://github.com/apache/hadoop/pull/4326#issuecomment-1130165900 Merged. Thank you for the cleanup @Hexiaoqiao -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Work logged] (HADOOP-18236) Remove duplicate locks in NetworkTopology

2022-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18236?focusedWorklogId=771961&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-771961 ] ASF GitHub Bot logged work on HADOOP-18236: --- Author: ASF GitHub B

[GitHub] [hadoop] ZanderXu commented on pull request #4320: HADOOP-18236. Remove duplicate locks in NetworkTopology

2022-05-18 Thread GitBox
ZanderXu commented on PR #4320: URL: https://github.com/apache/hadoop/pull/4320#issuecomment-1130159428 Thanks @Hexiaoqiao for your comment, and I have read [HADOOP-16028](https://issues.apache.org/jira/browse/HADOOP-16028) in detail. If we look at this function without context, it is indee

[GitHub] [hadoop] hadoop-yetus commented on pull request #4326: HDFS-16540. Addendum: Data locality is lost when DataNode pod restarts in kubernetes.

2022-05-18 Thread GitBox
hadoop-yetus commented on PR #4326: URL: https://github.com/apache/hadoop/pull/4326#issuecomment-1130072419 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Work logged] (HADOOP-18241) Move to Java 11

2022-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18241?focusedWorklogId=771891&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-771891 ] ASF GitHub Bot logged work on HADOOP-18241: --- Author: ASF GitHub B

[jira] [Updated] (HADOOP-18241) Move to Java 11

2022-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18241: Labels: pull-request-available (was: ) > Move to Java 11 > --- > >

[GitHub] [hadoop] hadoop-yetus commented on pull request #4319: HADOOP-18241. Move to JAVA 11.

2022-05-18 Thread GitBox
hadoop-yetus commented on PR #4319: URL: https://github.com/apache/hadoop/pull/4319#issuecomment-1130063364 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at https://ci-hadoop.apache.org/job

[GitHub] [hadoop] hadoop-yetus commented on pull request #4178: HDFS-16543. Keep default value of dfs.datanode.directoryscan.throttle.limit.ms.pe…

2022-05-18 Thread GitBox
hadoop-yetus commented on PR #4178: URL: https://github.com/apache/hadoop/pull/4178#issuecomment-1130042204 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Work logged] (HADOOP-18224) Upgrade maven compiler plugin to 3.10.1

2022-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18224?focusedWorklogId=771882&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-771882 ] ASF GitHub Bot logged work on HADOOP-18224: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4267: HADOOP-18224. Upgrade maven compiler plugin to 3.10.1

2022-05-18 Thread GitBox
hadoop-yetus commented on PR #4267: URL: https://github.com/apache/hadoop/pull/4267#issuecomment-1130041175 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Updated] (HADOOP-18244) Fix Hadoop-Common JavaDoc Error on branch-3.3

2022-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18244: Labels: pull-request-available (was: ) > Fix Hadoop-Common JavaDoc Error on branch-3.3 >

[jira] [Work logged] (HADOOP-18244) Fix Hadoop-Common JavaDoc Error on branch-3.3

2022-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18244?focusedWorklogId=771881&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-771881 ] ASF GitHub Bot logged work on HADOOP-18244: --- Author: ASF GitHub B

[GitHub] [hadoop] slfan1989 opened a new pull request, #4327: HADOOP-18244. Fix Hadoop-Common JavaDoc Error on branch-3.3

2022-05-18 Thread GitBox
slfan1989 opened a new pull request, #4327: URL: https://github.com/apache/hadoop/pull/4327 ### Description of PR JIRA : [HADOOP-18244. Fix Hadoop-Common JavaDoc Error on branch-3.3](https://issues.apache.org/jira/browse/HADOOP-18244) ### For code changes: Fix for Hadoop-Common

[jira] [Work logged] (HADOOP-18236) Remove duplicate locks in NetworkTopology

2022-05-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18236?focusedWorklogId=771875&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-771875 ] ASF GitHub Bot logged work on HADOOP-18236: --- Author: ASF GitHub B

[GitHub] [hadoop] Hexiaoqiao commented on pull request #4320: HADOOP-18236. Remove duplicate locks in NetworkTopology

2022-05-18 Thread GitBox
Hexiaoqiao commented on PR #4320: URL: https://github.com/apache/hadoop/pull/4320#issuecomment-1130021206 Thanks @ZanderXu for your proposal. Please reference HADOOP-16028, it will offer some more information about the read lock. -- This is an automated message from the Apache Git Service

[GitHub] [hadoop] Hexiaoqiao commented on pull request #4326: HDFS-16540. Addendum: Data locality is lost when DataNode pod restarts in kubernetes.

2022-05-18 Thread GitBox
Hexiaoqiao commented on PR #4326: URL: https://github.com/apache/hadoop/pull/4326#issuecomment-1130011537 cc @saintstack and @tomscut -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Resolved] (HADOOP-18198) Release Hadoop 3.3.3: hadoop-3.3.2 with some fixes

2022-05-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18198. - Fix Version/s: 3.3.3 Resolution: Fixed done! > Release Hadoop 3.3.3: hadoop-3.3

[GitHub] [hadoop] Hexiaoqiao opened a new pull request, #4326: HDFS-16540. Addendum: Data locality is lost when DataNode pod restarts in kubernetes.

2022-05-18 Thread GitBox
Hexiaoqiao opened a new pull request, #4326: URL: https://github.com/apache/hadoop/pull/4326 ### Description of PR remove unusually introduce file '.BUILDING.txt.swp'. ### How was this patch tested? No adding test since no source code changes. ### For code changes: - [Y

[GitHub] [hadoop] Hexiaoqiao commented on pull request #4246: HDFS-16540. Data locality is lost when DataNode pod restarts in kubernetes (#4170)

2022-05-18 Thread GitBox
Hexiaoqiao commented on PR #4246: URL: https://github.com/apache/hadoop/pull/4246#issuecomment-112819 I don't get what changes here. Maybe I missed something? Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Updated] (HADOOP-18243) Rebase s3a prefetching feature branch on top of trunk

2022-05-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18243: Summary: Rebase s3a prefetching feature branch on top of trunk (was: Rebase feature bran

[jira] [Commented] (HADOOP-18243) Rebase feature branch on top of trunk

2022-05-18 Thread Ahmar Suhail (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17538821#comment-17538821 ] Ahmar Suhail commented on HADOOP-18243: --- [~stev...@iseran.com], created this tick

[jira] (HADOOP-18243) Rebase feature branch on top of trunk

2022-05-18 Thread Ahmar Suhail (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18243 ] Ahmar Suhail deleted comment on HADOOP-18243: --- was (Author: JIRAUSER283484): [~stev...@iseran.com], created this ticket for rebasing, I'd like to own this if that sounds ok. Thanks for re

[GitHub] [hadoop] Hexiaoqiao commented on pull request #4170: HDFS-16540 Data locality is lost when DataNode pod restarts in kubern…

2022-05-18 Thread GitBox
Hexiaoqiao commented on PR #4170: URL: https://github.com/apache/hadoop/pull/4170#issuecomment-1129990002 Sorry for late response. Just found that this PR involved unrelated changes '.BUILDING.txt.swp' under root path of project. If no other concerns I would like to remove it for a while.

  1   2   >