[GitHub] [hadoop] hadoop-yetus commented on pull request #4354: YARN-6539. Create SecureLogin inside Router.

2022-06-30 Thread GitBox
hadoop-yetus commented on PR #4354: URL: https://github.com/apache/hadoop/pull/4354#issuecomment-1171962470 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #4493: [Do not commit] Testing cross platform builds

2022-06-30 Thread GitBox
hadoop-yetus commented on PR #4493: URL: https://github.com/apache/hadoop/pull/4493#issuecomment-1171942717 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] yuanboliu commented on pull request #4198: YARN-11112 Avoid renewing delegation token when app is first submitte…

2022-06-30 Thread GitBox
yuanboliu commented on PR #4198: URL: https://github.com/apache/hadoop/pull/4198#issuecomment-1171925390 For those who's interesting in this patch: We provide this patch, because our production clusters are very large numbers, accessing data cross clusters is required. So verifying

[jira] [Work logged] (HADOOP-18323) Bump javax.ws.rs-api To Version 3.1.0

2022-06-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18323?focusedWorklogId=786926=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-786926 ] ASF GitHub Bot logged work on HADOOP-18323: --- Author: ASF GitHub Bot

[GitHub] [hadoop] virajjasani commented on pull request #4522: HADOOP-18323.Bump javax.ws.rs-api to 3.1.0

2022-06-30 Thread GitBox
virajjasani commented on PR #4522: URL: https://github.com/apache/hadoop/pull/4522#issuecomment-1171922394 Can we wait sometime for HADOOP-15984 to go through? It will take sometime but if we can bump javax.ws.rs-api after Jersey 2 upgrade, that would be less complex. Otherwise we anyways

[GitHub] [hadoop] yuanboliu commented on pull request #4198: YARN-11112 Avoid renewing delegation token when app is first submitte…

2022-06-30 Thread GitBox
yuanboliu commented on PR #4198: URL: https://github.com/apache/hadoop/pull/4198#issuecomment-1171921057 @slfan1989 Basically this thread is used for jobs to renew token from third-party service. RM_DELEGATIONTOKEN is generated from RM and it should be renewed from the client, not

[GitHub] [hadoop] yuanboliu commented on pull request #4198: YARN-11112 Avoid renewing delegation token when app is first submitte…

2022-06-30 Thread GitBox
yuanboliu commented on PR #4198: URL: https://github.com/apache/hadoop/pull/4198#issuecomment-1171917112 Sorry for the late reply [9uapaw](https://github.com/9uapaw) Using renewing to verify the validation of token is not very convincible, the invaild token will be rejected as soon as

[GitHub] [hadoop] hadoop-yetus commented on pull request #4493: [Do not commit] Testing cross platform builds

2022-06-30 Thread GitBox
hadoop-yetus commented on PR #4493: URL: https://github.com/apache/hadoop/pull/4493#issuecomment-1171847501 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Work logged] (HADOOP-18321) Fix when to read an additional record from a BZip2 text file split

2022-06-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18321?focusedWorklogId=786901=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-786901 ] ASF GitHub Bot logged work on HADOOP-18321: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4521: HADOOP-18321.Fix when to read an additional record from a BZip2 text file split

2022-06-30 Thread GitBox
hadoop-yetus commented on PR #4521: URL: https://github.com/apache/hadoop/pull/4521#issuecomment-1171818052 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] simbadzina opened a new pull request, #4523: HDFS-13522: Allow routers to use observer namenode without an msync on even read. [Not ready for review]

2022-06-30 Thread GitBox
simbadzina opened a new pull request, #4523: URL: https://github.com/apache/hadoop/pull/4523 ### Description of PR Allow routers to use observer namenode without an msync on even read. Is layered on top of the following two - https://github.com/apache/hadoop/pull/4311 -

[jira] [Comment Edited] (HADOOP-18324) Interrupting RPC Client calls can lead to thread exhaustion

2022-06-30 Thread Owen O'Malley (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561206#comment-17561206 ] Owen O'Malley edited comment on HADOOP-18324 at 6/30/22 11:00 PM: -- We

[jira] [Commented] (HADOOP-18324) Interrupting RPC Client calls can lead to thread exhaustion

2022-06-30 Thread Owen O'Malley (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561206#comment-17561206 ] Owen O'Malley commented on HADOOP-18324: We had a NameNode taken out with 10k threads of which

[jira] [Updated] (HADOOP-18324) Interrupting RPC Client calls can lead to thread exhaustion

2022-06-30 Thread Owen O'Malley (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-18324: --- Affects Version/s: 3.3.3 2.10.2 3.4.0 >

[jira] [Created] (HADOOP-18324) Interrupting RPC Client calls can lead to thread exhaustion

2022-06-30 Thread Owen O'Malley (Jira)
Owen O'Malley created HADOOP-18324: -- Summary: Interrupting RPC Client calls can lead to thread exhaustion Key: HADOOP-18324 URL: https://issues.apache.org/jira/browse/HADOOP-18324 Project: Hadoop

[jira] [Work logged] (HADOOP-18323) Bump javax.ws.rs-api To Version 3.1.0

2022-06-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18323?focusedWorklogId=786867=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-786867 ] ASF GitHub Bot logged work on HADOOP-18323: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-18323) Bump javax.ws.rs-api To Version 3.1.0

2022-06-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18323: Labels: pull-request-available (was: ) > Bump javax.ws.rs-api To Version 3.1.0 >

[GitHub] [hadoop] ashutoshcipher opened a new pull request, #4522: HADOOP-18323.Bump javax.ws.rs-api To Version 3.1.0

2022-06-30 Thread GitBox
ashutoshcipher opened a new pull request, #4522: URL: https://github.com/apache/hadoop/pull/4522 ### Description of PR Bump javax.ws.rs-api To Version 3.1.0 to mitigate [CVE-2020-15250](https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2020-15250) JIRA - HADOOP-18323 ###

[GitHub] [hadoop] hadoop-yetus commented on pull request #4493: [Do not commit] Testing cross platform builds

2022-06-30 Thread GitBox
hadoop-yetus commented on PR #4493: URL: https://github.com/apache/hadoop/pull/4493#issuecomment-1171740949 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Created] (HADOOP-18323) Bump javax.ws.rs-api To Version 3.1.0

2022-06-30 Thread Ashutosh Gupta (Jira)
Ashutosh Gupta created HADOOP-18323: --- Summary: Bump javax.ws.rs-api To Version 3.1.0 Key: HADOOP-18323 URL: https://issues.apache.org/jira/browse/HADOOP-18323 Project: Hadoop Common Issue

[jira] [Work logged] (HADOOP-18297) Upgrade dependency-check-maven to 7.1.1

2022-06-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18297?focusedWorklogId=786831=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-786831 ] ASF GitHub Bot logged work on HADOOP-18297: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ashutoshcipher commented on pull request #4449: HADOOP-18297. Upgrade dependency-check-maven to 7.1.1

2022-06-30 Thread GitBox
ashutoshcipher commented on PR #4449: URL: https://github.com/apache/hadoop/pull/4449#issuecomment-1171662801 > I triggered another build just to be sure. Thankd @jojochuang -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Work logged] (HADOOP-18297) Upgrade dependency-check-maven to 7.1.1

2022-06-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18297?focusedWorklogId=786825=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-786825 ] ASF GitHub Bot logged work on HADOOP-18297: --- Author: ASF GitHub Bot

[GitHub] [hadoop] jojochuang commented on pull request #4449: HADOOP-18297. Upgrade dependency-check-maven to 7.1.1

2022-06-30 Thread GitBox
jojochuang commented on PR #4449: URL: https://github.com/apache/hadoop/pull/4449#issuecomment-1171649778 I triggered another build just to be sure. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Work logged] (HADOOP-18242) ABFS Rename Failure when tracking metadata is in incomplete state

2022-06-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18242?focusedWorklogId=786821=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-786821 ] ASF GitHub Bot logged work on HADOOP-18242: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mukund-thakur commented on pull request #4517: HADOOP-18242. ABFS Rename Failure when tracking metadata is in an incomplete state

2022-06-30 Thread GitBox
mukund-thakur commented on PR #4517: URL: https://github.com/apache/hadoop/pull/4517#issuecomment-1171637381 Can you try now. Just add a dummy commit with one line addition somewhere. It should trigger Yetus. I think it should be fixed by now

[jira] [Commented] (HADOOP-18322) Yetus build failure in branch-3.3.

2022-06-30 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561170#comment-17561170 ] Mukund Thakur commented on HADOOP-18322: This was cause because of introduction of new module

[jira] [Work logged] (HADOOP-18321) Fix when to read an additional record from a BZip2 text file split

2022-06-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18321?focusedWorklogId=786815=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-786815 ] ASF GitHub Bot logged work on HADOOP-18321: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4521: HADOOP-18321.Fix when to read an additional record from a BZip2 text file split

2022-06-30 Thread GitBox
hadoop-yetus commented on PR #4521: URL: https://github.com/apache/hadoop/pull/4521#issuecomment-1171632416 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #4493: [Do not commit] Testing cross platform builds

2022-06-30 Thread GitBox
hadoop-yetus commented on PR #4493: URL: https://github.com/apache/hadoop/pull/4493#issuecomment-1171558699 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Updated] (HADOOP-18322) Yetus build failure in branch-3.3.

2022-06-30 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18322: --- Description: [ERROR] The build could not read 1 project -> [Help 1] [ERROR] [ERROR] The

[jira] (HADOOP-18322) Yetus build failure in branch-3.3.

2022-06-30 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18322 ] Mukund Thakur deleted comment on HADOOP-18322: was (Author: mthakur): [ERROR] The build could not read 1 project -> [Help 1] [ERROR] [ERROR] The project

[jira] [Commented] (HADOOP-18322) Yetus build failure in branch-3.3.

2022-06-30 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561133#comment-17561133 ] Mukund Thakur commented on HADOOP-18322: [ERROR] The build could not read 1 project -> [Help 1]

[jira] [Created] (HADOOP-18322) Yetus build failure in branch-3.3.

2022-06-30 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-18322: -- Summary: Yetus build failure in branch-3.3. Key: HADOOP-18322 URL: https://issues.apache.org/jira/browse/HADOOP-18322 Project: Hadoop Common Issue Type:

[jira] [Work logged] (HADOOP-18242) ABFS Rename Failure when tracking metadata is in incomplete state

2022-06-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18242?focusedWorklogId=786724=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-786724 ] ASF GitHub Bot logged work on HADOOP-18242: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mukund-thakur commented on pull request #4517: HADOOP-18242. ABFS Rename Failure when tracking metadata is in an incomplete state

2022-06-30 Thread GitBox
mukund-thakur commented on PR #4517: URL: https://github.com/apache/hadoop/pull/4517#issuecomment-1171478703 Yeah even I saw this later while trying to backport internally. But how come local branch-3.3 build is successful. -- This is an automated message from the Apache Git Service. To

[jira] [Updated] (HADOOP-18321) Fix when to read an additional record from a BZip2 text file split

2022-06-30 Thread Ashutosh Gupta (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Gupta updated HADOOP-18321: Description: Fix data correctness issue with TextInputFormat that can occur when reading

[jira] [Work logged] (HADOOP-18321) Fix when to read an additional record from a BZip2 text file split

2022-06-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18321?focusedWorklogId=786695=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-786695 ] ASF GitHub Bot logged work on HADOOP-18321: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-18321) Fix when to read an additional record from a BZip2 text file split

2022-06-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18321: Labels: pull-request-available (was: ) > Fix when to read an additional record from a

[GitHub] [hadoop] ashutoshcipher opened a new pull request, #4521: HADOOP-18321.Fix when to read an additional record from a BZip2 text file split

2022-06-30 Thread GitBox
ashutoshcipher opened a new pull request, #4521: URL: https://github.com/apache/hadoop/pull/4521 ### Description of PR Fix when to read an additional record from a BZip2 text file split JIRA - HADOOP-18321 ### How was this patch tested? Added Units ###

[jira] [Created] (HADOOP-18321) Fix when to read an additional record from a BZip2 text file split

2022-06-30 Thread Ashutosh Gupta (Jira)
Ashutosh Gupta created HADOOP-18321: --- Summary: Fix when to read an additional record from a BZip2 text file split Key: HADOOP-18321 URL: https://issues.apache.org/jira/browse/HADOOP-18321 Project:

[jira] [Work logged] (HADOOP-18320) Improve S3A delegations token documentation

2022-06-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18320?focusedWorklogId=786636=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-786636 ] ASF GitHub Bot logged work on HADOOP-18320: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4499: HADOOP-18320. Fixes typos in Delegation Tokens documentation.

2022-06-30 Thread GitBox
hadoop-yetus commented on PR #4499: URL: https://github.com/apache/hadoop/pull/4499#issuecomment-1171317710 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Comment Edited] (HADOOP-17196) Fix C/C++ standard warnings

2022-06-30 Thread Gautham Banasandra (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561073#comment-17561073 ] Gautham Banasandra edited comment on HADOOP-17196 at 6/30/22 2:34 PM:

[jira] [Commented] (HADOOP-17196) Fix C/C++ standard warnings

2022-06-30 Thread Gautham Banasandra (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561073#comment-17561073 ] Gautham Banasandra commented on HADOOP-17196: - [~iwasakims] could you add the flags only

[jira] [Work logged] (HADOOP-18180) Remove use of scala jar twitter util-core with java futures in S3A prefetching stream

2022-06-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18180?focusedWorklogId=786620=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-786620 ] ASF GitHub Bot logged work on HADOOP-18180: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4520: HADOOP-18180. Replaces ExecutorServicePool with ExecutorService

2022-06-30 Thread GitBox
hadoop-yetus commented on PR #4520: URL: https://github.com/apache/hadoop/pull/4520#issuecomment-1171295676 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #4515: YARN-10287.Update scheduler-conf corrupts the CS configuration when removing queue which is referred in queue mapping

2022-06-30 Thread GitBox
hadoop-yetus commented on PR #4515: URL: https://github.com/apache/hadoop/pull/4515#issuecomment-1171291431 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Work logged] (HADOOP-15327) Upgrade MR ShuffleHandler to use Netty4

2022-06-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15327?focusedWorklogId=786596=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-786596 ] ASF GitHub Bot logged work on HADOOP-15327: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3259: HADOOP-15327. Upgrade MR ShuffleHandler to use Netty4

2022-06-30 Thread GitBox
hadoop-yetus commented on PR #3259: URL: https://github.com/apache/hadoop/pull/3259#issuecomment-1171258423 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Work logged] (HADOOP-18180) Remove use of scala jar twitter util-core with java futures in S3A prefetching stream

2022-06-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18180?focusedWorklogId=786591=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-786591 ] ASF GitHub Bot logged work on HADOOP-18180: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ahmarsuhail commented on pull request #4520: HADOOP-18180. Replaces ExecutorServicePool with ExecutorService

2022-06-30 Thread GitBox
ahmarsuhail commented on PR #4520: URL: https://github.com/apache/hadoop/pull/4520#issuecomment-1171237660 Failing unit tests are fixed in https://github.com/apache/hadoop/pull/4386 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Work logged] (HADOOP-18180) Remove use of scala jar twitter util-core with java futures in S3A prefetching stream

2022-06-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18180?focusedWorklogId=786588=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-786588 ] ASF GitHub Bot logged work on HADOOP-18180: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4520: HADOOP-18180. Replaces ExecutorServicePool with ExecutorService

2022-06-30 Thread GitBox
hadoop-yetus commented on PR #4520: URL: https://github.com/apache/hadoop/pull/4520#issuecomment-1171236024 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Updated] (HADOOP-18320) Improve S3A delegations token documentation

2022-06-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18320: Labels: pull-request-available (was: ) > Improve S3A delegations token documentation >

[jira] [Work logged] (HADOOP-18320) Improve S3A delegations token documentation

2022-06-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18320?focusedWorklogId=786584=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-786584 ] ASF GitHub Bot logged work on HADOOP-18320: --- Author: ASF GitHub Bot

[GitHub] [hadoop] dannycjones commented on a diff in pull request #4499: HADOOP-18320. Fixes typos in Delegation Tokens documentation.

2022-06-30 Thread GitBox
dannycjones commented on code in PR #4499: URL: https://github.com/apache/hadoop/pull/4499#discussion_r911038139 ## hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/delegation_tokens.md: ## @@ -108,7 +108,7 @@ password-protected data opaque to clients; they contain

[jira] [Assigned] (HADOOP-18320) Improve S3A delegations token documentation

2022-06-30 Thread Daniel Carl Jones (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Carl Jones reassigned HADOOP-18320: -- Assignee: Ahmar Suhail > Improve S3A delegations token documentation >

[GitHub] [hadoop] hadoop-yetus commented on pull request #4519: HDFS-16646. [RBF] Supports an elastic RouterRpcFairnessPolicyController

2022-06-30 Thread GitBox
hadoop-yetus commented on PR #4519: URL: https://github.com/apache/hadoop/pull/4519#issuecomment-1171203116 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Created] (HADOOP-18320) Improve S3A delegations token documentation

2022-06-30 Thread Ahmar Suhail (Jira)
Ahmar Suhail created HADOOP-18320: - Summary: Improve S3A delegations token documentation Key: HADOOP-18320 URL: https://issues.apache.org/jira/browse/HADOOP-18320 Project: Hadoop Common

[jira] [Work logged] (HADOOP-18180) Remove use of scala jar twitter util-core with java futures in S3A prefetching stream

2022-06-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18180?focusedWorklogId=786549=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-786549 ] ASF GitHub Bot logged work on HADOOP-18180: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ahmarsuhail commented on a diff in pull request #4520: HADOOP-18180. Replaces ExecutorServicePool with ExecutorService

2022-06-30 Thread GitBox
ahmarsuhail commented on code in PR #4520: URL: https://github.com/apache/hadoop/pull/4520#discussion_r910969010 ## hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java: ## @@ -1573,7 +1560,7 @@ protected S3AReadOpContext createReadContext(

[jira] [Comment Edited] (HADOOP-18291) SingleFilePerBlockCache does not have a limit

2022-06-30 Thread Daniel Carl Jones (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561018#comment-17561018 ] Daniel Carl Jones edited comment on HADOOP-18291 at 6/30/22 12:26 PM:

[jira] [Commented] (HADOOP-18291) SingleFilePerBlockCache does not have a limit

2022-06-30 Thread Daniel Carl Jones (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17561018#comment-17561018 ] Daniel Carl Jones commented on HADOOP-18291: I would propose to move the disk caching

[jira] [Work logged] (HADOOP-18180) Remove use of scala jar twitter util-core with java futures in S3A prefetching stream

2022-06-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18180?focusedWorklogId=786539=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-786539 ] ASF GitHub Bot logged work on HADOOP-18180: --- Author: ASF GitHub Bot

[GitHub] [hadoop] dannycjones commented on a diff in pull request #4520: HADOOP-18180. Replaces ExecutorServicePool with ExecutorService

2022-06-30 Thread GitBox
dannycjones commented on code in PR #4520: URL: https://github.com/apache/hadoop/pull/4520#discussion_r910945935 ## hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java: ## @@ -1573,7 +1560,7 @@ protected S3AReadOpContext createReadContext(

[jira] [Work logged] (HADOOP-18215) Enhance WritableName to be able to return aliases for classes that use serializers

2022-06-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18215?focusedWorklogId=786532=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-786532 ] ASF GitHub Bot logged work on HADOOP-18215: --- Author: ASF GitHub Bot

[GitHub] [hadoop] bbeaudreault commented on pull request #4215: HADOOP-18215. Enhance WritableName to be able to return aliases for classes that use serializers

2022-06-30 Thread GitBox
bbeaudreault commented on PR #4215: URL: https://github.com/apache/hadoop/pull/4215#issuecomment-1171129088 @jojochuang thank you very much for taking a look. Are you sure you tested correctly? Adding back the `.asSubclass(Writable.class)` in WritableName and re-running the tests, I

[jira] [Work logged] (HADOOP-18180) Remove use of scala jar twitter util-core with java futures in S3A prefetching stream

2022-06-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18180?focusedWorklogId=786527=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-786527 ] ASF GitHub Bot logged work on HADOOP-18180: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ahmarsuhail opened a new pull request, #4520: HADOOP-18180. Replaces ExecutorServicePool with ExecutorService

2022-06-30 Thread GitBox
ahmarsuhail opened a new pull request, #4520: URL: https://github.com/apache/hadoop/pull/4520 ### Description of PR The `ExecutorServicePool` class was only submitting tasks to the `ExecutorService`. This PR removes `ExecutorServicePool` and submits directly to the

[GitHub] [hadoop] ZanderXu opened a new pull request, #4519: HDFS-16646. [RBF] Supports an elastic RouterRpcFairnessPolicyController

2022-06-30 Thread GitBox
ZanderXu opened a new pull request, #4519: URL: https://github.com/apache/hadoop/pull/4519 ### Description of PR As we all known, `StaticRouterRpcFairnessPolicyController` is very helpfully for RBF to minimize impact of clients connecting to healthy vs unhealthy nameNodes. But in

[GitHub] [hadoop] hadoop-yetus commented on pull request #4518: HDFS-16645. [JN] Bugfix: java.lang.IllegalStateException: Invalid log manifest

2022-06-30 Thread GitBox
hadoop-yetus commented on PR #4518: URL: https://github.com/apache/hadoop/pull/4518#issuecomment-1171081128 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18218) Ensure S3A prefetching stream memory consumption scales

2022-06-30 Thread Daniel Carl Jones (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17560980#comment-17560980 ] Daniel Carl Jones commented on HADOOP-18218: I'll scope this ticket down to focus on memory

[jira] [Updated] (HADOOP-18218) Ensure S3A prefetching stream memory consumption scales

2022-06-30 Thread Daniel Carl Jones (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Carl Jones updated HADOOP-18218: --- Summary: Ensure S3A prefetching stream memory consumption scales (was: Ensure S3A

[jira] [Updated] (HADOOP-18218) Ensure S3A prefetching stream memory and disk consumption scales

2022-06-30 Thread Daniel Carl Jones (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Carl Jones updated HADOOP-18218: --- Summary: Ensure S3A prefetching stream memory and disk consumption scales (was:

[GitHub] [hadoop] ZanderXu opened a new pull request, #4518: HDFS-16645. Bugfix: java.lang.IllegalStateException: Invalid log manifest

2022-06-30 Thread GitBox
ZanderXu opened a new pull request, #4518: URL: https://github.com/apache/hadoop/pull/4518 ### Description of PR ``` java.lang.IllegalStateException: Invalid log manifest (log [1-? (in-progress)] overlaps [6-? (in-progress)])[[6-? (in-progress)], [1-? (in-progress)]] CommittedTxId: 0

[GitHub] [hadoop] hadoop-yetus commented on pull request #4515: YARN-10287.Update scheduler-conf corrupts the CS configuration when removing queue which is referred in queue mapping

2022-06-30 Thread GitBox
hadoop-yetus commented on PR #4515: URL: https://github.com/apache/hadoop/pull/4515#issuecomment-1170884175 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #4354: YARN-6539. Create SecureLogin inside Router.

2022-06-30 Thread GitBox
hadoop-yetus commented on PR #4354: URL: https://github.com/apache/hadoop/pull/4354#issuecomment-1170882027 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #4516: YARN-9403.GET /apps/{appid}/entities/YARN_APPLICATION accesses application table instead of entity table

2022-06-30 Thread GitBox
hadoop-yetus commented on PR #4516: URL: https://github.com/apache/hadoop/pull/4516#issuecomment-1170833253 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] pan3793 commented on pull request #4229: HDFS-16453. Upgrade okhttp from 2.7.5 to 4.9.3

2022-06-30 Thread GitBox
pan3793 commented on PR #4229: URL: https://github.com/apache/hadoop/pull/4229#issuecomment-1170813260 okhttp 3.14.9 is the latest version which does not depend on kotlin -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Work logged] (HADOOP-18316) ABFS: Add support for cache handling when filesystem instance has clientCorrelationID enabled

2022-06-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18316?focusedWorklogId=786377=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-786377 ] ASF GitHub Bot logged work on HADOOP-18316: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4512: HADOOP-18316: Add support for cache handling when filesystem instance has clientCorrelationID enabled

2022-06-30 Thread GitBox
hadoop-yetus commented on PR #4512: URL: https://github.com/apache/hadoop/pull/4512#issuecomment-1170803431 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Work logged] (HADOOP-18242) ABFS Rename Failure when tracking metadata is in incomplete state

2022-06-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18242?focusedWorklogId=786375=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-786375 ] ASF GitHub Bot logged work on HADOOP-18242: --- Author: ASF GitHub Bot