Re: [PR] YARN-11650. Refactoring variable names related multiNodePolicy in MultiNodePolicySpec, FiCaSchedulerApp and AbstractCSQueue [hadoop]

2024-01-24 Thread via GitHub
hadoop-yetus commented on PR #6490: URL: https://github.com/apache/hadoop/pull/6490#issuecomment-1909580764 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Resolved] (HADOOP-19039) Hadoop 3.4.0 Highlight big features and improvements.

2024-01-24 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan resolved HADOOP-19039. - Fix Version/s: 3.4.0 3.5.0 Hadoop Flags: Reviewed Target Ve

[jira] [Commented] (HADOOP-19039) Hadoop 3.4.0 Highlight big features and improvements.

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810734#comment-17810734 ] ASF GitHub Bot commented on HADOOP-19039: - slfan1989 merged PR #6462: URL: http

Re: [PR] HADOOP-19039. Hadoop 3.4.0 Highlight big features and improvements. [hadoop]

2024-01-24 Thread via GitHub
slfan1989 merged PR #6462: URL: https://github.com/apache/hadoop/pull/6462 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@had

[jira] [Commented] (HADOOP-19039) Hadoop 3.4.0 Highlight big features and improvements.

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810732#comment-17810732 ] ASF GitHub Bot commented on HADOOP-19039: - slfan1989 commented on PR #6462: URL

Re: [PR] HADOOP-19039. Hadoop 3.4.0 Highlight big features and improvements. [hadoop]

2024-01-24 Thread via GitHub
slfan1989 commented on PR #6462: URL: https://github.com/apache/hadoop/pull/6462#issuecomment-1909531875 @Hexiaoqiao Thank you for reviewing the code! all compilations have passed. I will merge this pr into the trunk branch. -- This is an automated message from the Apache Git Service. To

Re: [PR] YARN-11041. Replace all occurences of queuePath with the new QueuePath class - followup [hadoop]

2024-01-24 Thread via GitHub
brumi1024 commented on PR #5332: URL: https://github.com/apache/hadoop/pull/5332#issuecomment-1909465763 @slfan1989 thanks for checking! The issue is that the build was from December and #6433 was merged 2 weeks ago using a method with the old signature. Should be a one line change, @p-szuc

Re: [PR] HDFS-17354: Delay invoke clearStaleNamespacesInRouterStateIdContext during router start up [hadoop]

2024-01-24 Thread via GitHub
hadoop-yetus commented on PR #6498: URL: https://github.com/apache/hadoop/pull/6498#issuecomment-1909456547 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] YARN-11651. Fix UT TestQueueCapacityConfigParser compile error [hadoop]

2024-01-24 Thread via GitHub
hadoop-yetus commented on PR #6496: URL: https://github.com/apache/hadoop/pull/6496#issuecomment-1909431058 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] HDFS-17339:Skip cacheReport when one blockPool does not have CacheBlock on this DataNode [hadoop]

2024-01-24 Thread via GitHub
hadoop-yetus commented on PR #6456: URL: https://github.com/apache/hadoop/pull/6456#issuecomment-1909430980 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-19039) Hadoop 3.4.0 Highlight big features and improvements.

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810681#comment-17810681 ] ASF GitHub Bot commented on HADOOP-19039: - hadoop-yetus commented on PR #6462:

Re: [PR] HADOOP-19039. Hadoop 3.4.0 Highlight big features and improvements. [hadoop]

2024-01-24 Thread via GitHub
hadoop-yetus commented on PR #6462: URL: https://github.com/apache/hadoop/pull/6462#issuecomment-1909404785 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

Re: [PR] HDFS-17346. Fix DirectoryScanner check mark the normal blocks as corrupt [hadoop]

2024-01-24 Thread via GitHub
zhangshuyan0 commented on PR #6476: URL: https://github.com/apache/hadoop/pull/6476#issuecomment-1909350009 Committed to trunk. Thanks @haiyang1987 for your contribution and thanks @ZanderXu for your review. -- This is an automated message from the Apache Git Service. To respond to the me

Re: [PR] HDFS-17346. Fix DirectoryScanner check mark the normal blocks as corrupt [hadoop]

2024-01-24 Thread via GitHub
zhangshuyan0 merged PR #6476: URL: https://github.com/apache/hadoop/pull/6476 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@

[PR] HDFS-17354: Delay invoke clearStaleNamespacesInRouterStateIdContext during router start up [hadoop]

2024-01-24 Thread via GitHub
ThinkerLei opened a new pull request, #6498: URL: https://github.com/apache/hadoop/pull/6498 We should start clear expired namespace thread at RouterRpcServer RUNNING phase because StateStoreService is Initialized in initialization phase. Now, router will throw IoException when start up.

Re: [PR] Revert "YARN-11041. Replace all occurences of queuePath with the new QueuePath class - followup" [hadoop]

2024-01-24 Thread via GitHub
hadoop-yetus commented on PR #6497: URL: https://github.com/apache/hadoop/pull/6497#issuecomment-1909297732 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] YARN-11651. Fix UT TestQueueCapacityConfigParser compile error [hadoop]

2024-01-24 Thread via GitHub
yangjiandan closed pull request #6496: YARN-11651. Fix UT TestQueueCapacityConfigParser compile error URL: https://github.com/apache/hadoop/pull/6496 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] YARN-11651. Fix UT TestQueueCapacityConfigParser compile error [hadoop]

2024-01-24 Thread via GitHub
yangjiandan commented on PR #6496: URL: https://github.com/apache/hadoop/pull/6496#issuecomment-1909297358 YARN-11041 is reverted in https://github.com/apache/hadoop/pull/6497. So this mr can be close. -- This is an automated message from the Apache Git Service. To respond to the message

Re: [PR] Revert "YARN-11041. Replace all occurences of queuePath with the new QueuePath class - followup" [hadoop]

2024-01-24 Thread via GitHub
slfan1989 commented on PR #6497: URL: https://github.com/apache/hadoop/pull/6497#issuecomment-1909297213 @yangjiandan Thanks for reporting this issue! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] Revert "YARN-11041. Replace all occurences of queuePath with the new QueuePath class - followup" [hadoop]

2024-01-24 Thread via GitHub
yangjiandan commented on PR #6497: URL: https://github.com/apache/hadoop/pull/6497#issuecomment-1909295471 LGTM +1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubs

Re: [PR] Revert "YARN-11041. Replace all occurences of queuePath with the new QueuePath class - followup" [hadoop]

2024-01-24 Thread via GitHub
slfan1989 merged PR #6497: URL: https://github.com/apache/hadoop/pull/6497 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@had

[jira] [Commented] (HADOOP-19039) Hadoop 3.4.0 Highlight big features and improvements.

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810650#comment-17810650 ] ASF GitHub Bot commented on HADOOP-19039: - hadoop-yetus commented on PR #6462:

Re: [PR] YARN-11041. Replace all occurences of queuePath with the new QueuePath class - followup [hadoop]

2024-01-24 Thread via GitHub
slfan1989 commented on PR #5332: URL: https://github.com/apache/hadoop/pull/5332#issuecomment-1909293585 @brumi1024 I revert this change first, this pr causing YARN to fail to compile. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] HADOOP-19039. Hadoop 3.4.0 Highlight big features and improvements. [hadoop]

2024-01-24 Thread via GitHub
hadoop-yetus commented on PR #6462: URL: https://github.com/apache/hadoop/pull/6462#issuecomment-1909293366 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] YARN-11650. Refactoring variable names related multiNodePolicy in MultiNodePolicySpec, FiCaSchedulerApp and AbstractCSQueue [hadoop]

2024-01-24 Thread via GitHub
yangjiandan commented on PR #6490: URL: https://github.com/apache/hadoop/pull/6490#issuecomment-1909291218 The compilation error for TestQueueCapacityConfigParser is introduced by YARN-11041. I file a issue YARN-11651 to fix. -- This is an automated message from the Apache Git Servic

[jira] [Commented] (HADOOP-19039) Hadoop 3.4.0 Highlight big features and improvements.

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810648#comment-17810648 ] ASF GitHub Bot commented on HADOOP-19039: - hadoop-yetus commented on PR #6462:

Re: [PR] HADOOP-19039. Hadoop 3.4.0 Highlight big features and improvements. [hadoop]

2024-01-24 Thread via GitHub
hadoop-yetus commented on PR #6462: URL: https://github.com/apache/hadoop/pull/6462#issuecomment-1909288186 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] YARN-11651. Fix UT TestQueueCapacityConfigParser compile error [hadoop]

2024-01-24 Thread via GitHub
slfan1989 commented on PR #6496: URL: https://github.com/apache/hadoop/pull/6496#issuecomment-1909286466 Good Catch! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

Re: [PR] YARN-11041. Replace all occurences of queuePath with the new QueuePath class - followup [hadoop]

2024-01-24 Thread via GitHub
slfan1989 commented on PR #5332: URL: https://github.com/apache/hadoop/pull/5332#issuecomment-1909285974 @p-szucs @brumi1024 This seems to cause some issue. ``` [ERROR] /home/jenkins/jenkins-agent/workspace/hadoop-multibranch_PR-6462/ubuntu-focal/src/hadoop-yarn-project/hadoop-yarn

[jira] [Commented] (HADOOP-19039) Hadoop 3.4.0 Highlight big features and improvements.

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810644#comment-17810644 ] ASF GitHub Bot commented on HADOOP-19039: - hadoop-yetus commented on PR #6462:

Re: [PR] HADOOP-19039. Hadoop 3.4.0 Highlight big features and improvements. [hadoop]

2024-01-24 Thread via GitHub
hadoop-yetus commented on PR #6462: URL: https://github.com/apache/hadoop/pull/6462#issuecomment-1909285623 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-19050) Add S3 Access Grants Support in S3A

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810642#comment-17810642 ] ASF GitHub Bot commented on HADOOP-19050: - hadoop-yetus commented on PR #6495:

Re: [PR] HDFS-17351 Add support for AWS S3 Access Grants [hadoop]

2024-01-24 Thread via GitHub
hadoop-yetus commented on PR #6495: URL: https://github.com/apache/hadoop/pull/6495#issuecomment-1909281854 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[PR] YARN-11651. Fix UT TestQueueCapacityConfigParser compile error [hadoop]

2024-01-24 Thread via GitHub
yangjiandan opened a new pull request, #6496: URL: https://github.com/apache/hadoop/pull/6496 ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HAD

[jira] [Commented] (HADOOP-18656) ABFS: Support for Pagination in Recursive Directory Delete

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810640#comment-17810640 ] ASF GitHub Bot commented on HADOOP-18656: - saxenapranav commented on code in PR

Re: [PR] HADOOP-18656: [ABFS] Adding Support for Paginated Delete for Large Directories in HNS Account [hadoop]

2024-01-24 Thread via GitHub
saxenapranav commented on code in PR #6409: URL: https://github.com/apache/hadoop/pull/6409#discussion_r1465791387 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java: ## @@ -1053,12 +1053,24 @@ public AbfsRestOperation read(final St

[jira] [Commented] (HADOOP-19039) Hadoop 3.4.0 Highlight big features and improvements.

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810632#comment-17810632 ] ASF GitHub Bot commented on HADOOP-19039: - hadoop-yetus commented on PR #6462:

Re: [PR] HADOOP-19039. Hadoop 3.4.0 Highlight big features and improvements. [hadoop]

2024-01-24 Thread via GitHub
hadoop-yetus commented on PR #6462: URL: https://github.com/apache/hadoop/pull/6462#issuecomment-1909264001 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] YARN-11650. Refactoring variable names related multiNodePolicy in MultiNodePolicySpec, FiCaSchedulerApp and AbstractCSQueue [hadoop]

2024-01-24 Thread via GitHub
hadoop-yetus commented on PR #6490: URL: https://github.com/apache/hadoop/pull/6490#issuecomment-1909237131 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-19039) Hadoop 3.4.0 Highlight big features and improvements.

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810606#comment-17810606 ] ASF GitHub Bot commented on HADOOP-19039: - hadoop-yetus commented on PR #6462:

Re: [PR] HADOOP-19039. Hadoop 3.4.0 Highlight big features and improvements. [hadoop]

2024-01-24 Thread via GitHub
hadoop-yetus commented on PR #6462: URL: https://github.com/apache/hadoop/pull/6462#issuecomment-1909155546 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] YARN-11649. [Federation] Create Override for Maximum Resource Capability in getNewApplication [hadoop]

2024-01-24 Thread via GitHub
slfan1989 commented on code in PR #6481: URL: https://github.com/apache/hadoop/pull/6481#discussion_r1465687929 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/clientrm/FederationClientInterceptor.java: #

Re: [PR] YARN-11649. [Federation] Create Override for Maximum Resource Capability in getNewApplication [hadoop]

2024-01-24 Thread via GitHub
slfan1989 commented on code in PR #6481: URL: https://github.com/apache/hadoop/pull/6481#discussion_r1465687757 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/clientrm/FederationClientInterceptor.java: #

[jira] [Commented] (HADOOP-19044) AWS SDK V2 - Update S3A region logic

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810590#comment-17810590 ] ASF GitHub Bot commented on HADOOP-19044: - virajjasani commented on PR #6479: U

Re: [PR] HADOOP-19044. AWS SDK V2 - Update S3A region logic [hadoop]

2024-01-24 Thread via GitHub
virajjasani commented on PR #6479: URL: https://github.com/apache/hadoop/pull/6479#issuecomment-1909060235 Opened https://github.com/aws/aws-sdk-java-v2/issues/4846 Confirmed that the issue persists with the combination of `s3.amazonaws.com` endpoint and enabling cross-region access,

Re: [PR] HDFS-17353. Fix failing RBF module tests. [hadoop]

2024-01-24 Thread via GitHub
goiri commented on code in PR #6491: URL: https://github.com/apache/hadoop/pull/6491#discussion_r1465602892 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/test/java/org/apache/hadoop/hdfs/server/federation/router/TestRouterRpc.java: ## @@ -2074,9 +2074,6 @@ public void testMkdirsWit

Re: [PR] HDFS-17348. Enhance Log when checkLocations in RecoveryTaskStriped. [hadoop]

2024-01-24 Thread via GitHub
hadoop-yetus commented on PR #6485: URL: https://github.com/apache/hadoop/pull/6485#issuecomment-1908920445 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18679) Add API for bulk/paged object deletion

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810538#comment-17810538 ] ASF GitHub Bot commented on HADOOP-18679: - hadoop-yetus commented on PR #6494:

Re: [PR] HADOOP-18679. Add API for bulk/paged object deletion [hadoop]

2024-01-24 Thread via GitHub
hadoop-yetus commented on PR #6494: URL: https://github.com/apache/hadoop/pull/6494#issuecomment-1908768612 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-19050) Add S3 Access Grants Support in S3A

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810536#comment-17810536 ] ASF GitHub Bot commented on HADOOP-19050: - jxhan3 opened a new pull request, #6

[jira] [Updated] (HADOOP-19050) Add S3 Access Grants Support in S3A

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-19050: Labels: pull-request-available (was: ) > Add S3 Access Grants Support in S3A > -

[PR] HDFS-17351 Add support for AWS S3 Access Grants [hadoop]

2024-01-24 Thread via GitHub
jxhan3 opened a new pull request, #6495: URL: https://github.com/apache/hadoop/pull/6495 ### Description of PR Add support for AWS S3 Access Grants (https://aws.amazon.com/s3/features/access-grants/) ### How was this patch tested? Run the integration tests, including ass

[jira] [Commented] (HADOOP-18830) S3A: Cut S3 Select

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810524#comment-17810524 ] ASF GitHub Bot commented on HADOOP-18830: - steveloughran commented on PR #6144:

Re: [PR] HADOOP-18830. Cut S3 Select [hadoop]

2024-01-24 Thread via GitHub
steveloughran commented on PR #6144: URL: https://github.com/apache/hadoop/pull/6144#issuecomment-1908714315 @ahmarsuhail @mukund-thakur can I get this in? it'll help on test time... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

[jira] [Commented] (HADOOP-18679) Add API for bulk/paged object deletion

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810520#comment-17810520 ] ASF GitHub Bot commented on HADOOP-18679: - hadoop-yetus commented on PR #5993:

Re: [PR] HADOOP-18679. Add API for bulk/paged object deletion [hadoop]

2024-01-24 Thread via GitHub
hadoop-yetus commented on PR #5993: URL: https://github.com/apache/hadoop/pull/5993#issuecomment-1908677204 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] YARN-11639. CME and NPE in PriorityUtilizationQueueOrderingPolicy (#6… [hadoop]

2024-01-24 Thread via GitHub
hadoop-yetus commented on PR #6493: URL: https://github.com/apache/hadoop/pull/6493#issuecomment-1908594809 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18679) Add API for bulk/paged object deletion

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810499#comment-17810499 ] ASF GitHub Bot commented on HADOOP-18679: - steveloughran opened a new pull requ

[PR] HADOOP-18679. Add API for bulk/paged object deletion [hadoop]

2024-01-24 Thread via GitHub
steveloughran opened a new pull request, #6494: URL: https://github.com/apache/hadoop/pull/6494 A more minimal design that is easier to use and implement than #5993 Caller creates a BulkOperation; they get the page size of it and then submit batches to delete of less than that siz

[jira] [Commented] (HADOOP-19050) Add S3 Access Grants Support in S3A

2024-01-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810496#comment-17810496 ] Steve Loughran commented on HADOOP-19050: - this is going to keep you busy. Can

[jira] [Updated] (HADOOP-19050) Add S3 Access Grants Support in S3A

2024-01-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19050: Affects Version/s: 3.4.0 > Add S3 Access Grants Support in S3A >

[jira] [Resolved] (HADOOP-19046) S3A: update sdk versions

2024-01-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19046. - Fix Version/s: 3.5.0 Resolution: Fixed > S3A: update sdk versions >

[jira] [Commented] (HADOOP-14837) Handle S3A "glacier" data

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810477#comment-17810477 ] ASF GitHub Bot commented on HADOOP-14837: - hadoop-yetus commented on PR #6407:

Re: [PR] HADOOP-14837 : Support Read Restored Glacier Objects [hadoop]

2024-01-24 Thread via GitHub
hadoop-yetus commented on PR #6407: URL: https://github.com/apache/hadoop/pull/6407#issuecomment-1908429821 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

Re: [PR] YARN-11641. Fix getCapacityConfigurationTypeForQueues for absolute mode with zero resource. [hadoop]

2024-01-24 Thread via GitHub
hadoop-yetus commented on PR #6435: URL: https://github.com/apache/hadoop/pull/6435#issuecomment-1908385303 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] YARN-11639. CME and NPE in PriorityUtilizationQueueOrderingPolicy (#6… [hadoop]

2024-01-24 Thread via GitHub
hadoop-yetus commented on PR #6492: URL: https://github.com/apache/hadoop/pull/6492#issuecomment-1908379915 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-19039) Hadoop 3.4.0 Highlight big features and improvements.

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810446#comment-17810446 ] ASF GitHub Bot commented on HADOOP-19039: - slfan1989 commented on code in PR #6

Re: [PR] HADOOP-19039. Hadoop 3.4.0 Highlight big features and improvements. [hadoop]

2024-01-24 Thread via GitHub
slfan1989 commented on code in PR #6462: URL: https://github.com/apache/hadoop/pull/6462#discussion_r1465056105 ## hadoop-project/src/site/markdown/index.md.vm: ## @@ -15,103 +15,143 @@ Apache Hadoop ${project.version} -Apache Hadoop ${projec

Re: [PR] HADOOP-19039. Hadoop 3.4.0 Highlight big features and improvements. [hadoop]

2024-01-24 Thread via GitHub
slfan1989 commented on PR #6462: URL: https://github.com/apache/hadoop/pull/6462#issuecomment-1908314484 > @slfan1989 Thanks for your updates. Leave some nit comments inline. Do we need backport to banch-3.4 and branch-3.4.1? @Hexiaoqiao Thank you very much for reviewing the code! I

[jira] [Commented] (HADOOP-19039) Hadoop 3.4.0 Highlight big features and improvements.

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810443#comment-17810443 ] ASF GitHub Bot commented on HADOOP-19039: - slfan1989 commented on PR #6462: URL

Re: [PR] YARN-11041. Replace all occurences of queuePath with the new QueuePath class - followup [hadoop]

2024-01-24 Thread via GitHub
brumi1024 merged PR #5332: URL: https://github.com/apache/hadoop/pull/5332 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@had

Re: [PR] YARN-11041. Replace all occurences of queuePath with the new QueuePath class - followup [hadoop]

2024-01-24 Thread via GitHub
brumi1024 commented on code in PR #5332: URL: https://github.com/apache/hadoop/pull/5332#discussion_r1465016454 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/Capacit

Re: [PR] YARN-11041. Replace all occurences of queuePath with the new QueuePath class - followup [hadoop]

2024-01-24 Thread via GitHub
brumi1024 commented on PR #5332: URL: https://github.com/apache/hadoop/pull/5332#issuecomment-1908285588 Thanks @p-szucs for the patch, @szilard-nemeth for the review. I had one small comment but given the size of the commit and that it's long running already I don't think it's worth it to

Re: [PR] YARN-11641. Fix getCapacityConfigurationTypeForQueues for absolute mode with zero resource. [hadoop]

2024-01-24 Thread via GitHub
hadoop-yetus commented on PR #6435: URL: https://github.com/apache/hadoop/pull/6435#issuecomment-1908266142 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18656) ABFS: Support for Pagination in Recursive Directory Delete

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810417#comment-17810417 ] ASF GitHub Bot commented on HADOOP-18656: - anujmodi2021 commented on code in PR

Re: [PR] HADOOP-18656: [ABFS] Adding Support for Paginated Delete for Large Directories in HNS Account [hadoop]

2024-01-24 Thread via GitHub
anujmodi2021 commented on code in PR #6409: URL: https://github.com/apache/hadoop/pull/6409#discussion_r1464997079 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java: ## @@ -1053,12 +1053,24 @@ public AbfsRestOperation read(final St

[jira] [Commented] (HADOOP-18656) ABFS: Support for Pagination in Recursive Directory Delete

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810416#comment-17810416 ] ASF GitHub Bot commented on HADOOP-18656: - anujmodi2021 commented on code in PR

Re: [PR] HADOOP-18656: [ABFS] Adding Support for Paginated Delete for Large Directories in HNS Account [hadoop]

2024-01-24 Thread via GitHub
anujmodi2021 commented on code in PR #6409: URL: https://github.com/apache/hadoop/pull/6409#discussion_r1464996429 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AbfsConfiguration.java: ## @@ -1191,7 +1195,12 @@ public boolean getRenameResilience() {

Re: [PR] HADOOP-18656: [ABFS] Adding Support for Paginated Delete for Large Directories in HNS Account [hadoop]

2024-01-24 Thread via GitHub
anujmodi2021 commented on code in PR #6409: URL: https://github.com/apache/hadoop/pull/6409#discussion_r1464714707 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AbfsConfiguration.java: ## @@ -1191,7 +1195,12 @@ public boolean getRenameResilience() {

[jira] [Commented] (HADOOP-18656) ABFS: Support for Pagination in Recursive Directory Delete

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810411#comment-17810411 ] ASF GitHub Bot commented on HADOOP-18656: - anujmodi2021 commented on code in PR

[jira] [Commented] (HADOOP-18656) ABFS: Support for Pagination in Recursive Directory Delete

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810412#comment-17810412 ] ASF GitHub Bot commented on HADOOP-18656: - anujmodi2021 commented on code in PR

Re: [PR] HADOOP-18656: [ABFS] Adding Support for Paginated Delete for Large Directories in HNS Account [hadoop]

2024-01-24 Thread via GitHub
anujmodi2021 commented on code in PR #6409: URL: https://github.com/apache/hadoop/pull/6409#discussion_r1464989125 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java: ## @@ -1053,12 +1053,24 @@ public AbfsRestOperation read(final St

[jira] [Commented] (HADOOP-18656) ABFS: Support for Pagination in Recursive Directory Delete

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810381#comment-17810381 ] ASF GitHub Bot commented on HADOOP-18656: - saxenapranav commented on code in PR

[PR] YARN-11639. CME and NPE in PriorityUtilizationQueueOrderingPolicy (#6… [hadoop]

2024-01-24 Thread via GitHub
ferdelyi opened a new pull request, #6493: URL: https://github.com/apache/hadoop/pull/6493 …455) ### Description of PR Backporting [YARN-11639](https://issues.apache.org/jira/browse/YARN-11639) from trunk to branch-3.3. ### How was this patch tested? Run the unit

Re: [PR] HADOOP-18656: [ABFS] Adding Support for Paginated Delete for Large Directories in HNS Account [hadoop]

2024-01-24 Thread via GitHub
saxenapranav commented on code in PR #6409: URL: https://github.com/apache/hadoop/pull/6409#discussion_r1464894704 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AbfsConfiguration.java: ## @@ -1191,7 +1195,12 @@ public boolean getRenameResilience() {

[PR] YARN-11639. CME and NPE in PriorityUtilizationQueueOrderingPolicy (#6… [hadoop]

2024-01-24 Thread via GitHub
ferdelyi opened a new pull request, #6492: URL: https://github.com/apache/hadoop/pull/6492 …455) ### Description of PR Backporting YARN-11639 from trunk to branch-3.2. ### How was this patch tested? Run the unit test for the class. ### For code changes:

[jira] [Commented] (HADOOP-18656) ABFS: Support for Pagination in Recursive Directory Delete

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810370#comment-17810370 ] ASF GitHub Bot commented on HADOOP-18656: - hadoop-yetus commented on PR #6409:

Re: [PR] HADOOP-18656: [ABFS] Adding Support for Paginated Delete for Large Directories in HNS Account [hadoop]

2024-01-24 Thread via GitHub
hadoop-yetus commented on PR #6409: URL: https://github.com/apache/hadoop/pull/6409#issuecomment-1908060057 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-18656) ABFS: Support for Pagination in Recursive Directory Delete

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810327#comment-17810327 ] ASF GitHub Bot commented on HADOOP-18656: - anujmodi2021 commented on code in PR

Re: [PR] HADOOP-18656: [ABFS] Adding Support for Paginated Delete for Large Directories in HNS Account [hadoop]

2024-01-24 Thread via GitHub
anujmodi2021 commented on code in PR #6409: URL: https://github.com/apache/hadoop/pull/6409#discussion_r1464722105 ## hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/services/ITestAbfsPaginatedDelete.java: ## @@ -0,0 +1,279 @@ +/** + * Licensed to the Apach

[jira] [Commented] (HADOOP-18656) ABFS: Support for Pagination in Recursive Directory Delete

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810326#comment-17810326 ] ASF GitHub Bot commented on HADOOP-18656: - anujmodi2021 commented on code in PR

Re: [PR] HADOOP-18656: [ABFS] Adding Support for Paginated Delete for Large Directories in HNS Account [hadoop]

2024-01-24 Thread via GitHub
anujmodi2021 commented on code in PR #6409: URL: https://github.com/apache/hadoop/pull/6409#discussion_r1464716396 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java: ## @@ -1053,12 +1053,24 @@ public AbfsRestOperation read(final St

[jira] [Commented] (HADOOP-18656) ABFS: Support for Pagination in Recursive Directory Delete

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810325#comment-17810325 ] ASF GitHub Bot commented on HADOOP-18656: - anujmodi2021 commented on code in PR

Re: [PR] HADOOP-18656: [ABFS] Adding Support for Paginated Delete for Large Directories in HNS Account [hadoop]

2024-01-24 Thread via GitHub
anujmodi2021 commented on code in PR #6409: URL: https://github.com/apache/hadoop/pull/6409#discussion_r1464714707 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AbfsConfiguration.java: ## @@ -1191,7 +1195,12 @@ public boolean getRenameResilience() {

[jira] [Commented] (HADOOP-18656) ABFS: Support for Pagination in Recursive Directory Delete

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810322#comment-17810322 ] ASF GitHub Bot commented on HADOOP-18656: - anujmodi2021 commented on code in PR

[jira] [Commented] (HADOOP-18656) ABFS: Support for Pagination in Recursive Directory Delete

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810324#comment-17810324 ] ASF GitHub Bot commented on HADOOP-18656: - anujmodi2021 commented on code in PR

Re: [PR] HADOOP-18656: [ABFS] Adding Support for Paginated Delete for Large Directories in HNS Account [hadoop]

2024-01-24 Thread via GitHub
anujmodi2021 commented on code in PR #6409: URL: https://github.com/apache/hadoop/pull/6409#discussion_r1464712819 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java: ## @@ -1053,12 +1053,24 @@ public AbfsRestOperation read(final St

[jira] [Commented] (HADOOP-18656) ABFS: Support for Pagination in Recursive Directory Delete

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810323#comment-17810323 ] ASF GitHub Bot commented on HADOOP-18656: - anujmodi2021 commented on code in PR

Re: [PR] HADOOP-18656: [ABFS] Adding Support for Paginated Delete for Large Directories in HNS Account [hadoop]

2024-01-24 Thread via GitHub
anujmodi2021 commented on code in PR #6409: URL: https://github.com/apache/hadoop/pull/6409#discussion_r1464713380 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java: ## @@ -1053,12 +1053,24 @@ public AbfsRestOperation read(final St

Re: [PR] HADOOP-18656: [ABFS] Adding Support for Paginated Delete for Large Directories in HNS Account [hadoop]

2024-01-24 Thread via GitHub
anujmodi2021 commented on code in PR #6409: URL: https://github.com/apache/hadoop/pull/6409#discussion_r1464712357 ## hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/services/ITestAbfsPaginatedDelete.java: ## @@ -0,0 +1,279 @@ +/** + * Licensed to the Apach

  1   2   >