Re: [PR] HADOOP-19424. [S3A] Upgrade JUnit from 4 to 5 in hadoop-aws. [hadoop]

2025-06-20 Thread via GitHub
hadoop-yetus commented on PR #7752: URL: https://github.com/apache/hadoop/pull/7752#issuecomment-2993360900 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

Re: [PR] HADOOP-19424. [S3A] Upgrade JUnit from 4 to 5 in hadoop-aws. [hadoop]

2025-06-20 Thread via GitHub
hadoop-yetus commented on PR #7752: URL: https://github.com/apache/hadoop/pull/7752#issuecomment-2993296851 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

Re: [PR] HADOOP-19431. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-distcp Part2. [hadoop]

2025-06-20 Thread via GitHub
slfan1989 merged PR #7747: URL: https://github.com/apache/hadoop/pull/7747 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@had

Re: [PR] YARN-11263. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-yarn-server-nodemanager Part3. [hadoop]

2025-06-20 Thread via GitHub
slfan1989 commented on PR #7748: URL: https://github.com/apache/hadoop/pull/7748#issuecomment-2993275199 @cnauroth @zhtttylz Thank you very much for the review! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

Re: [PR] HADOOP-19431. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-distcp Part2. [hadoop]

2025-06-20 Thread via GitHub
slfan1989 commented on PR #7747: URL: https://github.com/apache/hadoop/pull/7747#issuecomment-2993275045 @cnauroth @zhtttylz Thank you very much for the review! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[jira] [Commented] (HADOOP-19424) [S3A] Upgrade JUnit from 4 to 5 in hadoop-aws.

2025-06-20 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17985058#comment-17985058 ] Shilun Fan commented on HADOOP-19424: - [~ste...@apache.org] Thank you for your resp

Re: [PR] HADOOP-19424. [S3A] Upgrade JUnit from 4 to 5 in hadoop-aws. [hadoop]

2025-06-20 Thread via GitHub
slfan1989 commented on PR #7752: URL: https://github.com/apache/hadoop/pull/7752#issuecomment-2993263105 @steveloughran The JUnit 5 upgrade for the hadoop-aws module has been completed and is ready for review. I've also removed the dependency on JUnit 4. Let's take a look at the Yetus build

Re: [PR] HDFS-17800 Prevent observer node from returning partial block data for erasure coded files [hadoop]

2025-06-20 Thread via GitHub
hadoop-yetus commented on PR #7754: URL: https://github.com/apache/hadoop/pull/7754#issuecomment-2993187862 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] HADOOP-18568. magic committer optional cleanup [hadoop]

2025-06-20 Thread via GitHub
cnauroth commented on PR #7693: URL: https://github.com/apache/hadoop/pull/7693#issuecomment-2992642117 On trunk, we ran into a conflict with the recent JUnit 5 migration for the test file. I pushed up this change to add a required import: https://github.com/apache/hadoop/commit/9183

Re: [PR] HADOOP-18296. Memory fragmentation in ChecksumFileSystem readVectored() [hadoop]

2025-06-20 Thread via GitHub
cnauroth commented on code in PR #7732: URL: https://github.com/apache/hadoop/pull/7732#discussion_r2159563178 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/LocalFileSystemConfigKeys.java: ## @@ -42,5 +42,6 @@ public class LocalFileSystemConfigKeys ex

[jira] [Resolved] (HADOOP-18568) Magic Committer optional clean up

2025-06-20 Thread Chris Nauroth (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HADOOP-18568. Fix Version/s: 3.4.2 Hadoop Flags: Reviewed Assignee: Sayed Mohammad Hossein

Re: [PR] HADOOP-18568. magic committer optional cleanup [hadoop]

2025-06-20 Thread via GitHub
cnauroth commented on PR #7693: URL: https://github.com/apache/hadoop/pull/7693#issuecomment-2992545503 I committed this to trunk, branch-3.4 and branch-3.4.2. @blcksrx , thank you for the contribution. -- This is an automated message from the Apache Git Service. To respond to the message

Re: [PR] HADOOP-18568. magic committer optional cleanup [hadoop]

2025-06-20 Thread via GitHub
cnauroth closed pull request #7693: HADOOP-18568. magic committer optional cleanup URL: https://github.com/apache/hadoop/pull/7693 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

Re: [PR] HADOOP-18568. magic committer optional cleanup [hadoop]

2025-06-20 Thread via GitHub
cnauroth commented on code in PR #7693: URL: https://github.com/apache/hadoop/pull/7693#discussion_r2159520024 ## hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/committers.md: ## @@ -1058,3 +1059,20 @@ one of the following conditions are met 1. The committer is bein

[jira] [Updated] (HADOOP-19593) S3A: tests against third party stores failing after latest update & conditional

2025-06-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19593: Attachment: reports.zip > S3A: tests against third party stores failing after latest upda

[jira] [Updated] (HADOOP-19256) S3A: Support S3 Conditional Writes

2025-06-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19256: Description: S3 Conditional Write (Put-if-absent) capability is now generally available -

[jira] [Updated] (HADOOP-19256) S3A: Support S3 Conditional Writes

2025-06-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19256: Release Note: S3A client now uses S3 conditional overwrite PUT requests to perform overwr

[jira] [Updated] (HADOOP-19256) S3A: Support S3 Conditional Writes

2025-06-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19256: Release Note: S3A client now uses S3 conditional overwrite PUT requests to perform overwr

[PR] [HDFS-17800] Prevent observer node from returning partial block data for erasure coded files [hadoop]

2025-06-20 Thread via GitHub
Kimahriman opened a new pull request, #7754: URL: https://github.com/apache/hadoop/pull/7754 ### Description of PR https://issues.apache.org/jira/browse/HDFS-17800 Follow up to https://issues.apache.org/jira/browse/HDFS-13924, https://issues.apache.org/jira/browse/HDFS-1673

[jira] [Updated] (HADOOP-19593) S3A: tests against third party stores failing after latest update & conditional creation

2025-06-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19593: Summary: S3A: tests against third party stores failing after latest update & conditional

Re: [PR] [HDFS-17800] Prevent observer node from returning partial block data for erasure coded files [hadoop]

2025-06-20 Thread via GitHub
Kimahriman commented on code in PR #7754: URL: https://github.com/apache/hadoop/pull/7754#discussion_r2159477891 ## hadoop-hdfs-project/hadoop-hdfs/pom.xml: ## @@ -261,6 +261,11 @@ https://maven.apache.org/xsd/maven-4.0.0.xsd";> junit-platform-launcher test +

Re: [PR] HADOOP-19576: Disable Purging Pending MPUs Before Directory Purge [hadoop]

2025-06-20 Thread via GitHub
steveloughran commented on PR #7722: URL: https://github.com/apache/hadoop/pull/7722#issuecomment-2991830195 @ahmarsuhail conflicts in multipart uploads are failing, just reporting the error in the xml response, not http error codes. we have to map 200 + error=precondition into the 412 exce

[jira] [Created] (HADOOP-19593) S3A: tests against third party stores failing after latest update & conditional

2025-06-20 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19593: --- Summary: S3A: tests against third party stores failing after latest update & conditional Key: HADOOP-19593 URL: https://issues.apache.org/jira/browse/HADOOP-19593

[jira] [Commented] (HADOOP-19424) [S3A] Upgrade JUnit from 4 to 5 in hadoop-aws.

2025-06-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17985006#comment-17985006 ] Steve Loughran commented on HADOOP-19424: - ok. I'm away next week, so will take

[jira] [Updated] (HADOOP-19256) S3A: Support S3 Conditional Writes

2025-06-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19256: Description: S3 Conditional Write (Put-if-absent) capability is now generally available -

Re: [PR] YARN-11828. Non-exclusive resource allocation respect queue's max capacity [hadoop]

2025-06-20 Thread via GitHub
hadoop-yetus commented on PR #7753: URL: https://github.com/apache/hadoop/pull/7753#issuecomment-2991968453 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Updated] (HADOOP-15760) Upgrade commons-collections to commons-collections4

2025-06-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15760: Release Note: Hadoop has upgraded to commons-collections4-4.4. This MUST be on the class

[jira] [Updated] (HADOOP-15760) Upgrade commons-collections to commons-collections4

2025-06-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15760: Description: Switch to Apache Commons Collections 4 library was:Please allow for use

[PR] YARN-11828. Non-exclusive resource allocation respect queue's max cap… [hadoop]

2025-06-20 Thread via GitHub
liubin101 opened a new pull request, #7753: URL: https://github.com/apache/hadoop/pull/7753 ### Description of PR Now when doing non-exclusive resource allocation, queue's max capacity on the partition will be considered to be 100%. In an ideal situation, preemption policy will reclaim r