Re: [PR] HADOOP-19575. ABFS: [FNSOverBlob] Add Distinct String In User Agent to Get Telemetry for FNS-Blob [hadoop]

2025-05-29 Thread via GitHub
manika137 commented on code in PR #7713: URL: https://github.com/apache/hadoop/pull/7713#discussion_r2115149106 ## hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/services/ITestAbfsClient.java: ## @@ -355,6 +356,25 @@ public void verifyUserAgentClusterType(

[jira] [Commented] (HADOOP-19575) ABFS: [FNSOverBlob] Add Distinct String In User Agent to Get Telemetry for FNS-Blob

2025-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17955104#comment-17955104 ] ASF GitHub Bot commented on HADOOP-19575: - manika137 commented on code in PR #7

Re: [PR] HADOOP-19580. [ABFS][BugFix][Bakport 3.4.2] IsNonEmptyDirectory Check should loop on listing using updated continuation token [hadoop]

2025-05-29 Thread via GitHub
anujmodi2021 commented on PR #7717: URL: https://github.com/apache/hadoop/pull/7717#issuecomment-2921085900 @steveloughran @ahmarsuhail We found this another bug in out internal testing. Let me know when to proceed with the merge. Would be good to have it as a part of 3.4.2. -- Thi

[jira] [Commented] (HADOOP-19580) ABFS: [FnsOverBlob][BugFix] IsNonEmptyDirectory Check should loop on listing using updated continuation token

2025-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17955081#comment-17955081 ] ASF GitHub Bot commented on HADOOP-19580: - anujmodi2021 commented on PR #7717:

[jira] [Commented] (HADOOP-19580) ABFS: [FnsOverBlob][BugFix] IsNonEmptyDirectory Check should loop on listing using updated continuation token

2025-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17955080#comment-17955080 ] ASF GitHub Bot commented on HADOOP-19580: - anujmodi2021 merged PR #7719: URL: h

Re: [PR] HADOOP-19580. [ABFS][BugFix][Backport 3.4] IsNonEmptyDirectory Check should loop on listing using updated continuation token [hadoop]

2025-05-29 Thread via GitHub
anujmodi2021 merged PR #7719: URL: https://github.com/apache/hadoop/pull/7719 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@

[jira] [Commented] (HADOOP-19569) S3A: stream write/close fails badly once FS is closed

2025-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17955064#comment-17955064 ] ASF GitHub Bot commented on HADOOP-19569: - hadoop-yetus commented on PR #7700:

Re: [PR] HADOOP-19569. S3A: stream write/close fails badly once FS is closed [hadoop]

2025-05-29 Thread via GitHub
hadoop-yetus commented on PR #7700: URL: https://github.com/apache/hadoop/pull/7700#issuecomment-2920818447 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-19580) ABFS: [FnsOverBlob][BugFix] IsNonEmptyDirectory Check should loop on listing using updated continuation token

2025-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17955043#comment-17955043 ] ASF GitHub Bot commented on HADOOP-19580: - hadoop-yetus commented on PR #7717:

Re: [PR] HADOOP-19580. [ABFS][BugFix][Bakport 3.4.2] IsNonEmptyDirectory Check should loop on listing using updated continuation token [hadoop]

2025-05-29 Thread via GitHub
hadoop-yetus commented on PR #7717: URL: https://github.com/apache/hadoop/pull/7717#issuecomment-2920487428 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-19580) ABFS: [FnsOverBlob][BugFix] IsNonEmptyDirectory Check should loop on listing using updated continuation token

2025-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17955030#comment-17955030 ] ASF GitHub Bot commented on HADOOP-19580: - hadoop-yetus commented on PR #7719:

Re: [PR] HADOOP-19580. [ABFS][BugFix][Backport 3.4] IsNonEmptyDirectory Check should loop on listing using updated continuation token [hadoop]

2025-05-29 Thread via GitHub
hadoop-yetus commented on PR #7719: URL: https://github.com/apache/hadoop/pull/7719#issuecomment-2920294985 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-19394) S3A Analytics Accelerator: vector IO support

2025-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17955019#comment-17955019 ] ASF GitHub Bot commented on HADOOP-19394: - hadoop-yetus commented on PR #7720:

Re: [PR] HADOOP-19394. Integrate with AAL's readVectored(). [hadoop]

2025-05-29 Thread via GitHub
hadoop-yetus commented on PR #7720: URL: https://github.com/apache/hadoop/pull/7720#issuecomment-2920168957 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-19394) S3A Analytics Accelerator: vector IO support

2025-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17955017#comment-17955017 ] ASF GitHub Bot commented on HADOOP-19394: - hadoop-yetus commented on PR #7720:

Re: [PR] HADOOP-19394. Integrate with AAL's readVectored(). [hadoop]

2025-05-29 Thread via GitHub
hadoop-yetus commented on PR #7720: URL: https://github.com/apache/hadoop/pull/7720#issuecomment-2920130212 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Created] (HADOOP-19581) Update PR template to ask about AI controbution

2025-05-29 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19581: --- Summary: Update PR template to ask about AI controbution Key: HADOOP-19581 URL: https://issues.apache.org/jira/browse/HADOOP-19581 Project: Hadoop Common

[jira] [Commented] (HADOOP-19394) S3A Analytics Accelerator: vector IO support

2025-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17955003#comment-17955003 ] ASF GitHub Bot commented on HADOOP-19394: - ahmarsuhail commented on code in PR

Re: [PR] HADOOP-19394. Integrate with AAL's readVectored(). [hadoop]

2025-05-29 Thread via GitHub
ahmarsuhail commented on code in PR #7720: URL: https://github.com/apache/hadoop/pull/7720#discussion_r2114283705 ## hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/impl/streams/AnalyticsStream.java: ## @@ -128,6 +139,33 @@ public int read(byte[] buf, int off, int

[jira] [Commented] (HADOOP-19394) S3A Analytics Accelerator: vector IO support

2025-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17955001#comment-17955001 ] ASF GitHub Bot commented on HADOOP-19394: - rajdchak commented on code in PR #77

Re: [PR] HADOOP-19394. Integrate with AAL's readVectored(). [hadoop]

2025-05-29 Thread via GitHub
rajdchak commented on code in PR #7720: URL: https://github.com/apache/hadoop/pull/7720#discussion_r2114280921 ## hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/impl/streams/AnalyticsStream.java: ## @@ -128,6 +139,33 @@ public int read(byte[] buf, int off, int le

Re: [PR] HADOOP-19394. Integrate with AAL's readVectored(). [hadoop]

2025-05-29 Thread via GitHub
rajdchak commented on code in PR #7720: URL: https://github.com/apache/hadoop/pull/7720#discussion_r2114280058 ## hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/impl/streams/AnalyticsStream.java: ## @@ -128,6 +139,33 @@ public int read(byte[] buf, int off, int le

[jira] [Commented] (HADOOP-19394) S3A Analytics Accelerator: vector IO support

2025-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17955002#comment-17955002 ] ASF GitHub Bot commented on HADOOP-19394: - rajdchak commented on code in PR #77

Re: [PR] HADOOP-19394. Integrate with AAL's readVectored(). [hadoop]

2025-05-29 Thread via GitHub
ahmarsuhail commented on PR #7720: URL: https://github.com/apache/hadoop/pull/7720#issuecomment-2919844852 @steveloughran @mukund-thakur could you please review this initial version, couple of small TODO's coming (more tests, and using the `release` readVectored() method), and will need a n

[jira] [Commented] (HADOOP-19394) S3A Analytics Accelerator: vector IO support

2025-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17954997#comment-17954997 ] ASF GitHub Bot commented on HADOOP-19394: - ahmarsuhail commented on PR #7720: U

[jira] [Commented] (HADOOP-19394) S3A Analytics Accelerator: vector IO support

2025-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17954996#comment-17954996 ] ASF GitHub Bot commented on HADOOP-19394: - ahmarsuhail opened a new pull reques

[jira] [Updated] (HADOOP-19394) S3A Analytics Accelerator: vector IO support

2025-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-19394: Labels: pull-request-available (was: ) > S3A Analytics Accelerator: vector IO support >

[PR] HADOOP-19394. Integrate with AAL's readVectored(). [hadoop]

2025-05-29 Thread via GitHub
ahmarsuhail opened a new pull request, #7720: URL: https://github.com/apache/hadoop/pull/7720 ### Description of PR This is the initial PR for readVectored(). TODO: * Add more tests in ITestS3AContractAnalyticsStreamVectoredRead * use the ```readVectored(List rang

[jira] [Commented] (HADOOP-19580) ABFS: [FnsOverBlob][BugFix] IsNonEmptyDirectory Check should loop on listing using updated continuation token

2025-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17954893#comment-17954893 ] ASF GitHub Bot commented on HADOOP-19580: - hadoop-yetus commented on PR #7717:

Re: [PR] HADOOP-19580. [ABFS][BugFix][Bakport 3.4.2] IsNonEmptyDirectory Check should loop on listing using updated continuation token [hadoop]

2025-05-29 Thread via GitHub
hadoop-yetus commented on PR #7717: URL: https://github.com/apache/hadoop/pull/7717#issuecomment-2918788060 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-19580) ABFS: [FnsOverBlob][BugFix] IsNonEmptyDirectory Check should loop on listing using updated continuation token

2025-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17954889#comment-17954889 ] ASF GitHub Bot commented on HADOOP-19580: - hadoop-yetus commented on PR #7719:

Re: [PR] HADOOP-19580. [ABFS][BugFix][Backport 3.4] IsNonEmptyDirectory Check should loop on listing using updated continuation token [hadoop]

2025-05-29 Thread via GitHub
hadoop-yetus commented on PR #7719: URL: https://github.com/apache/hadoop/pull/7719#issuecomment-2918753253 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-19580) ABFS: [FnsOverBlob][BugFix] IsNonEmptyDirectory Check should loop on listing using updated continuation token

2025-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17954885#comment-17954885 ] ASF GitHub Bot commented on HADOOP-19580: - anujmodi2021 opened a new pull reque

[PR] HADOOP-19580. [ABFS][BugFix][Backport 3.4] IsNonEmptyDirectory Check should loop on listing using updated continuation token [hadoop]

2025-05-29 Thread via GitHub
anujmodi2021 opened a new pull request, #7719: URL: https://github.com/apache/hadoop/pull/7719 ### Description of PR As part of recent change, loop over listing was added when checking if a directory is empty or not. Continuation token was not getting updated in subsequent listblob cal

Re: [PR] YARN-11822. Fix flaky unit test in TestFederationProtocolRecords [hadoop]

2025-05-29 Thread via GitHub
hadoop-yetus commented on PR #7718: URL: https://github.com/apache/hadoop/pull/7718#issuecomment-2918689262 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-19580) ABFS: [FnsOverBlob][BugFix] IsNonEmptyDirectory Check should loop on listing using updated continuation token

2025-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17954881#comment-17954881 ] ASF GitHub Bot commented on HADOOP-19580: - hadoop-yetus commented on PR #7717:

Re: [PR] HADOOP-19580. [ABFS][BugFix][Bakport 3.4.2] IsNonEmptyDirectory Check should loop on listing using updated continuation token [hadoop]

2025-05-29 Thread via GitHub
hadoop-yetus commented on PR #7717: URL: https://github.com/apache/hadoop/pull/7717#issuecomment-2918682504 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[PR] YARN-11822. Fix flaky unit test in TestFederationProtocolRecords [hadoop]

2025-05-29 Thread via GitHub
p-szucs opened a new pull request, #7718: URL: https://github.com/apache/hadoop/pull/7718 Change-Id: Ibf2c52efe20304bf5089e1aab160b20fb7f657b0 ### Description of PR TestFederationProtocolRecords.testSubClusterInfoEqual unit test fails intermittently. It looks like a

[jira] [Commented] (HADOOP-19580) ABFS: [FnsOverBlob][BugFix] IsNonEmptyDirectory Check should loop on listing using updated continuation token

2025-05-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17954877#comment-17954877 ] ASF GitHub Bot commented on HADOOP-19580: - anujmodi2021 opened a new pull reque

[PR] HADOOP-19580. [ABFS][BugFix][Bakport 3.4.2] IsNonEmptyDirectory Check should loop on listing using updated continuation token [hadoop]

2025-05-29 Thread via GitHub
anujmodi2021 opened a new pull request, #7717: URL: https://github.com/apache/hadoop/pull/7717 ### Description of PR As part of recent change, loop over listing was added when checking if a directory is empty or not. Continuation token was not getting updated in subsequent listblob cal