[PR] HADOOP-19027. S3A: S3AInputStream doesn't recover from HTTP/channel exceptions [hadoop]

2025-10-01 Thread via GitHub
steveloughran opened a new pull request, #8003: URL: https://github.com/apache/hadoop/pull/8003 This is a fraction of #6425 backported to the V1 SDK, which does a lot of V2-specific translation/unwinding. 416 responses are mapped to RangeNotSatisfiableEOFException, whose retry

Re: [PR] HDFS-17364. EC: Configurably use WeakReferencedElasticByteBufferPool in DFSStripedInputStream. [hadoop]

2025-10-01 Thread via GitHub
github-actions[bot] commented on PR #6514: URL: https://github.com/apache/hadoop/pull/6514#issuecomment-3358594524 We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR

Re: [PR] HDFS-17839. Rename skips path without valid 'DirectoryWithQuotaFeature' in FSDirRenameOp [hadoop]

2025-10-01 Thread via GitHub
hadoop-yetus commented on PR #7989: URL: https://github.com/apache/hadoop/pull/7989#issuecomment-3358919898 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] HDFS-17374. EC: StripedBlockReader#newConnectedPeer should set SO_TIMEOUT and SO_KEEPALIVE [hadoop]

2025-10-01 Thread via GitHub
github-actions[bot] commented on PR #6536: URL: https://github.com/apache/hadoop/pull/6536#issuecomment-3358594329 We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR

[jira] [Commented] (HADOOP-19158) S3A: Support ByteBufferPositionedReadable through vector IO

2025-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18024117#comment-18024117 ] ASF GitHub Bot commented on HADOOP-19158: - steveloughran opened a new pull requ

[jira] [Commented] (HADOOP-19711) Upgrade hadoop3 docker scripts to 3.4.2

2025-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18024197#comment-18024197 ] ASF GitHub Bot commented on HADOOP-19711: - slfan1989 commented on code in PR #8

[jira] [Commented] (HADOOP-19712) S3A: Deadlock observed in IOStatistics EvaluatingStatisticsMap.entryset()

2025-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18024152#comment-18024152 ] ASF GitHub Bot commented on HADOOP-19712: - hadoop-yetus commented on PR #8006:

Re: [PR] Commit to remove vulnerabilities raised for: HADOOP-19074 [hadoop]

2025-10-01 Thread via GitHub
github-actions[bot] closed pull request #6586: Commit to remove vulnerabilities raised for: HADOOP-19074 URL: https://github.com/apache/hadoop/pull/6586 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Commented] (HADOOP-19074) Transitive dependencies with CVEs in Hadoop distro

2025-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18024176#comment-18024176 ] ASF GitHub Bot commented on HADOOP-19074: - github-actions[bot] closed pull requ

[jira] [Commented] (HADOOP-19711) Upgrade hadoop3 docker scripts to 3.4.2

2025-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18024198#comment-18024198 ] ASF GitHub Bot commented on HADOOP-19711: - slfan1989 commented on PR #8005: URL

Re: [PR] HADOOP-19711. Upgrade hadoop3 docker scripts to 3.4.2. [hadoop]

2025-10-01 Thread via GitHub
slfan1989 commented on PR #8005: URL: https://github.com/apache/hadoop/pull/8005#issuecomment-3358754054 > Thanks @slfan1989 for the patch. > > ``` > $ docker run -it --rm ghcr.io/slfan1989/hadoop:3.4.2 hadoop version > ... > Hadoop 3.4.2 > Source code repository https://gi

Re: [PR] HADOOP-19711. Upgrade hadoop3 docker scripts to 3.4.2. [hadoop]

2025-10-01 Thread via GitHub
slfan1989 commented on code in PR #8005: URL: https://github.com/apache/hadoop/pull/8005#discussion_r2396443322 ## Dockerfile: ## @@ -14,7 +14,7 @@ # limitations under the License. FROM apache/hadoop-runner -ARG HADOOP_URL=https://dlcdn.apache.org/hadoop/common/hadoop-3.4.1

Re: [PR] HDFS-17357. NioInetPeer.close() should close socket connection. [hadoop]

2025-10-01 Thread via GitHub
github-actions[bot] commented on PR #6502: URL: https://github.com/apache/hadoop/pull/6502#issuecomment-3358594624 We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR

Re: [PR] YARN-11654. [JDK17] TestLinuxContainerExecutorWithMocks.testStartLoca… [hadoop]

2025-10-01 Thread via GitHub
github-actions[bot] commented on PR #6528: URL: https://github.com/apache/hadoop/pull/6528#issuecomment-3358594431 We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR

Re: [PR] HADOOP-19158. S3A: Support ByteBufferPositionedReadable through vector IO [hadoop]

2025-10-01 Thread via GitHub
github-actions[bot] closed pull request #6773: HADOOP-19158. S3A: Support ByteBufferPositionedReadable through vector IO URL: https://github.com/apache/hadoop/pull/6773 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Commented] (HADOOP-19365) S3A Analytics-Accelerator: Add audit header support

2025-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18024143#comment-18024143 ] ASF GitHub Bot commented on HADOOP-19365: - hadoop-yetus commented on PR #7723:

[jira] [Commented] (HADOOP-19365) S3A Analytics-Accelerator: Add audit header support

2025-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18024112#comment-18024112 ] ASF GitHub Bot commented on HADOOP-19365: - ahmarsuhail opened a new pull reques

[jira] [Commented] (HADOOP-19282) S3A: STSClientFactory has hard-coded dependency on shaded HttpClient

2025-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18024120#comment-18024120 ] ASF GitHub Bot commented on HADOOP-19282: - steveloughran commented on PR #7966:

[jira] [Updated] (HADOOP-17629) TestRPC#testAuthorization fails

2025-10-01 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HADOOP-17629: Summary: TestRPC#testAuthorization fails (was: TestRPC#testAuthorization fails by ClassCastExcep

Re: [PR] HADOOP-19365. AAL support for auditing. [hadoop]

2025-10-01 Thread via GitHub
hadoop-yetus commented on PR #7723: URL: https://github.com/apache/hadoop/pull/7723#issuecomment-3358062914 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] HADOOP-19282. S3A: STSClientFactory: do not use URIBuilder [hadoop]

2025-10-01 Thread via GitHub
steveloughran commented on PR #7966: URL: https://github.com/apache/hadoop/pull/7966#issuecomment-3357668716 @LDVSOFT thanks for this -we never want to make those shaded libraries mandatory. If you can sort out the classpath of a leaner deployment -well done! Those test failures show

Re: [PR] HADOOP-19282. S3A: STSClientFactory: do not use URIBuilder [hadoop]

2025-10-01 Thread via GitHub
steveloughran merged PR #7966: URL: https://github.com/apache/hadoop/pull/7966 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...

[jira] [Commented] (HADOOP-19282) S3A: STSClientFactory has hard-coded dependency on shaded HttpClient

2025-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18024121#comment-18024121 ] ASF GitHub Bot commented on HADOOP-19282: - steveloughran commented on PR #7966:

Re: [PR] HADOOP-19282. S3A: STSClientFactory: do not use URIBuilder [hadoop]

2025-10-01 Thread via GitHub
steveloughran commented on PR #7966: URL: https://github.com/apache/hadoop/pull/7966#issuecomment-3357675340 also, have you an asf JIRA ID to assign the fix to you there? If not: request one and tell me what it is. -- This is an automated message from the Apache Git Service. To respond t

[jira] [Resolved] (HADOOP-19282) S3A: STSClientFactory has hard-coded dependency on shaded HttpClient

2025-10-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19282. - Fix Version/s: 3.5.0 Resolution: Fixed > S3A: STSClientFactory has hard-coded de

[jira] [Commented] (HADOOP-19282) S3A: STSClientFactory has hard-coded dependency on shaded HttpClient

2025-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18024119#comment-18024119 ] ASF GitHub Bot commented on HADOOP-19282: - steveloughran merged PR #7966: URL:

[jira] [Commented] (HADOOP-19574) Restore Subject propagation semantics for Java 22+

2025-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18024118#comment-18024118 ] ASF GitHub Bot commented on HADOOP-19574: - steveloughran commented on code in P

Re: [PR] HADOOP-19574. Restore Subject propagation semantics for Java 22+ [hadoop]

2025-10-01 Thread via GitHub
steveloughran commented on code in PR #7892: URL: https://github.com/apache/hadoop/pull/7892#discussion_r2395491126 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/Shell.java: ## @@ -36,6 +36,7 @@ import java.util.concurrent.atomic.AtomicBoolean;

[PR] HADOOP-19158. S3A: Support ByteBufferPositionedReadable through vector IO [hadoop]

2025-10-01 Thread via GitHub
steveloughran opened a new pull request, #6773: URL: https://github.com/apache/hadoop/pull/6773 HADOOP-19158. ### How was this patch tested? no tests; would need to move the hdfs one up to a contract test. ### For code changes: - [X] Does the title or t

[jira] [Commented] (HADOOP-19559) S3A: Analytics accelerator for S3 to be enabled by default

2025-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18024115#comment-18024115 ] ASF GitHub Bot commented on HADOOP-19559: - steveloughran commented on code in P

Re: [PR] HADOOP-19559: S3A Analytics-Accelerator Add IoStatistics support [hadoop]

2025-10-01 Thread via GitHub
steveloughran commented on code in PR #7763: URL: https://github.com/apache/hadoop/pull/7763#discussion_r2395468392 ## hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/ITestS3AAnalyticsAcceleratorStreamReading.java: ## @@ -194,4 +223,96 @@ public void testInvalidCo

[jira] [Commented] (HADOOP-19712) S3A: Deadlock observed in IOStatistics EvaluatingStatisticsMap.entryset()

2025-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18024110#comment-18024110 ] ASF GitHub Bot commented on HADOOP-19712: - steveloughran commented on PR #8006:

Re: [PR] HADOOP-19712 S3A: Deadlock in EvaluatingStatisticsMap.entryset() [hadoop]

2025-10-01 Thread via GitHub
steveloughran commented on PR #8006: URL: https://github.com/apache/hadoop/pull/8006#issuecomment-3357467095 tested s3 london args ` -Dparallel-tests -DtestsThreadCount=8 -Dscale` ``` [ERROR] Failures: [ERROR] ITestS3APrefetchingInputStream.testReadLargeFileFully:130 [Maxiumum na

[jira] [Updated] (HADOOP-19712) S3A: Deadlock observed in IOStatistics EvaluatingStatisticsMap.entryset()

2025-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-19712: Labels: pull-request-available (was: ) > S3A: Deadlock observed in IOStatistics Evaluati

[jira] [Commented] (HADOOP-19712) S3A: Deadlock observed in IOStatistics EvaluatingStatisticsMap.entryset()

2025-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18024107#comment-18024107 ] ASF GitHub Bot commented on HADOOP-19712: - steveloughran opened a new pull requ

[PR] HADOOP-19712 S3A: Deadlock in EvaluatingStatisticsMap.entryset() [hadoop]

2025-10-01 Thread via GitHub
steveloughran opened a new pull request, #8006: URL: https://github.com/apache/hadoop/pull/8006 Reworked how entrySet() and values() work, using .forEach() iterators after reviewing what ConcurrentHashMap does internally; it does a (safe) traverse. Add EvaluatingStatisticsMap.forE

[jira] [Created] (HADOOP-19712) S3A: Deadlock observed in IOStatistics EvaluatingStatisticsMap.entryset()

2025-10-01 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19712: --- Summary: S3A: Deadlock observed in IOStatistics EvaluatingStatisticsMap.entryset() Key: HADOOP-19712 URL: https://issues.apache.org/jira/browse/HADOOP-19712 Pro

Re: [PR] HDFS-17378: Add missing operationType for some operations in authorizer [hadoop]

2025-10-01 Thread via GitHub
hadoop-yetus commented on PR #6553: URL: https://github.com/apache/hadoop/pull/6553#issuecomment-3356601711 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[PR] HADOOP-19711. Upgrade hadoop3 docker scripts to 3.4.2. [hadoop]

2025-10-01 Thread via GitHub
slfan1989 opened a new pull request, #8005: URL: https://github.com/apache/hadoop/pull/8005 ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOO

[jira] [Updated] (HADOOP-19711) Upgrade hadoop3 docker scripts to 3.4.2

2025-10-01 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-19711: Affects Version/s: 3.4.2 (was: 3.5.0) > Upgrade hadoop3 docker scripts

Re: [PR] HADOOP-19654. Upgrade AWS SDK to 2.32.23 [hadoop]

2025-10-01 Thread via GitHub
ahmarsuhail commented on PR #7882: URL: https://github.com/apache/hadoop/pull/7882#issuecomment-3355348352 Just created https://github.com/aws/aws-sdk-java-v2/issues/6459 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] HDFS-17378: Add missing operationType for some operations in authorizer [hadoop]

2025-10-01 Thread via GitHub
sbernauer closed pull request #6553: HDFS-17378: Add missing operationType for some operations in authorizer URL: https://github.com/apache/hadoop/pull/6553 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to