[jira] [Commented] (HADOOP-19197) S3A: Support AWS KMS Encryption Context

2024-06-18 Thread Junping Du (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17856136#comment-17856136 ] Junping Du commented on HADOOP-19197: - The fix passed the CI and make sense from a

[jira] [Commented] (HADOOP-18562) New configuration for static headers to be added to all S3 requests

2024-06-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17856063#comment-17856063 ] ASF GitHub Bot commented on HADOOP-18562: - PradhanPrerak commented on code in P

Re: [PR] [HADOOP-18562]: Override S3 Client in Spark Write/Read calls [hadoop]

2024-06-18 Thread via GitHub
PradhanPrerak commented on code in PR #6550: URL: https://github.com/apache/hadoop/pull/6550#discussion_r1644804835 ## hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/impl/AWSClientConfig.java: ## @@ -407,6 +413,48 @@ private static void initSigner(Configuration c

[jira] [Commented] (HADOOP-19205) S3A initialization/close slower than with v1 SDK

2024-06-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17856059#comment-17856059 ] ASF GitHub Bot commented on HADOOP-19205: - hadoop-yetus commented on PR #6892:

Re: [PR] HADOOP-19205. S3A: initialization/close slower than with v1 SDK [hadoop]

2024-06-18 Thread via GitHub
hadoop-yetus commented on PR #6892: URL: https://github.com/apache/hadoop/pull/6892#issuecomment-2176903980 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] [DRAFT] Jackson 2.14 [hadoop]

2024-06-18 Thread via GitHub
hadoop-yetus commented on PR #6761: URL: https://github.com/apache/hadoop/pull/6761#issuecomment-2176875839 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-19187) ABFS: [FnsOverBlob]Making AbfsClient Abstract for supporting both DFS and Blob Endpoint

2024-06-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17856056#comment-17856056 ] ASF GitHub Bot commented on HADOOP-19187: - hadoop-yetus commented on PR #6879:

Re: [PR] HADOOP-19187: [ABFS][FNSOverBlob] Making AbfsClient Abstract for supporting both DFS and Blob Endpoint [hadoop]

2024-06-18 Thread via GitHub
hadoop-yetus commented on PR #6879: URL: https://github.com/apache/hadoop/pull/6879#issuecomment-2176865061 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] HDFS-17546. Implementing HostsFileReader timeout (#6873) [hadoop]

2024-06-18 Thread via GitHub
ctrezzo commented on PR #6891: URL: https://github.com/apache/hadoop/pull/6891#issuecomment-2176655680 @NyteKnight can you take a look at the new spot bugs warning? It looks like it is complaining about an unchecked conversion. -- This is an automated message from the Apache Git Service.

[jira] [Updated] (HADOOP-18610) ABFS OAuth2 Token Provider to support Azure Workload Identity for AKS

2024-06-18 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18610: --- Fix Version/s: 3.3.9 3.4.1 > ABFS OAuth2 Token Provider to support Azure

[jira] [Commented] (HADOOP-18610) ABFS OAuth2 Token Provider to support Azure Workload Identity for AKS

2024-06-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17856012#comment-17856012 ] ASF GitHub Bot commented on HADOOP-18610: - mukund-thakur merged PR #6881: URL:

[jira] [Commented] (HADOOP-18610) ABFS OAuth2 Token Provider to support Azure Workload Identity for AKS

2024-06-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17856011#comment-17856011 ] ASF GitHub Bot commented on HADOOP-18610: - mukund-thakur commented on PR #6881:

Re: [PR] HADOOP-18610: [ABFS] [Backport to 3.4] OAuth2 Token Provider support for Azure Workload Identity [hadoop]

2024-06-18 Thread via GitHub
mukund-thakur merged PR #6881: URL: https://github.com/apache/hadoop/pull/6881 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...

Re: [PR] HADOOP-18610: [ABFS] [Backport to 3.4] OAuth2 Token Provider support for Azure Workload Identity [hadoop]

2024-06-18 Thread via GitHub
mukund-thakur commented on PR #6881: URL: https://github.com/apache/hadoop/pull/6881#issuecomment-2176610041 We don't need to wait but please create a tracking jira and mention here. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

[jira] [Commented] (HADOOP-18562) New configuration for static headers to be added to all S3 requests

2024-06-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17856005#comment-17856005 ] ASF GitHub Bot commented on HADOOP-18562: - PradhanPrerak commented on code in P

Re: [PR] [HADOOP-18562]: Override S3 Client in Spark Write/Read calls [hadoop]

2024-06-18 Thread via GitHub
PradhanPrerak commented on code in PR #6550: URL: https://github.com/apache/hadoop/pull/6550#discussion_r1644804835 ## hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/impl/AWSClientConfig.java: ## @@ -407,6 +413,48 @@ private static void initSigner(Configuration c

[jira] [Commented] (HADOOP-18708) AWS SDK V2 - Implement CSE

2024-06-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855996#comment-17855996 ] ASF GitHub Bot commented on HADOOP-18708: - steveloughran commented on PR #6884:

Re: [PR] HADOOP-18708: Support S3 Client Side Encryption(CSE) With AWS SDK V2 [hadoop]

2024-06-18 Thread via GitHub
steveloughran commented on PR #6884: URL: https://github.com/apache/hadoop/pull/6884#issuecomment-2176553207 #6892 is the draft pr with lazy creation; a new s3 client would go in there, but ideally we'd actually push the listing/transformation code into S3AStore so the extra client would ne

Re: [PR] HDFS-17439. Support -nonSuperUser for NNThroughputBenchmark: useful f… [hadoop]

2024-06-18 Thread via GitHub
sodonnel merged PR #6677: URL: https://github.com/apache/hadoop/pull/6677 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@hado

Re: [PR] HDFS-17546. Implementing HostsFileReader timeout (#6873) [hadoop]

2024-06-18 Thread via GitHub
hadoop-yetus commented on PR #6891: URL: https://github.com/apache/hadoop/pull/6891#issuecomment-2175850768 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] HADOOP-19187: [ABFS][FNSOverBlob] Making AbfsClient Abstract for supporting both DFS and Blob Endpoint [hadoop]

2024-06-18 Thread via GitHub
hadoop-yetus commented on PR #6879: URL: https://github.com/apache/hadoop/pull/6879#issuecomment-2175760825 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Updated] (HADOOP-19187) ABFS: [FnsOverBlob]Making AbfsClient Abstract for supporting both DFS and Blob Endpoint

2024-06-18 Thread Anuj Modi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anuj Modi updated HADOOP-19187: --- Summary: ABFS: [FnsOverBlob]Making AbfsClient Abstract for supporting both DFS and Blob Endpoint (

[jira] [Assigned] (HADOOP-19207) ABFS: [FnsOverBlob]Response Handling of Blob Endpoint APIs and Metadata APIs

2024-06-18 Thread Anuj Modi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anuj Modi reassigned HADOOP-19207: -- Assignee: Anuj Modi > ABFS: [FnsOverBlob]Response Handling of Blob Endpoint APIs and Metadat

[jira] [Commented] (HADOOP-19187) ABFS: [FnsOverBlob]Making AbfsClient Abstract for supporting both DFS and Blob Endpoint

2024-06-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855866#comment-17855866 ] ASF GitHub Bot commented on HADOOP-19187: - hadoop-yetus commented on PR #6879:

[jira] [Created] (HADOOP-19207) ABFS: [FnsOverBlob]Response Handling of Blob Endpoint APIs and Metadata APIs

2024-06-18 Thread Anuj Modi (Jira)
Anuj Modi created HADOOP-19207: -- Summary: ABFS: [FnsOverBlob]Response Handling of Blob Endpoint APIs and Metadata APIs Key: HADOOP-19207 URL: https://issues.apache.org/jira/browse/HADOOP-19207 Project: H

[jira] [Commented] (HADOOP-19187) ABFS: Making AbfsClient Abstract for supporting both DFS and Blob Endpoint

2024-06-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855843#comment-17855843 ] ASF GitHub Bot commented on HADOOP-19187: - hadoop-yetus commented on PR #6879:

Re: [PR] HADOOP-19187: [ABFS][FNSOverBlob] Making AbfsClient Abstract for supporting both DFS and Blob Endpoint [hadoop]

2024-06-18 Thread via GitHub
hadoop-yetus commented on PR #6879: URL: https://github.com/apache/hadoop/pull/6879#issuecomment-2175622014 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] HDFS-17545. [ARR] router async rpc client. [hadoop]

2024-06-18 Thread via GitHub
KeeProMise commented on code in PR #6871: URL: https://github.com/apache/hadoop/pull/6871#discussion_r1643993096 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/RouterRpcServer.java: ## @@ -428,6 +456,25 @@ public RouterRpcSer

Re: [PR] HDFS-17545. [ARR] router async rpc client. [hadoop]

2024-06-18 Thread via GitHub
hfutatzhanghb commented on code in PR #6871: URL: https://github.com/apache/hadoop/pull/6871#discussion_r1643984134 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/RouterRpcServer.java: ## @@ -428,6 +456,25 @@ public RouterRpc