[jira] [Updated] (HADOOP-18684) Fix S3A filesystem such that the scheme matches the URI scheme

2023-03-30 Thread Harshit Gupta (Jira)


 [ 
https://issues.apache.org/jira/browse/HADOOP-18684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Harshit Gupta updated HADOOP-18684:
---
Affects Version/s: 3.3.5

> Fix S3A filesystem such that the scheme matches the URI scheme
> --
>
> Key: HADOOP-18684
> URL: https://issues.apache.org/jira/browse/HADOOP-18684
> Project: Hadoop Common
>  Issue Type: Improvement
>Affects Versions: 3.3.5
>Reporter: Harshit Gupta
>Priority: Major
>  Labels: pull-request-available
>
> Certain codepaths use the FileContext API's to perform FS based operations 
> such as yarn log aggregations. While trying to reuse the S3A connector for 
> GCS based workloads the yarn log aggregation was not happening. Upon further 
> investigation it was observed that FileContext API have hardcoded URI scheme 
> checks that need to disabled/updated to make S3A compatible with non AWS 
> stores.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Updated] (HADOOP-18684) Fix S3A filesystem such that the scheme matches the URI scheme

2023-03-30 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/HADOOP-18684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated HADOOP-18684:

Labels: pull-request-available  (was: )

> Fix S3A filesystem such that the scheme matches the URI scheme
> --
>
> Key: HADOOP-18684
> URL: https://issues.apache.org/jira/browse/HADOOP-18684
> Project: Hadoop Common
>  Issue Type: Improvement
>Reporter: Harshit Gupta
>Priority: Major
>  Labels: pull-request-available
>
> Certain codepaths use the FileContext API's to perform FS based operations 
> such as yarn log aggregations. While trying to reuse the S3A connector for 
> GCS based workloads the yarn log aggregation was not happening. Upon further 
> investigation it was observed that FileContext API have hardcoded URI scheme 
> checks that need to disabled/updated to make S3A compatible with non AWS 
> stores.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org