[
https://issues.apache.org/jira/browse/HADOOP-19823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Fabbri updated HADOOP-19823:
----------------------------------
Description:
Requirements:
* Fix azure docs. Incorporate the patch from HADOOP-16893, removing the parts
that are ADL-specific.
* Deprecate in adl 3.6.0, remove in 3.7.0.
Details:
Currently there are two modules to access to Azure:
* hadoop-azure:
Supports Azure Blob Storage (ABFS/WASB) using these URI schemes:
* wasb:// and wasbs://
* abfs:// and abfss:// (new - Azure Data Lake Storage Gen2)
* hadoop-azure-datalake
This is the module to connect to Azure Data Lake Storage Gen1 with the URI
schema adl://.
Since 29 February 2024, Azure Data Lake Storage Gen1 is retired by Microsoft
and cannot be accessed:
[https://azure.microsoft.com/en-us/updates?id=action-required-switch-to-azure-data-lake-storage-gen2-by-29-february-2024]
I consider this module could be removed. This can reduce the maintenance
effort: tests, dependencies management, potential vulnerabilities, etc.
was:
Currently there are two modules to access to Azure:
* hadoop-azure:
Supports Azure Blob Storage (ABFS/WASB) using these URI schemes:
* wasb:// and wasbs://
* abfs:// and abfss:// (new - Azure Data Lake Storage Gen2)
* hadoop-azure-datalake
This is the module to connect to Azure Data Lake Storage Gen1 with the URI
schema adl://.
Since 29 February 2024, Azure Data Lake Storage Gen1 is retired by Microsoft
and cannot be accessed:
https://azure.microsoft.com/en-us/updates?id=action-required-switch-to-azure-data-lake-storage-gen2-by-29-february-2024
I consider this module could be removed. This can reduce the maintenance
effort: tests, dependencies management, potential vulnerabilities, etc.
> Remove hadoop-azure-datalake module
> -----------------------------------
>
> Key: HADOOP-19823
> URL: https://issues.apache.org/jira/browse/HADOOP-19823
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs/adl
> Reporter: Brais Couce
> Assignee: Aaron Fabbri
> Priority: Major
>
> Requirements:
> * Fix azure docs. Incorporate the patch from HADOOP-16893, removing the
> parts that are ADL-specific.
> * Deprecate in adl 3.6.0, remove in 3.7.0.
> Details:
> Currently there are two modules to access to Azure:
> * hadoop-azure:
> Supports Azure Blob Storage (ABFS/WASB) using these URI schemes:
> * wasb:// and wasbs://
> * abfs:// and abfss:// (new - Azure Data Lake Storage Gen2)
> * hadoop-azure-datalake
> This is the module to connect to Azure Data Lake Storage Gen1 with the URI
> schema adl://.
> Since 29 February 2024, Azure Data Lake Storage Gen1 is retired by Microsoft
> and cannot be accessed:
> [https://azure.microsoft.com/en-us/updates?id=action-required-switch-to-azure-data-lake-storage-gen2-by-29-february-2024]
> I consider this module could be removed. This can reduce the maintenance
> effort: tests, dependencies management, potential vulnerabilities, etc.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
