sumeetgajjar opened a new pull request #4465:
URL: https://github.com/apache/iceberg/pull/4465


   ### What changes were proposed in this pull request?
   
   Currently, HadoopFileIO is used to talk to azure blob storage. This PR 
introduces AzureFileIO which uses Azure native SDK to communicate with Azure 
blob storage.
   
   ### Does this PR introduce _any_ user-facing change?
   Yes, users can now configure the catalog `io-impl` property to 
`org.apache.iceberg.azure.blob.AzureBlobFileIO` to enable this feature.
   
   ### How was this patch tested?
   
   - Ran the newly added tests against [Azurite 
Emulator](https://docs.microsoft.com/en-us/azure/storage/common/storage-use-azurite?tabs=visual-studio)
   - Ran the newly added tests against Azure Blob Storage
   - Used newly added AzureFileIO to run queries on iceberg tables stored on 
azure using Spark


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to