GitHub user lhotari added a comment to the discussion: Replacing Apache JClouds with Apache OpenDAL in the tiered-storage module
It seems that Hadoop Cloud Storage could be a Java based alternative. The abstraction is the Hadoop FileSystem abstraction: https://hadoop.apache.org/docs/current/api/org/apache/hadoop/fs/FileSystem.html There are multiple implementations of the abstraction. It's not only S3, Azure and GCS, but many others. * S3: https://hadoop.apache.org/docs/current/api/org/apache/hadoop/fs/s3native/NativeS3FileSystem.html * GCS: https://issues.apache.org/jira/browse/HADOOP-19343 ([will be released in 3.5.0 very soon](https://lists.apache.org/thread/4ro2lhqtt6zwg77lfmgkmqkjtkr5x5vk)) * Azure: https://hadoop.apache.org/docs/current/api/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystemStore.html The 3.5.0 release will improve how the cloud storage modules are distributed: https://issues.apache.org/jira/browse/HADOOP-19696 GitHub link: https://github.com/apache/pulsar/discussions/25093#discussioncomment-15297365 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
