Xin Hao created FLINK-27203:
-------------------------------
Summary: Add supports for uploading jars from object storage (s3,
gcs, oss)
Key: FLINK-27203
URL: https://issues.apache.org/jira/browse/FLINK-27203
Project: Flink
Issue Type: Improvement
Components: Kubernetes Operator
Reporter: Xin Hao
I think it will be efficient if we can read jars from object storage.
* We can detect the object storage provider by path scheme. (Such as: `gs://`
for GCS)
* Because the most cloud providers' SDK support native permission integration
with K8s, for example, the GCP, the user can bind the permission by service
accounts, and the code running in the K8s cluster will be simple `{{{}storage =
StorageOptions.getDefaultInstance().service{}}}`
* In this way, the users only need to bind the service accounts permissions
and don't need to handle volumes mount and jars initialize (download jars from
object storage into the volumes by themselves).
I think we can define the interface first and let the community help contribute
to the implementation for the different cloud providers.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
