Hi,
I have a problem with accessing my own S3 system from within Flink when
running on Kubernetes.
*TL;DR* I have my own S3 (Ceph), Locally my application works, when running
in K8s it fails with
Caused by: com.amazonaws.SdkClientException: Unable to load credentials
from service endpoint
Caused
Hi Niels,
Glad to hear that you are trying Flink native K8s integration and share you
feedback.
What is causing the differences in behavior between local and in k8s? It
> works locally but not in the cluster.
In your case, the job could be executed successfully local. That means S3
endpoint cou
Hi,
As I mentioned in my original email I already verified that the endpoints
were accessible from the pods, that was not the problem.
It took me a while but I've figured out what went wrong.
Setting the configuration like I did
final Configuration conf = new Configuration();
conf.setString("pr
Hi Niels,
You are right. The S3 related configurations you have set in your `main()`
is only
applicable in the client side. Since the filesystem is initialized in the
entrypoint of
JM/TM for only once. AFAIK, we could not provide different credentials for
each
job in the same session cluster.
Bes
