Re: Questions on Restarting a Flink Application from a savepoint or checkpoint

2023-07-21 Thread Gyula Fóra
"One customization we did was to have the job-submitter pod search for the latest checkpoint or savepoint in S3 and then submit this information with the Flink job to the Flink cluster" I am aware that the Google operator does not support redeploying from last checkpoint it always uses savepoint

Re: Questions on Restarting a Flink Application from a savepoint or checkpoint

2023-07-21 Thread Tony Chen
For context, we have forked the GoogleCloudPlatform operator ( https://github.com/GoogleCloudPlatform/flink-on-k8s-operator), and we have customized it a bit to fit our use cases here. One customization we did was to have the job-submitter pod search for the latest checkpoint or savepoint in S3

Re: [DISCUSS] Status of Statefun Project

2023-07-21 Thread Filip Karnicki
This is great news, as we're using statefun as well. Please don't hesitate to let me know if you need me to do some additional testing on a real life prod-like setup. On Sat, 24 Jun 2023 at 18:41, Galen Warren via user wrote: > Great -- thanks! > > I'm going to be out of town for about a week

Re: flink configuration in flink kubernetes operator question about password

2023-07-21 Thread tian tian
Like s3.secret-key, the plaintext password cannot be directly written in the configuration. Is there a template language like jinja that can be replaced after mounting to the pod? >

flink configuration in flink kubernetes operator question about password

2023-07-21 Thread tian tian
hi all, How to specify the password and other information that needs to be encrypted in the configuration file?

Re: How to define imagePullSecrets with k8s operator to fetch image using FlinkDeploymentSpec

2023-07-21 Thread Gyula Fóra
Hi! We don't have imagePullSecrets as part of the FlinkDeplyomentSpec at the moment, however you can simply use the following built in Flink configuration: https://nightlies.apache.org/flink/flink-docs-release-1.16/docs/deployment/config/#kubernetes-container-image-pull-secrets

退订

2023-07-21 Thread XJ Li
退订

TCP server socket with Kubernetes Cluster

2023-07-21 Thread Kamal Mittal via user
Hello, Created a TCP server socket single source function and it is opened on a single POD (taskmanager) of Kubernetes cluster out of a set of PODs (taskmanager) by Flink. Is there any way to know on which POD (taskmanager) it is opened? Does Flink gives any such information? This is needed

How to define imagePullSecrets with k8s operator to fetch image using FlinkDeploymentSpec

2023-07-21 Thread Rajat Ahuja
Hi Flink Experts, When I need to fetch a customer Docker image (built on top of Flink 1.17 to add connectors or SQL code) from our organization's private registry using *K8s operator, it fails with the error. Although image is present on repo, and able to pull on my local machine after pushing to