How to open a Prometheus metrics port on the rest service when using the Kubernetes operator?

I am migrating my Flink app from standalone Kubernetes to the Kubernetes operator, it is going well but I ran into a problem, I can not figure out how to open a Prometheus metrics port in the rest-service to collect all my custom metrics from the task managers. Note that this is different from the

Re: Deploying Jobmanager on k8s as a Deployment

Hi! You should check out the Flink Kubernetes Operator. I think that covers all your needs . https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/ Cheers, Gyula On Sat, 3 Sep 2022 at 13:45, marco andreas wrote: > > We are deploying a flink application cluster on k8S. Followin

Deploying Jobmanager on k8s as a Deployment

We are deploying a flink application cluster on k8S. Following the official documentation the JM is deployed As a job resource , however we are deploying a long running flink job that is not supposed to be terminated and also we need to update the image of the flink job. The problem is that the j

questions about FLINK-27341

Hi, I want to know is there some way to avoid this problem now? I can not guarantee jobmanager and taskmanager do not run in the same machine.

Re: What is the recommended solution for this error of too many files open during a checkpoint?

We found a fix for this by upgrading Flink. We are forced to use the versions of Flink supported by EMR. The version of Flink that failed for us was 1.12.2. That version depends on RocksDB 5.17.2-artisans-2, which has this bug ticket: https://github.com/facebook/rocksdb/issues/5488 You can s

?????? flink ci build run longer than the maximum time of 310 minutes.

Hi,Matthias The ci build Error in  e2e_1_ci job: Sep 0211:01:51 ##[group]Top 15 biggest directories in terms of used disk space Sep 02 11:01:52 Searching for .dump, .dumpstream and related files in '/home/vsts/work/1/s' dmesg: read kernel buffer failed: Operation not permitted Sep 02 11:01:53 No t