Hi Wouter

I have no idea of question-2. But for question-1, you could try to add your 
steps which already included in your 
https://github.com/mbode/flink-prometheus-example/blob/master/Dockerfile 's 
"RUN" phase to your k8s deployment-yaml's "command" phase before launch the 
cluster in k8s.

Best
Yun Tang

________________________________
From: Wouter Zorgdrager <w.d.zorgdra...@tudelft.nl>
Sent: Monday, May 13, 2019 20:16
To: user
Subject: Flink and Prometheus setup in K8s

Hey all,

I'm working on a deployment setup with Flink and Prometheus on Kubernetes. I'm 
running into the following issues:

1) Is it possible to use the default Flink Docker image [1] and enable the 
Prometheus reporter? Modifying the flink-config.yaml is easy, but somehow the 
Prometheus reporter jar needs to be moved within the image. This is easy if use 
my own Dockerfile (as done here [2]) , but I prefer using the official one.
2) I can define the jobmanager/taskmanager metric endpoints statically, but 
w.r.t. scaling I prefer to have these resolved/discovered dynamically. Did 
anyone get a working setup on this? I came across this resource for YARN [3], 
is there something similar for Kubernetes? Or are there any other ways of 
configuring Prometheus to pick this up automatically?

Thanks a lot for your help!

Kind regards,
Wouter

[1]: https://hub.docker.com/_/flink/
[2]: https://github.com/mbode/flink-prometheus-example/blob/master/Dockerfile
[3]: https://github.com/eastcirclek/flink-service-discovery

Reply via email to