Hi Yang,
Thank you for your reply.
Yes, we have evaluated job specific clusters (as we used to deploy the same
in YARN) , the main issue is Job monitoring of multiple jobs as we won't be
having a single endpoint like YARN does . We will evaluate K8's operator
you have suggested
Thanks and
Hi Vinay Patil,
You are right. Flink does not provide any isolation between different jobs
in the same Flink session cluster.
You could use Flink job cluster or application cluster(from 1.11) to get
better isolation since a dedicated Flink
cluster will be started for each job.
Please refer to
Hi Team,
We have a session cluster running on K8 where multiple stateless jobs are
running fine. We observed that once we submit a stateful job (state size
per checkpoint is 1GB) to the same session cluster other jobs are impacted
because this job starts to utilise more memory and CPU and
