When I run a sql job with blink planner in my cluster,the task is almost
preemption the whole resources in the cluster, and this is a bad effect to the
stream task.As it is not necessary on speed,so is there any way to control the
rate in my batch task?
this is the machine performance in ru
Hi,
I'm not sure that I fully understand your question.
Is the intention to prioritize some jobs over the others in the same
Flink cluster? Currently, it is not possible (FLIP-156 and further
work aim to address this [1]). At the moment, you can either
- deploy the jobs in separate clusters (per-j
In Flink, you can only limit memory usage, e.g. via
taskmanager.memory.process.size [1]
(throttling could be implemented using the DataStream API, but you
mentioned you are using SQL).
Quotas on other resources can be set in the underlying resource manager.
But I'd suggest investigating the failur
