Re: Parallelism and Target TPS

2024-02-01 Thread Zhanghao Chen
a lee Sent: Thursday, February 1, 2024 15:26 To: user@flink.apache.org Subject: Parallelism and Target TPS Hi, I have a flink job that consumes from kafka and sinks it to an API. I need to ensure that my flink job can send within the rate limit 200 tps, we are planning to increase the parall

Parallelism and Target TPS

2024-01-31 Thread patricia lee
Hi, I have a flink job that consumes from kafka and sinks it to an API. I need to ensure that my flink job can send within the rate limit 200 tps, we are planning to increase the parallelism, but I do not know the right number to set. 1 parallelism does equal to 1 consumer? So if 200, should we s