Hi Team, I am trying to increase throughput of my flink stream job streaming from kafka source and sink to s3. Currently it is running fine for small events records. But records with large payloads are running extremely slow like at rate 2 TPS.
Could you provide some best practices to tune? Also, can we increase parallel processing, beyond the number of kafka partitions that we have, without causing any overhead ? Regards, Vijay