Sungpeo Kook created SPARK-37515: ------------------------------------ Summary: minRatePerPartition works as "max messages per partition per a batch" (it should be per seconds) Key: SPARK-37515 URL: https://issues.apache.org/jira/browse/SPARK-37515 Project: Spark Issue Type: Bug Components: Spark Core Affects Versions: 3.2.0, 2.4.8 Reporter: Sungpeo Kook
{{maxRatePerPartition}} means "max messages per partition per second". But minRatePerPartition does not. ("max messages per partition per a batch"). This is a bug. minRatePerPartition should be works as "min messages per partition per second". * [https://github.com/apache/spark/blob/f97de309792f382ae823894e978f7e54f34f1a29/docs/configuration.md?plain=1#L2878-L2886] -- This message was sent by Atlassian Jira (v8.20.1#820001) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org