[ https://issues.apache.org/jira/browse/SPARK-23294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shixiong Zhu resolved SPARK-23294. ---------------------------------- Resolution: Not A Problem > Spark Streaming + Rate source + Console Sink : Receiver MaxRate is violated > --------------------------------------------------------------------------- > > Key: SPARK-23294 > URL: https://issues.apache.org/jira/browse/SPARK-23294 > Project: Spark > Issue Type: Bug > Components: Structured Streaming > Affects Versions: 2.2.1 > Reporter: Ravinder Matte > Assignee: Takeshi Yamamuro > Priority: Minor > Labels: ConsoleSink, RateSource, backpressure, maxRate > > Using following configs while building SparkSession > ("spark.streaming.backpressure.enabled", "true") > ("spark.streaming.receiver.maxRate", "100") > ("spark.streaming.backpressure.initialRate", "100") > > Source: Rate Source with following options. > rowsPerSecond=100000 > Sink: Console Sink. > > I am expecting the process rate to limit at 100 Rows per Second, but maxRate > is ignored and streaming job is processing at 100000 rate. > -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org