Prashant Sharma created SPARK-18526: ---------------------------------------
Summary: [Kafka] The property max.poll.records is set to a very low non overridable default. Key: SPARK-18526 URL: https://issues.apache.org/jira/browse/SPARK-18526 Project: Spark Issue Type: Bug Components: Structured Streaming Affects Versions: 2.1.0 Reporter: Prashant Sharma In Kafka source for structured streaming the value of the property `max.poll.records` is set to a default of 1, this is very slow rate of reading. This should be set to a higher value or at least user should be able to configure it. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org