[jira] [Commented] (SPARK-8978) Implement the DirectKafkaController
[ https://issues.apache.org/jira/browse/SPARK-8978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647631#comment-14647631 ] Apache Spark commented on SPARK-8978: - User 'dragos' has created a pull request for this issue: https://github.com/apache/spark/pull/7796 > Implement the DirectKafkaController > --- > > Key: SPARK-8978 > URL: https://issues.apache.org/jira/browse/SPARK-8978 > Project: Spark > Issue Type: Sub-task > Components: Streaming >Reporter: Iulian Dragos > Fix For: 1.5.0 > > > Based on this [design > doc|https://docs.google.com/document/d/1ls_g5fFmfbbSTIfQQpUxH56d0f3OksF567zwA00zK9E/edit?usp=sharing]. > The DirectKafkaInputDStream should use the rate estimate to control how many > records/partition to put in the next batch. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8978) Implement the DirectKafkaController
[ https://issues.apache.org/jira/browse/SPARK-8978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14626542#comment-14626542 ] François Garillot commented on SPARK-8978: -- Typesafe PR: https://github.com/typesafehub/spark/pull/18 > Implement the DirectKafkaController > --- > > Key: SPARK-8978 > URL: https://issues.apache.org/jira/browse/SPARK-8978 > Project: Spark > Issue Type: Sub-task > Components: Streaming >Reporter: Iulian Dragos > Fix For: 1.5.0 > > > Based on this [design > doc|https://docs.google.com/document/d/1ls_g5fFmfbbSTIfQQpUxH56d0f3OksF567zwA00zK9E/edit?usp=sharing]. > The DirectKafkaInputDStream should use the rate estimate to control how many > records/partition to put in the next batch. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
