[ https://issues.apache.org/jira/browse/SPARK-7988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tathagata Das resolved SPARK-7988. ---------------------------------- Resolution: Fixed Assignee: Nishkam Ravi Fix Version/s: 1.5.0 > Mechanism to control receiver scheduling > ----------------------------------------- > > Key: SPARK-7988 > URL: https://issues.apache.org/jira/browse/SPARK-7988 > Project: Spark > Issue Type: New Feature > Components: Streaming > Reporter: Nishkam Ravi > Assignee: Nishkam Ravi > Priority: Critical > Fix For: 1.5.0 > > > Streaming receivers are currently scheduled by the underlying Spark scheduler > in the same way as other tasks. Will help performance if we added a knob to > control receiver scheduling. In most cases, even distribution of receivers > among workers should yield best results. In some cases, dense scheduling > (e.g, all receivers on one node) may perform better. Maybe support for a new > configuration parameter spark.receiver.scheduling.mode (or some such) would > help. With 'default' as the current scheduling scheme and 'round-robin' for > even distribution among workers (and potentially a third mode for 'dense' > scheduling). -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org