[
https://issues.apache.org/jira/browse/SPARK-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marius Soutier updated SPARK-7167:
----------------------------------
Summary: Receivers are not distributed efficiently when starting from
checkpoint (was: Receivers are not distributed efficiently)
> Receivers are not distributed efficiently when starting from checkpoint
> -----------------------------------------------------------------------
>
> Key: SPARK-7167
> URL: https://issues.apache.org/jira/browse/SPARK-7167
> Project: Spark
> Issue Type: Bug
> Components: Streaming
> Affects Versions: 1.2.1, 1.2.2
> Reporter: Marius Soutier
>
> Bug report: I'm seeing an issue where after starting a streaming application
> from a checkpoint, the network receivers are distributed such that not all
> nodes are used.
> For example, I have five nodes:
> node0 - 1 receiver
> node1 - 2 receivers
> node2 - 0 receivers
> node3 - 2 receivers
> node4 - 0 receivers
> This slows down the job, waiting batches pile up, and I have to kill and
> restart it, hoping that next time it will be distributed in a sensible
> fashion.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
