[
https://issues.apache.org/jira/browse/SPARK-19936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15924249#comment-15924249
]
Stan Teresen commented on SPARK-19936:
--------------------------------------
You are right, I didn't have big enough range of ports opened on AWS cluster.
From run to run Spark chooses ports for block manager randomly in a range of
~30000 to ~64000. Is there any way to control this range (at least to make it
narrower)? Thank you! I'm going to close this ticket.
> Page rank example takes long time to complete
> ---------------------------------------------
>
> Key: SPARK-19936
> URL: https://issues.apache.org/jira/browse/SPARK-19936
> Project: Spark
> Issue Type: Bug
> Components: Block Manager, Mesos
> Affects Versions: 2.1.0
> Environment: CentOS 7, Mesos 1.1.0
> Reporter: Stan Teresen
> Attachments: 1.stderr, 2.stderr, pr.out
>
>
> Sometimes Page Rank example takes very long time to finish on Mesos due to
> exceptions on fetching remote block in RetryingBlockFetcher on executor sides.
> As it is seen in the log files attached it took ~30 min for an example to
> complete in AWS 3 nodes environment (1 Mesos master and 2 agents).
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
