[
https://issues.apache.org/jira/browse/SPARK-20589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16197402#comment-16197402
]
Michael Park commented on SPARK-20589:
--
Pardon my ignorance of the inner workings of task
[
https://issues.apache.org/jira/browse/SPARK-20589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16161561#comment-16161561
]
Apache Spark commented on SPARK-20589:
--
User 'dhruve' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-20589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157424#comment-16157424
]
Apache Spark commented on SPARK-20589:
--
User 'dhruve' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-20589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144025#comment-16144025
]
Apache Spark commented on SPARK-20589:
--
User 'dhruve' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-20589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129380#comment-16129380
]
Imran Rashid commented on SPARK-20589:
--
Its pretty much the same thing whether you're trying to
[
https://issues.apache.org/jira/browse/SPARK-20589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129289#comment-16129289
]
Amit Kumar commented on SPARK-20589:
As you said, adding job boundary via code will be much easier
[
https://issues.apache.org/jira/browse/SPARK-20589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129198#comment-16129198
]
Imran Rashid commented on SPARK-20589:
--
the proposed solution will only let you control concurrency
[
https://issues.apache.org/jira/browse/SPARK-20589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127942#comment-16127942
]
Thomas Graves commented on SPARK-20589:
---
Note that this type of option is also already supported in
[
https://issues.apache.org/jira/browse/SPARK-20589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127930#comment-16127930
]
Amit Kumar commented on SPARK-20589:
[~imranr] Like you said, we could restrict the number of
[
https://issues.apache.org/jira/browse/SPARK-20589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127911#comment-16127911
]
Imran Rashid commented on SPARK-20589:
--
couldn't you just limit the number of executors of your
[
https://issues.apache.org/jira/browse/SPARK-20589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16114628#comment-16114628
]
Dhruve Ashar commented on SPARK-20589:
--
I have a patch for this and would like to have some
[
https://issues.apache.org/jira/browse/SPARK-20589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16114626#comment-16114626
]
Dhruve Ashar commented on SPARK-20589:
--
Spark defines stages based on the shuffle dependencies and
[
https://issues.apache.org/jira/browse/SPARK-20589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049228#comment-16049228
]
Thomas Graves commented on SPARK-20589:
---
[~Robin Shao] can you please clarify your comment? What
[
https://issues.apache.org/jira/browse/SPARK-20589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043877#comment-16043877
]
Fei Shao commented on SPARK-20589:
--
Tasks are assigned to executors. If we set the number of executors
[
https://issues.apache.org/jira/browse/SPARK-20589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023769#comment-16023769
]
Mark Nelson commented on SPARK-20589:
-
I would find this very useful. We're currently using coalesce
[
https://issues.apache.org/jira/browse/SPARK-20589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011024#comment-16011024
]
Amit Kumar commented on SPARK-20589:
I can probably give more reference. This originally arose from
[
https://issues.apache.org/jira/browse/SPARK-20589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15995650#comment-15995650
]
Thomas Graves commented on SPARK-20589:
---
thanks for the suggestions [~mridulm80].
Note just for
[
https://issues.apache.org/jira/browse/SPARK-20589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15995550#comment-15995550
]
Mridul Muralidharan commented on SPARK-20589:
-
coalasce with shuffle=false might be a
18 matches
Mail list logo