[jira] [Commented] (SPARK-13718) Scheduler "creating" straggler node

2016-03-14 Thread Ioannis Deligiannis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193547#comment-15193547 ] Ioannis Deligiannis commented on SPARK-13718: - Our solution can serve up to 8 users requests

[jira] [Commented] (SPARK-13718) Scheduler "creating" straggler node

2016-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193515#comment-15193515 ] Sean Owen commented on SPARK-13718: --- Some SQL queries end up touching lots of data, or just a little;

[jira] [Commented] (SPARK-13718) Scheduler "creating" straggler node

2016-03-14 Thread Ioannis Deligiannis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193495#comment-15193495 ] Ioannis Deligiannis commented on SPARK-13718: - I think I understand how you got to that

[jira] [Commented] (SPARK-13718) Scheduler "creating" straggler node

2016-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193389#comment-15193389 ] Sean Owen commented on SPARK-13718: --- Yeah, this is the problem. This is not at all a good application

[jira] [Commented] (SPARK-13718) Scheduler "creating" straggler node

2016-03-14 Thread Ioannis Deligiannis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193378#comment-15193378 ] Ioannis Deligiannis commented on SPARK-13718: - (reply per paragraph) To provide a bit more

[jira] [Commented] (SPARK-13718) Scheduler "creating" straggler node

2016-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193326#comment-15193326 ] Sean Owen commented on SPARK-13718: --- This is probably better as a discussion on user@. A more general

[jira] [Commented] (SPARK-13718) Scheduler "creating" straggler node

2016-03-14 Thread Ioannis Deligiannis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193287#comment-15193287 ] Ioannis Deligiannis commented on SPARK-13718: - (reply per paragraph) That is the point I am

[jira] [Commented] (SPARK-13718) Scheduler "creating" straggler node

2016-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193167#comment-15193167 ] Sean Owen commented on SPARK-13718: --- It's not so much that users need finer-grained per-partition

[jira] [Commented] (SPARK-13718) Scheduler "creating" straggler node

2016-03-14 Thread Ioannis Deligiannis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193122#comment-15193122 ] Ioannis Deligiannis commented on SPARK-13718: - That was my point above above partition

[jira] [Commented] (SPARK-13718) Scheduler "creating" straggler node

2016-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193074#comment-15193074 ] Sean Owen commented on SPARK-13718: --- (PS RDDs are already cached per-partition and can be replicated

[jira] [Commented] (SPARK-13718) Scheduler "creating" straggler node

2016-03-14 Thread Ioannis Deligiannis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193046#comment-15193046 ] Ioannis Deligiannis commented on SPARK-13718: - It would be hard to impossible to automate

[jira] [Commented] (SPARK-13718) Scheduler "creating" straggler node

2016-03-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192309#comment-15192309 ] Sean Owen commented on SPARK-13718: --- What do you mean that it tries to assign without an available core

[jira] [Commented] (SPARK-13718) Scheduler "creating" straggler node

2016-03-07 Thread Ioannis Deligiannis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15182902#comment-15182902 ] Ioannis Deligiannis commented on SPARK-13718: - True, tuning {{spark.locality.wait}} yields

[jira] [Commented] (SPARK-13718) Scheduler "creating" straggler node

2016-03-07 Thread Ioannis Deligiannis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15182901#comment-15182901 ] Ioannis Deligiannis commented on SPARK-13718: - Point taken, though I'd rank it higher than