[
https://issues.apache.org/jira/browse/SPARK-20483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Davis Shepherd updated SPARK-20483:
---
Description: if {{spark.cores.max = 10}} for example and
{{spark.executor.cores = 4}}, 2
[
https://issues.apache.org/jira/browse/SPARK-20483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Davis Shepherd updated SPARK-20483:
---
Description:
if {{spark.cores.max = 10}} for example and {{spark.executor.cores = 4}}, 2
[
https://issues.apache.org/jira/browse/SPARK-20483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Davis Shepherd updated SPARK-20483:
---
Description:
if {{spark.cores.max = 10}} for example and {{spark.executor.cores = 4}}, 2
Davis Shepherd created SPARK-20483:
--
Summary: Mesos Coarse mode may starve other Mesos frameworks if
max cores is not a multiple of executor cores
Key: SPARK-20483
URL:
[
https://issues.apache.org/jira/browse/SPARK-4759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238221#comment-14238221
]
Davis Shepherd commented on SPARK-4759:
---
The fix appears to resolve the issue in
[
https://issues.apache.org/jira/browse/SPARK-4759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14237264#comment-14237264
]
Davis Shepherd commented on SPARK-4759:
---
It is possible to reproduce the issue with
[
https://issues.apache.org/jira/browse/SPARK-4759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14237376#comment-14237376
]
Davis Shepherd commented on SPARK-4759:
---
local[2] on the latest commit of branch 1.1
[
https://issues.apache.org/jira/browse/SPARK-4759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14237383#comment-14237383
]
Davis Shepherd commented on SPARK-4759:
---
Ok your version does reproduce the issue
[
https://issues.apache.org/jira/browse/SPARK-4759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14237393#comment-14237393
]
Davis Shepherd commented on SPARK-4759:
---
I still cannot reproduce the issue in the
[
https://issues.apache.org/jira/browse/SPARK-4759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14237393#comment-14237393
]
Davis Shepherd edited comment on SPARK-4759 at 12/8/14 3:15 AM:
[
https://issues.apache.org/jira/browse/SPARK-4759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14235651#comment-14235651
]
Davis Shepherd commented on SPARK-4759:
---
[
https://issues.apache.org/jira/browse/SPARK-4759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14235651#comment-14235651
]
Davis Shepherd edited comment on SPARK-4759 at 12/5/14 3:48 PM:
[
https://issues.apache.org/jira/browse/SPARK-4759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14235651#comment-14235651
]
Davis Shepherd edited comment on SPARK-4759 at 12/5/14 3:52 PM:
[
https://issues.apache.org/jira/browse/SPARK-4759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Davis Shepherd updated SPARK-4759:
--
Description:
The attached test class runs two identical jobs that perform some iterative
[
https://issues.apache.org/jira/browse/SPARK-4759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14235703#comment-14235703
]
Davis Shepherd commented on SPARK-4759:
---
Fair enough. As far as I can work out, it
Davis Shepherd created SPARK-4759:
-
Summary: Deadlock in pathological spark job.
Key: SPARK-4759
URL: https://issues.apache.org/jira/browse/SPARK-4759
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-4759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Davis Shepherd updated SPARK-4759:
--
Attachment: SparkBugReplicator.scala
Deadlock in pathological spark job.
[
https://issues.apache.org/jira/browse/SPARK-4759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Davis Shepherd updated SPARK-4759:
--
Description:
The attached test class runs two identical jobs that perform some iterative
[
https://issues.apache.org/jira/browse/SPARK-4759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Davis Shepherd updated SPARK-4759:
--
Summary: Deadlock in complex spark job. (was: Deadlock in pathological
spark job.)
Deadlock
[
https://issues.apache.org/jira/browse/SPARK-4759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Davis Shepherd updated SPARK-4759:
--
Attachment: (was: SparkBugReplicator.scala)
Deadlock in complex spark job.
[
https://issues.apache.org/jira/browse/SPARK-4759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Davis Shepherd updated SPARK-4759:
--
Attachment: SparkBugReplicator.scala
Deadlock in complex spark job.
[
https://issues.apache.org/jira/browse/SPARK-3882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14173428#comment-14173428
]
Davis Shepherd commented on SPARK-3882:
---
This is also a serious memory leak that
[
https://issues.apache.org/jira/browse/SPARK-3882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Davis Shepherd updated SPARK-3882:
--
Comment: was deleted
(was: This is also a serious memory leak that will cause long running
Davis Shepherd created SPARK-3882:
-
Summary: JobProgressListener gets permanently out of sync with
long running job
Key: SPARK-3882
URL: https://issues.apache.org/jira/browse/SPARK-3882
Project:
[
https://issues.apache.org/jira/browse/SPARK-3882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Davis Shepherd updated SPARK-3882:
--
Attachment: Screen Shot 2014-10-03 at 12.50.59 PM.png
Lots of orphaned jobs.
[
https://issues.apache.org/jira/browse/SPARK-3882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14165535#comment-14165535
]
Davis Shepherd edited comment on SPARK-3882 at 10/9/14 6:51 PM:
Davis Shepherd created SPARK-1411:
-
Summary: When using spark.ui.retainedStages=n only the first n
stages are kept, not the most recent.
Key: SPARK-1411
URL: https://issues.apache.org/jira/browse/SPARK-1411
[
https://issues.apache.org/jira/browse/SPARK-1411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Davis Shepherd updated SPARK-1411:
--
Attachment: Screen Shot 2014-04-03 at 5.35.00 PM.png
Notice the large gap in stage ids and
[
https://issues.apache.org/jira/browse/SPARK-1411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Davis Shepherd updated SPARK-1411:
--
Priority: Major (was: Minor)
When using spark.ui.retainedStages=n only the first n stages
[
https://issues.apache.org/jira/browse/SPARK-1411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Davis Shepherd closed SPARK-1411.
-
Resolution: Duplicate
When using spark.ui.retainedStages=n only the first n stages are kept,
[
https://issues.apache.org/jira/browse/SPARK-1411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13959664#comment-13959664
]
Davis Shepherd commented on SPARK-1411:
---
I submitted a pull request to fix 1337 as
31 matches
Mail list logo