[jira] [Commented] (SPARK-20025) Driver fail over will not work, if SPARK_LOCAL* env is set.

2017-06-03 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16035875#comment-16035875 ] Prashant Sharma commented on SPARK-20025: - Done! > Driver fail over will not wor

[jira] [Created] (SPARK-20975) Excutors are no released if speculation + dynamic allocation enabled

2017-06-03 Thread harish chandra (JIRA)
harish chandra created SPARK-20975: -- Summary: Excutors are no released if speculation + dynamic allocation enabled Key: SPARK-20975 URL: https://issues.apache.org/jira/browse/SPARK-20975 Project: Sp

[jira] [Updated] (SPARK-20975) Excutors are no released if speculation + dynamic allocation enabled

2017-06-03 Thread harish chandra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] harish chandra updated SPARK-20975: --- Description: Whenever user enable spark speculation + dynamic allocation then after running

[jira] [Resolved] (SPARK-20936) Lack of an important case about the test of resolveURI

2017-06-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20936. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18158 [https://github.co

[jira] [Assigned] (SPARK-20936) Lack of an important case about the test of resolveURI

2017-06-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-20936: - Assignee: zuotingbing Priority: Trivial (was: Minor) Component/s: (was: Spark

[jira] [Commented] (SPARK-20662) Block jobs that have greater than a configured number of tasks

2017-06-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16035897#comment-16035897 ] Sean Owen commented on SPARK-20662: --- I still don't understand why YARN's capacity sched

[jira] [Resolved] (SPARK-20975) Excutors are no released if speculation + dynamic allocation enabled

2017-06-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20975. --- Resolution: Invalid There's no useful detail here. It's normal for executors to not be released in s

[jira] [Commented] (SPARK-20975) Excutors are no released if speculation + dynamic allocation enabled

2017-06-03 Thread harish chandra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16035903#comment-16035903 ] harish chandra commented on SPARK-20975: Thanks [~sowen] for quick response, Si

[jira] [Comment Edited] (SPARK-20975) Excutors are no released if speculation + dynamic allocation enabled

2017-06-03 Thread harish chandra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16035903#comment-16035903 ] harish chandra edited comment on SPARK-20975 at 6/3/17 9:39 AM: ---

[jira] [Commented] (SPARK-20928) Continuous Processing Mode for Structured Streaming

2017-06-03 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16035964#comment-16035964 ] Cody Koeninger commented on SPARK-20928: For jobs that only have narrow stages, I

[jira] [Assigned] (SPARK-20944) Move SortShuffleWriter.shouldBypassMergeSort to SortShuffleManager

2017-06-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20944: Assignee: (was: Apache Spark) > Move SortShuffleWriter.shouldBypassMergeSort to SortSh

[jira] [Assigned] (SPARK-20944) Move SortShuffleWriter.shouldBypassMergeSort to SortShuffleManager

2017-06-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20944: Assignee: Apache Spark > Move SortShuffleWriter.shouldBypassMergeSort to SortShuffleManage

[jira] [Commented] (SPARK-20944) Move SortShuffleWriter.shouldBypassMergeSort to SortShuffleManager

2017-06-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16035977#comment-16035977 ] Apache Spark commented on SPARK-20944: -- User 'zhengcanbin' has created a pull reques

[jira] [Commented] (SPARK-20928) Continuous Processing Mode for Structured Streaming

2017-06-03 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036157#comment-16036157 ] Nan Zhu commented on SPARK-20928: - if I understand correctly the tasks will be "long-term