[jira] [Commented] (SPARK-20928) Continuous Processing Mode for Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16036157#comment-16036157 ] Nan Zhu commented on SPARK-20928: - if I understand correctly the tasks will be "long-term" tasks just

[jira] [Assigned] (SPARK-20944) Move SortShuffleWriter.shouldBypassMergeSort to SortShuffleManager

[ https://issues.apache.org/jira/browse/SPARK-20944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20944: Assignee: Apache Spark > Move SortShuffleWriter.shouldBypassMergeSort to

[jira] [Commented] (SPARK-20944) Move SortShuffleWriter.shouldBypassMergeSort to SortShuffleManager

[ https://issues.apache.org/jira/browse/SPARK-20944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035977#comment-16035977 ] Apache Spark commented on SPARK-20944: -- User 'zhengcanbin' has created a pull request for this

[jira] [Assigned] (SPARK-20944) Move SortShuffleWriter.shouldBypassMergeSort to SortShuffleManager

[ https://issues.apache.org/jira/browse/SPARK-20944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20944: Assignee: (was: Apache Spark) > Move SortShuffleWriter.shouldBypassMergeSort to

[jira] [Commented] (SPARK-20928) Continuous Processing Mode for Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035964#comment-16035964 ] Cody Koeninger commented on SPARK-20928: For jobs that only have narrow stages, I think it should

[jira] [Comment Edited] (SPARK-20975) Excutors are no released if speculation + dynamic allocation enabled

[ https://issues.apache.org/jira/browse/SPARK-20975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035903#comment-16035903 ] harish chandra edited comment on SPARK-20975 at 6/3/17 9:39 AM: Thanks

[jira] [Commented] (SPARK-20975) Excutors are no released if speculation + dynamic allocation enabled

[ https://issues.apache.org/jira/browse/SPARK-20975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035903#comment-16035903 ] harish chandra commented on SPARK-20975: Thanks [~sowen] for quick response, Since I am passing

[jira] [Resolved] (SPARK-20975) Excutors are no released if speculation + dynamic allocation enabled

[ https://issues.apache.org/jira/browse/SPARK-20975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20975. --- Resolution: Invalid There's no useful detail here. It's normal for executors to not be released in

[jira] [Commented] (SPARK-20662) Block jobs that have greater than a configured number of tasks

[ https://issues.apache.org/jira/browse/SPARK-20662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035897#comment-16035897 ] Sean Owen commented on SPARK-20662: --- I still don't understand why YARN's capacity scheduler doesn't

[jira] [Assigned] (SPARK-20936) Lack of an important case about the test of resolveURI

[ https://issues.apache.org/jira/browse/SPARK-20936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-20936: - Assignee: zuotingbing Priority: Trivial (was: Minor) Component/s: (was: Spark

[jira] [Resolved] (SPARK-20936) Lack of an important case about the test of resolveURI

[ https://issues.apache.org/jira/browse/SPARK-20936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20936. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18158

[jira] [Updated] (SPARK-20975) Excutors are no released if speculation + dynamic allocation enabled

[ https://issues.apache.org/jira/browse/SPARK-20975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] harish chandra updated SPARK-20975: --- Description: Whenever user enable spark speculation + dynamic allocation then after running

[jira] [Created] (SPARK-20975) Excutors are no released if speculation + dynamic allocation enabled

harish chandra created SPARK-20975: -- Summary: Excutors are no released if speculation + dynamic allocation enabled Key: SPARK-20975 URL: https://issues.apache.org/jira/browse/SPARK-20975 Project:

[jira] [Commented] (SPARK-20025) Driver fail over will not work, if SPARK_LOCAL* env is set.

[ https://issues.apache.org/jira/browse/SPARK-20025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035875#comment-16035875 ] Prashant Sharma commented on SPARK-20025: - Done! > Driver fail over will not work, if

[jira] [Updated] (SPARK-20025) Driver fail over will not work, if SPARK_LOCAL* env is set.

[ https://issues.apache.org/jira/browse/SPARK-20025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-20025: Target Version/s: 2.3.0 (was: 2.2.0) > Driver fail over will not work, if SPARK_LOCAL*

[jira] [Updated] (SPARK-20950) Improve diskWriteBufferSize configurable

[ https://issues.apache.org/jira/browse/SPARK-20950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] caoxuewen updated SPARK-20950: -- Description: 1.With spark.shuffle.spill.diskWriteBufferSize configure diskWriteBufferSize of

[jira] [Updated] (SPARK-20950) Improve diskWriteBufferSize configurable

[ https://issues.apache.org/jira/browse/SPARK-20950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] caoxuewen updated SPARK-20950: -- Summary: Improve diskWriteBufferSize configurable (was: Improve Serializerbuffersize configurable) >

[jira] [Assigned] (SPARK-19732) DataFrame.fillna() does not work for bools in PySpark

[ https://issues.apache.org/jira/browse/SPARK-19732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-19732: - Assignee: Ruben Berenguel > DataFrame.fillna() does not work for bools in PySpark >