[jira] [Comment Edited] (SPARK-18278) SPIP: Support native submission of spark jobs to a kubernetes cluster

2017-09-28 Thread Anirudh Ramanathan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183960#comment-16183960 ] Anirudh Ramanathan edited comment on SPARK-18278 at 9/28/17 10:17 AM:

[jira] [Commented] (SPARK-18278) SPIP: Support native submission of spark jobs to a kubernetes cluster

2017-09-28 Thread Anirudh Ramanathan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183960#comment-16183960 ] Anirudh Ramanathan commented on SPARK-18278: An update on the plan - 2 days ago, we cut

[jira] [Comment Edited] (SPARK-22144) ExchangeCoordinator will not combine the partitions of an 0 sized pre-shuffle

2017-09-28 Thread Lijia Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183884#comment-16183884 ] Lijia Liu edited comment on SPARK-22144 at 9/28/17 10:11 AM: - [~yhuai] Would

[jira] [Updated] (SPARK-22144) ExchangeCoordinator will not combine the partitions of an 0 sized pre-shuffle

2017-09-28 Thread Lijia Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijia Liu updated SPARK-22144: -- Component/s: (was: Spark Core) SQL > ExchangeCoordinator will not combine the

[jira] [Commented] (SPARK-22141) Propagate empty relation before checking Cartesian products

2017-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183901#comment-16183901 ] Apache Spark commented on SPARK-22141: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-22144) ExchangeCoordinator will not combine the partitions of an 0 sized pre-shuffle

2017-09-28 Thread Lijia Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183884#comment-16183884 ] Lijia Liu commented on SPARK-22144: --- [~yhuai]: Please look at this issue! > ExchangeCoordinator will

[jira] [Commented] (SPARK-22144) ExchangeCoordinator will not combine the partitions of an 0 sized pre-shuffle

2017-09-28 Thread Lijia Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183883#comment-16183883 ] Lijia Liu commented on SPARK-22144: --- cc: Yin Huai Please take a look at this issue. >

[jira] [Issue Comment Deleted] (SPARK-22144) ExchangeCoordinator will not combine the partitions of an 0 sized pre-shuffle

2017-09-28 Thread Lijia Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijia Liu updated SPARK-22144: -- Comment: was deleted (was: cc: Yin Huai Please take a look at this issue.) > ExchangeCoordinator

[jira] [Commented] (SPARK-22143) OffHeapColumnVector may leak memory

2017-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183857#comment-16183857 ] Apache Spark commented on SPARK-22143: -- User 'hvanhovell' has created a pull request for this issue:

[jira] [Commented] (SPARK-22152) Add Dataset flatten function

2017-09-28 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183828#comment-16183828 ] Takeshi Yamamuro commented on SPARK-22152: -- cc: [~smilegator][~cloud_fan] > Add Dataset flatten

[jira] [Comment Edited] (SPARK-22152) Add Dataset flatten function

2017-09-28 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183828#comment-16183828 ] Takeshi Yamamuro edited comment on SPARK-22152 at 9/28/17 8:04 AM: --- cc:

[jira] [Resolved] (SPARK-22128) Update paranamer to 2.8 to avoid BytecodeReadingParanamer ArrayIndexOutOfBoundsException with Scala 2.12 + Java 8 lambda

2017-09-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22128. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19352

[jira] [Commented] (SPARK-22152) Add Dataset flatten function

2017-09-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183764#comment-16183764 ] Sean Owen commented on SPARK-22152: --- Likewise for RDDs. It's not a bad idea, but it also adds little.

[jira] [Assigned] (SPARK-22135) metrics in spark-dispatcher not being registered properly

2017-09-28 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned SPARK-22135: --- Assignee: paul mackles > metrics in spark-dispatcher not being registered properly >

[jira] [Assigned] (SPARK-22154) add a shutdown hook that explains why the output is terminating

2017-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22154: Assignee: (was: Apache Spark) > add a shutdown hook that explains why the output is

[jira] [Commented] (SPARK-22154) add a shutdown hook that explains why the output is terminating

2017-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183762#comment-16183762 ] Apache Spark commented on SPARK-22154: -- User 'liu-zhaokun' has created a pull request for this

[jira] [Assigned] (SPARK-22154) add a shutdown hook that explains why the output is terminating

2017-09-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22154: Assignee: Apache Spark > add a shutdown hook that explains why the output is terminating

[jira] [Resolved] (SPARK-22135) metrics in spark-dispatcher not being registered properly

2017-09-28 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved SPARK-22135. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 Issue resolved by pull

[jira] [Created] (SPARK-22154) add a shutdown hook that explains why the output is terminating

2017-09-28 Thread liuzhaokun (JIRA)
liuzhaokun created SPARK-22154: -- Summary: add a shutdown hook that explains why the output is terminating Key: SPARK-22154 URL: https://issues.apache.org/jira/browse/SPARK-22154 Project: Spark

<    1   2