[jira] [Commented] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569675#comment-16569675 ] Sean Owen commented on SPARK-25029: --- [~kiszk] and/or [~lrytz] I wonder if this could be related ... if

[jira] [Commented] (SPARK-20592) Alter table concatenate is not working as expected.

2018-08-05 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569673#comment-16569673 ] Yuming Wang commented on SPARK-20592: - Spark doesn't support this command:

[jira] [Commented] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-05 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569621#comment-16569621 ] Kazuaki Ishizaki commented on SPARK-25029: -- [~srowen] I see. The following parts have the

[jira] [Commented] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-05 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569602#comment-16569602 ] Stavros Kontopoulos commented on SPARK-25029: - [~srowen] I think the reason for this is

[jira] [Commented] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569600#comment-16569600 ] Sean Owen commented on SPARK-25029: --- One of the 'task not serializable' issues is proving trickier:

[jira] [Commented] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-05 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569592#comment-16569592 ] Stavros Kontopoulos commented on SPARK-25029: - [~srowen] cool will wait for the PR!

[jira] [Assigned] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25029: Assignee: (was: Apache Spark) > Scala 2.12 issues: TaskNotSerializable and Janino

[jira] [Assigned] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25029: Assignee: Apache Spark > Scala 2.12 issues: TaskNotSerializable and Janino "Two

[jira] [Commented] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569591#comment-16569591 ] Apache Spark commented on SPARK-25029: -- User 'srowen' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-05 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569588#comment-16569588 ] Stavros Kontopoulos edited comment on SPARK-25029 at 8/5/18 11:00 PM:

[jira] [Commented] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569590#comment-16569590 ] Sean Owen commented on SPARK-25029: --- Yep let me go ahead and open a PR with some fixes to get this

[jira] [Comment Edited] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-05 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569588#comment-16569588 ] Stavros Kontopoulos edited comment on SPARK-25029 at 8/5/18 10:52 PM:

[jira] [Comment Edited] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-05 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569588#comment-16569588 ] Stavros Kontopoulos edited comment on SPARK-25029 at 8/5/18 10:43 PM:

[jira] [Comment Edited] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-05 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569588#comment-16569588 ] Stavros Kontopoulos edited comment on SPARK-25029 at 8/5/18 10:42 PM:

[jira] [Comment Edited] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-05 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569588#comment-16569588 ] Stavros Kontopoulos edited comment on SPARK-25029 at 8/5/18 10:37 PM:

[jira] [Comment Edited] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-05 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569588#comment-16569588 ] Stavros Kontopoulos edited comment on SPARK-25029 at 8/5/18 10:35 PM:

[jira] [Comment Edited] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-05 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569588#comment-16569588 ] Stavros Kontopoulos edited comment on SPARK-25029 at 8/5/18 10:35 PM:

[jira] [Comment Edited] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-05 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569588#comment-16569588 ] Stavros Kontopoulos edited comment on SPARK-25029 at 8/5/18 10:34 PM:

[jira] [Commented] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-05 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569588#comment-16569588 ] Stavros Kontopoulos commented on SPARK-25029: - I think the second one comes up with

[jira] [Comment Edited] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-05 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569588#comment-16569588 ] Stavros Kontopoulos edited comment on SPARK-25029 at 8/5/18 10:32 PM:

[jira] [Assigned] (SPARK-25019) The published spark sql pom does not exclude the normal version of orc-core

2018-08-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25019: Assignee: Apache Spark > The published spark sql pom does not exclude the normal version

[jira] [Assigned] (SPARK-25019) The published spark sql pom does not exclude the normal version of orc-core

2018-08-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25019: Assignee: (was: Apache Spark) > The published spark sql pom does not exclude the

[jira] [Commented] (SPARK-25019) The published spark sql pom does not exclude the normal version of orc-core

2018-08-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569587#comment-16569587 ] Apache Spark commented on SPARK-25019: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569579#comment-16569579 ] Sean Owen commented on SPARK-25029: --- [~skonto] [~kiszk] [~ueshin] I thought you might be interested in

[jira] [Created] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-05 Thread Sean Owen (JIRA)
Sean Owen created SPARK-25029: - Summary: Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors Key: SPARK-25029 URL: https://issues.apache.org/jira/browse/SPARK-25029

[jira] [Comment Edited] (SPARK-25019) The published spark sql pom does not exclude the normal version of orc-core

2018-08-05 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569571#comment-16569571 ] Dongjoon Hyun edited comment on SPARK-25019 at 8/5/18 9:04 PM: --- I'll make

[jira] [Commented] (SPARK-25019) The published spark sql pom does not exclude the normal version of orc-core

2018-08-05 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569571#comment-16569571 ] Dongjoon Hyun commented on SPARK-25019: --- I'll make a PR soon. There is no reason that the parent

[jira] [Commented] (SPARK-23772) Provide an option to ignore column of all null values or empty map/array during JSON schema inference

2018-08-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569566#comment-16569566 ] Apache Spark commented on SPARK-23772: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-25019) The published spark sql pom does not exclude the normal version of orc-core

2018-08-05 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569526#comment-16569526 ] Dongjoon Hyun commented on SPARK-25019: --- Sure, I'll take a look, [~yhuai] . > The published spark

[jira] [Assigned] (SPARK-24819) Fail fast when no enough slots to launch the barrier stage on job submitted

2018-08-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24819: Assignee: Apache Spark > Fail fast when no enough slots to launch the barrier stage on

[jira] [Assigned] (SPARK-24819) Fail fast when no enough slots to launch the barrier stage on job submitted

2018-08-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24819: Assignee: (was: Apache Spark) > Fail fast when no enough slots to launch the barrier

[jira] [Commented] (SPARK-24819) Fail fast when no enough slots to launch the barrier stage on job submitted

2018-08-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569509#comment-16569509 ] Apache Spark commented on SPARK-24819: -- User 'jiangxb1987' has created a pull request for this

[jira] [Commented] (SPARK-24987) Kafka Cached Consumer Leaking File Descriptors

2018-08-05 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569491#comment-16569491 ] Cody Koeninger commented on SPARK-24987: It was merged to branch-2.3

[jira] [Updated] (SPARK-25026) Binary releases should contain some copy of compiled external integration modules

2018-08-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-25026: -- Summary: Binary releases should contain some copy of compiled external integration modules (was:

[jira] [Commented] (SPARK-20696) tf-idf document clustering with K-means in Apache Spark putting points into one cluster

2018-08-05 Thread rajanimaski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569460#comment-16569460 ] rajanimaski commented on SPARK-20696: - [~adiubc]  Here's the custom code developed for scala kmeans

[jira] [Comment Edited] (SPARK-24987) Kafka Cached Consumer Leaking File Descriptors

2018-08-05 Thread Yuval Itzchakov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569432#comment-16569432 ] Yuval Itzchakov edited comment on SPARK-24987 at 8/5/18 10:58 AM: --

[jira] [Updated] (SPARK-24987) Kafka Cached Consumer Leaking File Descriptors

2018-08-05 Thread Yuval Itzchakov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuval Itzchakov updated SPARK-24987: Shepherd: (was: Tathagata Das) > Kafka Cached Consumer Leaking File Descriptors >

[jira] [Comment Edited] (SPARK-24987) Kafka Cached Consumer Leaking File Descriptors

2018-08-05 Thread Yuval Itzchakov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569432#comment-16569432 ] Yuval Itzchakov edited comment on SPARK-24987 at 8/5/18 10:54 AM: --

[jira] [Commented] (SPARK-24987) Kafka Cached Consumer Leaking File Descriptors

2018-08-05 Thread Yuval Itzchakov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569432#comment-16569432 ] Yuval Itzchakov commented on SPARK-24987: - Is there any chance this will make it in time for

[jira] [Created] (SPARK-25028) AnalyzePartitionCommand failed with NPE if value is null

2018-08-05 Thread Izek Greenfield (JIRA)
Izek Greenfield created SPARK-25028: --- Summary: AnalyzePartitionCommand failed with NPE if value is null Key: SPARK-25028 URL: https://issues.apache.org/jira/browse/SPARK-25028 Project: Spark

[jira] [Commented] (SPARK-23939) High-order function: transform_keys(map, function) → map

2018-08-05 Thread Neha Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569397#comment-16569397 ] Neha Patil commented on SPARK-23939: I am working on this one, will have PR ready in a couple of