[jira] [Reopened] (SPARK-24857) required the sample code test the spark steaming job in kubernates and write the data in remote hdfs file system

[ https://issues.apache.org/jira/browse/SPARK-24857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kumpatla murali krishna reopened SPARK-24857: - Hi ,   I am facing issues while running the spark job on eks.   Followin

[jira] [Commented] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569675#comment-16569675 ] Sean Owen commented on SPARK-25029: --- [~kiszk] and/or [~lrytz] I wonder if this could b

[jira] [Commented] (SPARK-20592) Alter table concatenate is not working as expected.

[ https://issues.apache.org/jira/browse/SPARK-20592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569673#comment-16569673 ] Yuming Wang commented on SPARK-20592: - Spark doesn't support this command: [https:/

[jira] [Commented] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569621#comment-16569621 ] Kazuaki Ishizaki commented on SPARK-25029: -- [~srowen] I see. The following part

[jira] [Commented] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569602#comment-16569602 ] Stavros Kontopoulos commented on SPARK-25029: - [~srowen] I think the reason

[jira] [Commented] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569600#comment-16569600 ] Sean Owen commented on SPARK-25029: --- One of the 'task not serializable' issues is prov

[jira] [Commented] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569592#comment-16569592 ] Stavros Kontopoulos commented on SPARK-25029: - [~srowen] cool will wait for

[jira] [Assigned] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25029: Assignee: (was: Apache Spark) > Scala 2.12 issues: TaskNotSerializable and Janino "Tw

[jira] [Assigned] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25029: Assignee: Apache Spark > Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstr

[jira] [Commented] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569591#comment-16569591 ] Apache Spark commented on SPARK-25029: -- User 'srowen' has created a pull request fo

[jira] [Comment Edited] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569588#comment-16569588 ] Stavros Kontopoulos edited comment on SPARK-25029 at 8/5/18 11:00 PM:

[jira] [Commented] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569590#comment-16569590 ] Sean Owen commented on SPARK-25029: --- Yep let me go ahead and open a PR with some fixes

[jira] [Comment Edited] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569588#comment-16569588 ] Stavros Kontopoulos edited comment on SPARK-25029 at 8/5/18 10:52 PM:

[jira] [Comment Edited] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569588#comment-16569588 ] Stavros Kontopoulos edited comment on SPARK-25029 at 8/5/18 10:43 PM:

[jira] [Comment Edited] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569588#comment-16569588 ] Stavros Kontopoulos edited comment on SPARK-25029 at 8/5/18 10:42 PM:

[jira] [Comment Edited] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569588#comment-16569588 ] Stavros Kontopoulos edited comment on SPARK-25029 at 8/5/18 10:37 PM:

[jira] [Comment Edited] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569588#comment-16569588 ] Stavros Kontopoulos edited comment on SPARK-25029 at 8/5/18 10:35 PM:

[jira] [Comment Edited] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569588#comment-16569588 ] Stavros Kontopoulos edited comment on SPARK-25029 at 8/5/18 10:35 PM:

[jira] [Comment Edited] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569588#comment-16569588 ] Stavros Kontopoulos edited comment on SPARK-25029 at 8/5/18 10:34 PM:

[jira] [Commented] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569588#comment-16569588 ] Stavros Kontopoulos commented on SPARK-25029: - I think the second one comes

[jira] [Comment Edited] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569588#comment-16569588 ] Stavros Kontopoulos edited comment on SPARK-25029 at 8/5/18 10:32 PM:

[jira] [Assigned] (SPARK-25019) The published spark sql pom does not exclude the normal version of orc-core

[ https://issues.apache.org/jira/browse/SPARK-25019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25019: Assignee: Apache Spark > The published spark sql pom does not exclude the normal version

[jira] [Assigned] (SPARK-25019) The published spark sql pom does not exclude the normal version of orc-core

[ https://issues.apache.org/jira/browse/SPARK-25019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25019: Assignee: (was: Apache Spark) > The published spark sql pom does not exclude the norm

[jira] [Commented] (SPARK-25019) The published spark sql pom does not exclude the normal version of orc-core

[ https://issues.apache.org/jira/browse/SPARK-25019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569587#comment-16569587 ] Apache Spark commented on SPARK-25019: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569579#comment-16569579 ] Sean Owen commented on SPARK-25029: --- [~skonto] [~kiszk] [~ueshin] I thought you might

[jira] [Created] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

Sean Owen created SPARK-25029: - Summary: Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors Key: SPARK-25029 URL: https://issues.apache.org/jira/browse/SPARK-25029 Pro

[jira] [Comment Edited] (SPARK-25019) The published spark sql pom does not exclude the normal version of orc-core

[ https://issues.apache.org/jira/browse/SPARK-25019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569571#comment-16569571 ] Dongjoon Hyun edited comment on SPARK-25019 at 8/5/18 9:04 PM: ---

[jira] [Commented] (SPARK-25019) The published spark sql pom does not exclude the normal version of orc-core

[ https://issues.apache.org/jira/browse/SPARK-25019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569571#comment-16569571 ] Dongjoon Hyun commented on SPARK-25019: --- I'll make a PR soon. There is no reason t

[jira] [Commented] (SPARK-23772) Provide an option to ignore column of all null values or empty map/array during JSON schema inference

[ https://issues.apache.org/jira/browse/SPARK-23772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569566#comment-16569566 ] Apache Spark commented on SPARK-23772: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-25019) The published spark sql pom does not exclude the normal version of orc-core

[ https://issues.apache.org/jira/browse/SPARK-25019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569526#comment-16569526 ] Dongjoon Hyun commented on SPARK-25019: --- Sure, I'll take a look, [~yhuai] . > The

[jira] [Assigned] (SPARK-24819) Fail fast when no enough slots to launch the barrier stage on job submitted

[ https://issues.apache.org/jira/browse/SPARK-24819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24819: Assignee: Apache Spark > Fail fast when no enough slots to launch the barrier stage on jo

[jira] [Commented] (SPARK-24819) Fail fast when no enough slots to launch the barrier stage on job submitted

[ https://issues.apache.org/jira/browse/SPARK-24819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569509#comment-16569509 ] Apache Spark commented on SPARK-24819: -- User 'jiangxb1987' has created a pull reque

[jira] [Assigned] (SPARK-24819) Fail fast when no enough slots to launch the barrier stage on job submitted

[ https://issues.apache.org/jira/browse/SPARK-24819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24819: Assignee: (was: Apache Spark) > Fail fast when no enough slots to launch the barrier

[jira] [Commented] (SPARK-24987) Kafka Cached Consumer Leaking File Descriptors

[ https://issues.apache.org/jira/browse/SPARK-24987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569491#comment-16569491 ] Cody Koeninger commented on SPARK-24987: It was merged to branch-2.3 https://gi

[jira] [Updated] (SPARK-25026) Binary releases should contain some copy of compiled external integration modules

[ https://issues.apache.org/jira/browse/SPARK-25026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-25026: -- Summary: Binary releases should contain some copy of compiled external integration modules (was: Bina

[jira] [Commented] (SPARK-20696) tf-idf document clustering with K-means in Apache Spark putting points into one cluster

[ https://issues.apache.org/jira/browse/SPARK-20696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569460#comment-16569460 ] rajanimaski commented on SPARK-20696: - [~adiubc]  Here's the custom code developed

[jira] [Comment Edited] (SPARK-24987) Kafka Cached Consumer Leaking File Descriptors

[ https://issues.apache.org/jira/browse/SPARK-24987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569432#comment-16569432 ] Yuval Itzchakov edited comment on SPARK-24987 at 8/5/18 10:58 AM:

[jira] [Updated] (SPARK-24987) Kafka Cached Consumer Leaking File Descriptors

[ https://issues.apache.org/jira/browse/SPARK-24987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuval Itzchakov updated SPARK-24987: Shepherd: (was: Tathagata Das) > Kafka Cached Consumer Leaking File Descriptors > --

[jira] [Comment Edited] (SPARK-24987) Kafka Cached Consumer Leaking File Descriptors

[ https://issues.apache.org/jira/browse/SPARK-24987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569432#comment-16569432 ] Yuval Itzchakov edited comment on SPARK-24987 at 8/5/18 10:54 AM:

[jira] [Commented] (SPARK-24987) Kafka Cached Consumer Leaking File Descriptors

[ https://issues.apache.org/jira/browse/SPARK-24987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569432#comment-16569432 ] Yuval Itzchakov commented on SPARK-24987: - Is there any chance this will make it

[jira] [Created] (SPARK-25028) AnalyzePartitionCommand failed with NPE if value is null

Izek Greenfield created SPARK-25028: --- Summary: AnalyzePartitionCommand failed with NPE if value is null Key: SPARK-25028 URL: https://issues.apache.org/jira/browse/SPARK-25028 Project: Spark

[jira] [Commented] (SPARK-23939) High-order function: transform_keys(map, function) → map

[ https://issues.apache.org/jira/browse/SPARK-23939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569397#comment-16569397 ] Neha Patil commented on SPARK-23939: I am working on this one, will have PR ready in