[jira] [Commented] (SPARK-24432) Add support for dynamic resource allocation

2018-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16649774#comment-16649774 ] Apache Spark commented on SPARK-24432: -- User 'huafengw' has created a pull request

[jira] [Commented] (SPARK-24432) Add support for dynamic resource allocation

2018-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16649773#comment-16649773 ] Apache Spark commented on SPARK-24432: -- User 'huafengw' has created a pull request

[jira] [Assigned] (SPARK-24432) Add support for dynamic resource allocation

2018-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24432: Assignee: Apache Spark > Add support for dynamic resource allocation > --

[jira] [Assigned] (SPARK-24432) Add support for dynamic resource allocation

2018-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24432: Assignee: (was: Apache Spark) > Add support for dynamic resource allocation > ---

[jira] [Commented] (SPARK-25403) Broadcast join is changing to sort merge join , after spark-beeline session restarts.

2018-10-14 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16649763#comment-16649763 ] Yuming Wang commented on SPARK-25403: - The previous {{BroadcastHashJoin}} is incorre

[jira] [Commented] (SPARK-25403) Broadcast join is changing to sort merge join , after spark-beeline session restarts.

2018-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16649758#comment-16649758 ] Apache Spark commented on SPARK-25403: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-25403) Broadcast join is changing to sort merge join , after spark-beeline session restarts.

2018-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25403: Assignee: (was: Apache Spark) > Broadcast join is changing to sort merge join , after

[jira] [Assigned] (SPARK-25403) Broadcast join is changing to sort merge join , after spark-beeline session restarts.

2018-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25403: Assignee: Apache Spark > Broadcast join is changing to sort merge join , after spark-beel

[jira] [Commented] (SPARK-25403) Broadcast join is changing to sort merge join , after spark-beeline session restarts.

2018-10-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16649759#comment-16649759 ] Apache Spark commented on SPARK-25403: -- User 'wangyum' has created a pull request f

[jira] [Commented] (SPARK-25728) SPIP: Structured Intermediate Representation (Tungsten IR) for generating Java code

2018-10-14 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16649681#comment-16649681 ] Takeshi Yamamuro commented on SPARK-25728: -- Cool! I'll join this activity. Anyw

[jira] [Commented] (SPARK-20236) Overwrite a partitioned data source table should only overwrite related partitions

2018-10-14 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16649649#comment-16649649 ] Wenchen Fan commented on SPARK-20236: - I think the confusion here is, the partition

[jira] [Commented] (SPARK-25369) Replace Java shim functional interfaces like java.api.Function with Java 8 equivalents

2018-10-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16649495#comment-16649495 ] Sean Owen commented on SPARK-25369: --- This won't work. The problem is that an API funct

[jira] [Commented] (SPARK-25728) SPIP: Structured Intermediate Representation (Tungsten IR) for generating Java code

2018-10-14 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16649428#comment-16649428 ] Kazuaki Ishizaki commented on SPARK-25728: -- cc: [~viirya], [~cloud_fan], [~mgai

[jira] [Issue Comment Deleted] (SPARK-25728) SPIP: Structured Intermediate Representation (Tungsten IR) for generating Java code

2018-10-14 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-25728: - Comment: was deleted (was: This JIRA entry is to start a discussion about adding structu

[jira] [Updated] (SPARK-25728) SPIP: Structured Intermediate Representation (Tungsten IR) for generating Java code

2018-10-14 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-25728: - Description: This JIRA entry is to start a discussion about adding structure intermediat

[jira] [Commented] (SPARK-25728) SPIP: Structured Intermediate Representation (Tungsten IR) for generating Java code

2018-10-14 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16649422#comment-16649422 ] Kazuaki Ishizaki commented on SPARK-25728: -- This JIRA entry is to start a discu

[jira] [Updated] (SPARK-25728) SPIP: Structured Intermediate Representation (Tungsten IR) for generating Java code

2018-10-14 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-25728: - External issue URL: (was: https://docs.google.com/document/d/1Jzf56bxpMpSwsGV_hSzl9wQG

[jira] [Updated] (SPARK-25728) SPIP: Structured Intermediate Representation (Tungsten IR) for generating Java code

2018-10-14 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-25728: - External issue URL: https://docs.google.com/document/d/1Jzf56bxpMpSwsGV_hSzl9wQG22hyI731

[jira] [Updated] (SPARK-25728) SPIP: Structured Intermediate Representation (Tungsten IR) for generating Java code

2018-10-14 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-25728: - External issue ID: https://docs.google.com/document/d/1Jzf56bxpMpSwsGV_hSzl9wQG22hyI731M

[jira] [Created] (SPARK-25728) SPIP: Structured Intermediate Representation (Tungsten IR) for generating Java code

2018-10-14 Thread Kazuaki Ishizaki (JIRA)
Kazuaki Ishizaki created SPARK-25728: Summary: SPIP: Structured Intermediate Representation (Tungsten IR) for generating Java code Key: SPARK-25728 URL: https://issues.apache.org/jira/browse/SPARK-25728

[jira] [Resolved] (SPARK-25723) dataset.show() , scala.MatchError: 23.25 (of class java.lang.Double)

2018-10-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25723. -- Resolution: Invalid > dataset.show() , scala.MatchError: 23.25 (of class java.lang.Double) > -

[jira] [Commented] (SPARK-25723) dataset.show() , scala.MatchError: 23.25 (of class java.lang.Double)

2018-10-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16649282#comment-16649282 ] Hyukjin Kwon commented on SPARK-25723: -- Please narrow down the problem and produce

[jira] [Updated] (SPARK-25715) support configuration on rpc port and port range on yarn client mode

2018-10-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-25715: - Fix Version/s: (was: 2.3.2) (was: 2.3.1) (was:

[jira] [Updated] (SPARK-25715) support configuration on rpc port and port range on yarn client mode

2018-10-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-25715: - Target Version/s: (was: 2.3.0) > support configuration on rpc port and port range on yarn clie

[jira] [Commented] (SPARK-25715) support configuration on rpc port and port range on yarn client mode

2018-10-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16649281#comment-16649281 ] Hyukjin Kwon commented on SPARK-25715: -- Please avoid to set the target version whic