[jira] [Commented] (SPARK-29678) ALTER TABLE (add table partition) should look up catalog/table like v2 commands

2019-10-30 Thread Terry Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963618#comment-16963618 ] Terry Kim commented on SPARK-29678: --- working on this. > ALTER TABLE (add table partit

[jira] [Created] (SPARK-29678) ALTER TABLE (add table partition) should look up catalog/table like v2 commands

2019-10-30 Thread Terry Kim (Jira)
Terry Kim created SPARK-29678: - Summary: ALTER TABLE (add table partition) should look up catalog/table like v2 commands Key: SPARK-29678 URL: https://issues.apache.org/jira/browse/SPARK-29678 Project: Sp

[jira] [Resolved] (SPARK-29582) Unify the behavior of pyspark.TaskContext with spark core

2019-10-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29582. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26239 [https://gi

[jira] [Assigned] (SPARK-29582) Unify the behavior of pyspark.TaskContext with spark core

2019-10-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-29582: Assignee: Xianyang Liu > Unify the behavior of pyspark.TaskContext with spark core >

[jira] [Commented] (SPARK-29664) Column.getItem behavior is not consistent with Scala version

2019-10-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963648#comment-16963648 ] Hyukjin Kwon commented on SPARK-29664: -- Can we fix Python side to match with Scala

[jira] [Commented] (SPARK-29664) Column.getItem behavior is not consistent with Scala version

2019-10-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963649#comment-16963649 ] Hyukjin Kwon commented on SPARK-29664: -- We will have to update migration guide at

[jira] [Commented] (SPARK-29664) Column.getItem behavior is not consistent with Scala version

2019-10-30 Thread Terry Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963651#comment-16963651 ] Terry Kim commented on SPARK-29664: --- OK, will do. Thanks! > Column.getItem behavior i

[jira] [Created] (SPARK-29679) Make interval type camparable and orderable

2019-10-30 Thread Kent Yao (Jira)
Kent Yao created SPARK-29679: Summary: Make interval type camparable and orderable Key: SPARK-29679 URL: https://issues.apache.org/jira/browse/SPARK-29679 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-29636) Can't parse '11:00 BST' or '2000-10-19 10:23:54+01' signatures to timestamp

2019-10-30 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963666#comment-16963666 ] Aman Omer commented on SPARK-29636: --- [~hyukjin.kwon] [~maxgekk] Can you help us here

[jira] [Commented] (SPARK-29616) Bankers' rounding for double types

2019-10-30 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963670#comment-16963670 ] Aman Omer commented on SPARK-29616: --- Thanks [~maropu] . I am working on this. > Banke

[jira] [Assigned] (SPARK-29645) ML add param RelativeError

2019-10-30 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reassigned SPARK-29645: Assignee: zhengruifeng > ML add param RelativeError > -- > >

[jira] [Resolved] (SPARK-29645) ML add param RelativeError

2019-10-30 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-29645. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26305 [https://gi

[jira] [Commented] (SPARK-29650) Discard a NULL constant in LIMIT

2019-10-30 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963677#comment-16963677 ] Aman Omer commented on SPARK-29650: --- Analyzing this one. > Discard a NULL constant in

[jira] [Commented] (SPARK-29636) Can't parse '11:00 BST' or '2000-10-19 10:23:54+01' signatures to timestamp

2019-10-30 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963680#comment-16963680 ] Maxim Gekk commented on SPARK-29636: 1. The output is different because Spark uses t

[jira] [Reopened] (SPARK-29277) DataSourceV2: Add early filter and projection pushdown

2019-10-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-29277: --- This is reverted due to `SBT with Hadoop 3.2` profile failure. - https://amplab.cs.berkeley.edu

[jira] [Comment Edited] (SPARK-29277) DataSourceV2: Add early filter and projection pushdown

2019-10-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963682#comment-16963682 ] Dongjoon Hyun edited comment on SPARK-29277 at 10/31/19 6:20 AM: -

[jira] [Comment Edited] (SPARK-29650) Discard a NULL constant in LIMIT

2019-10-30 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963683#comment-16963683 ] Aman Omer edited comment on SPARK-29650 at 10/31/19 6:27 AM: -

[jira] [Commented] (SPARK-29650) Discard a NULL constant in LIMIT

2019-10-30 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963683#comment-16963683 ] Aman Omer commented on SPARK-29650: ---   {code:java} select * from TName limit (case whe

[jira] [Commented] (SPARK-29650) Discard a NULL constant in LIMIT

2019-10-30 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963686#comment-16963686 ] Aman Omer commented on SPARK-29650: ---   {code:java} select * from TName limit(int(1));{

[jira] [Comment Edited] (SPARK-29650) Discard a NULL constant in LIMIT

2019-10-30 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963686#comment-16963686 ] Aman Omer edited comment on SPARK-29650 at 10/31/19 6:33 AM: -

[jira] [Comment Edited] (SPARK-29604) SessionState is initialized with isolated classloader for Hive if spark.sql.hive.metastore.jars is being set

2019-10-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963693#comment-16963693 ] Dongjoon Hyun edited comment on SPARK-29604 at 10/31/19 6:37 AM: -

[jira] [Commented] (SPARK-29604) SessionState is initialized with isolated classloader for Hive if spark.sql.hive.metastore.jars is being set

2019-10-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963693#comment-16963693 ] Dongjoon Hyun commented on SPARK-29604: --- I don't know. It makes sense. In additio

<    1   2