[jira] [Commented] (SPARK-33911) Update SQL migration guide about changes in HiveClientImpl

2020-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254966#comment-17254966 ] Apache Spark commented on SPARK-33911: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-33911) Update SQL migration guide about changes in HiveClientImpl

2020-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254965#comment-17254965 ] Apache Spark commented on SPARK-33911: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33897) Can't set option 'cross' in join method.

2020-12-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33897: Assignee: GokiMori > Can't set option 'cross' in join method. >

[jira] [Resolved] (SPARK-33897) Can't set option 'cross' in join method.

2020-12-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33897. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30803

[jira] [Commented] (SPARK-33911) Update SQL migration guide about changes in HiveClientImpl

2020-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254960#comment-17254960 ] Apache Spark commented on SPARK-33911: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-33911) Update SQL migration guide about changes in HiveClientImpl

2020-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254959#comment-17254959 ] Apache Spark commented on SPARK-33911: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-33911) Update SQL migration guide about changes in HiveClientImpl

2020-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254958#comment-17254958 ] Apache Spark commented on SPARK-33911: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-33915) Allow json expression to be pushable column

2020-12-25 Thread Ted Yu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254944#comment-17254944 ] Ted Yu edited comment on SPARK-33915 at 12/26/20, 4:14 AM: --- I have

[jira] [Comment Edited] (SPARK-33915) Allow json expression to be pushable column

2020-12-25 Thread Ted Yu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254944#comment-17254944 ] Ted Yu edited comment on SPARK-33915 at 12/26/20, 4:14 AM: --- I have

[jira] [Commented] (SPARK-33915) Allow json expression to be pushable column

2020-12-25 Thread Ted Yu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254944#comment-17254944 ] Ted Yu commented on SPARK-33915: I have experimented with two patches which allow json expression to be

[jira] [Updated] (SPARK-33915) Allow json expression to be pushable column

2020-12-25 Thread Ted Yu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-33915: --- Description: Currently PushableColumnBase provides no support for json / jsonb expression. Example of json

[jira] [Created] (SPARK-33915) Allow json expression to be pushable column

2020-12-25 Thread Ted Yu (Jira)
Ted Yu created SPARK-33915: -- Summary: Allow json expression to be pushable column Key: SPARK-33915 URL: https://issues.apache.org/jira/browse/SPARK-33915 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-27367) Faster RoaringBitmap Serialization with v0.8.0

2020-12-25 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-27367. - Resolution: Duplicate Issue fixed by SPARK-32437. > Faster RoaringBitmap Serialization with

[jira] [Commented] (SPARK-33070) Optimizer rules for HigherOrderFunctions

2020-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254910#comment-17254910 ] Apache Spark commented on SPARK-33070: -- User 'tanelk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33070) Optimizer rules for HigherOrderFunctions

2020-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33070: Assignee: Apache Spark > Optimizer rules for HigherOrderFunctions >

[jira] [Commented] (SPARK-33070) Optimizer rules for HigherOrderFunctions

2020-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254909#comment-17254909 ] Apache Spark commented on SPARK-33070: -- User 'tanelk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33070) Optimizer rules for HigherOrderFunctions

2020-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33070: Assignee: (was: Apache Spark) > Optimizer rules for HigherOrderFunctions >

[jira] [Updated] (SPARK-33070) Optimizer rules for HigherOrderFunctions

2020-12-25 Thread Tanel Kiis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanel Kiis updated SPARK-33070: --- Summary: Optimizer rules for HigherOrderFunctions (was: Optimizer rules for collection datatypes

[jira] [Assigned] (SPARK-33914) Describe the structure of unified v1 and v2 tests

2020-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33914: Assignee: (was: Apache Spark) > Describe the structure of unified v1 and v2 tests >

[jira] [Commented] (SPARK-33914) Describe the structure of unified v1 and v2 tests

2020-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254866#comment-17254866 ] Apache Spark commented on SPARK-33914: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33914) Describe the structure of unified v1 and v2 tests

2020-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33914: Assignee: Apache Spark > Describe the structure of unified v1 and v2 tests >

[jira] [Commented] (SPARK-33914) Describe the structure of unified v1 and v2 tests

2020-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254865#comment-17254865 ] Apache Spark commented on SPARK-33914: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Created] (SPARK-33914) Describe the structure of unified v1 and v2 tests

2020-12-25 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33914: -- Summary: Describe the structure of unified v1 and v2 tests Key: SPARK-33914 URL: https://issues.apache.org/jira/browse/SPARK-33914 Project: Spark Issue Type:

[jira] [Created] (SPARK-33913) Upgrade Kafka to 2.7.0

2020-12-25 Thread dengziming (Jira)
dengziming created SPARK-33913: -- Summary: Upgrade Kafka to 2.7.0 Key: SPARK-33913 URL: https://issues.apache.org/jira/browse/SPARK-33913 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-33910) Simplify/Optimize conditional expressions

2020-12-25 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33910: Description: 1. Push down the foldable expressions through CaseWhen/If 2. Simplify conditional in

[jira] [Updated] (SPARK-33910) Simplify/Optimize conditional expressions

2020-12-25 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33910: Description: 1. Push down the foldable expressions through CaseWhen/If 2. Simplify conditional in

[jira] [Updated] (SPARK-33910) Simplify/Optimize conditional expressions

2020-12-25 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33910: Description: 1. Push down the foldable expressions through CaseWhen/If 2. Simplify conditional in

[jira] [Updated] (SPARK-33910) Simplify/Optimize conditional expressions

2020-12-25 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33910: Description: 1. Push down the foldable expressions through CaseWhen/If 2. Simplify conditional in

[jira] [Updated] (SPARK-33910) Simplify/Optimize conditional expressions

2020-12-25 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33910: Description: 1. Push down the foldable expressions through CaseWhen/If 2. Simplify conditional in

[jira] [Updated] (SPARK-33848) Push the UnaryExpression into (if / case) branches

2020-12-25 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33848: Summary: Push the UnaryExpression into (if / case) branches (was: Push the cast into (if / case)

[jira] [Updated] (SPARK-33910) Simplify/Optimize conditional expressions

2020-12-25 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33910: Description: Simplify/Optimize conditional expressions. We can improve these cases: 1. Reduce

[jira] [Updated] (SPARK-33910) Simplify/Optimize conditional expressions

2020-12-25 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33910: Summary: Simplify/Optimize conditional expressions (was: Simplify conditional) >

[jira] [Updated] (SPARK-33070) Optimizer rules for collection datatypes and SimpleHigherOrderFunction

2020-12-25 Thread Tanel Kiis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanel Kiis updated SPARK-33070: --- Affects Version/s: (was: 3.1.0) 3.2.0 > Optimizer rules for collection

[jira] [Updated] (SPARK-33888) JDBC SQL TIME type represents incorrectly as TimestampType, it should be physical Int in millis

2020-12-25 Thread Duc Hoa Nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duc Hoa Nguyen updated SPARK-33888: --- Summary: JDBC SQL TIME type represents incorrectly as TimestampType, it should be physical

[jira] [Updated] (SPARK-33888) AVRO SchemaConverts - logicalType TimeMillis not being converted to Timestamp type

2020-12-25 Thread Duc Hoa Nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duc Hoa Nguyen updated SPARK-33888: --- Description: Currently, for JDBC, SQL TIME type represents incorrectly as Spark

[jira] [Commented] (SPARK-33912) Refactor DependencyUtils ivy property parameter

2020-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254785#comment-17254785 ] Apache Spark commented on SPARK-33912: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-33912) Refactor DependencyUtils ivy property parameter

2020-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33912: Assignee: Apache Spark > Refactor DependencyUtils ivy property parameter >

[jira] [Assigned] (SPARK-33912) Refactor DependencyUtils ivy property parameter

2020-12-25 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33912: Assignee: (was: Apache Spark) > Refactor DependencyUtils ivy property parameter >

[jira] [Updated] (SPARK-33888) AVRO SchemaConverts - logicalType TimeMillis not being converted to Timestamp type

2020-12-25 Thread Duc Hoa Nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duc Hoa Nguyen updated SPARK-33888: --- Issue Type: Bug (was: New Feature) > AVRO SchemaConverts - logicalType TimeMillis not

[jira] [Updated] (SPARK-28123) String Functions: Add support btrim

2020-12-25 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-28123: --- Affects Version/s: (was: 3.0.0) 3.2.0 > String Functions: Add support

[jira] [Updated] (SPARK-30789) Support (IGNORE | RESPECT) NULLS for LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE

2020-12-25 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-30789: --- Affects Version/s: (was: 3.1.0) 3.2.0 > Support (IGNORE | RESPECT) NULLS

[jira] [Commented] (SPARK-33804) Cleanup "view bounds are deprecated" compilation warnings

2020-12-25 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254767#comment-17254767 ] Maxim Gekk commented on SPARK-33804: [~LuciferYang] Could you convert this (and your other similar