[jira] [Updated] (SPARK-30755) Support Hive 1.2.1's Serde after making built-in Hive to 2.3

2020-02-08 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30755: Target Version/s: 3.0.0 Description: {noformat} 2020-01-27 05:11:20.446 - stderr> 20/01/27

[jira] [Updated] (SPARK-30755) Support Hive 1.2.1's Serde after making built-in Hive to 2.3

2020-02-08 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30755: Priority: Blocker (was: Major) > Support Hive 1.2.1's Serde after making built-in Hive to 2.3 >

[jira] [Updated] (SPARK-30651) EXPLAIN EXTENDED does not show detail information for aggregate operators

2020-02-07 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30651: Issue Type: Bug (was: Improvement) > EXPLAIN EXTENDED does not show detail information for aggregate

[jira] [Reopened] (SPARK-24884) Implement regexp_extract_all

2020-02-07 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-24884: - > Implement regexp_extract_all > > > Key: SPARK-24884 >

[jira] [Assigned] (SPARK-30579) Document ORDER BY Clause of SELECT statement in SQL Reference.

2020-02-07 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-30579: --- Assignee: Dilip Biswal > Document ORDER BY Clause of SELECT statement in SQL Reference. >

[jira] [Resolved] (SPARK-30579) Document ORDER BY Clause of SELECT statement in SQL Reference.

2020-02-07 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-30579. - Fix Version/s: 3.0.0 Resolution: Fixed > Document ORDER BY Clause of SELECT statement in SQL

[jira] [Commented] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

2020-02-06 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031860#comment-17031860 ] Xiao Li commented on SPARK-30668: - I think this is still not resolved. Spark 3.0 should not silently

[jira] [Reopened] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

2020-02-06 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-30668: - > to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern > "-MM-dd'T'HH:mm:ss.SSSz" >

[jira] [Resolved] (SPARK-30719) AQE should not issue a "not supported" warning for queries being by-passed

2020-02-06 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-30719. - Fix Version/s: 3.0.0 Assignee: Wenchen Fan Resolution: Fixed > AQE should not issue a

[jira] [Commented] (SPARK-28880) ANSI SQL: Bracketed comments

2020-02-05 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030974#comment-17030974 ] Xiao Li commented on SPARK-28880: -

[jira] [Resolved] (SPARK-30636) Unable to add packages on spark-packages.org

2020-02-05 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-30636. - Fix Version/s: 3.0.0 Assignee: Cheng Lian (was: Burak Yavuz) Resolution: Fixed >

[jira] [Commented] (SPARK-30703) Add a documentation page for ANSI mode

2020-02-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028251#comment-17028251 ] Xiao Li commented on SPARK-30703: - [~maropu] Could you help this? > Add a documentation page for ANSI

[jira] [Created] (SPARK-30703) Add a documentation page for ANSI mode

2020-02-01 Thread Xiao Li (Jira)
Xiao Li created SPARK-30703: --- Summary: Add a documentation page for ANSI mode Key: SPARK-30703 URL: https://issues.apache.org/jira/browse/SPARK-30703 Project: Spark Issue Type: Documentation

[jira] [Updated] (SPARK-27946) Hive DDL to Spark DDL conversion USING "show create table"

2020-01-31 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27946: Description: This patch adds a DDL command SHOW CREATE TABLE AS SERDE. It is used to generate Hive DDL

[jira] [Resolved] (SPARK-27946) Hive DDL to Spark DDL conversion USING "show create table"

2020-01-31 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27946. - Fix Version/s: 3.0.0 Assignee: L. C. Hsieh Resolution: Fixed > Hive DDL to Spark DDL

[jira] [Resolved] (SPARK-30508) Add DataFrameReader.executeCommand API for external datasource

2020-01-31 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-30508. - Fix Version/s: 3.0.0 Resolution: Fixed > Add DataFrameReader.executeCommand API for external

[jira] [Assigned] (SPARK-30508) Add DataFrameReader.executeCommand API for external datasource

2020-01-31 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-30508: --- Assignee: wuyi > Add DataFrameReader.executeCommand API for external datasource >

[jira] [Commented] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

2020-01-29 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17025673#comment-17025673 ] Xiao Li commented on SPARK-30668: - [~hvanhovell] Making it configurable looks necessary. Today, Michael

[jira] [Commented] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

2020-01-28 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17025644#comment-17025644 ] Xiao Li commented on SPARK-30668: - Can we let users choose different parsing mechanisms between

[jira] [Commented] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

2020-01-28 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17025643#comment-17025643 ] Xiao Li commented on SPARK-30668: - This will make the migration very painful. This is not mentioned in

[jira] [Assigned] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

2020-01-28 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-30668: --- Assignee: (was: Xiao Li) > to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using

[jira] [Assigned] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

2020-01-28 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-30668: --- Assignee: Xiao Li > to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern >

[jira] [Commented] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

2020-01-28 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17025467#comment-17025467 ] Xiao Li commented on SPARK-30668: - cc [~maxgekk] > to_timestamp failed to parse

[jira] [Updated] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern

2020-01-28 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30668: Summary: to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern (was: to_timestamp

[jira] [Updated] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

2020-01-28 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30668: Summary: to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern

[jira] [Updated] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800

2020-01-28 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30668: Description: {code:java} SELECT to_timestamp("2020-01-27T20:06:11.847-0800",

[jira] [Created] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800

2020-01-28 Thread Xiao Li (Jira)
Xiao Li created SPARK-30668: --- Summary: to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 Key: SPARK-30668 URL: https://issues.apache.org/jira/browse/SPARK-30668 Project: Spark Issue Type:

[jira] [Created] (SPARK-30644) Remove query index from the golden files of SQLQueryTestSuite

2020-01-25 Thread Xiao Li (Jira)
Xiao Li created SPARK-30644: --- Summary: Remove query index from the golden files of SQLQueryTestSuite Key: SPARK-30644 URL: https://issues.apache.org/jira/browse/SPARK-30644 Project: Spark Issue

[jira] [Updated] (SPARK-30636) Unable to add packages on spark-packages.org

2020-01-24 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30636: Priority: Critical (was: Blocker) > Unable to add packages on spark-packages.org >

[jira] [Assigned] (SPARK-30636) Unable to add packages on spark-packages.org

2020-01-24 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-30636: --- Assignee: Burak Yavuz > Unable to add packages on spark-packages.org >

[jira] [Updated] (SPARK-30636) Unable to add packages on spark-packages.org

2020-01-24 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30636: Affects Version/s: (was: 3.0.0) 2.4.4 > Unable to add packages on

[jira] [Created] (SPARK-30636) Unable to add packages on spark-packages.org

2020-01-24 Thread Xiao Li (Jira)
Xiao Li created SPARK-30636: --- Summary: Unable to add packages on spark-packages.org Key: SPARK-30636 URL: https://issues.apache.org/jira/browse/SPARK-30636 Project: Spark Issue Type: Bug

[jira] [Reopened] (SPARK-14643) Remove overloaded methods which become ambiguous in Scala 2.12

2020-01-23 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-14643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-14643: - Assignee: (was: Josh Rosen) > Remove overloaded methods which become ambiguous in Scala 2.12 >

[jira] [Updated] (SPARK-14643) Remove overloaded methods which become ambiguous in Scala 2.12

2020-01-23 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-14643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-14643: Priority: Blocker (was: Major) > Remove overloaded methods which become ambiguous in Scala 2.12 >

[jira] [Updated] (SPARK-14643) Remove overloaded methods which become ambiguous in Scala 2.12

2020-01-23 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-14643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-14643: Target Version/s: 3.0.0 > Remove overloaded methods which become ambiguous in Scala 2.12 >

[jira] [Reopened] (SPARK-30535) Migrate ALTER TABLE commands to the new resolution framework

2020-01-22 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-30535: - Assignee: (was: Terry Kim) > Migrate ALTER TABLE commands to the new resolution framework >

[jira] [Assigned] (SPARK-30549) Fix the subquery metrics showing issue in UI When enable AQE

2020-01-22 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-30549: --- Assignee: Ke Jia > Fix the subquery metrics showing issue in UI When enable AQE >

[jira] [Resolved] (SPARK-30549) Fix the subquery metrics showing issue in UI When enable AQE

2020-01-22 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-30549. - Fix Version/s: 3.0.0 Resolution: Fixed > Fix the subquery metrics showing issue in UI When

[jira] [Updated] (SPARK-30546) Make interval type more future-proofing

2020-01-21 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30546: Priority: Blocker (was: Major) > Make interval type more future-proofing >

[jira] [Updated] (SPARK-30546) Make interval type more future-proofing

2020-01-21 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30546: Issue Type: New Feature (was: Improvement) > Make interval type more future-proofing >

[jira] [Reopened] (SPARK-27878) Support ARRAY(sub-SELECT) expressions

2020-01-21 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-27878: - > Support ARRAY(sub-SELECT) expressions > - > > Key:

[jira] [Commented] (SPARK-28329) SELECT INTO syntax

2020-01-21 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020597#comment-17020597 ] Xiao Li commented on SPARK-28329: - This conflicts with the SQL standard. > The SQL standard uses

[jira] [Assigned] (SPARK-18455) General support for correlated subquery processing

2020-01-18 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-18455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-18455: --- Assignee: Dilip Biswal > General support for correlated subquery processing >

[jira] [Commented] (SPARK-28531) Improve Extract Python UDFs optimizer rule to enforce idempotence

2020-01-18 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17018818#comment-17018818 ] Xiao Li commented on SPARK-28531: - [~mauzhang] Feel free to submit a PR > Improve Extract Python UDFs

[jira] [Resolved] (SPARK-23264) Support interval values without INTERVAL clauses

2020-01-03 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-23264. - Resolution: Later > Support interval values without INTERVAL clauses >

[jira] [Reopened] (SPARK-23264) Support interval values without INTERVAL clauses

2020-01-03 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-23264: - > Support interval values without INTERVAL clauses > > >

[jira] [Assigned] (SPARK-29568) Add flag to stop existing stream when new copy starts

2020-01-02 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-29568: --- Assignee: Burak Yavuz > Add flag to stop existing stream when new copy starts >

[jira] [Resolved] (SPARK-29568) Add flag to stop existing stream when new copy starts

2020-01-02 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-29568. - Fix Version/s: 3.0.0 Resolution: Fixed > Add flag to stop existing stream when new copy starts >

[jira] [Updated] (SPARK-30082) Zeros are being treated as NaNs

2019-12-29 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30082: Labels: correctness (was: ) > Zeros are being treated as NaNs > --- > >

[jira] [Reopened] (SPARK-29390) Add the justify_days(), justify_hours() and justify_interval() functions

2019-12-29 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-29390: - > Add the justify_days(), justify_hours() and justify_interval() functions >

[jira] [Resolved] (SPARK-29390) Add the justify_days(), justify_hours() and justify_interval() functions

2019-12-29 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-29390. - Resolution: Later > Add the justify_days(), justify_hours() and justify_interval() functions >

[jira] [Commented] (SPARK-29245) CCE during creating HiveMetaStoreClient

2019-12-23 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002539#comment-17002539 ] Xiao Li commented on SPARK-29245: - Since JDK support is experimental, it is not a blocker of Spark 3.0.

[jira] [Updated] (SPARK-29245) CCE during creating HiveMetaStoreClient

2019-12-23 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29245: Priority: Major (was: Blocker) > CCE during creating HiveMetaStoreClient >

[jira] [Commented] (SPARK-30316) data size boom after shuffle writing dataframe save as parquet

2019-12-23 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002529#comment-17002529 ] Xiao Li commented on SPARK-30316: - The compression ratio depends on your data layout, instead of number

[jira] [Updated] (SPARK-30316) data size boom after shuffle writing dataframe save as parquet

2019-12-23 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30316: Priority: Major (was: Blocker) > data size boom after shuffle writing dataframe save as parquet >

[jira] [Assigned] (SPARK-27762) Support user provided avro schema for writing fields with different ordering

2019-12-23 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-27762: --- Assignee: DB Tsai > Support user provided avro schema for writing fields with different ordering >

[jira] [Updated] (SPARK-26002) SQL date operators calculates with incorrect dayOfYears for dates before 1500-03-01

2019-12-23 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-26002: Labels: correctness (was: ) > SQL date operators calculates with incorrect dayOfYears for dates before

[jira] [Updated] (SPARK-27762) Support user provided avro schema for writing fields with different ordering

2019-12-22 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27762: Issue Type: Bug (was: New Feature) > Support user provided avro schema for writing fields with different

[jira] [Resolved] (SPARK-30291) Catch the exception when do materialize in AQE

2019-12-20 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-30291. - Fix Version/s: 3.0.0 Assignee: Ke Jia Resolution: Fixed > Catch the exception when do

[jira] [Updated] (SPARK-29245) CCE during creating HiveMetaStoreClient

2019-12-14 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29245: Target Version/s: 3.0.0 > CCE during creating HiveMetaStoreClient >

[jira] [Updated] (SPARK-28264) Revisiting Python / pandas UDF

2019-12-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28264: Priority: Blocker (was: Critical) > Revisiting Python / pandas UDF > -- > >

[jira] [Commented] (SPARK-29406) Interval output styles

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985725#comment-16985725 ] Xiao Li commented on SPARK-29406: - How about the other systems? > Interval output styles >

[jira] [Commented] (SPARK-29384) Support `ago` in interval strings

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985723#comment-16985723 ] Xiao Li commented on SPARK-29384: - How about the other systems? > Support `ago` in interval strings >

[jira] [Commented] (SPARK-29383) Support the optional prefix `@` in interval strings

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985724#comment-16985724 ] Xiao Li commented on SPARK-29383: - How about the other systems? > Support the optional prefix `@` in

[jira] [Commented] (SPARK-29514) String function: string_to_array

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985721#comment-16985721 ] Xiao Li commented on SPARK-29514: - Any other system besides postgreSQL support this? If not, this

[jira] [Updated] (SPARK-29699) Different answers in nested aggregates with window functions

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29699: Labels: correctness (was: ) > Different answers in nested aggregates with window functions >

[jira] [Updated] (SPARK-29699) Different answers in nested aggregates with window functions

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29699: Target Version/s: 3.0.0 > Different answers in nested aggregates with window functions >

[jira] [Updated] (SPARK-29701) Different answers when empty input given in GROUPING SETS

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29701: Target Version/s: 3.0.0 > Different answers when empty input given in GROUPING SETS >

[jira] [Updated] (SPARK-29701) Different answers when empty input given in GROUPING SETS

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29701: Labels: correctness (was: ) > Different answers when empty input given in GROUPING SETS >

[jira] [Issue Comment Deleted] (SPARK-29982) Add built-in Array Functions: array_append

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29982: Comment: was deleted (was: How useful is this function? Is PostgreSQL the only database that supports

[jira] [Commented] (SPARK-29891) Add built-in Array Functions: array_length

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985720#comment-16985720 ] Xiao Li commented on SPARK-29891: - This is like our built-in function size, right? > Add built-in Array

[jira] [Commented] (SPARK-29984) Add built-in Array Functions: array_ndims

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985718#comment-16985718 ] Xiao Li commented on SPARK-29984: - How useful is this function? Is PostgreSQL the only database that

[jira] [Commented] (SPARK-29982) Add built-in Array Functions: array_append

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985719#comment-16985719 ] Xiao Li commented on SPARK-29982: - How useful is this function? Is PostgreSQL the only database that

[jira] [Resolved] (SPARK-29775) Support truncate multiple tables

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-29775. - Resolution: Later > Support truncate multiple tables > > >

[jira] [Commented] (SPARK-29775) Support truncate multiple tables

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985717#comment-16985717 ] Xiao Li commented on SPARK-29775: - The syntax is not very consistent with our existing syntax that has

[jira] [Resolved] (SPARK-29737) Concat for array in Spark SQL is not the one in PostgreSQL but array_cat

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-29737. - Resolution: Later > Concat for array in Spark SQL is not the one in PostgreSQL but array_cat >

[jira] [Commented] (SPARK-29737) Concat for array in Spark SQL is not the one in PostgreSQL but array_cat

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985714#comment-16985714 ] Xiao Li commented on SPARK-29737: - We do not need to change the Spark behavior, although it is different

[jira] [Updated] (SPARK-29716) Support User-defined Types

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29716: Description: [https://www.postgresql.org/docs/9.5/xtypes.html]   was:

[jira] [Updated] (SPARK-29716) Support User-defined Types

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29716: Description: [|https://www.postgresql.org/docs/current/sql-createtype.html]

[jira] [Updated] (SPARK-29716) Support User-defined Types

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29716: Summary: Support User-defined Types (was: Support [CREATE|DROP] TYPE) > Support User-defined Types >

[jira] [Commented] (SPARK-29660) Dropping columns and changing column names/types are prohibited in VIEW definition

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985706#comment-16985706 ] Xiao Li commented on SPARK-29660: - It is cool that Spark supports them, but pgSQL has not supported them

[jira] [Resolved] (SPARK-29660) Dropping columns and changing column names/types are prohibited in VIEW definition

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-29660. - Resolution: Invalid > Dropping columns and changing column names/types are prohibited in VIEW >

[jira] [Resolved] (SPARK-29684) Support divide/multiply for interval types

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-29684. - Resolution: Duplicate > Support divide/multiply for interval types >

[jira] [Resolved] (SPARK-29451) Some queries with divisions in SQL windows are failling in Thrift

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-29451. - Resolution: Cannot Reproduce > Some queries with divisions in SQL windows are failling in Thrift >

[jira] [Commented] (SPARK-29451) Some queries with divisions in SQL windows are failling in Thrift

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985704#comment-16985704 ] Xiao Li commented on SPARK-29451: - Please try the latest version. I am closing this JIRA. Feel free to

[jira] [Commented] (SPARK-29650) Discard a NULL constant in LIMIT

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985701#comment-16985701 ] Xiao Li commented on SPARK-29650: - Let us first close this JIRA. If needed, we can open a separate Jira

[jira] [Resolved] (SPARK-29650) Discard a NULL constant in LIMIT

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-29650. - Resolution: Invalid > Discard a NULL constant in LIMIT > > >

[jira] [Commented] (SPARK-29661) Support cascaded syntax in CREATE SCHEMA

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985699#comment-16985699 ] Xiao Li commented on SPARK-29661: - Is it pgSQL specific? If yes, maybe the value to Spark community is

[jira] [Commented] (SPARK-29591) Support data insertion in a different order if you wish or even omit some columns in spark sql also like postgresql

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985697#comment-16985697 ] Xiao Li commented on SPARK-29591: - Ignoring the values is hard to support now since we need to define

[jira] [Commented] (SPARK-29632) Support ALTER TABLE [relname] SET SCHEMA [dbname]

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985694#comment-16985694 ] Xiao Li commented on SPARK-29632: - It is risky to support this. For the managed tables, the data will be

[jira] [Commented] (SPARK-29573) Spark should work as PostgreSQL when using + Operator

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985690#comment-16985690 ] Xiao Li commented on SPARK-29573: - We are unable to break our existing Spark behavior. Please consider

[jira] [Resolved] (SPARK-29573) Spark should work as PostgreSQL when using + Operator

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-29573. - Resolution: Won't Fix > Spark should work as PostgreSQL when using + Operator >

[jira] [Commented] (SPARK-29587) Real data type is not supported in Spark SQL which is supporting in postgresql

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985686#comment-16985686 ] Xiao Li commented on SPARK-29587: - Please consider using FLOAT, DOUBLE or DECIMAL instead.  > Real data

[jira] [Resolved] (SPARK-29587) Real data type is not supported in Spark SQL which is supporting in postgresql

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-29587. - Resolution: Won't Fix > Real data type is not supported in Spark SQL which is supporting in postgresql

[jira] [Resolved] (SPARK-29540) Thrift in some cases can't parse string to date

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-29540. - Resolution: Won't Fix > Thrift in some cases can't parse string to date >

[jira] [Commented] (SPARK-30042) Add built-in Array Functions: array_dims

2019-12-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985683#comment-16985683 ] Xiao Li commented on SPARK-30042: - How useful is this function? Is PostgreSQL the only database that

[jira] [Resolved] (SPARK-29989) Update release-script for `hive-1.2/2.3` combination

2019-11-27 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-29989. - Fix Version/s: 3.0.0 Resolution: Fixed > Update release-script for `hive-1.2/2.3` combination >

[jira] [Commented] (SPARK-29903) Add documentation for recursiveFileLookup

2019-11-27 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983833#comment-16983833 ] Xiao Li commented on SPARK-29903: - We also need to update the corresponding parts in PySpark  > Add

[jira] [Resolved] (SPARK-29906) Reading of csv file fails with adaptive execution turned on

2019-11-19 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-29906. - Fix Version/s: 3.0.0 Resolution: Fixed > Reading of csv file fails with adaptive execution

[jira] [Assigned] (SPARK-29906) Reading of csv file fails with adaptive execution turned on

2019-11-19 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-29906: --- Assignee: Wenchen Fan > Reading of csv file fails with adaptive execution turned on >

<    1   2   3   4   5   6   7   8   9   10   >