[jira] [Resolved] (SPARK-31087) Add Back Multiple Removed APIs

2020-03-28 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-31087. - Fix Version/s: 3.0.0 Resolution: Fixed > Add Back Multiple Removed APIs >

[jira] [Assigned] (SPARK-31287) groupby().applyInPandas, groupby().cogroup().applyInPandas and mapInPandas should ignore type hints

2020-03-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-31287: Assignee: Hyukjin Kwon > groupby().applyInPandas, groupby().cogroup().applyInPandas and

[jira] [Resolved] (SPARK-31287) groupby().applyInPandas, groupby().cogroup().applyInPandas and mapInPandas should ignore type hints

2020-03-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31287. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28052

[jira] [Resolved] (SPARK-31261) Avoid npe when reading bad csv input with `columnNameCorruptRecord` specified

2020-03-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31261. -- Fix Version/s: 3.0.0 2.4.6 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-31261) Avoid npe when reading bad csv input with `columnNameCorruptRecord` specified

2020-03-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-31261: Assignee: Zhenhua Wang > Avoid npe when reading bad csv input with

[jira] [Updated] (SPARK-29302) dynamic partition overwrite with speculation enabled

2020-03-28 Thread koert kuipers (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] koert kuipers updated SPARK-29302: -- Affects Version/s: (was: 3.0.0) > dynamic partition overwrite with speculation enabled >

[jira] [Updated] (SPARK-29302) dynamic partition overwrite with speculation enabled

2020-03-28 Thread koert kuipers (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] koert kuipers updated SPARK-29302: -- Affects Version/s: 3.0.0 > dynamic partition overwrite with speculation enabled >

[jira] [Updated] (SPARK-28592) Mark new Shuffle apis as @Experimental (instead of @Private)

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28592: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Mark new Shuffle apis as

[jira] [Updated] (SPARK-30033) Use Spark plugin support to manage shuffle plugin lifecycle

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30033: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Use Spark plugin support

[jira] [Updated] (SPARK-28212) Shuffle Storage API: Shuffle Cleanup

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28212: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Shuffle Storage API:

[jira] [Updated] (SPARK-28210) Shuffle Storage API: Reads

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28210: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Shuffle Storage API: Reads

[jira] [Updated] (SPARK-28191) Data Source - State - Read side

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28191: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Data Source - State - Read

[jira] [Updated] (SPARK-28190) Data Source - State

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28190: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Data Source - State >

[jira] [Updated] (SPARK-28192) Data Source - State - Write side

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28192: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Data Source - State -

[jira] [Resolved] (SPARK-25628) DistributedSuite: recover from repeated node failures during shuffle-reduce 40 seconds

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25628. --- Resolution: Later > DistributedSuite: recover from repeated node failures during

[jira] [Resolved] (SPARK-25619) WithAggregationKinesisStreamSuite: split and merge shards in a stream 2 min 15 sec

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25619. --- Resolution: Later > WithAggregationKinesisStreamSuite: split and merge shards in a stream 2

[jira] [Resolved] (SPARK-25620) WithAggregationKinesisStreamSuite: failure recovery 1 min 36 seconds

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25620. --- Resolution: Later > WithAggregationKinesisStreamSuite: failure recovery 1 min 36 seconds >

[jira] [Resolved] (SPARK-25617) KafkaContinuousSinkSuite: generic - write big data with small producer buffer 56 secs

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25617. --- Resolution: Later > KafkaContinuousSinkSuite: generic - write big data with small producer

[jira] [Resolved] (SPARK-25616) KafkaSinkSuite: generic - write big data with small producer buffer 57 secs

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25616. --- Resolution: Later > KafkaSinkSuite: generic - write big data with small producer buffer 57

[jira] [Resolved] (SPARK-25613) HiveSparkSubmitSuite: dir 1 min 3 seconds

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25613. --- Resolution: Duplicate > HiveSparkSubmitSuite: dir 1 min 3 seconds >

[jira] [Resolved] (SPARK-25614) HiveSparkSubmitSuite: SPARK-18989: DESC TABLE should not fail with format class not found 38 seconds

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25614. --- Resolution: Duplicate > HiveSparkSubmitSuite: SPARK-18989: DESC TABLE should not fail with

[jira] [Updated] (SPARK-25604) Reduce the overall time costs in Jenkins tests

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25604: -- Target Version/s: 3.0.0 > Reduce the overall time costs in Jenkins tests >

[jira] [Resolved] (SPARK-25608) HashAggregationQueryWithControlledFallbackSuite: multiple distinct multiple columns sets 38 seconds

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25608. --- Resolution: Not A Problem > HashAggregationQueryWithControlledFallbackSuite: multiple

[jira] [Resolved] (SPARK-25607) HashAggregationQueryWithControlledFallbackSuite: single distinct column set 42 seconds

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25607. --- Resolution: Not A Problem > HashAggregationQueryWithControlledFallbackSuite: single

[jira] [Updated] (SPARK-25604) Reduce the overall time costs in Jenkins tests

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25604: -- Target Version/s: (was: 3.0.0) > Reduce the overall time costs in Jenkins tests >

[jira] [Updated] (SPARK-23755) [Performance] Distinct elimination

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23755: -- Affects Version/s: (was: 3.0.0) 3.1.0 > [Performance] Distinct

[jira] [Updated] (SPARK-23752) [Performance] Existential Subquery to Inner Join

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23752: -- Affects Version/s: (was: 3.0.0) 3.1.0 > [Performance] Existential

[jira] [Updated] (SPARK-23756) [Performance] Redundant join elimination

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23756: -- Affects Version/s: (was: 3.0.0) 3.1.0 > [Performance] Redundant

[jira] [Updated] (SPARK-23753) [Performance] Group By Push Down through Join

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23753: -- Affects Version/s: (was: 3.0.0) 3.1.0 > [Performance] Group By

[jira] [Updated] (SPARK-23757) [Performance] Star schema detection improvements

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23757: -- Affects Version/s: (was: 3.0.0) 3.1.0 > [Performance] Star schema

[jira] [Updated] (SPARK-23750) [Performance] Inner Join Elimination based on Informational RI constraints

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23750: -- Affects Version/s: (was: 3.0.0) 3.1.0 > [Performance] Inner Join

[jira] [Updated] (SPARK-21823) ALTER TABLE table statements such as RENAME and CHANGE columns should raise error if there are any dependent constraints.

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21823: -- Affects Version/s: (was: 3.0.0) 3.1.0 > ALTER TABLE table

[jira] [Updated] (SPARK-22064) Add support for VALIDATE option to ALTER TABLE ADD CONSTRAINT command

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-22064: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Add support for VALIDATE

[jira] [Updated] (SPARK-22065) Add DDL support to modify constraint state for a given constraint

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-22065: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Add DDL support to modify

[jira] [Updated] (SPARK-21784) Add ALTER TABLE ADD CONSTRANT DDL to support defining primary key and foreign keys

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21784: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Add ALTER TABLE ADD

[jira] [Updated] (SPARK-21824) DROP TABLE should automatically drop any dependent referential constraints or raise error.

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21824: -- Affects Version/s: (was: 3.0.0) 3.1.0 > DROP TABLE should

[jira] [Updated] (SPARK-26346) Upgrade parquet to 1.11.1

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26346: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Upgrade parquet to 1.11.1

[jira] [Updated] (SPARK-26345) Parquet support Column indexes

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26345: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Parquet support Column

[jira] [Updated] (SPARK-27908) Improve parser error message for SELECT TOP statement

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27908: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Improve parser error

[jira] [Updated] (SPARK-27912) Improve parser error message for CASE clause

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27912: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Improve parser error

[jira] [Updated] (SPARK-27910) Improve parser error message for misused numeric identifiers

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27910: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Improve parser error

[jira] [Updated] (SPARK-27904) Improve parser error message for SHOW VIEW statement

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27904: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Improve parser error

[jira] [Updated] (SPARK-21529) Improve the error message for unsupported Uniontype

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21529: -- Affects Version/s: (was: 2.1.0) 3.1.0 > Improve the error message

[jira] [Updated] (SPARK-27903) Improve parser error message for mismatched parentheses in expressions

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27903: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Improve parser error

[jira] [Updated] (SPARK-27902) Improve error message for DESCRIBE statement

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27902: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Improve error message for

[jira] [Updated] (SPARK-27906) Improve parser error message for CREATE LOCAL TEMPORARY TABLE statement

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27906: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Improve parser error

[jira] [Resolved] (SPARK-28010) Support ORDER BY ... USING syntax

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28010. --- Resolution: Workaround Hi, All. I'll close this one since there exists a workaround for

[jira] [Updated] (SPARK-28068) `lag` second argument must be a literal

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28068: -- Affects Version/s: (was: 3.0.0) 3.1.0 > `lag` second argument must

[jira] [Updated] (SPARK-27923) List all cases that PostgreSQL throws an exception but Spark SQL is NULL

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27923: -- Affects Version/s: (was: 3.0.0) 3.1.0 > List all cases that

[jira] [Updated] (SPARK-20856) support statement using nested joins

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-20856: -- Labels: (was: bulk-closed) > support statement using nested joins >

[jira] [Updated] (SPARK-20856) support statement using nested joins

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-20856: -- Affects Version/s: (was: 2.1.0) 3.1.0 > support statement using

[jira] [Updated] (SPARK-28064) Order by does not accept a call to rank()

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28064: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Order by does not accept a

[jira] [Updated] (SPARK-28065) ntile only accepting positive (>0) values

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28065: -- Affects Version/s: (was: 3.0.0) 3.1.0 > ntile only accepting

[jira] [Resolved] (SPARK-28307) Support Interval comparison

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28307. --- Resolution: Duplicate > Support Interval comparison > --- > >

[jira] [Updated] (SPARK-28253) Date/Timestamp type have different low value and high value with Spark

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28253: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Date/Timestamp type have

[jira] [Closed] (SPARK-28307) Support Interval comparison

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-28307. - > Support Interval comparison > --- > > Key: SPARK-28307 >

[jira] [Updated] (SPARK-28307) Support Interval comparison

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28307: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Support Interval

[jira] [Updated] (SPARK-28318) Decimal can only support precision up to 38

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28318: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Decimal can only support

[jira] [Updated] (SPARK-28259) Date/Time Output Styles and Date Order Conventions

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28259: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Date/Time Output Styles

[jira] [Updated] (SPARK-28425) Add more Date/Time Operators

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28425: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Add more Date/Time

[jira] [Updated] (SPARK-28315) Decimal can not accept NaN as input

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28315: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Decimal can not accept NaN

[jira] [Updated] (SPARK-28299) Evaluation of multiple CTE uses

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28299: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Evaluation of multiple CTE

[jira] [Updated] (SPARK-28297) Handling outer links in CTE subquery expressions

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28297: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Handling outer links in

[jira] [Updated] (SPARK-28501) frame bound must be a literal

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28501: -- Affects Version/s: (was: 3.0.0) 3.1.0 > frame bound must be a

[jira] [Updated] (SPARK-28437) Different format when casting interval type to string type

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28437: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Different format when

[jira] [Updated] (SPARK-28405) Join with USING caluse doesn't hide original tables

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28405: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Join with USING caluse

[jira] [Updated] (SPARK-28409) SELECT FROM syntax

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28409: -- Affects Version/s: (was: 3.0.0) 3.1.0 > SELECT FROM syntax >

[jira] [Updated] (SPARK-28428) Spark `exclude` always expecting `()`

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28428: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Spark `exclude` always

[jira] [Resolved] (SPARK-28557) Support empty select list

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28557. --- Resolution: Duplicate > Support empty select list > - > >

[jira] [Updated] (SPARK-28506) not handling usage of group function and window function at some conditions

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28506: -- Affects Version/s: (was: 3.0.0) 3.1.0 > not handling usage of

[jira] [Closed] (SPARK-28557) Support empty select list

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-28557. - > Support empty select list > - > > Key: SPARK-28557 >

[jira] [Updated] (SPARK-28508) Support for range frame+row frame in the same query

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28508: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Support for range

[jira] [Updated] (SPARK-28664) ORDER BY in aggregate function

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28664: -- Affects Version/s: (was: 3.0.0) 3.1.0 > ORDER BY in aggregate

[jira] [Updated] (SPARK-28646) Allow usage of `count` only for parameterless aggregate function

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28646: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Allow usage of `count`

[jira] [Resolved] (SPARK-29117) char data type should support in Spark

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29117. --- Resolution: Won't Do According to SPARK-31147, this issue is closed as 'Won't Do'. > char

[jira] [Updated] (SPARK-29034) String Constants with C-style Escapes

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29034: -- Affects Version/s: (was: 3.0.0) 3.1.0 > String Constants with

[jira] [Closed] (SPARK-29117) char data type should support in Spark

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-29117. - > char data type should support in Spark > -- > >

[jira] [Updated] (SPARK-28754) [UDF] Supports for alter, rename, owner change should be supported in Spark

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28754: -- Affects Version/s: (was: 3.0.0) 3.1.0 > [UDF] Supports for alter,

[jira] [Resolved] (SPARK-28973) Add TimeType to Catalyst

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28973. --- Resolution: Won't Do According to the discussion on the PR, this issue is closed as 'Won't

[jira] [Closed] (SPARK-28973) Add TimeType to Catalyst

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-28973. - > Add TimeType to Catalyst > > > Key: SPARK-28973 >

[jira] [Updated] (SPARK-29006) Support special date/timestamp values `infinity`/`-infinity`

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29006: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Support special

[jira] [Updated] (SPARK-28973) Add TimeType to Catalyst

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28973: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Add TimeType to Catalyst >

[jira] [Updated] (SPARK-29024) Ignore case while resolving time zones

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29024: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Ignore case while

[jira] [Updated] (SPARK-29406) Interval output styles

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29406: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Interval output styles >

[jira] [Updated] (SPARK-29394) Support ISO 8601 format for intervals

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29394: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Support ISO 8601 format

[jira] [Updated] (SPARK-29370) Interval strings without explicit unit markings

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29370: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Interval strings without

[jira] [Updated] (SPARK-29388) Construct intervals from the `millenniums`, `centuries` or `decades` units

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29388: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Construct intervals from

[jira] [Updated] (SPARK-29389) Support synonyms for interval units

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29389: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Support synonyms for

[jira] [Updated] (SPARK-29383) Support the optional prefix `@` in interval strings

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29383: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Support the optional

[jira] [Updated] (SPARK-29384) Support `ago` in interval strings

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29384: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Support `ago` in interval

[jira] [Updated] (SPARK-29395) Precision of the interval type

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29395: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Precision of the interval

[jira] [Updated] (SPARK-29407) Support syntax for zero interval

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29407: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Support syntax for zero

[jira] [Updated] (SPARK-29524) Unordered interval units

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29524: -- Affects Version/s: (was: 2.4.4) 3.1.0 > Unordered interval units >

[jira] [Updated] (SPARK-29631) Support ANSI SQL CREATE SEQUENCE

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29631: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Support ANSI SQL CREATE

[jira] [Updated] (SPARK-27951) ANSI SQL: NTH_VALUE function

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27951: -- Affects Version/s: (was: 3.0.0) 3.1.0 > ANSI SQL: NTH_VALUE

[jira] [Updated] (SPARK-30070) ANSI-F053: Overlaps datetimes predicate support

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30070: -- Affects Version/s: (was: 3.0.0) 3.1.0 > ANSI-F053: Overlaps

[jira] [Updated] (SPARK-28447) ANSI SQL: Unicode escapes in literals

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28447: -- Affects Version/s: (was: 3.0.0) 3.1.0 > ANSI SQL: Unicode escapes

[jira] [Updated] (SPARK-28580) ANSI SQL: unique predicate

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28580: -- Affects Version/s: (was: 3.0.0) 3.1.0 > ANSI SQL: unique predicate

[jira] [Updated] (SPARK-24497) ANSI SQL: Recursive query

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-24497: -- Affects Version/s: (was: 3.0.0) 3.1.0 > ANSI SQL: Recursive query

[jira] [Updated] (SPARK-29098) Test both ANSI mode and Spark mode

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29098: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Test both ANSI mode and

  1   2   >