[jira] [Updated] (SPARK-28318) Decimal can only support precision up to 38

[ https://issues.apache.org/jira/browse/SPARK-28318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28318: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Decimal can only support pr

[jira] [Updated] (SPARK-28259) Date/Time Output Styles and Date Order Conventions

[ https://issues.apache.org/jira/browse/SPARK-28259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28259: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Date/Time Output Styles and

[jira] [Updated] (SPARK-28425) Add more Date/Time Operators

[ https://issues.apache.org/jira/browse/SPARK-28425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28425: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Add more Date/Time Operator

[jira] [Updated] (SPARK-28315) Decimal can not accept NaN as input

[ https://issues.apache.org/jira/browse/SPARK-28315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28315: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Decimal can not accept NaN

[jira] [Updated] (SPARK-28299) Evaluation of multiple CTE uses

[ https://issues.apache.org/jira/browse/SPARK-28299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28299: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Evaluation of multiple CTE

[jira] [Updated] (SPARK-28297) Handling outer links in CTE subquery expressions

[ https://issues.apache.org/jira/browse/SPARK-28297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28297: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Handling outer links in CTE

[jira] [Resolved] (SPARK-28307) Support Interval comparison

[ https://issues.apache.org/jira/browse/SPARK-28307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28307. --- Resolution: Duplicate > Support Interval comparison > --- > >

[jira] [Updated] (SPARK-28253) Date/Timestamp type have different low value and high value with Spark

[ https://issues.apache.org/jira/browse/SPARK-28253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28253: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Date/Timestamp type have di

[jira] [Closed] (SPARK-28307) Support Interval comparison

[ https://issues.apache.org/jira/browse/SPARK-28307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-28307. - > Support Interval comparison > --- > > Key: SPARK-28307 >

[jira] [Updated] (SPARK-28307) Support Interval comparison

[ https://issues.apache.org/jira/browse/SPARK-28307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28307: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Support Interval comparison

[jira] [Updated] (SPARK-28064) Order by does not accept a call to rank()

[ https://issues.apache.org/jira/browse/SPARK-28064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28064: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Order by does not accept a

[jira] [Updated] (SPARK-28065) ntile only accepting positive (>0) values

[ https://issues.apache.org/jira/browse/SPARK-28065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28065: -- Affects Version/s: (was: 3.0.0) 3.1.0 > ntile only accepting positi

[jira] [Updated] (SPARK-20856) support statement using nested joins

[ https://issues.apache.org/jira/browse/SPARK-20856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-20856: -- Affects Version/s: (was: 2.1.0) 3.1.0 > support statement using nes

[jira] [Updated] (SPARK-20856) support statement using nested joins

[ https://issues.apache.org/jira/browse/SPARK-20856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-20856: -- Labels: (was: bulk-closed) > support statement using nested joins >

[jira] [Updated] (SPARK-28068) `lag` second argument must be a literal

[ https://issues.apache.org/jira/browse/SPARK-28068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28068: -- Affects Version/s: (was: 3.0.0) 3.1.0 > `lag` second argument must

[jira] [Updated] (SPARK-27923) List all cases that PostgreSQL throws an exception but Spark SQL is NULL

[ https://issues.apache.org/jira/browse/SPARK-27923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27923: -- Affects Version/s: (was: 3.0.0) 3.1.0 > List all cases that Postgre

[jira] [Resolved] (SPARK-28010) Support ORDER BY ... USING syntax

[ https://issues.apache.org/jira/browse/SPARK-28010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28010. --- Resolution: Workaround Hi, All. I'll close this one since there exists a workaround for this

[jira] [Updated] (SPARK-21529) Improve the error message for unsupported Uniontype

[ https://issues.apache.org/jira/browse/SPARK-21529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21529: -- Affects Version/s: (was: 2.1.0) 3.1.0 > Improve the error message f

[jira] [Updated] (SPARK-27903) Improve parser error message for mismatched parentheses in expressions

[ https://issues.apache.org/jira/browse/SPARK-27903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27903: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Improve parser error messag

[jira] [Updated] (SPARK-27902) Improve error message for DESCRIBE statement

[ https://issues.apache.org/jira/browse/SPARK-27902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27902: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Improve error message for D

[jira] [Updated] (SPARK-27904) Improve parser error message for SHOW VIEW statement

[ https://issues.apache.org/jira/browse/SPARK-27904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27904: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Improve parser error messag

[jira] [Updated] (SPARK-27906) Improve parser error message for CREATE LOCAL TEMPORARY TABLE statement

[ https://issues.apache.org/jira/browse/SPARK-27906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27906: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Improve parser error messag

[jira] [Updated] (SPARK-27908) Improve parser error message for SELECT TOP statement

[ https://issues.apache.org/jira/browse/SPARK-27908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27908: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Improve parser error messag

[jira] [Updated] (SPARK-27912) Improve parser error message for CASE clause

[ https://issues.apache.org/jira/browse/SPARK-27912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27912: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Improve parser error messag

[jira] [Updated] (SPARK-27910) Improve parser error message for misused numeric identifiers

[ https://issues.apache.org/jira/browse/SPARK-27910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27910: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Improve parser error messag

[jira] [Updated] (SPARK-26345) Parquet support Column indexes

[ https://issues.apache.org/jira/browse/SPARK-26345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26345: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Parquet support Column inde

[jira] [Updated] (SPARK-26346) Upgrade parquet to 1.11.1

[ https://issues.apache.org/jira/browse/SPARK-26346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26346: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Upgrade parquet to 1.11.1 >

[jira] [Updated] (SPARK-23750) [Performance] Inner Join Elimination based on Informational RI constraints

[ https://issues.apache.org/jira/browse/SPARK-23750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23750: -- Affects Version/s: (was: 3.0.0) 3.1.0 > [Performance] Inner Join El

[jira] [Updated] (SPARK-21823) ALTER TABLE table statements such as RENAME and CHANGE columns should raise error if there are any dependent constraints.

[ https://issues.apache.org/jira/browse/SPARK-21823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21823: -- Affects Version/s: (was: 3.0.0) 3.1.0 > ALTER TABLE table statement

[jira] [Updated] (SPARK-22064) Add support for VALIDATE option to ALTER TABLE ADD CONSTRAINT command

[ https://issues.apache.org/jira/browse/SPARK-22064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-22064: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Add support for VALIDATE o

[jira] [Updated] (SPARK-22065) Add DDL support to modify constraint state for a given constraint

[ https://issues.apache.org/jira/browse/SPARK-22065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-22065: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Add DDL support to modify c

[jira] [Updated] (SPARK-21784) Add ALTER TABLE ADD CONSTRANT DDL to support defining primary key and foreign keys

[ https://issues.apache.org/jira/browse/SPARK-21784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21784: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Add ALTER TABLE ADD CONSTRA

[jira] [Updated] (SPARK-21824) DROP TABLE should automatically drop any dependent referential constraints or raise error.

[ https://issues.apache.org/jira/browse/SPARK-21824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21824: -- Affects Version/s: (was: 3.0.0) 3.1.0 > DROP TABLE should automati

[jira] [Updated] (SPARK-23752) [Performance] Existential Subquery to Inner Join

[ https://issues.apache.org/jira/browse/SPARK-23752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23752: -- Affects Version/s: (was: 3.0.0) 3.1.0 > [Performance] Existential S

[jira] [Updated] (SPARK-23756) [Performance] Redundant join elimination

[ https://issues.apache.org/jira/browse/SPARK-23756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23756: -- Affects Version/s: (was: 3.0.0) 3.1.0 > [Performance] Redundant joi

[jira] [Updated] (SPARK-23755) [Performance] Distinct elimination

[ https://issues.apache.org/jira/browse/SPARK-23755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23755: -- Affects Version/s: (was: 3.0.0) 3.1.0 > [Performance] Distinct elim

[jira] [Updated] (SPARK-23753) [Performance] Group By Push Down through Join

[ https://issues.apache.org/jira/browse/SPARK-23753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23753: -- Affects Version/s: (was: 3.0.0) 3.1.0 > [Performance] Group By Push

[jira] [Updated] (SPARK-23757) [Performance] Star schema detection improvements

[ https://issues.apache.org/jira/browse/SPARK-23757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23757: -- Affects Version/s: (was: 3.0.0) 3.1.0 > [Performance] Star schema d

[jira] [Updated] (SPARK-25604) Reduce the overall time costs in Jenkins tests

[ https://issues.apache.org/jira/browse/SPARK-25604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25604: -- Target Version/s: (was: 3.0.0) > Reduce the overall time costs in Jenkins tests > -

[jira] [Updated] (SPARK-25604) Reduce the overall time costs in Jenkins tests

[ https://issues.apache.org/jira/browse/SPARK-25604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25604: -- Target Version/s: 3.0.0 > Reduce the overall time costs in Jenkins tests > --

[jira] [Resolved] (SPARK-25608) HashAggregationQueryWithControlledFallbackSuite: multiple distinct multiple columns sets 38 seconds

[ https://issues.apache.org/jira/browse/SPARK-25608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25608. --- Resolution: Not A Problem > HashAggregationQueryWithControlledFallbackSuite: multiple distin

[jira] [Resolved] (SPARK-25607) HashAggregationQueryWithControlledFallbackSuite: single distinct column set 42 seconds

[ https://issues.apache.org/jira/browse/SPARK-25607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25607. --- Resolution: Not A Problem > HashAggregationQueryWithControlledFallbackSuite: single distinct

[jira] [Resolved] (SPARK-25613) HiveSparkSubmitSuite: dir 1 min 3 seconds

[ https://issues.apache.org/jira/browse/SPARK-25613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25613. --- Resolution: Duplicate > HiveSparkSubmitSuite: dir 1 min 3 seconds >

[jira] [Resolved] (SPARK-25614) HiveSparkSubmitSuite: SPARK-18989: DESC TABLE should not fail with format class not found 38 seconds

[ https://issues.apache.org/jira/browse/SPARK-25614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25614. --- Resolution: Duplicate > HiveSparkSubmitSuite: SPARK-18989: DESC TABLE should not fail with f

[jira] [Resolved] (SPARK-25616) KafkaSinkSuite: generic - write big data with small producer buffer 57 secs

[ https://issues.apache.org/jira/browse/SPARK-25616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25616. --- Resolution: Later > KafkaSinkSuite: generic - write big data with small producer buffer 57 s

[jira] [Resolved] (SPARK-25617) KafkaContinuousSinkSuite: generic - write big data with small producer buffer 56 secs

[ https://issues.apache.org/jira/browse/SPARK-25617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25617. --- Resolution: Later > KafkaContinuousSinkSuite: generic - write big data with small producer b

[jira] [Resolved] (SPARK-25628) DistributedSuite: recover from repeated node failures during shuffle-reduce 40 seconds

[ https://issues.apache.org/jira/browse/SPARK-25628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25628. --- Resolution: Later > DistributedSuite: recover from repeated node failures during shuffle-red

[jira] [Resolved] (SPARK-25619) WithAggregationKinesisStreamSuite: split and merge shards in a stream 2 min 15 sec

[ https://issues.apache.org/jira/browse/SPARK-25619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25619. --- Resolution: Later > WithAggregationKinesisStreamSuite: split and merge shards in a stream 2

[jira] [Resolved] (SPARK-25620) WithAggregationKinesisStreamSuite: failure recovery 1 min 36 seconds

[ https://issues.apache.org/jira/browse/SPARK-25620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25620. --- Resolution: Later > WithAggregationKinesisStreamSuite: failure recovery 1 min 36 seconds > -

[jira] [Updated] (SPARK-28191) Data Source - State - Read side

[ https://issues.apache.org/jira/browse/SPARK-28191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28191: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Data Source - State - Read

[jira] [Updated] (SPARK-28190) Data Source - State

[ https://issues.apache.org/jira/browse/SPARK-28190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28190: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Data Source - State > -

[jira] [Updated] (SPARK-28192) Data Source - State - Write side

[ https://issues.apache.org/jira/browse/SPARK-28192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28192: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Data Source - State - Write

[jira] [Updated] (SPARK-28210) Shuffle Storage API: Reads

[ https://issues.apache.org/jira/browse/SPARK-28210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28210: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Shuffle Storage API: Reads

[jira] [Updated] (SPARK-28592) Mark new Shuffle apis as @Experimental (instead of @Private)

[ https://issues.apache.org/jira/browse/SPARK-28592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28592: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Mark new Shuffle apis as @E

[jira] [Updated] (SPARK-30033) Use Spark plugin support to manage shuffle plugin lifecycle

[ https://issues.apache.org/jira/browse/SPARK-30033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30033: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Use Spark plugin support to

[jira] [Updated] (SPARK-28212) Shuffle Storage API: Shuffle Cleanup

[ https://issues.apache.org/jira/browse/SPARK-28212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28212: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Shuffle Storage API: Shuffl

[jira] [Updated] (SPARK-29302) dynamic partition overwrite with speculation enabled

[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] koert kuipers updated SPARK-29302: -- Affects Version/s: 3.0.0 > dynamic partition overwrite with speculation enabled >

[jira] [Updated] (SPARK-29302) dynamic partition overwrite with speculation enabled

[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] koert kuipers updated SPARK-29302: -- Affects Version/s: (was: 3.0.0) > dynamic partition overwrite with speculation enabled > -

[jira] [Resolved] (SPARK-31261) Avoid npe when reading bad csv input with `columnNameCorruptRecord` specified

[ https://issues.apache.org/jira/browse/SPARK-31261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31261. -- Fix Version/s: 3.0.0 2.4.6 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-31261) Avoid npe when reading bad csv input with `columnNameCorruptRecord` specified

[ https://issues.apache.org/jira/browse/SPARK-31261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-31261: Assignee: Zhenhua Wang > Avoid npe when reading bad csv input with `columnNameCorruptReco

[jira] [Resolved] (SPARK-31287) groupby().applyInPandas, groupby().cogroup().applyInPandas and mapInPandas should ignore type hints

[ https://issues.apache.org/jira/browse/SPARK-31287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31287. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28052 [https://gi

[jira] [Assigned] (SPARK-31287) groupby().applyInPandas, groupby().cogroup().applyInPandas and mapInPandas should ignore type hints

[ https://issues.apache.org/jira/browse/SPARK-31287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-31287: Assignee: Hyukjin Kwon > groupby().applyInPandas, groupby().cogroup().applyInPandas and m

[jira] [Resolved] (SPARK-31087) Add Back Multiple Removed APIs

[ https://issues.apache.org/jira/browse/SPARK-31087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-31087. - Fix Version/s: 3.0.0 Resolution: Fixed > Add Back Multiple Removed APIs > ---

[jira] [Updated] (SPARK-30363) Add Documentation for Refresh Resources

[ https://issues.apache.org/jira/browse/SPARK-30363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-30363: --- Parent: SPARK-28588 Issue Type: Sub-task (was: Improvement) > Add Documentation for Refresh

<    1   2