[jira] [Assigned] (SPARK-48280) Improve collation testing surface area using expression walking

2024-07-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48280: --- Assignee: Mihailo Milosevic > Improve collation testing surface area using expression

[jira] [Resolved] (SPARK-48280) Improve collation testing surface area using expression walking

2024-07-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48280. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46801

[jira] [Resolved] (SPARK-48715) UTF8String to String conversions should use Unicode replacement logic

2024-07-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48715. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47131

[jira] [Assigned] (SPARK-48715) UTF8String to String conversions should use Unicode replacement logic

2024-07-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48715: --- Assignee: Uroš Bojanić > UTF8String to String conversions should use Unicode replacement

[jira] [Resolved] (SPARK-48790) Use checkDatasetUnorderly in DeprecatedDatasetAggregatorSuite

2024-07-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48790. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47196

[jira] [Deleted] (SPARK-48349) [M1] Support for debugging

2024-07-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan deleted SPARK-48349: > [M1] Support for debugging > -- > > Key: SPARK-48349 >

[jira] [Deleted] (SPARK-48579) [M1] Merge DatabricksSqlParser with SparkSqlParser

2024-07-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan deleted SPARK-48579: > [M1] Merge DatabricksSqlParser with SparkSqlParser >

[jira] [Deleted] (SPARK-48527) [M0] Thrift investigation

2024-07-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan deleted SPARK-48527: > [M0] Thrift investigation > - > > Key: SPARK-48527 >

[jira] [Resolved] (SPARK-48760) Introduce ALTER TABLE ... CLUSTER BY to change clustering columns

2024-07-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48760. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47156

[jira] [Resolved] (SPARK-48759) Add migration doc for CREATE TABLE AS SELECT behavior change behavior change since Spark 3.4

2024-07-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48759. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47152

[jira] [Resolved] (SPARK-48697) Add collation aware string filters

2024-07-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48697. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47059

[jira] [Resolved] (SPARK-48737) Reduce number of exception creations for default expression analysis

2024-07-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48737. - Resolution: Fixed Issue resolved by pull request 47124

[jira] [Assigned] (SPARK-48737) Reduce number of exception creations for default expression analysis

2024-07-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48737: --- Assignee: Uros Stankovic > Reduce number of exception creations for default expression

[jira] [Assigned] (SPARK-48747) Add code point iterator to UTF8String

2024-07-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48747: --- Assignee: Uroš Bojanić > Add code point iterator to UTF8String >

[jira] [Resolved] (SPARK-48747) Add code point iterator to UTF8String

2024-07-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48747. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47123

[jira] [Resolved] (SPARK-48668) Support ALTER NAMESPACE ... UNSET PROPERTIES in v2

2024-06-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48668. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47038

[jira] [Assigned] (SPARK-48668) Support ALTER NAMESPACE ... UNSET PROPERTIES in v2

2024-06-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48668: --- Assignee: BingKun Pan > Support ALTER NAMESPACE ... UNSET PROPERTIES in v2 >

[jira] [Resolved] (SPARK-48282) Alter string search logic for: replace, find_in_set (UTF8_BINARY_LCASE)

2024-06-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48282. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46682

[jira] [Resolved] (SPARK-48682) Use ICU in InitCap expression (UTF8_BINARY collation)

2024-06-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48682. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47100

[jira] [Resolved] (SPARK-48428) IllegalStateException due to nested column aliasing

2024-06-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48428. - Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-48428) IllegalStateException due to nested column aliasing

2024-06-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48428: --- Assignee: Emil Ejbyfeldt > IllegalStateException due to nested column aliasing >

[jira] [Resolved] (SPARK-48729) Add a UserDefinedFunction interface to represent a SQL function

2024-06-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48729. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47108

[jira] [Assigned] (SPARK-48729) Add a UserDefinedFunction interface to represent a SQL function

2024-06-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48729: --- Assignee: Allison Wang > Add a UserDefinedFunction interface to represent a SQL function >

[jira] [Assigned] (SPARK-47353) Mode expression for strings (all collations)

2024-06-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47353: --- Assignee: Gideon P > Mode expression for strings (all collations) >

[jira] [Resolved] (SPARK-47353) Mode expression for strings (all collations)

2024-06-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47353. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46597

[jira] [Assigned] (SPARK-48670) Providing suggestion as part of error message when invalid collation name is given

2024-06-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48670: --- Assignee: Aleksandar Tomic > Providing suggestion as part of error message when invalid

[jira] [Resolved] (SPARK-48670) Providing suggestion as part of error message when invalid collation name is given

2024-06-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48670. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47040

[jira] [Resolved] (SPARK-48699) Refine collation API

2024-06-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48699. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47014

[jira] [Resolved] (SPARK-48718) Got incastable error when deserializer in cogroup is resolved during application of DeduplicateRelation rule

2024-06-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48718. - Fix Version/s: 4.0.0 Assignee: Xinyi Yu Resolution: Fixed > Got incastable

[jira] [Updated] (SPARK-43781) IllegalStateException when cogrouping two datasets derived from the same source

2024-06-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-43781: Fix Version/s: 4.0.0 (was: 3.5.0) > IllegalStateException when cogrouping

[jira] [Resolved] (SPARK-48578) Add new expressions for UTF8 string validation

2024-06-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48578. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46845

[jira] [Assigned] (SPARK-48578) Add new expressions for UTF8 string validation

2024-06-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48578: --- Assignee: Uroš Bojanić > Add new expressions for UTF8 string validation >

[jira] [Resolved] (SPARK-48681) Use ICU in Lower/Upper expressions (UTF8_BINARY collation)

2024-06-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48681. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47043

[jira] [Assigned] (SPARK-48675) Cache table doesn't work with collated column

2024-06-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48675: --- Assignee: Nikola Mandic > Cache table doesn't work with collated column >

[jira] [Resolved] (SPARK-48675) Cache table doesn't work with collated column

2024-06-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48675. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47045

[jira] [Resolved] (SPARK-48659) Unify v1 and v2 ALTER TABLE .. SET TBLPROPERTIES tests

2024-06-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48659. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47018

[jira] [Assigned] (SPARK-48659) Unify v1 and v2 ALTER TABLE .. SET TBLPROPERTIES tests

2024-06-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48659: --- Assignee: BingKun Pan > Unify v1 and v2 ALTER TABLE .. SET TBLPROPERTIES tests >

[jira] [Resolved] (SPARK-48479) Support creating SQL functions in parser

2024-06-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48479. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46816

[jira] [Assigned] (SPARK-48479) Support creating SQL functions in parser

2024-06-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48479: --- Assignee: Allison Wang > Support creating SQL functions in parser >

[jira] [Assigned] (SPARK-48472) Enable reflect expressions with collated strings

2024-06-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48472: --- Assignee: Mihailo Milosevic > Enable reflect expressions with collated strings >

[jira] [Resolved] (SPARK-48472) Enable reflect expressions with collated strings

2024-06-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48472. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46991

[jira] [Resolved] (SPARK-48466) Wrap empty relation propagation in a dedicated node

2024-06-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48466. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46830

[jira] [Resolved] (SPARK-48651) Document configuring different JDK for Spark on YARN

2024-06-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48651. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47010

[jira] [Assigned] (SPARK-48651) Document configuring different JDK for Spark on YARN

2024-06-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48651: --- Assignee: Cheng Pan > Document configuring different JDK for Spark on YARN >

[jira] [Resolved] (SPARK-48601) Fix Spark internal error when setting null value for jdbc option

2024-06-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48601. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46955

[jira] [Assigned] (SPARK-48649) Add "ignoreInvalidPartitionPaths" and "spark.sql.files.ignoreInvalidPartitionPaths" configs to allow ignoring invalid partition paths

2024-06-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48649: --- Assignee: Ivan Sadikov > Add "ignoreInvalidPartitionPaths" and >

[jira] [Resolved] (SPARK-48649) Add "ignoreInvalidPartitionPaths" and "spark.sql.files.ignoreInvalidPartitionPaths" configs to allow ignoring invalid partition paths

2024-06-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48649. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47006

[jira] [Resolved] (SPARK-48342) [M0] Parser support

2024-06-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48342. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46665

[jira] [Assigned] (SPARK-48342) [M0] Parser support

2024-06-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48342: --- Assignee: David Milicevic > [M0] Parser support > --- > >

[jira] [Resolved] (SPARK-48572) Fix DateSub, DateAdd, WindowTime, TimeWindow and SessionWindow expressions

2024-06-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48572. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46943

[jira] [Assigned] (SPARK-48572) Fix DateSub, DateAdd, WindowTime, TimeWindow and SessionWindow expressions

2024-06-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48572: --- Assignee: Mihailo Milosevic > Fix DateSub, DateAdd, WindowTime, TimeWindow and

[jira] [Resolved] (SPARK-48600) Fix FrameLessOffsetWindowFunction expressions implicit casting

2024-06-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48600. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46987

[jira] [Assigned] (SPARK-48600) Fix FrameLessOffsetWindowFunction expressions implicit casting

2024-06-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48600: --- Assignee: Mihailo Milosevic > Fix FrameLessOffsetWindowFunction expressions implicit

[jira] [Assigned] (SPARK-48610) Remove ExplainUtils.processPlan synchronize

2024-06-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48610: --- Assignee: Ziqi Liu > Remove ExplainUtils.processPlan synchronize >

[jira] [Resolved] (SPARK-48610) Remove ExplainUtils.processPlan synchronize

2024-06-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48610. - Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-48557) Support scalar subquery with group-by on column equal to constant

2024-06-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48557. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46902

[jira] [Assigned] (SPARK-48557) Support scalar subquery with group-by on column equal to constant

2024-06-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48557: --- Assignee: Jack Chen > Support scalar subquery with group-by on column equal to constant >

[jira] [Resolved] (SPARK-48577) Replace invalid byte sequences in UTF8Strings

2024-06-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48577. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46899

[jira] [Resolved] (SPARK-48587) Avoid storage amplification when accessing sub-Variant

2024-06-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48587. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46941

[jira] [Resolved] (SPARK-48597) Distinguish the streaming nodes from the text representation of logical plan

2024-06-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48597. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46953

[jira] [Assigned] (SPARK-48597) Distinguish the streaming nodes from the text representation of logical plan

2024-06-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48597: --- Assignee: Jungtaek Lim > Distinguish the streaming nodes from the text representation of

[jira] [Resolved] (SPARK-48576) Rename UTF8_BINARY_LCASE to UTF8_LCASE

2024-06-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48576. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46924

[jira] [Resolved] (SPARK-48556) Incorrect error message pointing to UNSUPPORTED_GROUPING_EXPRESSION

2024-06-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48556. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46900

[jira] [Assigned] (SPARK-48556) Incorrect error message pointing to UNSUPPORTED_GROUPING_EXPRESSION

2024-06-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48556: --- Assignee: Nikola Mandic > Incorrect error message pointing to

[jira] [Resolved] (SPARK-47415) Levenshtein (all collations)

2024-06-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47415. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46788

[jira] [Assigned] (SPARK-47415) Levenshtein (all collations)

2024-06-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47415: --- Assignee: Uroš Bojanić > Levenshtein (all collations) > > >

[jira] [Commented] (SPARK-48562) Writing to JDBC Temporary View Failed

2024-06-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854095#comment-17854095 ] Wenchen Fan commented on SPARK-48562: - writing to a temp view is an ill pattern IMO... > Writing to

[jira] [Assigned] (SPARK-48410) Fix InitCap expression

2024-06-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48410: --- Assignee: Uroš Bojanić > Fix InitCap expression > -- > >

[jira] [Resolved] (SPARK-48410) Fix InitCap expression

2024-06-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48410. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46732

[jira] [Resolved] (SPARK-48403) Fix Upper & Lower expressions for UTF8_BINARY_LCASE

2024-06-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48403. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46720

[jira] [Assigned] (SPARK-48559) Fetch globalTempDatabase name directly without invoking initialization of GlobalaTempViewManager

2024-06-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48559: --- Assignee: Wenchen Fan > Fetch globalTempDatabase name directly without invoking

[jira] [Resolved] (SPARK-48559) Fetch globalTempDatabase name directly without invoking initialization of GlobalaTempViewManager

2024-06-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48559. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46907

[jira] [Assigned] (SPARK-48286) Analyze 'exists' default expression instead of 'current' default expression in structField to v2 column conversion

2024-06-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48286: --- Assignee: Uros Stankovic > Analyze 'exists' default expression instead of 'current'

[jira] [Resolved] (SPARK-48286) Analyze 'exists' default expression instead of 'current' default expression in structField to v2 column conversion

2024-06-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48286. - Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 46594

[jira] [Resolved] (SPARK-48283) Implement modified Lowercase operation for UTF8_BINARY_LCASE

2024-06-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48283. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46700

[jira] [Resolved] (SPARK-48435) UNICODE collation should not support binary equality

2024-06-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48435. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46772

[jira] [Assigned] (SPARK-48435) UNICODE collation should not support binary equality

2024-06-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48435: --- Assignee: Uroš Bojanić > UNICODE collation should not support binary equality >

[jira] [Assigned] (SPARK-48526) Allow passing custom sink to StreamTest::testStream

2024-06-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48526: --- Assignee: Johan Lasperas > Allow passing custom sink to StreamTest::testStream >

[jira] [Resolved] (SPARK-48526) Allow passing custom sink to StreamTest::testStream

2024-06-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48526. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46866

[jira] [Assigned] (SPARK-48546) Fix ExpressionEncoder after replacing NullPointerExceptions with proper error classes in AssertNotNull expression

2024-06-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48546: --- Assignee: Daniel > Fix ExpressionEncoder after replacing NullPointerExceptions with proper

[jira] [Resolved] (SPARK-48546) Fix ExpressionEncoder after replacing NullPointerExceptions with proper error classes in AssertNotNull expression

2024-06-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48546. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46888

[jira] [Created] (SPARK-48552) multi-line CSV schema inference should also throw FAILED_READ_FILE

2024-06-06 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-48552: --- Summary: multi-line CSV schema inference should also throw FAILED_READ_FILE Key: SPARK-48552 URL: https://issues.apache.org/jira/browse/SPARK-48552 Project: Spark

[jira] [Resolved] (SPARK-48307) InlineCTE should keep not-inlined relations in the original WithCTE node

2024-06-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48307. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46617

[jira] [Assigned] (SPARK-48318) Hash join support for strings with collation (complex types)

2024-06-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48318: --- Assignee: Uroš Bojanić > Hash join support for strings with collation (complex types) >

[jira] [Resolved] (SPARK-48318) Hash join support for strings with collation (complex types)

2024-06-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48318. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46722

[jira] [Assigned] (SPARK-47972) Restrict CAST expression for collations

2024-06-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47972: --- Assignee: Mihailo Milosevic > Restrict CAST expression for collations >

[jira] [Resolved] (SPARK-47972) Restrict CAST expression for collations

2024-06-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47972. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46474

[jira] [Resolved] (SPARK-48413) ALTER COLUMN with collation

2024-06-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48413. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46734

[jira] [Assigned] (SPARK-48503) Scalar subquery with group-by and non-equality predicate incorrectly allowed, wrong results

2024-06-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48503: --- Assignee: Jack Chen > Scalar subquery with group-by and non-equality predicate incorrectly

[jira] [Resolved] (SPARK-48503) Scalar subquery with group-by and non-equality predicate incorrectly allowed, wrong results

2024-06-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48503. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46839

[jira] [Assigned] (SPARK-48391) use addAll instead of add function in TaskMetrics to accelerate

2024-05-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48391: --- Assignee: jiahong.li > use addAll instead of add function in TaskMetrics to accelerate >

[jira] [Resolved] (SPARK-48391) use addAll instead of add function in TaskMetrics to accelerate

2024-05-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48391. - Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-48465) Avoid no-op empty relation propagation in AQE

2024-05-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48465. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46814

[jira] [Resolved] (SPARK-48430) Fix map value extraction when map contains collated strings

2024-05-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48430. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46758

[jira] [Resolved] (SPARK-48476) NPE thrown when delimiter set to null in CSV

2024-05-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48476. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46810

[jira] [Assigned] (SPARK-48476) NPE thrown when delimiter set to null in CSV

2024-05-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48476: --- Assignee: Milan Stefanovic > NPE thrown when delimiter set to null in CSV >

[jira] [Assigned] (SPARK-48419) Foldable propagation replace foldable column should use origin column

2024-05-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48419: --- Assignee: KnightChess > Foldable propagation replace foldable column should use origin

[jira] [Resolved] (SPARK-48419) Foldable propagation replace foldable column should use origin column

2024-05-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48419. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46742

[jira] [Resolved] (SPARK-48468) Add LogicalQueryStage interface in catalyst

2024-05-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48468. - Fix Version/s: 4.0.0 Resolution: Fixed > Add LogicalQueryStage interface in catalyst >

[jira] [Assigned] (SPARK-48468) Add LogicalQueryStage interface in catalyst

2024-05-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48468: --- Assignee: Ziqi Liu > Add LogicalQueryStage interface in catalyst >

  1   2   3   4   5   6   7   8   9   10   >