[jira] [Updated] (SPARK-49211) V2 Catalog can also support built-in data sources

2024-08-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-49211: Fix Version/s: 3.5.3 > V2 Catalog can also support built-in data sources > ---

[jira] [Updated] (SPARK-49246) TableCatalog#loadTable should indicate if it's for writing

2024-08-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-49246: Summary: TableCatalog#loadTable should indicate if it's for writing (was: loadTable should indica

[jira] [Created] (SPARK-49246) loadTable should indicate if it's for writing

2024-08-15 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-49246: --- Summary: loadTable should indicate if it's for writing Key: SPARK-49246 URL: https://issues.apache.org/jira/browse/SPARK-49246 Project: Spark Issue Type: Impro

[jira] [Resolved] (SPARK-49211) V2 Catalog can also support built-in data sources

2024-08-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49211. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47723 [https://gith

[jira] [Assigned] (SPARK-48967) Improve performance and memory footprint of "INSERT INTO ... VALUES" Statements

2024-08-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48967: --- Assignee: Costas Zarifis > Improve performance and memory footprint of "INSERT INTO ... VAL

[jira] [Resolved] (SPARK-48967) Improve performance and memory footprint of "INSERT INTO ... VALUES" Statements

2024-08-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48967. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47428 [https://gith

[jira] [Assigned] (SPARK-49207) Fix SplitPart one-to-many case mapping (UTF8_LCASE)

2024-08-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49207: --- Assignee: Uroš Bojanić > Fix SplitPart one-to-many case mapping (UTF8_LCASE) >

[jira] [Resolved] (SPARK-49207) Fix SplitPart one-to-many case mapping (UTF8_LCASE)

2024-08-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49207. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47715 [https://gith

[jira] [Assigned] (SPARK-49204) Handle surrogate pairs properly

2024-08-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49204: --- Assignee: Uroš Bojanić > Handle surrogate pairs properly > ---

[jira] [Resolved] (SPARK-49204) Handle surrogate pairs properly

2024-08-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49204. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47713 [https://gith

[jira] [Resolved] (SPARK-49152) V2SessionCatalog should use V2Command

2024-08-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49152. - Resolution: Fixed > V2SessionCatalog should use V2Command >

[jira] [Updated] (SPARK-49152) V2SessionCatalog should use V2Command

2024-08-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-49152: Fix Version/s: 4.0.0 3.5.3 > V2SessionCatalog should use V2Command > --

[jira] [Assigned] (SPARK-46632) EquivalentExpressions throw IllegalStateException

2024-08-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46632: --- Assignee: Mingliang Zhu > EquivalentExpressions throw IllegalStateException > -

[jira] [Resolved] (SPARK-46632) EquivalentExpressions throw IllegalStateException

2024-08-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46632. - Fix Version/s: 4.0.0 3.5.3 Resolution: Fixed Issue resolved by pull re

[jira] [Resolved] (SPARK-49188) Internal error on concat_ws called on array of arrays of string

2024-08-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49188. - Fix Version/s: 4.0.0 Assignee: Nikola Mandic Resolution: Fixed > Internal error

[jira] [Resolved] (SPARK-49183) V2SessionCatalog.createTable should respect PROP_IS_MANAGED_LOCATION

2024-08-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49183. - Fix Version/s: 4.0.0 3.5.3 Resolution: Fixed Issue resolved by pull re

[jira] [Assigned] (SPARK-49183) V2SessionCatalog.createTable should respect PROP_IS_MANAGED_LOCATION

2024-08-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49183: --- Assignee: Wenchen Fan > V2SessionCatalog.createTable should respect PROP_IS_MANAGED_LOCATIO

[jira] [Assigned] (SPARK-48937) Fix collation support for the StringToMap expression (binary & lowercase collation only)

2024-08-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48937: --- Assignee: Uroš Bojanić > Fix collation support for the StringToMap expression (binary & low

[jira] [Resolved] (SPARK-48937) Fix collation support for the StringToMap expression (binary & lowercase collation only)

2024-08-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48937. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47621 [https://gith

[jira] [Resolved] (SPARK-49163) Attempt to create table based on broken parquet partition data results in internal error

2024-08-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49163. - Resolution: Fixed Issue resolved by pull request 47668 [https://github.com/apache/spark/pull/476

[jira] [Assigned] (SPARK-49163) Attempt to create table based on broken parquet partition data results in internal error

2024-08-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49163: --- Assignee: Nikola Mandic > Attempt to create table based on broken parquet partition data re

[jira] [Created] (SPARK-49183) V2SessionCatalog.createTable should respect PROP_IS_MANAGED_LOCATION

2024-08-09 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-49183: --- Summary: V2SessionCatalog.createTable should respect PROP_IS_MANAGED_LOCATION Key: SPARK-49183 URL: https://issues.apache.org/jira/browse/SPARK-49183 Project: Spark

[jira] [Resolved] (SPARK-49138) Fix CollationTypeCasts of several expressions

2024-08-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49138. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47649 [https://gith

[jira] [Assigned] (SPARK-49139) Enable collations by default for Spark 4.0.0 Preview 2

2024-08-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49139: --- Assignee: Uroš Bojanić > Enable collations by default for Spark 4.0.0 Preview 2 > -

[jira] [Resolved] (SPARK-49139) Enable collations by default for Spark 4.0.0 Preview 2

2024-08-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49139. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47650 [https://gith

[jira] [Resolved] (SPARK-49125) Allow writing CSV with duplicated column names

2024-08-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49125. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47633 [https://gith

[jira] [Assigned] (SPARK-49125) Allow writing CSV with duplicated column names

2024-08-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49125: --- Assignee: Wenchen Fan > Allow writing CSV with duplicated column names > --

[jira] [Created] (SPARK-49125) Allow writing CSV with duplicated column names

2024-08-06 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-49125: --- Summary: Allow writing CSV with duplicated column names Key: SPARK-49125 URL: https://issues.apache.org/jira/browse/SPARK-49125 Project: Spark Issue Type: Impr

[jira] [Resolved] (SPARK-48911) Improve collation support testing for various expressions

2024-08-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48911. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47372 [https://gith

[jira] [Resolved] (SPARK-48978) Optimize collation support for ASCII strings (all collations)

2024-08-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48978. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47326 [https://gith

[jira] [Assigned] (SPARK-49109) Rename leftover BinaryLcase to Lcase

2024-08-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49109: --- Assignee: Mihailo Milosevic > Rename leftover BinaryLcase to Lcase > --

[jira] [Resolved] (SPARK-49109) Rename leftover BinaryLcase to Lcase

2024-08-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49109. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47602 [https://gith

[jira] [Resolved] (SPARK-49018) Fix approx_count_distinct not working correctly with collation

2024-08-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49018. - Resolution: Fixed Issue resolved by pull request 47503 [https://github.com/apache/spark/pull/475

[jira] [Assigned] (SPARK-49018) Fix approx_count_distinct not working correctly with collation

2024-08-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49018: --- Assignee: Viktor Lučić > Fix approx_count_distinct not working correctly with collation > -

[jira] [Assigned] (SPARK-49063) Fix Between with ScalarSubqueries

2024-08-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49063: --- Assignee: Mihailo Milosevic > Fix Between with ScalarSubqueries > -

[jira] [Resolved] (SPARK-49063) Fix Between with ScalarSubqueries

2024-08-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49063. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47581 [https://gith

[jira] [Assigned] (SPARK-48346) [M0] Support for IF ELSE statement

2024-08-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48346: --- Assignee: David Milicevic > [M0] Support for IF ELSE statement > --

[jira] [Resolved] (SPARK-48346) [M0] Support for IF ELSE statement

2024-08-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48346. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47442 [https://gith

[jira] [Assigned] (SPARK-49057) Do not block the AQE loop when submitting query stages

2024-08-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49057: --- Assignee: Wenchen Fan > Do not block the AQE loop when submitting query stages > --

[jira] [Resolved] (SPARK-49057) Do not block the AQE loop when submitting query stages

2024-08-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49057. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47533 [https://gith

[jira] [Updated] (SPARK-49000) Aggregation with DISTINCT gives wrong results when dealing with literals

2024-08-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-49000: Fix Version/s: 3.5.2 > Aggregation with DISTINCT gives wrong results when dealing with literals >

[jira] [Assigned] (SPARK-49065) Rebasing in legacy formatters/parsers must support non JVM default time zones

2024-08-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49065: --- Assignee: Sumeet Varma > Rebasing in legacy formatters/parsers must support non JVM default

[jira] [Resolved] (SPARK-49065) Rebasing in legacy formatters/parsers must support non JVM default time zones

2024-08-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49065. - Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pull re

[jira] [Assigned] (SPARK-49074) Fix cached Variant with column size greater than 128KB or individual variant larger than 2kb

2024-07-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49074: --- Assignee: Richard Chen > Fix cached Variant with column size greater than 128KB or individu

[jira] [Resolved] (SPARK-49074) Fix cached Variant with column size greater than 128KB or individual variant larger than 2kb

2024-07-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49074. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47559 [https://gith

[jira] [Resolved] (SPARK-49000) Aggregation with DISTINCT gives wrong results when dealing with literals

2024-07-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49000. - Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pull re

[jira] [Assigned] (SPARK-49000) Aggregation with DISTINCT gives wrong results when dealing with literals

2024-07-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49000: --- Assignee: Uroš Bojanić > Aggregation with DISTINCT gives wrong results when dealing with li

[jira] [Assigned] (SPARK-48977) Optimize collation support for string search (UTF8_LCASE collation)

2024-07-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48977: --- Assignee: Uroš Bojanić > Optimize collation support for string search (UTF8_LCASE collation

[jira] [Resolved] (SPARK-48977) Optimize collation support for string search (UTF8_LCASE collation)

2024-07-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48977. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47444 [https://gith

[jira] [Assigned] (SPARK-48725) Use lowerCaseCodePoints in string functions for UTF8_LCASE

2024-07-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48725: --- Assignee: Uroš Bojanić > Use lowerCaseCodePoints in string functions for UTF8_LCASE > -

[jira] [Resolved] (SPARK-48725) Use lowerCaseCodePoints in string functions for UTF8_LCASE

2024-07-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48725. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47132 [https://gith

[jira] [Resolved] (SPARK-49003) Fix calculating hash value of collated strings

2024-07-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49003. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47502 [https://gith

[jira] [Assigned] (SPARK-49003) Fix calculating hash value of collated strings

2024-07-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49003: --- Assignee: Marko Ilic > Fix calculating hash value of collated strings > ---

[jira] [Created] (SPARK-49057) Do not block the AQE loop when submitting query stages

2024-07-30 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-49057: --- Summary: Do not block the AQE loop when submitting query stages Key: SPARK-49057 URL: https://issues.apache.org/jira/browse/SPARK-49057 Project: Spark Issue Ty

[jira] [Resolved] (SPARK-48989) WholeStageCodeGen error resulting in NumberFormatException when calling SUBSTRING_INDEX

2024-07-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48989. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47481 [https://gith

[jira] [Resolved] (SPARK-48910) Slow linear searches in PreprocessTableCreation

2024-07-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48910. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47484 [https://gith

[jira] [Assigned] (SPARK-48910) Slow linear searches in PreprocessTableCreation

2024-07-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48910: --- Assignee: Vladimir Golubev > Slow linear searches in PreprocessTableCreation >

[jira] [Assigned] (SPARK-45787) Support Catalog.listColumns() for clustering columns

2024-07-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45787: --- Assignee: Jiaheng Tang (was: Terry Kim) > Support Catalog.listColumns() for clustering col

[jira] [Resolved] (SPARK-45787) Support Catalog.listColumns() for clustering columns

2024-07-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45787. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47451 [https://gith

[jira] [Assigned] (SPARK-45787) Support Catalog.listColumns() for clustering columns

2024-07-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45787: --- Assignee: Terry Kim > Support Catalog.listColumns() for clustering columns > --

[jira] [Resolved] (SPARK-48761) Add clusterBy DataFrameWriter API for Scala

2024-07-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48761. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47301 [https://gith

[jira] [Assigned] (SPARK-48761) Add clusterBy DataFrameWriter API for Scala

2024-07-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48761: --- Assignee: Jiaheng Tang > Add clusterBy DataFrameWriter API for Scala >

[jira] [Assigned] (SPARK-48990) Unified variable related SQL syntax keywords

2024-07-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48990: --- Assignee: BingKun Pan > Unified variable related SQL syntax keywords >

[jira] [Resolved] (SPARK-48990) Unified variable related SQL syntax keywords

2024-07-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48990. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47469 [https://gith

[jira] [Resolved] (SPARK-48833) Support variant in `InMemoryTableScan`

2024-07-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48833. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47252 [https://gith

[jira] [Assigned] (SPARK-48833) Support variant in `InMemoryTableScan`

2024-07-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48833: --- Assignee: Richard Chen > Support variant in `InMemoryTableScan` > -

[jira] [Resolved] (SPARK-48338) Sql Scripting support for Spark SQL

2024-07-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48338. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47404 [https://gith

[jira] [Assigned] (SPARK-48338) Sql Scripting support for Spark SQL

2024-07-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48338: --- Assignee: Aleksandar Tomic > Sql Scripting support for Spark SQL >

[jira] [Resolved] (SPARK-48935) Make `checkEvaluation` directly check the `Collation` expression itself in UT

2024-07-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48935. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47401 [https://gith

[jira] [Resolved] (SPARK-48914) Add OFFSET operator as an option in the subquery generator

2024-07-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48914. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47375 [https://gith

[jira] [Resolved] (SPARK-48959) Make NoSuchNamespaceException extend NoSuchDatabaseException

2024-07-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48959. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47433 [https://gith

[jira] [Assigned] (SPARK-48959) Make NoSuchNamespaceException extend NoSuchDatabaseException

2024-07-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48959: --- Assignee: Ruifeng Zheng > Make NoSuchNamespaceException extend NoSuchDatabaseException > --

[jira] [Resolved] (SPARK-48388) [M0] Fix SET behavior for scripts

2024-07-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48388. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47272 [https://gith

[jira] [Assigned] (SPARK-48388) [M0] Fix SET behavior for scripts

2024-07-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48388: --- Assignee: David Milicevic > [M0] Fix SET behavior for scripts > ---

[jira] [Resolved] (SPARK-48900) Add `reason` string to all job / stage / job group cancellation calls

2024-07-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48900. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47361 [https://gith

[jira] [Assigned] (SPARK-48900) Add `reason` string to all job / stage / job group cancellation calls

2024-07-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48900: --- Assignee: Mingkang Li > Add `reason` string to all job / stage / job group cancellation cal

[jira] [Assigned] (SPARK-48915) Add inequality (!=, <, <=, >, >=) predicates for correlation in GeneratedSubquerySuite

2024-07-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48915: --- Assignee: Wei Guo > Add inequality (!=, <, <=, >, >=) predicates for correlation in > Gene

[jira] [Resolved] (SPARK-48915) Add inequality (!=, <, <=, >, >=) predicates for correlation in GeneratedSubquerySuite

2024-07-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48915. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47386 [https://gith

[jira] [Assigned] (SPARK-48923) Fix the incorrect logic of `CollationFactorySuite`

2024-07-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48923: --- Assignee: BingKun Pan > Fix the incorrect logic of `CollationFactorySuite` > --

[jira] [Resolved] (SPARK-48923) Fix the incorrect logic of `CollationFactorySuite`

2024-07-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48923. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47382 [https://gith

[jira] [Assigned] (SPARK-48350) [M0] Support for exceptions thrown from parser/interpreter

2024-07-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48350: --- Assignee: Milan Dankovic > [M0] Support for exceptions thrown from parser/interpreter > ---

[jira] [Resolved] (SPARK-48350) [M0] Support for exceptions thrown from parser/interpreter

2024-07-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48350. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47147 [https://gith

[jira] [Resolved] (SPARK-48441) Alter string search logic for: trim (UTF8_BINARY_LCASE)

2024-07-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48441. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46762 [https://gith

[jira] [Assigned] (SPARK-48441) Alter string search logic for: trim (UTF8_BINARY_LCASE)

2024-07-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48441: --- Assignee: Uroš Bojanić > Alter string search logic for: trim (UTF8_BINARY_LCASE) >

[jira] [Assigned] (SPARK-48440) Alter string search logic for: translate (UTF8_BINARY_LCASE)

2024-07-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48440: --- Assignee: Uroš Bojanić > Alter string search logic for: translate (UTF8_BINARY_LCASE) > ---

[jira] [Resolved] (SPARK-48440) Alter string search logic for: translate (UTF8_BINARY_LCASE)

2024-07-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48440. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46761 [https://gith

[jira] [Assigned] (SPARK-48871) Fix INVALID_NON_DETERMINISTIC_EXPRESSIONS validation in CheckAnalysis

2024-07-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48871: --- Assignee: Carmen Kwan > Fix INVALID_NON_DETERMINISTIC_EXPRESSIONS validation in CheckAnalys

[jira] [Resolved] (SPARK-48871) Fix INVALID_NON_DETERMINISTIC_EXPRESSIONS validation in CheckAnalysis

2024-07-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48871. - Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pull re

[jira] [Resolved] (SPARK-48841) Include `collationName` to `sql()` of `Collate`

2024-07-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48841. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47265 [https://gith

[jira] [Resolved] (SPARK-48793) Unify v1 and v2 `ALTER TABLE .. `DROP|RENAME` COLUMN[S] ...` tests

2024-07-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48793. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47199 [https://gith

[jira] [Resolved] (SPARK-48773) Document config "spark.default.parallelism"

2024-07-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48773. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47171 [https://gith

[jira] [Resolved] (SPARK-48851) Attach full name for `SCHEMA_NOT_FOUND`

2024-07-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48851. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47276 [https://gith

[jira] [Assigned] (SPARK-48851) Attach full name for `SCHEMA_NOT_FOUND`

2024-07-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48851: --- Assignee: BingKun Pan > Attach full name for `SCHEMA_NOT_FOUND` > -

[jira] [Resolved] (SPARK-48529) [M0] Support for labels

2024-07-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48529. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47146 [https://gith

[jira] [Assigned] (SPARK-48529) [M0] Support for labels

2024-07-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48529: --- Assignee: David Milicevic > [M0] Support for labels > --- > >

[jira] [Resolved] (SPARK-48791) Perf regression due to accumulator registration overhead using CopyOnWriteArrayList

2024-07-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48791. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47197 [https://gith

[jira] [Assigned] (SPARK-48791) Perf regression due to accumulator registration overhead using CopyOnWriteArrayList

2024-07-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48791: --- Assignee: wuyi > Perf regression due to accumulator registration overhead using > CopyOnWr

[jira] [Assigned] (SPARK-48843) Infinite loop with GlobalLimit/BindParameters

2024-07-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48843: --- Assignee: Nemanja Boric > Infinite loop with GlobalLimit/BindParameters > -

[jira] [Resolved] (SPARK-48843) Infinite loop with GlobalLimit/BindParameters

2024-07-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48843. - Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pull re

[jira] [Assigned] (SPARK-36680) Supports Dynamic Table Options for Spark SQL

2024-07-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36680: --- Assignee: wang-zhun > Supports Dynamic Table Options for Spark SQL > --

<    1   2   3   4   5   6   7   8   9   10   >