[jira] [Assigned] (SPARK-49743) OptimizeCsvJsonExpr should not change the schema of underlying StructType in GetArrayStructFields

2024-09-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49743: --- Assignee: Nikhil Sheoran > OptimizeCsvJsonExpr should not change the schema of underlying S

[jira] [Resolved] (SPARK-49743) OptimizeCsvJsonExpr should not change the schema of underlying StructType in GetArrayStructFields

2024-09-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49743. - Fix Version/s: 3.5.4 Resolution: Fixed Issue resolved by pull request 48308 [https://gith

[jira] [Resolved] (SPARK-48196) Make lazy val plans in QueryExecution Trys to not re-execute on error

2024-09-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48196. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48211 [https://gith

[jira] [Assigned] (SPARK-48196) Make lazy val plans in QueryExecution Trys to not re-execute on error

2024-09-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48196: --- Assignee: Juliusz Sompolski > Make lazy val plans in QueryExecution Trys to not re-execute

[jira] [Resolved] (SPARK-49561) PIVOT + UNPIVOT operators

2024-09-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49561. - Fix Version/s: 4.0.0 Resolution: Fixed > PIVOT + UNPIVOT operators >

[jira] [Assigned] (SPARK-49561) PIVOT + UNPIVOT operators

2024-09-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49561: --- Assignee: Daniel > PIVOT + UNPIVOT operators > - > >

[jira] [Resolved] (SPARK-49816) should only update out-going-ref-count for referenced outer CTE relation

2024-09-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49816. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48284 [https://gith

[jira] [Resolved] (SPARK-49819) Disable CollapseProject for correlated subqueries in projection over aggregate correctly

2024-09-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49819. - Fix Version/s: 3.5.4 4.0.0 Resolution: Fixed Issue resolved by pull re

[jira] [Assigned] (SPARK-49819) Disable CollapseProject for correlated subqueries in projection over aggregate correctly

2024-09-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49819: --- Assignee: Nick Young > Disable CollapseProject for correlated subqueries in projection over

[jira] [Assigned] (SPARK-49666) Put trim sensitivity under a flag

2024-09-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49666: --- Assignee: Uroš Bojanić > Put trim sensitivity under a flag > --

[jira] [Resolved] (SPARK-49666) Put trim sensitivity under a flag

2024-09-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49666. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48222 [https://gith

[jira] [Assigned] (SPARK-49811) Rename StringTypeAnyCollation to reflect all collation identifiers supported

2024-09-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49811: --- Assignee: Vladan Vasić > Rename StringTypeAnyCollation to reflect all collation identifiers

[jira] [Resolved] (SPARK-49811) Rename StringTypeAnyCollation to reflect all collation identifiers supported

2024-09-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49811. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48265 [https://gith

[jira] [Created] (SPARK-49816) should only update out-going-ref-count for referenced outer CTE relation

2024-09-27 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-49816: --- Summary: should only update out-going-ref-count for referenced outer CTE relation Key: SPARK-49816 URL: https://issues.apache.org/jira/browse/SPARK-49816 Project: Spark

[jira] [Assigned] (SPARK-49757) SET CATALOG syntax doesn't support IDENTIFIER

2024-09-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49757: --- Assignee: Mikhail Nikoliukin > SET CATALOG syntax doesn't support IDENTIFIER > ---

[jira] [Resolved] (SPARK-49808) Fix a deadlock in subquery execution due to lazy vals

2024-09-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49808. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48279 [https://gith

[jira] [Resolved] (SPARK-49757) SET CATALOG syntax doesn't support IDENTIFIER

2024-09-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49757. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48228 [https://gith

[jira] [Assigned] (SPARK-49444) Univocity parser handles ArrayIndexOutOfBounds exception

2024-09-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49444: --- Assignee: Vladan Vasić > Univocity parser handles ArrayIndexOutOfBounds exception > ---

[jira] [Resolved] (SPARK-49444) Univocity parser handles ArrayIndexOutOfBounds exception

2024-09-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49444. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47906 [https://gith

[jira] [Created] (SPARK-49791) Make DelegatingCatalogExtension more extendable

2024-09-25 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-49791: --- Summary: Make DelegatingCatalogExtension more extendable Key: SPARK-49791 URL: https://issues.apache.org/jira/browse/SPARK-49791 Project: Spark Issue Type: Imp

[jira] [Resolved] (SPARK-49653) Support single joins for full scalar subquery decorrelation

2024-09-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49653. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48145 [https://gith

[jira] [Assigned] (SPARK-49653) Support single joins for full scalar subquery decorrelation

2024-09-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49653: --- Assignee: Andrey Gubichev > Support single joins for full scalar subquery decorrelation > -

[jira] [Assigned] (SPARK-49667) Spark expressions that use StringSearch do not behave properly with CS_AI collators

2024-09-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49667: --- Assignee: Vladan Vasić > Spark expressions that use StringSearch do not behave properly wit

[jira] [Resolved] (SPARK-49667) Spark expressions that use StringSearch do not behave properly with CS_AI collators

2024-09-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49667. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48121 [https://gith

[jira] [Assigned] (SPARK-48782) Add support for loading stored procedures in catalogs

2024-09-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48782: --- Assignee: Anton Okolnychyi > Add support for loading stored procedures in catalogs > --

[jira] [Resolved] (SPARK-48782) Add support for loading stored procedures in catalogs

2024-09-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48782. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47943 [https://gith

[jira] [Resolved] (SPARK-49611) Introduce TVF all_collations()

2024-09-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49611. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48087 [https://gith

[jira] [Resolved] (SPARK-49646) fix subquery decorrelation for union / set operations when parentOuterReferences has references not covered in collectedChildOuterReferences

2024-09-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49646. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48109 [https://gith

[jira] [Assigned] (SPARK-49646) fix subquery decorrelation for union / set operations when parentOuterReferences has references not covered in collectedChildOuterReferences

2024-09-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49646: --- Assignee: Avery Qi > fix subquery decorrelation for union / set operations when > parentOu

[jira] [Resolved] (SPARK-48824) Add SQL syntax in create/replace table to create an identity column

2024-09-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48824. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47614 [https://gith

[jira] [Assigned] (SPARK-48824) Add SQL syntax in create/replace table to create an identity column

2024-09-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48824: --- Assignee: Carmen Kwan > Add SQL syntax in create/replace table to create an identity column

[jira] [Resolved] (SPARK-49556) SELECT operator

2024-09-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49556. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48047 [https://gith

[jira] [Resolved] (SPARK-49488) MySQL dialect supports pushdown datetime functions.

2024-09-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49488. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47951 [https://gith

[jira] [Assigned] (SPARK-49591) Distinguish logical and physical types in variant spec

2024-09-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49591: --- Assignee: David Cashman > Distinguish logical and physical types in variant spec >

[jira] [Resolved] (SPARK-49591) Distinguish logical and physical types in variant spec

2024-09-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49591. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48064 [https://gith

[jira] [Assigned] (SPARK-49443) Implement to_variant_object expression and make schema_of_variant expressions print OBJECT for for Variant Objects

2024-09-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49443: --- Assignee: Harsh Motwani > Implement to_variant_object expression and make schema_of_variant

[jira] [Resolved] (SPARK-49501) Catalog createTable API is double-escaping paths

2024-09-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49501. - Fix Version/s: 3.5.4 4.0.0 Resolution: Fixed > Catalog createTable API

[jira] [Resolved] (SPARK-49383) Support Transpose DataFrame API

2024-09-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49383. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47884 [https://gith

[jira] [Assigned] (SPARK-49396) PLAN_VALIDATION_FAILED_RULE_IN_BATCH in SimplifyConditionals rule

2024-09-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49396: --- Assignee: Avery Qi > PLAN_VALIDATION_FAILED_RULE_IN_BATCH in SimplifyConditionals rule > --

[jira] [Assigned] (SPARK-48348) [M0] Support for LEAVE statement

2024-09-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48348: --- Assignee: David Milicevic > [M0] Support for LEAVE statement >

[jira] [Assigned] (SPARK-49451) Allow duplicate keys in parse_json.

2024-09-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49451: --- Assignee: Chenhao Li > Allow duplicate keys in parse_json. > --

[jira] [Resolved] (SPARK-49451) Allow duplicate keys in parse_json.

2024-09-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49451. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47920 [https://gith

[jira] [Resolved] (SPARK-49480) NullPointerException from SparkThrowableHelper.isInternalError method

2024-09-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49480. - Fix Version/s: 4.0.0 3.5.3 Resolution: Fixed > NullPointerException fr

[jira] [Assigned] (SPARK-49480) NullPointerException from SparkThrowableHelper.isInternalError method

2024-09-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49480: --- Assignee: Xi Chen > NullPointerException from SparkThrowableHelper.isInternalError method >

[jira] [Assigned] (SPARK-46037) When Left Join build Left, ShuffledHashJoinExec may result in incorrect results

2024-08-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46037: --- Assignee: mcdull_zhang > When Left Join build Left, ShuffledHashJoinExec may result in inco

[jira] [Resolved] (SPARK-46037) When Left Join build Left, ShuffledHashJoinExec may result in incorrect results

2024-08-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46037. - Fix Version/s: 4.0.0 3.5.3 Resolution: Fixed Issue resolved by pull re

[jira] [Created] (SPARK-49393) fail by default in deprecated catalog plugin APIs

2024-08-26 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-49393: --- Summary: fail by default in deprecated catalog plugin APIs Key: SPARK-49393 URL: https://issues.apache.org/jira/browse/SPARK-49393 Project: Spark Issue Type: I

[jira] [Updated] (SPARK-49359) allow StagedTableCatalog implementations to fall back to non-atomic write

2024-08-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-49359: Fix Version/s: 3.5.3 > allow StagedTableCatalog implementations to fall back to non-atomic write >

[jira] [Updated] (SPARK-49359) allow StagedTableCatalog implementations to fall back to non-atomic write

2024-08-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-49359: Summary: allow StagedTableCatalog implementations to fall back to non-atomic write (was: allow Fa

[jira] [Created] (SPARK-49359) allow FakeStagedTableCatalog implementations to fall back to non-atomic write

2024-08-22 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-49359: --- Summary: allow FakeStagedTableCatalog implementations to fall back to non-atomic write Key: SPARK-49359 URL: https://issues.apache.org/jira/browse/SPARK-49359 Project:

[jira] [Resolved] (SPARK-49246) TableCatalog#loadTable should indicate if it's for writing

2024-08-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49246. - Fix Version/s: 4.0.0 3.5.3 Resolution: Fixed Issue resolved by pull re

[jira] [Resolved] (SPARK-49250) CheckAnalysis with UnresolvedWindowExpression nested inside other expressions produces confusing error message

2024-08-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49250. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47775 [https://gith

[jira] [Assigned] (SPARK-49250) CheckAnalysis with UnresolvedWindowExpression nested inside other expressions produces confusing error message

2024-08-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49250: --- Assignee: Vladimir Golubev > CheckAnalysis with UnresolvedWindowExpression nested inside ot

[jira] [Updated] (SPARK-49211) V2 Catalog can also support built-in data sources

2024-08-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-49211: Fix Version/s: 3.5.3 > V2 Catalog can also support built-in data sources > ---

[jira] [Updated] (SPARK-49246) TableCatalog#loadTable should indicate if it's for writing

2024-08-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-49246: Summary: TableCatalog#loadTable should indicate if it's for writing (was: loadTable should indica

[jira] [Created] (SPARK-49246) loadTable should indicate if it's for writing

2024-08-15 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-49246: --- Summary: loadTable should indicate if it's for writing Key: SPARK-49246 URL: https://issues.apache.org/jira/browse/SPARK-49246 Project: Spark Issue Type: Impro

[jira] [Resolved] (SPARK-49211) V2 Catalog can also support built-in data sources

2024-08-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49211. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47723 [https://gith

[jira] [Assigned] (SPARK-48967) Improve performance and memory footprint of "INSERT INTO ... VALUES" Statements

2024-08-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48967: --- Assignee: Costas Zarifis > Improve performance and memory footprint of "INSERT INTO ... VAL

[jira] [Resolved] (SPARK-48967) Improve performance and memory footprint of "INSERT INTO ... VALUES" Statements

2024-08-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48967. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47428 [https://gith

[jira] [Assigned] (SPARK-49207) Fix SplitPart one-to-many case mapping (UTF8_LCASE)

2024-08-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49207: --- Assignee: Uroš Bojanić > Fix SplitPart one-to-many case mapping (UTF8_LCASE) >

[jira] [Resolved] (SPARK-49207) Fix SplitPart one-to-many case mapping (UTF8_LCASE)

2024-08-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49207. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47715 [https://gith

[jira] [Assigned] (SPARK-49204) Handle surrogate pairs properly

2024-08-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49204: --- Assignee: Uroš Bojanić > Handle surrogate pairs properly > ---

[jira] [Resolved] (SPARK-49204) Handle surrogate pairs properly

2024-08-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49204. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47713 [https://gith

[jira] [Resolved] (SPARK-49152) V2SessionCatalog should use V2Command

2024-08-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49152. - Resolution: Fixed > V2SessionCatalog should use V2Command >

[jira] [Updated] (SPARK-49152) V2SessionCatalog should use V2Command

2024-08-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-49152: Fix Version/s: 4.0.0 3.5.3 > V2SessionCatalog should use V2Command > --

[jira] [Assigned] (SPARK-46632) EquivalentExpressions throw IllegalStateException

2024-08-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46632: --- Assignee: Mingliang Zhu > EquivalentExpressions throw IllegalStateException > -

[jira] [Resolved] (SPARK-46632) EquivalentExpressions throw IllegalStateException

2024-08-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46632. - Fix Version/s: 4.0.0 3.5.3 Resolution: Fixed Issue resolved by pull re

[jira] [Resolved] (SPARK-49188) Internal error on concat_ws called on array of arrays of string

2024-08-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49188. - Fix Version/s: 4.0.0 Assignee: Nikola Mandic Resolution: Fixed > Internal error

[jira] [Resolved] (SPARK-49183) V2SessionCatalog.createTable should respect PROP_IS_MANAGED_LOCATION

2024-08-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49183. - Fix Version/s: 4.0.0 3.5.3 Resolution: Fixed Issue resolved by pull re

[jira] [Assigned] (SPARK-49183) V2SessionCatalog.createTable should respect PROP_IS_MANAGED_LOCATION

2024-08-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49183: --- Assignee: Wenchen Fan > V2SessionCatalog.createTable should respect PROP_IS_MANAGED_LOCATIO

[jira] [Assigned] (SPARK-48937) Fix collation support for the StringToMap expression (binary & lowercase collation only)

2024-08-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48937: --- Assignee: Uroš Bojanić > Fix collation support for the StringToMap expression (binary & low

[jira] [Resolved] (SPARK-48937) Fix collation support for the StringToMap expression (binary & lowercase collation only)

2024-08-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48937. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47621 [https://gith

[jira] [Resolved] (SPARK-49163) Attempt to create table based on broken parquet partition data results in internal error

2024-08-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49163. - Resolution: Fixed Issue resolved by pull request 47668 [https://github.com/apache/spark/pull/476

[jira] [Assigned] (SPARK-49163) Attempt to create table based on broken parquet partition data results in internal error

2024-08-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49163: --- Assignee: Nikola Mandic > Attempt to create table based on broken parquet partition data re

[jira] [Created] (SPARK-49183) V2SessionCatalog.createTable should respect PROP_IS_MANAGED_LOCATION

2024-08-09 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-49183: --- Summary: V2SessionCatalog.createTable should respect PROP_IS_MANAGED_LOCATION Key: SPARK-49183 URL: https://issues.apache.org/jira/browse/SPARK-49183 Project: Spark

[jira] [Resolved] (SPARK-49138) Fix CollationTypeCasts of several expressions

2024-08-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49138. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47649 [https://gith

[jira] [Assigned] (SPARK-49139) Enable collations by default for Spark 4.0.0 Preview 2

2024-08-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49139: --- Assignee: Uroš Bojanić > Enable collations by default for Spark 4.0.0 Preview 2 > -

[jira] [Resolved] (SPARK-49139) Enable collations by default for Spark 4.0.0 Preview 2

2024-08-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49139. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47650 [https://gith

[jira] [Resolved] (SPARK-49125) Allow writing CSV with duplicated column names

2024-08-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49125. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47633 [https://gith

[jira] [Assigned] (SPARK-49125) Allow writing CSV with duplicated column names

2024-08-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49125: --- Assignee: Wenchen Fan > Allow writing CSV with duplicated column names > --

[jira] [Created] (SPARK-49125) Allow writing CSV with duplicated column names

2024-08-06 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-49125: --- Summary: Allow writing CSV with duplicated column names Key: SPARK-49125 URL: https://issues.apache.org/jira/browse/SPARK-49125 Project: Spark Issue Type: Impr

[jira] [Resolved] (SPARK-48911) Improve collation support testing for various expressions

2024-08-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48911. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47372 [https://gith

[jira] [Resolved] (SPARK-48978) Optimize collation support for ASCII strings (all collations)

2024-08-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48978. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47326 [https://gith

[jira] [Assigned] (SPARK-49109) Rename leftover BinaryLcase to Lcase

2024-08-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49109: --- Assignee: Mihailo Milosevic > Rename leftover BinaryLcase to Lcase > --

[jira] [Resolved] (SPARK-49109) Rename leftover BinaryLcase to Lcase

2024-08-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49109. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47602 [https://gith

[jira] [Resolved] (SPARK-49018) Fix approx_count_distinct not working correctly with collation

2024-08-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49018. - Resolution: Fixed Issue resolved by pull request 47503 [https://github.com/apache/spark/pull/475

[jira] [Assigned] (SPARK-49018) Fix approx_count_distinct not working correctly with collation

2024-08-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49018: --- Assignee: Viktor Lučić > Fix approx_count_distinct not working correctly with collation > -

[jira] [Assigned] (SPARK-49063) Fix Between with ScalarSubqueries

2024-08-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49063: --- Assignee: Mihailo Milosevic > Fix Between with ScalarSubqueries > -

[jira] [Resolved] (SPARK-49063) Fix Between with ScalarSubqueries

2024-08-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49063. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47581 [https://gith

[jira] [Assigned] (SPARK-48346) [M0] Support for IF ELSE statement

2024-08-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48346: --- Assignee: David Milicevic > [M0] Support for IF ELSE statement > --

[jira] [Resolved] (SPARK-48346) [M0] Support for IF ELSE statement

2024-08-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48346. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47442 [https://gith

[jira] [Assigned] (SPARK-49057) Do not block the AQE loop when submitting query stages

2024-08-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49057: --- Assignee: Wenchen Fan > Do not block the AQE loop when submitting query stages > --

[jira] [Resolved] (SPARK-49057) Do not block the AQE loop when submitting query stages

2024-08-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49057. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47533 [https://gith

[jira] [Updated] (SPARK-49000) Aggregation with DISTINCT gives wrong results when dealing with literals

2024-08-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-49000: Fix Version/s: 3.5.2 > Aggregation with DISTINCT gives wrong results when dealing with literals >

[jira] [Assigned] (SPARK-49065) Rebasing in legacy formatters/parsers must support non JVM default time zones

2024-08-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49065: --- Assignee: Sumeet Varma > Rebasing in legacy formatters/parsers must support non JVM default

[jira] [Resolved] (SPARK-49065) Rebasing in legacy formatters/parsers must support non JVM default time zones

2024-08-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49065. - Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pull re

[jira] [Assigned] (SPARK-49074) Fix cached Variant with column size greater than 128KB or individual variant larger than 2kb

2024-07-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49074: --- Assignee: Richard Chen > Fix cached Variant with column size greater than 128KB or individu

[jira] [Resolved] (SPARK-49074) Fix cached Variant with column size greater than 128KB or individual variant larger than 2kb

2024-07-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49074. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47559 [https://gith

[jira] [Resolved] (SPARK-49000) Aggregation with DISTINCT gives wrong results when dealing with literals

2024-07-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49000. - Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pull re

[jira] [Assigned] (SPARK-49000) Aggregation with DISTINCT gives wrong results when dealing with literals

2024-07-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49000: --- Assignee: Uroš Bojanić > Aggregation with DISTINCT gives wrong results when dealing with li

  1   2   3   4   5   6   7   8   9   10   >