[jira] [Assigned] (SPARK-50460) Generalize and simplify Connect exception handling

2024-12-09 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee reassigned SPARK-50460: --- Assignee: Haejoon Lee > Generalize and simplify Connect exception handling > --

[jira] [Resolved] (SPARK-50460) Generalize and simplify Connect exception handling

2024-12-09 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-50460. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49041 [https://gith

[jira] [Updated] (SPARK-48730) Implement CreateSQLFunctionCommand for SQL Scalar and Table Functions

2024-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48730: --- Labels: pull-request-available (was: ) > Implement CreateSQLFunctionCommand for SQL Scalar

[jira] [Updated] (SPARK-48730) Implement CreateSQLFunctionCommand for SQL Scalar and Table Functions

2024-12-09 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-48730: - Description: Implement CreateSQLFunctionCommand to support the creation of SQL scalar and table

[jira] [Updated] (SPARK-48730) Implement CreateSQLFunctionCommand for SQL Scalar and Table Functions

2024-12-09 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-48730: - Summary: Implement CreateSQLFunctionCommand for SQL Scalar and Table Functions (was: Support cr

[jira] [Updated] (SPARK-50528) Move InvalidCommandInput to common module

2024-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50528: --- Labels: pull-request-available (was: ) > Move InvalidCommandInput to common module > --

[jira] [Created] (SPARK-50528) Move InvalidCommandInput to common module

2024-12-09 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50528: - Summary: Move InvalidCommandInput to common module Key: SPARK-50528 URL: https://issues.apache.org/jira/browse/SPARK-50528 Project: Spark Issue Type: Impro

[jira] [Updated] (SPARK-48730) Support create persistent SQL UDFs

2024-12-09 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-48730: - Summary: Support create persistent SQL UDFs (was: Support creating persistent SQL UDFs) > Supp

[jira] [Updated] (SPARK-48730) Support creating persistent SQL UDFs

2024-12-09 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-48730: - Summary: Support creating persistent SQL UDFs (was: Support create persistent SQL UDFs) > Supp

[jira] [Updated] (SPARK-48730) Support creating persistent SQL UDFs

2024-12-09 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-48730: - Summary: Support creating persistent SQL UDFs (was: Support creating persistent SQL UDFs in par

[jira] [Commented] (SPARK-24400) Issue with spark while accessing managed table with partitions across multiple namespaces - HDFS Federation

2024-12-09 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17904336#comment-17904336 ] Tao Li commented on SPARK-24400: This scenario is quite common. If we change the locatio

[jira] [Updated] (SPARK-50527) Add a separate docker file for python 3.12 daily build

2024-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50527: --- Labels: pull-request-available (was: ) > Add a separate docker file for python 3.12 daily b

[jira] [Created] (SPARK-50527) Add a separate docker file for python 3.12 daily build

2024-12-09 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50527: - Summary: Add a separate docker file for python 3.12 daily build Key: SPARK-50527 URL: https://issues.apache.org/jira/browse/SPARK-50527 Project: Spark Issu

[jira] [Assigned] (SPARK-50524) Lower `RowBasedKeyValueBatch.spill` warning message to debug level

2024-12-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-50524: Assignee: Dongjoon Hyun > Lower `RowBasedKeyValueBatch.spill` warning message to debug le

[jira] [Resolved] (SPARK-50524) Lower `RowBasedKeyValueBatch.spill` warning message to debug level

2024-12-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-50524. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49116 [https://gi

[jira] [Resolved] (SPARK-50480) Extend CharType and VarcharType from StringType

2024-12-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-50480. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48883 [https://gith

[jira] [Assigned] (SPARK-50480) Extend CharType and VarcharType from StringType

2024-12-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-50480: --- Assignee: Jovan Markovic > Extend CharType and VarcharType from StringType > --

[jira] [Resolved] (SPARK-50329) InSet$toString should work for unresolved plan node

2024-12-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-50329. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48865 [https://gith

[jira] [Assigned] (SPARK-50329) InSet$toString should work for unresolved plan node

2024-12-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-50329: --- Assignee: Avery Qi > InSet$toString should work for unresolved plan node >

[jira] [Created] (SPARK-50526) Store state encoding format in offset log

2024-12-09 Thread Anish Shrigondekar (Jira)
Anish Shrigondekar created SPARK-50526: -- Summary: Store state encoding format in offset log Key: SPARK-50526 URL: https://issues.apache.org/jira/browse/SPARK-50526 Project: Spark Issue T

[jira] [Updated] (SPARK-33152) SPIP: Constraint Propagation code causes OOM issues or increasing compilation time to hours

2024-12-09 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-33152: - Description: h2. Q1. What are you trying to do? Articulate your objectives using absolutely no jargon. Proposi

[jira] [Commented] (SPARK-33152) SPIP: Constraint Propagation code causes OOM issues or increasing compilation time to hours

2024-12-09 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17904288#comment-17904288 ] Asif commented on SPARK-33152: -- Latest reopened PR [https://github.com/apache/spark/pull/4

[jira] [Created] (SPARK-50525) Do not allow repartition by map

2024-12-09 Thread Jira
Herman van Hövell created SPARK-50525: - Summary: Do not allow repartition by map Key: SPARK-50525 URL: https://issues.apache.org/jira/browse/SPARK-50525 Project: Spark Issue Type: Bug

[jira] (SPARK-33152) SPIP: Constraint Propagation code causes OOM issues or increasing compilation time to hours

2024-12-09 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33152 ] Asif deleted comment on SPARK-33152: -- was (Author: ashahid7): PR opened: [pr-33152|https://github.com/apache/spark/pull/30185] > SPIP: Constraint Propagation code causes OOM issues or increasing c

[jira] [Resolved] (SPARK-50523) Fix casts on complex types in collation coercion

2024-12-09 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-50523. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49075 [https://github.com

[jira] [Resolved] (SPARK-50063) Support Variant in Spark Connect Scala client

2024-12-09 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-50063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-50063. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49057 [

[jira] [Assigned] (SPARK-50063) Support Variant in Spark Connect Scala client

2024-12-09 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-50063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell reassigned SPARK-50063: - Assignee: Harsh Motwani > Support Variant in Spark Connect Scala client > -

[jira] [Resolved] (SPARK-50503) Disable repartition by Variant columns

2024-12-09 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-50503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-50503. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49080 [

[jira] [Created] (SPARK-50524) Lower `RowBasedKeyValueBatch.spill` warning message to debug level

2024-12-09 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-50524: - Summary: Lower `RowBasedKeyValueBatch.spill` warning message to debug level Key: SPARK-50524 URL: https://issues.apache.org/jira/browse/SPARK-50524 Project: Spark

[jira] [Updated] (SPARK-50524) Lower `RowBasedKeyValueBatch.spill` warning message to debug level

2024-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50524: --- Labels: pull-request-available (was: ) > Lower `RowBasedKeyValueBatch.spill` warning messag

[jira] [Resolved] (SPARK-50497) Fail queries with proper message if MultiAlias contains non-generator function

2024-12-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-50497. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49072 [https://gith

[jira] [Assigned] (SPARK-50497) Fail queries with proper message if MultiAlias contains non-generator function

2024-12-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-50497: --- Assignee: Mihailo Milosevic > Fail queries with proper message if MultiAlias contains non-g

[jira] [Updated] (SPARK-50428) Batch support for TransformWithStateInPandas

2024-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50428: --- Labels: pull-request-available (was: ) > Batch support for TransformWithStateInPandas > ---

[jira] [Updated] (SPARK-43415) Impl mapValues for KVGDS#mapValues

2024-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43415: --- Labels: pull-request-available (was: ) > Impl mapValues for KVGDS#mapValues > -

[jira] [Resolved] (SPARK-50517) Group arrow function related tests

2024-12-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50517. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49104 [https://

[jira] [Assigned] (SPARK-50517) Group arrow function related tests

2024-12-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-50517: - Assignee: Ruifeng Zheng > Group arrow function related tests >

[jira] [Updated] (SPARK-50518) Add default value for driver/executor CPU limit configuration

2024-12-09 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-50518: Description:   K8s pod.yaml {code:java} limits:   memory: 24320Mi requests:   cpu: "4"   memory: 24

[jira] [Created] (SPARK-50522) Support for indeterminate collation

2024-12-09 Thread Stefan Kandic (Jira)
Stefan Kandic created SPARK-50522: - Summary: Support for indeterminate collation Key: SPARK-50522 URL: https://issues.apache.org/jira/browse/SPARK-50522 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-50521) JDBCTableCatalog listTables API is not compatible with table catalog specification

2024-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50521: --- Labels: pull-request-available (was: ) > JDBCTableCatalog listTables API is not compatible

[jira] [Created] (SPARK-50521) JDBCTableCatalog listTables API is not compatible with table catalog specification

2024-12-09 Thread Uros Stankovic (Jira)
Uros Stankovic created SPARK-50521: -- Summary: JDBCTableCatalog listTables API is not compatible with table catalog specification Key: SPARK-50521 URL: https://issues.apache.org/jira/browse/SPARK-50521

[jira] [Created] (SPARK-50520) df.rdd.countApprox() : PySpark API does not respect the timeout.

2024-12-09 Thread Nandini (Jira)
Nandini created SPARK-50520: --- Summary: df.rdd.countApprox() : PySpark API does not respect the timeout. Key: SPARK-50520 URL: https://issues.apache.org/jira/browse/SPARK-50520 Project: Spark Issue

[jira] [Updated] (SPARK-50519) Simplify the method of creating SparkPlan for queryExecution

2024-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50519: --- Labels: pull-request-available (was: ) > Simplify the method of creating SparkPlan for quer

[jira] [Updated] (SPARK-50519) Simplify the method of creating SparkPlan for queryExecution

2024-12-09 Thread guihuawen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guihuawen updated SPARK-50519: -- Description: Simplify the method of creating SparkPlan for queryExecution.   The parameter of method

[jira] [Created] (SPARK-50519) Simplify the method of creating SparkPlan for queryExecution

2024-12-09 Thread guihuawen (Jira)
guihuawen created SPARK-50519: - Summary: Simplify the method of creating SparkPlan for queryExecution Key: SPARK-50519 URL: https://issues.apache.org/jira/browse/SPARK-50519 Project: Spark Issue

[jira] [Updated] (SPARK-50518) Add default value for driver/executor CPU limit configuration

2024-12-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50518: --- Labels: pull-request-available (was: ) > Add default value for driver/executor CPU limit co

[jira] [Created] (SPARK-50518) Add default value for driver/executor CPU limit configuration

2024-12-09 Thread Tongwei (Jira)
Tongwei created SPARK-50518: --- Summary: Add default value for driver/executor CPU limit configuration Key: SPARK-50518 URL: https://issues.apache.org/jira/browse/SPARK-50518 Project: Spark Issue Ty