[jira] [Assigned] (SPARK-51946) Eagerly fail for creating hive-incompatible datasource table with `col` a partition name

2025-04-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-51946: Assignee: Kent Yao > Eagerly fail for creating hive-incompatible datasource table with `col` a >

[jira] [Resolved] (SPARK-51946) Eagerly fail for creating hive-incompatible datasource table with `col` a partition name

2025-04-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-51946. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50750 [https://github.com

[jira] [Assigned] (SPARK-51953) Support Java 24

2025-04-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51953: - Assignee: Dongjoon Hyun > Support Java 24 > --- > > Key: SP

[jira] [Resolved] (SPARK-51953) Support Java 24

2025-04-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51953. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Updated] (SPARK-51902) Enforce check constraint on table insertion

2025-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51902: --- Labels: pull-request-available (was: ) > Enforce check constraint on table insertion >

[jira] [Resolved] (SPARK-51834) Support end-to-end table constraint management

2025-04-29 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-51834. Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50631 [https:

[jira] [Resolved] (SPARK-51428) Implicit aliases of collated trees are assigned non-deterministically

2025-04-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51428. - Resolution: Fixed Issue resolved by pull request 50727 [https://github.com/apache/spark/pull/507

[jira] [Resolved] (SPARK-51867) Make scala model supporting save / load against local filesystem path

2025-04-29 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-51867. -- Resolution: Fixed Issue resolved by pull request 50665 [https://github.com/apache/spark/pull/50665] >

[jira] [Created] (SPARK-51957) Fix partition column and EMTPY_DATA_SCHEMA naming conflict

2025-04-29 Thread Kent Yao (Jira)
Kent Yao created SPARK-51957: Summary: Fix partition column and EMTPY_DATA_SCHEMA naming conflict Key: SPARK-51957 URL: https://issues.apache.org/jira/browse/SPARK-51957 Project: Spark Issue Type

[jira] [Assigned] (SPARK-51956) Fix `KerberosConfDriverFeatureStep` to warn in case of failures

2025-04-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51956: - Assignee: Dongjoon Hyun > Fix `KerberosConfDriverFeatureStep` to warn in case of failur

[jira] [Resolved] (SPARK-51956) Fix `KerberosConfDriverFeatureStep` to warn in case of failures

2025-04-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51956. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50758 [https://

[jira] [Updated] (SPARK-51956) Fix `KerberosConfDriverFeatureStep` to warn in case of failures

2025-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51956: --- Labels: pull-request-available (was: ) > Fix `KerberosConfDriverFeatureStep` to warn in cas

[jira] [Created] (SPARK-51956) Fix `KerberosConfDriverFeatureStep` to warn in case of failures

2025-04-29 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-51956: - Summary: Fix `KerberosConfDriverFeatureStep` to warn in case of failures Key: SPARK-51956 URL: https://issues.apache.org/jira/browse/SPARK-51956 Project: Spark

[jira] [Updated] (SPARK-51955) Adding release() to ReadStateStore interface and reusing ReadStore for Streaming Aggregations

2025-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51955: --- Labels: pull-request-available (was: ) > Adding release() to ReadStateStore interface and r

[jira] [Created] (SPARK-51955) Adding release() to ReadStateStore interface and reusing ReadStore for Streaming Aggregations

2025-04-29 Thread Eric Marnadi (Jira)
Eric Marnadi created SPARK-51955: Summary: Adding release() to ReadStateStore interface and reusing ReadStore for Streaming Aggregations Key: SPARK-51955 URL: https://issues.apache.org/jira/browse/SPARK-51955

[jira] [Created] (SPARK-51954) Ensure that the KafkaSourceRDD in kafka sql connector supports generic deserializers

2025-04-29 Thread Rajesh Mahindra (Jira)
Rajesh Mahindra created SPARK-51954: --- Summary: Ensure that the KafkaSourceRDD in kafka sql connector supports generic deserializers Key: SPARK-51954 URL: https://issues.apache.org/jira/browse/SPARK-51954

[jira] [Updated] (SPARK-51953) Support Java 24

2025-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51953: --- Labels: pull-request-available (was: ) > Support Java 24 > --- > >

[jira] [Created] (SPARK-51953) Support Java 24

2025-04-29 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-51953: - Summary: Support Java 24 Key: SPARK-51953 URL: https://issues.apache.org/jira/browse/SPARK-51953 Project: Spark Issue Type: Sub-task Components:

[jira] [Assigned] (SPARK-51952) Disable `fail-fast` in `Build Test CI` matrix

2025-04-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51952: - Assignee: Dongjoon Hyun > Disable `fail-fast` in `Build Test CI` matrix > -

[jira] [Resolved] (SPARK-51952) Disable `fail-fast` in `Build Test CI` matrix

2025-04-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51952. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Resolved] (SPARK-51951) Upgrade `Gradle` to 8.14

2025-04-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51951. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Commented] (SPARK-51415) Support the time type by make_timestamp()

2025-04-29 Thread Sakthi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17948228#comment-17948228 ] Sakthi commented on SPARK-51415: Let me take a stab at this. > Support the time type by

[jira] [Updated] (SPARK-51952) Disable `fail-fast` in `Build Test CI` matix

2025-04-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51952: -- Summary: Disable `fail-fast` in `Build Test CI` matix (was: Disable `fail-fast` in `Build Tes

[jira] [Updated] (SPARK-51952) Disable `fail-fast` in `Build Test CI` matrix

2025-04-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51952: -- Summary: Disable `fail-fast` in `Build Test CI` matrix (was: Disable `fail-fast` in `Build Te

[jira] [Updated] (SPARK-51952) Disable `fail-fast` in `Build Test CI`

2025-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51952: --- Labels: pull-request-available (was: ) > Disable `fail-fast` in `Build Test CI` > -

[jira] [Created] (SPARK-51952) Disable `fail-fast` in `Build Test CI`

2025-04-29 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-51952: - Summary: Disable `fail-fast` in `Build Test CI` Key: SPARK-51952 URL: https://issues.apache.org/jira/browse/SPARK-51952 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-51951) Upgrade `Gradle` to 8.14

2025-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51951: --- Labels: pull-request-available (was: ) > Upgrade `Gradle` to 8.14 > ---

[jira] [Updated] (SPARK-51951) Upgrade `Gradle` to 8.14

2025-04-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51951: -- Summary: Upgrade `Gradle` to 8.14 (was: Upgrade `Gradle` to 8.14 for Java 24) > Upgrade `Gra

[jira] [Updated] (SPARK-51949) Increase the default value of CONNECT_GRPC_MARSHALLER_RECURSION_LIMIT

2025-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51949: --- Labels: pull-request-available (was: ) > Increase the default value of CONNECT_GRPC_MARSHAL

[jira] [Updated] (SPARK-51950) Upgrade `Parquet` to 1.15.2

2025-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51950: --- Labels: pull-request-available (was: ) > Upgrade `Parquet` to 1.15.2 >

[jira] [Resolved] (SPARK-51948) Changes to the mllib module should trigger the tests for the connect module

2025-04-29 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-51948. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50753 [https://github.com

[jira] [Assigned] (SPARK-51948) Changes to the mllib module should trigger the tests for the connect module

2025-04-29 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-51948: Assignee: Yang Jie > Changes to the mllib module should trigger the tests for the connect module

[jira] [Created] (SPARK-51949) Increase the default value of CONNECT_GRPC_MARSHALLER_RECURSION_LIMIT

2025-04-29 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-51949: Summary: Increase the default value of CONNECT_GRPC_MARSHALLER_RECURSION_LIMIT Key: SPARK-51949 URL: https://issues.apache.org/jira/browse/SPARK-51949

[jira] [Resolved] (SPARK-51609) Optimize Recursive CTE execution for simple queries

2025-04-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51609. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50402 [https://gith

[jira] [Assigned] (SPARK-51609) Optimize Recursive CTE execution for simple queries

2025-04-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51609: --- Assignee: Pavle Martinović > Optimize Recursive CTE execution for simple queries >

[jira] [Resolved] (SPARK-51890) Store user-specified options when reading views

2025-04-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51890. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50645 [https://gith

[jira] [Assigned] (SPARK-51890) Store user-specified options when reading views

2025-04-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51890: --- Assignee: Yumingxuan Guo > Store user-specified options when reading views > --

[jira] [Updated] (SPARK-51890) Store user-specified options when reading views

2025-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51890: --- Labels: pull-request-available (was: ) > Store user-specified options when reading views >

[jira] [Resolved] (SPARK-51941) CatalystTypeConverters.convertToCatalyst failed to convert BigDecimal between -1.0 and 1.0

2025-04-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51941. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50747 [https://gith

[jira] [Assigned] (SPARK-51941) CatalystTypeConverters.convertToCatalyst failed to convert BigDecimal between -1.0 and 1.0

2025-04-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51941: --- Assignee: Junqing Li > CatalystTypeConverters.convertToCatalyst failed to convert BigDecima

[jira] [Reopened] (SPARK-51867) Make scala model supporting save / load against local filesystem path

2025-04-29 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reopened SPARK-51867: -- > Make scala model supporting save / load against local filesystem path >

[jira] [Updated] (SPARK-51948) Changes to the mllib module should trigger the tests for the connect module

2025-04-29 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-51948: - Affects Version/s: 4.0.0 > Changes to the mllib module should trigger the tests for the connect module >

[jira] [Updated] (SPARK-51948) Changes to the mllib module should trigger the tests for the connect module

2025-04-29 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-51948: - Issue Type: Bug (was: Improvement) > Changes to the mllib module should trigger the tests for the conne

[jira] [Updated] (SPARK-51948) Changes to the mllib module should trigger the tests for the connect module

2025-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51948: --- Labels: pull-request-available (was: ) > Changes to the mllib module should trigger the tes

[jira] [Created] (SPARK-51948) Changes to the mllib module should trigger the tests for the connect module

2025-04-29 Thread Yang Jie (Jira)
Yang Jie created SPARK-51948: Summary: Changes to the mllib module should trigger the tests for the connect module Key: SPARK-51948 URL: https://issues.apache.org/jira/browse/SPARK-51948 Project: Spark

[jira] [Updated] (SPARK-51947) Model cache offloading

2025-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51947: --- Labels: pull-request-available (was: ) > Model cache offloading > -- >

[jira] [Updated] (SPARK-51945) Precision Increase from Decimal(28,20) to Decimal(29,20) When Rounding to 20 Decimal Places in Spark 3.5

2025-04-29 Thread Tarique Anwer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarique Anwer updated SPARK-51945: -- Description: In Apache Spark 3.5 (and Databricks Runtime 15.4 LTS), the round function increa

[jira] [Resolved] (SPARK-51944) Upgrade Netty to 4.1.121.Final

2025-04-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-51944. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50749 [https://github.com

[jira] [Updated] (SPARK-51946) Eagerly fail for creating hive-incompatible datasource table with `col` a partition name

2025-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51946: --- Labels: pull-request-available (was: ) > Eagerly fail for creating hive-incompatible dataso

[jira] [Created] (SPARK-51946) Eagerly fail for creating hive-incompatible datasource table with `col` a partition name

2025-04-29 Thread Kent Yao (Jira)
Kent Yao created SPARK-51946: Summary: Eagerly fail for creating hive-incompatible datasource table with `col` a partition name Key: SPARK-51946 URL: https://issues.apache.org/jira/browse/SPARK-51946 Proj

[jira] [Resolved] (SPARK-51867) Make scala model supporting save / load against local filesystem path

2025-04-29 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu resolved SPARK-51867. Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50665 [https://github

[jira] [Assigned] (SPARK-51867) Make scala model supporting save / load against local filesystem path

2025-04-29 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu reassigned SPARK-51867: -- Assignee: Weichen Xu > Make scala model supporting save / load against local filesystem path

[jira] [Updated] (SPARK-51945) Precision Increase from Decimal(28,20) to Decimal(29,20) When Rounding to 20 Decimal Places in Spark 3.5

2025-04-29 Thread Tarique Anwer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarique Anwer updated SPARK-51945: -- Description: In Apache Spark 3.5 (and Databricks Runtime 15.4 LTS), the round function increa

[jira] [Updated] (SPARK-51945) Precision Increase from Decimal(28,20) to Decimal(29,20) When Rounding to 20 Decimal Places in Spark 3.5

2025-04-29 Thread Tarique Anwer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarique Anwer updated SPARK-51945: -- Description: In Apache Spark 3.5 (and Databricks Runtime 15.4 LTS), the round function increa

[jira] [Created] (SPARK-51945) Precision Increase from Decimal(28,20) to Decimal(29,20) When Rounding to 20 Decimal Places in Spark 3.5

2025-04-29 Thread Tarique Anwer (Jira)
Tarique Anwer created SPARK-51945: - Summary: Precision Increase from Decimal(28,20) to Decimal(29,20) When Rounding to 20 Decimal Places in Spark 3.5 Key: SPARK-51945 URL: https://issues.apache.org/jira/browse/SPA