[jira] [Updated] (SPARK-48733) Do not test SET command in Python UDTF test

[ https://issues.apache.org/jira/browse/SPARK-48733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-48733: - Summary: Do not test SET command in Python UDTF test (was: Do not set SET command in Python

[jira] [Created] (SPARK-48734) Separate local cluster test from test_artifact to test_artifact_localcluster

Hyukjin Kwon created SPARK-48734: Summary: Separate local cluster test from test_artifact to test_artifact_localcluster Key: SPARK-48734 URL: https://issues.apache.org/jira/browse/SPARK-48734

[jira] [Updated] (SPARK-48734) Separate local cluster test from test_artifact to test_artifact_localcluster

[ https://issues.apache.org/jira/browse/SPARK-48734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-48734: - Description: Separate local cluster test from test_artifact to test_artifact_localcluster. Both

[jira] [Created] (SPARK-48733) Do not set SET command in Python UDTF test

Hyukjin Kwon created SPARK-48733: Summary: Do not set SET command in Python UDTF test Key: SPARK-48733 URL: https://issues.apache.org/jira/browse/SPARK-48733 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47172) Upgrade Transport block cipher mode to GCM

[ https://issues.apache.org/jira/browse/SPARK-47172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi resolved SPARK-47172. -- Resolution: Fixed > Upgrade Transport block cipher mode to GCM > -- >

[jira] [Updated] (SPARK-47172) Upgrade Transport block cipher mode to GCM

[ https://issues.apache.org/jira/browse/SPARK-47172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-47172: - Fix Version/s: 4.0.0 3.5.2 3.4.4 > Upgrade Transport block cipher mode to

[jira] [Commented] (SPARK-47172) Upgrade Transport block cipher mode to GCM

[ https://issues.apache.org/jira/browse/SPARK-47172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17860325#comment-17860325 ] wuyi commented on SPARK-47172: -- The issue has been resolved by [https://github.com/apache/spark/pull/46515]

[jira] [Assigned] (SPARK-47172) Upgrade Transport block cipher mode to GCM

[ https://issues.apache.org/jira/browse/SPARK-47172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi reassigned SPARK-47172: Assignee: Steve Weis > Upgrade Transport block cipher mode to GCM >

[jira] [Resolved] (SPARK-48729) Add a UserDefinedFunction interface to represent a SQL function

[ https://issues.apache.org/jira/browse/SPARK-48729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48729. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47108

[jira] [Assigned] (SPARK-48729) Add a UserDefinedFunction interface to represent a SQL function

[ https://issues.apache.org/jira/browse/SPARK-48729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48729: --- Assignee: Allison Wang > Add a UserDefinedFunction interface to represent a SQL function >

[jira] [Assigned] (SPARK-48732) Cleanup deprecated api usage related to JdbcDialect.compileAggregate

[ https://issues.apache.org/jira/browse/SPARK-48732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-48732: Assignee: Wei Guo > Cleanup deprecated api usage related to JdbcDialect.compileAggregate >

[jira] [Resolved] (SPARK-48732) Cleanup deprecated api usage related to JdbcDialect.compileAggregate

[ https://issues.apache.org/jira/browse/SPARK-48732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-48732. -- Resolution: Fixed Resloved by https://github.com/apache/spark/pull/47070 > Cleanup deprecated api

[jira] [Created] (SPARK-48732) Cleanup deprecated api usage related to JdbcDialect.compileAggregate

Wei Guo created SPARK-48732: --- Summary: Cleanup deprecated api usage related to JdbcDialect.compileAggregate Key: SPARK-48732 URL: https://issues.apache.org/jira/browse/SPARK-48732 Project: Spark

[jira] [Resolved] (SPARK-48721) Fix Decode doc in SQL API page

[ https://issues.apache.org/jira/browse/SPARK-48721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48721. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47099

[jira] [Assigned] (SPARK-48721) Fix Decode doc in SQL API page

[ https://issues.apache.org/jira/browse/SPARK-48721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48721: Assignee: Kent Yao > Fix Decode doc in SQL API page > -- > >

[jira] [Resolved] (SPARK-48723) Run `git cherry-pick --abort` if backporting is denied by committer

[ https://issues.apache.org/jira/browse/SPARK-48723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48723. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47101

[jira] [Assigned] (SPARK-48717) Python foreachBatch streaming query cannot be stopped gracefully after pin thread mode is enabled and is running spark queries

[ https://issues.apache.org/jira/browse/SPARK-48717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48717: Assignee: Wei Liu > Python foreachBatch streaming query cannot be stopped gracefully

[jira] [Resolved] (SPARK-48717) Python foreachBatch streaming query cannot be stopped gracefully after pin thread mode is enabled and is running spark queries

[ https://issues.apache.org/jira/browse/SPARK-48717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48717. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47093

[jira] [Updated] (SPARK-48479) Support creating temp SQL functions in parser

[ https://issues.apache.org/jira/browse/SPARK-48479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-48479: - Summary: Support creating temp SQL functions in parser (was: Support creating SQL functions in

[jira] [Created] (SPARK-48730) Support creating persistent SQL UDFs in parser

Allison Wang created SPARK-48730: Summary: Support creating persistent SQL UDFs in parser Key: SPARK-48730 URL: https://issues.apache.org/jira/browse/SPARK-48730 Project: Spark Issue Type:

[jira] [Created] (SPARK-48729) Add a UserDefinedFunction interface to represent a SQL function

Allison Wang created SPARK-48729: Summary: Add a UserDefinedFunction interface to represent a SQL function Key: SPARK-48729 URL: https://issues.apache.org/jira/browse/SPARK-48729 Project: Spark

[jira] [Updated] (SPARK-48586) Remove lock acquisition in doMaintenance() by making a deep copy of file mappings in RocksDBFileManager in load()

[ https://issues.apache.org/jira/browse/SPARK-48586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Riya Verma updated SPARK-48586: --- Description: Currently the lock of the *RocksDB* state store is acquired when uploading the

[jira] [Updated] (SPARK-48586) Remove lock acquisition in doMaintenance() by making a deep copy of file mappings in RocksDBFileManager in load()

[ https://issues.apache.org/jira/browse/SPARK-48586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Riya Verma updated SPARK-48586: --- Summary: Remove lock acquisition in doMaintenance() by making a deep copy of file mappings in

[jira] [Updated] (SPARK-48727) Native QueryExecution information for the dataframe [SPARK CLASSIC]

[ https://issues.apache.org/jira/browse/SPARK-48727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sem Sinchenko updated SPARK-48727: -- Description: Adding a new property to `DataFrame` called `queryExecution` that returns a

[jira] [Updated] (SPARK-48727) Native QueryExecution information for the dataframe [SPARK CLASSIC]

[ https://issues.apache.org/jira/browse/SPARK-48727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sem Sinchenko updated SPARK-48727: -- Component/s: (was: Connect) > Native QueryExecution information for the dataframe [SPARK

[jira] [Created] (SPARK-48727) Native QueryExecution information for the dataframe [SPARK CLASSIC]

Sem Sinchenko created SPARK-48727: - Summary: Native QueryExecution information for the dataframe [SPARK CLASSIC] Key: SPARK-48727 URL: https://issues.apache.org/jira/browse/SPARK-48727 Project: Spark

[jira] [Created] (SPARK-48726) Create the StateSchemaV3 file format, and write this out for the TransformWithStateExec operator

Eric Marnadi created SPARK-48726: Summary: Create the StateSchemaV3 file format, and write this out for the TransformWithStateExec operator Key: SPARK-48726 URL:

[jira] [Commented] (SPARK-48719) Wrong Result in regr_slope_intercept Aggregate with Tuples has NULL

[ https://issues.apache.org/jira/browse/SPARK-48719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17860200#comment-17860200 ] Wei Guo commented on SPARK-48719: - I made a [PR|https://github.com/apache/spark/pull/47105] for this. >

[jira] [Updated] (SPARK-48691) Upgrade `scalatest` related dependencies to the 3.2.19 series

[ https://issues.apache.org/jira/browse/SPARK-48691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-48691: - Summary: Upgrade `scalatest` related dependencies to the 3.2.19 series (was: Upgrade `scalatest`

[jira] [Assigned] (SPARK-48691) Upgrade `scalatest` related dependencies to the 3.2.19 series

[ https://issues.apache.org/jira/browse/SPARK-48691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-48691: Assignee: Wei Guo > Upgrade `scalatest` related dependencies to the 3.2.19 series >

[jira] [Resolved] (SPARK-48691) Upgrade `scalatest` related dependencies to the 3.2.19 series

[ https://issues.apache.org/jira/browse/SPARK-48691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-48691. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47065

[jira] [Assigned] (SPARK-48687) Add changes to implement state schema validation in planning phase on driver for stateful streaming queries

[ https://issues.apache.org/jira/browse/SPARK-48687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-48687: Assignee: Anish Shrigondekar > Add changes to implement state schema validation in

[jira] [Resolved] (SPARK-48687) Add changes to implement state schema validation in planning phase on driver for stateful streaming queries

[ https://issues.apache.org/jira/browse/SPARK-48687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-48687. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47035

[jira] [Created] (SPARK-48725) Use lowerCaseCodePoints in string functions for UTF8_LCASE

Uroš Bojanić created SPARK-48725: Summary: Use lowerCaseCodePoints in string functions for UTF8_LCASE Key: SPARK-48725 URL: https://issues.apache.org/jira/browse/SPARK-48725 Project: Spark

[jira] [Resolved] (SPARK-48724) Fix incorrect conf settings of ignoreCorruptFiles related tests case in ParquetQuerySuite

[ https://issues.apache.org/jira/browse/SPARK-48724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-48724. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47088

[jira] [Assigned] (SPARK-48724) Fix incorrect conf settings of ignoreCorruptFiles related tests case in ParquetQuerySuite

[ https://issues.apache.org/jira/browse/SPARK-48724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-48724: Assignee: Wei Guo > Fix incorrect conf settings of ignoreCorruptFiles related tests case in >

[jira] [Updated] (SPARK-48724) Fix incorrect conf settings of ignoreCorruptFiles related tests case in ParquetQuerySuite

[ https://issues.apache.org/jira/browse/SPARK-48724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-48724: Description: The code as follows: {code:java} withSQLConf(SQLConf.IGNORE_CORRUPT_FILES.key -> sqlConf) {

[jira] [Updated] (SPARK-48724) Fix incorrect conf settings of ignoreCorruptFiles related tests case in ParquetQuerySuite

[ https://issues.apache.org/jira/browse/SPARK-48724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-48724: Description: The code as belows:   > Fix incorrect conf settings of ignoreCorruptFiles related tests

[jira] [Created] (SPARK-48724) Fix incorrect conf settings of ignoreCorruptFiles related tests case in ParquetQuerySuite

Wei Guo created SPARK-48724: --- Summary: Fix incorrect conf settings of ignoreCorruptFiles related tests case in ParquetQuerySuite Key: SPARK-48724 URL: https://issues.apache.org/jira/browse/SPARK-48724

[jira] [Created] (SPARK-48723) Run `git cherry-pick --abort` if backporting is denied by committer

Kent Yao created SPARK-48723: Summary: Run `git cherry-pick --abort` if backporting is denied by committer Key: SPARK-48723 URL: https://issues.apache.org/jira/browse/SPARK-48723 Project: Spark

[jira] [Updated] (SPARK-48722) Patch executor pod without optimistic locking

[ https://issues.apache.org/jira/browse/SPARK-48722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qian Sun updated SPARK-48722: - Description: With fabric8 version 6.5, Apache Spark patch executor pod with optimistic locking, which

[jira] [Resolved] (SPARK-48713) Add index range check for UnsafeRow.pointTo when baseObject is byte array

[ https://issues.apache.org/jira/browse/SPARK-48713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48713. -- Fix Version/s: 4.0.0 Assignee: wuyi Resolution: Fixed > Add index range check for

[jira] [Assigned] (SPARK-48668) Support ALTER NAMESPACE ... UNSET PROPERTIES in v2

[ https://issues.apache.org/jira/browse/SPARK-48668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48668: -- Assignee: (was: Apache Spark) > Support ALTER NAMESPACE ... UNSET PROPERTIES in

[jira] [Assigned] (SPARK-48668) Support ALTER NAMESPACE ... UNSET PROPERTIES in v2

[ https://issues.apache.org/jira/browse/SPARK-48668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48668: -- Assignee: Apache Spark > Support ALTER NAMESPACE ... UNSET PROPERTIES in v2 >

[jira] [Commented] (SPARK-48668) Support ALTER NAMESPACE ... UNSET PROPERTIES in v2

[ https://issues.apache.org/jira/browse/SPARK-48668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17860099#comment-17860099 ] ASF GitHub Bot commented on SPARK-48668: User 'panbingkun' has created a pull request for this

[jira] [Commented] (SPARK-48668) Support ALTER NAMESPACE ... UNSET PROPERTIES in v2

[ https://issues.apache.org/jira/browse/SPARK-48668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17860098#comment-17860098 ] ASF GitHub Bot commented on SPARK-48668: User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-48668) Support ALTER NAMESPACE ... UNSET PROPERTIES in v2

[ https://issues.apache.org/jira/browse/SPARK-48668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48668: -- Assignee: Apache Spark > Support ALTER NAMESPACE ... UNSET PROPERTIES in v2 >

[jira] [Assigned] (SPARK-48668) Support ALTER NAMESPACE ... UNSET PROPERTIES in v2

[ https://issues.apache.org/jira/browse/SPARK-48668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48668: -- Assignee: (was: Apache Spark) > Support ALTER NAMESPACE ... UNSET PROPERTIES in

[jira] [Updated] (SPARK-48421) SPJ: Add documentation

[ https://issues.apache.org/jira/browse/SPARK-48421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated SPARK-48421: -- Parent: SPARK-48613 Issue Type: Sub-task (was: Documentation) > SPJ: Add documentation >

[jira] [Created] (SPARK-48721) Fix Decode doc in SQL API page

Kent Yao created SPARK-48721: Summary: Fix Decode doc in SQL API page Key: SPARK-48721 URL: https://issues.apache.org/jira/browse/SPARK-48721 Project: Spark Issue Type: Bug Components:

[jira] [Assigned] (SPARK-47353) Mode expression for strings (all collations)

[ https://issues.apache.org/jira/browse/SPARK-47353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47353: --- Assignee: Gideon P > Mode expression for strings (all collations) >

[jira] [Resolved] (SPARK-47353) Mode expression for strings (all collations)

[ https://issues.apache.org/jira/browse/SPARK-47353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47353. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46597

[jira] [Assigned] (SPARK-48670) Providing suggestion as part of error message when invalid collation name is given

[ https://issues.apache.org/jira/browse/SPARK-48670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48670: --- Assignee: Aleksandar Tomic > Providing suggestion as part of error message when invalid

[jira] [Resolved] (SPARK-48670) Providing suggestion as part of error message when invalid collation name is given

[ https://issues.apache.org/jira/browse/SPARK-48670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48670. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47040

[jira] [Created] (SPARK-48720) Fix `IF EXISTS` ignored for `ALTER TABLE ... UNSET TBLPROPERTIES ...` in v2

BingKun Pan created SPARK-48720: --- Summary: Fix `IF EXISTS` ignored for `ALTER TABLE ... UNSET TBLPROPERTIES ...` in v2 Key: SPARK-48720 URL: https://issues.apache.org/jira/browse/SPARK-48720 Project:

[jira] [Resolved] (SPARK-48699) Refine collation API

[ https://issues.apache.org/jira/browse/SPARK-48699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48699. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47014