[jira] [Resolved] (SPARK-47588) Hive module: Migrate logInfo with variables to structured logging framework

2024-04-16 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47588. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46086

[jira] [Updated] (SPARK-47882) createTableColumnTypes need to be mapped to database types instead of using directly

2024-04-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47882: --- Labels: pull-request-available (was: ) > createTableColumnTypes need to be mapped to

[jira] [Updated] (SPARK-47361) Improve JDBC data sources

2024-04-16 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47361: - Affects Version/s: 3.5.1 3.4.2 > Improve JDBC data sources >

[jira] [Updated] (SPARK-47882) createTableColumnTypes need to be mapped to database types instead of using directly

2024-04-16 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47882: - Affects Version/s: 3.5.1 3.4.2 > createTableColumnTypes need to be mapped to

[jira] [Updated] (SPARK-47361) Improve JDBC data sources

2024-04-16 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47361: - Affects Version/s: (was: 3.4.2) (was: 3.5.1) > Improve JDBC data sources

[jira] [Created] (SPARK-47882) createTableColumnTypes need to be mapped to database types instead of using directly

2024-04-16 Thread Kent Yao (Jira)
Kent Yao created SPARK-47882: Summary: createTableColumnTypes need to be mapped to database types instead of using directly Key: SPARK-47882 URL: https://issues.apache.org/jira/browse/SPARK-47882

[jira] [Resolved] (SPARK-47880) Oracle: Document Mapping Spark SQL Data Types to Oracle

2024-04-16 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47880. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46092

[jira] [Assigned] (SPARK-47880) Oracle: Document Mapping Spark SQL Data Types to Oracle

2024-04-16 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47880: Assignee: Kent Yao > Oracle: Document Mapping Spark SQL Data Types to Oracle >

[jira] [Resolved] (SPARK-47879) Oracle: Use VARCHAR2 instead of VARCHAR for VarcharType mapping

2024-04-16 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47879. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46091

[jira] [Updated] (SPARK-47880) Oracle: Document Mapping Spark SQL Data Types to Oracle

2024-04-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47880: --- Labels: pull-request-available (was: ) > Oracle: Document Mapping Spark SQL Data Types to

[jira] [Created] (SPARK-47881) Not working HDFS path for hive.metastore.jars.path

2024-04-16 Thread jungho.choi (Jira)
jungho.choi created SPARK-47881: --- Summary: Not working HDFS path for hive.metastore.jars.path Key: SPARK-47881 URL: https://issues.apache.org/jira/browse/SPARK-47881 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47881) Not working HDFS path for hive.metastore.jars.path

2024-04-16 Thread jungho.choi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jungho.choi updated SPARK-47881: Description: I trying to use Hive Metastore version 3.1.3 with Spark version 3.4.2, but

[jira] [Created] (SPARK-47880) Oracle: Document Mapping Spark SQL Data Types to Oracle

2024-04-16 Thread Kent Yao (Jira)
Kent Yao created SPARK-47880: Summary: Oracle: Document Mapping Spark SQL Data Types to Oracle Key: SPARK-47880 URL: https://issues.apache.org/jira/browse/SPARK-47880 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47879) Oracle: Use VARCHAR2 instead of VARCHAR for VarcharType mapping

2024-04-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47879: --- Labels: pull-request-available (was: ) > Oracle: Use VARCHAR2 instead of VARCHAR for

[jira] [Created] (SPARK-47879) Oracle: Use VARCHAR2 instead of VARCHAR for VarcharType mapping

2024-04-16 Thread Kent Yao (Jira)
Kent Yao created SPARK-47879: Summary: Oracle: Use VARCHAR2 instead of VARCHAR for VarcharType mapping Key: SPARK-47879 URL: https://issues.apache.org/jira/browse/SPARK-47879 Project: Spark

[jira] [Commented] (SPARK-47172) Upgrade Transport block cipher mode to GCM

2024-04-16 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837927#comment-17837927 ] Mridul Muralidharan commented on SPARK-47172: - Given we have addressed SPARK-47318, and with

[jira] [Resolved] (SPARK-47876) Improve docstring of mapInArrow

2024-04-16 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-47876. -- Resolution: Done Resolved by https://github.com/apache/spark/pull/46088 > Improve docstring

[jira] [Resolved] (SPARK-46375) Add documentation for Python data source API

2024-04-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46375. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46089

[jira] [Assigned] (SPARK-46375) Add documentation for Python data source API

2024-04-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46375: Assignee: Allison Wang > Add documentation for Python data source API >

[jira] [Updated] (SPARK-47763) Reeanble Protobuf function doctests

2024-04-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47763: --- Labels: pull-request-available (was: ) > Reeanble Protobuf function doctests >

[jira] [Resolved] (SPARK-47877) Speed up test_parity_listener

2024-04-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47877. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46072

[jira] [Resolved] (SPARK-47760) Reeanble Avro function doctests

2024-04-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47760. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46055

[jira] [Resolved] (SPARK-47875) Remove `spark.deploy.recoverySerializer`

2024-04-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47875. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46087

[jira] [Resolved] (SPARK-47763) Reeanble Protobuf function doctests

2024-04-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47763. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46055

[jira] [Resolved] (SPARK-47868) Recursion Limit Error in SparkSession and SparkConnectPlanner

2024-04-16 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-47868. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46075

[jira] [Updated] (SPARK-46375) Add documentation for Python data source API

2024-04-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46375: --- Labels: pull-request-available (was: ) > Add documentation for Python data source API >

[jira] [Updated] (SPARK-47877) Speed up test_parity_listener

2024-04-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47877: --- Labels: pull-request-available (was: ) > Speed up test_parity_listener >

[jira] [Created] (SPARK-47877) Speed up test_parity_listener

2024-04-16 Thread Wei Liu (Jira)
Wei Liu created SPARK-47877: --- Summary: Speed up test_parity_listener Key: SPARK-47877 URL: https://issues.apache.org/jira/browse/SPARK-47877 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-47876) Improve docstring of mapInArrow

2024-04-16 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-47876: Summary: Improve docstring of mapInArrow Key: SPARK-47876 URL: https://issues.apache.org/jira/browse/SPARK-47876 Project: Spark Issue Type: Documentation

[jira] [Created] (SPARK-47875) Remove `spark.deploy.recoverySerializer`

2024-04-16 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47875: - Summary: Remove `spark.deploy.recoverySerializer` Key: SPARK-47875 URL: https://issues.apache.org/jira/browse/SPARK-47875 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-47590) Hive-thriftserver: Migrate logWarn with variables to structured logging framework

2024-04-16 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47590. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45923

[jira] [Updated] (SPARK-47588) Hive module: Migrate logInfo with variables to structured logging framework

2024-04-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47588: --- Labels: pull-request-available (was: ) > Hive module: Migrate logInfo with variables to

[jira] [Assigned] (SPARK-47594) Connector module: Migrate logInfo with variables to structured logging framework

2024-04-16 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-47594: -- Assignee: BingKun Pan > Connector module: Migrate logInfo with variables to

[jira] [Resolved] (SPARK-47594) Connector module: Migrate logInfo with variables to structured logging framework

2024-04-16 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47594. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46022

[jira] [Created] (SPARK-47874) Multiple bugs with map operations in combination with collations

2024-04-16 Thread Nikola Mandic (Jira)
Nikola Mandic created SPARK-47874: - Summary: Multiple bugs with map operations in combination with collations Key: SPARK-47874 URL: https://issues.apache.org/jira/browse/SPARK-47874 Project: Spark

[jira] [Resolved] (SPARK-47871) Oracle: Map TimestampType to TIMESTAMP WITH LOCAL TIME ZONE

2024-04-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47871. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46080

[jira] [Assigned] (SPARK-47871) Oracle: Map TimestampType to TIMESTAMP WITH LOCAL TIME ZONE

2024-04-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47871: - Assignee: Kent Yao > Oracle: Map TimestampType to TIMESTAMP WITH LOCAL TIME ZONE >

[jira] [Assigned] (SPARK-47417) Ascii, Chr, Base64, UnBase64, Decode, StringDecode, Encode, ToBinary, FormatNumber, Sentences (all collations)

2024-04-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47417: --- Assignee: Nikola Mandic > Ascii, Chr, Base64, UnBase64, Decode, StringDecode, Encode,

[jira] [Updated] (SPARK-47745) Add License to Spark Operator

2024-04-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47745: -- Affects Version/s: kubernetes-operator-0.1.0 (was: 4.0.0) > Add

[jira] [Resolved] (SPARK-47417) Ascii, Chr, Base64, UnBase64, Decode, StringDecode, Encode, ToBinary, FormatNumber, Sentences (all collations)

2024-04-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47417. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45933

[jira] [Updated] (SPARK-47745) Add License to Spark Operator

2024-04-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47745: -- Fix Version/s: kubernetes-operator-0.1.0 (was: 4.0.0) > Add License to

[jira] [Resolved] (SPARK-47745) Add License to Spark Operator

2024-04-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47745. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 3

[jira] [Assigned] (SPARK-47745) Add License to Spark Operator

2024-04-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47745: - Assignee: Zhou JIANG > Add License to Spark Operator > - >

[jira] [Updated] (SPARK-33822) TPCDS Q5 fails if spark.sql.adaptive.enabled=true

2024-04-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-33822: --- Labels: pull-request-available (was: ) > TPCDS Q5 fails if spark.sql.adaptive.enabled=true

[jira] [Resolved] (SPARK-47356) Add support for ConcatWs & Elt (all collations)

2024-04-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47356. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46061

[jira] [Assigned] (SPARK-47356) Add support for ConcatWs & Elt (all collations)

2024-04-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47356: --- Assignee: Mihailo Milosevic > Add support for ConcatWs & Elt (all collations) >

[jira] [Updated] (SPARK-47873) Write collated strings to hive as regular strings

2024-04-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47873: --- Labels: pull-request-available (was: ) > Write collated strings to hive as regular strings

[jira] [Created] (SPARK-47873) Write collated strings to hive as regular strings

2024-04-16 Thread Stefan Kandic (Jira)
Stefan Kandic created SPARK-47873: - Summary: Write collated strings to hive as regular strings Key: SPARK-47873 URL: https://issues.apache.org/jira/browse/SPARK-47873 Project: Spark Issue

[jira] [Updated] (SPARK-47418) Optimize string predicate expressions for UTF8_BINARY_LCASE collation

2024-04-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47418: --- Labels: pull-request-available (was: ) > Optimize string predicate expressions for

[jira] [Updated] (SPARK-47353) TBD

2024-04-16 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47353: - Summary: TBD (was: regexp_count & regexp_substr (binary & lowercase collation only)) > TBD >

[jira] [Closed] (SPARK-47872) Add the option to initially hide a CustomMetric from the Spark UI

2024-04-16 Thread Robert Dillitz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Dillitz closed SPARK-47872. -- > Add the option to initially hide a CustomMetric from the Spark UI >

[jira] [Resolved] (SPARK-47872) Add the option to initially hide a CustomMetric from the Spark UI

2024-04-16 Thread Robert Dillitz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Dillitz resolved SPARK-47872. Resolution: Works for Me > Add the option to initially hide a CustomMetric from the Spark

[jira] [Commented] (SPARK-46841) Language support for collations

2024-04-16 Thread Nikola Mandic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837668#comment-17837668 ] Nikola Mandic commented on SPARK-46841: --- Working on it. > Language support for collations >

[jira] [Created] (SPARK-47872) Add the option to initially hide a CustomMetric from the Spark UI

2024-04-16 Thread Robert Dillitz (Jira)
Robert Dillitz created SPARK-47872: -- Summary: Add the option to initially hide a CustomMetric from the Spark UI Key: SPARK-47872 URL: https://issues.apache.org/jira/browse/SPARK-47872 Project: Spark

[jira] [Resolved] (SPARK-47739) Avro does not register custom logical types on spark startup

2024-04-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47739. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45895

[jira] [Resolved] (SPARK-46574) Upgrade maven plugin to latest version

2024-04-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46574. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46043

[jira] [Updated] (SPARK-47871) Oracle: Map TimestampType to TIMESTAMP WITH LOCAL TIME ZONE

2024-04-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47871: --- Labels: pull-request-available (was: ) > Oracle: Map TimestampType to TIMESTAMP WITH LOCAL

[jira] [Commented] (SPARK-45859) Make UDF objects in ml.functions lazy

2024-04-16 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837644#comment-17837644 ] Kent Yao commented on SPARK-45859: -- I removed 3.0 and 3.1 from *Affects Version/s:* here because I

[jira] [Updated] (SPARK-45859) Make UDF objects in ml.functions lazy

2024-04-16 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-45859: - Affects Version/s: (was: 3.0) (was: 3.1) > Make UDF objects in

[jira] [Updated] (SPARK-47556) [K8] Spark App ID collision resulting in deleting wrong resources

2024-04-16 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47556: - Affects Version/s: 3.1.0 (was: 3.1) > [K8] Spark App ID collision resulting

[jira] [Commented] (SPARK-5159) Thrift server does not respect hive.server2.enable.doAs=true

2024-04-16 Thread Goutam Ghosh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837634#comment-17837634 ] Goutam Ghosh commented on SPARK-5159: - can the patch by [~angerszhuuu] be verified ? > Thrift

[jira] [Created] (SPARK-47871) Oracle: Map TimestampType to TIMESTAMP WITH LOCAL TIME ZONE

2024-04-16 Thread Kent Yao (Jira)
Kent Yao created SPARK-47871: Summary: Oracle: Map TimestampType to TIMESTAMP WITH LOCAL TIME ZONE Key: SPARK-47871 URL: https://issues.apache.org/jira/browse/SPARK-47871 Project: Spark Issue

[jira] (SPARK-47353) regexp_count & regexp_substr (binary & lowercase collation only)

2024-04-16 Thread Milan Dankovic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47353 ] Milan Dankovic deleted comment on SPARK-47353: was (Author: JIRAUSER304529): I am working on this > regexp_count & regexp_substr (binary & lowercase collation only) >

[jira] [Assigned] (SPARK-47476) StringReplace (all collations)

2024-04-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47476: -- Assignee: (was: Apache Spark) > StringReplace (all collations) >

[jira] [Assigned] (SPARK-47476) StringReplace (all collations)

2024-04-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47476: -- Assignee: Apache Spark > StringReplace (all collations) >

[jira] [Assigned] (SPARK-47858) Refactoring the structure for DataFrame error context

2024-04-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47858: -- Assignee: (was: Apache Spark) > Refactoring the structure for DataFrame error

[jira] [Assigned] (SPARK-47858) Refactoring the structure for DataFrame error context

2024-04-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47858: -- Assignee: Apache Spark > Refactoring the structure for DataFrame error context >

[jira] [Assigned] (SPARK-47741) Handle stack overflow when parsing query

2024-04-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47741: -- Assignee: (was: Apache Spark) > Handle stack overflow when parsing query >

[jira] [Assigned] (SPARK-47741) Handle stack overflow when parsing query

2024-04-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47741: -- Assignee: Apache Spark > Handle stack overflow when parsing query >

[jira] [Assigned] (SPARK-47411) StringInstr, FindInSet (all collations)

2024-04-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47411: -- Assignee: Apache Spark > StringInstr, FindInSet (all collations) >

[jira] [Assigned] (SPARK-47411) StringInstr, FindInSet (all collations)

2024-04-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47411: -- Assignee: (was: Apache Spark) > StringInstr, FindInSet (all collations) >

[jira] [Updated] (SPARK-47596) Streaming: Migrate logWarn with variables to structured logging framework

2024-04-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47596: --- Labels: pull-request-available (was: ) > Streaming: Migrate logWarn with variables to

[jira] [Updated] (SPARK-47869) Upgrade built in hive to Hive-4.0

2024-04-16 Thread Simhadri Govindappa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simhadri Govindappa updated SPARK-47869: Description: Hive 4.0 has been released. It brings in a lot of new features, bug

[jira] [Created] (SPARK-47869) Upgrade built in hive to Hive-4.0

2024-04-16 Thread Simhadri Govindappa (Jira)
Simhadri Govindappa created SPARK-47869: --- Summary: Upgrade built in hive to Hive-4.0 Key: SPARK-47869 URL: https://issues.apache.org/jira/browse/SPARK-47869 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47414) Regexp expressions (binary & lowercase collation only)

2024-04-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47414: --- Labels: pull-request-available (was: ) > Regexp expressions (binary & lowercase collation

[jira] [Updated] (SPARK-47416) Add benchmark for stringpredicate expressions

2024-04-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47416: --- Labels: pull-request-available (was: ) > Add benchmark for stringpredicate expressions >

[jira] [Updated] (SPARK-47416) Add benchmark for stringpredicate expressions

2024-04-16 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47416: - Summary: Add benchmark for stringpredicate expressions (was: TBD) > Add benchmark for

[jira] [Updated] (SPARK-45387) Optimize hive patition filter when the comparision dataType not match

2024-04-16 Thread TianyiMa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TianyiMa updated SPARK-45387: - Affects Version/s: 3.5.1 > Optimize hive patition filter when the comparision dataType not match >

[jira] [Updated] (SPARK-45387) Optimize hive patition filter when the comparision dataType not match

2024-04-16 Thread TianyiMa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TianyiMa updated SPARK-45387: - Affects Version/s: 3.5.0 > Optimize hive patition filter when the comparision dataType not match >

[jira] [Updated] (SPARK-47355) TBD

2024-04-16 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47355: - Summary: TBD (was: regexp_replace & regexp_instr (binary & lowercase collation only)) > TBD >

[jira] [Updated] (SPARK-47354) TBD

2024-04-16 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47354: - Summary: TBD (was: regexp_extract & regexp_extract_all (binary & lowercase collation only)) >

[jira] [Updated] (SPARK-47868) Recursion Limit Error in SparkSession and SparkConnectPlanner

2024-04-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47868: --- Labels: pull-request-available (was: ) > Recursion Limit Error in SparkSession and

[jira] [Updated] (SPARK-47351) TBD

2024-04-16 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47351: - Summary: TBD (was: ilike & rlike (binary & lowercase collation only)) > TBD > --- > >

[jira] [Updated] (SPARK-47414) Regexp expressions (binary & lowercase collation only)

2024-04-16 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47414: - Summary: Regexp expressions (binary & lowercase collation only) (was: Regexp expressions) >

[jira] [Updated] (SPARK-47350) TBD

2024-04-16 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47350: - Summary: TBD (was: like (binary & lowercase collation only)) > TBD > --- > >

[jira] [Updated] (SPARK-47414) Regexp expressions

2024-04-16 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47414: - Summary: Regexp expressions (was: TBD) > Regexp expressions > -- > >

[jira] [Assigned] (SPARK-47818) Introduce plan cache in SparkConnectPlanner to improve performance of Analyze requests

2024-04-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47818: Assignee: Xi Lyu > Introduce plan cache in SparkConnectPlanner to improve performance of

[jira] [Resolved] (SPARK-47818) Introduce plan cache in SparkConnectPlanner to improve performance of Analyze requests

2024-04-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47818. -- Resolution: Fixed Issue resolved by pull request 46012

[jira] [Created] (SPARK-47868) Recursion Limit Error in SparkSession and SparkConnectPlanner

2024-04-16 Thread Tom van Bussel (Jira)
Tom van Bussel created SPARK-47868: -- Summary: Recursion Limit Error in SparkSession and SparkConnectPlanner Key: SPARK-47868 URL: https://issues.apache.org/jira/browse/SPARK-47868 Project: Spark

[jira] [Updated] (SPARK-45387) Optimize hive patition filter when the comparision dataType not match

2024-04-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45387: --- Labels: pull-request-available (was: ) > Optimize hive patition filter when the

[jira] [Updated] (SPARK-45387) Optimize hive patition filter when the comparision dataType not match

2024-04-16 Thread TianyiMa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TianyiMa updated SPARK-45387: - Summary: Optimize hive patition filter when the comparision dataType not match (was: Partition key

[jira] [Updated] (SPARK-45387) Partition key filter cannot be pushed down when using cast

2024-04-16 Thread TianyiMa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TianyiMa updated SPARK-45387: - Description: Suppose we have a partitioned table `table_pt` with partition colum `dt` which is

[jira] [Updated] (SPARK-47352) Fix Upper, Lower, InitCap collation awareness

2024-04-16 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47352: - Summary: Fix Upper, Lower, InitCap collation awareness (was: TBD) > Fix Upper, Lower, InitCap