[jira] [Assigned] (SPARK-49682) Upgrade joda-time to 2.13.0

[ https://issues.apache.org/jira/browse/SPARK-49682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49682: - Assignee: BingKun Pan > Upgrade joda-time to 2.13.0 > --- > >

[jira] [Resolved] (SPARK-49682) Upgrade joda-time to 2.13.0

[ https://issues.apache.org/jira/browse/SPARK-49682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49682. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48130 [https://

[jira] [Updated] (SPARK-49682) Upgrade joda-time to 2.13.0

[ https://issues.apache.org/jira/browse/SPARK-49682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49682: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade joda-time to 2.

[jira] [Updated] (SPARK-49692) Refine the string representation of literal date and timestamp

[ https://issues.apache.org/jira/browse/SPARK-49692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49692: --- Labels: pull-request-available (was: ) > Refine the string representation of literal date a

[jira] [Created] (SPARK-49693) Refine the string representation of timedelta

Ruifeng Zheng created SPARK-49693: - Summary: Refine the string representation of timedelta Key: SPARK-49693 URL: https://issues.apache.org/jira/browse/SPARK-49693 Project: Spark Issue Type: I

[jira] [Created] (SPARK-49692) Refine the string representation of literal date and timestamp

Ruifeng Zheng created SPARK-49692: - Summary: Refine the string representation of literal date and timestamp Key: SPARK-49692 URL: https://issues.apache.org/jira/browse/SPARK-49692 Project: Spark

[jira] [Resolved] (SPARK-49249) Implement new Connect APIs in SQL Core

[ https://issues.apache.org/jira/browse/SPARK-49249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-49249. --- Resolution: Fixed Issue resolved by pull request 47815 [https://github.com/apache/sp

[jira] [Resolved] (SPARK-49320) Add tag-related APs to Spark Core

[ https://issues.apache.org/jira/browse/SPARK-49320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-49320. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47815 [

[jira] [Resolved] (SPARK-49424) Consolidate Encoders in sql/api

[ https://issues.apache.org/jira/browse/SPARK-49424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-49424. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48021 [

[jira] [Updated] (SPARK-49691) Function `substring` should accept column names

[ https://issues.apache.org/jira/browse/SPARK-49691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49691: --- Labels: pull-request-available (was: ) > Function `substring` should accept column names >

[jira] [Created] (SPARK-49691) Function `substring` should accept column names

Ruifeng Zheng created SPARK-49691: - Summary: Function `substring` should accept column names Key: SPARK-49691 URL: https://issues.apache.org/jira/browse/SPARK-49691 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-49495) Document and Feature Preview on master branch via Live GitHub Pages Updates

[ https://issues.apache.org/jira/browse/SPARK-49495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-49495. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47968 [https://github.com

[jira] [Assigned] (SPARK-49495) Document and Feature Preview on master branch via Live GitHub Pages Updates

[ https://issues.apache.org/jira/browse/SPARK-49495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-49495: Assignee: Kent Yao > Document and Feature Preview on master branch via Live GitHub Pages Updates

[jira] [Updated] (SPARK-49690) UDT type is not expanded into its StructType in the schema definition

[ https://issues.apache.org/jira/browse/SPARK-49690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-49690: - Description: A UDT type field does not show up as constituent struct type in the schema. Instead it shows up as

[jira] [Updated] (SPARK-49690) UDT type is not expanded into its StructType in the schema definition

[ https://issues.apache.org/jira/browse/SPARK-49690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-49690: - Description: A UDT type field does not show up as constituent struct type in the schema. Instead it shows up as

[jira] [Created] (SPARK-49690) UDT type is not expanded into its StructType in the schema definition

Asif created SPARK-49690: Summary: UDT type is not expanded into its StructType in the schema definition Key: SPARK-49690 URL: https://issues.apache.org/jira/browse/SPARK-49690 Project: Spark Issue

[jira] [Resolved] (SPARK-49640) Apply Reservoir sampling in `SampledPlotBase`

[ https://issues.apache.org/jira/browse/SPARK-49640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-49640. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48105 [https://

[jira] [Commented] (SPARK-49617) Stop ignoring auth errors when ignoreCorruptFiles=1 in FileScanRDD

[ https://issues.apache.org/jira/browse/SPARK-49617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882529#comment-17882529 ] Xiao Li commented on SPARK-49617: - [~yhosny]  when did we introduce this behavior change

[jira] [Resolved] (SPARK-49413) Create shared RuntimeConf interface

[ https://issues.apache.org/jira/browse/SPARK-49413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-49413. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47980 [

[jira] [Updated] (SPARK-49689) EventTimeWatermark to support TimestampNTZType

[ https://issues.apache.org/jira/browse/SPARK-49689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] harikishore updated SPARK-49689: Description: Spark added TimestampNTZType support since 3.4.0. [https://spark.apache.org/docs/3.4

[jira] [Updated] (SPARK-49689) EventTimeWatermark to support TimestampNTZType

[ https://issues.apache.org/jira/browse/SPARK-49689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] harikishore updated SPARK-49689: Description: Spark added TimestampNTZType support since 3.4.0. [https://spark.apache.org/docs/3.4

[jira] [Commented] (SPARK-49689) EventTimeWatermark to support TimestampNTZType

[ https://issues.apache.org/jira/browse/SPARK-49689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882508#comment-17882508 ] Chirag Shah commented on SPARK-49689: - [~ggregory] ,[~ggregory] , [~ggregory1]  > E

[jira] (SPARK-49689) EventTimeWatermark to support TimestampNTZType

[ https://issues.apache.org/jira/browse/SPARK-49689 ] Chirag Shah deleted comment on SPARK-49689: - was (Author: JIRAUSER306906): [~ggregory] ,[~ggregory] , [~ggregory1]  > EventTimeWatermark to support TimestampNTZType > ---

[jira] [Updated] (SPARK-49689) EventTimeWatermark to support TimestampNTZType

[ https://issues.apache.org/jira/browse/SPARK-49689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] harikishore updated SPARK-49689: Description: Spark added TimestampNTZType support since 3.4.0. [https://spark.apache.org/docs/3.4

[jira] [Created] (SPARK-49689) EventTimeWatermark to support TimestampNTZType

harikishore created SPARK-49689: --- Summary: EventTimeWatermark to support TimestampNTZType Key: SPARK-49689 URL: https://issues.apache.org/jira/browse/SPARK-49689 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-49687) Delay sorting in validateAndMaybeEvolveStateSchema

[ https://issues.apache.org/jira/browse/SPARK-49687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49687. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48116 [https://

[jira] [Assigned] (SPARK-49687) Delay sorting in validateAndMaybeEvolveStateSchema

[ https://issues.apache.org/jira/browse/SPARK-49687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49687: - Assignee: Zhihong Yu > Delay sorting in validateAndMaybeEvolveStateSchema > ---

[jira] [Updated] (SPARK-49688) Data race between SparkListener and SparkConnectServiceSuite over ExecuteHolder

[ https://issues.apache.org/jira/browse/SPARK-49688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Changgyoo Park updated SPARK-49688: --- Issue Type: Bug (was: Improvement) > Data race between SparkListener and SparkConnectServic

[jira] [Created] (SPARK-49688) Data race between SparkListener and SparkConnectServiceSuite over ExecuteHolder

Changgyoo Park created SPARK-49688: -- Summary: Data race between SparkListener and SparkConnectServiceSuite over ExecuteHolder Key: SPARK-49688 URL: https://issues.apache.org/jira/browse/SPARK-49688 P

[jira] [Updated] (SPARK-49687) Delay sorting in validateAndMaybeEvolveStateSchema

[ https://issues.apache.org/jira/browse/SPARK-49687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhihong Yu updated SPARK-49687: --- Summary: Delay sorting in validateAndMaybeEvolveStateSchema (was: Avoid sorting in validateAndMaybe

[jira] [Updated] (SPARK-49687) Delay sorting in validateAndMaybeEvolveStateSchema

[ https://issues.apache.org/jira/browse/SPARK-49687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhihong Yu updated SPARK-49687: --- Description: In `{{{}validateAndMaybeEvolveStateSchema`{}}}, existing schema and new schema are sor

[jira] [Updated] (SPARK-49687) Avoid sorting in validateAndMaybeEvolveStateSchema

[ https://issues.apache.org/jira/browse/SPARK-49687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49687: --- Labels: pull-request-available (was: ) > Avoid sorting in validateAndMaybeEvolveStateSchema

[jira] [Created] (SPARK-49687) Avoid sorting in validateAndMaybeEvolveStateSchema

Zhihong Yu created SPARK-49687: -- Summary: Avoid sorting in validateAndMaybeEvolveStateSchema Key: SPARK-49687 URL: https://issues.apache.org/jira/browse/SPARK-49687 Project: Spark Issue Type: Im

[jira] [Updated] (SPARK-49686) Spark get stuck while evaluating sorted wrong dataframe rdd

[ https://issues.apache.org/jira/browse/SPARK-49686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alvaro Berdonces updated SPARK-49686: - Description: Under the below scenario `sorted.rdd` takes for ever instead of throwing th

[jira] [Updated] (SPARK-49686) Spark get stuck while evaluating sorted wrong dataframe rdd

[ https://issues.apache.org/jira/browse/SPARK-49686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alvaro Berdonces updated SPARK-49686: - Description: Under the below scenario `sorted.rdd` takes for ever instead of throwing th

[jira] [Updated] (SPARK-49686) Spark get stuck while evaluating sorted wrong dataframe rdd

[ https://issues.apache.org/jira/browse/SPARK-49686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alvaro Berdonces updated SPARK-49686: - Description: Under the below scenario `sorted.rdd` takes for ever instead of throwing th

[jira] [Created] (SPARK-49686) Spark get stuck while evaluating sorted wrong dataframe rdd

Alvaro Berdonces created SPARK-49686: Summary: Spark get stuck while evaluating sorted wrong dataframe rdd Key: SPARK-49686 URL: https://issues.apache.org/jira/browse/SPARK-49686 Project: Spark

[jira] [Created] (SPARK-49685) Increase CONNECT_GRPC_MARSHALLER_RECURSION_LIMIT from 1024 to 4096

Thang Long Vu created SPARK-49685: - Summary: Increase CONNECT_GRPC_MARSHALLER_RECURSION_LIMIT from 1024 to 4096 Key: SPARK-49685 URL: https://issues.apache.org/jira/browse/SPARK-49685 Project: Spark

[jira] [Resolved] (SPARK-49505) Create SQL functions to generate random strings or numbers within ranges

[ https://issues.apache.org/jira/browse/SPARK-49505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-49505. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48004 [https://github.com

[jira] [Assigned] (SPARK-49505) Create SQL functions to generate random strings or numbers within ranges

[ https://issues.apache.org/jira/browse/SPARK-49505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-49505: Assignee: Daniel > Create SQL functions to generate random strings or numbers within ranges > ---

[jira] [Assigned] (SPARK-49644) Support drop multi-level partition V2 table with partial partition spec

[ https://issues.apache.org/jira/browse/SPARK-49644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-49644: -- Assignee: (was: Apache Spark) > Support drop multi-level partition V2 table with

[jira] [Assigned] (SPARK-49644) Support drop multi-level partition V2 table with partial partition spec

[ https://issues.apache.org/jira/browse/SPARK-49644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-49644: -- Assignee: Apache Spark > Support drop multi-level partition V2 table with partial par

[jira] [Resolved] (SPARK-49498) Added test to check difference between SR_AI and SR_Latn_AI collations

[ https://issues.apache.org/jira/browse/SPARK-49498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-49498. -- Resolution: Fixed Issue resolved by pull request 47958 [https://github.com/apache/spark/pull/47958] >

[jira] [Assigned] (SPARK-49498) Added test to check difference between SR_AI and SR_Latn_AI collations

[ https://issues.apache.org/jira/browse/SPARK-49498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-49498: Assignee: Marko Ilic > Added test to check difference between SR_AI and SR_Latn_AI collations > -

[jira] [Resolved] (SPARK-49650) Don't use deprecated Hive JDBC client parameters in docs / tests

[ https://issues.apache.org/jira/browse/SPARK-49650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-49650. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48114 [https://github.com