[jira] [Updated] (SPARK-47828) DataFrameWriterV2.overwrite fails with invalid plan

2024-04-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47828: --- Labels: pull-request-available (was: ) > DataFrameWriterV2.overwrite fails with invalid

[jira] [Updated] (SPARK-47828) DataFrameWriterV2.overwrite fails with invalid plan

2024-04-11 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-47828: -- Affects Version/s: 3.4.2 > DataFrameWriterV2.overwrite fails with invalid plan >

[jira] [Resolved] (SPARK-47792) Make the value of MDC can support `null`

2024-04-11 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47792. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45975

[jira] [Resolved] (SPARK-47784) [State API v2] Merge TimeoutMode and TTLMode into TimeMode

2024-04-11 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-47784. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45960

[jira] [Updated] (SPARK-47828) DataFrameWriterV2.overwrite fails with invalid plan

2024-04-11 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-47828: -- Issue Type: Bug (was: Improvement) > DataFrameWriterV2.overwrite fails with invalid plan >

[jira] [Created] (SPARK-47828) DataFrameWriterV2.overwrite fails with invalid plan

2024-04-11 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-47828: - Summary: DataFrameWriterV2.overwrite fails with invalid plan Key: SPARK-47828 URL: https://issues.apache.org/jira/browse/SPARK-47828 Project: Spark Issue

[jira] [Updated] (SPARK-47594) Connector module: Migrate logInfo with variables to structured logging framework

2024-04-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47594: --- Labels: pull-request-available (was: ) > Connector module: Migrate logInfo with variables

[jira] [Commented] (SPARK-44444) Enabled ANSI mode by default

2024-04-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836397#comment-17836397 ] Dongjoon Hyun commented on SPARK-4: --- Hi, All. Here is the discussion thread I sent a few

[jira] [Commented] (SPARK-44444) Enabled ANSI mode by default

2024-04-11 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836398#comment-17836398 ] L. C. Hsieh commented on SPARK-4: - Thank you [~dongjoon] > Enabled ANSI mode by default >

[jira] [Commented] (SPARK-44444) Enabled ANSI mode by default

2024-04-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836389#comment-17836389 ] Dongjoon Hyun commented on SPARK-4: --- I made a draft PR and will initiate the discussion thread

[jira] [Resolved] (SPARK-47795) Supplement the doc of job schedule for K8S

2024-04-11 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47795. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45982

[jira] [Resolved] (SPARK-47813) Replace getArrayDimension with updateExtraColumnMeta

2024-04-11 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47813. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46006

[jira] [Updated] (SPARK-47827) Missing warnings for deprecated features

2024-04-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47827: --- Labels: pull-request-available (was: ) > Missing warnings for deprecated features >

[jira] [Created] (SPARK-47827) Missing warnings for deprecated features

2024-04-11 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-47827: --- Summary: Missing warnings for deprecated features Key: SPARK-47827 URL: https://issues.apache.org/jira/browse/SPARK-47827 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-47174) Client Side Listener - Server side implementation

2024-04-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47174. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45988

[jira] [Assigned] (SPARK-47174) Client Side Listener - Server side implementation

2024-04-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47174: Assignee: Wei Liu > Client Side Listener - Server side implementation >

[jira] [Resolved] (SPARK-47824) Nondeterminism in pyspark.pandas.series.asof

2024-04-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47824. -- Fix Version/s: 3.4.3 3.5.2 4.0.0 Resolution:

[jira] [Assigned] (SPARK-47824) Nondeterminism in pyspark.pandas.series.asof

2024-04-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47824: Assignee: Mark Jarvin > Nondeterminism in pyspark.pandas.series.asof >

[jira] [Assigned] (SPARK-47826) Add VariantVal for PySpark

2024-04-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47826: Assignee: Gene Pang > Add VariantVal for PySpark > -- > >

[jira] [Resolved] (SPARK-47826) Add VariantVal for PySpark

2024-04-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47826. -- Resolution: Fixed Fixed in https://github.com/apache/spark/pull/45826 > Add VariantVal for

[jira] [Created] (SPARK-47826) Add VariantVal for PySpark

2024-04-11 Thread Gene Pang (Jira)
Gene Pang created SPARK-47826: - Summary: Add VariantVal for PySpark Key: SPARK-47826 URL: https://issues.apache.org/jira/browse/SPARK-47826 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-47811) Run ML tests for pyspark-connect package

2024-04-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47811. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45941

[jira] [Assigned] (SPARK-47811) Run ML tests for pyspark-connect package

2024-04-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47811: Assignee: Hyukjin Kwon > Run ML tests for pyspark-connect package >

[jira] [Updated] (SPARK-47825) Make `KinesisTestUtils` & `WriteInputFormatTestDataGenerator` deprecated

2024-04-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47825: --- Labels: pull-request-available (was: ) > Make `KinesisTestUtils` &

[jira] [Created] (SPARK-47825) Make `KinesisTestUtils` & `WriteInputFormatTestDataGenerator` deprecated

2024-04-11 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47825: --- Summary: Make `KinesisTestUtils` & `WriteInputFormatTestDataGenerator` deprecated Key: SPARK-47825 URL: https://issues.apache.org/jira/browse/SPARK-47825 Project:

[jira] [Updated] (SPARK-47824) Nondeterminism in pyspark.pandas.series.asof

2024-04-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47824: --- Labels: pull-request-available (was: ) > Nondeterminism in pyspark.pandas.series.asof >

[jira] [Created] (SPARK-47824) Nondeterminism in pyspark.pandas.series.asof

2024-04-11 Thread Mark Jarvin (Jira)
Mark Jarvin created SPARK-47824: --- Summary: Nondeterminism in pyspark.pandas.series.asof Key: SPARK-47824 URL: https://issues.apache.org/jira/browse/SPARK-47824 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-47814) Remove the `KinesisTestUtils` from `main` to `test`

2024-04-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47814: - Assignee: BingKun Pan > Remove the `KinesisTestUtils` from `main` to `test` >

[jira] [Resolved] (SPARK-47814) Remove the `KinesisTestUtils` from `main` to `test`

2024-04-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47814. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46000

[jira] [Updated] (SPARK-47823) Improve appName and getOrCreate usage for Spark Connect

2024-04-11 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-47823: - Description:   In Spark Connect {code:java} spark =

[jira] [Created] (SPARK-47823) Improve appName and getOrCreate usage for Spark Connect

2024-04-11 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-47823: Summary: Improve appName and getOrCreate usage for Spark Connect Key: SPARK-47823 URL: https://issues.apache.org/jira/browse/SPARK-47823 Project: Spark

[jira] [Updated] (SPARK-47822) Prohibit Hash expressions from hashing Variant type

2024-04-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47822: --- Labels: pull-request-available (was: ) > Prohibit Hash expressions from hashing Variant

[jira] [Created] (SPARK-47822) Prohibit Hash expressions from hashing Variant type

2024-04-11 Thread Harsh Motwani (Jira)
Harsh Motwani created SPARK-47822: - Summary: Prohibit Hash expressions from hashing Variant type Key: SPARK-47822 URL: https://issues.apache.org/jira/browse/SPARK-47822 Project: Spark Issue

[jira] [Updated] (SPARK-47318) AuthEngine key exchange needs additional KDF round

2024-04-11 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-47318: Affects Version/s: 3.5.0 3.4.0 > AuthEngine key exchange

[jira] [Resolved] (SPARK-47318) AuthEngine key exchange needs additional KDF round

2024-04-11 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-47318. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request

[jira] [Updated] (SPARK-47818) Introduce plan cache in SparkConnectPlanner to improve performance of Analyze requests

2024-04-11 Thread Xi Lyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xi Lyu updated SPARK-47818: --- Description: While building the DataFrame step by step, each time a new DataFrame is generated with an

[jira] [Updated] (SPARK-44444) Enabled ANSI mode by default

2024-04-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-4: --- Labels: pull-request-available (was: ) > Enabled ANSI mode by default >

[jira] [Updated] (SPARK-47818) Introduce plan cache in SparkConnectPlanner to improve performance of Analyze requests

2024-04-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47818: --- Labels: pull-request-available (was: ) > Introduce plan cache in SparkConnectPlanner to

[jira] [Updated] (SPARK-47818) Introduce plan cache in SparkConnectPlanner to improve performance of Analyze requests

2024-04-11 Thread Xi Lyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xi Lyu updated SPARK-47818: --- Description: While building the DataFrame step by step, each time a new DataFrame is generated with an

[jira] [Updated] (SPARK-47819) Use asynchronous callback for execution cleanup

2024-04-11 Thread Xi Lyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xi Lyu updated SPARK-47819: --- Description: Expired sessions are regularly checked and cleaned up by a maintenance thread. However,

[jira] [Updated] (SPARK-47777) Add spark connect test for python streaming data source

2024-04-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-4: -- Component/s: Tests > Add spark connect test for python streaming data source >

[jira] [Assigned] (SPARK-47777) Add spark connect test for python streaming data source

2024-04-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-4: - Assignee: Chaoqin Li > Add spark connect test for python streaming data source >

[jira] [Commented] (SPARK-44444) Enabled ANSI mode by default

2024-04-11 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836283#comment-17836283 ] L. C. Hsieh commented on SPARK-4: - What impact this change could bring to user applications?

[jira] [Resolved] (SPARK-47777) Add spark connect test for python streaming data source

2024-04-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-4. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45950

[jira] [Resolved] (SPARK-47820) Run `ANSI` SQL CI twice per day

2024-04-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47820. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46010

[jira] [Updated] (SPARK-47820) Run `ANSI` SQL CI twice per day

2024-04-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47820: --- Labels: pull-request-available (was: ) > Run `ANSI` SQL CI twice per day >

[jira] [Updated] (SPARK-47820) Run `ANSI` SQL CI twice per day

2024-04-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47820: -- Summary: Run `ANSI` SQL CI twice per day (was: Run `ANSI` SQL Daily CI twice) > Run `ANSI`

[jira] [Created] (SPARK-47820) Run `ANSI` SQL Daily CI twice

2024-04-11 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47820: - Summary: Run `ANSI` SQL Daily CI twice Key: SPARK-47820 URL: https://issues.apache.org/jira/browse/SPARK-47820 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-47820) Run `ANSI` SQL Daily CI twice

2024-04-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47820: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Test) > Run `ANSI` SQL Daily CI twice

[jira] [Updated] (SPARK-47799) Preserve parameter information when using SBT package jar

2024-04-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47799: -- Affects Version/s: 4.0.0 (was: 3.5.1) > Preserve parameter

[jira] [Resolved] (SPARK-47799) Preserve parameter information when using SBT package jar

2024-04-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47799. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45983

[jira] [Assigned] (SPARK-47799) Preserve parameter information when using SBT package jar

2024-04-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47799: - Assignee: dzcxzl > Preserve parameter information when using SBT package jar >

[jira] [Updated] (SPARK-47819) Use asynchronous callback for execution cleanup

2024-04-11 Thread Xi Lyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xi Lyu updated SPARK-47819: --- Description: Expired sessions are regularly checked and cleaned up by a maintenance thread. However,

[jira] [Updated] (SPARK-47818) Introduce plan cache in SparkConnectPlanner to improve performance of Analyze requests

2024-04-11 Thread Xi Lyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xi Lyu updated SPARK-47818: --- Description: While building the DataFrame step by step, each time a new DataFrame is generated with an

[jira] [Updated] (SPARK-47819) Use asynchronous callback for execution cleanup

2024-04-11 Thread Xi Lyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xi Lyu updated SPARK-47819: --- Description: Expired sessions are regularly checked and cleaned up by a maintenance thread. However,

[jira] [Updated] (SPARK-47819) Use asynchronous callback for execution cleanup

2024-04-11 Thread Xi Lyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xi Lyu updated SPARK-47819: --- Description: Expired sessions are regularly checked and cleaned up by a maintenance thread. However,

[jira] [Created] (SPARK-47819) Use asynchronous callback for execution cleanup

2024-04-11 Thread Xi Lyu (Jira)
Xi Lyu created SPARK-47819: -- Summary: Use asynchronous callback for execution cleanup Key: SPARK-47819 URL: https://issues.apache.org/jira/browse/SPARK-47819 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-47418) Optimize string predicate expressions for UTF8_BINARY_LCASE collation

2024-04-11 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47418: - Description: Implement {*}contains{*}, {*}startsWith{*}, and *endsWith* built-in string Spark

[jira] [Updated] (SPARK-47797) Skip deleting pod from k8s if the pod does not exists

2024-04-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47797: -- Affects Version/s: 4.0.0 (was: 3.5.1) > Skip deleting pod from k8s

[jira] [Resolved] (SPARK-47797) Skip deleting pod from k8s if the pod does not exists

2024-04-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47797. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45979

[jira] [Assigned] (SPARK-47797) Skip deleting pod from k8s if the pod does not exists

2024-04-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47797: - Assignee: leesf > Skip deleting pod from k8s if the pod does not exists >

[jira] [Updated] (SPARK-47818) Introduce plan cache in SparkConnectPlanner to improve performance of Analyze requests

2024-04-11 Thread Xi Lyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xi Lyu updated SPARK-47818: --- Description: While building the DataFrame step by step, each time a new DataFrame is generated with an

[jira] [Created] (SPARK-47818) Introduce plan cache in SparkConnectPlanner to improve performance of Analyze requests

2024-04-11 Thread Xi Lyu (Jira)
Xi Lyu created SPARK-47818: -- Summary: Introduce plan cache in SparkConnectPlanner to improve performance of Analyze requests Key: SPARK-47818 URL: https://issues.apache.org/jira/browse/SPARK-47818 Project:

[jira] [Updated] (SPARK-47418) Optimize string predicate expressions for UTF8_BINARY_LCASE collation

2024-04-11 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47418: - Summary: Optimize string predicate expressions for UTF8_BINARY_LCASE collation (was: TBD) >

[jira] [Assigned] (SPARK-47817) Update pandas to 2.2.2

2024-04-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47817: - Assignee: Bjørn Jørgensen > Update pandas to 2.2.2 > -- > >

[jira] [Updated] (SPARK-47817) Update pandas to 2.2.2

2024-04-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47817: --- Labels: pull-request-available (was: ) > Update pandas to 2.2.2 > -- >

[jira] [Resolved] (SPARK-47817) Update pandas to 2.2.2

2024-04-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47817. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46009

[jira] [Assigned] (SPARK-47410) refactor UTF8String and CollationFactory

2024-04-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47410: --- Assignee: Uroš Bojanić > refactor UTF8String and CollationFactory >

[jira] [Resolved] (SPARK-47410) refactor UTF8String and CollationFactory

2024-04-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47410. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45978

[jira] [Resolved] (SPARK-47617) Add TPC-DS testing infrastructure for collations

2024-04-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47617. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45739

[jira] [Assigned] (SPARK-47617) Add TPC-DS testing infrastructure for collations

2024-04-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47617: --- Assignee: Nikola Mandic > Add TPC-DS testing infrastructure for collations >

[jira] [Updated] (SPARK-47357) Add support for Upper, Lower, InitCap (all collations)

2024-04-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47357: --- Labels: pull-request-available (was: ) > Add support for Upper, Lower, InitCap (all

[jira] [Updated] (SPARK-47357) Add support for Upper, Lower, InitCap (all collations)

2024-04-11 Thread Mihailo Milosevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Milosevic updated SPARK-47357: -- Summary: Add support for Upper, Lower, InitCap (all collations) (was: Upper, Lower,

[jira] [Resolved] (SPARK-47815) Unify the user agent with json

2024-04-11 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-47815. --- Resolution: Not A Problem > Unify the user agent with json > --

[jira] [Updated] (SPARK-47816) Document the lazy evaluation of views in spark.{sql, table}

2024-04-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47816: --- Labels: pull-request-available (was: ) > Document the lazy evaluation of views in

[jira] [Created] (SPARK-47816) Document the lazy evaluation of views in spark.{sql, table}

2024-04-11 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-47816: - Summary: Document the lazy evaluation of views in spark.{sql, table} Key: SPARK-47816 URL: https://issues.apache.org/jira/browse/SPARK-47816 Project: Spark

[jira] [Resolved] (SPARK-47809) checkExceptionInExpression should check error for each codegen mode

2024-04-11 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47809. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45997

[jira] [Assigned] (SPARK-47809) checkExceptionInExpression should check error for each codegen mode

2024-04-11 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47809: Assignee: Wenchen Fan > checkExceptionInExpression should check error for each codegen mode >

[jira] [Updated] (SPARK-47813) Replace getArrayDimension with updateExtraColumnMeta

2024-04-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47813: --- Labels: pull-request-available (was: ) > Replace getArrayDimension with

[jira] [Updated] (SPARK-47357) Upper, Lower, InitCap (all collations)

2024-04-11 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47357: - Summary: Upper, Lower, InitCap (all collations) (was: Upper, Lower, InitCap (binary &

[jira] [Updated] (SPARK-47356) ConcatWs & Elt (all collations)

2024-04-11 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47356: - Summary: ConcatWs & Elt (all collations) (was: ConcatWs & Elt (binary & lowercase collation

[jira] [Updated] (SPARK-47814) Remove the `KinesisTestUtils` from `main` to `test`

2024-04-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47814: --- Labels: pull-request-available (was: ) > Remove the `KinesisTestUtils` from `main` to

[jira] [Updated] (SPARK-47815) Unify the user agent with json

2024-04-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47815: --- Labels: pull-request-available (was: ) > Unify the user agent with json >

[jira] [Updated] (SPARK-47815) Unify the user agent string with json

2024-04-11 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-47815: -- Summary: Unify the user agent string with json (was: Unify the user agent string

[jira] [Created] (SPARK-47815) Unify the user agent string representation with json

2024-04-11 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-47815: - Summary: Unify the user agent string representation with json Key: SPARK-47815 URL: https://issues.apache.org/jira/browse/SPARK-47815 Project: Spark Issue

[jira] [Updated] (SPARK-47815) Unify the user agent with json

2024-04-11 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-47815: -- Summary: Unify the user agent with json (was: Unify the user agent string with json) >

[jira] [Updated] (SPARK-47625) Addition of Indeterminate Collation Support

2024-04-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47625: --- Labels: pull-request-available (was: ) > Addition of Indeterminate Collation Support >

[jira] [Commented] (SPARK-47412) StringLPad, StringRPad (all collations)

2024-04-11 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836100#comment-17836100 ] Uroš Bojanić commented on SPARK-47412: -- [~gpgp] Yup, you got it! That's the expected behaviour,

[jira] [Updated] (SPARK-47408) TBD

2024-04-11 Thread Nikola Mandic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikola Mandic updated SPARK-47408: -- Summary: TBD (was: Luhncheck (all collations)) > TBD > --- > > Key:

[jira] [Updated] (SPARK-47414) TBD

2024-04-11 Thread Nikola Mandic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikola Mandic updated SPARK-47414: -- Summary: TBD (was: Length, BitLength, OctetLength (all collations)) > TBD > --- > >

[jira] [Updated] (SPARK-47416) TBD

2024-04-11 Thread Nikola Mandic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikola Mandic updated SPARK-47416: -- Summary: TBD (was: SoundEx (all collations)) > TBD > --- > > Key:

[jira] [Commented] (SPARK-47814) Remove the `KinesisTestUtils` from `main` to `test`

2024-04-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836079#comment-17836079 ] ASF GitHub Bot commented on SPARK-47814: User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-47814) Remove the `KinesisTestUtils` from `main` to `test`

2024-04-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47814: -- Assignee: Apache Spark > Remove the `KinesisTestUtils` from `main` to `test` >

[jira] [Assigned] (SPARK-47814) Remove the `KinesisTestUtils` from `main` to `test`

2024-04-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47814: -- Assignee: (was: Apache Spark) > Remove the `KinesisTestUtils` from `main` to

[jira] [Created] (SPARK-47814) Remove the `KinesisTestUtils` from `main` to `test`

2024-04-11 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47814: --- Summary: Remove the `KinesisTestUtils` from `main` to `test` Key: SPARK-47814 URL: https://issues.apache.org/jira/browse/SPARK-47814 Project: Spark Issue

[jira] [Assigned] (SPARK-47617) Add TPC-DS testing infrastructure for collations

2024-04-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47617: -- Assignee: (was: Apache Spark) > Add TPC-DS testing infrastructure for collations

[jira] [Assigned] (SPARK-47617) Add TPC-DS testing infrastructure for collations

2024-04-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47617: -- Assignee: Apache Spark > Add TPC-DS testing infrastructure for collations >

[jira] [Assigned] (SPARK-47800) Add method for converting v2 identifier to table identifier

2024-04-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47800: -- Assignee: Apache Spark > Add method for converting v2 identifier to table identifier

[jira] [Assigned] (SPARK-47800) Add method for converting v2 identifier to table identifier

2024-04-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47800: -- Assignee: (was: Apache Spark) > Add method for converting v2 identifier to table

[jira] [Created] (SPARK-47813) Replace getArrayDimension with updateExtraColumnMeta

2024-04-11 Thread Kent Yao (Jira)
Kent Yao created SPARK-47813: Summary: Replace getArrayDimension with updateExtraColumnMeta Key: SPARK-47813 URL: https://issues.apache.org/jira/browse/SPARK-47813 Project: Spark Issue Type:

  1   2   >