[jira] [Assigned] (SPARK-41136) Shorten graceful shutdown time of ExecutorPodsSnapshotsStoreImpl to prevent blocking shutdown process

2022-12-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-41136: - Assignee: Cheng Pan > Shorten graceful shutdown time of ExecutorPodsSnapshotsStoreImpl

[jira] [Resolved] (SPARK-41136) Shorten graceful shutdown time of ExecutorPodsSnapshotsStoreImpl to prevent blocking shutdown process

2022-12-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-41136. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38651

[jira] [Assigned] (SPARK-41153) Log migrated shuffle data size and migration time

2022-12-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-41153: - Assignee: Zhongwei Zhu > Log migrated shuffle data size and migration time >

[jira] [Resolved] (SPARK-41153) Log migrated shuffle data size and migration time

2022-12-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-41153. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38668

[jira] [Resolved] (SPARK-41253) Make K8s volcano IT work in Github Action

2022-12-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-41253. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38789

[jira] [Assigned] (SPARK-41253) Make K8s volcano IT work in Github Action

2022-12-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-41253: - Assignee: Yikun Jiang > Make K8s volcano IT work in Github Action >

[jira] [Resolved] (SPARK-41374) Update ORC to 1.8.1

2022-12-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-41374. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38894

[jira] [Assigned] (SPARK-41374) Update ORC to 1.8.1

2022-12-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-41374: - Assignee: William Hyun > Update ORC to 1.8.1 > --- > >

[jira] [Assigned] (SPARK-41374) Update ORC to 1.8.1

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41374: Assignee: (was: Apache Spark) > Update ORC to 1.8.1 > --- > >

[jira] [Commented] (SPARK-41374) Update ORC to 1.8.1

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642734#comment-17642734 ] Apache Spark commented on SPARK-41374: -- User 'williamhyun' has created a pull request for this

[jira] [Commented] (SPARK-41374) Update ORC to 1.8.1

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642733#comment-17642733 ] Apache Spark commented on SPARK-41374: -- User 'williamhyun' has created a pull request for this

[jira] [Assigned] (SPARK-41374) Update ORC to 1.8.1

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41374: Assignee: Apache Spark > Update ORC to 1.8.1 > --- > >

[jira] [Created] (SPARK-41374) Update ORC to 1.8.1

2022-12-02 Thread William Hyun (Jira)
William Hyun created SPARK-41374: Summary: Update ORC to 1.8.1 Key: SPARK-41374 URL: https://issues.apache.org/jira/browse/SPARK-41374 Project: Spark Issue Type: Bug Components:

[jira] [Updated] (SPARK-41313) AM shutdown hook fails with IllegalStateException if AM crashes on startup (recurrence of SPARK-3900)

2022-12-02 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated SPARK-41313: Summary: AM shutdown hook fails with IllegalStateException if AM crashes on startup (recurrence

[jira] [Updated] (SPARK-41313) Combine fixes for SPARK-3900 and SPARK-21138

2022-12-02 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated SPARK-41313: Description: SPARK-3900 fixed the {{IllegalStateException}} in cleanupStagingDir in

[jira] [Assigned] (SPARK-40099) Merge adjacent CaseWhen branches if their values are the same

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40099: Assignee: Apache Spark > Merge adjacent CaseWhen branches if their values are the same >

[jira] [Assigned] (SPARK-40099) Merge adjacent CaseWhen branches if their values are the same

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40099: Assignee: (was: Apache Spark) > Merge adjacent CaseWhen branches if their values are

[jira] [Commented] (SPARK-40099) Merge adjacent CaseWhen branches if their values are the same

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642673#comment-17642673 ] Apache Spark commented on SPARK-40099: -- User 'MrDLontheway' has created a pull request for this

[jira] [Assigned] (SPARK-41373) Rename CAST_WITH_FUN_SUGGESTION to CAST_WITH_FUNC_SUGGESTION

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41373: Assignee: (was: Apache Spark) > Rename CAST_WITH_FUN_SUGGESTION to

[jira] [Assigned] (SPARK-41373) Rename CAST_WITH_FUN_SUGGESTION to CAST_WITH_FUNC_SUGGESTION

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41373: Assignee: Apache Spark > Rename CAST_WITH_FUN_SUGGESTION to CAST_WITH_FUNC_SUGGESTION >

[jira] [Commented] (SPARK-41373) Rename CAST_WITH_FUN_SUGGESTION to CAST_WITH_FUNC_SUGGESTION

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642670#comment-17642670 ] Apache Spark commented on SPARK-41373: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Created] (SPARK-41373) Rename CAST_WITH_FUN_SUGGESTION to CAST_WITH_FUNC_SUGGESTION

2022-12-02 Thread Rui Wang (Jira)
Rui Wang created SPARK-41373: Summary: Rename CAST_WITH_FUN_SUGGESTION to CAST_WITH_FUNC_SUGGESTION Key: SPARK-41373 URL: https://issues.apache.org/jira/browse/SPARK-41373 Project: Spark Issue

[jira] [Assigned] (SPARK-41372) Support DataFrame TempView

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41372: Assignee: Apache Spark (was: Rui Wang) > Support DataFrame TempView >

[jira] [Commented] (SPARK-41372) Support DataFrame TempView

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642652#comment-17642652 ] Apache Spark commented on SPARK-41372: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Commented] (SPARK-41372) Support DataFrame TempView

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642653#comment-17642653 ] Apache Spark commented on SPARK-41372: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41372) Support DataFrame TempView

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41372: Assignee: Rui Wang (was: Apache Spark) > Support DataFrame TempView >

[jira] [Created] (SPARK-41372) Support DataFrame TempView

2022-12-02 Thread Rui Wang (Jira)
Rui Wang created SPARK-41372: Summary: Support DataFrame TempView Key: SPARK-41372 URL: https://issues.apache.org/jira/browse/SPARK-41372 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-41305) Connect Proto Completeness

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41305: Assignee: Apache Spark (was: Rui Wang) > Connect Proto Completeness >

[jira] [Commented] (SPARK-41305) Connect Proto Completeness

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642632#comment-17642632 ] Apache Spark commented on SPARK-41305: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41305) Connect Proto Completeness

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41305: Assignee: Rui Wang (was: Apache Spark) > Connect Proto Completeness >

[jira] [Created] (SPARK-41371) Improve Documentation for Command proto

2022-12-02 Thread Rui Wang (Jira)
Rui Wang created SPARK-41371: Summary: Improve Documentation for Command proto Key: SPARK-41371 URL: https://issues.apache.org/jira/browse/SPARK-41371 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-41369) Refactor connect directory structure

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642575#comment-17642575 ] Apache Spark commented on SPARK-41369: -- User 'vicennial' has created a pull request for this issue:

[jira] [Commented] (SPARK-41369) Refactor connect directory structure

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642576#comment-17642576 ] Apache Spark commented on SPARK-41369: -- User 'vicennial' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41369) Refactor connect directory structure

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41369: Assignee: (was: Apache Spark) > Refactor connect directory structure >

[jira] [Assigned] (SPARK-41369) Refactor connect directory structure

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41369: Assignee: Apache Spark > Refactor connect directory structure >

[jira] [Created] (SPARK-41370) Add data frame equality check for testing purposes.

2022-12-02 Thread Oscar Delicaat (Jira)
Oscar Delicaat created SPARK-41370: -- Summary: Add data frame equality check for testing purposes. Key: SPARK-41370 URL: https://issues.apache.org/jira/browse/SPARK-41370 Project: Spark

[jira] [Created] (SPARK-41369) Refactor connect directory structure

2022-12-02 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-41369: Summary: Refactor connect directory structure Key: SPARK-41369 URL: https://issues.apache.org/jira/browse/SPARK-41369 Project: Spark

[jira] [Assigned] (SPARK-41368) Reorder the window partition expressions by expression stats

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41368: Assignee: (was: Apache Spark) > Reorder the window partition expressions by

[jira] [Assigned] (SPARK-41368) Reorder the window partition expressions by expression stats

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41368: Assignee: Apache Spark > Reorder the window partition expressions by expression stats >

[jira] [Commented] (SPARK-41368) Reorder the window partition expressions by expression stats

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642563#comment-17642563 ] Apache Spark commented on SPARK-41368: -- User 'wankunde' has created a pull request for this issue:

[jira] [Updated] (SPARK-41368) Reorder the window partition expressions by expression stats

2022-12-02 Thread Wan Kun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-41368: Description: We can reorder window partition expressions by the distinct values stats. Sorting with high

[jira] [Created] (SPARK-41368) Reorder the window partition expressions by expression stats

2022-12-02 Thread Wan Kun (Jira)
Wan Kun created SPARK-41368: --- Summary: Reorder the window partition expressions by expression stats Key: SPARK-41368 URL: https://issues.apache.org/jira/browse/SPARK-41368 Project: Spark Issue

[jira] [Commented] (SPARK-41346) Implement asc and desc methods

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642511#comment-17642511 ] Apache Spark commented on SPARK-41346: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-41367) Enable V2 file tables in read paths in session catalog

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642505#comment-17642505 ] Apache Spark commented on SPARK-41367: -- User 'peter-toth' has created a pull request for this

[jira] [Commented] (SPARK-41367) Enable V2 file tables in read paths in session catalog

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642506#comment-17642506 ] Apache Spark commented on SPARK-41367: -- User 'peter-toth' has created a pull request for this

[jira] [Assigned] (SPARK-41367) Enable V2 file tables in read paths in session catalog

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41367: Assignee: Apache Spark > Enable V2 file tables in read paths in session catalog >

[jira] [Assigned] (SPARK-41367) Enable V2 file tables in read paths in session catalog

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41367: Assignee: (was: Apache Spark) > Enable V2 file tables in read paths in session

[jira] [Created] (SPARK-41367) Enable V2 file tables in read paths in session catalog

2022-12-02 Thread Peter Toth (Jira)
Peter Toth created SPARK-41367: -- Summary: Enable V2 file tables in read paths in session catalog Key: SPARK-41367 URL: https://issues.apache.org/jira/browse/SPARK-41367 Project: Spark Issue

[jira] [Updated] (SPARK-41319) when-otherwise support

2022-12-02 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-41319: -- Description: 1, add protobuf message for expression 'CaseWhen'; 2, support the

[jira] [Updated] (SPARK-41319) when-otherwise support

2022-12-02 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-41319: -- Description: 1, add protobuf message for expression 'CaseWhen'; 2, support the

[jira] [Updated] (SPARK-41319) when-otherwise support

2022-12-02 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-41319: -- Description: 1, add protobuf message for expression 'CaseWhen'; 2, support the Column.{when,

[jira] [Assigned] (SPARK-41363) implement normal functions

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41363: Assignee: Apache Spark (was: Ruifeng Zheng) > implement normal functions >

[jira] [Assigned] (SPARK-41363) implement normal functions

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41363: Assignee: Ruifeng Zheng (was: Apache Spark) > implement normal functions >

[jira] [Commented] (SPARK-41363) implement normal functions

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642471#comment-17642471 ] Apache Spark commented on SPARK-41363: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-41366) DF.groupby.agg() API should be compatible

2022-12-02 Thread Martin Grund (Jira)
Martin Grund created SPARK-41366: Summary: DF.groupby.agg() API should be compatible Key: SPARK-41366 URL: https://issues.apache.org/jira/browse/SPARK-41366 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-41357) Implement math functions

2022-12-02 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41357: - Assignee: Ruifeng Zheng > Implement math functions > > >

[jira] [Resolved] (SPARK-41357) Implement math functions

2022-12-02 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41357. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38872

[jira] [Assigned] (SPARK-41365) Stages UI page fails to load for proxy in some yarn versions

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41365: Assignee: Apache Spark > Stages UI page fails to load for proxy in some yarn versions >

[jira] [Commented] (SPARK-41365) Stages UI page fails to load for proxy in some yarn versions

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642412#comment-17642412 ] Apache Spark commented on SPARK-41365: -- User 'yabola' has created a pull request for this issue:

[jira] [Commented] (SPARK-41365) Stages UI page fails to load for proxy in some yarn versions

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642411#comment-17642411 ] Apache Spark commented on SPARK-41365: -- User 'yabola' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41365) Stages UI page fails to load for proxy in some yarn versions

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41365: Assignee: (was: Apache Spark) > Stages UI page fails to load for proxy in some yarn

[jira] [Updated] (SPARK-41365) Stages UI page fails to load for proxy in some yarn versions

2022-12-02 Thread Mars (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mars updated SPARK-41365: - Description: My environment CDH 5.8 , click to enter the spark UI from the yarn interface when visit the stage

[jira] [Updated] (SPARK-41365) Stages UI page fails to load for proxy in some yarn versions

2022-12-02 Thread Mars (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mars updated SPARK-41365: - Description: My environment CDH 5.8 , click to enter the spark UI from the yarn interface when visit the stage

[jira] [Updated] (SPARK-41365) Stages UI page fails to load for proxy in some yarn versions

2022-12-02 Thread Mars (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mars updated SPARK-41365: - Attachment: image-2022-12-02-17-53-03-003.png > Stages UI page fails to load for proxy in some yarn versions >

[jira] [Commented] (SPARK-38277) Clear write batch after RocksDB state store's commit

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642403#comment-17642403 ] Apache Spark commented on SPARK-38277: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Assigned] (SPARK-38277) Clear write batch after RocksDB state store's commit

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38277: Assignee: (was: Apache Spark) > Clear write batch after RocksDB state store's commit

[jira] [Commented] (SPARK-38277) Clear write batch after RocksDB state store's commit

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642402#comment-17642402 ] Apache Spark commented on SPARK-38277: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Assigned] (SPARK-38277) Clear write batch after RocksDB state store's commit

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38277: Assignee: Apache Spark > Clear write batch after RocksDB state store's commit >

[jira] [Created] (SPARK-41365) Stages UI page fails to load for proxy in some yarn versions

2022-12-02 Thread Mars (Jira)
Mars created SPARK-41365: Summary: Stages UI page fails to load for proxy in some yarn versions Key: SPARK-41365 URL: https://issues.apache.org/jira/browse/SPARK-41365 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-41362) Better type errors when passing wrong parameters

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41362: Assignee: (was: Apache Spark) > Better type errors when passing wrong parameters >

[jira] [Assigned] (SPARK-41362) Better type errors when passing wrong parameters

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41362: Assignee: Apache Spark > Better type errors when passing wrong parameters >

[jira] [Commented] (SPARK-41362) Better type errors when passing wrong parameters

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642391#comment-17642391 ] Apache Spark commented on SPARK-41362: -- User 'grundprinzip' has created a pull request for this

[jira] [Created] (SPARK-41364) implement `broadcast` function

2022-12-02 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41364: - Summary: implement `broadcast` function Key: SPARK-41364 URL: https://issues.apache.org/jira/browse/SPARK-41364 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-41363) implement normal functions

2022-12-02 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41363: - Summary: implement normal functions Key: SPARK-41363 URL: https://issues.apache.org/jira/browse/SPARK-41363 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-41362) Better type errors when passing wrong parameters

2022-12-02 Thread Martin Grund (Jira)
Martin Grund created SPARK-41362: Summary: Better type errors when passing wrong parameters Key: SPARK-41362 URL: https://issues.apache.org/jira/browse/SPARK-41362 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-41337) Add a physical rule to remove the partialLimitExec node

2022-12-02 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng resolved SPARK-41337. Resolution: Invalid > Add a physical rule to remove the partialLimitExec node >

[jira] [Commented] (SPARK-41361) Invalid call toAttribute on unresolved object exception caused by WidenSetOperationTypes

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642356#comment-17642356 ] Apache Spark commented on SPARK-41361: -- User 'mcdull-zhang' has created a pull request for this

[jira] [Commented] (SPARK-41361) Invalid call toAttribute on unresolved object exception caused by WidenSetOperationTypes

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642355#comment-17642355 ] Apache Spark commented on SPARK-41361: -- User 'mcdull-zhang' has created a pull request for this

[jira] [Assigned] (SPARK-41361) Invalid call toAttribute on unresolved object exception caused by WidenSetOperationTypes

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41361: Assignee: Apache Spark > Invalid call toAttribute on unresolved object exception caused

[jira] [Assigned] (SPARK-41361) Invalid call toAttribute on unresolved object exception caused by WidenSetOperationTypes

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41361: Assignee: (was: Apache Spark) > Invalid call toAttribute on unresolved object

[jira] [Commented] (SPARK-41360) Avoid BlockManager re-registration if the executor has been lost

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642350#comment-17642350 ] Apache Spark commented on SPARK-41360: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Commented] (SPARK-41360) Avoid BlockManager re-registration if the executor has been lost

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642349#comment-17642349 ] Apache Spark commented on SPARK-41360: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41360) Avoid BlockManager re-registration if the executor has been lost

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41360: Assignee: (was: Apache Spark) > Avoid BlockManager re-registration if the executor

[jira] [Assigned] (SPARK-41360) Avoid BlockManager re-registration if the executor has been lost

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41360: Assignee: Apache Spark > Avoid BlockManager re-registration if the executor has been

[jira] [Resolved] (SPARK-40970) Support List[Column] for Join's on argument.

2022-12-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40970. -- Assignee: Rui Wang (was: Apache Spark) Resolution: Fixed Fixed in

[jira] [Updated] (SPARK-40970) Support List[Column] for Join's on argument.

2022-12-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40970: - Fix Version/s: 3.4.0 > Support List[Column] for Join's on argument. >

[jira] [Commented] (SPARK-40988) Test case for insert partition should verify value

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642341#comment-17642341 ] Apache Spark commented on SPARK-40988: -- User 'rangareddy' has created a pull request for this

[jira] [Commented] (SPARK-40988) Test case for insert partition should verify value

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642339#comment-17642339 ] Apache Spark commented on SPARK-40988: -- User 'rangareddy' has created a pull request for this

[jira] [Created] (SPARK-41361) Invalid call toAttribute on unresolved object exception caused by WidenSetOperationTypes

2022-12-02 Thread mcdull_zhang (Jira)
mcdull_zhang created SPARK-41361: Summary: Invalid call toAttribute on unresolved object exception caused by WidenSetOperationTypes Key: SPARK-41361 URL: https://issues.apache.org/jira/browse/SPARK-41361

[jira] [Assigned] (SPARK-41235) High-order function: array_compact

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41235: Assignee: (was: Apache Spark) > High-order function: array_compact >

[jira] [Commented] (SPARK-41235) High-order function: array_compact

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642336#comment-17642336 ] Apache Spark commented on SPARK-41235: -- User 'sandeep-katta' has created a pull request for this

[jira] [Assigned] (SPARK-41235) High-order function: array_compact

2022-12-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41235: Assignee: Apache Spark > High-order function: array_compact >