[jira] [Commented] (SPARK-42768) Enable cached plan apply AQE by default

2023-03-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699445#comment-17699445 ] Apache Spark commented on SPARK-42768: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-42768) Enable cached plan apply AQE by default

2023-03-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42768: Assignee: (was: Apache Spark) > Enable cached plan apply AQE by default >

[jira] [Assigned] (SPARK-42768) Enable cached plan apply AQE by default

2023-03-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42768: Assignee: Apache Spark > Enable cached plan apply AQE by default >

[jira] [Updated] (SPARK-42768) Enable cached plan apply AQE by default

2023-03-12 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-42768: -- Summary: Enable cached plan apply AQE by default (was: Enable cache apply AQE by default) > Enable

[jira] [Created] (SPARK-42768) Enable cache apply AQE by default

2023-03-12 Thread XiDuo You (Jira)
XiDuo You created SPARK-42768: - Summary: Enable cache apply AQE by default Key: SPARK-42768 URL: https://issues.apache.org/jira/browse/SPARK-42768 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-42767) Add check condition to start connect server fallback with `in-memory` and auto ignored some tests strongly depend on hive

2023-03-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42767: Assignee: Apache Spark > Add check condition to start connect server fallback with

[jira] [Assigned] (SPARK-42767) Add check condition to start connect server fallback with `in-memory` and auto ignored some tests strongly depend on hive

2023-03-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42767: Assignee: (was: Apache Spark) > Add check condition to start connect server fallback

[jira] [Commented] (SPARK-42767) Add check condition to start connect server fallback with `in-memory` and auto ignored some tests strongly depend on hive

2023-03-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699444#comment-17699444 ] Apache Spark commented on SPARK-42767: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-42767) Add check condition to start connect server fallback with `in-memory` and auto ignored some tests strongly depend on hive

2023-03-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699443#comment-17699443 ] Apache Spark commented on SPARK-42767: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-42767) Add check condition to start connect server fallback with `in-memory` and auto ignored some tests strongly depend on hive

2023-03-12 Thread Yang Jie (Jira)
Yang Jie created SPARK-42767: Summary: Add check condition to start connect server fallback with `in-memory` and auto ignored some tests strongly depend on hive Key: SPARK-42767 URL:

[jira] [Created] (SPARK-42766) YarnAllocator should filter excluded nodes when launching allocated containers

2023-03-12 Thread wangshengjie (Jira)
wangshengjie created SPARK-42766: Summary: YarnAllocator should filter excluded nodes when launching allocated containers Key: SPARK-42766 URL: https://issues.apache.org/jira/browse/SPARK-42766

[jira] [Commented] (SPARK-42766) YarnAllocator should filter excluded nodes when launching allocated containers

2023-03-12 Thread wangshengjie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699438#comment-17699438 ] wangshengjie commented on SPARK-42766: -- Working on this > YarnAllocator should filter excluded

[jira] [Resolved] (SPARK-42679) createDataFrame doesn't work with non-nullable schema.

2023-03-12 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-42679. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40382

[jira] [Assigned] (SPARK-42101) Wrap InMemoryTableScanExec with QueryStage

2023-03-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42101: --- Assignee: XiDuo You > Wrap InMemoryTableScanExec with QueryStage >

[jira] [Resolved] (SPARK-42101) Wrap InMemoryTableScanExec with QueryStage

2023-03-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42101. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39624

[jira] [Commented] (SPARK-42765) Regulate the import path of `pandas_udf`

2023-03-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699425#comment-17699425 ] Apache Spark commented on SPARK-42765: -- User 'xinrong-meng' has created a pull request for this

[jira] [Assigned] (SPARK-42765) Regulate the import path of `pandas_udf`

2023-03-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42765: Assignee: Apache Spark > Regulate the import path of `pandas_udf` >

[jira] [Commented] (SPARK-42765) Regulate the import path of `pandas_udf`

2023-03-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699426#comment-17699426 ] Apache Spark commented on SPARK-42765: -- User 'xinrong-meng' has created a pull request for this

[jira] [Assigned] (SPARK-42765) Regulate the import path of `pandas_udf`

2023-03-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42765: Assignee: (was: Apache Spark) > Regulate the import path of `pandas_udf` >

[jira] [Updated] (SPARK-42765) Regulate the import path of `pandas_udf`

2023-03-12 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42765: - Summary: Regulate the import path of `pandas_udf` (was: Standardize the import path of

[jira] [Updated] (SPARK-42765) Standardize the import path of `pandas_udf`

2023-03-12 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42765: - Summary: Standardize the import path of `pandas_udf` (was: Remove the outdated import path of

[jira] [Created] (SPARK-42765) Remove the outdated import path of `pandas_udf`

2023-03-12 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-42765: Summary: Remove the outdated import path of `pandas_udf` Key: SPARK-42765 URL: https://issues.apache.org/jira/browse/SPARK-42765 Project: Spark Issue Type:

[jira] [Commented] (SPARK-42764) Parameterize the max number of attempts for driver props fetcher in KubernetesExecutorBackend

2023-03-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699417#comment-17699417 ] Apache Spark commented on SPARK-42764: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-42764) Parameterize the max number of attempts for driver props fetcher in KubernetesExecutorBackend

2023-03-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42764: Assignee: (was: Apache Spark) > Parameterize the max number of attempts for driver

[jira] [Commented] (SPARK-42764) Parameterize the max number of attempts for driver props fetcher in KubernetesExecutorBackend

2023-03-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699416#comment-17699416 ] Apache Spark commented on SPARK-42764: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-42764) Parameterize the max number of attempts for driver props fetcher in KubernetesExecutorBackend

2023-03-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42764: Assignee: Apache Spark > Parameterize the max number of attempts for driver props

[jira] [Created] (SPARK-42764) Parameterize the max number of attempts for driver props fetcher in KubernetesExecutorBackend

2023-03-12 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-42764: - Summary: Parameterize the max number of attempts for driver props fetcher in KubernetesExecutorBackend Key: SPARK-42764 URL: https://issues.apache.org/jira/browse/SPARK-42764

[jira] [Assigned] (SPARK-42761) kubernetes-client from 6.4.1 to 6.5.0

2023-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42761: - Assignee: Bjørn Jørgensen > kubernetes-client from 6.4.1 to 6.5.0 >

[jira] [Resolved] (SPARK-42761) kubernetes-client from 6.4.1 to 6.5.0

2023-03-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42761. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40381

[jira] [Updated] (SPARK-42761) kubernetes-client from 6.4.1 to 6.5.0

2023-03-12 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-42761: Description: Upgrade fabric8:kubernetes-client from 6.4.1 to 6.5.0 was: Upgrade

[jira] [Commented] (SPARK-42753) ReusedExchange refers to non-existent node

2023-03-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699388#comment-17699388 ] Apache Spark commented on SPARK-42753: -- User 'StevenChenDatabricks' has created a pull request for

[jira] [Assigned] (SPARK-42753) ReusedExchange refers to non-existent node

2023-03-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42753: Assignee: (was: Apache Spark) > ReusedExchange refers to non-existent node >

[jira] [Assigned] (SPARK-42753) ReusedExchange refers to non-existent node

2023-03-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42753: Assignee: Apache Spark > ReusedExchange refers to non-existent node >

[jira] [Commented] (SPARK-42753) ReusedExchange refers to non-existent node

2023-03-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699389#comment-17699389 ] Apache Spark commented on SPARK-42753: -- User 'StevenChenDatabricks' has created a pull request for