[jira] [Resolved] (SPARK-46275) Protobuf: Permissive mode should return null rather than struct with null fields

[ https://issues.apache.org/jira/browse/SPARK-46275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46275. -- Assignee: Raghu Angadi Resolution: Fixed Fixed in

[jira] [Updated] (SPARK-46326) Test missing cases for functions (pyspark.sql.functions)

[ https://issues.apache.org/jira/browse/SPARK-46326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46326: --- Labels: pull-request-available (was: ) > Test missing cases for functions

[jira] [Updated] (SPARK-46325) Remove unnecessary override functions when constructing `WrappedCloseableIterator` in `ResponseValidator#wrapIterator`

[ https://issues.apache.org/jira/browse/SPARK-46325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46325: --- Labels: pull-request-available (was: ) > Remove unnecessary override functions when

[jira] [Created] (SPARK-46326) Test missing cases for functions (pyspark.sql.functions)

Hyukjin Kwon created SPARK-46326: Summary: Test missing cases for functions (pyspark.sql.functions) Key: SPARK-46326 URL: https://issues.apache.org/jira/browse/SPARK-46326 Project: Spark

[jira] [Created] (SPARK-46325) Remove unnecessary override functions when constructing `WrappedCloseableIterator` in `ResponseValidator#wrapIterator`

Yang Jie created SPARK-46325: Summary: Remove unnecessary override functions when constructing `WrappedCloseableIterator` in `ResponseValidator#wrapIterator` Key: SPARK-46325 URL:

[jira] [Updated] (SPARK-46275) Protobuf: Permissive mode should return null rather than struct with null fields

[ https://issues.apache.org/jira/browse/SPARK-46275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated SPARK-46275: - Fix Version/s: 3.4.3 > Protobuf: Permissive mode should return null rather than struct with

[jira] [Resolved] (SPARK-46321) Re-ennable IndexesTests.test_asof that was skipped due to Pandas bug

[ https://issues.apache.org/jira/browse/SPARK-46321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46321. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44250

[jira] [Updated] (SPARK-46324) Fix the output name of pyspark.sql.functions.user and session_user

[ https://issues.apache.org/jira/browse/SPARK-46324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46324: --- Labels: pull-request-available (was: ) > Fix the output name of pyspark.sql.functions.user

[jira] [Updated] (SPARK-46275) Protobuf: Permissive mode should return null rather than struct with null fields

[ https://issues.apache.org/jira/browse/SPARK-46275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-46275: - Affects Version/s: 3.4.2 (was: 3.4.0) > Protobuf: Permissive mode should

[jira] [Updated] (SPARK-46275) Protobuf: Permissive mode should return null rather than struct with null fields

[ https://issues.apache.org/jira/browse/SPARK-46275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-46275: - Affects Version/s: 3.5.0 4.0.0 > Protobuf: Permissive mode should return null

[jira] [Assigned] (SPARK-46320) Support `spark.master.rest.host`

[ https://issues.apache.org/jira/browse/SPARK-46320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46320: - Assignee: Dongjoon Hyun > Support `spark.master.rest.host` >

[jira] [Resolved] (SPARK-46320) Support `spark.master.rest.host`

[ https://issues.apache.org/jira/browse/SPARK-46320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46320. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44249

[jira] [Created] (SPARK-46324) Fix the output name of pyspark.sql.functions.user and session_user

Hyukjin Kwon created SPARK-46324: Summary: Fix the output name of pyspark.sql.functions.user and session_user Key: SPARK-46324 URL: https://issues.apache.org/jira/browse/SPARK-46324 Project: Spark

[jira] [Updated] (SPARK-46275) Protobuf: Permissive mode should return null rather than struct with null fields

[ https://issues.apache.org/jira/browse/SPARK-46275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated SPARK-46275: - Affects Version/s: (was: 3.5.0) > Protobuf: Permissive mode should return null rather than

[jira] [Updated] (SPARK-46275) Protobuf: Permissive mode should return null rather than struct with null fields

[ https://issues.apache.org/jira/browse/SPARK-46275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated SPARK-46275: - Affects Version/s: 3.4.0 > Protobuf: Permissive mode should return null rather than struct with

[jira] [Resolved] (SPARK-46319) Implements OffHeapRecyclingBufferPool for ZSTD Compression Buffer Pool

[ https://issues.apache.org/jira/browse/SPARK-46319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46319. -- Resolution: Later zstd-jni currently uses heap buffer in ZstdOutputStreamNoFinalizer > Implements

[jira] [Updated] (SPARK-46323) Fix the output name of pyspark.sql.functions.now

[ https://issues.apache.org/jira/browse/SPARK-46323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46323: --- Labels: pull-request-available (was: ) > Fix the output name of pyspark.sql.functions.now

[jira] [Created] (SPARK-46323) Fix the output name of pyspark.sql.functions.now

Hyukjin Kwon created SPARK-46323: Summary: Fix the output name of pyspark.sql.functions.now Key: SPARK-46323 URL: https://issues.apache.org/jira/browse/SPARK-46323 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46322) Replace external link with internal link for error documentation

[ https://issues.apache.org/jira/browse/SPARK-46322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46322: --- Labels: pull-request-available (was: ) > Replace external link with internal link for

[jira] [Created] (SPARK-46322) Replace external link with internal link for error documentation

Haejoon Lee created SPARK-46322: --- Summary: Replace external link with internal link for error documentation Key: SPARK-46322 URL: https://issues.apache.org/jira/browse/SPARK-46322 Project: Spark

[jira] [Resolved] (SPARK-46317) Test missing cases for SparkSession (pyspark.sql.session)

[ https://issues.apache.org/jira/browse/SPARK-46317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46317. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44247

[jira] [Assigned] (SPARK-46317) Test missing cases for SparkSession (pyspark.sql.session)

[ https://issues.apache.org/jira/browse/SPARK-46317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46317: Assignee: Hyukjin Kwon > Test missing cases for SparkSession (pyspark.sql.session) >

[jira] [Assigned] (SPARK-46315) Test invalid key for spark.conf.get (pyspark.sql.conf)

[ https://issues.apache.org/jira/browse/SPARK-46315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46315: Assignee: Hyukjin Kwon > Test invalid key for spark.conf.get (pyspark.sql.conf) >

[jira] [Resolved] (SPARK-46315) Test invalid key for spark.conf.get (pyspark.sql.conf)

[ https://issues.apache.org/jira/browse/SPARK-46315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46315. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44245

[jira] [Assigned] (SPARK-46318) Exclude ported loose_version from the code coverage report

[ https://issues.apache.org/jira/browse/SPARK-46318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46318: Assignee: Hyukjin Kwon > Exclude ported loose_version from the code coverage report >

[jira] [Resolved] (SPARK-46318) Exclude ported loose_version from the code coverage report

[ https://issues.apache.org/jira/browse/SPARK-46318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46318. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44248

[jira] [Resolved] (SPARK-46316) Enable `buf-lint-action` on `core` module

[ https://issues.apache.org/jira/browse/SPARK-46316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46316. --- Assignee: Dongjoon Hyun Resolution: Fixed > Enable `buf-lint-action` on `core` module

[jira] [Updated] (SPARK-46321) Re-ennable IndexesTests.test_asof that was skipped due to Pandas bug

[ https://issues.apache.org/jira/browse/SPARK-46321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46321: --- Labels: pull-request-available (was: ) > Re-ennable IndexesTests.test_asof that was

[jira] [Created] (SPARK-46321) Re-ennable IndexesTests.test_asof that was skipped due to Pandas bug

Haejoon Lee created SPARK-46321: --- Summary: Re-ennable IndexesTests.test_asof that was skipped due to Pandas bug Key: SPARK-46321 URL: https://issues.apache.org/jira/browse/SPARK-46321 Project: Spark

[jira] [Commented] (SPARK-46320) Support `spark.master.rest.host`

[ https://issues.apache.org/jira/browse/SPARK-46320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17794522#comment-17794522 ] Dongjoon Hyun commented on SPARK-46320: --- This is a retry of SPARK-45095 . > Support

[jira] [Updated] (SPARK-46320) Support `spark.master.rest.host`

[ https://issues.apache.org/jira/browse/SPARK-46320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46320: --- Labels: pull-request-available (was: ) > Support `spark.master.rest.host` >

[jira] [Created] (SPARK-46320) Support `spark.master.rest.host`

Dongjoon Hyun created SPARK-46320: - Summary: Support `spark.master.rest.host` Key: SPARK-46320 URL: https://issues.apache.org/jira/browse/SPARK-46320 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-46319) Implements OffHeapRecyclingBufferPool for ZSTD Compression Buffer Pool

Kent Yao created SPARK-46319: Summary: Implements OffHeapRecyclingBufferPool for ZSTD Compression Buffer Pool Key: SPARK-46319 URL: https://issues.apache.org/jira/browse/SPARK-46319 Project: Spark

[jira] [Updated] (SPARK-46318) Exclude ported loose_version from the code coverage report

[ https://issues.apache.org/jira/browse/SPARK-46318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46318: --- Labels: pull-request-available (was: ) > Exclude ported loose_version from the code

[jira] [Created] (SPARK-46318) Exclude ported loose_version from the code coverage report

Hyukjin Kwon created SPARK-46318: Summary: Exclude ported loose_version from the code coverage report Key: SPARK-46318 URL: https://issues.apache.org/jira/browse/SPARK-46318 Project: Spark

[jira] [Reopened] (SPARK-46316) Enable `buf-lint-action` on `core` module

[ https://issues.apache.org/jira/browse/SPARK-46316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-46316: --- Assignee: (was: Dongjoon Hyun) This is reopened because we didn't add this to the

[jira] [Updated] (SPARK-46317) Test missing cases for SparkSession (pyspark.sql.session)

[ https://issues.apache.org/jira/browse/SPARK-46317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46317: --- Labels: pull-request-available (was: ) > Test missing cases for SparkSession

[jira] [Resolved] (SPARK-46316) Enable `buf-lint-action` on `core` module

[ https://issues.apache.org/jira/browse/SPARK-46316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46316. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44246

[jira] [Assigned] (SPARK-46316) Enable `buf-lint-action` on `core` module

[ https://issues.apache.org/jira/browse/SPARK-46316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46316: - Assignee: Dongjoon Hyun > Enable `buf-lint-action` on `core` module >

[jira] [Created] (SPARK-46317) Test missing cases for SparkSession (pyspark.sql.session)

Hyukjin Kwon created SPARK-46317: Summary: Test missing cases for SparkSession (pyspark.sql.session) Key: SPARK-46317 URL: https://issues.apache.org/jira/browse/SPARK-46317 Project: Spark

[jira] [Updated] (SPARK-46316) Enable `buf-lint-action` on `core` module

[ https://issues.apache.org/jira/browse/SPARK-46316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46316: --- Labels: pull-request-available (was: ) > Enable `buf-lint-action` on `core` module >

[jira] [Created] (SPARK-46316) Enable `buf-lint-action` on `core` module

Dongjoon Hyun created SPARK-46316: - Summary: Enable `buf-lint-action` on `core` module Key: SPARK-46316 URL: https://issues.apache.org/jira/browse/SPARK-46316 Project: Spark Issue Type: Task

[jira] [Updated] (SPARK-46315) Test invalid key for spark.conf.get (pyspark.sql.conf)

[ https://issues.apache.org/jira/browse/SPARK-46315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46315: --- Labels: pull-request-available (was: ) > Test invalid key for spark.conf.get

[jira] [Updated] (SPARK-46315) Test invalid key for spark.conf.get (pyspark.sql.conf)

[ https://issues.apache.org/jira/browse/SPARK-46315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46315: - Summary: Test invalid key for spark.conf.get (pyspark.sql.conf) (was: Test invalid value for

[jira] [Created] (SPARK-46315) Test invalid value for spark.conf (pyspark.sql.conf)

Hyukjin Kwon created SPARK-46315: Summary: Test invalid value for spark.conf (pyspark.sql.conf) Key: SPARK-46315 URL: https://issues.apache.org/jira/browse/SPARK-46315 Project: Spark Issue

[jira] [Resolved] (SPARK-46313) Log Spark HA recovery duration

[ https://issues.apache.org/jira/browse/SPARK-46313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46313. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44243

[jira] [Updated] (SPARK-46314) If Hadoop is not installed and configured, can the Spark cluster read and write OBS in standalone mode?

[ https://issues.apache.org/jira/browse/SPARK-46314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuqing Xue updated SPARK-46314: --- Language: Python Description: If Hadoop is not deployed, PySpark APIs read data from OBS

[jira] [Created] (SPARK-46314) If Hadoop is not installed and configured, can the Spark cluster read and write OBS in standalone mode?

Yuqing Xue created SPARK-46314: -- Summary: If Hadoop is not installed and configured, can the Spark cluster read and write OBS in standalone mode? Key: SPARK-46314 URL:

[jira] [Comment Edited] (SPARK-44976) Preserve full principal user name on executor side

[ https://issues.apache.org/jira/browse/SPARK-44976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759201#comment-17759201 ] YUBI LEE edited comment on SPARK-44976 at 12/8/23 12:34 AM:

[jira] [Comment Edited] (SPARK-44976) Preserve full principal user name on executor side

[ https://issues.apache.org/jira/browse/SPARK-44976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759201#comment-17759201 ] YUBI LEE edited comment on SPARK-44976 at 12/8/23 12:33 AM:

[jira] [Comment Edited] (SPARK-44976) Preserve full principal user name on executor side

[ https://issues.apache.org/jira/browse/SPARK-44976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759201#comment-17759201 ] YUBI LEE edited comment on SPARK-44976 at 12/8/23 12:33 AM:  

[jira] [Updated] (SPARK-46313) Log Spark HA recovery duration

[ https://issues.apache.org/jira/browse/SPARK-46313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46313: --- Labels: pull-request-available (was: ) > Log Spark HA recovery duration >

[jira] [Assigned] (SPARK-46309) Remove unused code in `pyspark.pandas.tests.indexes.* `

[ https://issues.apache.org/jira/browse/SPARK-46309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46309: - Assignee: Ruifeng Zheng > Remove unused code in `pyspark.pandas.tests.indexes.* ` >

[jira] [Resolved] (SPARK-46309) Remove unused code in `pyspark.pandas.tests.indexes.* `

[ https://issues.apache.org/jira/browse/SPARK-46309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46309. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44239

[jira] [Resolved] (SPARK-46277) Validate startup urls with the config being set

[ https://issues.apache.org/jira/browse/SPARK-46277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-46277. -- Resolution: Fixed Resolved by https://github.com/apache/spark/pull/44194 > Validate startup

[jira] [Assigned] (SPARK-46277) Validate startup urls with the config being set

[ https://issues.apache.org/jira/browse/SPARK-46277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng reassigned SPARK-46277: Assignee: Xinrong Meng > Validate startup urls with the config being set >

[jira] [Commented] (SPARK-40939) Release a shaded version of Apache Spark / shade jars on main jar

[ https://issues.apache.org/jira/browse/SPARK-40939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17794394#comment-17794394 ] Erik Krogen commented on SPARK-40939: - No movement/discussion that I've seen in the community since

[jira] [Commented] (SPARK-46032) connect: cannot assign instance of java.lang.invoke.SerializedLambda to field org.apache.spark.rdd.MapPartitionsRDD.f

[ https://issues.apache.org/jira/browse/SPARK-46032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17794376#comment-17794376 ] Faiz Halde commented on SPARK-46032: So we had a dire need to fix this and the following patch

[jira] [Assigned] (SPARK-46261) Python Client DataFrame.withColumnsRenamed should respect the dict ordering

[ https://issues.apache.org/jira/browse/SPARK-46261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46261: - Assignee: Ruifeng Zheng > Python Client DataFrame.withColumnsRenamed should respect

[jira] [Resolved] (SPARK-46261) Python Client DataFrame.withColumnsRenamed should respect the dict ordering

[ https://issues.apache.org/jira/browse/SPARK-46261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46261. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44231

[jira] [Resolved] (SPARK-46307) Enable `fill_value` tests for `GroupByTests.test_shift`

[ https://issues.apache.org/jira/browse/SPARK-46307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46307. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44237

[jira] [Assigned] (SPARK-46307) Enable `fill_value` tests for `GroupByTests.test_shift`

[ https://issues.apache.org/jira/browse/SPARK-46307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46307: - Assignee: Haejoon Lee > Enable `fill_value` tests for `GroupByTests.test_shift` >

[jira] [Resolved] (SPARK-46112) Implement lint check for PySpark custom errors

[ https://issues.apache.org/jira/browse/SPARK-46112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46112. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44203

[jira] [Resolved] (SPARK-46305) Remove the special Zookeeper version in the `streaming-kafka-0-10` and `sql-kafka-0-10` modules

[ https://issues.apache.org/jira/browse/SPARK-46305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46305. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44230

[jira] [Assigned] (SPARK-46305) Remove the special Zookeeper version in the `streaming-kafka-0-10` and `sql-kafka-0-10` modules

[ https://issues.apache.org/jira/browse/SPARK-46305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46305: - Assignee: Yang Jie > Remove the special Zookeeper version in the

[jira] [Updated] (SPARK-46310) Cannot deploy Spark application using VolcanoFeatureStep to specify podGroupTemplate file

[ https://issues.apache.org/jira/browse/SPARK-46310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lucca Sergi updated SPARK-46310: Description: I'm trying to deploy a Spark application (version 3.4.1) on Kubernetes using

[jira] [Updated] (SPARK-46310) Cannot deploy Spark application using VolcanoFeatureStep to specify podGroupTemplate file

[ https://issues.apache.org/jira/browse/SPARK-46310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lucca Sergi updated SPARK-46310: Description: I'm trying to deploy a Spark application (version 3.4.1) on Kubernetes using

[jira] [Updated] (SPARK-46310) Cannot deploy Spark application using VolcanoFeatureStep to specify podGroupTemplate file

[ https://issues.apache.org/jira/browse/SPARK-46310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lucca Sergi updated SPARK-46310: Description: I'm trying to deploy a Spark application (version 3.4.1) on Kubernetes using

[jira] [Created] (SPARK-46310) Cannot deploy Spark application using VolcanoFeatureStep to specify podGroupTemplate file

Lucca Sergi created SPARK-46310: --- Summary: Cannot deploy Spark application using VolcanoFeatureStep to specify podGroupTemplate file Key: SPARK-46310 URL: https://issues.apache.org/jira/browse/SPARK-46310

[jira] [Resolved] (SPARK-46304) Upgrade setup-java action to v4 and setup-python to v5

[ https://issues.apache.org/jira/browse/SPARK-46304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-46304. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44235

[jira] [Updated] (SPARK-46309) Remove unused code in `pyspark.pandas.tests.indexes.* `

[ https://issues.apache.org/jira/browse/SPARK-46309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46309: --- Labels: pull-request-available (was: ) > Remove unused code in

[jira] [Created] (SPARK-46309) Remove unused code in `pyspark.pandas.tests.indexes.* `

Ruifeng Zheng created SPARK-46309: - Summary: Remove unused code in `pyspark.pandas.tests.indexes.* ` Key: SPARK-46309 URL: https://issues.apache.org/jira/browse/SPARK-46309 Project: Spark

[jira] [Updated] (SPARK-46261) Python Client DataFrame.withColumnsRenamed should respect the dict ordering

[ https://issues.apache.org/jira/browse/SPARK-46261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46261: --- Labels: pull-request-available (was: ) > Python Client DataFrame.withColumnsRenamed should

[jira] [Updated] (SPARK-46308) Forbid recursive error handling by adding recursion guards

[ https://issues.apache.org/jira/browse/SPARK-46308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46308: --- Labels: pull-request-available (was: ) > Forbid recursive error handling by adding

[jira] [Created] (SPARK-46308) Forbid recursive error handling by adding recursion guards

Alice Sayutina created SPARK-46308: -- Summary: Forbid recursive error handling by adding recursion guards Key: SPARK-46308 URL: https://issues.apache.org/jira/browse/SPARK-46308 Project: Spark

[jira] [Updated] (SPARK-40353) Re-enable the `read_excel` tests

[ https://issues.apache.org/jira/browse/SPARK-40353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-40353: --- Labels: pull-request-available (was: ) > Re-enable the `read_excel` tests >

[jira] [Updated] (SPARK-46307) Enable `fill_value` tests for `GroupByTests.test_shift`

[ https://issues.apache.org/jira/browse/SPARK-46307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46307: --- Labels: pull-request-available (was: ) > Enable `fill_value` tests for

[jira] [Created] (SPARK-46307) Enable `fill_value` tests for `GroupByTests.test_shift`

Haejoon Lee created SPARK-46307: --- Summary: Enable `fill_value` tests for `GroupByTests.test_shift` Key: SPARK-46307 URL: https://issues.apache.org/jira/browse/SPARK-46307 Project: Spark Issue

[jira] [Updated] (SPARK-46305) Remove the special Zookeeper version in the `streaming-kafka-0-10` and `sql-kafka-0-10` modules

[ https://issues.apache.org/jira/browse/SPARK-46305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46305: --- Labels: pull-request-available (was: ) > Remove the special Zookeeper version in the

[jira] [Updated] (SPARK-46306) Fix `LocIndexer` to work properly when the key is missing

[ https://issues.apache.org/jira/browse/SPARK-46306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46306: --- Labels: pull-request-available (was: ) > Fix `LocIndexer` to work properly when the key is

[jira] [Updated] (SPARK-46306) Fix `LocIndexer` to work properly when the key is missing

[ https://issues.apache.org/jira/browse/SPARK-46306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46306: Summary: Fix `LocIndexer` to work properly when the key is missing (was: Fix `LocIndexer` work

[jira] [Created] (SPARK-46306) Fix `LocIndexer` work properly when the key is missing

Haejoon Lee created SPARK-46306: --- Summary: Fix `LocIndexer` work properly when the key is missing Key: SPARK-46306 URL: https://issues.apache.org/jira/browse/SPARK-46306 Project: Spark Issue

[jira] [Updated] (SPARK-46305) Remove the special Zookeeper version in the `streaming-kafka-0-10` and `sql-kafka-0-10` modules

[ https://issues.apache.org/jira/browse/SPARK-46305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-46305: - Component/s: Build (was: SQL) > Remove the special Zookeeper version in the

[jira] [Created] (SPARK-46305) Remove the special Zookeeper version in the `streaming-kafka-0-10` and `sql-kafka-0-10` modules

Yang Jie created SPARK-46305: Summary: Remove the special Zookeeper version in the `streaming-kafka-0-10` and `sql-kafka-0-10` modules Key: SPARK-46305 URL: https://issues.apache.org/jira/browse/SPARK-46305

[jira] [Updated] (SPARK-46293) Remove `protobuf` from required package.

[ https://issues.apache.org/jira/browse/SPARK-46293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46293: Description: (was: Add missing required package for docs.) > Remove `protobuf` from required

[jira] [Updated] (SPARK-46293) Remove `protobuf` from required package.

[ https://issues.apache.org/jira/browse/SPARK-46293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46293: Description: Remove `protobuf` from requirements.txt > Remove `protobuf` from required package. >

[jira] [Updated] (SPARK-46293) Remove `protobuf` from required package.

[ https://issues.apache.org/jira/browse/SPARK-46293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46293: Summary: Remove `protobuf` from required package. (was: Add protobuf to required dependency for

[jira] [Assigned] (SPARK-46302) Fix maven daily testing

[ https://issues.apache.org/jira/browse/SPARK-46302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46302: -- Assignee: Apache Spark > Fix maven daily testing > --- > >

[jira] [Assigned] (SPARK-46302) Fix maven daily testing

[ https://issues.apache.org/jira/browse/SPARK-46302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46302: -- Assignee: (was: Apache Spark) > Fix maven daily testing >

[jira] [Resolved] (SPARK-46301) Support `spark.worker.(initial|max)RegistrationRetries`

[ https://issues.apache.org/jira/browse/SPARK-46301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46301. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44229

[jira] [Resolved] (SPARK-46303) Remove unused code in `pyspark.pandas.tests.series.* `

[ https://issues.apache.org/jira/browse/SPARK-46303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-46303. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44232

[jira] [Updated] (SPARK-46304) Upgrade setup-java action to v4 and setup-python to v5

[ https://issues.apache.org/jira/browse/SPARK-46304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46304: Summary: Upgrade setup-java action to v4 and setup-python to v5 (was: Upgrade setup-java action

[jira] [Commented] (SPARK-46295) TPCDS q39a and a39b have correctness issues with broadcast hash join and shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-46295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17794081#comment-17794081 ] Kazuyuki Tanimura commented on SPARK-46295: --- I realized that I am using the default