[jira] [Updated] (SPARK-43620) Support `Column` for SparkConnectColumn.__getitem__

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43620: --- Labels: pull-request-available (was: ) > Support `Column` for SparkConnectColumn.__getitem_

[jira] [Created] (SPARK-45335) Correct the group of `ElementAt` and `TryElementAt`

2023-09-26 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-45335: - Summary: Correct the group of `ElementAt` and `TryElementAt` Key: SPARK-45335 URL: https://issues.apache.org/jira/browse/SPARK-45335 Project: Spark Issue T

[jira] [Updated] (SPARK-45335) Correct the group of `ElementAt` and `TryElementAt`

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45335: --- Labels: pull-request-available (was: ) > Correct the group of `ElementAt` and `TryElementAt

[jira] [Created] (SPARK-45336) Update the Oracle docker image version used for test and integration to use Oracle Database 23c Free

2023-09-26 Thread Luca Canali (Jira)
Luca Canali created SPARK-45336: --- Summary: Update the Oracle docker image version used for test and integration to use Oracle Database 23c Free Key: SPARK-45336 URL: https://issues.apache.org/jira/browse/SPARK-45336

[jira] [Updated] (SPARK-45336) Update the Oracle docker image version used for test and integration to use Oracle Database 23c Free

2023-09-26 Thread Luca Canali (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Canali updated SPARK-45336: Description: This proposes to update the Docker image used for integration tests and builds to Or

[jira] [Assigned] (SPARK-45310) Mapstatus location type changed from external shuffle service to executor after decommission migration

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45310: -- Assignee: Apache Spark > Mapstatus location type changed from external shuffle servic

[jira] [Assigned] (SPARK-45310) Mapstatus location type changed from external shuffle service to executor after decommission migration

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45310: -- Assignee: (was: Apache Spark) > Mapstatus location type changed from external shu

[jira] [Updated] (SPARK-45336) Update the Oracle docker image version used for test and integration to use Oracle Database 23c Free

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45336: --- Labels: pull-request-available (was: ) > Update the Oracle docker image version used for te

[jira] [Assigned] (SPARK-45321) Clean up the unnecessary Scala 2.12 related binary files.

2023-09-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-45321: Assignee: Yang Jie > Clean up the unnecessary Scala 2.12 related binary files. >

[jira] [Resolved] (SPARK-45321) Clean up the unnecessary Scala 2.12 related binary files.

2023-09-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45321. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43106 [https://github.com

[jira] [Created] (SPARK-45337) Refactor `AbstractCommandBuilder#getScalaVersion` to remove the check for Scala 2.12.

2023-09-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45337: Summary: Refactor `AbstractCommandBuilder#getScalaVersion` to remove the check for Scala 2.12. Key: SPARK-45337 URL: https://issues.apache.org/jira/browse/SPARK-45337 Projec

[jira] [Updated] (SPARK-45313) Inline `Iterators#size` and remove `Iterators.scala`

2023-09-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45313: - Parent: SPARK-45314 Issue Type: Sub-task (was: Improvement) > Inline `Iterators#size` and remov

[jira] [Created] (SPARK-45338) Remove scala.collection.JavaConverters

2023-09-26 Thread Jia Fan (Jira)
Jia Fan created SPARK-45338: --- Summary: Remove scala.collection.JavaConverters Key: SPARK-45338 URL: https://issues.apache.org/jira/browse/SPARK-45338 Project: Spark Issue Type: Sub-task C

[jira] [Updated] (SPARK-45337) Refactor `AbstractCommandBuilder#getScalaVersion` to remove the check for Scala 2.12.

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45337: --- Labels: pull-request-available (was: ) > Refactor `AbstractCommandBuilder#getScalaVersion`

[jira] [Updated] (SPARK-45338) Remove scala.collection.JavaConverters

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45338: --- Labels: pull-request-available (was: ) > Remove scala.collection.JavaConverters > -

[jira] [Assigned] (SPARK-45323) Upgrade snappy to 1.1.10.4

2023-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45323: Assignee: Bjørn Jørgensen > Upgrade snappy to 1.1.10.4 > -- > >

[jira] [Resolved] (SPARK-45323) Upgrade snappy to 1.1.10.4

2023-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45323. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43109 [https://gi

[jira] [Resolved] (SPARK-45309) Remove all SystemUtils.isJavaVersionAtLeast with JDK 9

2023-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45309. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43098 [https://gi

[jira] [Assigned] (SPARK-45309) Remove all SystemUtils.isJavaVersionAtLeast with JDK 9

2023-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45309: Assignee: Hyukjin Kwon > Remove all SystemUtils.isJavaVersionAtLeast with JDK 9 > ---

[jira] [Created] (SPARK-45339) Pyspark should log errors it retries

2023-09-26 Thread Alice Sayutina (Jira)
Alice Sayutina created SPARK-45339: -- Summary: Pyspark should log errors it retries Key: SPARK-45339 URL: https://issues.apache.org/jira/browse/SPARK-45339 Project: Spark Issue Type: Improvem

[jira] [Updated] (SPARK-45339) Pyspark should log errors it retries

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45339: --- Labels: pull-request-available (was: ) > Pyspark should log errors it retries > ---

[jira] [Assigned] (SPARK-45271) Merge _LEGACY_ERROR_TEMP_1113 into TABLE_OPERATION & delete some unused method in QueryCompilationErrors

2023-09-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45271: --- Assignee: BingKun Pan > Merge _LEGACY_ERROR_TEMP_1113 into TABLE_OPERATION & delete some un

[jira] [Resolved] (SPARK-45271) Merge _LEGACY_ERROR_TEMP_1113 into TABLE_OPERATION & delete some unused method in QueryCompilationErrors

2023-09-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45271. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43044 [https://gith

[jira] [Updated] (SPARK-43850) Cleanup unused imports related suppression rules for Scala 2.13

2023-09-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-43850: - Affects Version/s: 4.0.0 (was: 3.5.0) > Cleanup unused imports related suppre

[jira] [Updated] (SPARK-43850) Cleanup unused imports related suppression rules for Scala 2.13

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43850: --- Labels: pull-request-available (was: ) > Cleanup unused imports related suppression rules f

[jira] [Updated] (SPARK-43850) Remove the import for scala.language.higherKinds and delete the corresponding suppression rule

2023-09-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-43850: - Summary: Remove the import for scala.language.higherKinds and delete the corresponding suppression rule

[jira] [Updated] (SPARK-43850) Cleanup unused imports related suppression rules for Scala 2.13

2023-09-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-43850: - Parent: SPARK-45314 Issue Type: Sub-task (was: Improvement) > Cleanup unused imports related su

[jira] [Created] (SPARK-45340) Remove the SQL config spark.sql.hive.verifyPartitionPath

2023-09-26 Thread Max Gekk (Jira)
Max Gekk created SPARK-45340: Summary: Remove the SQL config spark.sql.hive.verifyPartitionPath Key: SPARK-45340 URL: https://issues.apache.org/jira/browse/SPARK-45340 Project: Spark Issue Type:

[jira] [Updated] (SPARK-45340) Remove the SQL config spark.sql.hive.verifyPartitionPath

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45340: --- Labels: pull-request-available (was: ) > Remove the SQL config spark.sql.hive.verifyPartiti

[jira] [Created] (SPARK-45341) Make the sbt doc command execute successfully with Java 17

2023-09-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45341: Summary: Make the sbt doc command execute successfully with Java 17 Key: SPARK-45341 URL: https://issues.apache.org/jira/browse/SPARK-45341 Project: Spark Issue Type

[jira] [Updated] (SPARK-45341) Make the sbt doc command execute successfully with Java 17

2023-09-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45341: - Description: {code:java} [error] /Users/yangjie01/SourceCode/git/spark-mine-sbt/Picked up JAVA_TOOL_OPT

[jira] [Updated] (SPARK-45341) Make the sbt doc command execute successfully with Java 17

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45341: --- Labels: pull-request-available (was: ) > Make the sbt doc command execute successfully with

[jira] [Created] (SPARK-45342) Remove the scala doc compilation option specific to Scala 2.12.

2023-09-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45342: Summary: Remove the scala doc compilation option specific to Scala 2.12. Key: SPARK-45342 URL: https://issues.apache.org/jira/browse/SPARK-45342 Project: Spark Issu

[jira] [Created] (SPARK-45343) CSV multiLine documentation is confusing

2023-09-26 Thread Bill Schneider (Jira)
Bill Schneider created SPARK-45343: -- Summary: CSV multiLine documentation is confusing Key: SPARK-45343 URL: https://issues.apache.org/jira/browse/SPARK-45343 Project: Spark Issue Type: Docu

[jira] [Resolved] (SPARK-45316) Respect `spark.sql.files.ignoreMissingFiles` in HadoopRDD

2023-09-26 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-45316. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43097 [https://github.com

[jira] [Commented] (SPARK-45343) CSV multiLine documentation is confusing

2023-09-26 Thread Bill Schneider (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17769236#comment-17769236 ] Bill Schneider commented on SPARK-45343: PR:https://github.com/apache/spark/pull

[jira] [Updated] (SPARK-45217) Support change log level of specific package or class

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45217: --- Labels: pull-request-available (was: ) > Support change log level of specific package or cl

[jira] [Created] (SPARK-45344) Remove all scala version string check

2023-09-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45344: Summary: Remove all scala version string check Key: SPARK-45344 URL: https://issues.apache.org/jira/browse/SPARK-45344 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-45345) Refactor release-build.sh

2023-09-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45345: Summary: Refactor release-build.sh Key: SPARK-45345 URL: https://issues.apache.org/jira/browse/SPARK-45345 Project: Spark Issue Type: Sub-task Components:

[jira] [Updated] (SPARK-45343) CSV multiLine documentation is confusing

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45343: --- Labels: pull-request-available (was: ) > CSV multiLine documentation is confusing > ---

[jira] [Updated] (SPARK-45343) CSV multiLine documentation is confusing

2023-09-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-45343: - Priority: Trivial (was: Major) > CSV multiLine documentation is confusing > ---

[jira] [Updated] (SPARK-45344) Remove all scala version string check

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45344: --- Labels: pull-request-available (was: ) > Remove all scala version string check > --

[jira] [Assigned] (SPARK-44756) Executor hangs when RetryingBlockTransferor fails to initiate retry

2023-09-26 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-44756: --- Assignee: Harunobu Daikoku > Executor hangs when RetryingBlockTransferor fa

[jira] [Resolved] (SPARK-44756) Executor hangs when RetryingBlockTransferor fails to initiate retry

2023-09-26 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-44756. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 424

[jira] [Assigned] (SPARK-44366) Migrate antlr4 from 4.9 to 4.10+

2023-09-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-44366: Assignee: Yang Jie > Migrate antlr4 from 4.9 to 4.10+ >

[jira] [Resolved] (SPARK-44366) Migrate antlr4 from 4.9 to 4.10+

2023-09-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-44366. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43075 [https://gi

[jira] [Commented] (SPARK-45345) Refactor release-build.sh

2023-09-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17769278#comment-17769278 ] Yang Jie commented on SPARK-45345: -- Currently, I'm not familiar enough with this, so I'

[jira] [Created] (SPARK-45346) Parquet schema inference should respect case sensitive flag when merging schema

2023-09-26 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-45346: --- Summary: Parquet schema inference should respect case sensitive flag when merging schema Key: SPARK-45346 URL: https://issues.apache.org/jira/browse/SPARK-45346 Project

[jira] [Updated] (SPARK-45346) Parquet schema inference should respect case sensitive flag when merging schema

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45346: --- Labels: pull-request-available (was: ) > Parquet schema inference should respect case sensi

[jira] [Updated] (SPARK-44034) Add a new test group for sql module

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44034: --- Labels: pull-request-available (was: ) > Add a new test group for sql module >

[jira] [Updated] (SPARK-44442) Drop mesos support

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-2: --- Labels: pull-request-available (was: ) > Drop mesos support > -- > >

[jira] [Commented] (SPARK-44940) Improve performance of JSON parsing when "spark.sql.json.enablePartialResults" is enabled

2023-09-26 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17769338#comment-17769338 ] Thomas Graves commented on SPARK-44940: ---  I noticed this went into 3.5.0  ([https

[jira] [Updated] (SPARK-44940) Improve performance of JSON parsing when "spark.sql.json.enablePartialResults" is enabled

2023-09-26 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-44940: -- Fix Version/s: 3.5.0 (was: 3.5.1) > Improve performance of JSON parsing

[jira] [Created] (SPARK-45347) Include SparkThrowable in FetchErrorDetailsResponse

2023-09-26 Thread Yihong He (Jira)
Yihong He created SPARK-45347: - Summary: Include SparkThrowable in FetchErrorDetailsResponse Key: SPARK-45347 URL: https://issues.apache.org/jira/browse/SPARK-45347 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-45347) Include SparkThrowable in FetchErrorDetailsResponse

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45347: --- Labels: pull-request-available (was: ) > Include SparkThrowable in FetchErrorDetailsRespons

[jira] [Assigned] (SPARK-45328) Remove Hive support prior to 2.0.0

2023-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45328: Assignee: Hyukjin Kwon > Remove Hive support prior to 2.0.0 > ---

[jira] [Resolved] (SPARK-45328) Remove Hive support prior to 2.0.0

2023-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45328. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43116 [https://gi

[jira] [Updated] (SPARK-43662) Enable ReshapeParityTests.test_merge_asof

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43662: --- Labels: pull-request-available (was: ) > Enable ReshapeParityTests.test_merge_asof > --

[jira] [Assigned] (SPARK-45339) Pyspark should log errors it retries

2023-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45339: Assignee: Alice Sayutina > Pyspark should log errors it retries > ---

[jira] [Resolved] (SPARK-45339) Pyspark should log errors it retries

2023-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45339. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43127 [https://gi

[jira] [Created] (SPARK-45348) Make the Maven build in GitHub Action check "javadoc:javadoc".

2023-09-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45348: Summary: Make the Maven build in GitHub Action check "javadoc:javadoc". Key: SPARK-45348 URL: https://issues.apache.org/jira/browse/SPARK-45348 Project: Spark Issue

[jira] [Commented] (SPARK-45282) Join loses records for cached datasets

2023-09-26 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17769383#comment-17769383 ] XiDuo You commented on SPARK-45282: --- I can not re-produce this issue in master branch

[jira] [Assigned] (SPARK-45302) Remove PID communication between Python workers when no demon is used

2023-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45302: Assignee: Hyukjin Kwon > Remove PID communication between Python workers when no demon is

[jira] [Resolved] (SPARK-45302) Remove PID communication between Python workers when no demon is used

2023-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45302. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43087 [https://gi

[jira] [Resolved] (SPARK-45334) Remove misleading comment in parquetSchemaConverter

2023-09-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-45334. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43119 [https://gi

[jira] [Assigned] (SPARK-45334) Remove misleading comment in parquetSchemaConverter

2023-09-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-45334: Assignee: Mengran Lan > Remove misleading comment in parquetSchemaConverter > ---

[jira] [Updated] (SPARK-44223) Drop leveldb support

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44223: --- Labels: pull-request-available (was: ) > Drop leveldb support > > >

[jira] [Updated] (SPARK-45348) Make the Maven build in GitHub Action check "javadoc:javadoc".

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45348: --- Labels: pull-request-available (was: ) > Make the Maven build in GitHub Action check "javad

[jira] [Created] (SPARK-45349) Backport SPARK-44034 and SPARK-44074 to branch-3.4/banch-3.3

2023-09-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45349: Summary: Backport SPARK-44034 and SPARK-44074 to branch-3.4/banch-3.3 Key: SPARK-45349 URL: https://issues.apache.org/jira/browse/SPARK-45349 Project: Spark Issue T

[jira] [Updated] (SPARK-45349) Backport SPARK-44034 and SPARK-44074 to branch-3.4/banch-3.3

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45349: --- Labels: pull-request-available (was: ) > Backport SPARK-44034 and SPARK-44074 to branch-3.4

[jira] [Assigned] (SPARK-43850) Remove the import for scala.language.higherKinds and delete the corresponding suppression rule

2023-09-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-43850: Assignee: Yang Jie > Remove the import for scala.language.higherKinds and delete the correspondin

[jira] [Resolved] (SPARK-43850) Remove the import for scala.language.higherKinds and delete the corresponding suppression rule

2023-09-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-43850. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43128 [https://github.com

[jira] [Updated] (SPARK-45338) Remove scala.collection.JavaConverters

2023-09-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45338: - Parent Issue: SPARK-45314 (was: SPARK-44111) > Remove scala.collection.JavaConverters > ---

[jira] [Updated] (SPARK-44780) Document SQL Session variables

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44780: --- Labels: pull-request-available (was: ) > Document SQL Session variables > -

[jira] [Resolved] (SPARK-44780) Document SQL Session variables

2023-09-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44780. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42467 [https://gith

[jira] [Assigned] (SPARK-44780) Document SQL Session variables

2023-09-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44780: --- Assignee: Serge Rielau > Document SQL Session variables > -- >

[jira] [Resolved] (SPARK-44681) Solve issue referencing github.com/apache/spark-connect-go as Go library

2023-09-26 Thread BoYang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BoYang resolved SPARK-44681. Fix Version/s: 3.4.0 Target Version/s: 3.5.0 Resolution: Fixed > Solve issue referencing

[jira] [Created] (SPARK-45350) Rename the imported Java Boolean to JBoolean

2023-09-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45350: Summary: Rename the imported Java Boolean to JBoolean Key: SPARK-45350 URL: https://issues.apache.org/jira/browse/SPARK-45350 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-45340) Remove the SQL config spark.sql.hive.verifyPartitionPath

2023-09-26 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-45340. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43130 [https://github.com

[jira] [Created] (SPARK-45351) Change RocksDB as default shuffle service db backend

2023-09-26 Thread Jia Fan (Jira)
Jia Fan created SPARK-45351: --- Summary: Change RocksDB as default shuffle service db backend Key: SPARK-45351 URL: https://issues.apache.org/jira/browse/SPARK-45351 Project: Spark Issue Type: Improv

[jira] [Updated] (SPARK-45351) Change RocksDB as default shuffle service db backend

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45351: --- Labels: pull-request-available (was: ) > Change RocksDB as default shuffle service db backe

[jira] [Resolved] (SPARK-45329) DataFrame methods avoid pandas conversion if possible

2023-09-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-45329. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43117 [https://

[jira] [Assigned] (SPARK-45329) DataFrame methods avoid pandas conversion if possible

2023-09-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-45329: - Assignee: Ruifeng Zheng > DataFrame methods avoid pandas conversion if possible > -

[jira] [Resolved] (SPARK-45335) Correct the group of `ElementAt` and `TryElementAt`

2023-09-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-45335. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43121 [https://

[jira] [Assigned] (SPARK-45335) Correct the group of `ElementAt` and `TryElementAt`

2023-09-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-45335: - Assignee: Ruifeng Zheng > Correct the group of `ElementAt` and `TryElementAt` > ---

[jira] [Resolved] (SPARK-45267) Change the default value for `numeric_only`.

2023-09-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-45267. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43043 [https://

[jira] [Assigned] (SPARK-45267) Change the default value for `numeric_only`.

2023-09-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-45267: - Assignee: Haejoon Lee > Change the default value for `numeric_only`. >

[jira] [Commented] (SPARK-45057) Deadlock caused by rdd replication level of 2

2023-09-26 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17769443#comment-17769443 ] wuyi commented on SPARK-45057: -- In the case of "Received UploadBlock request from T1 (block