[jira] [Updated] (SPARK-45351) Change RocksDB as default shuffle service db backend

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45351: --- Labels: pull-request-available (was: ) > Change RocksDB as default shuffle service db

[jira] [Created] (SPARK-45351) Change RocksDB as default shuffle service db backend

2023-09-26 Thread Jia Fan (Jira)
Jia Fan created SPARK-45351: --- Summary: Change RocksDB as default shuffle service db backend Key: SPARK-45351 URL: https://issues.apache.org/jira/browse/SPARK-45351 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-45340) Remove the SQL config spark.sql.hive.verifyPartitionPath

2023-09-26 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-45340. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43130

[jira] [Created] (SPARK-45350) Rename the imported Java Boolean to JBoolean

2023-09-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45350: Summary: Rename the imported Java Boolean to JBoolean Key: SPARK-45350 URL: https://issues.apache.org/jira/browse/SPARK-45350 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-44681) Solve issue referencing github.com/apache/spark-connect-go as Go library

2023-09-26 Thread BoYang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BoYang resolved SPARK-44681. Fix Version/s: 3.4.0 Target Version/s: 3.5.0 Resolution: Fixed > Solve issue referencing

[jira] [Resolved] (SPARK-44780) Document SQL Session variables

2023-09-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44780. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42467

[jira] [Assigned] (SPARK-44780) Document SQL Session variables

2023-09-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44780: --- Assignee: Serge Rielau > Document SQL Session variables > -- >

[jira] [Updated] (SPARK-44780) Document SQL Session variables

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44780: --- Labels: pull-request-available (was: ) > Document SQL Session variables >

[jira] [Updated] (SPARK-45338) Remove scala.collection.JavaConverters

2023-09-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45338: - Parent Issue: SPARK-45314 (was: SPARK-44111) > Remove scala.collection.JavaConverters >

[jira] [Resolved] (SPARK-43850) Remove the import for scala.language.higherKinds and delete the corresponding suppression rule

2023-09-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-43850. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43128

[jira] [Assigned] (SPARK-43850) Remove the import for scala.language.higherKinds and delete the corresponding suppression rule

2023-09-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-43850: Assignee: Yang Jie > Remove the import for scala.language.higherKinds and delete the

[jira] [Updated] (SPARK-45349) Backport SPARK-44034 and SPARK-44074 to branch-3.4/banch-3.3

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45349: --- Labels: pull-request-available (was: ) > Backport SPARK-44034 and SPARK-44074 to

[jira] [Created] (SPARK-45349) Backport SPARK-44034 and SPARK-44074 to branch-3.4/banch-3.3

2023-09-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45349: Summary: Backport SPARK-44034 and SPARK-44074 to branch-3.4/banch-3.3 Key: SPARK-45349 URL: https://issues.apache.org/jira/browse/SPARK-45349 Project: Spark Issue

[jira] [Updated] (SPARK-45348) Make the Maven build in GitHub Action check "javadoc:javadoc".

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45348: --- Labels: pull-request-available (was: ) > Make the Maven build in GitHub Action check

[jira] [Updated] (SPARK-44223) Drop leveldb support

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44223: --- Labels: pull-request-available (was: ) > Drop leveldb support > > >

[jira] [Assigned] (SPARK-45334) Remove misleading comment in parquetSchemaConverter

2023-09-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-45334: Assignee: Mengran Lan > Remove misleading comment in parquetSchemaConverter >

[jira] [Resolved] (SPARK-45334) Remove misleading comment in parquetSchemaConverter

2023-09-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-45334. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43119

[jira] [Resolved] (SPARK-45302) Remove PID communication between Python workers when no demon is used

2023-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45302. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43087

[jira] [Assigned] (SPARK-45302) Remove PID communication between Python workers when no demon is used

2023-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45302: Assignee: Hyukjin Kwon > Remove PID communication between Python workers when no demon

[jira] [Commented] (SPARK-45282) Join loses records for cached datasets

2023-09-26 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17769383#comment-17769383 ] XiDuo You commented on SPARK-45282: --- I can not re-produce this issue in master branch (4.0.0),

[jira] [Created] (SPARK-45348) Make the Maven build in GitHub Action check "javadoc:javadoc".

2023-09-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45348: Summary: Make the Maven build in GitHub Action check "javadoc:javadoc". Key: SPARK-45348 URL: https://issues.apache.org/jira/browse/SPARK-45348 Project: Spark

[jira] [Resolved] (SPARK-45339) Pyspark should log errors it retries

2023-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45339. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43127

[jira] [Assigned] (SPARK-45339) Pyspark should log errors it retries

2023-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45339: Assignee: Alice Sayutina > Pyspark should log errors it retries >

[jira] [Updated] (SPARK-43662) Enable ReshapeParityTests.test_merge_asof

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43662: --- Labels: pull-request-available (was: ) > Enable ReshapeParityTests.test_merge_asof >

[jira] [Assigned] (SPARK-45328) Remove Hive support prior to 2.0.0

2023-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45328: Assignee: Hyukjin Kwon > Remove Hive support prior to 2.0.0 >

[jira] [Resolved] (SPARK-45328) Remove Hive support prior to 2.0.0

2023-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45328. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43116

[jira] [Updated] (SPARK-45347) Include SparkThrowable in FetchErrorDetailsResponse

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45347: --- Labels: pull-request-available (was: ) > Include SparkThrowable in

[jira] [Created] (SPARK-45347) Include SparkThrowable in FetchErrorDetailsResponse

2023-09-26 Thread Yihong He (Jira)
Yihong He created SPARK-45347: - Summary: Include SparkThrowable in FetchErrorDetailsResponse Key: SPARK-45347 URL: https://issues.apache.org/jira/browse/SPARK-45347 Project: Spark Issue Type:

[jira] [Updated] (SPARK-44940) Improve performance of JSON parsing when "spark.sql.json.enablePartialResults" is enabled

2023-09-26 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-44940: -- Fix Version/s: 3.5.0 (was: 3.5.1) > Improve performance of JSON

[jira] [Commented] (SPARK-44940) Improve performance of JSON parsing when "spark.sql.json.enablePartialResults" is enabled

2023-09-26 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17769338#comment-17769338 ] Thomas Graves commented on SPARK-44940: ---  I noticed this went into 3.5.0 

[jira] [Updated] (SPARK-44442) Drop mesos support

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-2: --- Labels: pull-request-available (was: ) > Drop mesos support > -- > >

[jira] [Updated] (SPARK-44034) Add a new test group for sql module

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44034: --- Labels: pull-request-available (was: ) > Add a new test group for sql module >

[jira] [Updated] (SPARK-45346) Parquet schema inference should respect case sensitive flag when merging schema

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45346: --- Labels: pull-request-available (was: ) > Parquet schema inference should respect case

[jira] [Created] (SPARK-45346) Parquet schema inference should respect case sensitive flag when merging schema

2023-09-26 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-45346: --- Summary: Parquet schema inference should respect case sensitive flag when merging schema Key: SPARK-45346 URL: https://issues.apache.org/jira/browse/SPARK-45346

[jira] [Commented] (SPARK-45345) Refactor release-build.sh

2023-09-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17769278#comment-17769278 ] Yang Jie commented on SPARK-45345: -- Currently, I'm not familiar enough with this, so I'm not sure if

[jira] [Resolved] (SPARK-44366) Migrate antlr4 from 4.9 to 4.10+

2023-09-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-44366. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43075

[jira] [Assigned] (SPARK-44366) Migrate antlr4 from 4.9 to 4.10+

2023-09-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-44366: Assignee: Yang Jie > Migrate antlr4 from 4.9 to 4.10+ >

[jira] [Resolved] (SPARK-44756) Executor hangs when RetryingBlockTransferor fails to initiate retry

2023-09-26 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-44756. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-44756) Executor hangs when RetryingBlockTransferor fails to initiate retry

2023-09-26 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-44756: --- Assignee: Harunobu Daikoku > Executor hangs when RetryingBlockTransferor

[jira] [Updated] (SPARK-45344) Remove all scala version string check

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45344: --- Labels: pull-request-available (was: ) > Remove all scala version string check >

[jira] [Updated] (SPARK-45343) CSV multiLine documentation is confusing

2023-09-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-45343: - Priority: Trivial (was: Major) > CSV multiLine documentation is confusing >

[jira] [Updated] (SPARK-45343) CSV multiLine documentation is confusing

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45343: --- Labels: pull-request-available (was: ) > CSV multiLine documentation is confusing >

[jira] [Created] (SPARK-45345) Refactor release-build.sh

2023-09-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45345: Summary: Refactor release-build.sh Key: SPARK-45345 URL: https://issues.apache.org/jira/browse/SPARK-45345 Project: Spark Issue Type: Sub-task Components:

[jira] [Created] (SPARK-45344) Remove all scala version string check

2023-09-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45344: Summary: Remove all scala version string check Key: SPARK-45344 URL: https://issues.apache.org/jira/browse/SPARK-45344 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-45217) Support change log level of specific package or class

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45217: --- Labels: pull-request-available (was: ) > Support change log level of specific package or

[jira] [Commented] (SPARK-45343) CSV multiLine documentation is confusing

2023-09-26 Thread Bill Schneider (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17769236#comment-17769236 ] Bill Schneider commented on SPARK-45343: PR:https://github.com/apache/spark/pull/43132 > CSV

[jira] [Resolved] (SPARK-45316) Respect `spark.sql.files.ignoreMissingFiles` in HadoopRDD

2023-09-26 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-45316. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43097

[jira] [Created] (SPARK-45343) CSV multiLine documentation is confusing

2023-09-26 Thread Bill Schneider (Jira)
Bill Schneider created SPARK-45343: -- Summary: CSV multiLine documentation is confusing Key: SPARK-45343 URL: https://issues.apache.org/jira/browse/SPARK-45343 Project: Spark Issue Type:

[jira] [Created] (SPARK-45342) Remove the scala doc compilation option specific to Scala 2.12.

2023-09-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45342: Summary: Remove the scala doc compilation option specific to Scala 2.12. Key: SPARK-45342 URL: https://issues.apache.org/jira/browse/SPARK-45342 Project: Spark

[jira] [Updated] (SPARK-45341) Make the sbt doc command execute successfully with Java 17

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45341: --- Labels: pull-request-available (was: ) > Make the sbt doc command execute successfully

[jira] [Updated] (SPARK-45341) Make the sbt doc command execute successfully with Java 17

2023-09-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45341: - Description: {code:java} [error] /Users/yangjie01/SourceCode/git/spark-mine-sbt/Picked up

[jira] [Created] (SPARK-45341) Make the sbt doc command execute successfully with Java 17

2023-09-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45341: Summary: Make the sbt doc command execute successfully with Java 17 Key: SPARK-45341 URL: https://issues.apache.org/jira/browse/SPARK-45341 Project: Spark Issue

[jira] [Updated] (SPARK-45340) Remove the SQL config spark.sql.hive.verifyPartitionPath

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45340: --- Labels: pull-request-available (was: ) > Remove the SQL config

[jira] [Created] (SPARK-45340) Remove the SQL config spark.sql.hive.verifyPartitionPath

2023-09-26 Thread Max Gekk (Jira)
Max Gekk created SPARK-45340: Summary: Remove the SQL config spark.sql.hive.verifyPartitionPath Key: SPARK-45340 URL: https://issues.apache.org/jira/browse/SPARK-45340 Project: Spark Issue Type:

[jira] [Updated] (SPARK-43850) Cleanup unused imports related suppression rules for Scala 2.13

2023-09-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-43850: - Parent: SPARK-45314 Issue Type: Sub-task (was: Improvement) > Cleanup unused imports related

[jira] [Updated] (SPARK-43850) Remove the import for scala.language.higherKinds and delete the corresponding suppression rule

2023-09-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-43850: - Summary: Remove the import for scala.language.higherKinds and delete the corresponding suppression rule

[jira] [Updated] (SPARK-43850) Cleanup unused imports related suppression rules for Scala 2.13

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43850: --- Labels: pull-request-available (was: ) > Cleanup unused imports related suppression rules

[jira] [Updated] (SPARK-43850) Cleanup unused imports related suppression rules for Scala 2.13

2023-09-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-43850: - Affects Version/s: 4.0.0 (was: 3.5.0) > Cleanup unused imports related

[jira] [Assigned] (SPARK-45271) Merge _LEGACY_ERROR_TEMP_1113 into TABLE_OPERATION & delete some unused method in QueryCompilationErrors

2023-09-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45271: --- Assignee: BingKun Pan > Merge _LEGACY_ERROR_TEMP_1113 into TABLE_OPERATION & delete some

[jira] [Resolved] (SPARK-45271) Merge _LEGACY_ERROR_TEMP_1113 into TABLE_OPERATION & delete some unused method in QueryCompilationErrors

2023-09-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45271. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43044

[jira] [Updated] (SPARK-45339) Pyspark should log errors it retries

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45339: --- Labels: pull-request-available (was: ) > Pyspark should log errors it retries >

[jira] [Created] (SPARK-45339) Pyspark should log errors it retries

2023-09-26 Thread Alice Sayutina (Jira)
Alice Sayutina created SPARK-45339: -- Summary: Pyspark should log errors it retries Key: SPARK-45339 URL: https://issues.apache.org/jira/browse/SPARK-45339 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-45309) Remove all SystemUtils.isJavaVersionAtLeast with JDK 9

2023-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45309: Assignee: Hyukjin Kwon > Remove all SystemUtils.isJavaVersionAtLeast with JDK 9 >

[jira] [Resolved] (SPARK-45309) Remove all SystemUtils.isJavaVersionAtLeast with JDK 9

2023-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45309. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43098

[jira] [Resolved] (SPARK-45323) Upgrade snappy to 1.1.10.4

2023-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45323. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43109

[jira] [Assigned] (SPARK-45323) Upgrade snappy to 1.1.10.4

2023-09-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45323: Assignee: Bjørn Jørgensen > Upgrade snappy to 1.1.10.4 > -- > >

[jira] [Updated] (SPARK-45338) Remove scala.collection.JavaConverters

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45338: --- Labels: pull-request-available (was: ) > Remove scala.collection.JavaConverters >

[jira] [Updated] (SPARK-45337) Refactor `AbstractCommandBuilder#getScalaVersion` to remove the check for Scala 2.12.

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45337: --- Labels: pull-request-available (was: ) > Refactor `AbstractCommandBuilder#getScalaVersion`

[jira] [Created] (SPARK-45338) Remove scala.collection.JavaConverters

2023-09-26 Thread Jia Fan (Jira)
Jia Fan created SPARK-45338: --- Summary: Remove scala.collection.JavaConverters Key: SPARK-45338 URL: https://issues.apache.org/jira/browse/SPARK-45338 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-45313) Inline `Iterators#size` and remove `Iterators.scala`

2023-09-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45313: - Parent: SPARK-45314 Issue Type: Sub-task (was: Improvement) > Inline `Iterators#size` and

[jira] [Created] (SPARK-45337) Refactor `AbstractCommandBuilder#getScalaVersion` to remove the check for Scala 2.12.

2023-09-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-45337: Summary: Refactor `AbstractCommandBuilder#getScalaVersion` to remove the check for Scala 2.12. Key: SPARK-45337 URL: https://issues.apache.org/jira/browse/SPARK-45337

[jira] [Resolved] (SPARK-45321) Clean up the unnecessary Scala 2.12 related binary files.

2023-09-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45321. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43106

[jira] [Assigned] (SPARK-45321) Clean up the unnecessary Scala 2.12 related binary files.

2023-09-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-45321: Assignee: Yang Jie > Clean up the unnecessary Scala 2.12 related binary files. >

[jira] [Updated] (SPARK-45336) Update the Oracle docker image version used for test and integration to use Oracle Database 23c Free

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45336: --- Labels: pull-request-available (was: ) > Update the Oracle docker image version used for

[jira] [Assigned] (SPARK-45310) Mapstatus location type changed from external shuffle service to executor after decommission migration

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45310: -- Assignee: (was: Apache Spark) > Mapstatus location type changed from external

[jira] [Assigned] (SPARK-45310) Mapstatus location type changed from external shuffle service to executor after decommission migration

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45310: -- Assignee: Apache Spark > Mapstatus location type changed from external shuffle

[jira] [Updated] (SPARK-45336) Update the Oracle docker image version used for test and integration to use Oracle Database 23c Free

2023-09-26 Thread Luca Canali (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Canali updated SPARK-45336: Description: This proposes to update the Docker image used for integration tests and builds to

[jira] [Created] (SPARK-45336) Update the Oracle docker image version used for test and integration to use Oracle Database 23c Free

2023-09-26 Thread Luca Canali (Jira)
Luca Canali created SPARK-45336: --- Summary: Update the Oracle docker image version used for test and integration to use Oracle Database 23c Free Key: SPARK-45336 URL:

[jira] [Updated] (SPARK-45335) Correct the group of `ElementAt` and `TryElementAt`

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45335: --- Labels: pull-request-available (was: ) > Correct the group of `ElementAt` and

[jira] [Created] (SPARK-45335) Correct the group of `ElementAt` and `TryElementAt`

2023-09-26 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-45335: - Summary: Correct the group of `ElementAt` and `TryElementAt` Key: SPARK-45335 URL: https://issues.apache.org/jira/browse/SPARK-45335 Project: Spark Issue

[jira] [Updated] (SPARK-43620) Support `Column` for SparkConnectColumn.__getitem__

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43620: --- Labels: pull-request-available (was: ) > Support `Column` for

[jira] [Updated] (SPARK-45334) Remove misleading comment in parquetSchemaConverter

2023-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45334: --- Labels: pull-request-available (was: ) > Remove misleading comment in

[jira] [Created] (SPARK-45334) Remove misleading comment in parquetSchemaConverter

2023-09-26 Thread Mengran Lan (Jira)
Mengran Lan created SPARK-45334: --- Summary: Remove misleading comment in parquetSchemaConverter Key: SPARK-45334 URL: https://issues.apache.org/jira/browse/SPARK-45334 Project: Spark Issue

[jira] [Assigned] (SPARK-45232) Add missing function groups to SQL references

2023-09-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-45232: - Assignee: Ruifeng Zheng > Add missing function groups to SQL references >

[jira] [Resolved] (SPARK-45232) Add missing function groups to SQL references

2023-09-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-45232. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43011