[jira] [Created] (SPARK-45368) Remove scala2.12 compatibility logic for DoubleType, FloatType, Decimal

BingKun Pan created SPARK-45368: --- Summary: Remove scala2.12 compatibility logic for DoubleType, FloatType, Decimal Key: SPARK-45368 URL: https://issues.apache.org/jira/browse/SPARK-45368 Project: Spark

[jira] [Updated] (SPARK-45366) Remove productHash from TreeNode

[ https://issues.apache.org/jira/browse/SPARK-45366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45366: --- Labels: pull-request-available (was: ) > Remove productHash from TreeNode >

[jira] [Created] (SPARK-45367) Add errorclass and sqlstate for: _LEGACY_ERROR_TEMP_1273

Serge Rielau created SPARK-45367: Summary: Add errorclass and sqlstate for: _LEGACY_ERROR_TEMP_1273 Key: SPARK-45367 URL: https://issues.apache.org/jira/browse/SPARK-45367 Project: Spark

[jira] [Comment Edited] (SPARK-45282) Join loses records for cached datasets

[ https://issues.apache.org/jira/browse/SPARK-45282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17769893#comment-17769893 ] koert kuipers edited comment on SPARK-45282 at 9/28/23 4:07 AM: yes i

[jira] [Comment Edited] (SPARK-45282) Join loses records for cached datasets

[ https://issues.apache.org/jira/browse/SPARK-45282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17769893#comment-17769893 ] koert kuipers edited comment on SPARK-45282 at 9/28/23 4:06 AM: yes i

[jira] [Commented] (SPARK-45282) Join loses records for cached datasets

[ https://issues.apache.org/jira/browse/SPARK-45282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17769893#comment-17769893 ] koert kuipers commented on SPARK-45282: --- yes i can reproduce it. master branch on commit:  

[jira] [Updated] (SPARK-45361) Describe characters unescaping in string literals

[ https://issues.apache.org/jira/browse/SPARK-45361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45361: --- Labels: pull-request-available (was: ) > Describe characters unescaping in string literals

[jira] [Commented] (SPARK-33458) Hive partition pruning support Contains, StartsWith and EndsWith predicate

[ https://issues.apache.org/jira/browse/SPARK-33458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17769889#comment-17769889 ] dzcxzl commented on SPARK-33458: After [HIVE-22900|https://issues.apache.org/jira/browse/HIVE-22900]

[jira] [Resolved] (SPARK-45344) Remove all scala version string check

[ https://issues.apache.org/jira/browse/SPARK-45344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45344. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43133

[jira] [Assigned] (SPARK-45344) Remove all scala version string check

[ https://issues.apache.org/jira/browse/SPARK-45344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-45344: Assignee: Yang Jie > Remove all scala version string check >

[jira] [Resolved] (SPARK-45353) Refine docstring of `create_map/slice/array_join`

[ https://issues.apache.org/jira/browse/SPARK-45353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45353. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43145

[jira] [Assigned] (SPARK-45353) Refine docstring of `create_map/slice/array_join`

[ https://issues.apache.org/jira/browse/SPARK-45353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-45353: Assignee: Yang Jie > Refine docstring of `create_map/slice/array_join` >

[jira] [Resolved] (SPARK-45342) Remove the scala doc compilation option specific to Scala 2.12.

[ https://issues.apache.org/jira/browse/SPARK-45342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45342. -- Resolution: Duplicate > Remove the scala doc compilation option specific to Scala 2.12. >

[jira] [Updated] (SPARK-45364) Clean up the unnecessary Scala 2.12 logical in SparkBuild

[ https://issues.apache.org/jira/browse/SPARK-45364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45364: - Parent: SPARK-45314 Issue Type: Sub-task (was: Improvement) > Clean up the unnecessary Scala

[jira] [Updated] (SPARK-45342) Remove the scala doc compilation option specific to Scala 2.12.

[ https://issues.apache.org/jira/browse/SPARK-45342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45342: --- Labels: pull-request-available (was: ) > Remove the scala doc compilation option specific

[jira] [Created] (SPARK-45366) Remove productHash from TreeNode

BingKun Pan created SPARK-45366: --- Summary: Remove productHash from TreeNode Key: SPARK-45366 URL: https://issues.apache.org/jira/browse/SPARK-45366 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-45365) Allow the daily tests of branch-3.4 to use the new test group tags

[ https://issues.apache.org/jira/browse/SPARK-45365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45365: --- Labels: pull-request-available (was: ) > Allow the daily tests of branch-3.4 to use the

[jira] [Assigned] (SPARK-44442) Drop mesos support

[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-2: Assignee: Sean R. Owen > Drop mesos support > -- > >

[jira] [Updated] (SPARK-45364) Clean up the unnecessary Scala 2.12 logical in SparkBuild

[ https://issues.apache.org/jira/browse/SPARK-45364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45364: --- Labels: pull-request-available (was: ) > Clean up the unnecessary Scala 2.12 logical in

[jira] [Resolved] (SPARK-44442) Drop mesos support

[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-2. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43135

[jira] [Created] (SPARK-45365) Allow the daily tests of branch-3.4 to use the new test group tags

Yang Jie created SPARK-45365: Summary: Allow the daily tests of branch-3.4 to use the new test group tags Key: SPARK-45365 URL: https://issues.apache.org/jira/browse/SPARK-45365 Project: Spark

[jira] [Updated] (SPARK-44074) `Logging plan changes for execution` test failed

[ https://issues.apache.org/jira/browse/SPARK-44074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44074: --- Labels: pull-request-available (was: ) > `Logging plan changes for execution` test failed

[jira] [Created] (SPARK-45364) Clean up the unnecessary Scala 2.12 logical in SparkBuild

BingKun Pan created SPARK-45364: --- Summary: Clean up the unnecessary Scala 2.12 logical in SparkBuild Key: SPARK-45364 URL: https://issues.apache.org/jira/browse/SPARK-45364 Project: Spark

[jira] [Updated] (SPARK-43801) Support unwrap date type to string type in UnwrapCastInBinaryComparison

[ https://issues.apache.org/jira/browse/SPARK-43801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43801: --- Labels: pull-request-available (was: ) > Support unwrap date type to string type in

[jira] [Updated] (SPARK-38230) InsertIntoHadoopFsRelationCommand unnecessarily fetches details of partitions in most cases

[ https://issues.apache.org/jira/browse/SPARK-38230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-38230: --- Labels: pull-request-available (was: ) > InsertIntoHadoopFsRelationCommand unnecessarily

[jira] [Created] (SPARK-45363) Avro connector should use new error class framework

Neil Ramaswamy created SPARK-45363: -- Summary: Avro connector should use new error class framework Key: SPARK-45363 URL: https://issues.apache.org/jira/browse/SPARK-45363 Project: Spark

[jira] [Resolved] (SPARK-45354) Resolve functions bottom-up

[ https://issues.apache.org/jira/browse/SPARK-45354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth resolved SPARK-45354. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43146

[jira] [Assigned] (SPARK-45354) Resolve functions bottom-up

[ https://issues.apache.org/jira/browse/SPARK-45354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth reassigned SPARK-45354: -- Assignee: Peter Toth > Resolve functions bottom-up > --- > >

[jira] [Updated] (SPARK-45362) Project out PARTITION BY expressions before 'eval' method consumes input rows

[ https://issues.apache.org/jira/browse/SPARK-45362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45362: --- Labels: pull-request-available (was: ) > Project out PARTITION BY expressions before

[jira] [Created] (SPARK-45362) Project out PARTITION BY expressions before 'eval' method consumes input rows

Daniel created SPARK-45362: -- Summary: Project out PARTITION BY expressions before 'eval' method consumes input rows Key: SPARK-45362 URL: https://issues.apache.org/jira/browse/SPARK-45362 Project: Spark

[jira] [Created] (SPARK-45361) Describe characters unescaping in string literals

Max Gekk created SPARK-45361: Summary: Describe characters unescaping in string literals Key: SPARK-45361 URL: https://issues.apache.org/jira/browse/SPARK-45361 Project: Spark Issue Type:

[jira] [Updated] (SPARK-45357) Maven test `SparkConnectProtoSuite` failed

[ https://issues.apache.org/jira/browse/SPARK-45357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45357: --- Labels: pull-request-available (was: ) > Maven test `SparkConnectProtoSuite` failed >

[jira] [Assigned] (SPARK-44838) Enhance raise_error() to exploit the new error framework

[ https://issues.apache.org/jira/browse/SPARK-44838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-44838: -- Assignee: Serge Rielau > Enhance raise_error() to exploit the new error framework >

[jira] [Resolved] (SPARK-44838) Enhance raise_error() to exploit the new error framework

[ https://issues.apache.org/jira/browse/SPARK-44838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-44838. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42985

[jira] [Updated] (SPARK-44539) Upgrade RoaringBitmap to 1.0.0

[ https://issues.apache.org/jira/browse/SPARK-44539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-44539: - Priority: Minor (was: Trivial) > Upgrade RoaringBitmap to 1.0.0 >

[jira] [Assigned] (SPARK-44539) Upgrade RoaringBitmap to 1.0.0

[ https://issues.apache.org/jira/browse/SPARK-44539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-44539: Assignee: BingKun Pan > Upgrade RoaringBitmap to 1.0.0 >

[jira] [Resolved] (SPARK-44539) Upgrade RoaringBitmap to 1.0.0

[ https://issues.apache.org/jira/browse/SPARK-44539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-44539. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42143

[jira] [Updated] (SPARK-45360) Initialize spark session builder configuration from SPARK_REMOTE

[ https://issues.apache.org/jira/browse/SPARK-45360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45360: --- Labels: pull-request-available (was: ) > Initialize spark session builder configuration

[jira] [Created] (SPARK-45360) Initialize spark session builder configuration from SPARK_REMOTE

Yihong He created SPARK-45360: - Summary: Initialize spark session builder configuration from SPARK_REMOTE Key: SPARK-45360 URL: https://issues.apache.org/jira/browse/SPARK-45360 Project: Spark

[jira] [Updated] (SPARK-45242) Use DataFrame ID to semantically validate CollectMetrics

[ https://issues.apache.org/jira/browse/SPARK-45242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45242: --- Labels: pull-request-available (was: ) > Use DataFrame ID to semantically validate

[jira] [Updated] (SPARK-45357) Maven test `SparkConnectProtoSuite` failed

[ https://issues.apache.org/jira/browse/SPARK-45357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45357: - Description:   build/mvn clean install -pl connector/connect/server -am -DskipTests mvn test -pl

[jira] [Updated] (SPARK-45358) Remove shim classes for Hive prior 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-45358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45358: --- Labels: pull-request-available (was: ) > Remove shim classes for Hive prior 2.0.0 >

[jira] [Updated] (SPARK-45354) Resolve functions bottom-up

[ https://issues.apache.org/jira/browse/SPARK-45354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-45354: --- Description: This PR proposes bottum-up resolution in  {{{}ResolveFunctions{}}}, which is much

[jira] [Assigned] (SPARK-45343) CSV multiLine documentation is confusing

[ https://issues.apache.org/jira/browse/SPARK-45343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-45343: Assignee: Bill Schneider > CSV multiLine documentation is confusing >

[jira] [Resolved] (SPARK-45343) CSV multiLine documentation is confusing

[ https://issues.apache.org/jira/browse/SPARK-45343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-45343. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43132

[jira] [Assigned] (SPARK-44170) Migrating Junit4 to Junit5

[ https://issues.apache.org/jira/browse/SPARK-44170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-44170: Assignee: Yang Jie > Migrating Junit4 to Junit5 > -- > >

[jira] [Resolved] (SPARK-44170) Migrating Junit4 to Junit5

[ https://issues.apache.org/jira/browse/SPARK-44170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-44170. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43074

[jira] [Assigned] (SPARK-45338) Remove scala.collection.JavaConverters

[ https://issues.apache.org/jira/browse/SPARK-45338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-45338: Assignee: Jia Fan > Remove scala.collection.JavaConverters >

[jira] [Resolved] (SPARK-45338) Remove scala.collection.JavaConverters

[ https://issues.apache.org/jira/browse/SPARK-45338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-45338. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43126

[jira] [Updated] (SPARK-45341) Make the sbt doc command execute successfully with Java 17

[ https://issues.apache.org/jira/browse/SPARK-45341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-45341: - Priority: Minor (was: Major) > Make the sbt doc command execute successfully with Java 17 >

[jira] [Resolved] (SPARK-45341) Make the sbt doc command execute successfully with Java 17

[ https://issues.apache.org/jira/browse/SPARK-45341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-45341. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43131

[jira] [Assigned] (SPARK-45341) Make the sbt doc command execute successfully with Java 17

[ https://issues.apache.org/jira/browse/SPARK-45341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-45341: Assignee: Yang Jie > Make the sbt doc command execute successfully with Java 17 >

[jira] [Updated] (SPARK-45359) DataFrame.{columns, colRegex, explain} should raise exceptions when plan is invalid

[ https://issues.apache.org/jira/browse/SPARK-45359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45359: --- Labels: pull-request-available (was: ) > DataFrame.{columns, colRegex, explain} should

[jira] [Created] (SPARK-45359) DataFrame.{columns, colRegex, explain} should raise exceptions when plan is invalid

Ruifeng Zheng created SPARK-45359: - Summary: DataFrame.{columns, colRegex, explain} should raise exceptions when plan is invalid Key: SPARK-45359 URL: https://issues.apache.org/jira/browse/SPARK-45359

[jira] [Created] (SPARK-45358) Remove shim classes for Hive prior 2.0.0

Cheng Pan created SPARK-45358: - Summary: Remove shim classes for Hive prior 2.0.0 Key: SPARK-45358 URL: https://issues.apache.org/jira/browse/SPARK-45358 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-45357) Maven test `SparkConnectProtoSuite` failed

Yang Jie created SPARK-45357: Summary: Maven test `SparkConnectProtoSuite` failed Key: SPARK-45357 URL: https://issues.apache.org/jira/browse/SPARK-45357 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-45356) Optimize the Maven daily test configuration

[ https://issues.apache.org/jira/browse/SPARK-45356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45356: - Summary: Optimize the Maven daily test configuration (was: Sync Python dependencies installation for

[jira] [Commented] (SPARK-31622) Test-jar in the Spark distribution

[ https://issues.apache.org/jira/browse/SPARK-31622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17769558#comment-17769558 ] Arseniy Tashoyan commented on SPARK-31622: -- In Spark 3.4.1 there are no test jars in the

[jira] [Updated] (SPARK-45356) Sync Python dependencies installation for Maven daily test

[ https://issues.apache.org/jira/browse/SPARK-45356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45356: --- Labels: pull-request-available (was: ) > Sync Python dependencies installation for Maven

[jira] [Created] (SPARK-45356) Sync Python dependencies installation for Maven daily test

Yang Jie created SPARK-45356: Summary: Sync Python dependencies installation for Maven daily test Key: SPARK-45356 URL: https://issues.apache.org/jira/browse/SPARK-45356 Project: Spark Issue

[jira] [Created] (SPARK-45355) Fix function groups in Scala Doc

Ruifeng Zheng created SPARK-45355: - Summary: Fix function groups in Scala Doc Key: SPARK-45355 URL: https://issues.apache.org/jira/browse/SPARK-45355 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-45337) Refactor `AbstractCommandBuilder#getScalaVersion` to remove the check for Scala 2.12.

[ https://issues.apache.org/jira/browse/SPARK-45337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45337. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43125

[jira] [Assigned] (SPARK-45337) Refactor `AbstractCommandBuilder#getScalaVersion` to remove the check for Scala 2.12.

[ https://issues.apache.org/jira/browse/SPARK-45337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-45337: Assignee: Yang Jie > Refactor `AbstractCommandBuilder#getScalaVersion` to remove the check for

[jira] [Updated] (SPARK-45354) Resolve functions bottom-up

[ https://issues.apache.org/jira/browse/SPARK-45354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45354: --- Labels: pull-request-available (was: ) > Resolve functions bottom-up >

[jira] [Created] (SPARK-45354) Resolve functions bottom-up

Peter Toth created SPARK-45354: -- Summary: Resolve functions bottom-up Key: SPARK-45354 URL: https://issues.apache.org/jira/browse/SPARK-45354 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-45353) Refine docstring of `create_map/slice/array_join`

[ https://issues.apache.org/jira/browse/SPARK-45353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45353: --- Labels: pull-request-available (was: ) > Refine docstring of `create_map/slice/array_join`

[jira] [Created] (SPARK-45353) Refine docstring of `create_map/slice/array_join`

Yang Jie created SPARK-45353: Summary: Refine docstring of `create_map/slice/array_join` Key: SPARK-45353 URL: https://issues.apache.org/jira/browse/SPARK-45353 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-45338) Remove scala.collection.JavaConverters

[ https://issues.apache.org/jira/browse/SPARK-45338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45338: -- Assignee: Apache Spark > Remove scala.collection.JavaConverters >

[jira] [Assigned] (SPARK-45338) Remove scala.collection.JavaConverters

[ https://issues.apache.org/jira/browse/SPARK-45338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45338: -- Assignee: (was: Apache Spark) > Remove scala.collection.JavaConverters >

[jira] [Resolved] (SPARK-44101) Support pandas 2

[ https://issues.apache.org/jira/browse/SPARK-44101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-44101. - Resolution: Fixed > Support pandas 2 > > > Key: SPARK-44101 >

[jira] [Assigned] (SPARK-45338) Remove scala.collection.JavaConverters

[ https://issues.apache.org/jira/browse/SPARK-45338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45338: -- Assignee: (was: Apache Spark) > Remove scala.collection.JavaConverters >

[jira] [Assigned] (SPARK-45338) Remove scala.collection.JavaConverters

[ https://issues.apache.org/jira/browse/SPARK-45338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45338: -- Assignee: Apache Spark > Remove scala.collection.JavaConverters >

[jira] [Assigned] (SPARK-45338) Remove scala.collection.JavaConverters

[ https://issues.apache.org/jira/browse/SPARK-45338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45338: -- Assignee: Apache Spark > Remove scala.collection.JavaConverters >

[jira] [Assigned] (SPARK-45338) Remove scala.collection.JavaConverters

[ https://issues.apache.org/jira/browse/SPARK-45338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45338: -- Assignee: (was: Apache Spark) > Remove scala.collection.JavaConverters >

[jira] [Assigned] (SPARK-45338) Remove scala.collection.JavaConverters

[ https://issues.apache.org/jira/browse/SPARK-45338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45338: -- Assignee: Apache Spark > Remove scala.collection.JavaConverters >

[jira] [Assigned] (SPARK-45338) Remove scala.collection.JavaConverters

[ https://issues.apache.org/jira/browse/SPARK-45338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45338: -- Assignee: (was: Apache Spark) > Remove scala.collection.JavaConverters >

[jira] [Assigned] (SPARK-45351) Change RocksDB as default shuffle service db backend

[ https://issues.apache.org/jira/browse/SPARK-45351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45351: -- Assignee: (was: Apache Spark) > Change RocksDB as default shuffle service db

[jira] [Assigned] (SPARK-45351) Change RocksDB as default shuffle service db backend

[ https://issues.apache.org/jira/browse/SPARK-45351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45351: -- Assignee: Apache Spark > Change RocksDB as default shuffle service db backend >

[jira] [Updated] (SPARK-45352) Remove window partition if partition expression are foldable

[ https://issues.apache.org/jira/browse/SPARK-45352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuml updated SPARK-45352: -- Priority: Major (was: Minor) > Remove window partition if partition expression are foldable >

[jira] [Updated] (SPARK-45352) Remove window partition if partition expression are foldable

[ https://issues.apache.org/jira/browse/SPARK-45352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuml updated SPARK-45352: -- Description: Foldable partition is redundant, remove it not only can simplify plan, but some rules can also

[jira] [Assigned] (SPARK-45341) Make the sbt doc command execute successfully with Java 17

[ https://issues.apache.org/jira/browse/SPARK-45341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45341: -- Assignee: Apache Spark > Make the sbt doc command execute successfully with Java 17

[jira] [Assigned] (SPARK-45341) Make the sbt doc command execute successfully with Java 17

[ https://issues.apache.org/jira/browse/SPARK-45341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45341: -- Assignee: (was: Apache Spark) > Make the sbt doc command execute successfully

[jira] [Assigned] (SPARK-45352) Remove window partition if partition expression are foldable

[ https://issues.apache.org/jira/browse/SPARK-45352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45352: -- Assignee: Apache Spark > Remove window partition if partition expression are

[jira] [Assigned] (SPARK-45352) Remove window partition if partition expression are foldable

[ https://issues.apache.org/jira/browse/SPARK-45352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45352: -- Assignee: (was: Apache Spark) > Remove window partition if partition expression

[jira] [Assigned] (SPARK-45268) python function categories should be consistent with SQL function groups

[ https://issues.apache.org/jira/browse/SPARK-45268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-45268: - Assignee: Ruifeng Zheng > python function categories should be consistent with SQL

[jira] [Resolved] (SPARK-45268) python function categories should be consistent with SQL function groups

[ https://issues.apache.org/jira/browse/SPARK-45268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-45268. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43045

[jira] [Updated] (SPARK-45352) Remove window partition if partition expression are foldable

[ https://issues.apache.org/jira/browse/SPARK-45352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuml updated SPARK-45352: -- Description: Foldable partition is redundant, remove it not only can simplify plan, but some rules can also

[jira] [Updated] (SPARK-45352) Remove window partition if partition expression are foldable

[ https://issues.apache.org/jira/browse/SPARK-45352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuml updated SPARK-45352: -- Description: Foldable partition is redundant, remove it not only can simplify plan, but some rules can also

[jira] [Updated] (SPARK-45352) Remove window partition if partition expression are foldable

[ https://issues.apache.org/jira/browse/SPARK-45352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45352: --- Labels: pull-request-available (was: ) > Remove window partition if partition expression

[jira] [Updated] (SPARK-45352) Remove window partition if partition expression are foldable

[ https://issues.apache.org/jira/browse/SPARK-45352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuml updated SPARK-45352: -- Priority: Minor (was: Major) > Remove window partition if partition expression are foldable >

[jira] [Created] (SPARK-45352) Remove window partition if partition expression are foldable

zhuml created SPARK-45352: - Summary: Remove window partition if partition expression are foldable Key: SPARK-45352 URL: https://issues.apache.org/jira/browse/SPARK-45352 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-45346) Parquet schema inference should respect case sensitive flag when merging schema

[ https://issues.apache.org/jira/browse/SPARK-45346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45346. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-45346) Parquet schema inference should respect case sensitive flag when merging schema

[ https://issues.apache.org/jira/browse/SPARK-45346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45346: --- Assignee: Wenchen Fan > Parquet schema inference should respect case sensitive flag when

[jira] [Updated] (SPARK-45350) Rename the imported Java Boolean to JBoolean

[ https://issues.apache.org/jira/browse/SPARK-45350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45350: --- Labels: pull-request-available (was: ) > Rename the imported Java Boolean to JBoolean >

[jira] [Resolved] (SPARK-43662) Enable ReshapeParityTests.test_merge_asof

[ https://issues.apache.org/jira/browse/SPARK-43662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43662. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43137

[jira] [Assigned] (SPARK-43662) Enable ReshapeParityTests.test_merge_asof

[ https://issues.apache.org/jira/browse/SPARK-43662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43662: - Assignee: Takuya Ueshin > Enable ReshapeParityTests.test_merge_asof >

[jira] [Resolved] (SPARK-45308) Enable `GroupbySplitApplyTests.test_split_apply_combine_on_series` for pandas 2.0.0.

[ https://issues.apache.org/jira/browse/SPARK-45308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-45308. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43096

[jira] [Assigned] (SPARK-45308) Enable `GroupbySplitApplyTests.test_split_apply_combine_on_series` for pandas 2.0.0.

[ https://issues.apache.org/jira/browse/SPARK-45308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-45308: - Assignee: Haejoon Lee > Enable

[jira] [Commented] (SPARK-45057) Deadlock caused by rdd replication level of 2

[ https://issues.apache.org/jira/browse/SPARK-45057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17769443#comment-17769443 ] wuyi commented on SPARK-45057: -- In the case of "Received UploadBlock request from T1 (blocked by T4)",

[jira] [Assigned] (SPARK-45267) Change the default value for `numeric_only`.

[ https://issues.apache.org/jira/browse/SPARK-45267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-45267: - Assignee: Haejoon Lee > Change the default value for `numeric_only`. >

  1   2   >