[jira] [Updated] (SPARK-48612) Cleanup deprecated api usage related to commons-pool2

[ https://issues.apache.org/jira/browse/SPARK-48612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48612: --- Labels: pull-request-available (was: ) > Cleanup deprecated api usage related to commons-po

[jira] [Created] (SPARK-48612) Cleanup deprecated api usage related to commons-pool2

Yang Jie created SPARK-48612: Summary: Cleanup deprecated api usage related to commons-pool2 Key: SPARK-48612 URL: https://issues.apache.org/jira/browse/SPARK-48612 Project: Spark Issue Type: Imp

[jira] [Resolved] (SPARK-48609) Upgrade `scala-xml` to 2.3

[ https://issues.apache.org/jira/browse/SPARK-48609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-48609. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46964 [https://github.com

[jira] [Assigned] (SPARK-48609) Upgrade `scala-xml` to 2.3

[ https://issues.apache.org/jira/browse/SPARK-48609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-48609: Assignee: BingKun Pan > Upgrade `scala-xml` to 2.3 > -- > >

[jira] [Updated] (SPARK-48611) Log TID for input split in HadoopRDD and NewHadoopRDD

[ https://issues.apache.org/jira/browse/SPARK-48611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48611: --- Labels: pull-request-available (was: ) > Log TID for input split in HadoopRDD and NewHadoop

[jira] [Updated] (SPARK-48574) Fix support for StructTypes with collations

[ https://issues.apache.org/jira/browse/SPARK-48574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Milosevic updated SPARK-48574: -- Summary: Fix support for StructTypes with collations (was: Add support for StructType

[jira] [Created] (SPARK-48611) Log TID for input split in HadoopRDD and NewHadoopRDD

Cheng Pan created SPARK-48611: - Summary: Log TID for input split in HadoopRDD and NewHadoopRDD Key: SPARK-48611 URL: https://issues.apache.org/jira/browse/SPARK-48611 Project: Spark Issue Type: I

[jira] [Assigned] (SPARK-48602) Make csv generator support different output style with spark.sql.binaryOutputStyle

[ https://issues.apache.org/jira/browse/SPARK-48602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48602: Assignee: Kent Yao > Make csv generator support different output style with > spark.sql.binaryOu

[jira] [Resolved] (SPARK-48602) Make csv generator support different output style with spark.sql.binaryOutputStyle

[ https://issues.apache.org/jira/browse/SPARK-48602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48602. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46956 [https://github.com

[jira] [Assigned] (SPARK-48583) Replace deprecated classes and methods of commons-io called in Spark

[ https://issues.apache.org/jira/browse/SPARK-48583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-48583: Assignee: Wei Guo > Replace deprecated classes and methods of commons-io called in Spark > --

[jira] [Resolved] (SPARK-48583) Replace deprecated classes and methods of commons-io called in Spark

[ https://issues.apache.org/jira/browse/SPARK-48583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-48583. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46935 [https://github.com

[jira] [Updated] (SPARK-48610) Remove ExplainUtils.processPlan synchronize

[ https://issues.apache.org/jira/browse/SPARK-48610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48610: --- Labels: pull-request-available (was: ) > Remove ExplainUtils.processPlan synchronize >

[jira] [Created] (SPARK-48610) Remove ExplainUtils.processPlan synchronize

Ziqi Liu created SPARK-48610: Summary: Remove ExplainUtils.processPlan synchronize Key: SPARK-48610 URL: https://issues.apache.org/jira/browse/SPARK-48610 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-48593) Fix the string representation of lambda function

[ https://issues.apache.org/jira/browse/SPARK-48593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48593. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46948 [https://gi

[jira] [Assigned] (SPARK-48593) Fix the string representation of lambda function

[ https://issues.apache.org/jira/browse/SPARK-48593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48593: Assignee: Ruifeng Zheng > Fix the string representation of lambda function >

[jira] [Assigned] (SPARK-48421) SPJ: Add documentation

[ https://issues.apache.org/jira/browse/SPARK-48421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48421: Assignee: Szehon Ho > SPJ: Add documentation > -- > >

[jira] [Resolved] (SPARK-48421) SPJ: Add documentation

[ https://issues.apache.org/jira/browse/SPARK-48421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48421. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46745 [https://gi

[jira] [Resolved] (SPARK-48591) Simplify the if-else branches with `F.lit`

[ https://issues.apache.org/jira/browse/SPARK-48591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48591. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46946 [https://gi

[jira] [Assigned] (SPARK-48591) Simplify the if-else branches with `F.lit`

[ https://issues.apache.org/jira/browse/SPARK-48591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48591: Assignee: Ruifeng Zheng > Simplify the if-else branches with `F.lit` > --

[jira] [Assigned] (SPARK-48598) Propagate cached schema in dataframe operations

[ https://issues.apache.org/jira/browse/SPARK-48598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48598: Assignee: Ruifeng Zheng > Propagate cached schema in dataframe operations > -

[jira] [Resolved] (SPARK-48598) Propagate cached schema in dataframe operations

[ https://issues.apache.org/jira/browse/SPARK-48598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48598. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46954 [https://gi

[jira] [Updated] (SPARK-48609) Upgrade `scala-xml` to 2.3

[ https://issues.apache.org/jira/browse/SPARK-48609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48609: --- Labels: pull-request-available (was: ) > Upgrade `scala-xml` to 2.3 > -

[jira] [Created] (SPARK-48609) Upgrade `scala-xml` to 2.3

BingKun Pan created SPARK-48609: --- Summary: Upgrade `scala-xml` to 2.3 Key: SPARK-48609 URL: https://issues.apache.org/jira/browse/SPARK-48609 Project: Spark Issue Type: Improvement Co

[jira] [Updated] (SPARK-48589) Add option snapshotStartBatchId and snapshotPartitionId to state data source

[ https://issues.apache.org/jira/browse/SPARK-48589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48589: --- Labels: pull-request-available (was: ) > Add option snapshotStartBatchId and snapshotPartit

[jira] [Resolved] (SPARK-48607) Support more types of expressions in VALUES lists

[ https://issues.apache.org/jira/browse/SPARK-48607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel resolved SPARK-48607. Resolution: Duplicate > Support more types of expressions in VALUES lists > --

[jira] [Updated] (SPARK-48608) Spark 3.5: fails to build with value defaultValueNotConstantError is not a member of object org.apache.spark.sql.errors.QueryCompilationErrors

[ https://issues.apache.org/jira/browse/SPARK-48608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-48608: -- Priority: Blocker (was: Major) > Spark 3.5: fails to build with value defaultValueNotConstant

[jira] [Created] (SPARK-48608) Spark 3.5: fails to build with value defaultValueNotConstantError is not a member of object org.apache.spark.sql.errors.QueryCompilationErrors

Thomas Graves created SPARK-48608: - Summary: Spark 3.5: fails to build with value defaultValueNotConstantError is not a member of object org.apache.spark.sql.errors.QueryCompilationErrors Key: SPARK-48608 URL: h

[jira] [Created] (SPARK-48607) Support more types of expressions in VALUES lists

Daniel created SPARK-48607: -- Summary: Support more types of expressions in VALUES lists Key: SPARK-48607 URL: https://issues.apache.org/jira/browse/SPARK-48607 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-48606) Upgrade `google-java-format` to 1.22.0

[ https://issues.apache.org/jira/browse/SPARK-48606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48606. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-48606) Upgrade `google-java-format` to 1.22.0

[ https://issues.apache.org/jira/browse/SPARK-48606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48606: - Assignee: Dongjoon Hyun > Upgrade `google-java-format` to 1.22.0 >

[jira] [Updated] (SPARK-48606) Upgrade `google-java-format` to 1.22.0

[ https://issues.apache.org/jira/browse/SPARK-48606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48606: --- Labels: pull-request-available (was: ) > Upgrade `google-java-format` to 1.22.0 > -

[jira] [Created] (SPARK-48606) Upgrade `google-java-format` to 1.22.0

Dongjoon Hyun created SPARK-48606: - Summary: Upgrade `google-java-format` to 1.22.0 Key: SPARK-48606 URL: https://issues.apache.org/jira/browse/SPARK-48606 Project: Spark Issue Type: Improvem

[jira] [Updated] (SPARK-48605) UI display driver thread first on the thread dump page

[ https://issues.apache.org/jira/browse/SPARK-48605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48605: --- Labels: pull-request-available (was: ) > UI display driver thread first on the thread dump

[jira] [Created] (SPARK-48605) UI display driver thread first on the thread dump page

Cheng Pan created SPARK-48605: - Summary: UI display driver thread first on the thread dump page Key: SPARK-48605 URL: https://issues.apache.org/jira/browse/SPARK-48605 Project: Spark Issue Type:

[jira] [Created] (SPARK-48604) Replace deprecated classes and methods of arrow-vector called in Spark

Wei Guo created SPARK-48604: --- Summary: Replace deprecated classes and methods of arrow-vector called in Spark Key: SPARK-48604 URL: https://issues.apache.org/jira/browse/SPARK-48604 Project: Spark

[jira] [Updated] (SPARK-48604) Replace deprecated classes and methods of arrow-vector called in Spark

[ https://issues.apache.org/jira/browse/SPARK-48604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-48604: Description: There are some deprecated classes and methods in arrow-vector called in Spark, we need to re

[jira] [Updated] (SPARK-48603) Update *ParquetReadSchemaSuite to cover type widen capability

[ https://issues.apache.org/jira/browse/SPARK-48603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48603: --- Labels: pull-request-available (was: ) > Update *ParquetReadSchemaSuite to cover type widen

[jira] [Created] (SPARK-48603) Update *ParquetReadSchemaSuite to cover type widen capability

Cheng Pan created SPARK-48603: - Summary: Update *ParquetReadSchemaSuite to cover type widen capability Key: SPARK-48603 URL: https://issues.apache.org/jira/browse/SPARK-48603 Project: Spark Issu

[jira] [Resolved] (SPARK-48596) Perf improvement for calculating hex string for long

[ https://issues.apache.org/jira/browse/SPARK-48596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48596. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46952 [https://github.com

[jira] [Assigned] (SPARK-48596) Perf improvement for calculating hex string for long

[ https://issues.apache.org/jira/browse/SPARK-48596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48596: Assignee: Kent Yao > Perf improvement for calculating hex string for long > -

[jira] [Updated] (SPARK-48602) Make csv generator support different output style with spark.sql.binaryOutputStyle

[ https://issues.apache.org/jira/browse/SPARK-48602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48602: --- Labels: pull-request-available (was: ) > Make csv generator support different output style

[jira] [Created] (SPARK-48602) Make csv generator support different output style with spark.sql.binaryOutputStyle

Kent Yao created SPARK-48602: Summary: Make csv generator support different output style with spark.sql.binaryOutputStyle Key: SPARK-48602 URL: https://issues.apache.org/jira/browse/SPARK-48602 Project: S

[jira] [Updated] (SPARK-48600) Fix Lag expression implicit casting

[ https://issues.apache.org/jira/browse/SPARK-48600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Milosevic updated SPARK-48600: -- Description: Expression walker found the error of Lag expression not behaving properly

[jira] [Created] (SPARK-48600) Fix Lag expression implicit casting

Mihailo Milosevic created SPARK-48600: - Summary: Fix Lag expression implicit casting Key: SPARK-48600 URL: https://issues.apache.org/jira/browse/SPARK-48600 Project: Spark Issue Type: Sub

[jira] [Created] (SPARK-48599) OIDC support for Spark

Yeachan Park created SPARK-48599: Summary: OIDC support for Spark Key: SPARK-48599 URL: https://issues.apache.org/jira/browse/SPARK-48599 Project: Spark Issue Type: New Feature Comp

[jira] [Assigned] (SPARK-48342) [M0] Parser support

[ https://issues.apache.org/jira/browse/SPARK-48342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48342: -- Assignee: (was: Apache Spark) > [M0] Parser support > --- > >

[jira] [Assigned] (SPARK-48342) [M0] Parser support

[ https://issues.apache.org/jira/browse/SPARK-48342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48342: -- Assignee: Apache Spark > [M0] Parser support > --- > >

[jira] [Resolved] (SPARK-48595) Cleanup deprecated api usage related to commons-compress

[ https://issues.apache.org/jira/browse/SPARK-48595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48595. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46950 [https://github.com

[jira] [Assigned] (SPARK-48595) Cleanup deprecated api usage related to commons-compress

[ https://issues.apache.org/jira/browse/SPARK-48595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48595: Assignee: Yang Jie > Cleanup deprecated api usage related to commons-compress > -

[jira] [Resolved] (SPARK-48584) Perf improvement for unescapePathName

[ https://issues.apache.org/jira/browse/SPARK-48584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48584. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46938 [https://github.com

[jira] [Updated] (SPARK-48583) Replace deprecated classes and methods of commons-io called in Spark

[ https://issues.apache.org/jira/browse/SPARK-48583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-48583: Summary: Replace deprecated classes and methods of commons-io called in Spark (was: Replace deprecated cl

[jira] [Updated] (SPARK-48583) Replace deprecated classes and methods of `commons-io` called in Spark

[ https://issues.apache.org/jira/browse/SPARK-48583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-48583: Description: There are some deprecated classes and methods in commons-io called in Spark, we need to repl

[jira] [Updated] (SPARK-48583) Replace deprecated classes and methods of `commons-io` called in Spark

[ https://issues.apache.org/jira/browse/SPARK-48583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-48583: Description: There are some deprecated classes and methods in `commons-io` called in Spark, we need to re

[jira] [Updated] (SPARK-48583) Replace deprecated classes and methods of `commons-io` called in Spark

[ https://issues.apache.org/jira/browse/SPARK-48583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-48583: Description: There are some deprecated classes and methods in `commons-io` called in Spark, we need to re

[jira] [Updated] (SPARK-48583) Replace deprecated classes and methods of `commons-io` called in Spark

[ https://issues.apache.org/jira/browse/SPARK-48583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-48583: Summary: Replace deprecated classes and methods of `commons-io` called in Spark (was: Replace deprecated

[jira] [Updated] (SPARK-48598) Propagate cached schema in dataframe operations

[ https://issues.apache.org/jira/browse/SPARK-48598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48598: --- Labels: pull-request-available (was: ) > Propagate cached schema in dataframe operations >

[jira] [Updated] (SPARK-48597) Distinguish the streaming nodes from the text representation of logical plan

[ https://issues.apache.org/jira/browse/SPARK-48597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48597: --- Labels: pull-request-available (was: ) > Distinguish the streaming nodes from the text repr

[jira] [Created] (SPARK-48598) Propagate cached schema in dataframe operations

Ruifeng Zheng created SPARK-48598: - Summary: Propagate cached schema in dataframe operations Key: SPARK-48598 URL: https://issues.apache.org/jira/browse/SPARK-48598 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-48581) Upgrade dropwizard metrics to 4.2.26

[ https://issues.apache.org/jira/browse/SPARK-48581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48581. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46932 [https://github.com

[jira] [Created] (SPARK-48597) Distinguish the streaming nodes from the text representation of logical plan

Jungtaek Lim created SPARK-48597: Summary: Distinguish the streaming nodes from the text representation of logical plan Key: SPARK-48597 URL: https://issues.apache.org/jira/browse/SPARK-48597 Project:

[jira] [Commented] (SPARK-48597) Distinguish the streaming nodes from the text representation of logical plan

[ https://issues.apache.org/jira/browse/SPARK-48597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17854291#comment-17854291 ] Jungtaek Lim commented on SPARK-48597: -- Will submit a PR sooner. > Distinguish the