[jira] [Resolved] (SPARK-48625) Upgrade mssql-jdbc to 12.6.2.jre11

[ https://issues.apache.org/jira/browse/SPARK-48625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48625. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46981 [https://github.com

[jira] [Assigned] (SPARK-48625) Upgrade mssql-jdbc to 12.6.2.jre11

[ https://issues.apache.org/jira/browse/SPARK-48625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48625: Assignee: Wei Guo > Upgrade mssql-jdbc to 12.6.2.jre11 > -- > >

[jira] [Updated] (SPARK-48627) Perf improvement for binary to toSting

[ https://issues.apache.org/jira/browse/SPARK-48627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48627: --- Labels: pull-request-available (was: ) > Perf improvement for binary to toSting > -

[jira] [Created] (SPARK-48627) Perf improvement for binary to toSting

Kent Yao created SPARK-48627: Summary: Perf improvement for binary to toSting Key: SPARK-48627 URL: https://issues.apache.org/jira/browse/SPARK-48627 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-48626) Change the scope of object LogKeys as private in Spark

[ https://issues.apache.org/jira/browse/SPARK-48626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48626: --- Labels: pull-request-available (was: ) > Change the scope of object LogKeys as private in S

[jira] [Updated] (SPARK-48626) Change the scope of object LogKeys as private in Spark

[ https://issues.apache.org/jira/browse/SPARK-48626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-48626: --- Summary: Change the scope of object LogKeys as private in Spark (was: Change the scope of o

[jira] [Created] (SPARK-48626) Change the scope of object LogKyes as private in Spark

Gengliang Wang created SPARK-48626: -- Summary: Change the scope of object LogKyes as private in Spark Key: SPARK-48626 URL: https://issues.apache.org/jira/browse/SPARK-48626 Project: Spark Is

[jira] [Assigned] (SPARK-48612) Cleanup deprecated api usage related to commons-pool2

[ https://issues.apache.org/jira/browse/SPARK-48612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-48612: Assignee: Yang Jie > Cleanup deprecated api usage related to commons-pool2 >

[jira] [Resolved] (SPARK-48612) Cleanup deprecated api usage related to commons-pool2

[ https://issues.apache.org/jira/browse/SPARK-48612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-48612. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46967 [https://github.com

[jira] [Updated] (SPARK-42616) SparkSQLCLIDriver shall only close started hive sessionState

[ https://issues.apache.org/jira/browse/SPARK-42616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-42616: --- Labels: pull-request-available (was: ) > SparkSQLCLIDriver shall only close started hive se

[jira] [Updated] (SPARK-48600) Fix FrameLessOffsetWindowFunction expressions implicit casting

[ https://issues.apache.org/jira/browse/SPARK-48600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Milosevic updated SPARK-48600: -- Summary: Fix FrameLessOffsetWindowFunction expressions implicit casting (was: Fix Lag

[jira] [Updated] (SPARK-48625) Upgrade mssql-jdbc to 12.6.2.jre11

[ https://issues.apache.org/jira/browse/SPARK-48625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48625: --- Labels: pull-request-available (was: ) > Upgrade mssql-jdbc to 12.6.2.jre11 > -

[jira] [Updated] (SPARK-48615) Perf improvement for parsing hex string

[ https://issues.apache.org/jira/browse/SPARK-48615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-48615: - Parent: SPARK-48624 Issue Type: Sub-task (was: Improvement) > Perf improvement for parsing hex

[jira] [Updated] (SPARK-48596) Perf improvement for calculating hex string for long

[ https://issues.apache.org/jira/browse/SPARK-48596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-48596: - Parent: SPARK-48624 Issue Type: Sub-task (was: Improvement) > Perf improvement for calculating

[jira] [Created] (SPARK-48624) Performance improvement via refactoring some suboptimal algorithms

Kent Yao created SPARK-48624: Summary: Performance improvement via refactoring some suboptimal algorithms Key: SPARK-48624 URL: https://issues.apache.org/jira/browse/SPARK-48624 Project: Spark I

[jira] [Assigned] (SPARK-48622) 50% cpu time spent on SQLConf.getConf in ALTER ADD COLUMN query

[ https://issues.apache.org/jira/browse/SPARK-48622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48622: Assignee: Andrew Xue > 50% cpu time spent on SQLConf.getConf in ALTER ADD COLUMN query >

[jira] [Resolved] (SPARK-48622) 50% cpu time spent on SQLConf.getConf in ALTER ADD COLUMN query

[ https://issues.apache.org/jira/browse/SPARK-48622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48622. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46979 [https://github.com

[jira] [Updated] (SPARK-48623) Structured Logging Framework Scala Style Migration

[ https://issues.apache.org/jira/browse/SPARK-48623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48623: --- Labels: pull-request-available (was: ) > Structured Logging Framework Scala Style Migration

[jira] [Created] (SPARK-48623) Structured Logging Framework Scala Style Migration

Amanda Liu created SPARK-48623: -- Summary: Structured Logging Framework Scala Style Migration Key: SPARK-48623 URL: https://issues.apache.org/jira/browse/SPARK-48623 Project: Spark Issue Type: Su

[jira] [Updated] (SPARK-48622) 50% cpu time spent on SQLConf.getConf in ALTER ADD COLUMN query

[ https://issues.apache.org/jira/browse/SPARK-48622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48622: --- Labels: pull-request-available (was: ) > 50% cpu time spent on SQLConf.getConf in ALTER ADD

[jira] [Updated] (SPARK-48622) 50% cpu time spent on SQLConf.getConf in ALTER ADD COLUMN query

[ https://issues.apache.org/jira/browse/SPARK-48622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Xue updated SPARK-48622: --- Description: SQLConf.caseSensitiveAnalsysis is evaluated for all (existing and added) columns in an

[jira] [Updated] (SPARK-48622) 50% cpu time spent on SQLConf.getConf in ALTER ADD COLUMN query

[ https://issues.apache.org/jira/browse/SPARK-48622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Xue updated SPARK-48622: --- Attachment: Screenshot 2024-06-13 at 12.51.16 PM.png > 50% cpu time spent on SQLConf.getConf in ALTE

[jira] [Updated] (SPARK-48622) 50% cpu time spent on SQLConf.getConf in ALTER ADD COLUMN query

[ https://issues.apache.org/jira/browse/SPARK-48622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Xue updated SPARK-48622: --- Description: SQLConf.caseSensitiveAnalsysis is evaluated for all (existing and added) columns in an

[jira] [Created] (SPARK-48622) 50% cpu time spent on SQLConf.getConf in ALTER ADD COLUMN query

Andrew Xue created SPARK-48622: -- Summary: 50% cpu time spent on SQLConf.getConf in ALTER ADD COLUMN query Key: SPARK-48622 URL: https://issues.apache.org/jira/browse/SPARK-48622 Project: Spark

[jira] [Updated] (SPARK-48545) Create to_avro and from_avro SQL functions to match PySpark equivalent

[ https://issues.apache.org/jira/browse/SPARK-48545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel updated SPARK-48545: --- Summary: Create to_avro and from_avro SQL functions to match PySpark equivalent (was: Create from_avro SQL

[jira] [Updated] (SPARK-48621) Fix Like simplification in Optimizer (for UTF8_LCASE collation)

[ https://issues.apache.org/jira/browse/SPARK-48621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48621: --- Labels: pull-request-available (was: ) > Fix Like simplification in Optimizer (for UTF8_LCA

[jira] [Created] (SPARK-48621) Fix Like simplification in Optimizer (for UTF8_LCASE collation)

Uroš Bojanić created SPARK-48621: Summary: Fix Like simplification in Optimizer (for UTF8_LCASE collation) Key: SPARK-48621 URL: https://issues.apache.org/jira/browse/SPARK-48621 Project: Spark

[jira] [Created] (SPARK-48620) Fix internal raw data leak in YearMonthIntervalType

Ruifeng Zheng created SPARK-48620: - Summary: Fix internal raw data leak in YearMonthIntervalType Key: SPARK-48620 URL: https://issues.apache.org/jira/browse/SPARK-48620 Project: Spark Issue T

[jira] [Updated] (SPARK-48620) Fix internal raw data leak in YearMonthIntervalType

[ https://issues.apache.org/jira/browse/SPARK-48620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48620: --- Labels: pull-request-available (was: ) > Fix internal raw data leak in YearMonthIntervalTyp

[jira] [Updated] (SPARK-48619) Fix GROUP BY MapType feature

[ https://issues.apache.org/jira/browse/SPARK-48619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48619: --- Labels: pull-request-available (was: ) > Fix GROUP BY MapType feature > ---

[jira] [Created] (SPARK-48619) Fix GROUP BY MapType feature

Stevo Mitric created SPARK-48619: Summary: Fix GROUP BY MapType feature Key: SPARK-48619 URL: https://issues.apache.org/jira/browse/SPARK-48619 Project: Spark Issue Type: Bug Compon

[jira] [Updated] (SPARK-48573) TBD

[ https://issues.apache.org/jira/browse/SPARK-48573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Milosevic updated SPARK-48573: -- Summary: TBD (was: Fix binary conversion expressions (etc. Hex)) > TBD > --- > >

[jira] [Resolved] (SPARK-48604) Replace deprecated classes and methods of arrow-vector called in Spark

[ https://issues.apache.org/jira/browse/SPARK-48604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-48604. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46961 [https://github.com

[jira] [Assigned] (SPARK-48604) Replace deprecated classes and methods of arrow-vector called in Spark

[ https://issues.apache.org/jira/browse/SPARK-48604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-48604: Assignee: Wei Guo > Replace deprecated classes and methods of arrow-vector called in Spark >

[jira] [Updated] (SPARK-48618) Use the `ErrorCode` and `SQLState` returned in SQLException to make errors more accurate

[ https://issues.apache.org/jira/browse/SPARK-48618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48618: --- Labels: pull-request-available (was: ) > Use the `ErrorCode` and `SQLState` returned in SQL

[jira] [Created] (SPARK-48618) Use the `ErrorCode` and `SQLState` returned in SQLException to make errors more accurate

BingKun Pan created SPARK-48618: --- Summary: Use the `ErrorCode` and `SQLState` returned in SQLException to make errors more accurate Key: SPARK-48618 URL: https://issues.apache.org/jira/browse/SPARK-48618

[jira] [Updated] (SPARK-48615) Perf improvement for parsing hex string

[ https://issues.apache.org/jira/browse/SPARK-48615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48615: --- Labels: pull-request-available (was: ) > Perf improvement for parsing hex string >

[jira] [Created] (SPARK-48617) Try to schedule tasks to the same executor

Yuming Wang created SPARK-48617: --- Summary: Try to schedule tasks to the same executor Key: SPARK-48617 URL: https://issues.apache.org/jira/browse/SPARK-48617 Project: Spark Issue Type: Improvem

[jira] [Created] (SPARK-48615) Perf improvement for parsing hex string

Kent Yao created SPARK-48615: Summary: Perf improvement for parsing hex string Key: SPARK-48615 URL: https://issues.apache.org/jira/browse/SPARK-48615 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-48604) Replace deprecated classes and methods of arrow-vector called in Spark

[ https://issues.apache.org/jira/browse/SPARK-48604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48604: -- Assignee: (was: Apache Spark) > Replace deprecated classes and methods of arrow-v

[jira] [Assigned] (SPARK-48604) Replace deprecated classes and methods of arrow-vector called in Spark

[ https://issues.apache.org/jira/browse/SPARK-48604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48604: -- Assignee: Apache Spark > Replace deprecated classes and methods of arrow-vector calle

[jira] [Assigned] (SPARK-48611) Log TID for input split in HadoopRDD and NewHadoopRDD

[ https://issues.apache.org/jira/browse/SPARK-48611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48611: -- Assignee: (was: Apache Spark) > Log TID for input split in HadoopRDD and NewHadoo

[jira] [Assigned] (SPARK-48611) Log TID for input split in HadoopRDD and NewHadoopRDD

[ https://issues.apache.org/jira/browse/SPARK-48611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48611: -- Assignee: Apache Spark > Log TID for input split in HadoopRDD and NewHadoopRDD >

[jira] [Assigned] (SPARK-48604) Replace deprecated classes and methods of arrow-vector called in Spark

[ https://issues.apache.org/jira/browse/SPARK-48604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48604: -- Assignee: (was: Apache Spark) > Replace deprecated classes and methods of arrow-v

[jira] [Assigned] (SPARK-48604) Replace deprecated classes and methods of arrow-vector called in Spark

[ https://issues.apache.org/jira/browse/SPARK-48604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48604: -- Assignee: Apache Spark > Replace deprecated classes and methods of arrow-vector calle

[jira] [Assigned] (SPARK-48604) Replace deprecated classes and methods of arrow-vector called in Spark

[ https://issues.apache.org/jira/browse/SPARK-48604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48604: -- Assignee: (was: Apache Spark) > Replace deprecated classes and methods of arrow-v

[jira] [Assigned] (SPARK-48604) Replace deprecated classes and methods of arrow-vector called in Spark

[ https://issues.apache.org/jira/browse/SPARK-48604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48604: -- Assignee: Apache Spark > Replace deprecated classes and methods of arrow-vector calle

[jira] [Assigned] (SPARK-48604) Replace deprecated classes and methods of arrow-vector called in Spark

[ https://issues.apache.org/jira/browse/SPARK-48604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48604: -- Assignee: Apache Spark > Replace deprecated classes and methods of arrow-vector calle

[jira] [Assigned] (SPARK-48604) Replace deprecated classes and methods of arrow-vector called in Spark

[ https://issues.apache.org/jira/browse/SPARK-48604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48604: -- Assignee: (was: Apache Spark) > Replace deprecated classes and methods of arrow-v

[jira] [Resolved] (SPARK-48543) Track invalid unsafe row exception explicitly as error class

[ https://issues.apache.org/jira/browse/SPARK-48543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-48543. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46885 [https://gi

[jira] [Assigned] (SPARK-48543) Track invalid unsafe row exception explicitly as error class

[ https://issues.apache.org/jira/browse/SPARK-48543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-48543: Assignee: Anish Shrigondekar > Track invalid unsafe row exception explicitly as error cla

[jira] [Commented] (SPARK-48613) Umbrella: Storage Partition Join Improvements

[ https://issues.apache.org/jira/browse/SPARK-48613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17854665#comment-17854665 ] Szehon Ho commented on SPARK-48613: --- Adding new umbrella Jira as discussed in [https:

[jira] [Updated] (SPARK-48614) Cleanup deprecated api usage related to kafka-clients

[ https://issues.apache.org/jira/browse/SPARK-48614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-48614: Description: (was: There are some deprecated classes and methods in commons-io called in Spark, we nee

[jira] [Created] (SPARK-48614) Cleanup deprecated api usage related to kafka-clients

Wei Guo created SPARK-48614: --- Summary: Cleanup deprecated api usage related to kafka-clients Key: SPARK-48614 URL: https://issues.apache.org/jira/browse/SPARK-48614 Project: Spark Issue Type: Impro

[jira] [Comment Edited] (SPARK-15041) adding mode strategy for ml.feature.Imputer for categorical features

[ https://issues.apache.org/jira/browse/SPARK-15041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17854661#comment-17854661 ] Chhavi Bansal edited comment on SPARK-15041 at 6/13/24 7:43 AM: --

[jira] [Commented] (SPARK-15041) adding mode strategy for ml.feature.Imputer for categorical features

[ https://issues.apache.org/jira/browse/SPARK-15041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17854661#comment-17854661 ] Chhavi Bansal commented on SPARK-15041: --- Are there plans to have imputations for C

[jira] [Created] (SPARK-48613) Umbrella: Storage Partition Join Improvements

Szehon Ho created SPARK-48613: - Summary: Umbrella: Storage Partition Join Improvements Key: SPARK-48613 URL: https://issues.apache.org/jira/browse/SPARK-48613 Project: Spark Issue Type: New Featu