[jira] [Resolved] (SPARK-48626) Change the scope of object LogKeys as private in Spark

[ https://issues.apache.org/jira/browse/SPARK-48626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-48626. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46983 [https://github.com

[jira] [Resolved] (SPARK-42252) Deprecate spark.shuffle.unsafe.file.output.buffer and add a new config

[ https://issues.apache.org/jira/browse/SPARK-42252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-42252. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 39819 [https://github.com

[jira] [Assigned] (SPARK-42252) Deprecate spark.shuffle.unsafe.file.output.buffer and add a new config

[ https://issues.apache.org/jira/browse/SPARK-42252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-42252: Assignee: Wei Guo > Deprecate spark.shuffle.unsafe.file.output.buffer and add a new config >

[jira] [Updated] (SPARK-48627) Perf improvement for binary to HEX_DISCRETE strings

[ https://issues.apache.org/jira/browse/SPARK-48627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-48627: - Summary: Perf improvement for binary to HEX_DISCRETE strings (was: Perf improvement for binary to toSti

[jira] [Resolved] (SPARK-48463) MLLib function unable to handle nested data

[ https://issues.apache.org/jira/browse/SPARK-48463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu resolved SPARK-48463. Resolution: Not A Problem > MLLib function unable to handle nested data >

[jira] [Created] (SPARK-48628) Add task peak on/off heap execution memory metrics

Ziqi Liu created SPARK-48628: Summary: Add task peak on/off heap execution memory metrics Key: SPARK-48628 URL: https://issues.apache.org/jira/browse/SPARK-48628 Project: Spark Issue Type: Improv

[jira] [Created] (SPARK-48629) Migrate the remaining code to the log structured framework Migrate logWarn with variables to structured logging framework

BingKun Pan created SPARK-48629: --- Summary: Migrate the remaining code to the log structured framework Migrate logWarn with variables to structured logging framework Key: SPARK-48629 URL: https://issues.apache.org/ji

[jira] [Updated] (SPARK-48629) Migrate the remaining code to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-48629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-48629: Summary: Migrate the remaining code to structured logging framework (was: Migrate the remaining c

[jira] [Updated] (SPARK-48629) Migrate the remaining code to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-48629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48629: --- Labels: pull-request-available (was: ) > Migrate the remaining code to structured logging f

[jira] [Updated] (SPARK-48600) Fix FrameLessOffsetWindowFunction expressions implicit casting

[ https://issues.apache.org/jira/browse/SPARK-48600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48600: --- Labels: pull-request-available (was: ) > Fix FrameLessOffsetWindowFunction expressions impl

[jira] [Assigned] (SPARK-48600) Fix FrameLessOffsetWindowFunction expressions implicit casting

[ https://issues.apache.org/jira/browse/SPARK-48600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48600: -- Assignee: (was: Apache Spark) > Fix FrameLessOffsetWindowFunction expressions imp

[jira] [Assigned] (SPARK-48591) Simplify the if-else branches with `F.lit`

[ https://issues.apache.org/jira/browse/SPARK-48591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48591: -- Assignee: Apache Spark (was: Ruifeng Zheng) > Simplify the if-else branches with `F.

[jira] [Assigned] (SPARK-48591) Simplify the if-else branches with `F.lit`

[ https://issues.apache.org/jira/browse/SPARK-48591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48591: -- Assignee: Ruifeng Zheng (was: Apache Spark) > Simplify the if-else branches with `F.

[jira] [Assigned] (SPARK-48600) Fix FrameLessOffsetWindowFunction expressions implicit casting

[ https://issues.apache.org/jira/browse/SPARK-48600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48600: -- Assignee: Apache Spark > Fix FrameLessOffsetWindowFunction expressions implicit casti

[jira] [Assigned] (SPARK-48600) Fix FrameLessOffsetWindowFunction expressions implicit casting

[ https://issues.apache.org/jira/browse/SPARK-48600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48600: -- Assignee: Apache Spark > Fix FrameLessOffsetWindowFunction expressions implicit casti

[jira] [Assigned] (SPARK-48600) Fix FrameLessOffsetWindowFunction expressions implicit casting

[ https://issues.apache.org/jira/browse/SPARK-48600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48600: -- Assignee: (was: Apache Spark) > Fix FrameLessOffsetWindowFunction expressions imp

[jira] [Assigned] (SPARK-48572) Fix DateSub, DateAdd, WindowTime, TimeWindow and SessionWindow expressions

[ https://issues.apache.org/jira/browse/SPARK-48572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48572: -- Assignee: Apache Spark > Fix DateSub, DateAdd, WindowTime, TimeWindow and SessionWind

[jira] [Assigned] (SPARK-48572) Fix DateSub, DateAdd, WindowTime, TimeWindow and SessionWindow expressions

[ https://issues.apache.org/jira/browse/SPARK-48572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48572: -- Assignee: (was: Apache Spark) > Fix DateSub, DateAdd, WindowTime, TimeWindow and

[jira] [Assigned] (SPARK-48572) Fix DateSub, DateAdd, WindowTime, TimeWindow and SessionWindow expressions

[ https://issues.apache.org/jira/browse/SPARK-48572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48572: -- Assignee: Apache Spark > Fix DateSub, DateAdd, WindowTime, TimeWindow and SessionWind

[jira] [Assigned] (SPARK-48572) Fix DateSub, DateAdd, WindowTime, TimeWindow and SessionWindow expressions

[ https://issues.apache.org/jira/browse/SPARK-48572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48572: -- Assignee: (was: Apache Spark) > Fix DateSub, DateAdd, WindowTime, TimeWindow and

[jira] [Assigned] (SPARK-48621) Fix Like simplification in Optimizer (for UTF8_LCASE collation)

[ https://issues.apache.org/jira/browse/SPARK-48621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48621: -- Assignee: Apache Spark > Fix Like simplification in Optimizer (for UTF8_LCASE collati

[jira] [Created] (SPARK-48630) Make merge_spark_pr properly format revert PR

Ruifeng Zheng created SPARK-48630: - Summary: Make merge_spark_pr properly format revert PR Key: SPARK-48630 URL: https://issues.apache.org/jira/browse/SPARK-48630 Project: Spark Issue Type: I

[jira] [Resolved] (SPARK-48621) Fix Like simplification in Optimizer (for UTF8_LCASE collation)

[ https://issues.apache.org/jira/browse/SPARK-48621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48621. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46976 [https://github.com

[jira] [Updated] (SPARK-48630) Make merge_spark_pr properly format revert PR

[ https://issues.apache.org/jira/browse/SPARK-48630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48630: --- Labels: pull-request-available (was: ) > Make merge_spark_pr properly format revert PR > --

[jira] [Created] (SPARK-48631) Fix test case "error during accessing host local dirs for executors"

Bo Zhang created SPARK-48631: Summary: Fix test case "error during accessing host local dirs for executors" Key: SPARK-48631 URL: https://issues.apache.org/jira/browse/SPARK-48631 Project: Spark

[jira] [Updated] (SPARK-48631) Fix test case "error during accessing host local dirs for executors"

[ https://issues.apache.org/jira/browse/SPARK-48631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48631: --- Labels: pull-request-available (was: ) > Fix test case "error during accessing host local d

[jira] [Updated] (SPARK-48632) Remove unused LogKeys

[ https://issues.apache.org/jira/browse/SPARK-48632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48632: --- Labels: pull-request-available (was: ) > Remove unused LogKeys > - > >

[jira] [Created] (SPARK-48632) Remove unused LogKeys

Amanda Liu created SPARK-48632: -- Summary: Remove unused LogKeys Key: SPARK-48632 URL: https://issues.apache.org/jira/browse/SPARK-48632 Project: Spark Issue Type: Sub-task Components:

[jira] [Updated] (SPARK-48472) Enable reflect expressions with collated strings

[ https://issues.apache.org/jira/browse/SPARK-48472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48472: --- Labels: pull-request-available (was: ) > Enable reflect expressions with collated strings >

[jira] [Updated] (SPARK-48633) Upgrade scalacheck to 1.18.0

[ https://issues.apache.org/jira/browse/SPARK-48633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48633: --- Labels: pull-request-available (was: ) > Upgrade scalacheck to 1.18.0 > ---

[jira] [Resolved] (SPARK-48632) Remove unused LogKeys

[ https://issues.apache.org/jira/browse/SPARK-48632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amanda Liu resolved SPARK-48632. Resolution: Not A Problem > Remove unused LogKeys > - > > Key:

[jira] [Updated] (SPARK-48575) spark.history.fs.update.interval calling too many directory pollings when spark log dir contains many sparkEvent apps

[ https://issues.apache.org/jira/browse/SPARK-48575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arnaud Nauwynck updated SPARK-48575: Description: In the case of a sparkLog dir containing "lot" of spark eventLogs sub-dirs (

[jira] [Created] (SPARK-48634) Avoid statically initialize threadpool at ExecutePlanResponseReattachableIterator

Hyukjin Kwon created SPARK-48634: Summary: Avoid statically initialize threadpool at ExecutePlanResponseReattachableIterator Key: SPARK-48634 URL: https://issues.apache.org/jira/browse/SPARK-48634 Pro

[jira] [Updated] (SPARK-48634) Avoid statically initialize threadpool at ExecutePlanResponseReattachableIterator

[ https://issues.apache.org/jira/browse/SPARK-48634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48634: --- Labels: pull-request-available (was: ) > Avoid statically initialize threadpool at > Execu

[jira] [Created] (SPARK-48635) Assign classes to join type errors _LEGACY_ERROR_TEMP_[1319, 3216] and as-of join error _LEGACY_ERROR_TEMP_3217

Wei Guo created SPARK-48635: --- Summary: Assign classes to join type errors _LEGACY_ERROR_TEMP_[1319, 3216] and as-of join error _LEGACY_ERROR_TEMP_3217 Key: SPARK-48635 URL: https://issues.apache.org/jira/browse/SPARK-

[jira] [Updated] (SPARK-48635) Assign classes to join type errors and as-of join error _LEGACY_ERROR_TEMP_3217

[ https://issues.apache.org/jira/browse/SPARK-48635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-48635: Description: job type errors: _LEGACY_ERROR_TEMP_[1319, 3216] as-of join error: _LEGACY_ERROR_TEMP_3217

[jira] [Updated] (SPARK-48635) Assign classes to join type errors and as-of join error _LEGACY_ERROR_TEMP_3217

[ https://issues.apache.org/jira/browse/SPARK-48635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-48635: Description: job type errors: _LEGACY_ERROR_TEMP_[1319, 3216] as-of join error: > Assign classes to jo

[jira] [Updated] (SPARK-48635) Assign classes to join type errors and as-of join error _LEGACY_ERROR_TEMP_3217

[ https://issues.apache.org/jira/browse/SPARK-48635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-48635: Description: job type errors: LEGACY_ERROR_TEMP[1319, 3216] as-of join error: _LEGACY_ERROR_TEMP_3217

[jira] [Updated] (SPARK-48635) Assign classes to join type errors and as-of join error _LEGACY_ERROR_TEMP_3217

[ https://issues.apache.org/jira/browse/SPARK-48635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-48635: Summary: Assign classes to join type errors and as-of join error _LEGACY_ERROR_TEMP_3217 (was: Assign

[jira] [Updated] (SPARK-48635) Assign classes to join type errors and as-of join error

[ https://issues.apache.org/jira/browse/SPARK-48635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-48635: Summary: Assign classes to join type errors and as-of join error (was: Assign classes to join type err

[jira] [Updated] (SPARK-48635) Assign classes to join type errors and as-of join error

[ https://issues.apache.org/jira/browse/SPARK-48635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48635: --- Labels: pull-request-available (was: ) > Assign classes to join type errors and as-of joi

[jira] [Reopened] (SPARK-48463) MLLib function unable to handle nested data

[ https://issues.apache.org/jira/browse/SPARK-48463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu reopened SPARK-48463: Assignee: Weichen Xu > MLLib function unable to handle nested data > ---

[jira] [Resolved] (SPARK-48611) Log TID for input split in HadoopRDD and NewHadoopRDD

[ https://issues.apache.org/jira/browse/SPARK-48611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-48611. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46966 [https:

[jira] [Assigned] (SPARK-48611) Log TID for input split in HadoopRDD and NewHadoopRDD

[ https://issues.apache.org/jira/browse/SPARK-48611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-48611: -- Assignee: Cheng Pan > Log TID for input split in HadoopRDD and NewHadoopRDD > ---