[jira] [Updated] (SPARK-45283) Make StatusTrackerSuite less fragile

2023-09-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45283: --- Labels: pull-request-available (was: ) > Make StatusTrackerSuite less fragile >

[jira] [Updated] (SPARK-45387) Partition key filter cannot be pushed down when using cast

2023-09-30 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-45387: Target Version/s: (was: 3.1.1, 3.3.0) > Partition key filter cannot be pushed down when using

[jira] [Updated] (SPARK-45390) Remove `distutils` usage

2023-09-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45390: -- Description: [PEP-632|https://peps.python.org/pep-0632] deprecated {{distutils}} module in

[jira] [Updated] (SPARK-45390) Remove `distutils` usage

2023-09-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45390: -- Description: [PEP-632|https://peps.python.org/pep-0632] deprecated {{distutils}} module in

[jira] [Updated] (SPARK-45390) Remove `distutils` usage

2023-09-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45390: -- Summary: Remove `distutils` usage (was: Remove distutils usage) > Remove `distutils` usage >

[jira] [Updated] (SPARK-45390) Remove distutils usage

2023-09-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45390: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Remove distutils usage

[jira] [Assigned] (SPARK-45390) Remove distutils usage

2023-09-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45390: - Assignee: Dongjoon Hyun > Remove distutils usage > -- > >

[jira] [Updated] (SPARK-45390) Remove distutils usage

2023-09-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45390: --- Labels: pull-request-available (was: ) > Remove distutils usage > -- >

[jira] [Created] (SPARK-45390) Remove distutils usage

2023-09-30 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-45390: - Summary: Remove distutils usage Key: SPARK-45390 URL: https://issues.apache.org/jira/browse/SPARK-45390 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-45389) Correct MetaException matching rule on getting partition metadata

2023-09-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45389: --- Labels: pull-request-available (was: ) > Correct MetaException matching rule on getting

[jira] [Created] (SPARK-45389) Correct MetaException matching rule on getting partition metadata

2023-09-30 Thread Cheng Pan (Jira)
Cheng Pan created SPARK-45389: - Summary: Correct MetaException matching rule on getting partition metadata Key: SPARK-45389 URL: https://issues.apache.org/jira/browse/SPARK-45389 Project: Spark

[jira] [Resolved] (SPARK-36321) Do not fail application in kubernetes if name is too long

2023-09-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36321. --- Fix Version/s: 3.3.1 Resolution: Duplicate > Do not fail application in kubernetes

[jira] [Closed] (SPARK-36321) Do not fail application in kubernetes if name is too long

2023-09-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-36321. - > Do not fail application in kubernetes if name is too long >

[jira] [Commented] (SPARK-36321) Do not fail application in kubernetes if name is too long

2023-09-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17770752#comment-17770752 ] Dongjoon Hyun commented on SPARK-36321: --- Yes, [~wypoon]  > Do not fail application in kubernetes

[jira] [Updated] (SPARK-45227) Fix a subtle thread-safety issue with CoarseGrainedExecutorBackend where an executor process randomly gets stuck

2023-09-30 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-45227: Fix Version/s: 3.3.4 > Fix a subtle thread-safety issue with

[jira] [Updated] (SPARK-45388) Eliminate unnecessary reflection invocation in Hive shim classes

2023-09-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45388: --- Labels: pull-request-available (was: ) > Eliminate unnecessary reflection invocation in

[jira] [Created] (SPARK-45388) Eliminate unnecessary reflection invocation in Hive shim classes

2023-09-30 Thread Cheng Pan (Jira)
Cheng Pan created SPARK-45388: - Summary: Eliminate unnecessary reflection invocation in Hive shim classes Key: SPARK-45388 URL: https://issues.apache.org/jira/browse/SPARK-45388 Project: Spark

[jira] [Assigned] (SPARK-44762) Add more documentation and examples for using job tags for interrupt

2023-09-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44762: Assignee: Juliusz Sompolski > Add more documentation and examples for using job tags for

[jira] [Resolved] (SPARK-44762) Add more documentation and examples for using job tags for interrupt

2023-09-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44762. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43182

[jira] [Resolved] (SPARK-45331) Upgrade Scala to 2.13.12

2023-09-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45331. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43185

[jira] [Assigned] (SPARK-45331) Upgrade Scala to 2.13.12

2023-09-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45331: - Assignee: Yang Jie > Upgrade Scala to 2.13.12 > > >

[jira] [Resolved] (SPARK-45359) DataFrame.{columns, colRegex, explain} should raise exceptions when plan is invalid

2023-09-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45359. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43150

[jira] [Assigned] (SPARK-45359) DataFrame.{columns, colRegex, explain} should raise exceptions when plan is invalid

2023-09-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45359: Assignee: Ruifeng Zheng > DataFrame.{columns, colRegex, explain} should raise exceptions

[jira] [Resolved] (SPARK-45358) Remove shim classes for Hive prior 2.0.0

2023-09-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45358. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43151

[jira] [Assigned] (SPARK-45358) Remove shim classes for Hive prior 2.0.0

2023-09-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45358: Assignee: Cheng Pan > Remove shim classes for Hive prior 2.0.0 >

[jira] [Created] (SPARK-45387) Partition key filter cannot be pushed down when using cast

2023-09-30 Thread TianyiMa (Jira)
TianyiMa created SPARK-45387: Summary: Partition key filter cannot be pushed down when using cast Key: SPARK-45387 URL: https://issues.apache.org/jira/browse/SPARK-45387 Project: Spark Issue

[jira] [Updated] (SPARK-45386) Correctness issue when persisting using StorageLevel.NONE

2023-09-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45386: --- Labels: pull-request-available (was: ) > Correctness issue when persisting using

[jira] [Created] (SPARK-45386) Correctness issue when persisting using StorageLevel.NONE

2023-09-30 Thread Emil Ejbyfeldt (Jira)
Emil Ejbyfeldt created SPARK-45386: -- Summary: Correctness issue when persisting using StorageLevel.NONE Key: SPARK-45386 URL: https://issues.apache.org/jira/browse/SPARK-45386 Project: Spark

[jira] [Assigned] (SPARK-45385) Deprecate spark.sql.parser.escapedStringLiterals

2023-09-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45385: -- Assignee: Apache Spark (was: Max Gekk) > Deprecate

[jira] [Assigned] (SPARK-45385) Deprecate spark.sql.parser.escapedStringLiterals

2023-09-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45385: -- Assignee: Max Gekk (was: Apache Spark) > Deprecate

[jira] [Commented] (SPARK-45385) Deprecate spark.sql.parser.escapedStringLiterals

2023-09-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17770674#comment-17770674 ] ASF GitHub Bot commented on SPARK-45385: User 'MaxGekk' has created a pull request for this

[jira] [Assigned] (SPARK-45385) Deprecate spark.sql.parser.escapedStringLiterals

2023-09-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45385: -- Assignee: Max Gekk (was: Apache Spark) > Deprecate

[jira] [Assigned] (SPARK-45385) Deprecate spark.sql.parser.escapedStringLiterals

2023-09-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45385: -- Assignee: Apache Spark (was: Max Gekk) > Deprecate

[jira] [Commented] (SPARK-45385) Deprecate spark.sql.parser.escapedStringLiterals

2023-09-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17770673#comment-17770673 ] ASF GitHub Bot commented on SPARK-45385: User 'MaxGekk' has created a pull request for this

[jira] [Created] (SPARK-45385) Deprecate spark.sql.parser.escapedStringLiterals

2023-09-30 Thread Max Gekk (Jira)
Max Gekk created SPARK-45385: Summary: Deprecate spark.sql.parser.escapedStringLiterals Key: SPARK-45385 URL: https://issues.apache.org/jira/browse/SPARK-45385 Project: Spark Issue Type:

[jira] [Commented] (SPARK-24042) High-order function: zip_with_index

2023-09-30 Thread ZygD (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17770659#comment-17770659 ] ZygD commented on SPARK-24042: -- [~Tagar]  has incorrectly linked another issue to this one. Even this is

[jira] [Comment Edited] (SPARK-23074) Dataframe-ified zipwithindex

2023-09-30 Thread ZygD (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17770658#comment-17770658 ] ZygD edited comment on SPARK-23074 at 9/30/23 7:58 AM: --- [~gurwls223] [~Tagar]  The

[jira] [Comment Edited] (SPARK-23074) Dataframe-ified zipwithindex

2023-09-30 Thread ZygD (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17770658#comment-17770658 ] ZygD edited comment on SPARK-23074 at 9/30/23 7:57 AM: --- [~gurwls223] [~Tagar]  The

[jira] [Comment Edited] (SPARK-23074) Dataframe-ified zipwithindex

2023-09-30 Thread ZygD (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17770658#comment-17770658 ] ZygD edited comment on SPARK-23074 at 9/30/23 7:54 AM: --- [~gurwls223] [~Tagar]  The

[jira] [Comment Edited] (SPARK-23074) Dataframe-ified zipwithindex

2023-09-30 Thread ZygD (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17770658#comment-17770658 ] ZygD edited comment on SPARK-23074 at 9/30/23 7:51 AM: --- The problem is not solved!

[jira] [Comment Edited] (SPARK-23074) Dataframe-ified zipwithindex

2023-09-30 Thread ZygD (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17770658#comment-17770658 ] ZygD edited comment on SPARK-23074 at 9/30/23 7:51 AM: --- The problem is not solved!

[jira] [Commented] (SPARK-23074) Dataframe-ified zipwithindex

2023-09-30 Thread ZygD (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17770658#comment-17770658 ] ZygD commented on SPARK-23074: -- The problem is not solved! This was incorrectly closed. [The linked