[jira] [Updated] (SPARK-47056) Add scalastyle and checkstyle rules to ban `FileBackedOutputStream`

2024-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47056: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Test) > Add scalastyle and checkstyle

[jira] [Resolved] (SPARK-47056) Add scalastyle and checkstyle rules to ban `FileBackedOutputStream`

2024-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47056. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45116

[jira] [Updated] (SPARK-47055) Upgrade MyPy 1.8.0

2024-02-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47055: --- Labels: pull-request-available (was: ) > Upgrade MyPy 1.8.0 > -- > >

[jira] [Assigned] (SPARK-47056) Add scalastyle and checkstyle rules to ban `FileBackedOutputStream`

2024-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47056: - Assignee: Dongjoon Hyun > Add scalastyle and checkstyle rules to ban

[jira] [Updated] (SPARK-47057) Reenable MyPy data test

2024-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47057: - Summary: Reenable MyPy data test (was: Reenable MyPy Data test) > Reenable MyPy data test >

[jira] [Updated] (SPARK-47025) Upgrade `Guava` dependency in `docker-integration-tests` test module

2024-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47025: -- Summary: Upgrade `Guava` dependency in `docker-integration-tests` test module (was: Switch

[jira] [Updated] (SPARK-36964) Reuse CachedDNSToSwitchMapping for yarn container requests

2024-02-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-36964: --- Labels: pull-request-available (was: ) > Reuse CachedDNSToSwitchMapping for yarn

[jira] [Commented] (SPARK-46876) Data is silently lost in Tab separated CSV with empty (whitespace) rows

2024-02-15 Thread Martin Rueckl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817643#comment-17817643 ] Martin Rueckl commented on SPARK-46876: --- ping. Can someone review the PR? I had a quick look and

[jira] [Updated] (SPARK-47056) Add scalastyle and checkstyle rules to ban `FileBackedOutputStream`

2024-02-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47056: --- Labels: pull-request-available (was: ) > Add scalastyle and checkstyle rules to ban

[jira] [Updated] (SPARK-47056) Add scalastyle and checkstyle rules to ban `FileBackedOutputStream`

2024-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47056: -- Summary: Add scalastyle and checkstyle rules to ban `FileBackedOutputStream` (was: Add a

[jira] [Updated] (SPARK-47059) attach error context for ALTER COLUMN v1 command

2024-02-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47059: --- Labels: pull-request-available (was: ) > attach error context for ALTER COLUMN v1 command

[jira] [Updated] (SPARK-47060) Check SparkIllegalArgumentException instead of IllegalArgumentException in catalyst

2024-02-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-47060: - Summary: Check SparkIllegalArgumentException instead of IllegalArgumentException in catalyst (was:

[jira] [Created] (SPARK-47055) Upgrade MyPy from 0.920 to 1.8.0

2024-02-15 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47055: Summary: Upgrade MyPy from 0.920 to 1.8.0 Key: SPARK-47055 URL: https://issues.apache.org/jira/browse/SPARK-47055 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-47055) Upgrade MyPy 1.8.0

2024-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47055: - Summary: Upgrade MyPy 1.8.0 (was: Upgrade MyPy from 0.920 to 1.8.0) > Upgrade MyPy 1.8.0 >

[jira] [Commented] (SPARK-46938) Migrate jetty 10 to jetty 11

2024-02-15 Thread HiuFung Kwok (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817612#comment-17817612 ] HiuFung Kwok commented on SPARK-46938: -- To update on this ticket, the Hive SPARK-44114 is blocked

[jira] [Created] (SPARK-47058) Add `scalastyle` and `checkstyle` rules to ban `AtomicDoubleArray|CompoundOrdering`

2024-02-15 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47058: - Summary: Add `scalastyle` and `checkstyle` rules to ban `AtomicDoubleArray|CompoundOrdering` Key: SPARK-47058 URL: https://issues.apache.org/jira/browse/SPARK-47058

[jira] [Updated] (SPARK-46078) Upgrade `pytorch` for Python 3.12

2024-02-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46078: --- Labels: pull-request-available (was: ) > Upgrade `pytorch` for Python 3.12 >

[jira] [Created] (SPARK-47056) Add a checkstyle rule to ban `FileBackedOutputStream`

2024-02-15 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47056: - Summary: Add a checkstyle rule to ban `FileBackedOutputStream` Key: SPARK-47056 URL: https://issues.apache.org/jira/browse/SPARK-47056 Project: Spark

[jira] [Created] (SPARK-47057) Reenable MyPy Data test

2024-02-15 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47057: Summary: Reenable MyPy Data test Key: SPARK-47057 URL: https://issues.apache.org/jira/browse/SPARK-47057 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-47039) Add a checkstyle rule to ban `commons-lang` in Java code

2024-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47039: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Test) > Add a checkstyle rule to ban

[jira] [Created] (SPARK-47059) attach error context for ALTER COLUMN v1 command

2024-02-15 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-47059: --- Summary: attach error context for ALTER COLUMN v1 command Key: SPARK-47059 URL: https://issues.apache.org/jira/browse/SPARK-47059 Project: Spark Issue Type:

[jira] [Created] (SPARK-47060) Check SparkIllegalArgumentException instead of IllegalArgumentException

2024-02-15 Thread Max Gekk (Jira)
Max Gekk created SPARK-47060: Summary: Check SparkIllegalArgumentException instead of IllegalArgumentException Key: SPARK-47060 URL: https://issues.apache.org/jira/browse/SPARK-47060 Project: Spark

[jira] [Updated] (SPARK-47060) Check SparkIllegalArgumentException instead of IllegalArgumentException

2024-02-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-47060: - Description: Use checkError() to test the SparkIllegalArgumentException exception instead of

[jira] [Updated] (SPARK-47060) Check SparkIllegalArgumentException instead of IllegalArgumentException

2024-02-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-47060: - Description: Use checkError() to test the SparkIllegalArgumentException exception instead of

[jira] [Updated] (SPARK-47058) Add `scalastyle` and `checkstyle` rules to ban `AtomicDoubleArray|CompoundOrdering`

2024-02-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47058: --- Labels: pull-request-available (was: ) > Add `scalastyle` and `checkstyle` rules to ban >

[jira] [Assigned] (SPARK-47059) attach error context for ALTER COLUMN v1 command

2024-02-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-47059: Assignee: Wenchen Fan > attach error context for ALTER COLUMN v1 command >

[jira] [Resolved] (SPARK-47059) attach error context for ALTER COLUMN v1 command

2024-02-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-47059. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45121

[jira] [Created] (SPARK-47061) Wrong result from flatMapGroups using Scala 2.13.x

2024-02-15 Thread Jira
Magnus Kühn created SPARK-47061: --- Summary: Wrong result from flatMapGroups using Scala 2.13.x Key: SPARK-47061 URL: https://issues.apache.org/jira/browse/SPARK-47061 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47050) Collect and publish partition level metrics

2024-02-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47050: --- Labels: pull-request-available (was: ) > Collect and publish partition level metrics >

[jira] [Commented] (SPARK-46400) When there are corrupted files in the local maven repo, retry to skip this cache

2024-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817748#comment-17817748 ] Dongjoon Hyun commented on SPARK-46400: --- This is backported to branch-3.5 via

[jira] [Assigned] (SPARK-47058) Add `scalastyle` and `checkstyle` rules to ban `AtomicDoubleArray|CompoundOrdering`

2024-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47058: - Assignee: Dongjoon Hyun > Add `scalastyle` and `checkstyle` rules to ban >

[jira] [Resolved] (SPARK-47058) Add `scalastyle` and `checkstyle` rules to ban `AtomicDoubleArray|CompoundOrdering`

2024-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47058. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45120

[jira] [Updated] (SPARK-47064) Use Scala 2.13 Spark distribution in HiveExternalCatalogVersionsSuite

2024-02-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47064: --- Labels: pull-request-available (was: ) > Use Scala 2.13 Spark distribution in

[jira] [Commented] (SPARK-46400) When there are corrupted files in the local maven repo, retry to skip this cache

2024-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817749#comment-17817749 ] Dongjoon Hyun commented on SPARK-46400: --- This is back ported to branch-3.4 via

[jira] [Created] (SPARK-47066) Add Apple Silicon GitHub Action Job for Maven build

2024-02-15 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47066: - Summary: Add Apple Silicon GitHub Action Job for Maven build Key: SPARK-47066 URL: https://issues.apache.org/jira/browse/SPARK-47066 Project: Spark Issue

[jira] [Updated] (SPARK-47066) Add Apple Silicon Maven build test to GitHub Action

2024-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47066: -- Summary: Add Apple Silicon Maven build test to GitHub Action (was: Add Apple Silicon GitHub

[jira] [Updated] (SPARK-47066) Add Apple Silicon Maven build test to GitHub Action CI

2024-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47066: -- Summary: Add Apple Silicon Maven build test to GitHub Action CI (was: Add Apple Silicon

[jira] [Created] (SPARK-47063) CAST long to timestamp has different behavior for codegen vs interpreted

2024-02-15 Thread Robert Joseph Evans (Jira)
Robert Joseph Evans created SPARK-47063: --- Summary: CAST long to timestamp has different behavior for codegen vs interpreted Key: SPARK-47063 URL: https://issues.apache.org/jira/browse/SPARK-47063

[jira] [Resolved] (SPARK-47064) Use Scala 2.13 Spark distribution in HiveExternalCatalogVersionsSuite

2024-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47064. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45124

[jira] [Assigned] (SPARK-47064) Use Scala 2.13 Spark distribution in HiveExternalCatalogVersionsSuite

2024-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47064: - Assignee: Dongjoon Hyun > Use Scala 2.13 Spark distribution in

[jira] [Updated] (SPARK-46400) When there are corrupted files in the local maven repo, retry to skip this cache

2024-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46400: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > When there are

[jira] [Created] (SPARK-47064) Use Scala 2.13 Spark distribution in HiveExternalCatalogVersionsSuite

2024-02-15 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47064: - Summary: Use Scala 2.13 Spark distribution in HiveExternalCatalogVersionsSuite Key: SPARK-47064 URL: https://issues.apache.org/jira/browse/SPARK-47064 Project:

[jira] [Updated] (SPARK-47064) Use Scala 2.13 Spark distribution in HiveExternalCatalogVersionsSuite

2024-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47064: -- Description: SPARK-45314 makes Scala 2.13 is the default Scala version. As one of migration

[jira] [Updated] (SPARK-46400) When there are corrupted files in the local maven repo, retry to skip this cache

2024-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46400: -- Fix Version/s: 3.5.1 3.4.3 > When there are corrupted files in the local

[jira] [Updated] (SPARK-47066) Add Apple Silicon Maven build test to GitHub Action CI

2024-02-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47066: --- Labels: pull-request-available (was: ) > Add Apple Silicon Maven build test to GitHub

[jira] [Updated] (SPARK-47065) Honor .alias() in pivot aggregation

2024-02-15 Thread Prashant Vithani (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Vithani updated SPARK-47065: - Summary: Honor .alias() in pivot aggregation (was: Honor `alias()` in pivot

[jira] [Created] (SPARK-47065) Honor `alias()` in pivot aggregation

2024-02-15 Thread Prashant Vithani (Jira)
Prashant Vithani created SPARK-47065: Summary: Honor `alias()` in pivot aggregation Key: SPARK-47065 URL: https://issues.apache.org/jira/browse/SPARK-47065 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-47017) Show metrics of the physical plan of RDDScanExec's internal RDD in the history server

2024-02-15 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated SPARK-47017: -- Attachment: simple2.scala > Show metrics of the physical plan of RDDScanExec's internal RDD in the >

[jira] [Updated] (SPARK-47017) Show metrics of the physical plan of RDDScanExec's internal RDD in the history server

2024-02-15 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated SPARK-47017: -- Attachment: eventLogs-local-1708032228180.zip > Show metrics of the physical plan of RDDScanExec's

[jira] [Comment Edited] (SPARK-47017) Show metrics of the physical plan of RDDScanExec's internal RDD in the history server

2024-02-15 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817786#comment-17817786 ] Eric Yang edited comment on SPARK-47017 at 2/15/24 9:30 PM: Here is a simple

[jira] [Updated] (SPARK-47067) Add Daily Apple Silicon Github Action Job (Java/Scala)

2024-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47067: -- Summary: Add Daily Apple Silicon Github Action Job (Java/Scala) (was: Add Daily Apple

[jira] [Comment Edited] (SPARK-47017) Show metrics of the physical plan of RDDScanExec's internal RDD in the history server

2024-02-15 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817786#comment-17817786 ] Eric Yang edited comment on SPARK-47017 at 2/15/24 9:27 PM: Here is a simple

[jira] [Commented] (SPARK-47017) Show metrics of the physical plan of RDDScanExec's internal RDD in the history server

2024-02-15 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817786#comment-17817786 ] Eric Yang commented on SPARK-47017: --- Here is a simple example of this issue (based on the example code

[jira] [Updated] (SPARK-46743) Count bug introduced for scalar subquery when using TEMPORARY VIEW, as compared to using table

2024-02-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46743: --- Labels: pull-request-available (was: ) > Count bug introduced for scalar subquery when

[jira] [Resolved] (SPARK-47066) Add Apple Silicon Maven build test to GitHub Action CI

2024-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47066. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45126

[jira] [Assigned] (SPARK-47066) Add Apple Silicon Maven build test to GitHub Action CI

2024-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47066: - Assignee: Dongjoon Hyun > Add Apple Silicon Maven build test to GitHub Action CI >

[jira] [Created] (SPARK-47070) Subquery rewrite inside an aggregation makes an aggregation invalid

2024-02-15 Thread Anton Lykov (Jira)
Anton Lykov created SPARK-47070: --- Summary: Subquery rewrite inside an aggregation makes an aggregation invalid Key: SPARK-47070 URL: https://issues.apache.org/jira/browse/SPARK-47070 Project: Spark

[jira] [Assigned] (SPARK-47054) Remove pinned version of torch for Python 3.12 support

2024-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47054: - Assignee: Hyukjin Kwon > Remove pinned version of torch for Python 3.12 support >

[jira] [Resolved] (SPARK-47054) Remove pinned version of torch for Python 3.12 support

2024-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47054. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45113

[jira] [Created] (SPARK-47071) inline With expression if it contains aggregate/window expression

2024-02-15 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-47071: --- Summary: inline With expression if it contains aggregate/window expression Key: SPARK-47071 URL: https://issues.apache.org/jira/browse/SPARK-47071 Project: Spark

[jira] [Updated] (SPARK-47071) inline With expression if it contains special expression

2024-02-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-47071: Summary: inline With expression if it contains special expression (was: inline With expression

[jira] [Updated] (SPARK-47071) inline With expression if it contains special expression

2024-02-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47071: --- Labels: pull-request-available (was: ) > inline With expression if it contains special

[jira] [Created] (SPARK-47072) Wrong error message for incorrect ANSI intervals

2024-02-15 Thread Max Gekk (Jira)
Max Gekk created SPARK-47072: Summary: Wrong error message for incorrect ANSI intervals Key: SPARK-47072 URL: https://issues.apache.org/jira/browse/SPARK-47072 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-47072) Wrong error message for incorrect ANSI intervals

2024-02-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47072: --- Labels: pull-request-available (was: ) > Wrong error message for incorrect ANSI intervals

[jira] [Commented] (SPARK-45292) Remove Guava from shared classes from IsolatedClientLoader

2024-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817859#comment-17817859 ] Dongjoon Hyun commented on SPARK-45292: --- I moved this from SPARK-44111 to SPARK-47046,

[jira] [Updated] (SPARK-45292) Remove Guava from shared classes from IsolatedClientLoader

2024-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45292: -- Parent Issue: SPARK-47046 (was: SPARK-44111) > Remove Guava from shared classes from

[jira] [Created] (SPARK-47068) Recover -1 and 0 case for spark.sql.execution.arrow.maxRecordsPerBatch

2024-02-15 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47068: Summary: Recover -1 and 0 case for spark.sql.execution.arrow.maxRecordsPerBatch Key: SPARK-47068 URL: https://issues.apache.org/jira/browse/SPARK-47068 Project:

[jira] [Resolved] (SPARK-47055) Upgrade MyPy 1.8.0

2024-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47055. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45115

[jira] [Updated] (SPARK-47068) Recover -1 and 0 case for spark.sql.execution.arrow.maxRecordsPerBatch

2024-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47068: - Fix Version/s: 4.0.0 3.5.2 3.4.3 > Recover -1 and 0 case

[jira] [Resolved] (SPARK-47067) Add Daily Apple Silicon Github Action Job (Java/Scala)

2024-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47067. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45128

[jira] [Updated] (SPARK-47067) Add Daily Apple Silicon Github Action Job (Java/Scala)

2024-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47067: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Test) > Add Daily Apple Silicon

[jira] [Updated] (SPARK-38098) Add support for ArrayType of nested StructType to arrow-based conversion

2024-02-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-38098: --- Labels: pull-request-available (was: ) > Add support for ArrayType of nested StructType to

[jira] [Assigned] (SPARK-47068) Recover -1 and 0 case for spark.sql.execution.arrow.maxRecordsPerBatch

2024-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47068: Assignee: Hyukjin Kwon > Recover -1 and 0 case for

[jira] [Resolved] (SPARK-46078) Upgrade `pytorch` for Python 3.12

2024-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46078. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45119

[jira] [Updated] (SPARK-47068) Recover -1 and 0 case for spark.sql.execution.arrow.maxRecordsPerBatch

2024-02-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47068: --- Labels: pull-request-available (was: ) > Recover -1 and 0 case for