Hyukjin Kwon created SPARK-47055:
Summary: Upgrade MyPy from 0.920 to 1.8.0
Key: SPARK-47055
URL: https://issues.apache.org/jira/browse/SPARK-47055
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-47055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-47055:
-
Summary: Upgrade MyPy 1.8.0 (was: Upgrade MyPy from 0.920 to 1.8.0)
> Upgrade MyPy 1.8.0
>
[
https://issues.apache.org/jira/browse/SPARK-47055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47055:
---
Labels: pull-request-available (was: )
> Upgrade MyPy 1.8.0
> --
>
>
Dongjoon Hyun created SPARK-47056:
-
Summary: Add a checkstyle rule to ban `FileBackedOutputStream`
Key: SPARK-47056
URL: https://issues.apache.org/jira/browse/SPARK-47056
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-47056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47056:
---
Labels: pull-request-available (was: )
> Add scalastyle and checkstyle rules to ban `FileBa
[
https://issues.apache.org/jira/browse/SPARK-47056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-47056:
--
Summary: Add scalastyle and checkstyle rules to ban
`FileBackedOutputStream` (was: Add a chec
[
https://issues.apache.org/jira/browse/SPARK-46938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17817612#comment-17817612
]
HiuFung Kwok commented on SPARK-46938:
--
To update on this ticket, the Hive SPARK-44
[
https://issues.apache.org/jira/browse/SPARK-47056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-47056:
--
Parent: SPARK-47046
Issue Type: Sub-task (was: Test)
> Add scalastyle and checkstyle
[
https://issues.apache.org/jira/browse/SPARK-46078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-46078:
---
Labels: pull-request-available (was: )
> Upgrade `pytorch` for Python 3.12
> --
[
https://issues.apache.org/jira/browse/SPARK-47056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-47056:
-
Assignee: Dongjoon Hyun
> Add scalastyle and checkstyle rules to ban `FileBackedOutputS
Hyukjin Kwon created SPARK-47057:
Summary: Reenable MyPy Data test
Key: SPARK-47057
URL: https://issues.apache.org/jira/browse/SPARK-47057
Project: Spark
Issue Type: Improvement
Com
[
https://issues.apache.org/jira/browse/SPARK-47039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-47039:
--
Parent: SPARK-47046
Issue Type: Sub-task (was: Test)
> Add a checkstyle rule to ban `
[
https://issues.apache.org/jira/browse/SPARK-47057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-47057:
-
Summary: Reenable MyPy data test (was: Reenable MyPy Data test)
> Reenable MyPy data test
> ---
[
https://issues.apache.org/jira/browse/SPARK-47025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-47025:
--
Summary: Upgrade `Guava` dependency in `docker-integration-tests` test
module (was: Switch `G
[
https://issues.apache.org/jira/browse/SPARK-47056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-47056.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 45116
[https://
Dongjoon Hyun created SPARK-47058:
-
Summary: Add `scalastyle` and `checkstyle` rules to ban
`AtomicDoubleArray|CompoundOrdering`
Key: SPARK-47058
URL: https://issues.apache.org/jira/browse/SPARK-47058
[
https://issues.apache.org/jira/browse/SPARK-47058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47058:
---
Labels: pull-request-available (was: )
> Add `scalastyle` and `checkstyle` rules to ban
>
[
https://issues.apache.org/jira/browse/SPARK-36964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-36964:
---
Labels: pull-request-available (was: )
> Reuse CachedDNSToSwitchMapping for yarn container
Wenchen Fan created SPARK-47059:
---
Summary: attach error context for ALTER COLUMN v1 command
Key: SPARK-47059
URL: https://issues.apache.org/jira/browse/SPARK-47059
Project: Spark
Issue Type: Im
[
https://issues.apache.org/jira/browse/SPARK-47059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47059:
---
Labels: pull-request-available (was: )
> attach error context for ALTER COLUMN v1 command
>
Max Gekk created SPARK-47060:
Summary: Check SparkIllegalArgumentException instead of
IllegalArgumentException
Key: SPARK-47060
URL: https://issues.apache.org/jira/browse/SPARK-47060
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-47060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk updated SPARK-47060:
-
Description: Use checkError() to test the SparkIllegalArgumentException
exception instead of Unsupported
[
https://issues.apache.org/jira/browse/SPARK-47060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk updated SPARK-47060:
-
Description: Use checkError() to test the SparkIllegalArgumentException
exception instead of IllegalArgu
[
https://issues.apache.org/jira/browse/SPARK-47060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk updated SPARK-47060:
-
Summary: Check SparkIllegalArgumentException instead of
IllegalArgumentException in catalyst (was: Chec
[
https://issues.apache.org/jira/browse/SPARK-46876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17817643#comment-17817643
]
Martin Rueckl commented on SPARK-46876:
---
ping.
Can someone review the PR? I had a
Magnus Kühn created SPARK-47061:
---
Summary: Wrong result from flatMapGroups using Scala 2.13.x
Key: SPARK-47061
URL: https://issues.apache.org/jira/browse/SPARK-47061
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-47059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-47059:
Assignee: Wenchen Fan
> attach error context for ALTER COLUMN v1 command
> --
[
https://issues.apache.org/jira/browse/SPARK-47059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-47059.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 45121
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-47050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47050:
---
Labels: pull-request-available (was: )
> Collect and publish partition level metrics
>
Robert Joseph Evans created SPARK-47063:
---
Summary: CAST long to timestamp has different behavior for codegen
vs interpreted
Key: SPARK-47063
URL: https://issues.apache.org/jira/browse/SPARK-47063
Dongjoon Hyun created SPARK-47064:
-
Summary: Use Scala 2.13 Spark distribution in
HiveExternalCatalogVersionsSuite
Key: SPARK-47064
URL: https://issues.apache.org/jira/browse/SPARK-47064
Project: Spar
Prashant Vithani created SPARK-47065:
Summary: Honor `alias()` in pivot aggregation
Key: SPARK-47065
URL: https://issues.apache.org/jira/browse/SPARK-47065
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-47065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prashant Vithani updated SPARK-47065:
-
Summary: Honor .alias() in pivot aggregation (was: Honor `alias()` in
pivot aggregation
[
https://issues.apache.org/jira/browse/SPARK-47064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47064:
---
Labels: pull-request-available (was: )
> Use Scala 2.13 Spark distribution in HiveExternalC
[
https://issues.apache.org/jira/browse/SPARK-47064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-47064.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 45124
[https://
[
https://issues.apache.org/jira/browse/SPARK-47064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-47064:
-
Assignee: Dongjoon Hyun
> Use Scala 2.13 Spark distribution in HiveExternalCatalogVersi
[
https://issues.apache.org/jira/browse/SPARK-47064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-47064:
--
Description:
SPARK-45314 makes Scala 2.13 is the default Scala version.
As one of migration pa
[
https://issues.apache.org/jira/browse/SPARK-46400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-46400:
--
Fix Version/s: 3.5.1
3.4.3
> When there are corrupted files in the local ma
[
https://issues.apache.org/jira/browse/SPARK-46400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17817748#comment-17817748
]
Dongjoon Hyun commented on SPARK-46400:
---
This is backported to branch-3.5 via http
[
https://issues.apache.org/jira/browse/SPARK-46400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17817749#comment-17817749
]
Dongjoon Hyun commented on SPARK-46400:
---
This is back ported to branch-3.4 via htt
[
https://issues.apache.org/jira/browse/SPARK-46400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-46400:
--
Parent: SPARK-47046
Issue Type: Sub-task (was: Improvement)
> When there are corrupte
[
https://issues.apache.org/jira/browse/SPARK-47058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-47058:
-
Assignee: Dongjoon Hyun
> Add `scalastyle` and `checkstyle` rules to ban
> `AtomicDoub
[
https://issues.apache.org/jira/browse/SPARK-47058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-47058.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 45120
[https://
Dongjoon Hyun created SPARK-47066:
-
Summary: Add Apple Silicon GitHub Action Job for Maven build
Key: SPARK-47066
URL: https://issues.apache.org/jira/browse/SPARK-47066
Project: Spark
Issue T
[
https://issues.apache.org/jira/browse/SPARK-47066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-47066:
--
Summary: Add Apple Silicon Maven build test to GitHub Action (was: Add
Apple Silicon GitHub A
[
https://issues.apache.org/jira/browse/SPARK-47066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-47066:
--
Summary: Add Apple Silicon Maven build test to GitHub Action CI (was: Add
Apple Silicon Maven
[
https://issues.apache.org/jira/browse/SPARK-47066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47066:
---
Labels: pull-request-available (was: )
> Add Apple Silicon Maven build test to GitHub Actio
[
https://issues.apache.org/jira/browse/SPARK-47017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eric Yang updated SPARK-47017:
--
Attachment: simple2.scala
> Show metrics of the physical plan of RDDScanExec's internal RDD in the
>
[
https://issues.apache.org/jira/browse/SPARK-47017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eric Yang updated SPARK-47017:
--
Attachment: eventLogs-local-1708032228180.zip
> Show metrics of the physical plan of RDDScanExec's int
[
https://issues.apache.org/jira/browse/SPARK-47017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17817786#comment-17817786
]
Eric Yang commented on SPARK-47017:
---
Here is a simple example of this issue (based on
[
https://issues.apache.org/jira/browse/SPARK-47017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17817786#comment-17817786
]
Eric Yang edited comment on SPARK-47017 at 2/15/24 9:27 PM:
[
https://issues.apache.org/jira/browse/SPARK-47017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17817786#comment-17817786
]
Eric Yang edited comment on SPARK-47017 at 2/15/24 9:30 PM:
[
https://issues.apache.org/jira/browse/SPARK-46743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-46743:
---
Labels: pull-request-available (was: )
> Count bug introduced for scalar subquery when usin
[
https://issues.apache.org/jira/browse/SPARK-47066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-47066:
-
Assignee: Dongjoon Hyun
> Add Apple Silicon Maven build test to GitHub Action CI
>
[
https://issues.apache.org/jira/browse/SPARK-47066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-47066.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 45126
[https://
[
https://issues.apache.org/jira/browse/SPARK-47067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-47067:
--
Summary: Add Daily Apple Silicon Github Action Job (Java/Scala) (was: Add
Daily Apple Silicon
Hyukjin Kwon created SPARK-47068:
Summary: Recover -1 and 0 case for
spark.sql.execution.arrow.maxRecordsPerBatch
Key: SPARK-47068
URL: https://issues.apache.org/jira/browse/SPARK-47068
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-47067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-47067.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 45128
[https://
[
https://issues.apache.org/jira/browse/SPARK-47067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-47067:
--
Parent: SPARK-44111
Issue Type: Sub-task (was: Test)
> Add Daily Apple Silicon Github
[
https://issues.apache.org/jira/browse/SPARK-38098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-38098:
---
Labels: pull-request-available (was: )
> Add support for ArrayType of nested StructType to
[
https://issues.apache.org/jira/browse/SPARK-47055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-47055.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 45115
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-46078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-46078.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 45119
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-47068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47068:
---
Labels: pull-request-available (was: )
> Recover -1 and 0 case for spark.sql.execution.arro
[
https://issues.apache.org/jira/browse/SPARK-47068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-47068:
Assignee: Hyukjin Kwon
> Recover -1 and 0 case for spark.sql.execution.arrow.maxRecordsPe
[
https://issues.apache.org/jira/browse/SPARK-47068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-47068:
-
Fix Version/s: 4.0.0
3.5.2
3.4.3
> Recover -1 and 0 case f
Anton Lykov created SPARK-47070:
---
Summary: Subquery rewrite inside an aggregation makes an
aggregation invalid
Key: SPARK-47070
URL: https://issues.apache.org/jira/browse/SPARK-47070
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-47054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-47054:
-
Assignee: Hyukjin Kwon
> Remove pinned version of torch for Python 3.12 support
> -
[
https://issues.apache.org/jira/browse/SPARK-47054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-47054.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 45113
[https://
Wenchen Fan created SPARK-47071:
---
Summary: inline With expression if it contains aggregate/window
expression
Key: SPARK-47071
URL: https://issues.apache.org/jira/browse/SPARK-47071
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-47071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-47071:
Summary: inline With expression if it contains special expression (was:
inline With expression if
[
https://issues.apache.org/jira/browse/SPARK-47071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47071:
---
Labels: pull-request-available (was: )
> inline With expression if it contains special expr
Max Gekk created SPARK-47072:
Summary: Wrong error message for incorrect ANSI intervals
Key: SPARK-47072
URL: https://issues.apache.org/jira/browse/SPARK-47072
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-45292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-45292:
--
Parent Issue: SPARK-47046 (was: SPARK-44111)
> Remove Guava from shared classes from Isolated
[
https://issues.apache.org/jira/browse/SPARK-47072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47072:
---
Labels: pull-request-available (was: )
> Wrong error message for incorrect ANSI intervals
>
[
https://issues.apache.org/jira/browse/SPARK-45292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17817859#comment-17817859
]
Dongjoon Hyun commented on SPARK-45292:
---
I moved this from SPARK-44111 to SPARK-47
75 matches
Mail list logo