Jason Xu created SPARK-38388:
Summary: Repartition + Stage retries could lead to incorrect data
Key: SPARK-38388
URL: https://issues.apache.org/jira/browse/SPARK-38388
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-38388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Xu updated SPARK-38388:
-
Description:
Spark repartition uses RoundRobinPartitioning, the generated results is
non-deterministic
[
https://issues.apache.org/jira/browse/SPARK-38388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17499979#comment-17499979
]
Jason Xu commented on SPARK-38388:
--
I think one potential solution is do not allow part
Max Gekk created SPARK-38389:
Summary: Add the `DATEDIFF` and `DATE_DIFF` aliases for
`TIMESTAMPDIFF()`
Key: SPARK-38389
URL: https://issues.apache.org/jira/browse/SPARK-38389
Project: Spark
Iss
[
https://issues.apache.org/jira/browse/SPARK-38389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk updated SPARK-38389:
-
Description:
Introduce the datediff()/date_diff() function, which takes three arguments:
unit, and two
[
https://issues.apache.org/jira/browse/SPARK-38389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38389:
Assignee: Apache Spark (was: Max Gekk)
> Add the `DATEDIFF` and `DATE_DIFF` aliases for
[
https://issues.apache.org/jira/browse/SPARK-38389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38389:
Assignee: Max Gekk (was: Apache Spark)
> Add the `DATEDIFF` and `DATE_DIFF` aliases for
[
https://issues.apache.org/jira/browse/SPARK-38389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1755#comment-1755
]
Apache Spark commented on SPARK-38389:
--
User 'MaxGekk' has created a pull request f
Mikhail Pochatkin created SPARK-38390:
-
Summary: Spark submit k8s with proxy user
Key: SPARK-38390
URL: https://issues.apache.org/jira/browse/SPARK-38390
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-38390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500076#comment-17500076
]
MIKHAIL POCHATKIN commented on SPARK-38390:
---
Correct command line
{code:java}
jiaan.geng created SPARK-38391:
--
Summary: Datasource v2 supports complete partial sort pushdown
Key: SPARK-38391
URL: https://issues.apache.org/jira/browse/SPARK-38391
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-38391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38391:
Assignee: (was: Apache Spark)
> Datasource v2 supports complete partial sort pushdown
[
https://issues.apache.org/jira/browse/SPARK-38391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500104#comment-17500104
]
Apache Spark commented on SPARK-38391:
--
User 'beliefer' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-38391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38391:
Assignee: Apache Spark
> Datasource v2 supports complete partial sort pushdown
>
[
https://issues.apache.org/jira/browse/SPARK-38340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500130#comment-17500130
]
Bjørn Jørgensen commented on SPARK-38340:
-
ok, well all the test in github now a
[
https://issues.apache.org/jira/browse/SPARK-38340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500130#comment-17500130
]
Bjørn Jørgensen edited comment on SPARK-38340 at 3/2/22, 1:01 PM:
Martin Tzvetanov Grigorov created SPARK-38392:
-
Summary: [K8S] Improve the names used for K8S namespace and driver
pod in integration tests
Key: SPARK-38392
URL: https://issues.apache.org/jira/browse/S
[
https://issues.apache.org/jira/browse/SPARK-38392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38392:
Assignee: Apache Spark
> [K8S] Improve the names used for K8S namespace and driver pod in
[
https://issues.apache.org/jira/browse/SPARK-38392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38392:
Assignee: (was: Apache Spark)
> [K8S] Improve the names used for K8S namespace and dr
[
https://issues.apache.org/jira/browse/SPARK-38392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500158#comment-17500158
]
Apache Spark commented on SPARK-38392:
--
User 'martin-g' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-38342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-38342:
Assignee: Yang Jie
> Clean up deprecated api usage of Ivy
> -
[
https://issues.apache.org/jira/browse/SPARK-38342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-38342.
--
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 35672
[https://gi
Yang Jie created SPARK-38393:
Summary: Clean up deprecated usage of GenSeq/GenMap
Key: SPARK-38393
URL: https://issues.apache.org/jira/browse/SPARK-38393
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-38393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38393:
Assignee: (was: Apache Spark)
> Clean up deprecated usage of GenSeq/GenMap
>
[
https://issues.apache.org/jira/browse/SPARK-38393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500206#comment-17500206
]
Apache Spark commented on SPARK-38393:
--
User 'LuciferYang' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-38393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500207#comment-17500207
]
Apache Spark commented on SPARK-38393:
--
User 'LuciferYang' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-38393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38393:
Assignee: Apache Spark
> Clean up deprecated usage of GenSeq/GenMap
> ---
Steve Loughran created SPARK-38394:
--
Summary: build of spark sql against hadoop-3.4.0-snapshot failing
with bouncycastle classpath error
Key: SPARK-38394
URL: https://issues.apache.org/jira/browse/SPARK-38394
[
https://issues.apache.org/jira/browse/SPARK-33206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500271#comment-17500271
]
Apache Spark commented on SPARK-33206:
--
User 'attilapiros' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-33206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500272#comment-17500272
]
Apache Spark commented on SPARK-33206:
--
User 'attilapiros' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-38389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-38389.
--
Resolution: Fixed
Issue resolved by pull request 35709
[https://github.com/apache/spark/pull/35709]
>
[
https://issues.apache.org/jira/browse/SPARK-38388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Xu updated SPARK-38388:
-
Description:
Spark repartition uses RoundRobinPartitioning, the generated results is
non-deterministic
[
https://issues.apache.org/jira/browse/SPARK-38388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Xu updated SPARK-38388:
-
Description:
Spark repartition uses RoundRobinPartitioning, the generated results is
non-deterministic
Krishna Sangeeth KS created SPARK-38395:
---
Summary: Pyspark issue in resolving column when there is dot (.)
Key: SPARK-38395
URL: https://issues.apache.org/jira/browse/SPARK-38395
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-38392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-38392.
---
Fix Version/s: 3.3.0
3.2.2
Resolution: Fixed
Issue resolved by pul
[
https://issues.apache.org/jira/browse/SPARK-38392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-38392:
-
Assignee: Martin Tzvetanov Grigorov
> [K8S] Improve the names used for K8S namespace an
[
https://issues.apache.org/jira/browse/SPARK-38392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38392:
--
Summary: Add `spark-` prefix to namespaces and `-driver` suffix to drivers
during IT (was: Ad
[
https://issues.apache.org/jira/browse/SPARK-38353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yihong He updated SPARK-38353:
--
Description:
For example, for the following code:
{code:java}
pdf = pd.DataFrame(
[(0.2, 0.3),
[
https://issues.apache.org/jira/browse/SPARK-38392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38392:
--
Summary: Add spark- prefix to namespaces and -driver suffix to drivers
during IT (was: [K8S]
[
https://issues.apache.org/jira/browse/SPARK-38353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yihong He updated SPARK-38353:
--
Description:
For example, for the following code:
{code:java}
pdf = pd.DataFrame(
[(0.2, 0.3),
[
https://issues.apache.org/jira/browse/SPARK-20050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500321#comment-17500321
]
James Grinter commented on SPARK-20050:
---
You're just working around a genuine bug,
[
https://issues.apache.org/jira/browse/SPARK-38392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38392:
--
Component/s: Tests
> [K8S] Improve the names used for K8S namespace and driver pod in integrat
[
https://issues.apache.org/jira/browse/SPARK-38353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yihong He updated SPARK-38353:
--
Description:
Create the ticket since instrumenting _{_}enter{_}_ and _{_}exit{_}_ magic
methods for P
[
https://issues.apache.org/jira/browse/SPARK-38353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yihong He updated SPARK-38353:
--
Description:
Create the ticket since instrumenting {_}{{_}}enter{{_}}{_} and
{_}{{_}}exit{{_}}{_} mag
[
https://issues.apache.org/jira/browse/SPARK-38353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yihong He updated SPARK-38353:
--
Description:
Create the ticket since instrumenting {_}{{_}}enter{{_}}{_} and
{_}{{_}}exit{{_}}{_} mag
[
https://issues.apache.org/jira/browse/SPARK-38029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38029:
--
Fix Version/s: 3.2.2
> Support docker-desktop K8S integration test in SBT
> --
[
https://issues.apache.org/jira/browse/SPARK-38071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38071:
--
Fix Version/s: 3.2.2
> Support K8s namespace parameter in SBT K8s IT
> ---
[
https://issues.apache.org/jira/browse/SPARK-38072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38072:
--
Fix Version/s: 3.2.2
> Support K8s imageTag parameter in SBT K8s IT
>
[
https://issues.apache.org/jira/browse/SPARK-38379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500354#comment-17500354
]
Thomas Graves commented on SPARK-38379:
---
just going by the stack trace this looks
[
https://issues.apache.org/jira/browse/SPARK-38048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38048:
--
Fix Version/s: 3.2.2
> Add IntegrationTestBackend.describePods to support all K8s test backend
Dongjoon Hyun created SPARK-38396:
-
Summary: Improve K8s Integration Tests
Key: SPARK-38396
URL: https://issues.apache.org/jira/browse/SPARK-38396
Project: Spark
Issue Type: Umbrella
[
https://issues.apache.org/jira/browse/SPARK-38071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38071:
--
Parent: SPARK-38396
Issue Type: Sub-task (was: Test)
> Support K8s namespace paramete
[
https://issues.apache.org/jira/browse/SPARK-38072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38072:
--
Parent: SPARK-38396
Issue Type: Sub-task (was: Test)
> Support K8s imageTag parameter
[
https://issues.apache.org/jira/browse/SPARK-38029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38029:
--
Parent: SPARK-38396
Issue Type: Sub-task (was: Test)
> Support docker-desktop K8S int
[
https://issues.apache.org/jira/browse/SPARK-38392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38392:
--
Parent: SPARK-38396
Issue Type: Sub-task (was: Improvement)
> Add `spark-` prefix to
[
https://issues.apache.org/jira/browse/SPARK-38048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38048:
--
Parent: SPARK-38396
Issue Type: Sub-task (was: Test)
> Add IntegrationTestBackend.des
[
https://issues.apache.org/jira/browse/SPARK-38396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38396:
--
Affects Version/s: (was: 3.2.2)
> Improve K8s Integration Tests
>
[
https://issues.apache.org/jira/browse/SPARK-38396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38396:
--
Target Version/s: 3.3.0
> Improve K8s Integration Tests
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-38396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38396:
--
Labels: releasenotes (was: )
> Improve K8s Integration Tests
> -
[
https://issues.apache.org/jira/browse/SPARK-38244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38244:
--
Parent: SPARK-38396
Issue Type: Sub-task (was: Bug)
> Upgrade kubernetes-client to 5.
[
https://issues.apache.org/jira/browse/SPARK-38396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38396:
--
Description:
This JIRA aims to improve K8s integration tests for the following recent
activit
[
https://issues.apache.org/jira/browse/SPARK-38396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38396:
--
Description:
This JIRA aims to improve K8s integration tests for the following recent
activit
[
https://issues.apache.org/jira/browse/SPARK-38022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38022:
--
Parent: SPARK-38396
Issue Type: Sub-task (was: Test)
> Use relativePath for K8s remot
[
https://issues.apache.org/jira/browse/SPARK-38272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38272:
--
Parent: SPARK-38396
Issue Type: Sub-task (was: Improvement)
> Use docker-desktop inst
[
https://issues.apache.org/jira/browse/SPARK-36553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Huaxin Gao resolved SPARK-36553.
Fix Version/s: 3.1.3
3.3.0
3.2.2
Assignee: zhengruif
[
https://issues.apache.org/jira/browse/SPARK-38241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38241:
--
Parent: SPARK-38396
Issue Type: Sub-task (was: Task)
> Close KubernetesClient in K8S
[
https://issues.apache.org/jira/browse/SPARK-38081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38081:
--
Parent: SPARK-38396
Issue Type: Sub-task (was: Test)
> Support cloud-backend in K8s I
[
https://issues.apache.org/jira/browse/SPARK-37998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-37998:
--
Parent: SPARK-38396
Issue Type: Sub-task (was: Test)
> Use `rbac.authorization.k8s.io
[
https://issues.apache.org/jira/browse/SPARK-37645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-37645:
--
Parent: SPARK-38396
Issue Type: Sub-task (was: Improvement)
> Word spell error - "lab
[
https://issues.apache.org/jira/browse/SPARK-37529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-37529:
--
Parent Issue: SPARK-38396 (was: SPARK-33772)
> Support K8s integration tests for Java 17
> --
[
https://issues.apache.org/jira/browse/SPARK-38269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Huaxin Gao resolved SPARK-38269.
Fix Version/s: 3.3.0
Assignee: Yang Jie
Resolution: Fixed
> Clean up redundant typ
[
https://issues.apache.org/jira/browse/SPARK-38302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38302:
--
Parent Issue: SPARK-38396 (was: SPARK-33772)
> Use Java 17 in K8S integration tests when sett
[
https://issues.apache.org/jira/browse/SPARK-37319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-37319:
--
Parent Issue: SPARK-38396 (was: SPARK-33772)
> Support K8s image building with Java 17
>
[
https://issues.apache.org/jira/browse/SPARK-37354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-37354:
--
Parent: SPARK-38396
Issue Type: Sub-task (was: Bug)
> Make the Java version installed
[
https://issues.apache.org/jira/browse/SPARK-38396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-38396:
-
Assignee: William Hyun
> Improve K8s Integration Tests
> -
[
https://issues.apache.org/jira/browse/SPARK-38396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-38396.
---
Fix Version/s: 3.3.0
Resolution: Fixed
> Improve K8s Integration Tests
>
[
https://issues.apache.org/jira/browse/SPARK-38272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38272:
--
Fix Version/s: 3.2.2
> Use docker-desktop instead of docker-for-desktop for Docker K8S IT depl
[
https://issues.apache.org/jira/browse/SPARK-33206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-33206:
--
Fix Version/s: 3.2.2
> Spark Shuffle Index Cache calculates memory usage wrong
> -
[
https://issues.apache.org/jira/browse/SPARK-38396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38396:
--
Description:
This JIRA aims to improve K8s integration tests for the following recent
activit
[
https://issues.apache.org/jira/browse/SPARK-38353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haejoon Lee updated SPARK-38353:
Summary: Instrument __enter__ and __exit__ magic methods for pandas API on
Spark (was: Instrument
[
https://issues.apache.org/jira/browse/SPARK-38353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haejoon Lee updated SPARK-38353:
Description:
Create the ticket since instrumenting __enter__ and __exit__ magic methods for
panda
[
https://issues.apache.org/jira/browse/SPARK-38353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haejoon Lee updated SPARK-38353:
Description:
Create the ticket since instrumenting _{_}enter{_}_ and _{_}exit{_}_ magic
methods f
[
https://issues.apache.org/jira/browse/SPARK-38379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500416#comment-17500416
]
Dongjoon Hyun commented on SPARK-38379:
---
Could you describe your procedure about t
[
https://issues.apache.org/jira/browse/SPARK-38379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500416#comment-17500416
]
Dongjoon Hyun edited comment on SPARK-38379 at 3/2/22, 10:54 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-38081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38081:
--
Fix Version/s: 3.2.2
> Support cloud-backend in K8s IT with SBT
>
[
https://issues.apache.org/jira/browse/SPARK-38396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38396:
--
Description:
This JIRA aims to improve K8s integration tests for the following recent
activit
[
https://issues.apache.org/jira/browse/SPARK-37895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500419#comment-17500419
]
Pablo Langa Blanco commented on SPARK-37895:
I'm working on a fix
> Error w
[
https://issues.apache.org/jira/browse/SPARK-38191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-38191.
--
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 35693
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-37753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37753:
Assignee: (was: Apache Spark)
> DynamicJoinSelection.shouldDemoteBroadcastHashJoin sh
[
https://issues.apache.org/jira/browse/SPARK-37753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500446#comment-17500446
]
Apache Spark commented on SPARK-37753:
--
User 'ekoifman' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-37753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37753:
Assignee: Apache Spark
> DynamicJoinSelection.shouldDemoteBroadcastHashJoin should apply
[
https://issues.apache.org/jira/browse/SPARK-38310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500448#comment-17500448
]
Wilfred Spiegelenburg commented on SPARK-38310:
---
Spark on yarn uses the --
Dongjoon Hyun created SPARK-38397:
-
Summary: Support Kueue: K8s-native Job Queueing
Key: SPARK-38397
URL: https://issues.apache.org/jira/browse/SPARK-38397
Project: Spark
Issue Type: Improvem
[
https://issues.apache.org/jira/browse/SPARK-38397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38397:
--
Description:
This issue is tracking K8s-native Job Queueing related work.
* [https://github.c
[
https://issues.apache.org/jira/browse/SPARK-38397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38397:
--
Description:
This issue is tracking K8s-native Job Queueing related work.
* [https://github.c
[
https://issues.apache.org/jira/browse/SPARK-38397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38397:
--
Description:
There are several ways to run Spark on K8s including vanilla `spark-submit`
with
[
https://issues.apache.org/jira/browse/SPARK-38340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500487#comment-17500487
]
Yang Jie commented on SPARK-38340:
--
cc [~hyukjin.kwon] , do you know how GA tests code
[
https://issues.apache.org/jira/browse/SPARK-38395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krishna Sangeeth KS updated SPARK-38395:
Description:
Pyspark apply in pandas have some difficulty in resolving columns whe
[
https://issues.apache.org/jira/browse/SPARK-38334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38334:
--
Issue Type: Improvement (was: Story)
> Implement support for DEFAULT values for columns in ta
[
https://issues.apache.org/jira/browse/SPARK-38334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-38334:
--
Affects Version/s: 3.3.0
(was: 3.2.1)
> Implement support for DEFAU
1 - 100 of 119 matches
Mail list logo