Faiz Halde created SPARK-47917:
--
Summary: Accounting the impact of failures in spark jobs
Key: SPARK-47917
URL: https://issues.apache.org/jira/browse/SPARK-47917
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-46032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17794376#comment-17794376
]
Faiz Halde commented on SPARK-46032:
So we had a dire need to fix this and the following patch
[
https://issues.apache.org/jira/browse/SPARK-45255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17791996#comment-17791996
]
Faiz Halde edited comment on SPARK-45255 at 12/1/23 10:40 AM:
--
it seems to
[
https://issues.apache.org/jira/browse/SPARK-45255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17791996#comment-17791996
]
Faiz Halde commented on SPARK-45255:
it seems to be failing on another issue now
a fresh project
[
https://issues.apache.org/jira/browse/SPARK-45255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17791996#comment-17791996
]
Faiz Halde edited comment on SPARK-45255 at 12/1/23 10:39 AM:
--
it seems to
[
https://issues.apache.org/jira/browse/SPARK-45255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17791996#comment-17791996
]
Faiz Halde edited comment on SPARK-45255 at 12/1/23 10:39 AM:
--
it seems to
[
https://issues.apache.org/jira/browse/SPARK-45255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17791996#comment-17791996
]
Faiz Halde edited comment on SPARK-45255 at 12/1/23 10:38 AM:
--
it seems to
[
https://issues.apache.org/jira/browse/SPARK-46046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Faiz Halde updated SPARK-46046:
---
Description:
Hello,
We use spark 3.5.0 and were wondering if the following is achievable using
[
https://issues.apache.org/jira/browse/SPARK-46046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Faiz Halde updated SPARK-46046:
---
Description:
Hello,
We use spark 3.5.0 and were wondering if the following is achievable using
Faiz Halde created SPARK-46046:
--
Summary: Isolated classloader per spark session
Key: SPARK-46046
URL: https://issues.apache.org/jira/browse/SPARK-46046
Project: Spark
Issue Type: Question
[
https://issues.apache.org/jira/browse/SPARK-42471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17786292#comment-17786292
]
Faiz Halde edited comment on SPARK-42471 at 11/15/23 10:22 AM:
---
Hello, our
[
https://issues.apache.org/jira/browse/SPARK-45598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Faiz Halde updated SPARK-45598:
---
Description:
Spark version 3.5.0
Spark Connect version 3.5.0
Delta table 3.0.0
Spark connect
[
https://issues.apache.org/jira/browse/SPARK-45598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Faiz Halde updated SPARK-45598:
---
Description:
Spark version 3.5.0
Spark Connect version 3.5.0
Delta table 3.0.0
Spark connect
[
https://issues.apache.org/jira/browse/SPARK-45598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Faiz Halde updated SPARK-45598:
---
Description:
Spark version 3.5.0
Spark Connect version 3.5.0
Delta table 3.0.0
Spark connect
[
https://issues.apache.org/jira/browse/SPARK-45598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779843#comment-17779843
]
Faiz Halde commented on SPARK-45598:
Hi, do we have any updates here? Happy to help
> Delta table
[
https://issues.apache.org/jira/browse/SPARK-45598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1246#comment-1246
]
Faiz Halde edited comment on SPARK-45598 at 10/19/23 4:04 PM:
--
Hi
[
https://issues.apache.org/jira/browse/SPARK-45598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1246#comment-1246
]
Faiz Halde commented on SPARK-45598:
Hi [~sdaberdaku] , corrected the title. I tested it with 3.0.0
[
https://issues.apache.org/jira/browse/SPARK-45598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Faiz Halde updated SPARK-45598:
---
Summary: Delta table 3.0.0 not working with Spark Connect 3.5.0 (was:
Delta table 3.0-rc2 not
[
https://issues.apache.org/jira/browse/SPARK-45598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Faiz Halde updated SPARK-45598:
---
Description:
Spark version 3.5.0
Spark Connect version 3.5.0
Delta table 3.0-rc2
Spark connect
[
https://issues.apache.org/jira/browse/SPARK-44526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Faiz Halde updated SPARK-44526:
---
Affects Version/s: 3.4.1
(was: 3.5.0)
> Porting k8s PVC reuse logic to
[
https://issues.apache.org/jira/browse/SPARK-44526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Faiz Halde updated SPARK-44526:
---
Affects Version/s: 3.5.0
(was: 3.4.1)
> Porting k8s PVC reuse logic to
Faiz Halde created SPARK-45598:
--
Summary: Delta table 3.0-rc2 not working with Spark Connect 3.5.0
Key: SPARK-45598
URL: https://issues.apache.org/jira/browse/SPARK-45598
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-45255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17768040#comment-17768040
]
Faiz Halde edited comment on SPARK-45255 at 9/22/23 2:31 PM:
-
to get past
[
https://issues.apache.org/jira/browse/SPARK-45255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17768040#comment-17768040
]
Faiz Halde edited comment on SPARK-45255 at 9/22/23 2:31 PM:
-
to get past
[
https://issues.apache.org/jira/browse/SPARK-45255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17768040#comment-17768040
]
Faiz Halde commented on SPARK-45255:
to get pas the error
[
https://issues.apache.org/jira/browse/SPARK-45255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17768037#comment-17768037
]
Faiz Halde commented on SPARK-45255:
For now, I unblocked myself by manually building spark connect
[
https://issues.apache.org/jira/browse/SPARK-45255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17768037#comment-17768037
]
Faiz Halde edited comment on SPARK-45255 at 9/22/23 2:29 PM:
-
For now, I
[
https://issues.apache.org/jira/browse/SPARK-45255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Faiz Halde updated SPARK-45255:
---
Description:
java 1.8, sbt 1.9, scala 2.12
I have a very simple repo with the following
[
https://issues.apache.org/jira/browse/SPARK-45255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Faiz Halde updated SPARK-45255:
---
Description:
java 1.8, sbt 1.9, scala 2.12
I have a very simple repo with the following
[
https://issues.apache.org/jira/browse/SPARK-45255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Faiz Halde updated SPARK-45255:
---
Issue Type: Bug (was: New Feature)
> Spark connect client failing with
[
https://issues.apache.org/jira/browse/SPARK-45255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Faiz Halde updated SPARK-45255:
---
Description:
I have a very simple repo with the following dependency in `build.sbt`
```
[
https://issues.apache.org/jira/browse/SPARK-45255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Faiz Halde updated SPARK-45255:
---
Description:
I have a very simple repo with the following dependency in `build.sbt`
```
Faiz Halde created SPARK-45255:
--
Summary: Spark connect client failing with
java.lang.NoClassDefFoundError
Key: SPARK-45255
URL: https://issues.apache.org/jira/browse/SPARK-45255
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-45255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Faiz Halde updated SPARK-45255:
---
Description:
I have a very simple repo with the following dependency in `build.sbt`
```
[
https://issues.apache.org/jira/browse/SPARK-44526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Faiz Halde updated SPARK-44526:
---
Description:
Hi,
This ticket is meant to understand the work that would be involved in porting
[
https://issues.apache.org/jira/browse/SPARK-44526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Faiz Halde updated SPARK-44526:
---
Description:
Hi,
This ticket is meant to understand the work that would be involved in porting
[
https://issues.apache.org/jira/browse/SPARK-44526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Faiz Halde updated SPARK-44526:
---
Description:
Hi,
This ticket is meant to understand the work that would be involved in porting
Faiz Halde created SPARK-44526:
--
Summary: Porting k8s PVC reuse logic to spark standalone
Key: SPARK-44526
URL: https://issues.apache.org/jira/browse/SPARK-44526
Project: Spark
Issue Type: New
Faiz Halde created SPARK-43426:
--
Summary: Introducing a new SparkListenerEvent for jobs running in
AQE mode
Key: SPARK-43426
URL: https://issues.apache.org/jira/browse/SPARK-43426
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-43408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Faiz Halde updated SPARK-43408:
---
Description:
Does caching benefit a spark job with only a single action in it? Spark IIRC
already
[
https://issues.apache.org/jira/browse/SPARK-43408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Faiz Halde updated SPARK-43408:
---
Description:
Does caching benefit a spark job with only a single action in it? Spark IIRC
already
[
https://issues.apache.org/jira/browse/SPARK-43408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Faiz Halde updated SPARK-43408:
---
Description:
Does caching benefit a spark job with only a single action in it? Spark IIRC
already
Faiz Halde created SPARK-43408:
--
Summary: Spark caching in the context of a single job
Key: SPARK-43408
URL: https://issues.apache.org/jira/browse/SPARK-43408
Project: Spark
Issue Type:
Faiz Halde created SPARK-43407:
--
Summary: Can executors recover/reuse shuffle files upon failure?
Key: SPARK-43407
URL: https://issues.apache.org/jira/browse/SPARK-43407
Project: Spark
Issue
44 matches
Mail list logo
