[
https://issues.apache.org/jira/browse/SPARK-40085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-40085.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 37524
[
https://issues.apache.org/jira/browse/SPARK-40085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-40085:
Assignee: Wenchen Fan
> use INTERNAL_ERROR error class instead of IllegalStateException to
[
https://issues.apache.org/jira/browse/SPARK-40096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40096:
Assignee: (was: Apache Spark)
> Finalize shuffle merge slow due to connection
[
https://issues.apache.org/jira/browse/SPARK-40096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40096:
Assignee: Apache Spark
> Finalize shuffle merge slow due to connection creation fails
>
[
https://issues.apache.org/jira/browse/SPARK-40096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580059#comment-17580059
]
Apache Spark commented on SPARK-40096:
--
User 'wankunde' has created a pull request for this issue:
Wan Kun created SPARK-40096:
---
Summary: Finalize shuffle merge slow due to connection creation
fails
Key: SPARK-40096
URL: https://issues.apache.org/jira/browse/SPARK-40096
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-39989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580046#comment-17580046
]
Apache Spark commented on SPARK-39989:
--
User 'linhongliu-db' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-39989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580045#comment-17580045
]
Apache Spark commented on SPARK-39989:
--
User 'linhongliu-db' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-38334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580028#comment-17580028
]
Daniel commented on SPARK-38334:
I think it is OK to declare that this feature is implemented in Apache
[
https://issues.apache.org/jira/browse/SPARK-38334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580028#comment-17580028
]
Daniel edited comment on SPARK-38334 at 8/16/22 3:48 AM:
-
I think it is OK to
[
https://issues.apache.org/jira/browse/SPARK-38334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daniel resolved SPARK-38334.
Fix Version/s: 3.4.0
Resolution: Fixed
> Implement support for DEFAULT values for columns in
[
https://issues.apache.org/jira/browse/SPARK-40095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580022#comment-17580022
]
Apache Spark commented on SPARK-40095:
--
User 'zhengruifeng' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-40095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40095:
Assignee: (was: Apache Spark)
> sc.uiWebUrl should not throw exception when webui is
[
https://issues.apache.org/jira/browse/SPARK-40095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40095:
Assignee: Apache Spark
> sc.uiWebUrl should not throw exception when webui is disabled
>
[
https://issues.apache.org/jira/browse/SPARK-40095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580021#comment-17580021
]
Apache Spark commented on SPARK-40095:
--
User 'zhengruifeng' has created a pull request for this
Ruifeng Zheng created SPARK-40095:
-
Summary: sc.uiWebUrl should not throw exception when webui is
disabled
Key: SPARK-40095
URL: https://issues.apache.org/jira/browse/SPARK-40095
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang resolved SPARK-4.
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 37430
[
https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang reassigned SPARK-4:
--
Assignee: Daniel
> Add config to toggle whether to automatically add default values
[
https://issues.apache.org/jira/browse/SPARK-40094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580003#comment-17580003
]
Apache Spark commented on SPARK-40094:
--
User 'wangshengjie123' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-40094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40094:
Assignee: (was: Apache Spark)
> Send TaskEnd event when task failed with
[
https://issues.apache.org/jira/browse/SPARK-40094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40094:
Assignee: Apache Spark
> Send TaskEnd event when task failed with
[
https://issues.apache.org/jira/browse/SPARK-40094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580002#comment-17580002
]
Apache Spark commented on SPARK-40094:
--
User 'wangshengjie123' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-40094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1757#comment-1757
]
wangshengjie commented on SPARK-40094:
--
I'm working on this, a pr will be submitted later, thanks.
wangshengjie created SPARK-40094:
Summary: Send TaskEnd event when task failed with
NotSerializableException or TaskOutputFileAlreadyExistException to release
executors for dynamic allocation
Key: SPARK-40094
t oo created SPARK-40093:
Summary: is kubernetes jar required if not using that executor?
Key: SPARK-40093
URL: https://issues.apache.org/jira/browse/SPARK-40093
Project: Spark
Issue Type: Question
[
https://issues.apache.org/jira/browse/SPARK-40093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
t oo updated SPARK-40093:
-
Description:
my docker file is very big with pyspark
can i remove dis files below if i don't use 'kubernetes
t oo created SPARK-40092:
Summary: is breeze required if not using ML?
Key: SPARK-40092
URL: https://issues.apache.org/jira/browse/SPARK-40092
Project: Spark
Issue Type: Question
[
https://issues.apache.org/jira/browse/SPARK-40092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
t oo updated SPARK-40092:
-
Description:
my docker file is very big with pyspark
can i remove dis files below if i don't use 'ML'?
14M
t oo created SPARK-40091:
Summary: is rocksdbjni required if not using streaming?
Key: SPARK-40091
URL: https://issues.apache.org/jira/browse/SPARK-40091
Project: Spark
Issue Type: Question
[
https://issues.apache.org/jira/browse/SPARK-40089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579984#comment-17579984
]
XiDuo You commented on SPARK-40089:
---
thank you [~revans2] for reporting the issue, I can reproduce it
[
https://issues.apache.org/jira/browse/SPARK-40009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-40009.
--
Fix Version/s: 3.4.0
Assignee: Khalid Mammadov
Resolution: Fixed
Resolved by
[
https://issues.apache.org/jira/browse/SPARK-40077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-40077:
Assignee: Ruifeng Zheng
> Make pyspark.context examples self-contained
>
[
https://issues.apache.org/jira/browse/SPARK-40077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-40077.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 37517
[
https://issues.apache.org/jira/browse/SPARK-37442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579969#comment-17579969
]
EmmaYang commented on SPARK-37442:
--
Hello, I exactly have this issue. and I am usign spark2.4
so my
[
https://issues.apache.org/jira/browse/SPARK-40066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang resolved SPARK-40066.
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 37503
[
https://issues.apache.org/jira/browse/SPARK-40090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xinrong Meng resolved SPARK-40090.
--
Resolution: Duplicate
> Upgrade to Py4J 0.10.9.7
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-40090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40090:
Assignee: (was: Apache Spark)
> Upgrade to Py4J 0.10.9.7
>
[
https://issues.apache.org/jira/browse/SPARK-40090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579930#comment-17579930
]
Apache Spark commented on SPARK-40090:
--
User 'xinrong-meng' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-40090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40090:
Assignee: Apache Spark
> Upgrade to Py4J 0.10.9.7
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-40090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579929#comment-17579929
]
Apache Spark commented on SPARK-40090:
--
User 'xinrong-meng' has created a pull request for this
Xinrong Meng created SPARK-40090:
Summary: Upgrade to Py4J 0.10.9.7
Key: SPARK-40090
URL: https://issues.apache.org/jira/browse/SPARK-40090
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-40089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579897#comment-17579897
]
Robert Joseph Evans commented on SPARK-40089:
-
Looking at the code it appears that the
[
https://issues.apache.org/jira/browse/SPARK-40089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579892#comment-17579892
]
Robert Joseph Evans commented on SPARK-40089:
-
It sure looks like it is related to the
[
https://issues.apache.org/jira/browse/SPARK-40089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579887#comment-17579887
]
Robert Joseph Evans commented on SPARK-40089:
-
I have been trying to debug this and it does
[
https://issues.apache.org/jira/browse/SPARK-40089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Robert Joseph Evans updated SPARK-40089:
Attachment: input.parquet
> Doring of at least Decimal(20, 2) fails for some
Robert Joseph Evans created SPARK-40089:
---
Summary: Doring of at least Decimal(20, 2) fails for some values
near the max.
Key: SPARK-40089
URL: https://issues.apache.org/jira/browse/SPARK-40089
[
https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579845#comment-17579845
]
Dongjoon Hyun commented on SPARK-3:
---
BTW, SPARK-35781 has more backgrounds.
- LevelDB,
[
https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579839#comment-17579839
]
Dongjoon Hyun commented on SPARK-3:
---
Yes, [~tgraves]. LevelDB is too ancient and has
[
https://issues.apache.org/jira/browse/SPARK-40064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Huaxin Gao resolved SPARK-40064.
Fix Version/s: 3.4.0
Assignee: Huaxin Gao
Resolution: Fixed
> Use V2 Filter in
Kazuyuki Tanimura created SPARK-40088:
-
Summary: Add SparkPlanWIthAQESuite
Key: SPARK-40088
URL: https://issues.apache.org/jira/browse/SPARK-40088
Project: Spark
Issue Type: Test
[
https://issues.apache.org/jira/browse/SPARK-40087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40087:
Assignee: Apache Spark
> Support multiple Column drop in R
>
[
https://issues.apache.org/jira/browse/SPARK-40087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40087:
Assignee: (was: Apache Spark)
> Support multiple Column drop in R
>
[
https://issues.apache.org/jira/browse/SPARK-40087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579826#comment-17579826
]
Apache Spark commented on SPARK-40087:
--
User 'santosh-d3vpl3x' has created a pull request for this
Santosh Pingale created SPARK-40087:
---
Summary: Support multiple Column drop in R
Key: SPARK-40087
URL: https://issues.apache.org/jira/browse/SPARK-40087
Project: Spark
Issue Type: New
[
https://issues.apache.org/jira/browse/SPARK-40086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40086:
Assignee: (was: Apache Spark)
> Improve AliasAwareOutputPartitioning to take all
[
https://issues.apache.org/jira/browse/SPARK-40086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579814#comment-17579814
]
Apache Spark commented on SPARK-40086:
--
User 'peter-toth' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-40086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40086:
Assignee: Apache Spark
> Improve AliasAwareOutputPartitioning to take all aliases into
Peter Toth created SPARK-40086:
--
Summary: Improve AliasAwareOutputPartitioning to take all aliases
into account
Key: SPARK-40086
URL: https://issues.apache.org/jira/browse/SPARK-40086
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-40085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579749#comment-17579749
]
Apache Spark commented on SPARK-40085:
--
User 'cloud-fan' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-40085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40085:
Assignee: Apache Spark
> use INTERNAL_ERROR error class instead of IllegalStateException
[
https://issues.apache.org/jira/browse/SPARK-40085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40085:
Assignee: (was: Apache Spark)
> use INTERNAL_ERROR error class instead of
[
https://issues.apache.org/jira/browse/SPARK-40085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579748#comment-17579748
]
Apache Spark commented on SPARK-40085:
--
User 'cloud-fan' has created a pull request for this issue:
Wenchen Fan created SPARK-40085:
---
Summary: use INTERNAL_ERROR error class instead of
IllegalStateException to indicate bugs
Key: SPARK-40085
URL: https://issues.apache.org/jira/browse/SPARK-40085
[
https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579738#comment-17579738
]
Thomas Graves commented on SPARK-3:
---
Just curious does rocksdb give us some particular benefit
[
https://issues.apache.org/jira/browse/SPARK-40058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-40058:
Assignee: ZiyueGuan
> Avoid filter twice in HadoopFSUtils
>
[
https://issues.apache.org/jira/browse/SPARK-40058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-40058.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Resolved by
[
https://issues.apache.org/jira/browse/SPARK-40035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-40035.
--
Resolution: Duplicate
> Avoid apply filter twice when listing files
>
[
https://issues.apache.org/jira/browse/SPARK-39887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-39887:
---
Assignee: Peter Toth
> Expression transform error
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-39887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-39887:
Fix Version/s: 3.4.0
3.3.1
3.2.3
> Expression transform
[
https://issues.apache.org/jira/browse/SPARK-39887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-39887.
-
Fix Version/s: 3.1.4
Resolution: Fixed
Issue resolved by pull request 37496
[
https://issues.apache.org/jira/browse/SPARK-39982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-39982.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Resolved by
[
https://issues.apache.org/jira/browse/SPARK-39982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-39982:
Assignee: Khalid Mammadov
> StructType.fromJson method missing documentation
>
[
https://issues.apache.org/jira/browse/SPARK-40019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-40019.
-
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 37453
[
https://issues.apache.org/jira/browse/SPARK-40019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-40019:
---
Assignee: angerszhu
> Refactor comment of ArrayType
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-40073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-40073.
-
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 37512
[
https://issues.apache.org/jira/browse/SPARK-40083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579692#comment-17579692
]
wangshengjie edited comment on SPARK-40083 at 8/15/22 1:03 PM:
---
Maybe i
[
https://issues.apache.org/jira/browse/SPARK-40073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-40073:
---
Assignee: Yang Jie
> Should Use `connector/${moduleName}` instead of
[
https://issues.apache.org/jira/browse/SPARK-40083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579692#comment-17579692
]
wangshengjie commented on SPARK-40083:
--
Maybe i should add expire policy for push merge shuffle
[
https://issues.apache.org/jira/browse/SPARK-39976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-39976.
-
Fix Version/s: 3.4.0
3.3.1
Assignee: angerszhu
Resolution:
[
https://issues.apache.org/jira/browse/SPARK-40084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579685#comment-17579685
]
Apache Spark commented on SPARK-40084:
--
User 'panbingkun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-40084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40084:
Assignee: (was: Apache Spark)
> Upgrade Py4J from 0.10.9.5 to 0.10.9.7
>
[
https://issues.apache.org/jira/browse/SPARK-40084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40084:
Assignee: Apache Spark
> Upgrade Py4J from 0.10.9.5 to 0.10.9.7
>
BingKun Pan created SPARK-40084:
---
Summary: Upgrade Py4J from 0.10.9.5 to 0.10.9.7
Key: SPARK-40084
URL: https://issues.apache.org/jira/browse/SPARK-40084
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-40082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Penglei Shi updated SPARK-40082:
Description:
In condition of push-based shuffle being enabled and speculative tasks
existing, a
[
https://issues.apache.org/jira/browse/SPARK-40083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40083:
Assignee: (was: Apache Spark)
> Add shuffle index cache expire time policy to avoid
[
https://issues.apache.org/jira/browse/SPARK-40083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40083:
Assignee: Apache Spark
> Add shuffle index cache expire time policy to avoid unused
[
https://issues.apache.org/jira/browse/SPARK-40083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579659#comment-17579659
]
Apache Spark commented on SPARK-40083:
--
User 'wangshengjie123' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-40078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579658#comment-17579658
]
Apache Spark commented on SPARK-40078:
--
User 'dcoliversun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-40078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40078:
Assignee: Apache Spark
> Make pyspark.sql.column examples self-contained
>
[
https://issues.apache.org/jira/browse/SPARK-40078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40078:
Assignee: (was: Apache Spark)
> Make pyspark.sql.column examples self-contained
>
[
https://issues.apache.org/jira/browse/SPARK-40083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579651#comment-17579651
]
wangshengjie commented on SPARK-40083:
--
I'm working on this, a pr will be submitted later.
> Add
wangshengjie created SPARK-40083:
Summary: Add shuffle index cache expire time policy to avoid
unused continuous memory consumption
Key: SPARK-40083
URL: https://issues.apache.org/jira/browse/SPARK-40083
[
https://issues.apache.org/jira/browse/SPARK-40079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weichen Xu resolved SPARK-40079.
Fix Version/s: 3.1.4
3.4.0
3.3.1
3.2.3
[
https://issues.apache.org/jira/browse/SPARK-40082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579612#comment-17579612
]
Penglei Shi commented on SPARK-40082:
-
ping [~mshen]
> DAGScheduler may not schduler new stage in
[
https://issues.apache.org/jira/browse/SPARK-40082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Penglei Shi updated SPARK-40082:
Description:
In condition of push-based shuffle being enabled and speculative tasks
existing, a
[
https://issues.apache.org/jira/browse/SPARK-40082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Penglei Shi updated SPARK-40082:
Description:
In condition of push-based shuffle being enabled and speculative tasks
existing, a
[
https://issues.apache.org/jira/browse/SPARK-40082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Penglei Shi updated SPARK-40082:
Attachment: missParentStages.png
> DAGScheduler may not schduler new stage in condition of
[
https://issues.apache.org/jira/browse/SPARK-40082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Penglei Shi updated SPARK-40082:
Attachment: submitMissingTasks.png
> DAGScheduler may not schduler new stage in condition of
[
https://issues.apache.org/jira/browse/SPARK-40082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Penglei Shi updated SPARK-40082:
Attachment: shuffleMergeFinalized.png
> DAGScheduler may not schduler new stage in condition of
Penglei Shi created SPARK-40082:
---
Summary: DAGScheduler may not schduler new stage in condition of
push-based shuffle enabled
Key: SPARK-40082
URL: https://issues.apache.org/jira/browse/SPARK-40082
1 - 100 of 115 matches
Mail list logo