[
https://issues.apache.org/jira/browse/SPARK-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947678#comment-15947678
]
Apache Spark commented on SPARK-3577:
-
User 'sitalkedia' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947669#comment-15947669
]
Sital Kedia commented on SPARK-3577:
I am making a change to report correct spill data size on disk.
[
https://issues.apache.org/jira/browse/SPARK-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15564472#comment-15564472
]
Reynold Xin commented on SPARK-3577:
[~dreamworks007] can you take a look at the problem here?
[
https://issues.apache.org/jira/browse/SPARK-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15563038#comment-15563038
]
Gaoxiang Liu commented on SPARK-3577:
-
I find that the spill size metrics is already added in
[
https://issues.apache.org/jira/browse/SPARK-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15562945#comment-15562945
]
Reynold Xin commented on SPARK-3577:
Actually instead of tracking spill time, it's more important to
[
https://issues.apache.org/jira/browse/SPARK-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15562938#comment-15562938
]
Reynold Xin commented on SPARK-3577:
This is still relevant.
> Add task metric to report spill time
>
[
https://issues.apache.org/jira/browse/SPARK-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15562925#comment-15562925
]
Gaoxiang Liu commented on SPARK-3577:
-
Hi [~kayousterhout],
Just want to make sure that this JIRA is
[
https://issues.apache.org/jira/browse/SPARK-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15417929#comment-15417929
]
Kay Ousterhout commented on SPARK-3577:
---
I believe spill time will currently be displayed as part of
[
https://issues.apache.org/jira/browse/SPARK-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15417916#comment-15417916
]
Tzach Zohar commented on SPARK-3577:
Does this mean that currently, spill time will be displayed as
[
https://issues.apache.org/jira/browse/SPARK-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628646#comment-14628646
]
Tom Hubregtsen commented on SPARK-3577:
---
I could also use this metric
Add task
[
https://issues.apache.org/jira/browse/SPARK-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14578240#comment-14578240
]
Ming Chen commented on SPARK-3577:
--
Why have not the metric been added? I think this is
[
https://issues.apache.org/jira/browse/SPARK-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14144412#comment-14144412
]
Apache Spark commented on SPARK-3577:
-
User 'sryza' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14142524#comment-14142524
]
Sandy Ryza commented on SPARK-3577:
---
No problem. Yeah, I agree that a spill time metric
13 matches
Mail list logo