[
https://issues.apache.org/jira/browse/SPARK-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Antony Mayi updated SPARK-6334:
---
Attachment: gc.png
spark-local dir not getting cleared during ALS
[
https://issues.apache.org/jira/browse/SPARK-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Antony Mayi updated SPARK-6334:
---
Attachment: als-diskusage.png
this is the disk usage pattern during ALS - 90% is when YARN kills the
[
https://issues.apache.org/jira/browse/SPARK-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Antony Mayi updated SPARK-6334:
---
Description:
when running bigger ALS training spark spills loads of temp data into the
local-dir (in
[
https://issues.apache.org/jira/browse/SPARK-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Antony Mayi updated SPARK-6334:
---
Description:
when running bigger ALS training spark spills loads of temp data into the
local-dir (in
