[
https://issues.apache.org/jira/browse/SPARK-26679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750696#comment-16750696
]
Felix Cheung commented on SPARK-26679:
--
I find the fraction configs very confusing and there are
[
https://issues.apache.org/jira/browse/SPARK-26679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750694#comment-16750694
]
Hyukjin Kwon commented on SPARK-26679:
--
Also, if it controls a ratio comparing to the whole
[
https://issues.apache.org/jira/browse/SPARK-26679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750689#comment-16750689
]
Hyukjin Kwon commented on SPARK-26679:
--
What does the current {{spark.memory.fraction}} exactly
[
https://issues.apache.org/jira/browse/SPARK-26679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750660#comment-16750660
]
Imran Rashid commented on SPARK-26679:
--
the java side has the same problem. Spark has no idea how
[
https://issues.apache.org/jira/browse/SPARK-26679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750594#comment-16750594
]
Hyukjin Kwon commented on SPARK-26679:
--
{quote}
There are two extreme cases: (1) an app which does
[
https://issues.apache.org/jira/browse/SPARK-26679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750504#comment-16750504
]
Imran Rashid commented on SPARK-26679:
--
I agree the old name "spark.python.worker.memory" is very
[
https://issues.apache.org/jira/browse/SPARK-26679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749557#comment-16749557
]
Hyukjin Kwon commented on SPARK-26679:
--
[~rdblue], if there's no case we can currently come up with
[
https://issues.apache.org/jira/browse/SPARK-26679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748307#comment-16748307
]
Hyukjin Kwon commented on SPARK-26679:
--
It's fine to have two different configurations to me if
