subject:"\[jira\] \[Commented\] \(SPARK\-34406\) When we submit spark core tasks frequently, the submitted nodes will have a lot of resource pressure"

[jira] [Commented] (SPARK-34406) When we submit spark core tasks frequently, the submitted nodes will have a lot of resource pressure

2021-02-08 Thread hao (Jira)

[ https://issues.apache.org/jira/browse/SPARK-34406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17281560#comment-17281560 ] hao commented on SPARK-34406: - Yes, sir. I'm using the Yarn cluster mode. What I mean here i

[jira] [Commented] (SPARK-34406) When we submit spark core tasks frequently, the submitted nodes will have a lot of resource pressure

2021-02-08 Thread Hyukjin Kwon (Jira)

[ https://issues.apache.org/jira/browse/SPARK-34406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17281541#comment-17281541 ] Hyukjin Kwon commented on SPARK-34406: -- You should use Yarn cluster mode that will