Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/18435 From my understanding, this looks like a bug here, we didn't consider CPU_PER_TASK configuration. Instead of CPU memory, I think this PR is more like fixing a bug here. As for saving memory, yes it does, but I don't think performance will be affected a lot.
--- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org