Github user thegiive commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-135786660 hi @JoshRosen , @andrewor14 , @srowen Viirya and I are in the same team. Currently Spark standalone has only one FIFO scheduler outside the application and that what we want to change. Base on our team's simulation and observe, a advance scheduler will boost the spark standalone cluster's CPU/memory resource usage A LOT. We are working on implement a better scheduler than current version. This is our team's result and we have already push to prod. Any idea or comment will be very helpful. Thanks
--- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org