[GitHub] spark pull request: Modify default YARN memory_overhead-- from an ...

Github user mridulm commented on the pull request: https://github.com/apache/spark/pull/1391#issuecomment-48836123 You are missing my point I think ... To give unscientific anecdotal example : our gbdt expiriments , which run on about 22 nodes need no tuning. While our

[GitHub] spark pull request: Modify default YARN memory_overhead-- from an ...

Github user nishkamravi2 commented on the pull request: https://github.com/apache/spark/pull/1391#issuecomment-48836220 Mridul, I think you are missing the point. We understand that this parameter will in a lot of cases have to be specified by the developer, since there is no easy

[GitHub] spark pull request: Modify default YARN memory_overhead-- from an ...

Github user mridulm commented on the pull request: https://github.com/apache/spark/pull/1391#issuecomment-48836408 On Jul 13, 2014 3:16 PM, nishkamravi2 notificati...@github.com wrote: Mridul, I think you are missing the point. We understand that this parameter will in a

[GitHub] spark pull request: Modify default YARN memory_overhead-- from an ...

Github user mridulm commented on the pull request: https://github.com/apache/spark/pull/1391#issuecomment-48836619 Hmm, looks like some of my responses to Sean via mail reply have not shown up here ... Maybe mail gateway delays ? --- If your project is set up for it, you can reply

[GitHub] spark pull request: Modify default YARN memory_overhead-- from an ...

Github user mridulm commented on the pull request: https://github.com/apache/spark/pull/1391#issuecomment-48836879 Since this is a recurring nightmare for our users, let me try to list down the factors which influence overhead given current spark codebase state in the jira when

[GitHub] spark pull request: Modify default YARN memory_overhead-- from an ...

GitHub user nishkamravi2 opened a pull request: https://github.com/apache/spark/pull/1391 Modify default YARN memory_overhead-- from an additive constant to a multiplier Related to https://github.com/apache/spark/pull/894/ and https://issues.apache.org/jira/browse/SPARK-2398

[GitHub] spark pull request: Modify default YARN memory_overhead-- from an ...

Github user nishkamravi2 commented on the pull request: https://github.com/apache/spark/pull/1391#issuecomment-48832556 Also see: https://issues.apache.org/jira/browse/SPARK-2444 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: Modify default YARN memory_overhead-- from an ...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1391#issuecomment-48832590 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

<    1   2