You are lucky :-) for some of our jobs, in a 8gb container, overhead is 1.8gb ! On 13-Jul-2014 2:40 pm, "nishkamravi2" <g...@git.apache.org> wrote:
> Github user nishkamravi2 commented on the pull request: > > https://github.com/apache/spark/pull/1391#issuecomment-48835560 > > Sean, the memory_overhead is fairly substantial. More than 2GB for a > 30GB executor. Less than 400MB for a 2GB executor. > > > --- > If your project is set up for it, you can reply to this email and have your > reply appear on GitHub as well. If your project does not have this feature > enabled and wishes so, or if the feature is enabled but not working, please > contact infrastructure at infrastruct...@apache.org or file a JIRA ticket > with INFRA. > --- >
