[jira] [Resolved] (MAPREDUCE-3946) If a resource requirement is higher than available on any node, job should fail early

2013-05-03 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved MAPREDUCE-3946. --- Resolution: Duplicate > If a resource requirement is higher than available on any nod

Re: JVM vs container memory configs

2013-05-03 Thread Robert Evans
For us we typically leave a 500MB difference between the heap and the container size. I think we can make this smaller, but we have not really tried. --Bobby On 5/3/13 11:20 AM, "Karthik Kambatla" wrote: >Hi > >While looking into MAPREDUCE-5207 (adding defaults for >mapreduce.{map|reduce}.memo

[jira] [Created] (MAPREDUCE-5208) SpillRecord and ShuffleHandler should use SecureIOUtils for reading index file and map output

2013-05-03 Thread Omkar Vinit Joshi (JIRA)
Omkar Vinit Joshi created MAPREDUCE-5208: Summary: SpillRecord and ShuffleHandler should use SecureIOUtils for reading index file and map output Key: MAPREDUCE-5208 URL: https://issues.apache.org/jira/brow

[jira] [Resolved] (MAPREDUCE-5207) Add mapreduce.{map|reduce}.memory.mb defaults to mapred-default.xml

2013-05-03 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved MAPREDUCE-5207. - Resolution: Duplicate > Add mapreduce.{map|reduce}.memory.mb defaults to

JVM vs container memory configs

2013-05-03 Thread Karthik Kambatla
Hi While looking into MAPREDUCE-5207 (adding defaults for mapreduce.{map|reduce}.memory.mb), I was wondering how much headroom should be left on top of mapred.child.java.opts (or other similar JVM opts) for the container memory itself? Currently, mapred.child.java.opts (per mapred-default.xml) is

[jira] [Created] (MAPREDUCE-5207) Add mapreduce.{map|reduce}.memory.mb defaults to mapred-default.xml

2013-05-03 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5207: --- Summary: Add mapreduce.{map|reduce}.memory.mb defaults to mapred-default.xml Key: MAPREDUCE-5207 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5207

Re: Heads up - 2.0.5-beta

2013-05-03 Thread Robert Evans
I agree that "destructive" is not the correct word to describe features like snapshots and windows support. However, I also agree with Konstantin that any large feature will have a destabilizing effect on the code base, even if it is done on a branch and thoroughly tested before being merged in. H

Re: Heads up - 2.0.5-beta

2013-05-03 Thread Konstantin Shvachko
Hi Arun and Suresh, I am glad my choice of words attracted your attention. I consider this important for the project otherwise I wouldn't waste everybody's time. You tend reacting on a latest message taken out of context, which does not reveal full picture. I'll try here to summarize my proposal a

[jira] [Created] (MAPREDUCE-5206) JT can show the same job multiple times in Retired Jobs section

2013-05-03 Thread Arun C Murthy (JIRA)
Arun C Murthy created MAPREDUCE-5206: Summary: JT can show the same job multiple times in Retired Jobs section Key: MAPREDUCE-5206 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5206 Project