[jira] [Created] (MAPREDUCE-5361) Reducer getting fewer records than expected

2013-06-28 Thread Sathish (JIRA)
Sathish created MAPREDUCE-5361: -- Summary: Reducer getting fewer records than expected Key: MAPREDUCE-5361 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5361 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5362) clean up POM dependencies

2013-06-28 Thread Alejandro Abdelnur (JIRA)
Alejandro Abdelnur created MAPREDUCE-5362: - Summary: clean up POM dependencies Key: MAPREDUCE-5362 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5362 Project: Hadoop Map/Reduce

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-06-28 Thread Hitesh Shah
Hi Arun, From a YARN perspective, YARN-791 and YARN-727 are 2 jiras that may potentially change the apis. They can implemented in a backward compat fashion if committed after 2.1.0. However, this will require adding of differently-named apis ( different urls in case of the webservices ) and

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-06-28 Thread Sandy Ryza
For YARN-791, if we can come to consensus on the correct approach, I can try to have a patch ASAP. -Sandy On Fri, Jun 28, 2013 at 12:03 PM, Hitesh Shah hit...@apache.org wrote: Hi Arun, From a YARN perspective, YARN-791 and YARN-727 are 2 jiras that may potentially change the apis. They

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-06-28 Thread Roman Shaposhnik
I think it would very useful if somebody more familiar with HDFS (Suresh?) could take a look at: https://issues.apache.org/jira/browse/HDFS-4940 Suresh was very helpful in unblocking the client side of things, but even after I followed his recommendations on the heap size, etc. The NN still

[jira] [Resolved] (MAPREDUCE-5260) Job failed because of JvmManager running into inconsistent state

2013-06-28 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-5260. -- Resolution: Fixed Fix Version/s: (was: 1.1.3) 1.2.1

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-06-28 Thread Arun C Murthy
Thanks Hitesh Roman, I'll roll RC1 once these are fixed. Arun On Jun 28, 2013, at 12:25 PM, Roman Shaposhnik r...@apache.org wrote: I think it would very useful if somebody more familiar with HDFS (Suresh?) could take a look at: https://issues.apache.org/jira/browse/HDFS-4940 Suresh

How to Free-up a Map Slot without Killing the Entire Job?

2013-06-28 Thread Sreejith Ramakrishnan
I'm trying to implement a scheduler (EDF). The scheduler should be able to kill or free-up a running map slot so that it can be assigned as a map slot to another job. I did some looking around and found a kill() method in org.apache.hadoop.mapred.JobInProgress. But, this kills the entire job. I

[jira] [Reopened] (MAPREDUCE-5318) Ampersand in JSPUtil.java is not escaped

2013-06-28 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy reopened MAPREDUCE-5318: -- Ampersand in JSPUtil.java is not escaped

[jira] [Resolved] (MAPREDUCE-5318) Ampersand in JSPUtil.java is not escaped

2013-06-28 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-5318. -- Resolution: Fixed Fix Version/s: 1.2.1 I just committed this. Thanks

[jira] [Resolved] (MAPREDUCE-5328) ClientToken should not be set in the environment

2013-06-28 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi resolved MAPREDUCE-5328. -- Resolution: Fixed ClientToken should not be set in the environment

Re: How to Free-up a Map Slot without Killing the Entire Job?

2013-06-28 Thread Kun Ling
Hi Sreejith, the bin/hadoop script provide an option to kill the task by running bin/hadoop job -kill-task task-attempt-id. It seems helpful to you. Here is how the killTask works. ##1. JobClient tell JobTracker which task to kill 1.1. JobClient will recognize this command, and