[jira] [Resolved] (MAPREDUCE-5099) mapreduce.lib.jobcontrol.JobControl API Incompatibility between branch-1 and branch-2

2013-03-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved MAPREDUCE-5099. - Resolution: Not A Problem Not an issue - was looking at JobControl from diffe

[jira] [Created] (MAPREDUCE-5099) mapreduce.lib.jobcontrol.JobControl API Incompatibility between branch-1 and branch-2

2013-03-22 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5099: --- Summary: mapreduce.lib.jobcontrol.JobControl API Incompatibility between branch-1 and branch-2 Key: MAPREDUCE-5099 URL: https://issues.apache.org/jira/browse/MAPREDU

[jira] [Created] (MAPREDUCE-5098) Fix findbugs warnings in gridmix

2013-03-22 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5098: --- Summary: Fix findbugs warnings in gridmix Key: MAPREDUCE-5098 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5098 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5097) Job.addArchiveToClassPath is ignored when running job with LocalJobRunner

2013-03-22 Thread Alex Baranau (JIRA)
Alex Baranau created MAPREDUCE-5097: --- Summary: Job.addArchiveToClassPath is ignored when running job with LocalJobRunner Key: MAPREDUCE-5097 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5097

[jira] [Created] (MAPREDUCE-5096) Deprecate ability to not cancel tokens when job completes

2013-03-22 Thread Daryn Sharp (JIRA)
Daryn Sharp created MAPREDUCE-5096: -- Summary: Deprecate ability to not cancel tokens when job completes Key: MAPREDUCE-5096 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5096 Project: Hadoop Ma

[jira] [Created] (MAPREDUCE-5095) TestShuffleExceptionCount#testCheckException fails occasionally with JDK7

2013-03-22 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created MAPREDUCE-5095: Summary: TestShuffleExceptionCount#testCheckException fails occasionally with JDK7 Key: MAPREDUCE-5095 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5095

[jira] [Resolved] (MAPREDUCE-1849) Implement a FlumeJava-like library for operations over parallel collections using Hadoop MapReduce

2013-03-22 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-1849. Resolution: Implemented Crunch is now a top level Apache project (Apache Crunch): http://crunc

[jira] [Created] (MAPREDUCE-5094) Disable mem monitoring by default in MiniMRYarnCluster

2013-03-22 Thread Siddharth Seth (JIRA)
Siddharth Seth created MAPREDUCE-5094: - Summary: Disable mem monitoring by default in MiniMRYarnCluster Key: MAPREDUCE-5094 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5094 Project: Hadoop

Re: In the constructor of JobInProgress, why is it safe to call FileSyste.closeAllForUGI().

2013-03-22 Thread Xiao Yu
Thanks a lot for the reply. I have made several changes here and there, but I do not think they are quite relevant (the most relevant modification on the control flow of JIP construction is at the end of JobInProgress$initTasks() where I add all the map tasks of this job into a data structure in J

[jira] [Created] (MAPREDUCE-5093) Improve RM and HS token acquisition during job submission

2013-03-22 Thread Daryn Sharp (JIRA)
Daryn Sharp created MAPREDUCE-5093: -- Summary: Improve RM and HS token acquisition during job submission Key: MAPREDUCE-5093 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5093 Project: Hadoop Ma

[jira] [Created] (MAPREDUCE-5092) Parameter 'chunks' of org.apache.hadoop.mapred.lib.db.DBInputFormat.getSplits method is ignored

2013-03-22 Thread Dennis Y (JIRA)
Dennis Y created MAPREDUCE-5092: --- Summary: Parameter 'chunks' of org.apache.hadoop.mapred.lib.db.DBInputFormat.getSplits method is ignored Key: MAPREDUCE-5092 URL: https://issues.apache.org/jira/browse/MAPREDUCE-509

[jira] [Created] (MAPREDUCE-5092) Parameter 'chunks' of org.apache.hadoop.mapred.lib.db.DBInputFormat.getSplits method is ignored

2013-03-22 Thread Dennis Y (JIRA)
Dennis Y created MAPREDUCE-5092: --- Summary: Parameter 'chunks' of org.apache.hadoop.mapred.lib.db.DBInputFormat.getSplits method is ignored Key: MAPREDUCE-5092 URL: https://issues.apache.org/jira/browse/MAPREDUCE-509

Re: In the constructor of JobInProgress, why is it safe to call FileSyste.closeAllForUGI().

2013-03-22 Thread Harsh J
The current user (UserGroupInformation.getCurrentUser()) is the user active in the RPC call thats invoking these functions, and not the JT user exactly. However, given that the JIP construction is outside of a synchronized step and can potentially happen in parallel with another JIP request, it is