Re: [VOTE] Release Apache Hadoop 2.1.0-beta

I have just raised https://issues.apache.org/jira/browse/HDFS-5016 .. This bug can easily be reproduced by some HBase tests. I'd like this to be considered before we make a beta release. Have spoken about this with some hdfs folks offline and I am told that it is being worked on. Thanks Devaraj

Re: In the constructor of JobInProgress, why is it safe to call FileSyste.closeAllForUGI().

Hey Xiao, iirc, the ugi will be different for the second ec2-user's job submission. So they should not interfere... On Mar 22, 2013 8:05 AM, "Xiao Yu" wrote: > Thanks a lot for the reply. > > I have made several changes here and there, but I do not think they are > quite relevant (the most relev

[jira] [Created] (MAPREDUCE-3885) Apply the fix similar to HADOOP-8084

Affects Versions: 0.24.0 Reporter: Devaraj Das Assignee: Devaraj Das Fix For: 0.24.0 Attachments: mr-no-copy.patch Apply the fix similar to HADOOP-8084 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please

Re: [VOTE] Merge MR-279 to trunk.

+1 (finally!) On Aug 16, 2011, at 2:14 PM, Mahadev Konar wrote: > Hi all, > > We are excited to let you know that we have MR-279 ready to be merged to > trunk. I have uploaded necessary details on > https://issues.apache.org/jira/browse/MAPREDUCE-279. > > Please take a look and vote. >

Re: MR2 and local disk failures

Thanks Eli for pointing this out. I personally dont know if anyone is working on it. I will check. Sent from my iPhone On Jul 5, 2011, at 1:59 PM, Eli Collins wrote: Hey guys, Looks like MR2 doesn't have the local disk failure improvements in 203 (MR-2413, MR-2415, etc). Is someone workin

[jira] [Created] (MAPREDUCE-2452) Delegation token cancellation shouldn't hold global JobTracker lock

educe Issue Type: Bug Components: jobtracker Reporter: Devaraj Das Assignee: Devaraj Das Fix For: 0.23.0 Currently, when the JobTracker cancels a job's delegation token (at the end of the job), it holds the global lock. This is not desired

[jira] Created: (MAPREDUCE-2353) Make the MR changes to reflect the API changes in SecureIO library

Issue Type: Improvement Components: security, task, tasktracker Affects Versions: 0.22.0 Reporter: Devaraj Das Make the MR changes to reflect the API changes in SecureIO library. Specifically, the 'group' argument is never used in the SecureIO library, and hen

[jira] Resolved: (MAPREDUCE-2082) Race condition in writing the jobtoken password file when launching pipes jobs

[ https://issues.apache.org/jira/browse/MAPREDUCE-2082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved MAPREDUCE-2082. Fix Version/s: 0.22.0 Resolution: Fixed I just committed this. Thanks, Jitendra

[jira] Created: (MAPREDUCE-2089) JobToken should be passed over RPC

submission, jobtracker, security, task, tasktracker Reporter: Devaraj Das Assignee: Devaraj Das Fix For: 0.22.0 JobToken file is currently created by the JobTracker, and stored in the HDFS. Later on, the TaskTrackers pull that file from the HDFS as part of job

[jira] Created: (MAPREDUCE-1993) TestTrackerDistributedCacheManagerWith LinuxTaskController fails on trunk

/Reduce Issue Type: Bug Reporter: Devaraj Das Assignee: Devaraj Das TestTrackerDistributedCacheManagerWithLinuxTaskController fails when run with the DefaultTaskController. -- This message is automatically generated by JIRA. - You can reply to this email to add a

[jira] Resolved: (MAPREDUCE-1958) using delegation token over hftp for long running clients (part of hdfs 1296)

[ https://issues.apache.org/jira/browse/MAPREDUCE-1958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved MAPREDUCE-1958. Fix Version/s: 0.22.0 Resolution: Fixed I just committed this. Thanks Boris and

[jira] Reopened: (MAPREDUCE-1624) Document the job credentials and associated details to do with delegation tokens (on the client side)

[ https://issues.apache.org/jira/browse/MAPREDUCE-1624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das reopened MAPREDUCE-1624: I am reopening this issue. The links in the patch points to currently non-existing Common

[jira] Resolved: (MAPREDUCE-1624) Document the job credentials and associated details to do with delegation tokens (on the client side)

[ https://issues.apache.org/jira/browse/MAPREDUCE-1624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved MAPREDUCE-1624. Resolution: Fixed Thanks, Jitendra for the trunk patch. > Document the

[jira] Resolved: (MAPREDUCE-1701) AccessControlException while renewing a delegation token in not correctly handled in the JobTracker

[ https://issues.apache.org/jira/browse/MAPREDUCE-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved MAPREDUCE-1701. Resolution: Fixed I just committed this. Thanks, Boris! > AccessControlExcept

[jira] Resolved: (MAPREDUCE-1566) Need to add a mechanism to import tokens and secrets into a submitted job.

[ https://issues.apache.org/jira/browse/MAPREDUCE-1566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved MAPREDUCE-1566. Assignee: Jitendra Nath Pandey (was: Owen O'Malley) Resolution: Fixed I

[jira] Resolved: (MAPREDUCE-1945) Support for using different Kerberos keys for Jobtracker and TaskTrackers

[ https://issues.apache.org/jira/browse/MAPREDUCE-1945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved MAPREDUCE-1945. Fix Version/s: 0.22.0 Resolution: Fixed I just committed this. Thanks, Kan

[jira] Resolved: (MAPREDUCE-1935) HFTP needs to be updated to use delegation tokens (from HDFS-1007)

[ https://issues.apache.org/jira/browse/MAPREDUCE-1935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved MAPREDUCE-1935. Fix Version/s: 0.22.0 Resolution: Fixed I committed this. Thanks, Boris

[jira] Created: (MAPREDUCE-1938) Ability for having user's classes take precedence over the system classes for tasks' classpath

/MAPREDUCE-1938 Project: Hadoop Map/Reduce Issue Type: New Feature Components: job submission, task, tasktracker Reporter: Devaraj Das Fix For: 0.22.0 It would be nice to have the ability in MapReduce to allow users to specify for

[jira] Resolved: (MAPREDUCE-1528) TokenStorage should not be static

[ https://issues.apache.org/jira/browse/MAPREDUCE-1528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved MAPREDUCE-1528. Assignee: Jitendra Nath Pandey (was: Arun C Murthy) Fix Version/s: 0.22.0

[jira] Created: (MAPREDUCE-1900) MapReduce daemons should close FileSystems that are not needed anymore

Issue Type: Bug Components: jobtracker, tasktracker Reporter: Devaraj Das Fix For: 0.22.0 Related to HADOOP:6843, this jira is to make MapReduce behave better with respect to closing FileSystems when they are not needed anymore. -- This message is

[jira] Resolved: (MAPREDUCE-1855) refreshSuperUserGroupsConfiguration for MR should use server side configuration for the refresh (for HADOOP-6815)

[ https://issues.apache.org/jira/browse/MAPREDUCE-1855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved MAPREDUCE-1855. Resolution: Fixed I just committed this. Thanks, Boris

[jira] Resolved: (MAPREDUCE-1516) JobTracker should issue a delegation token only for kerberos authenticated client

[ https://issues.apache.org/jira/browse/MAPREDUCE-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved MAPREDUCE-1516. Fix Version/s: 0.22.0 Resolution: Fixed I just committed the changes in

[jira] Resolved: (MAPREDUCE-1599) MRBench reuses jobConf and credentials there in.

[ https://issues.apache.org/jira/browse/MAPREDUCE-1599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved MAPREDUCE-1599. Fix Version/s: 0.22.0 Resolution: Fixed I just committed this. Thanks, Jitendra

[jira] Resolved: (MAPREDUCE-1558) specify correct server principal for RefreshAuthorizationPolicyProtocol and RefreshUserToGroupMappingsProtocol protocols in MRAdmin (for HADOOP-6612)

[ https://issues.apache.org/jira/browse/MAPREDUCE-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved MAPREDUCE-1558. Fix Version/s: 0.22.0 Resolution: Fixed I just committed this. Thanks, Boris

[jira] Created: (MAPREDUCE-1701) AccessControlException while renewing a delegation token in not correctly handled in the JobTracker

/MAPREDUCE-1701 Project: Hadoop Map/Reduce Issue Type: Bug Components: jobtracker Affects Versions: 0.22.0 Reporter: Devaraj Das Assignee: Devaraj Das Fix For: 0.22.0 The timer task for renewing delegation token gets

[jira] Created: (MAPREDUCE-1624) Document the job credentials and associated details to do with delegation tokens (on the client side)

/browse/MAPREDUCE-1624 Project: Hadoop Map/Reduce Issue Type: Improvement Components: documentation Affects Versions: 0.22.0 Reporter: Devaraj Das Assignee: Devaraj Das Fix For: 0.22.0 Document the job credentials and

[jira] Created: (MAPREDUCE-1559) The DelegationTokenRenewal timer task should use the jobtracker's credentials to create the filesystem

/jira/browse/MAPREDUCE-1559 Project: Hadoop Map/Reduce Issue Type: Bug Components: jobtracker Affects Versions: 0.22.0 Reporter: Devaraj Das Assignee: Devaraj Das Fix For: 0.22.0 The submitJob RPC finally creates a timer tas

[jira] Created: (MAPREDUCE-1550) UGI.doAs should not be used for getting the history file of jobs

Type: Bug Components: jobtracker Affects Versions: 0.22.0 Reporter: Devaraj Das Fix For: 0.22.0 When the jobtracker tries to open a job history file it does a doAs to get the filesystem for the user (that had submitted the job). This should not be done

[jira] Reopened: (MAPREDUCE-1537) TestDelegationTokenRenewal fails

[ https://issues.apache.org/jira/browse/MAPREDUCE-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das reopened MAPREDUCE-1537: HADOOP-6573 & HDFS-984 seems to have broken other testcases in MR not just

[jira] Created: (MAPREDUCE-1532) Delegation token is obtained as the superuser

submission, security Affects Versions: 0.22.0 Reporter: Devaraj Das Assignee: Devaraj Das Fix For: 0.22.0 When the UserGroupInformation.doAs is invoked for proxy users, the delegation token is incorrectly obtained as the real user. -- This message is

[jira] Reopened: (MAPREDUCE-1515) need to pass down java5 and forrest home variables

[ https://issues.apache.org/jira/browse/MAPREDUCE-1515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das reopened MAPREDUCE-1515: Sorry, i didn't mean to resolve it .. *smile* > need to pass down java5 and forr

[jira] Created: (MAPREDUCE-1520) TestMiniMRLocalFS fails on trunk

: Devaraj Das Fix For: 0.22.0 TestMiniMRLocalFS fails on trunk. I checked with both trunk revs - pre and post MAPREDUCE-1430 commit and it failed in both the cases. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.

[jira] Created: (MAPREDUCE-1505) Job class should create the rpc client only when needed

Components: client Affects Versions: 0.20.2 Reporter: Devaraj Das Fix For: 0.22.0 It will be good to have the org.apache.hadoop.mapreduce.Cluster create the rpc client object only when needed (when a call to the jobtracker is actually required

[jira] Resolved: (MAPREDUCE-1464) In JobTokenIdentifier change method getUsername to getUser which returns UGI

[ https://issues.apache.org/jira/browse/MAPREDUCE-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved MAPREDUCE-1464. Resolution: Fixed Fix Version/s: 0.22.0 Assignee: Jitendra Nath Pandey

[jira] Created: (MAPREDUCE-1457) For secure job execution, couple of more UserGroupInformation.doAs needs to be added

Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 0.22.0 Reporter: Devaraj Das Assignee: Devaraj Das Fix For: 0.22.0 During our testing in a kerberos environment, we had to add UserGroupInformation.doAs blocks in certain places

[jira] Created: (MAPREDUCE-1455) Authorization for servlets

Authorization for servlets -- Key: MAPREDUCE-1455 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1455 Project: Hadoop Map/Reduce Issue Type: New Feature Reporter: Devaraj Das Fix For

[jira] Created: (MAPREDUCE-1454) The servlets should quote server generated strings sent in the response

Issue Type: Bug Reporter: Devaraj Das Fix For: 0.22.0 This is related to HADOOP-6151 but for output. We need to go through all the servlets/jsps and pass all the response strings that could be based on the incoming request or user's data through a f

[jira] Resolved: (MAPREDUCE-1335) Add SASL DIGEST-MD5 authentication to TaskUmbilicalProtocol

[ https://issues.apache.org/jira/browse/MAPREDUCE-1335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved MAPREDUCE-1335. Resolution: Fixed Fix Version/s: 0.22.0 Hadoop Flags: [Reviewed] +1 (also

[jira] Created: (MAPREDUCE-1432) Add the hooks in JobTracker and TaskTracker to load tokens from the token cache into the user's UGI

rowse/MAPREDUCE-1432 Project: Hadoop Map/Reduce Issue Type: New Feature Affects Versions: 0.22.0 Reporter: Devaraj Das Assignee: Devaraj Das Fix For: 0.22.0 Related to HADOOP-6520. Here it is about putting hooks in the JobTr

[jira] Created: (MAPREDUCE-1430) JobTracker should be able to renew delegation tokens for the jobs

Issue Type: New Feature Components: jobtracker Affects Versions: 0.22.0 Reporter: Devaraj Das Assignee: Boris Shkolnik Fix For: 0.22.0 JobTracker should automatically renew delegation tokens for the jobs it is currently running. -- This message is

[jira] Created: (MAPREDUCE-1385) Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)

Map/Reduce Issue Type: New Feature Reporter: Devaraj Das Assignee: Devaraj Das Fix For: 0.22.0 This is about moving the MapReduce code to use the new UserGroupInformation API as described in HADOOP-6299. -- This message is automatically generated

[jira] Created: (MAPREDUCE-1354) Refactor JobTracker.submitJob to not lock the JobTracker during the HDFS accesses

: Hadoop Map/Reduce Issue Type: Improvement Reporter: Devaraj Das It'd be nice to have the JobTracker object not be locked while accessing the HDFS for reading the jobconf file and while writing the jobinfo file in the submitJob method. We should see if we can avoid t

[jira] Resolved: (MAPREDUCE-744) Support in DistributedCache to share cache files with other users after HADOOP-4493

[ https://issues.apache.org/jira/browse/MAPREDUCE-744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved MAPREDUCE-744. --- Resolution: Fixed I just committed this. > Support in DistributedCache to share ca

[jira] Resolved: (MAPREDUCE-1331) TestMiniMRWithDFS.testWithDFSWithDefaultPort inadvertently mistyped

[ https://issues.apache.org/jira/browse/MAPREDUCE-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved MAPREDUCE-1331. Resolution: Fixed Assignee: Devaraj Das I committed this

[jira] Created: (MAPREDUCE-1319) Refactor ClientProtocol.getSystemDir usage on the job client side to instead use ClientProtocol.getStagingAreaDir

://issues.apache.org/jira/browse/MAPREDUCE-1319 Project: Hadoop Map/Reduce Issue Type: Improvement Components: client Affects Versions: 0.22.0 Reporter: Devaraj Das Fix For: 0.22.0 MAPREDUCE-181 introduced ClientProtocol.getStagingAreaDir

[jira] Resolved: (MAPREDUCE-181) Secure job submission

[ https://issues.apache.org/jira/browse/MAPREDUCE-181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved MAPREDUCE-181. --- Resolution: Fixed Hadoop Flags: [Reviewed] I just committed this. Thanks Amar for

[jira] Created: (MAPREDUCE-1307) Introduce the concept of Job Permissions

Reporter: Devaraj Das Fix For: 0.22.0 It would be good to define the notion of job permissions analogous to file permissions. Then the JobTracker can restrict who can "read" (e.g. look at the job page) or "modify" (e.g. kill) jobs. -- This mess

[jira] Created: (MAPREDUCE-1288) DistributedCache localizes only once per cache URI

Components: security, tasktracker Affects Versions: 0.21.0 Reporter: Devaraj Das Priority: Blocker Fix For: 0.21.0 As part of the file localization the distributed cache localizer creates a copy of the file in the corresponding user's private directory

Re: [VOTE] Commit MAPREDUCE-728 to Hadoop 0.21

It will be nice to have this in. +1 On 9/18/09 10:24 PM, "Hong Tang" wrote: MAPREDUCE-728 could not make the code freeze deadline primarily it couples closely with JobTracker and that there are quite a few late patches that changed the APIs it depend on. It passed testing on Hudson on Thursday

[jira] Created: (MAPREDUCE-1014) After the 0.21 branch, MapReduce trunk doesn't compile

: Bug Reporter: Devaraj Das Priority: Blocker When ant is run, the build fails with compilation problems. The first of that is: compile-mapred-classes: [taskdef] log4j:ERROR Could not instantiate class [org.apache.hadoop.metrics.jvm.EventCounter]. [ta

[jira] Resolved: (MAPREDUCE-943) TestNodeRefresh timesout occasionally

[ https://issues.apache.org/jira/browse/MAPREDUCE-943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved MAPREDUCE-943. --- Resolution: Fixed I just committed this. Thanks, Amar! > TestNodeRefresh times

[jira] Resolved: (MAPREDUCE-807) Stray user files in mapred.system.dir with permissions other than 777 can prevent the jobtracker from starting up.

[ https://issues.apache.org/jira/browse/MAPREDUCE-807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved MAPREDUCE-807. --- Resolution: Fixed Fix Version/s: 0.20.1 I just committed this. Thanks, Amar

[jira] Resolved: (MAPREDUCE-767) to remove mapreduce dependency on commons-cli2

[ https://issues.apache.org/jira/browse/MAPREDUCE-767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved MAPREDUCE-767. --- Resolution: Fixed I committed to trunk a fix to handle -debug (that was missed in the

[jira] Resolved: (MAPREDUCE-745) TestRecoveryManager fails sometimes

[ https://issues.apache.org/jira/browse/MAPREDUCE-745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved MAPREDUCE-745. --- Resolution: Fixed Fix Version/s: (was: 0.21.0) 0.20.1

[jira] Created: (MAPREDUCE-882) TestJobHistory fails sometimes

TestJobHistory fails sometimes -- Key: MAPREDUCE-882 URL: https://issues.apache.org/jira/browse/MAPREDUCE-882 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Devaraj Das Testcase

[jira] Created: (MAPREDUCE-879) TestTaskTrackerLocalization fails on MAC OS

Affects Versions: 0.21.0 Environment: Mac OS X 10.5.7 Reporter: Devaraj Das Fix For: 0.21.0 TestTaskTrackerLocalization failed on an 'ant test' run. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to

[jira] Created: (MAPREDUCE-873) Simplify Job Recovery

Reporter: Devaraj Das Assignee: Sharad Agarwal Fix For: 0.21.0 On a couple of occasions we have seen the JobTracker not being able to handle job recovery well, and leading to cluster downtime after a restart. The current design for handling job recovery is complex

[jira] Created: (MAPREDUCE-864) Enhance JobClient API implementations to look at history files to get information about jobs that are not in memory

://issues.apache.org/jira/browse/MAPREDUCE-864 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: jobtracker Reporter: Devaraj Das Fix For: 0.21.0 MAPREDUCE-817 added an API to get the JobHistory URL from the JobTracker. This is

[jira] Created: (MAPREDUCE-863) Improve/standardize job history file content format and the management of the history files

Project: Hadoop Map/Reduce Issue Type: Improvement Components: jobtracker Reporter: Devaraj Das Fix For: 0.21.0 This jira will track the various improvements that will be done in the JobHistory component of Hadoop. The main goals: 1) Make

[jira] Created: (MAPREDUCE-848) TestCapacityScheduler is failing

Affects Versions: 0.20.1 Reporter: Devaraj Das Assignee: Amar Kamat Fix For: 0.20.1 Looks like the commit of HADOOP-805 broke the CapacityScheduler testcase. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the

[jira] Resolved: (MAPREDUCE-805) Deadlock in Jobtracker

[ https://issues.apache.org/jira/browse/MAPREDUCE-805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved MAPREDUCE-805. --- Resolution: Fixed Fix Version/s: 0.20.1 Hadoop Flags: [Reviewed] I just

[jira] Resolved: (MAPREDUCE-796) Encountered "ClassCastException" on tasktracker while running wordcount with MultithreadedMapRunner

[ https://issues.apache.org/jira/browse/MAPREDUCE-796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved MAPREDUCE-796. --- Resolution: Fixed Fix Version/s: 0.20.1 Hadoop Flags: [Reviewed] I just

[jira] Resolved: (MAPREDUCE-796) Encountered "ClassCastException" on tasktracker while running wordcount with MultithreadedMapRunner

[ https://issues.apache.org/jira/browse/MAPREDUCE-796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved MAPREDUCE-796. --- Resolution: Won't Fix Looks like this is a problem caused by a combinati

[jira] Resolved: (MAPREDUCE-735) ArrayIndexOutOfBoundsException is thrown by KeyFieldBasedPartitioner

[ https://issues.apache.org/jira/browse/MAPREDUCE-735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved MAPREDUCE-735. --- Resolution: Fixed Fix Version/s: 0.20.1 Hadoop Flags: [Reviewed] I just

[jira] Created: (MAPREDUCE-773) LineRecordReader can report non-zero progress while it is processing a compressed stream

Project: Hadoop Map/Reduce Issue Type: Bug Components: task Reporter: Devaraj Das Assignee: Devaraj Das Fix For: 0.21.0 Currently, the LineRecordReader returns 0.0 from getProgress() for most inputs (since the "end" of the fi

[jira] Resolved: (MAPREDUCE-683) TestJobTrackerRestart fails with Map task completion events ordering mismatch

[ https://issues.apache.org/jira/browse/MAPREDUCE-683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved MAPREDUCE-683. --- Resolution: Fixed Hadoop Flags: [Reviewed] I just committed this. Thanks, Amar

[jira] Created: (MAPREDUCE-718) Support for per-phase speculative execution

: jobtracker Affects Versions: 0.21.0 Reporter: Devaraj Das Fix For: 0.21.0 It would be good to have support for per-phase speculative execution where the algorithm looks at the current phase of a task, and compares with the other tasks in the same phase before deciding

[jira] Created: (MAPREDUCE-717) Fix some corner case issues in speculative execution (post hadoop-2141)

Issue Type: Bug Components: jobtracker Affects Versions: 0.21.0 Reporter: Devaraj Das Assignee: Devaraj Das Fix For: 0.21.0 Some corner case issues can be fixed: 1) Setup task should not add anything to the job statistics (since they are

Re: New subproject logos

+1 On 6/26/09 12:12 PM, "Nigel Daley" wrote: Here are some logos for the new subprojects http://www.flickr.com/photos/88199...@n00/3661433605/ Please vote +1 if you like 'em and -1 if you don't. Cheers, Nige