[jira] [Commented] (MAPREDUCE-5470) LocalJobRunner does not work on Windows.

[ https://issues.apache.org/jira/browse/MAPREDUCE-5470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13747307#comment-13747307 ] Chris Nauroth commented on MAPREDUCE-5470: -- Sandy, thanks so much for taking

[jira] [Resolved] (MAPREDUCE-5401) Succeeded Job details displayed as Error In JobHistoryServer UI when RM issues Reboot to 1st app master.

[ https://issues.apache.org/jira/browse/MAPREDUCE-5401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved MAPREDUCE-5401. Resolution: Duplicate [~rohithsharma], you are right, closing t

[jira] [Commented] (MAPREDUCE-5475) MRClientService does not verify ACLs properly

[ https://issues.apache.org/jira/browse/MAPREDUCE-5475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13747184#comment-13747184 ] Vinod Kumar Vavilapalli commented on MAPREDUCE-5475: Good changes

[jira] [Updated] (MAPREDUCE-4935) Support timeout limitation to MRv1 job end notifications

[ https://issues.apache.org/jira/browse/MAPREDUCE-4935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brad Liu updated MAPREDUCE-4935: Resolution: Fixed Status: Resolved (was: Patch Available) > Support timeout limita

[jira] [Updated] (MAPREDUCE-5475) MRClientService does not verify ACLs properly

[ https://issues.apache.org/jira/browse/MAPREDUCE-5475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-5475: - Resolution: Fixed Fix Version/s: 2.1.1-beta Status: Resolved (was:

[jira] [Commented] (MAPREDUCE-5476) Job can fail when RM restarts after staging dir is cleaned but before MR successfully unregister with RM

[ https://issues.apache.org/jira/browse/MAPREDUCE-5476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13747151#comment-13747151 ] Hadoop QA commented on MAPREDUCE-5476: -- {color:green}+1 overall{color}. Here are

[jira] [Updated] (MAPREDUCE-5468) AM recovery does not work for map only jobs

apache.org/jira/browse/MAPREDUCE-5468 > Project: Hadoop Map/Reduce > Issue Type: Bug >Reporter: yeshavora >Assignee: Vinod Kumar Vavilapalli >Priority: Blocker > Fix For: 2.1.1-beta > > Attachments: MAP

[jira] [Commented] (MAPREDUCE-5472) reducer of sort job restarts from scratch in between after RM restart

[ https://issues.apache.org/jira/browse/MAPREDUCE-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13747149#comment-13747149 ] Omkar Vinit Joshi commented on MAPREDUCE-5472: -- I think we should try run

[jira] [Commented] (MAPREDUCE-5468) AM recovery does not work for map only jobs

Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12599334/MAPREDUCE-5468-20130821.txt against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}.

[jira] [Updated] (MAPREDUCE-5476) Job can fail when RM restarts after staging dir is cleaned but before MR successfully unregister with RM

[ https://issues.apache.org/jira/browse/MAPREDUCE-5476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-5476: - Priority: Blocker (was: Major) > Job can fail when RM restarts after staging dir

[jira] [Updated] (MAPREDUCE-5476) Job can fail when RM restarts after staging dir is cleaned but before MR successfully unregister with RM

[ https://issues.apache.org/jira/browse/MAPREDUCE-5476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-5476: - Target Version/s: 2.1.1-beta > Job can fail when RM restarts after staging dir is

[jira] [Updated] (MAPREDUCE-5468) AM recovery does not work for map only jobs

Reporter: yeshavora >Assignee: Vinod Kumar Vavilapalli >Priority: Blocker > Attachments: MAPREDUCE-5468-20130821.txt > > > Map only job (randomwriter, randomtextwriter) restarts from scratch [0% map > 0% reduce] after RM restart. > It should resume

[jira] [Updated] (MAPREDUCE-5468) AM recovery does not work for map only jobs

[ https://issues.apache.org/jira/browse/MAPREDUCE-5468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-5468: --- Attachment: MAPREDUCE-5468-20130821.txt Here's a simple

[jira] [Commented] (MAPREDUCE-5470) LocalJobRunner does not work on Windows.

[ https://issues.apache.org/jira/browse/MAPREDUCE-5470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13747129#comment-13747129 ] Sandy Ryza commented on MAPREDUCE-5470: --- Oh I see where I went wrong. I thought

[jira] [Commented] (MAPREDUCE-5470) LocalJobRunner does not work on Windows.

[ https://issues.apache.org/jira/browse/MAPREDUCE-5470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13747066#comment-13747066 ] Sandy Ryza commented on MAPREDUCE-5470: --- [~cnauroth], I'll take a look at this l

[jira] [Commented] (MAPREDUCE-5367) Local jobs all use same local working directory

[ https://issues.apache.org/jira/browse/MAPREDUCE-5367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13747059#comment-13747059 ] Chris Nauroth commented on MAPREDUCE-5367: -- Hi, [~sandyr]. Have you seen MAP

[jira] [Commented] (MAPREDUCE-5471) Succeed job tries to restart after RMrestart

[ https://issues.apache.org/jira/browse/MAPREDUCE-5471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13747009#comment-13747009 ] Jian He commented on MAPREDUCE-5471: If RM restarts and prior attempt reboots/cras

[jira] [Updated] (MAPREDUCE-5471) Succeed job tries to restart after RMrestart

[ https://issues.apache.org/jira/browse/MAPREDUCE-5471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yeshavora updated MAPREDUCE-5471: - Attachment: MR5471-2AM.log MR5471-1AM.log > Succeed job tries to restart

[jira] [Commented] (MAPREDUCE-5471) Succeed job tries to restart after RMrestart

[ https://issues.apache.org/jira/browse/MAPREDUCE-5471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13746986#comment-13746986 ] yeshavora commented on MAPREDUCE-5471: -- attaching AM logs. MR5471-1AM.log is the

[jira] [Commented] (MAPREDUCE-5475) MRClientService does not verify ACLs properly

[ https://issues.apache.org/jira/browse/MAPREDUCE-5475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13746988#comment-13746988 ] Hadoop QA commented on MAPREDUCE-5475: -- {color:green}+1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-5471) Succeed job tries to restart after RMrestart

[ https://issues.apache.org/jira/browse/MAPREDUCE-5471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13746982#comment-13746982 ] Jason Lowe commented on MAPREDUCE-5471: --- bq. maybe we can also look for that in

[jira] [Commented] (MAPREDUCE-5471) Succeed job tries to restart after RMrestart

[ https://issues.apache.org/jira/browse/MAPREDUCE-5471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13746969#comment-13746969 ] Jian He commented on MAPREDUCE-5471: Agree. In the recovering phase, currently MR

[jira] [Commented] (MAPREDUCE-5475) MRClientService does not verify ACLs properly

[ https://issues.apache.org/jira/browse/MAPREDUCE-5475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13746965#comment-13746965 ] Arun C Murthy commented on MAPREDUCE-5475: -- +1 pending jenkins, lgtm. Thanks

[jira] [Commented] (MAPREDUCE-4424) The 'mapred job -list' command should show the job name as well

[ https://issues.apache.org/jira/browse/MAPREDUCE-4424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13746966#comment-13746966 ] Akira AJISAKA commented on MAPREDUCE-4424: -- I ran sample pi job and then exec

[jira] [Commented] (MAPREDUCE-2818) Rest API for retrieving job / task statistics

[ https://issues.apache.org/jira/browse/MAPREDUCE-2818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13746918#comment-13746918 ] Mikhail Antonov commented on MAPREDUCE-2818: Thanks! but it's talking abou

[jira] [Commented] (MAPREDUCE-5471) Succeed job tries to restart after RMrestart

[ https://issues.apache.org/jira/browse/MAPREDUCE-5471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13746917#comment-13746917 ] Bikas Saha commented on MAPREDUCE-5471: --- [~yeshavora] Can you please attach the

[jira] [Commented] (MAPREDUCE-5471) Succeed job tries to restart after RMrestart

[ https://issues.apache.org/jira/browse/MAPREDUCE-5471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13746915#comment-13746915 ] Bikas Saha commented on MAPREDUCE-5471: --- Even storing a persistent flag is not e

[jira] [Commented] (MAPREDUCE-5476) Job can fail when RM restarts after staging dir is cleaned but before MR successfully unregister with RM

[ https://issues.apache.org/jira/browse/MAPREDUCE-5476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13746899#comment-13746899 ] Jian He commented on MAPREDUCE-5476: Did manual test on single node cluster. 1. Pu

[jira] [Updated] (MAPREDUCE-5476) Job can fail when RM restarts after staging dir is cleaned but before MR successfully unregister with RM

[ https://issues.apache.org/jira/browse/MAPREDUCE-5476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated MAPREDUCE-5476: --- Attachment: MAPREDUCE-5476.patch New patch add tests as Jason suggested. > Job c

[jira] [Updated] (MAPREDUCE-5476) Job can fail when RM restarts after staging dir is cleaned but before MR successfully unregister with RM

[ https://issues.apache.org/jira/browse/MAPREDUCE-5476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated MAPREDUCE-5476: --- Status: Patch Available (was: Open) > Job can fail when RM restarts after staging dir is cle

[jira] [Updated] (MAPREDUCE-5476) Job can fail when RM restarts after staging dir is cleaned but before MR successfully unregister with RM

[ https://issues.apache.org/jira/browse/MAPREDUCE-5476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated MAPREDUCE-5476: --- Status: Open (was: Patch Available) > Job can fail when RM restarts after staging dir is cle

[jira] [Updated] (MAPREDUCE-5476) Job can fail when RM restarts after staging dir is cleaned but before MR successfully unregister with RM

[ https://issues.apache.org/jira/browse/MAPREDUCE-5476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi updated MAPREDUCE-5476: - Component/s: (was: resourcemanager) > Job can fail when RM restarts a

[jira] [Moved] (MAPREDUCE-5476) Job can fail when RM restarts after staging dir is cleaned but before MR successfully unregister with RM

[ https://issues.apache.org/jira/browse/MAPREDUCE-5476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi moved YARN-917 to MAPREDUCE-5476: --- Component/s: (was: resourcemanager) r

[jira] [Updated] (MAPREDUCE-5332) Support token-preserving restart of history server

[ https://issues.apache.org/jira/browse/MAPREDUCE-5332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5332: -- Attachment: MAPREDUCE-5332-3.patch Updated patch based on similar changes in YARN-1082: *

[jira] [Updated] (MAPREDUCE-5475) MRClientService does not verify ACLs properly

[ https://issues.apache.org/jira/browse/MAPREDUCE-5475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5475: -- Attachment: MAPREDUCE-5475.patch Patch to verify ACLs and improve logging of requests.

[jira] [Updated] (MAPREDUCE-5475) MRClientService does not verify ACLs properly

[ https://issues.apache.org/jira/browse/MAPREDUCE-5475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5475: -- Status: Patch Available (was: Open) > MRClientService does not verify ACLs properly >

[jira] [Created] (MAPREDUCE-5475) MRClientService does not verify ACLs properly

Jason Lowe created MAPREDUCE-5475: - Summary: MRClientService does not verify ACLs properly Key: MAPREDUCE-5475 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5475 Project: Hadoop Map/Reduce

[jira] [Commented] (MAPREDUCE-5466) Historyserver does not refresh the result of restarted jobs after RM restart

[ https://issues.apache.org/jira/browse/MAPREDUCE-5466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13746681#comment-13746681 ] Hudson commented on MAPREDUCE-5466: --- SUCCESS: Integrated in Hadoop-trunk-Commit #430

[jira] [Updated] (MAPREDUCE-5466) Historyserver does not refresh the result of restarted jobs after RM restart

[ https://issues.apache.org/jira/browse/MAPREDUCE-5466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-5466: --- Resolution: Fixed Fix Version/s: 2.1.1-beta Hadoop Fla

[jira] [Commented] (MAPREDUCE-5471) Succeed job tries to restart after RMrestart

[ https://issues.apache.org/jira/browse/MAPREDUCE-5471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13746664#comment-13746664 ] Jian He commented on MAPREDUCE-5471: bq. The same AM cannot have stop and start l

[jira] [Commented] (MAPREDUCE-5471) Succeed job tries to restart after RMrestart

[ https://issues.apache.org/jira/browse/MAPREDUCE-5471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13746655#comment-13746655 ] Jian He commented on MAPREDUCE-5471: The current RMStateStore implementation doesn

[jira] [Commented] (MAPREDUCE-5466) Historyserver does not refresh the result of restarted jobs after RM restart

[ https://issues.apache.org/jira/browse/MAPREDUCE-5466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13746648#comment-13746648 ] Hadoop QA commented on MAPREDUCE-5466: -- {color:green}+1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-5471) Succeed job tries to restart after RMrestart

[ https://issues.apache.org/jira/browse/MAPREDUCE-5471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13746644#comment-13746644 ] Bikas Saha commented on MAPREDUCE-5471: --- +1 to Jason's comments. I dont underst

[jira] [Updated] (MAPREDUCE-5466) Historyserver does not refresh the result of restarted jobs after RM restart

[ https://issues.apache.org/jira/browse/MAPREDUCE-5466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated MAPREDUCE-5466: --- Status: Open (was: Patch Available) > Historyserver does not refresh the result of restarted

[jira] [Updated] (MAPREDUCE-5466) Historyserver does not refresh the result of restarted jobs after RM restart

[ https://issues.apache.org/jira/browse/MAPREDUCE-5466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated MAPREDUCE-5466: --- Status: Patch Available (was: Open) > Historyserver does not refresh the result of restarted

[jira] [Commented] (MAPREDUCE-5466) Historyserver does not refresh the result of restarted jobs after RM restart

[ https://issues.apache.org/jira/browse/MAPREDUCE-5466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13746620#comment-13746620 ] Vinod Kumar Vavilapalli commented on MAPREDUCE-5466: Patch looks g

[jira] [Created] (MAPREDUCE-5474) Add support for mapreduce.reduce.input.limit in MR2

Arpit Gupta created MAPREDUCE-5474: -- Summary: Add support for mapreduce.reduce.input.limit in MR2 Key: MAPREDUCE-5474 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5474 Project: Hadoop Map/Redu

[jira] [Commented] (MAPREDUCE-5471) Succeed job tries to restart after RMrestart

[ https://issues.apache.org/jira/browse/MAPREDUCE-5471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13746106#comment-13746106 ] Jason Lowe commented on MAPREDUCE-5471: --- I should mention that in general there

[jira] [Commented] (MAPREDUCE-5001) LocalJobRunner has race condition resulting in job failures

[ https://issues.apache.org/jira/browse/MAPREDUCE-5001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13746098#comment-13746098 ] Hudson commented on MAPREDUCE-5001: --- FAILURE: Integrated in Hadoop-Mapreduce-trunk #

[jira] [Commented] (MAPREDUCE-5471) Succeed job tries to restart after RMrestart

[ https://issues.apache.org/jira/browse/MAPREDUCE-5471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13746094#comment-13746094 ] Jason Lowe commented on MAPREDUCE-5471: --- This sounds like it could be a case whe

[jira] [Commented] (MAPREDUCE-5001) LocalJobRunner has race condition resulting in job failures

[ https://issues.apache.org/jira/browse/MAPREDUCE-5001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13745957#comment-13745957 ] Hudson commented on MAPREDUCE-5001: --- FAILURE: Integrated in Hadoop-Hdfs-0.23-Build #

[jira] [Commented] (MAPREDUCE-5001) LocalJobRunner has race condition resulting in job failures

[ https://issues.apache.org/jira/browse/MAPREDUCE-5001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13745932#comment-13745932 ] Hudson commented on MAPREDUCE-5001: --- SUCCESS: Integrated in Hadoop-Yarn-trunk #308 (