[jira] [Reopened] (MAPREDUCE-6566) Add retry support to mapreduce CLI tool

[Vinod Kumar Vavilapalli (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-6566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vinod Kumar Vavilapalli reopened MAPREDUCE-6566:


[~xgong], there are many major issues with how this patch got committed.
 - This is an improvement. It should never have been in 2.7.2. Why did you put 
it in 2.7.2?
 - Even if I give you that, it actually doesn't exist in 2.7.2 branch.
 - Neither does it exist in 2.8.0 branch.
 - What exactly happened with that trunk commit? You made too many CHANGES.txt 
modifications there.

I'm reverting both the commits and reopening this JIRA to get this fixed 
correctly.

> Add retry support to mapreduce CLI tool
> ---
>
> Key: MAPREDUCE-6566
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6566
> Project: Hadoop Map/Reduce
>  Issue Type: Improvement
>Affects Versions: 2.7.1
>Reporter: Varun Vasudev
>Assignee: Varun Vasudev
> Attachments: MAPREDUCE-6566.001.patch, MAPREDUCE-6566.002.patch
>
>
> MAPREDUCE-6251 added support for retries to JobClient. However the MR CLI 
> class doesn't use the JobClient. It would be useful to add support for 
> retries to the CLI class as well.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (MAPREDUCE-6566) Add retry support to mapreduce CLI tool

[Akihiro Suda (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-6566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akihiro Suda reopened MAPREDUCE-6566:
-

The test is flaky, so I would like to open this issue again.
{code}
---
Test set: org.apache.hadoop.mapreduce.tools.TestCLI
---
Tests run: 4, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.699 sec <<< 
FAILURE! - in org.apache.hadoop.mapreduce.tools.TestCLI
testGetJob(org.apache.hadoop.mapreduce.tools.TestCLI)  Time elapsed: 0.025 sec  
<<< FAILURE!
java.lang.AssertionError: null
at org.junit.Assert.fail(Assert.java:86)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.junit.Assert.assertTrue(Assert.java:52)
at 
org.apache.hadoop.mapreduce.tools.TestCLI.testGetJob(TestCLI.java:175)
{code}

{code}
$ cat 
./hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/target/surefire-reports/org.apache.hadoop.mapreduce.tools.TestCLI-output.txt
Killed job job_1234654654_001
The job job_1234654654_002 has already been killed.
Could not mark the job job_1234654654_003 as killed, as it has already failed.
Killed job job_1234654654_004
Error: Invalid task-type: JOB_SETUP
Usage: job [-list-attempt-ids   ]. Valid values 
for  are MAP REDUCE. Valid values for  are pending, 
running, completed, failed, killed
Error: Invalid task-type: JOB_CLEANUP
Usage: job [-list-attempt-ids   ]. Valid values 
for  are MAP REDUCE. Valid values for  are pending, 
running, completed, failed, killed
Error: Invalid task-state: complete
Usage: job [-list-attempt-ids   ]. Valid values 
for  are MAP REDUCE. Valid values for  are pending, 
running, completed, failed, killed
{code}

https://github.com/apache/hadoop/blob/d4e766de931c1cc478561a211215c517ba1f341c/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/tools/TestCLI.java#L175

> Add retry support to mapreduce CLI tool
> ---
>
> Key: MAPREDUCE-6566
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6566
> Project: Hadoop Map/Reduce
>  Issue Type: Improvement
>Affects Versions: 2.7.1
>Reporter: Varun Vasudev
>Assignee: Varun Vasudev
> Fix For: 2.8.0
>
> Attachments: MAPREDUCE-6566.001.patch, MAPREDUCE-6566.002.patch
>
>
> MAPREDUCE-6251 added support for retries to JobClient. However the MR CLI 
> class doesn't use the JobClient. It would be useful to add support for 
> retries to the CLI class as well.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)