[jira] [Updated] (MAPREDUCE-3958) RM: Remove RMNodeState and replace it with NodeState

2012-04-19 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3958:
--

Attachment: MAPREDUCE-3958-2.patch

Done

 RM: Remove RMNodeState and replace it with NodeState
 

 Key: MAPREDUCE-3958
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3958
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Bikas Saha
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3958-1.patch, MAPREDUCE-3958-2.patch, 
 MAPREDUCE-3958.patch


 RMNodeState is being sent over the wire after MAPREDUCE-3353. This has been 
 done by cloning the enum into NodeState in yarn protocol records.
 That makes RMNodeState redundant and it should be replaced with NodeState.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3921) MR AM should act on the nodes liveliness information when nodes go up/down/unhealthy

2012-04-13 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3921:
--

Status: Open  (was: Patch Available)

 MR AM should act on the nodes liveliness information when nodes go 
 up/down/unhealthy
 

 Key: MAPREDUCE-3921
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3921
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mr-am, mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3921-1.patch, MAPREDUCE-3921-3.patch, 
 MAPREDUCE-3921-branch-0.23.patch, MAPREDUCE-3921-branch-0.23.patch, 
 MAPREDUCE-3921-branch-0.23.patch, MAPREDUCE-3921.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3921) MR AM should act on the nodes liveliness information when nodes go up/down/unhealthy

2012-04-13 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3921:
--

Attachment: MAPREDUCE-3921-3.patch

Attaching patch after pulling latest changes and improved test for AM recovery.

 MR AM should act on the nodes liveliness information when nodes go 
 up/down/unhealthy
 

 Key: MAPREDUCE-3921
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3921
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mr-am, mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3921-1.patch, MAPREDUCE-3921-3.patch, 
 MAPREDUCE-3921-branch-0.23.patch, MAPREDUCE-3921-branch-0.23.patch, 
 MAPREDUCE-3921-branch-0.23.patch, MAPREDUCE-3921.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3921) MR AM should act on the nodes liveliness information when nodes go up/down/unhealthy

2012-04-13 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3921:
--

Status: Patch Available  (was: Open)

 MR AM should act on the nodes liveliness information when nodes go 
 up/down/unhealthy
 

 Key: MAPREDUCE-3921
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3921
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mr-am, mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3921-1.patch, MAPREDUCE-3921-3.patch, 
 MAPREDUCE-3921-branch-0.23.patch, MAPREDUCE-3921-branch-0.23.patch, 
 MAPREDUCE-3921-branch-0.23.patch, MAPREDUCE-3921.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-4128) AM Recovery expects all attempts of a completed task to also be completed.

2012-04-12 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-4128:
--

Attachment: MAPREDUCE-4128-2.patch

Attaching patch with above mentioned fix.

 AM Recovery expects all attempts of a completed task to also be completed.
 --

 Key: MAPREDUCE-4128
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4128
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 3.0.0
Reporter: Bikas Saha
Assignee: Bikas Saha
 Fix For: 3.0.0

 Attachments: MAPREDUCE-4128-1.patch, MAPREDUCE-4128-2.patch, 
 MAPREDUCE-4128.patch


 The AM seems to assume that all attempts of a completed task (from a previous 
 AM incarnation) would also be completed. There is at least one case in which 
 this does not hold. Case being cancellation of a completed task resulting in 
 a new running attempt.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-4128) AM Recovery expects all attempts of a completed task to also be completed.

2012-04-11 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-4128:
--

Status: Open  (was: Patch Available)

 AM Recovery expects all attempts of a completed task to also be completed.
 --

 Key: MAPREDUCE-4128
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4128
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 3.0.0
Reporter: Bikas Saha
Assignee: Bikas Saha
 Fix For: 3.0.0

 Attachments: MAPREDUCE-4128-1.patch, MAPREDUCE-4128.patch


 The AM seems to assume that all attempts of a completed task (from a previous 
 AM incarnation) would also be completed. There is at least one case in which 
 this does not hold. Case being cancellation of a completed task resulting in 
 a new running attempt.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-4128) AM Recovery expects all attempts of a completed task to also be completed.

2012-04-11 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-4128:
--

Attachment: MAPREDUCE-4128-1.patch

Fixed the javadoc. Thanks!

 AM Recovery expects all attempts of a completed task to also be completed.
 --

 Key: MAPREDUCE-4128
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4128
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 3.0.0
Reporter: Bikas Saha
Assignee: Bikas Saha
 Fix For: 3.0.0

 Attachments: MAPREDUCE-4128-1.patch, MAPREDUCE-4128.patch


 The AM seems to assume that all attempts of a completed task (from a previous 
 AM incarnation) would also be completed. There is at least one case in which 
 this does not hold. Case being cancellation of a completed task resulting in 
 a new running attempt.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-4128) AM Recovery expects all attempts of a completed task to also be completed.

2012-04-10 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-4128:
--

Status: Open  (was: Patch Available)

 AM Recovery expects all attempts of a completed task to also be completed.
 --

 Key: MAPREDUCE-4128
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4128
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 3.0.0
Reporter: Bikas Saha
Assignee: Bikas Saha
 Fix For: 3.0.0

 Attachments: MAPREDUCE-4128.patch


 The AM seems to assume that all attempts of a completed task (from a previous 
 AM incarnation) would also be completed. There is at least one case in which 
 this does not hold. Case being cancellation of a completed task resulting in 
 a new running attempt.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-4128) AM Recovery expects all attempts of a completed task to also be completed.

2012-04-10 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-4128:
--

Status: Patch Available  (was: Open)

 AM Recovery expects all attempts of a completed task to also be completed.
 --

 Key: MAPREDUCE-4128
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4128
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 3.0.0
Reporter: Bikas Saha
Assignee: Bikas Saha
 Fix For: 3.0.0

 Attachments: MAPREDUCE-4128.patch


 The AM seems to assume that all attempts of a completed task (from a previous 
 AM incarnation) would also be completed. There is at least one case in which 
 this does not hold. Case being cancellation of a completed task resulting in 
 a new running attempt.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3958) RM: Remove RMNodeState and replace it with NodeState

2012-04-10 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3958:
--

Status: Patch Available  (was: Open)

 RM: Remove RMNodeState and replace it with NodeState
 

 Key: MAPREDUCE-3958
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3958
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Bikas Saha
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3958.patch


 RMNodeState is being sent over the wire after MAPREDUCE-3353. This has been 
 done by cloning the enum into NodeState in yarn protocol records.
 That makes RMNodeState redundant and it should be replaced with NodeState.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3958) RM: Remove RMNodeState and replace it with NodeState

2012-04-10 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3958:
--

Attachment: MAPREDUCE-3958.patch

Patch replaces RMNodeState with NodeState. A few other unneeded imports have 
also been cleaned up.

 RM: Remove RMNodeState and replace it with NodeState
 

 Key: MAPREDUCE-3958
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3958
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Bikas Saha
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3958.patch


 RMNodeState is being sent over the wire after MAPREDUCE-3353. This has been 
 done by cloning the enum into NodeState in yarn protocol records.
 That makes RMNodeState redundant and it should be replaced with NodeState.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3958) RM: Remove RMNodeState and replace it with NodeState

2012-04-10 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3958:
--

Status: Open  (was: Patch Available)

 RM: Remove RMNodeState and replace it with NodeState
 

 Key: MAPREDUCE-3958
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3958
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Bikas Saha
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3958.patch


 RMNodeState is being sent over the wire after MAPREDUCE-3353. This has been 
 done by cloning the enum into NodeState in yarn protocol records.
 That makes RMNodeState redundant and it should be replaced with NodeState.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3958) RM: Remove RMNodeState and replace it with NodeState

2012-04-10 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3958:
--

Attachment: MAPREDUCE-3958-1.patch

The test failures are unrelated/hiccups and pass on my machine. Except for 
TestRMWebServicesNodes which was expecting the full package name of 
RMNodeState. I have replaced it with the full package name of NodeState.

 RM: Remove RMNodeState and replace it with NodeState
 

 Key: MAPREDUCE-3958
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3958
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Bikas Saha
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3958-1.patch, MAPREDUCE-3958.patch


 RMNodeState is being sent over the wire after MAPREDUCE-3353. This has been 
 done by cloning the enum into NodeState in yarn protocol records.
 That makes RMNodeState redundant and it should be replaced with NodeState.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3958) RM: Remove RMNodeState and replace it with NodeState

2012-04-10 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3958:
--

Status: Patch Available  (was: Open)

 RM: Remove RMNodeState and replace it with NodeState
 

 Key: MAPREDUCE-3958
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3958
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Bikas Saha
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3958-1.patch, MAPREDUCE-3958.patch


 RMNodeState is being sent over the wire after MAPREDUCE-3353. This has been 
 done by cloning the enum into NodeState in yarn protocol records.
 That makes RMNodeState redundant and it should be replaced with NodeState.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-4128) AM Recovery expects all attempts of a completed task to also be completed.

2012-04-09 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-4128:
--

Attachment: MAPREDUCE-4128.patch

 AM Recovery expects all attempts of a completed task to also be completed.
 --

 Key: MAPREDUCE-4128
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4128
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 3.0.0
Reporter: Bikas Saha
Assignee: Bikas Saha
 Fix For: 3.0.0

 Attachments: MAPREDUCE-4128.patch


 The AM seems to assume that all attempts of a completed task (from a previous 
 AM incarnation) would also be completed. There is at least one case in which 
 this does not hold. Case being cancellation of a completed task resulting in 
 a new running attempt.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-4128) AM Recovery expects all attempts of a completed task to also be completed.

2012-04-09 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-4128:
--

Status: Patch Available  (was: Open)

 AM Recovery expects all attempts of a completed task to also be completed.
 --

 Key: MAPREDUCE-4128
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4128
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 3.0.0
Reporter: Bikas Saha
Assignee: Bikas Saha
 Fix For: 3.0.0

 Attachments: MAPREDUCE-4128.patch


 The AM seems to assume that all attempts of a completed task (from a previous 
 AM incarnation) would also be completed. There is at least one case in which 
 this does not hold. Case being cancellation of a completed task resulting in 
 a new running attempt.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3921) MR AM should act on the nodes liveliness information when nodes go up/down/unhealthy

2012-04-06 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3921:
--

Status: Open  (was: Patch Available)

 MR AM should act on the nodes liveliness information when nodes go 
 up/down/unhealthy
 

 Key: MAPREDUCE-3921
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3921
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mr-am, mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3921-branch-0.23.patch, 
 MAPREDUCE-3921-branch-0.23.patch, MAPREDUCE-3921-branch-0.23.patch, 
 MAPREDUCE-3921.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3921) MR AM should act on the nodes liveliness information when nodes go up/down/unhealthy

2012-04-05 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3921:
--

Status: Open  (was: Patch Available)

 MR AM should act on the nodes liveliness information when nodes go 
 up/down/unhealthy
 

 Key: MAPREDUCE-3921
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3921
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mr-am, mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3921-branch-0.23.patch, 
 MAPREDUCE-3921-branch-0.23.patch, MAPREDUCE-3921-branch-0.23.patch, 
 MAPREDUCE-3921.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3921) MR AM should act on the nodes liveliness information when nodes go up/down/unhealthy

2012-04-05 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3921:
--

Attachment: MAPREDUCE-3921.patch

Some cleanup and creating new diff wrt trunk since the previous one was for 0.23

 MR AM should act on the nodes liveliness information when nodes go 
 up/down/unhealthy
 

 Key: MAPREDUCE-3921
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3921
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mr-am, mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3921-branch-0.23.patch, 
 MAPREDUCE-3921-branch-0.23.patch, MAPREDUCE-3921-branch-0.23.patch, 
 MAPREDUCE-3921.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3921) MR AM should act on the nodes liveliness information when nodes go up/down/unhealthy

2012-04-05 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3921:
--

Status: Patch Available  (was: Open)

 MR AM should act on the nodes liveliness information when nodes go 
 up/down/unhealthy
 

 Key: MAPREDUCE-3921
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3921
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mr-am, mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3921-branch-0.23.patch, 
 MAPREDUCE-3921-branch-0.23.patch, MAPREDUCE-3921-branch-0.23.patch, 
 MAPREDUCE-3921.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3921) MR AM should act on the nodes liveliness information when nodes go up/down/unhealthy

2012-03-26 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3921:
--

Attachment: MAPREDUCE-3921-branch-0.23.patch

Patch with above implemented.

 MR AM should act on the nodes liveliness information when nodes go 
 up/down/unhealthy
 

 Key: MAPREDUCE-3921
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3921
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mr-am, mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3921-branch-0.23.patch, 
 MAPREDUCE-3921-branch-0.23.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3921) MR AM should act on the nodes liveliness information when nodes go up/down/unhealthy

2012-03-26 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3921:
--

Status: Patch Available  (was: Open)

 MR AM should act on the nodes liveliness information when nodes go 
 up/down/unhealthy
 

 Key: MAPREDUCE-3921
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3921
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mr-am, mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3921-branch-0.23.patch, 
 MAPREDUCE-3921-branch-0.23.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3921) MR AM should act on the nodes liveliness information when nodes go up/down/unhealthy

2012-03-26 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3921:
--

Status: Open  (was: Patch Available)

 MR AM should act on the nodes liveliness information when nodes go 
 up/down/unhealthy
 

 Key: MAPREDUCE-3921
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3921
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mr-am, mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3921-branch-0.23.patch, 
 MAPREDUCE-3921-branch-0.23.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3921) MR AM should act on the nodes liveliness information when nodes go up/down/unhealthy

2012-03-26 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3921:
--

Attachment: MAPREDUCE-3921-branch-0.23.patch

The javadoc warning and 1 javac warning was because of a spurious import of sun 
libraries that Eclipse had inserted.
The remaining 2 javac warnings are similar to existing warnings.
==
[WARNING] 
/home/jenkins/jenkins-slave/workspace/PreCommit-MAPREDUCE-Build/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMContainerAllocator.java:[626,25]
 [unchecked] unchecked call to handle(T) as a member of the raw type 
org.apache.hadoop.yarn.event.EventHandler
[WARNING] 
/home/jenkins/jenkins-slave/workspace/PreCommit-MAPREDUCE-Build/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMContainerAllocator.java:[647,29]
 [unchecked] unchecked call to handle(T) as a member of the raw type 
org.apache.hadoop.yarn.event.EventHandler
==

 MR AM should act on the nodes liveliness information when nodes go 
 up/down/unhealthy
 

 Key: MAPREDUCE-3921
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3921
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mr-am, mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3921-branch-0.23.patch, 
 MAPREDUCE-3921-branch-0.23.patch, MAPREDUCE-3921-branch-0.23.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3921) MR AM should act on the nodes liveliness information when nodes go up/down/unhealthy

2012-03-26 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3921:
--

Status: Patch Available  (was: Open)

 MR AM should act on the nodes liveliness information when nodes go 
 up/down/unhealthy
 

 Key: MAPREDUCE-3921
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3921
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mr-am, mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3921-branch-0.23.patch, 
 MAPREDUCE-3921-branch-0.23.patch, MAPREDUCE-3921-branch-0.23.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3353) Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes

2012-03-19 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3353:
--

Status: Patch Available  (was: Open)

 Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes
 -

 Key: MAPREDUCE-3353
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3353
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: applicationmaster, mrv2, resourcemanager
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch, MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch, MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch


 When a node gets lost or turns faulty, AM needs to know about that event so 
 that it can take some action like for e.g. re-executing map tasks whose 
 intermediate output live on that faulty node.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3353) Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes

2012-03-19 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3353:
--

Attachment: MAPREDUCE-3353-branch-0.23.patch

uploading patch again to trigger hudson

 Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes
 -

 Key: MAPREDUCE-3353
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3353
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: applicationmaster, mrv2, resourcemanager
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch, MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch, MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch


 When a node gets lost or turns faulty, AM needs to know about that event so 
 that it can take some action like for e.g. re-executing map tasks whose 
 intermediate output live on that faulty node.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3353) Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes

2012-03-19 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3353:
--

Status: Open  (was: Patch Available)

 Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes
 -

 Key: MAPREDUCE-3353
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3353
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: applicationmaster, mrv2, resourcemanager
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch, MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch, MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch


 When a node gets lost or turns faulty, AM needs to know about that event so 
 that it can take some action like for e.g. re-executing map tasks whose 
 intermediate output live on that faulty node.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3353) Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes

2012-03-19 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3353:
--

Attachment: MAPREDUCE-3353-branch-0.23.patch

New patch after latest git pull. Removed unreferenced import. Reused newly 
added BuilderUtil function.

 Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes
 -

 Key: MAPREDUCE-3353
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3353
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: applicationmaster, mrv2, resourcemanager
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch, MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch, MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch, MAPREDUCE-3353-branch-0.23.patch


 When a node gets lost or turns faulty, AM needs to know about that event so 
 that it can take some action like for e.g. re-executing map tasks whose 
 intermediate output live on that faulty node.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3353) Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes

2012-03-19 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3353:
--

Status: Open  (was: Patch Available)

 Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes
 -

 Key: MAPREDUCE-3353
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3353
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: applicationmaster, mrv2, resourcemanager
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch, MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch, MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch, MAPREDUCE-3353-branch-0.23.patch


 When a node gets lost or turns faulty, AM needs to know about that event so 
 that it can take some action like for e.g. re-executing map tasks whose 
 intermediate output live on that faulty node.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3353) Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes

2012-03-19 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3353:
--

Status: Patch Available  (was: Open)

 Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes
 -

 Key: MAPREDUCE-3353
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3353
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: applicationmaster, mrv2, resourcemanager
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch, MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch, MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch, MAPREDUCE-3353-branch-0.23.patch


 When a node gets lost or turns faulty, AM needs to know about that event so 
 that it can take some action like for e.g. re-executing map tasks whose 
 intermediate output live on that faulty node.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3353) Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes

2012-03-16 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3353:
--

Status: Patch Available  (was: Open)

 Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes
 -

 Key: MAPREDUCE-3353
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3353
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: applicationmaster, mrv2, resourcemanager
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch, MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch, MAPREDUCE-3353-branch-0.23.patch


 When a node gets lost or turns faulty, AM needs to know about that event so 
 that it can take some action like for e.g. re-executing map tasks whose 
 intermediate output live on that faulty node.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3353) Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes

2012-03-16 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3353:
--

Attachment: MAPREDUCE-3353-branch-0.23.patch

New patch. I have not change ConcurrentMap implementations. They use 
ConcurrentHashmap that have safe iterators, although java docs claim that the 
iterator itself can be accessed on 1 thread. 

 Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes
 -

 Key: MAPREDUCE-3353
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3353
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: applicationmaster, mrv2, resourcemanager
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch, MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch, MAPREDUCE-3353-branch-0.23.patch


 When a node gets lost or turns faulty, AM needs to know about that event so 
 that it can take some action like for e.g. re-executing map tasks whose 
 intermediate output live on that faulty node.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3921) MR AM should act on the nodes liveliness information when nodes go up/down/unhealthy

2012-03-10 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3921:
--

Attachment: MAPREDUCE-3921-branch-0.23.patch

 MR AM should act on the nodes liveliness information when nodes go 
 up/down/unhealthy
 

 Key: MAPREDUCE-3921
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3921
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mr-am, mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3921-branch-0.23.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3353) Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes

2012-03-06 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3353:
--

Status: Open  (was: Patch Available)

 Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes
 -

 Key: MAPREDUCE-3353
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3353
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: applicationmaster, mrv2, resourcemanager
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch, MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch


 When a node gets lost or turns faulty, AM needs to know about that event so 
 that it can take some action like for e.g. re-executing map tasks whose 
 intermediate output live on that faulty node.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3353) Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes

2012-03-06 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3353:
--

Status: Patch Available  (was: Open)

 Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes
 -

 Key: MAPREDUCE-3353
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3353
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: applicationmaster, mrv2, resourcemanager
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch, MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch


 When a node gets lost or turns faulty, AM needs to know about that event so 
 that it can take some action like for e.g. re-executing map tasks whose 
 intermediate output live on that faulty node.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3353) Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes

2012-03-05 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3353:
--

Status: Open  (was: Patch Available)

 Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes
 -

 Key: MAPREDUCE-3353
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3353
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: applicationmaster, mrv2, resourcemanager
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch, MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch


 When a node gets lost or turns faulty, AM needs to know about that event so 
 that it can take some action like for e.g. re-executing map tasks whose 
 intermediate output live on that faulty node.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3353) Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes

2012-03-05 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3353:
--

Attachment: MAPREDUCE-3353-branch-0.23.patch

Adding new patch with latest changes pulled and merged.

 Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes
 -

 Key: MAPREDUCE-3353
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3353
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: applicationmaster, mrv2, resourcemanager
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch, MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch


 When a node gets lost or turns faulty, AM needs to know about that event so 
 that it can take some action like for e.g. re-executing map tasks whose 
 intermediate output live on that faulty node.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3353) Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes

2012-03-05 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3353:
--

Status: Patch Available  (was: Open)

 Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes
 -

 Key: MAPREDUCE-3353
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3353
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: applicationmaster, mrv2, resourcemanager
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch, MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch


 When a node gets lost or turns faulty, AM needs to know about that event so 
 that it can take some action like for e.g. re-executing map tasks whose 
 intermediate output live on that faulty node.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3353) Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes

2012-03-01 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3353:
--

Attachment: MAPREDUCE-3353-branch-0.23.patch

Attaching patch. This passes all tests locally and has a functional test for 
main changes.
1) providing all unusable nodes on app attempt registration
2) providing delta updates of nodes thereafter to a running app
I will scan through the changes for final clean ups and look at adding some 
more tests if necessary.

 Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes
 -

 Key: MAPREDUCE-3353
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3353
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: applicationmaster, mrv2, resourcemanager
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
Priority: Critical
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3353-branch-0.23.patch


 When a node gets lost or turns faulty, AM needs to know about that event so 
 that it can take some action like for e.g. re-executing map tasks whose 
 intermediate output live on that faulty node.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3353) Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes

2012-03-01 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3353:
--

Attachment: MAPREDUCE-3353-branch-0.23.patch

Done with planned changes. Patch for review.

 Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes
 -

 Key: MAPREDUCE-3353
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3353
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: applicationmaster, mrv2, resourcemanager
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
Priority: Critical
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch


 When a node gets lost or turns faulty, AM needs to know about that event so 
 that it can take some action like for e.g. re-executing map tasks whose 
 intermediate output live on that faulty node.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3353) Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes

2012-03-01 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3353:
--

Status: Patch Available  (was: Open)

 Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes
 -

 Key: MAPREDUCE-3353
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3353
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: applicationmaster, mrv2, resourcemanager
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
Priority: Critical
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch


 When a node gets lost or turns faulty, AM needs to know about that event so 
 that it can take some action like for e.g. re-executing map tasks whose 
 intermediate output live on that faulty node.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3353) Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes

2012-03-01 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3353:
--

Status: Open  (was: Patch Available)

 Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes
 -

 Key: MAPREDUCE-3353
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3353
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: applicationmaster, mrv2, resourcemanager
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
Priority: Critical
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch


 When a node gets lost or turns faulty, AM needs to know about that event so 
 that it can take some action like for e.g. re-executing map tasks whose 
 intermediate output live on that faulty node.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3353) Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes

2012-03-01 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3353:
--

Status: Patch Available  (was: Open)

 Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes
 -

 Key: MAPREDUCE-3353
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3353
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: applicationmaster, mrv2, resourcemanager
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
Priority: Critical
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch, MAPREDUCE-3353-branch-0.23.patch


 When a node gets lost or turns faulty, AM needs to know about that event so 
 that it can take some action like for e.g. re-executing map tasks whose 
 intermediate output live on that faulty node.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3353) Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes

2012-03-01 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3353:
--

Attachment: MAPREDUCE-3353-branch-0.23.patch

1) Fixed the javadoc warning.

2) The javac warnings are because of events handlers being called in 
NodesListManager.java and are similar to pre-existing warnings.
===
[WARNING] 
/home/jenkins/jenkins-slave/workspace/PreCommit-MAPREDUCE-Build/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/NodesListManager.java:[142,19]
 [unchecked] unchecked call to handle(T) as a member of the raw type 
org.apache.hadoop.yarn.event.EventHandler
[WARNING] 
/home/jenkins/jenkins-slave/workspace/PreCommit-MAPREDUCE-Build/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/NodesListManager.java:[155,21]
 [unchecked] unchecked call to handle(T) as a member of the raw type 
org.apache.hadoop.yarn.event.EventHandler
[WARNING] 
/home/jenkins/jenkins-slave/workspace/PreCommit-MAPREDUCE-Build/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmcontainer/RMContainerImpl.java:[244,35]
 [unchecked] unchecked call to handle(T) as a member of the raw type 
org.apache.hadoop.yarn.event.EventHandler
===

 Need a RM-AM channel to inform AMs about faulty/unhealthy/lost nodes
 -

 Key: MAPREDUCE-3353
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3353
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: applicationmaster, mrv2, resourcemanager
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Bikas Saha
Priority: Critical
 Fix For: 0.23.2

 Attachments: MAPREDUCE-3353-branch-0.23.patch, 
 MAPREDUCE-3353-branch-0.23.patch, MAPREDUCE-3353-branch-0.23.patch


 When a node gets lost or turns faulty, AM needs to know about that event so 
 that it can take some action like for e.g. re-executing map tasks whose 
 intermediate output live on that faulty node.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3958) RM: Remove RMNodeState and replace it with NodeState

2012-03-01 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3958:
--

Summary: RM: Remove RMNodeState and replace it with NodeState  (was: Remove 
RMNodeState and replace it with NodeState)

 RM: Remove RMNodeState and replace it with NodeState
 

 Key: MAPREDUCE-3958
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3958
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Bikas Saha
 Fix For: 0.23.2


 RMNodeState is being sent over the wire after MAPREDUCE-3353. This has been 
 done by cloning the enum into NodeState in yarn protocol records.
 That makes RMNodeState redundant and it should be replaced with NodeState.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-3923) RM/AM/JHS webservers should return HTTP.BadRequest for malformed requests and not HTTP.NotFound

2012-02-24 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-3923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-3923:
--

  Component/s: webapps
  Description: 
Many webserver methods (eg. 
AMWebServices.getTaskAttemptFromTaskAttemptString()) return NotFound for 
malformed requests instead of BadRequest.
This would be inconsistent with expected HTTP behavior. Would be good to fix 
them. NotFound should be returned for valid resources which dont exist.
Affects Version/s: 0.23.0
Fix Version/s: 0.23.2
  Summary: RM/AM/JHS webservers should return HTTP.BadRequest for 
malformed requests and not HTTP.NotFound  (was: RM/AM/JHS webserver)

 RM/AM/JHS webservers should return HTTP.BadRequest for malformed requests and 
 not HTTP.NotFound
 ---

 Key: MAPREDUCE-3923
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3923
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: webapps
Affects Versions: 0.23.0
Reporter: Bikas Saha
 Fix For: 0.23.2


 Many webserver methods (eg. 
 AMWebServices.getTaskAttemptFromTaskAttemptString()) return NotFound for 
 malformed requests instead of BadRequest.
 This would be inconsistent with expected HTTP behavior. Would be good to fix 
 them. NotFound should be returned for valid resources which dont exist.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-2793) [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs

2012-02-24 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-2793:
--

Status: Open  (was: Patch Available)

 [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs 
 --

 Key: MAPREDUCE-2793
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2793
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Ramya Sunil
Assignee: Bikas Saha
Priority: Critical
 Fix For: 0.23.2

 Attachments: MAPREDUCE-2793-branch-0.23.fix.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793.patch


 appIDs, jobIDs and attempt/container ids are not consistently named in the 
 logs, console and UI. For consistency purpose, they all have to follow a 
 common naming convention.
 Currently, 
 For appID
 =
 On the RM UI: app_1308259676864_5 
 On the JHS UI: No appID 
 Console/logs: No appID
 mapred-local dirs are named as: application_1308259676864_0005
 For jobID
 =
 On the RM UI: job_1308259676864_5_5 
 JHS UI: job_1308259676864_5_5 
 Console/logs: job_1308259676864_0005
 mapred-local dirs are named as: No jobID
 For attemptID
 
 On the RM UI: attempt_1308259676864_5_5_m_24_0
 JHS attempt_1308259676864_5_5_m_24_0
 Console/logs: attempt_1308259676864_0005_m_24_0
 mapred-local dirs are named as: container_1308259676864_0005_24

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-2793) [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs

2012-02-24 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-2793:
--

Attachment: MAPREDUCE-2793-branch-0.23.fix.patch

Re-enabling those tests. Tests pass locally.

 [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs 
 --

 Key: MAPREDUCE-2793
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2793
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Ramya Sunil
Assignee: Bikas Saha
Priority: Critical
 Fix For: 0.23.2

 Attachments: MAPREDUCE-2793-branch-0.23.fix.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793.patch


 appIDs, jobIDs and attempt/container ids are not consistently named in the 
 logs, console and UI. For consistency purpose, they all have to follow a 
 common naming convention.
 Currently, 
 For appID
 =
 On the RM UI: app_1308259676864_5 
 On the JHS UI: No appID 
 Console/logs: No appID
 mapred-local dirs are named as: application_1308259676864_0005
 For jobID
 =
 On the RM UI: job_1308259676864_5_5 
 JHS UI: job_1308259676864_5_5 
 Console/logs: job_1308259676864_0005
 mapred-local dirs are named as: No jobID
 For attemptID
 
 On the RM UI: attempt_1308259676864_5_5_m_24_0
 JHS attempt_1308259676864_5_5_m_24_0
 Console/logs: attempt_1308259676864_0005_m_24_0
 mapred-local dirs are named as: container_1308259676864_0005_24

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-2793) [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs

2012-02-23 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-2793:
--

Status: Patch Available  (was: Open)

 [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs 
 --

 Key: MAPREDUCE-2793
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2793
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Ramya Sunil
Assignee: Bikas Saha
Priority: Critical
 Fix For: 0.23.2

 Attachments: MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793.patch


 appIDs, jobIDs and attempt/container ids are not consistently named in the 
 logs, console and UI. For consistency purpose, they all have to follow a 
 common naming convention.
 Currently, 
 For appID
 =
 On the RM UI: app_1308259676864_5 
 On the JHS UI: No appID 
 Console/logs: No appID
 mapred-local dirs are named as: application_1308259676864_0005
 For jobID
 =
 On the RM UI: job_1308259676864_5_5 
 JHS UI: job_1308259676864_5_5 
 Console/logs: job_1308259676864_0005
 mapred-local dirs are named as: No jobID
 For attemptID
 
 On the RM UI: attempt_1308259676864_5_5_m_24_0
 JHS attempt_1308259676864_5_5_m_24_0
 Console/logs: attempt_1308259676864_0005_m_24_0
 mapred-local dirs are named as: container_1308259676864_0005_24

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-2793) [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs

2012-02-23 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-2793:
--

Attachment: MAPREDUCE-2793-branch-0.23.patch

Changed the test to have jobid==appid. The AppContext methods that are supposed 
to return appId for the AppContext return null for this TestAppContext so that 
it crashes deterministically if it gets used in the  future.

 [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs 
 --

 Key: MAPREDUCE-2793
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2793
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Ramya Sunil
Assignee: Bikas Saha
Priority: Critical
 Fix For: 0.23.2

 Attachments: MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793.patch


 appIDs, jobIDs and attempt/container ids are not consistently named in the 
 logs, console and UI. For consistency purpose, they all have to follow a 
 common naming convention.
 Currently, 
 For appID
 =
 On the RM UI: app_1308259676864_5 
 On the JHS UI: No appID 
 Console/logs: No appID
 mapred-local dirs are named as: application_1308259676864_0005
 For jobID
 =
 On the RM UI: job_1308259676864_5_5 
 JHS UI: job_1308259676864_5_5 
 Console/logs: job_1308259676864_0005
 mapred-local dirs are named as: No jobID
 For attemptID
 
 On the RM UI: attempt_1308259676864_5_5_m_24_0
 JHS attempt_1308259676864_5_5_m_24_0
 Console/logs: attempt_1308259676864_0005_m_24_0
 mapred-local dirs are named as: container_1308259676864_0005_24

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-2793) [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs

2012-02-23 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-2793:
--

Status: Open  (was: Patch Available)

 [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs 
 --

 Key: MAPREDUCE-2793
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2793
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Ramya Sunil
Assignee: Bikas Saha
Priority: Critical
 Fix For: 0.23.2

 Attachments: MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793.patch


 appIDs, jobIDs and attempt/container ids are not consistently named in the 
 logs, console and UI. For consistency purpose, they all have to follow a 
 common naming convention.
 Currently, 
 For appID
 =
 On the RM UI: app_1308259676864_5 
 On the JHS UI: No appID 
 Console/logs: No appID
 mapred-local dirs are named as: application_1308259676864_0005
 For jobID
 =
 On the RM UI: job_1308259676864_5_5 
 JHS UI: job_1308259676864_5_5 
 Console/logs: job_1308259676864_0005
 mapred-local dirs are named as: No jobID
 For attemptID
 
 On the RM UI: attempt_1308259676864_5_5_m_24_0
 JHS attempt_1308259676864_5_5_m_24_0
 Console/logs: attempt_1308259676864_0005_m_24_0
 mapred-local dirs are named as: container_1308259676864_0005_24

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-2793) [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs

2012-02-22 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-2793:
--

Attachment: MAPREDUCE-2793-branch-0.23.patch

This patch does not have extra strings.

 [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs 
 --

 Key: MAPREDUCE-2793
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2793
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Ramya Sunil
Assignee: Bikas Saha
Priority: Critical
 Fix For: 0.23.2

 Attachments: MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793.patch


 appIDs, jobIDs and attempt/container ids are not consistently named in the 
 logs, console and UI. For consistency purpose, they all have to follow a 
 common naming convention.
 Currently, 
 For appID
 =
 On the RM UI: app_1308259676864_5 
 On the JHS UI: No appID 
 Console/logs: No appID
 mapred-local dirs are named as: application_1308259676864_0005
 For jobID
 =
 On the RM UI: job_1308259676864_5_5 
 JHS UI: job_1308259676864_5_5 
 Console/logs: job_1308259676864_0005
 mapred-local dirs are named as: No jobID
 For attemptID
 
 On the RM UI: attempt_1308259676864_5_5_m_24_0
 JHS attempt_1308259676864_5_5_m_24_0
 Console/logs: attempt_1308259676864_0005_m_24_0
 mapred-local dirs are named as: container_1308259676864_0005_24

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-2793) [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs

2012-02-21 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-2793:
--

Attachment: MAPREDUCE-2793-branch-0.23.patch

I did not use the helper methods in ConvertorUtils because the currently used 
one have better error messages and some tests are testing that proper errors 
are reported.
Rest fixed. The code in the forName functions are trying to use the same 
exception code and  use fall through from catch blocks to do that. I have made 
the minimal changes to make it work with the above code flow.

 [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs 
 --

 Key: MAPREDUCE-2793
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2793
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Ramya Sunil
Assignee: Bikas Saha
Priority: Critical
 Fix For: 0.23.2

 Attachments: MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793.patch


 appIDs, jobIDs and attempt/container ids are not consistently named in the 
 logs, console and UI. For consistency purpose, they all have to follow a 
 common naming convention.
 Currently, 
 For appID
 =
 On the RM UI: app_1308259676864_5 
 On the JHS UI: No appID 
 Console/logs: No appID
 mapred-local dirs are named as: application_1308259676864_0005
 For jobID
 =
 On the RM UI: job_1308259676864_5_5 
 JHS UI: job_1308259676864_5_5 
 Console/logs: job_1308259676864_0005
 mapred-local dirs are named as: No jobID
 For attemptID
 
 On the RM UI: attempt_1308259676864_5_5_m_24_0
 JHS attempt_1308259676864_5_5_m_24_0
 Console/logs: attempt_1308259676864_0005_m_24_0
 mapred-local dirs are named as: container_1308259676864_0005_24

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-2793) [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs

2012-02-21 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-2793:
--

Status: Patch Available  (was: Open)

 [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs 
 --

 Key: MAPREDUCE-2793
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2793
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Ramya Sunil
Assignee: Bikas Saha
Priority: Critical
 Fix For: 0.23.2

 Attachments: MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793.patch


 appIDs, jobIDs and attempt/container ids are not consistently named in the 
 logs, console and UI. For consistency purpose, they all have to follow a 
 common naming convention.
 Currently, 
 For appID
 =
 On the RM UI: app_1308259676864_5 
 On the JHS UI: No appID 
 Console/logs: No appID
 mapred-local dirs are named as: application_1308259676864_0005
 For jobID
 =
 On the RM UI: job_1308259676864_5_5 
 JHS UI: job_1308259676864_5_5 
 Console/logs: job_1308259676864_0005
 mapred-local dirs are named as: No jobID
 For attemptID
 
 On the RM UI: attempt_1308259676864_5_5_m_24_0
 JHS attempt_1308259676864_5_5_m_24_0
 Console/logs: attempt_1308259676864_0005_m_24_0
 mapred-local dirs are named as: container_1308259676864_0005_24

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-2793) [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs

2012-02-21 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-2793:
--

Status: Open  (was: Patch Available)

 [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs 
 --

 Key: MAPREDUCE-2793
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2793
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Ramya Sunil
Assignee: Bikas Saha
Priority: Critical
 Fix For: 0.23.2

 Attachments: MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793.patch


 appIDs, jobIDs and attempt/container ids are not consistently named in the 
 logs, console and UI. For consistency purpose, they all have to follow a 
 common naming convention.
 Currently, 
 For appID
 =
 On the RM UI: app_1308259676864_5 
 On the JHS UI: No appID 
 Console/logs: No appID
 mapred-local dirs are named as: application_1308259676864_0005
 For jobID
 =
 On the RM UI: job_1308259676864_5_5 
 JHS UI: job_1308259676864_5_5 
 Console/logs: job_1308259676864_0005
 mapred-local dirs are named as: No jobID
 For attemptID
 
 On the RM UI: attempt_1308259676864_5_5_m_24_0
 JHS attempt_1308259676864_5_5_m_24_0
 Console/logs: attempt_1308259676864_0005_m_24_0
 mapred-local dirs are named as: container_1308259676864_0005_24

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-2793) [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs

2012-02-21 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-2793:
--

Attachment: MAPREDUCE-2793-branch-0.23.patch

Uploading new patch per comments above. I have run all the failed tests locally 
and they pass.

 [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs 
 --

 Key: MAPREDUCE-2793
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2793
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Ramya Sunil
Assignee: Bikas Saha
Priority: Critical
 Fix For: 0.23.2

 Attachments: MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793.patch


 appIDs, jobIDs and attempt/container ids are not consistently named in the 
 logs, console and UI. For consistency purpose, they all have to follow a 
 common naming convention.
 Currently, 
 For appID
 =
 On the RM UI: app_1308259676864_5 
 On the JHS UI: No appID 
 Console/logs: No appID
 mapred-local dirs are named as: application_1308259676864_0005
 For jobID
 =
 On the RM UI: job_1308259676864_5_5 
 JHS UI: job_1308259676864_5_5 
 Console/logs: job_1308259676864_0005
 mapred-local dirs are named as: No jobID
 For attemptID
 
 On the RM UI: attempt_1308259676864_5_5_m_24_0
 JHS attempt_1308259676864_5_5_m_24_0
 Console/logs: attempt_1308259676864_0005_m_24_0
 mapred-local dirs are named as: container_1308259676864_0005_24

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-2793) [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs

2012-02-21 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-2793:
--

Status: Patch Available  (was: Open)

 [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs 
 --

 Key: MAPREDUCE-2793
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2793
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Ramya Sunil
Assignee: Bikas Saha
Priority: Critical
 Fix For: 0.23.2

 Attachments: MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793.patch


 appIDs, jobIDs and attempt/container ids are not consistently named in the 
 logs, console and UI. For consistency purpose, they all have to follow a 
 common naming convention.
 Currently, 
 For appID
 =
 On the RM UI: app_1308259676864_5 
 On the JHS UI: No appID 
 Console/logs: No appID
 mapred-local dirs are named as: application_1308259676864_0005
 For jobID
 =
 On the RM UI: job_1308259676864_5_5 
 JHS UI: job_1308259676864_5_5 
 Console/logs: job_1308259676864_0005
 mapred-local dirs are named as: No jobID
 For attemptID
 
 On the RM UI: attempt_1308259676864_5_5_m_24_0
 JHS attempt_1308259676864_5_5_m_24_0
 Console/logs: attempt_1308259676864_0005_m_24_0
 mapred-local dirs are named as: container_1308259676864_0005_24

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-2793) [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs

2012-02-15 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-2793:
--

Status: Patch Available  (was: Open)

 [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs 
 --

 Key: MAPREDUCE-2793
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2793
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Ramya Sunil
Assignee: Bikas Saha
Priority: Critical
 Fix For: 0.23.2

 Attachments: MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793.patch


 appIDs, jobIDs and attempt/container ids are not consistently named in the 
 logs, console and UI. For consistency purpose, they all have to follow a 
 common naming convention.
 Currently, 
 For appID
 =
 On the RM UI: app_1308259676864_5 
 On the JHS UI: No appID 
 Console/logs: No appID
 mapred-local dirs are named as: application_1308259676864_0005
 For jobID
 =
 On the RM UI: job_1308259676864_5_5 
 JHS UI: job_1308259676864_5_5 
 Console/logs: job_1308259676864_0005
 mapred-local dirs are named as: No jobID
 For attemptID
 
 On the RM UI: attempt_1308259676864_5_5_m_24_0
 JHS attempt_1308259676864_5_5_m_24_0
 Console/logs: attempt_1308259676864_0005_m_24_0
 mapred-local dirs are named as: container_1308259676864_0005_24

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-2793) [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs

2012-02-15 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-2793:
--

Attachment: MAPREDUCE-2793-branch-0.23.patch

new patch with fixed tests

 [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs 
 --

 Key: MAPREDUCE-2793
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2793
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Ramya Sunil
Assignee: Bikas Saha
Priority: Critical
 Fix For: 0.23.2

 Attachments: MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793.patch


 appIDs, jobIDs and attempt/container ids are not consistently named in the 
 logs, console and UI. For consistency purpose, they all have to follow a 
 common naming convention.
 Currently, 
 For appID
 =
 On the RM UI: app_1308259676864_5 
 On the JHS UI: No appID 
 Console/logs: No appID
 mapred-local dirs are named as: application_1308259676864_0005
 For jobID
 =
 On the RM UI: job_1308259676864_5_5 
 JHS UI: job_1308259676864_5_5 
 Console/logs: job_1308259676864_0005
 mapred-local dirs are named as: No jobID
 For attemptID
 
 On the RM UI: attempt_1308259676864_5_5_m_24_0
 JHS attempt_1308259676864_5_5_m_24_0
 Console/logs: attempt_1308259676864_0005_m_24_0
 mapred-local dirs are named as: container_1308259676864_0005_24

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-2793) [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs

2012-02-15 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-2793:
--

Status: Open  (was: Patch Available)

 [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs 
 --

 Key: MAPREDUCE-2793
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2793
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Ramya Sunil
Assignee: Bikas Saha
Priority: Critical
 Fix For: 0.23.2

 Attachments: MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793.patch


 appIDs, jobIDs and attempt/container ids are not consistently named in the 
 logs, console and UI. For consistency purpose, they all have to follow a 
 common naming convention.
 Currently, 
 For appID
 =
 On the RM UI: app_1308259676864_5 
 On the JHS UI: No appID 
 Console/logs: No appID
 mapred-local dirs are named as: application_1308259676864_0005
 For jobID
 =
 On the RM UI: job_1308259676864_5_5 
 JHS UI: job_1308259676864_5_5 
 Console/logs: job_1308259676864_0005
 mapred-local dirs are named as: No jobID
 For attemptID
 
 On the RM UI: attempt_1308259676864_5_5_m_24_0
 JHS attempt_1308259676864_5_5_m_24_0
 Console/logs: attempt_1308259676864_0005_m_24_0
 mapred-local dirs are named as: container_1308259676864_0005_24

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-2793) [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs

2012-02-15 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-2793:
--

Status: Patch Available  (was: Open)

 [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs 
 --

 Key: MAPREDUCE-2793
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2793
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Ramya Sunil
Assignee: Bikas Saha
Priority: Critical
 Fix For: 0.23.2

 Attachments: MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793.patch


 appIDs, jobIDs and attempt/container ids are not consistently named in the 
 logs, console and UI. For consistency purpose, they all have to follow a 
 common naming convention.
 Currently, 
 For appID
 =
 On the RM UI: app_1308259676864_5 
 On the JHS UI: No appID 
 Console/logs: No appID
 mapred-local dirs are named as: application_1308259676864_0005
 For jobID
 =
 On the RM UI: job_1308259676864_5_5 
 JHS UI: job_1308259676864_5_5 
 Console/logs: job_1308259676864_0005
 mapred-local dirs are named as: No jobID
 For attemptID
 
 On the RM UI: attempt_1308259676864_5_5_m_24_0
 JHS attempt_1308259676864_5_5_m_24_0
 Console/logs: attempt_1308259676864_0005_m_24_0
 mapred-local dirs are named as: container_1308259676864_0005_24

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-2793) [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs

2012-02-15 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-2793:
--

Attachment: MAPREDUCE-2793-branch-0.23.patch

new patch. running tests locally in parallel.

 [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs 
 --

 Key: MAPREDUCE-2793
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2793
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Ramya Sunil
Assignee: Bikas Saha
Priority: Critical
 Fix For: 0.23.2

 Attachments: MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793.patch


 appIDs, jobIDs and attempt/container ids are not consistently named in the 
 logs, console and UI. For consistency purpose, they all have to follow a 
 common naming convention.
 Currently, 
 For appID
 =
 On the RM UI: app_1308259676864_5 
 On the JHS UI: No appID 
 Console/logs: No appID
 mapred-local dirs are named as: application_1308259676864_0005
 For jobID
 =
 On the RM UI: job_1308259676864_5_5 
 JHS UI: job_1308259676864_5_5 
 Console/logs: job_1308259676864_0005
 mapred-local dirs are named as: No jobID
 For attemptID
 
 On the RM UI: attempt_1308259676864_5_5_m_24_0
 JHS attempt_1308259676864_5_5_m_24_0
 Console/logs: attempt_1308259676864_0005_m_24_0
 mapred-local dirs are named as: container_1308259676864_0005_24

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-2793) [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs

2012-02-15 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-2793:
--

Status: Patch Available  (was: Open)

 [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs 
 --

 Key: MAPREDUCE-2793
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2793
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Ramya Sunil
Assignee: Bikas Saha
Priority: Critical
 Fix For: 0.23.2

 Attachments: MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793.patch


 appIDs, jobIDs and attempt/container ids are not consistently named in the 
 logs, console and UI. For consistency purpose, they all have to follow a 
 common naming convention.
 Currently, 
 For appID
 =
 On the RM UI: app_1308259676864_5 
 On the JHS UI: No appID 
 Console/logs: No appID
 mapred-local dirs are named as: application_1308259676864_0005
 For jobID
 =
 On the RM UI: job_1308259676864_5_5 
 JHS UI: job_1308259676864_5_5 
 Console/logs: job_1308259676864_0005
 mapred-local dirs are named as: No jobID
 For attemptID
 
 On the RM UI: attempt_1308259676864_5_5_m_24_0
 JHS attempt_1308259676864_5_5_m_24_0
 Console/logs: attempt_1308259676864_0005_m_24_0
 mapred-local dirs are named as: container_1308259676864_0005_24

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-2793) [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs

2012-02-15 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-2793:
--

Status: Open  (was: Patch Available)

 [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs 
 --

 Key: MAPREDUCE-2793
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2793
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Ramya Sunil
Assignee: Bikas Saha
Priority: Critical
 Fix For: 0.23.2

 Attachments: MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793-branch-0.23.patch, 
 MAPREDUCE-2793.patch


 appIDs, jobIDs and attempt/container ids are not consistently named in the 
 logs, console and UI. For consistency purpose, they all have to follow a 
 common naming convention.
 Currently, 
 For appID
 =
 On the RM UI: app_1308259676864_5 
 On the JHS UI: No appID 
 Console/logs: No appID
 mapred-local dirs are named as: application_1308259676864_0005
 For jobID
 =
 On the RM UI: job_1308259676864_5_5 
 JHS UI: job_1308259676864_5_5 
 Console/logs: job_1308259676864_0005
 mapred-local dirs are named as: No jobID
 For attemptID
 
 On the RM UI: attempt_1308259676864_5_5_m_24_0
 JHS attempt_1308259676864_5_5_m_24_0
 Console/logs: attempt_1308259676864_0005_m_24_0
 mapred-local dirs are named as: container_1308259676864_0005_24

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-2793) [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs

2012-02-14 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-2793:
--

Attachment: MAPREDUCE-2793-branch-0.23.patch

Adding patch with code and test fixes.

 [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs 
 --

 Key: MAPREDUCE-2793
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2793
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Ramya Sunil
Assignee: Bikas Saha
Priority: Critical
 Fix For: 0.23.2

 Attachments: MAPREDUCE-2793-branch-0.23.patch, MAPREDUCE-2793.patch


 appIDs, jobIDs and attempt/container ids are not consistently named in the 
 logs, console and UI. For consistency purpose, they all have to follow a 
 common naming convention.
 Currently, 
 For appID
 =
 On the RM UI: app_1308259676864_5 
 On the JHS UI: No appID 
 Console/logs: No appID
 mapred-local dirs are named as: application_1308259676864_0005
 For jobID
 =
 On the RM UI: job_1308259676864_5_5 
 JHS UI: job_1308259676864_5_5 
 Console/logs: job_1308259676864_0005
 mapred-local dirs are named as: No jobID
 For attemptID
 
 On the RM UI: attempt_1308259676864_5_5_m_24_0
 JHS attempt_1308259676864_5_5_m_24_0
 Console/logs: attempt_1308259676864_0005_m_24_0
 mapred-local dirs are named as: container_1308259676864_0005_24

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (MAPREDUCE-2793) [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs

2012-02-13 Thread Bikas Saha (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bikas Saha updated MAPREDUCE-2793:
--

Assignee: Bikas Saha  (was: Mahadev konar)

 [MR-279] Maintain consistency in naming appIDs, jobIDs and attemptIDs 
 --

 Key: MAPREDUCE-2793
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2793
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv2
Affects Versions: 0.23.0
Reporter: Ramya Sunil
Assignee: Bikas Saha
Priority: Critical
 Fix For: 0.23.2

 Attachments: MAPREDUCE-2793.patch


 appIDs, jobIDs and attempt/container ids are not consistently named in the 
 logs, console and UI. For consistency purpose, they all have to follow a 
 common naming convention.
 Currently, 
 For appID
 =
 On the RM UI: app_1308259676864_5 
 On the JHS UI: No appID 
 Console/logs: No appID
 mapred-local dirs are named as: application_1308259676864_0005
 For jobID
 =
 On the RM UI: job_1308259676864_5_5 
 JHS UI: job_1308259676864_5_5 
 Console/logs: job_1308259676864_0005
 mapred-local dirs are named as: No jobID
 For attemptID
 
 On the RM UI: attempt_1308259676864_5_5_m_24_0
 JHS attempt_1308259676864_5_5_m_24_0
 Console/logs: attempt_1308259676864_0005_m_24_0
 mapred-local dirs are named as: container_1308259676864_0005_24

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira