[jira] [Updated] (MAPREDUCE-3256) Authorization checks needed for AM->NM protocol

2011-10-24 Thread Vinod Kumar Vavilapalli (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-3256: --- Description: We already authenticate requests to NM from any AM.

[jira] [Created] (MAPREDUCE-3257) Authorization checks needed for AM->RM protocol

2011-10-24 Thread Vinod Kumar Vavilapalli (Created) (JIRA)
Authorization checks needed for AM->RM protocol --- Key: MAPREDUCE-3257 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3257 Project: Hadoop Map/Reduce Issue Type: Sub-task Reporte

[jira] [Assigned] (MAPREDUCE-3256) Authorization checks needed for AM->NM protocol

2011-10-24 Thread Vinod Kumar Vavilapalli (Assigned) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli reassigned MAPREDUCE-3256: -- Assignee: Vinod Kumar Vavilapalli > Authorization check

[jira] [Updated] (MAPREDUCE-2821) [MR-279] Missing fields in job summary logs

2011-10-24 Thread Arun C Murthy (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-2821: - Resolution: Fixed Status: Resolved (was: Patch Available) I just committed t

[jira] [Updated] (MAPREDUCE-2746) [MR-279] [Security] Yarn servers can't communicate with each other with hadoop.security.authorization set to true

2011-10-24 Thread Mahadev konar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar updated MAPREDUCE-2746: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Commented] (MAPREDUCE-3255) MR2 needs a counter analogous to "slot seconds"

2011-10-24 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134773#comment-13134773 ] Todd Lipcon commented on MAPREDUCE-3255: Ah, it looks like the SLOT_MILLIS_* c

[jira] [Updated] (MAPREDUCE-3253) ContextFactory throw NoSuchFieldException

2011-10-24 Thread Arun C Murthy (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-3253: - Attachment: MAPREDUCE-3253.patch Fixed ContextFactory, improved javadoc and added a t

[jira] [Updated] (MAPREDUCE-3253) ContextFactory throw NoSuchFieldException

2011-10-24 Thread Arun C Murthy (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-3253: - Status: Patch Available (was: Open) > ContextFactory throw NoSuchFieldException

[jira] [Updated] (MAPREDUCE-3256) Authorization checks needed for AM->NM and AM->RM protocols

2011-10-24 Thread Vinod Kumar Vavilapalli (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-3256: --- Component/s: resourcemanager nodemana

[jira] [Created] (MAPREDUCE-3256) Authorization checks needed for AM->NM and AM->RM protocols

2011-10-24 Thread Vinod Kumar Vavilapalli (Created) (JIRA)
Authorization checks needed for AM->NM and AM->RM protocols --- Key: MAPREDUCE-3256 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3256 Project: Hadoop Map/Reduce Issue Type: Sub-

[jira] [Updated] (MAPREDUCE-3250) When AM restarts, client keeps reconnecting to the new AM and prints a lots of logs.

2011-10-24 Thread Vinod Kumar Vavilapalli (Updated) (JIRA)
Fix For: 0.23.0 > > Attachments: MAPREDUCE-3250-20111024.txt, MAPREDUCE-3250-20111025.txt > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAd

[jira] [Updated] (MAPREDUCE-3250) When AM restarts, client keeps reconnecting to the new AM and prints a lots of logs.

2011-10-24 Thread Vinod Kumar Vavilapalli (Updated) (JIRA)
Priority: Blocker > Fix For: 0.23.0 > > Attachments: MAPREDUCE-3250-20111024.txt, MAPREDUCE-3250-20111025.txt > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apa

[jira] [Commented] (MAPREDUCE-2746) [MR-279] [Security] Yarn servers can't communicate with each other with hadoop.security.authorization set to true

2011-10-24 Thread Mahadev konar (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134757#comment-13134757 ] Mahadev konar commented on MAPREDUCE-2746: -- Tried it out on a cluster, seems

[jira] [Commented] (MAPREDUCE-2850) TaskTracker disk failure handling (MR-2413) has no test coverage

2011-10-24 Thread Ravi Gummadi (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134743#comment-13134743 ] Ravi Gummadi commented on MAPREDUCE-2850: - test-patch passed on my local machi

[jira] [Updated] (MAPREDUCE-3193) FileInputFormat doesn't read files recursively in the input path dir

2011-10-24 Thread Mahadev konar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar updated MAPREDUCE-3193: - Status: Open (was: Patch Available) cancelling patch to address Tom's comments.

[jira] [Commented] (MAPREDUCE-3121) NodeManager should handle disk-failures

2011-10-24 Thread Ravi Gummadi (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134735#comment-13134735 ] Ravi Gummadi commented on MAPREDUCE-3121: - Yes. Adding a TimerTask that checks

[jira] [Updated] (MAPREDUCE-2989) JobHistory should link to task logs

2011-10-24 Thread Siddharth Seth (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated MAPREDUCE-2989: -- Attachment: MR2989_v3.txt Rebased, and fixed the findbugs warnings.

[jira] [Updated] (MAPREDUCE-3240) NM should send a SIGKILL for completed containers also

2011-10-24 Thread Hitesh Shah (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated MAPREDUCE-3240: --- Attachment: MR-3240.1.patch Worked around things slightly now to have setsid be invoked b

[jira] [Updated] (MAPREDUCE-3240) NM should send a SIGKILL for completed containers also

2011-10-24 Thread Hitesh Shah (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated MAPREDUCE-3240: --- Status: Patch Available (was: Open) > NM should send a SIGKILL for completed contain

[jira] [Resolved] (MAPREDUCE-3084) race when KILL_CONTAINER is received for a LOCALIZED container

2011-10-24 Thread Hitesh Shah (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved MAPREDUCE-3084. Resolution: Duplicate Fix Version/s: 0.23.0 Target Version/s: 0.23.0 B

[jira] [Assigned] (MAPREDUCE-3253) ContextFactory throw NoSuchFieldException

2011-10-24 Thread Arun C Murthy (Assigned) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy reassigned MAPREDUCE-3253: Assignee: Arun C Murthy (was: Mahadev konar) Ok, I can reproduce this on branc

[jira] [Commented] (MAPREDUCE-3253) ContextFactory throw NoSuchFieldException

2011-10-24 Thread Arun C Murthy (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134678#comment-13134678 ] Arun C Murthy commented on MAPREDUCE-3253: -- Daniel, which version of Hadoop w

[jira] [Resolved] (MAPREDUCE-3159) DefaultContainerExecutor removes appcache dir on every localization

2011-10-24 Thread Todd Lipcon (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved MAPREDUCE-3159. Resolution: Fixed Hadoop Flags: Reviewed > DefaultContainerExecutor removes a

[jira] [Commented] (MAPREDUCE-3159) DefaultContainerExecutor removes appcache dir on every localization

2011-10-24 Thread Arun C Murthy (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134677#comment-13134677 ] Arun C Murthy commented on MAPREDUCE-3159: -- No worries, go ahead. Please comm

[jira] [Reopened] (MAPREDUCE-3159) DefaultContainerExecutor removes appcache dir on every localization

2011-10-24 Thread Todd Lipcon (Reopened) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reopened MAPREDUCE-3159: > DefaultContainerExecutor removes appcache dir on every localization > ---

[jira] [Updated] (MAPREDUCE-3159) DefaultContainerExecutor removes appcache dir on every localization

2011-10-24 Thread Todd Lipcon (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated MAPREDUCE-3159: --- Attachment: fix-jdoc.txt Need this addendum to fix javadoc warnings. Mind if I just commi

[jira] [Assigned] (MAPREDUCE-3254) Streaming jobs failing with PipeMapRunner ClassNotFoundException

2011-10-24 Thread Arun C Murthy (Assigned) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy reassigned MAPREDUCE-3254: Assignee: Hitesh Shah > Streaming jobs failing with PipeMapRunner ClassNotF

[jira] [Updated] (MAPREDUCE-2821) [MR-279] Missing fields in job summary logs

2011-10-24 Thread Mahadev konar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar updated MAPREDUCE-2821: - Status: Patch Available (was: Open) > [MR-279] Missing fields in job summary log

[jira] [Updated] (MAPREDUCE-2821) [MR-279] Missing fields in job summary logs

2011-10-24 Thread Mahadev konar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar updated MAPREDUCE-2821: - Attachment: MAPREDUCE-2821.patch Updated patch. > [MR-279] Missing f

[jira] [Updated] (MAPREDUCE-3248) Log4j logs from unit tests are lost

2011-10-24 Thread Arun C Murthy (Updated) (JIRA)
Project: Hadoop Map/Reduce > Issue Type: Bug > Components: test >Affects Versions: 0.24.0 >Reporter: Arun C Murthy >Assignee: Vinod Kumar Vavilapalli >Priority: Blocker > Fix For: 0.24.0 > >

[jira] [Created] (MAPREDUCE-3255) MR2 needs a counter analogous to "slot seconds"

2011-10-24 Thread Todd Lipcon (Created) (JIRA)
MR2 needs a counter analogous to "slot seconds" --- Key: MAPREDUCE-3255 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3255 Project: Hadoop Map/Reduce Issue Type: Improvement Compon

[jira] [Updated] (MAPREDUCE-2821) [MR-279] Missing fields in job summary logs

2011-10-24 Thread Arun C Murthy (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-2821: - Status: Open (was: Patch Available) Needs to be rebased, sorry! > [

[jira] [Updated] (MAPREDUCE-2746) [MR-279] [Security] Yarn servers can't communicate with each other with hadoop.security.authorization set to true

2011-10-24 Thread Arun C Murthy (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-2746: - Attachment: MAPREDUCE-2746.patch Rebased. > [MR-279] [Security] Yarn

[jira] [Updated] (MAPREDUCE-3159) DefaultContainerExecutor removes appcache dir on every localization

2011-10-24 Thread Arun C Murthy (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-3159: - Resolution: Fixed Status: Resolved (was: Patch Available) I just committed t

[jira] [Updated] (MAPREDUCE-3159) DefaultContainerExecutor removes appcache dir on every localization

2011-10-24 Thread Arun C Murthy (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-3159: - Fix Version/s: 0.23.0 > DefaultContainerExecutor removes appcache dir on every lo

[jira] [Updated] (MAPREDUCE-2746) [MR-279] [Security] Yarn servers can't communicate with each other with hadoop.security.authorization set to true

2011-10-24 Thread Arun C Murthy (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-2746: - Attachment: MAPREDUCE-2746.patch Ok, I spent 3 days debugging this with help from Mah

[jira] [Updated] (MAPREDUCE-2746) [MR-279] [Security] Yarn servers can't communicate with each other with hadoop.security.authorization set to true

2011-10-24 Thread Arun C Murthy (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-2746: - Status: Patch Available (was: Open) > [MR-279] [Security] Yarn servers can't com

[jira] [Commented] (MAPREDUCE-3206) FairScheduler breaks writing of job tokens to MR system dir when using kerberos auth

2011-10-24 Thread Gary Helmling (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134652#comment-13134652 ] Gary Helmling commented on MAPREDUCE-3206: -- >From looking at the current code

[jira] [Updated] (MAPREDUCE-3254) Streaming jobs failing with PipeMapRunner ClassNotFoundException

2011-10-24 Thread Mahadev konar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar updated MAPREDUCE-3254: - Priority: Blocker (was: Major) > Streaming jobs failing with PipeMapRunner Class

[jira] [Updated] (MAPREDUCE-2850) TaskTracker disk failure handling (MR-2413) has no test coverage

2011-10-24 Thread Eli Collins (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated MAPREDUCE-2850: --- Attachment: MR2850.v1.3.patch Good catch wrt CME. How about using an iterator instead? Se

[jira] [Commented] (MAPREDUCE-3159) DefaultContainerExecutor removes appcache dir on every localization

2011-10-24 Thread Hadoop QA (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134636#comment-13134636 ] Hadoop QA commented on MAPREDUCE-3159: -- -1 overall. Here are the results of test

[jira] [Commented] (MAPREDUCE-3252) MR2: Map tasks rewrite data once even if output fits in sort buffer

2011-10-24 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134607#comment-13134607 ] Hudson commented on MAPREDUCE-3252: --- Integrated in Hadoop-Mapreduce-trunk-Commit #11

[jira] [Commented] (MAPREDUCE-3252) MR2: Map tasks rewrite data once even if output fits in sort buffer

2011-10-24 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134606#comment-13134606 ] Hudson commented on MAPREDUCE-3252: --- Integrated in Hadoop-Mapreduce-0.23-Commit #47

[jira] [Updated] (MAPREDUCE-3159) DefaultContainerExecutor removes appcache dir on every localization

2011-10-24 Thread Todd Lipcon (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated MAPREDUCE-3159: --- Status: Patch Available (was: Open) > DefaultContainerExecutor removes appcache dir

[jira] [Updated] (MAPREDUCE-3159) DefaultContainerExecutor removes appcache dir on every localization

2011-10-24 Thread Todd Lipcon (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated MAPREDUCE-3159: --- Attachment: mr-3159.txt Here's the simple fix as suggested. I didn't change any unit test

[jira] [Commented] (MAPREDUCE-3252) MR2: Map tasks rewrite data once even if output fits in sort buffer

2011-10-24 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134599#comment-13134599 ] Hudson commented on MAPREDUCE-3252: --- Integrated in Hadoop-Hdfs-0.23-Commit #48 (See

[jira] [Commented] (MAPREDUCE-3252) MR2: Map tasks rewrite data once even if output fits in sort buffer

2011-10-24 Thread Hadoop QA (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134598#comment-13134598 ] Hadoop QA commented on MAPREDUCE-3252: -- -1 overall. Here are the results of test

[jira] [Commented] (MAPREDUCE-3252) MR2: Map tasks rewrite data once even if output fits in sort buffer

2011-10-24 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134593#comment-13134593 ] Hudson commented on MAPREDUCE-3252: --- Integrated in Hadoop-Common-0.23-Commit #47 (Se

[jira] [Commented] (MAPREDUCE-3252) MR2: Map tasks rewrite data once even if output fits in sort buffer

2011-10-24 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134591#comment-13134591 ] Hudson commented on MAPREDUCE-3252: --- Integrated in Hadoop-Common-trunk-Commit #1148

[jira] [Commented] (MAPREDUCE-3252) MR2: Map tasks rewrite data once even if output fits in sort buffer

2011-10-24 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134589#comment-13134589 ] Hudson commented on MAPREDUCE-3252: --- Integrated in Hadoop-Hdfs-trunk-Commit #1226 (S

[jira] [Updated] (MAPREDUCE-3252) MR2: Map tasks rewrite data once even if output fits in sort buffer

2011-10-24 Thread Todd Lipcon (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated MAPREDUCE-3252: --- Resolution: Fixed Fix Version/s: 0.23.0 Target Version/s: 0.23.0

[jira] [Updated] (MAPREDUCE-3252) MR2: Map tasks rewrite data once even if output fits in sort buffer

2011-10-24 Thread Todd Lipcon (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated MAPREDUCE-3252: --- Attachment: mr-3252.txt added javadoc, fixed a spurious whitespace change. I ran this on

[jira] [Resolved] (MAPREDUCE-2957) The TT should not re-init if it has no good local dirs

2011-10-24 Thread Eli Collins (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved MAPREDUCE-2957. Resolution: Fixed Hadoop Flags: Reviewed Thanks for the review Ravi! I've committ

[jira] [Updated] (MAPREDUCE-3045) Elapsed time filter on jobhistory server displays incorrect table entries

2011-10-24 Thread Ramya Sunil (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramya Sunil updated MAPREDUCE-3045: --- The issue exists not just for elapsed time but also for elapsed time shuffle, elapsed time m

[jira] [Commented] (MAPREDUCE-3254) Streaming jobs failing with PipeMapRunner ClassNotFoundException

2011-10-24 Thread Ramya Sunil (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134556#comment-13134556 ] Ramya Sunil commented on MAPREDUCE-3254: {noformat} Error: java.lang.RuntimeEx

[jira] [Created] (MAPREDUCE-3254) Streaming jobs failing with PipeMapRunner ClassNotFoundException

2011-10-24 Thread Ramya Sunil (Created) (JIRA)
Streaming jobs failing with PipeMapRunner ClassNotFoundException Key: MAPREDUCE-3254 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3254 Project: Hadoop Map/Reduce Issue

[jira] [Commented] (MAPREDUCE-3251) JobClient should have an option to only to talk to RM+HistoryServer to get job status

2011-10-24 Thread Milind Bhandarkar (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134544#comment-13134544 ] Milind Bhandarkar commented on MAPREDUCE-3251: -- Arun, Thanks for the cla

[jira] [Commented] (MAPREDUCE-2376) test-task-controller fails if run as a userid < 1000

2011-10-24 Thread Tim Broberg (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134530#comment-13134530 ] Tim Broberg commented on MAPREDUCE-2376: I am also seeing this trying to build

[jira] [Commented] (MAPREDUCE-3186) User jobs are getting hanged if the Resource manager process goes down and comes up while job is getting executed.

2011-10-24 Thread Mahadev konar (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134531#comment-13134531 ] Mahadev konar commented on MAPREDUCE-3186: -- Eric, You have to make sure, sto

[jira] [Commented] (MAPREDUCE-3028) Support job end notification in .next /0.23

2011-10-24 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134526#comment-13134526 ] Hudson commented on MAPREDUCE-3028: --- Integrated in Hadoop-Mapreduce-trunk-Commit #11

[jira] [Commented] (MAPREDUCE-3249) Recovery of MR AMs with reduces fails the subsequent generation of the job

2011-10-24 Thread Hudson (Commented) (JIRA)
23.0 >Reporter: Vinod Kumar Vavilapalli >Assignee: Vinod Kumar Vavilapalli >Priority: Blocker > Fix For: 0.23.0 > > Attachments: MAPREDUCE-3249-20111024.txt > > -- This message is automatically generated by JIRA.

[jira] [Commented] (MAPREDUCE-3028) Support job end notification in .next /0.23

2011-10-24 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134517#comment-13134517 ] Hudson commented on MAPREDUCE-3028: --- Integrated in Hadoop-Mapreduce-0.23-Commit #46

[jira] [Commented] (MAPREDUCE-3186) User jobs are getting hanged if the Resource manager process goes down and comes up while job is getting executed.

2011-10-24 Thread Eric Payne (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134518#comment-13134518 ] Eric Payne commented on MAPREDUCE-3186: --- MRAppMaster still doesn't exit even aft

[jira] [Commented] (MAPREDUCE-3249) Recovery of MR AMs with reduces fails the subsequent generation of the job

2011-10-24 Thread Hudson (Commented) (JIRA)
Reporter: Vinod Kumar Vavilapalli >Assignee: Vinod Kumar Vavilapalli >Priority: Blocker > Fix For: 0.23.0 > > Attachments: MAPREDUCE-3249-20111024.txt > > -- This message is automatically generated by JIRA. If you think it was se

[jira] [Assigned] (MAPREDUCE-3253) ContextFactory throw NoSuchFieldException

2011-10-24 Thread Mahadev konar (Assigned) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar reassigned MAPREDUCE-3253: Assignee: Mahadev konar > ContextFactory throw NoSuchFieldException > -

[jira] [Commented] (MAPREDUCE-3249) Recovery of MR AMs with reduces fails the subsequent generation of the job

2011-10-24 Thread Hudson (Commented) (JIRA)
Reporter: Vinod Kumar Vavilapalli >Assignee: Vinod Kumar Vavilapalli >Priority: Blocker > Fix For: 0.23.0 > > Attachments: MAPREDUCE-3249-20111024.txt > > -- This message is automatically generated by JIRA. If you think i

[jira] [Commented] (MAPREDUCE-3252) MR2: Map tasks rewrite data once even if output fits in sort buffer

2011-10-24 Thread Hadoop QA (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134508#comment-13134508 ] Hadoop QA commented on MAPREDUCE-3252: -- -1 overall. Here are the results of test

[jira] [Commented] (MAPREDUCE-3028) Support job end notification in .next /0.23

2011-10-24 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134502#comment-13134502 ] Hudson commented on MAPREDUCE-3028: --- Integrated in Hadoop-Hdfs-0.23-Commit #47 (See

[jira] [Updated] (MAPREDUCE-3250) When AM restarts, client keeps reconnecting to the new AM and prints a lots of logs.

2011-10-24 Thread Arun C Murthy (Updated) (JIRA)
Priority: Blocker > Fix For: 0.23.0 > > Attachments: MAPREDUCE-3250-20111024.txt > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdminis

[jira] [Commented] (MAPREDUCE-3028) Support job end notification in .next /0.23

2011-10-24 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134499#comment-13134499 ] Hudson commented on MAPREDUCE-3028: --- Integrated in Hadoop-Common-0.23-Commit #46 (Se

[jira] [Updated] (MAPREDUCE-3249) Recovery of MR AMs with reduces fails the subsequent generation of the job

2011-10-24 Thread Arun C Murthy (Updated) (JIRA)
Priority: Blocker > Fix For: 0.23.0 > > Attachments: MAPREDUCE-3249-20111024.txt > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/Contact

[jira] [Commented] (MAPREDUCE-3028) Support job end notification in .next /0.23

2011-10-24 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134494#comment-13134494 ] Hudson commented on MAPREDUCE-3028: --- Integrated in Hadoop-Common-trunk-Commit #1146

[jira] [Commented] (MAPREDUCE-3251) JobClient should have an option to only to talk to RM+HistoryServer to get job status

2011-10-24 Thread Arun C Murthy (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134491#comment-13134491 ] Arun C Murthy commented on MAPREDUCE-3251: -- bq. I believe, one will have to g

[jira] [Commented] (MAPREDUCE-3028) Support job end notification in .next /0.23

2011-10-24 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134490#comment-13134490 ] Hudson commented on MAPREDUCE-3028: --- Integrated in Hadoop-Hdfs-trunk-Commit #1224 (S

[jira] [Commented] (MAPREDUCE-3252) MR2: Map tasks rewrite data once even if output fits in sort buffer

2011-10-24 Thread Arun C Murthy (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134484#comment-13134484 ] Arun C Murthy commented on MAPREDUCE-3252: -- +1 > MR2: Map ta

[jira] [Commented] (MAPREDUCE-2821) [MR-279] Missing fields in job summary logs

2011-10-24 Thread Hadoop QA (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134483#comment-13134483 ] Hadoop QA commented on MAPREDUCE-2821: -- -1 overall. Here are the results of test

[jira] [Resolved] (MAPREDUCE-3028) Support job end notification in .next /0.23

2011-10-24 Thread Arun C Murthy (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-3028. -- Resolution: Fixed I just committed this. Thanks Ravi! > Support jo

[jira] [Created] (MAPREDUCE-3253) ContextFactory throw NoSuchFieldException

2011-10-24 Thread Daniel Dai (Created) (JIRA)
ContextFactory throw NoSuchFieldException - Key: MAPREDUCE-3253 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3253 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affec

[jira] [Updated] (MAPREDUCE-3252) MR2: Map tasks rewrite data once even if output fits in sort buffer

2011-10-24 Thread Todd Lipcon (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated MAPREDUCE-3252: --- Attachment: mr-3252.txt > MR2: Map tasks rewrite data once even if output fits in sor

[jira] [Updated] (MAPREDUCE-3252) MR2: Map tasks rewrite data once even if output fits in sort buffer

2011-10-24 Thread Todd Lipcon (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated MAPREDUCE-3252: --- Status: Patch Available (was: Open) > MR2: Map tasks rewrite data once even if outpu

[jira] [Created] (MAPREDUCE-3252) MR2: Map tasks rewrite data once even if output fits in sort buffer

2011-10-24 Thread Todd Lipcon (Created) (JIRA)
MR2: Map tasks rewrite data once even if output fits in sort buffer --- Key: MAPREDUCE-3252 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3252 Project: Hadoop Map/Reduce

[jira] [Updated] (MAPREDUCE-2821) [MR-279] Missing fields in job summary logs

2011-10-24 Thread Mahadev konar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar updated MAPREDUCE-2821: - Status: Patch Available (was: Open) > [MR-279] Missing fields in job summary log

[jira] [Updated] (MAPREDUCE-2821) [MR-279] Missing fields in job summary logs

2011-10-24 Thread Mahadev konar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar updated MAPREDUCE-2821: - Attachment: MAPREDUCE-2821.patch Forgot to clean up some minor nits in the patch.

[jira] [Updated] (MAPREDUCE-2821) [MR-279] Missing fields in job summary logs

2011-10-24 Thread Mahadev konar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar updated MAPREDUCE-2821: - Attachment: MAPREDUCE-2821.patch Tested patch with added test. Includes some fixing o

[jira] [Updated] (MAPREDUCE-3175) Yarn httpservers not created with access Control lists

2011-10-24 Thread Jonathan Eagles (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated MAPREDUCE-3175: --- Attachment: MAPREDUCE-3175.patch > Yarn httpservers not created with access C

[jira] [Commented] (MAPREDUCE-3121) NodeManager should handle disk-failures

2011-10-24 Thread Eli Collins (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134413#comment-13134413 ] Eli Collins commented on MAPREDUCE-3121: Will failure detection to work simila

[jira] [Commented] (MAPREDUCE-2858) MRv2 WebApp Security

2011-10-24 Thread Robert Joseph Evans (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134405#comment-13134405 ] Robert Joseph Evans commented on MAPREDUCE-2858: That would work espec

[jira] [Updated] (MAPREDUCE-3175) Yarn httpservers not created with access Control lists

2011-10-24 Thread Jonathan Eagles (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated MAPREDUCE-3175: --- Attachment: MAPREDUCE-3175.patch > Yarn httpservers not created with access C

[jira] [Commented] (MAPREDUCE-3028) Support job end notification in .next /0.23

2011-10-24 Thread Ravi Prakash (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134376#comment-13134376 ] Ravi Prakash commented on MAPREDUCE-3028: - Hitesh! I came back home. Nopes. I

[jira] [Commented] (MAPREDUCE-2858) MRv2 WebApp Security

2011-10-24 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134341#comment-13134341 ] Todd Lipcon commented on MAPREDUCE-2858: Why not just make the cookie be named

[jira] [Assigned] (MAPREDUCE-2821) [MR-279] Missing fields in job summary logs

2011-10-24 Thread Arun C Murthy (Assigned) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy reassigned MAPREDUCE-2821: Assignee: Mahadev konar (was: Harsh J) > [MR-279] Missing fields in job su

[jira] [Resolved] (MAPREDUCE-3178) Capacity Schedular shows incorrect cluster information in the RM logs

2011-10-24 Thread Arun C Murthy (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-3178. -- Resolution: Duplicate Will be fixed via MAPREDUCE-2775 > Capacity

[jira] [Commented] (MAPREDUCE-3251) JobClient should have an option to only to talk to RM+HistoryServer to get job status

2011-10-24 Thread Milind Bhandarkar (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134331#comment-13134331 ] Milind Bhandarkar commented on MAPREDUCE-3251: -- Vinod, Which method in R

[jira] [Commented] (MAPREDUCE-2747) [MR-279] [Security] Cleanup LinuxContainerExecutor binary sources

2011-10-24 Thread Hudson (Commented) (JIRA)
Reporter: Vinod Kumar Vavilapalli >Assignee: Robert Joseph Evans >Priority: Blocker > Fix For: 0.23.0, 0.24.0 > > Attachments: MAPREDUCE-2747-20111024-branch-0.23.txt, > MAPREDUCE-2747-20111024.txt, MAPREDUCE-2747.patch, MR-27

[jira] [Updated] (MAPREDUCE-2858) MRv2 WebApp Security

2011-10-24 Thread Robert Joseph Evans (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans updated MAPREDUCE-2858: --- Target Version/s: 0.23.0, 0.24.0 (was: 0.24.0, 0.23.0) Stat

[jira] [Commented] (MAPREDUCE-2858) MRv2 WebApp Security

2011-10-24 Thread Robert Joseph Evans (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134312#comment-13134312 ] Robert Joseph Evans commented on MAPREDUCE-2858: I agree that it is a

[jira] [Commented] (MAPREDUCE-3251) JobClient should have an option to only to talk to RM+HistoryServer to get job status

2011-10-24 Thread Vinod Kumar Vavilapalli (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134307#comment-13134307 ] Vinod Kumar Vavilapalli commented on MAPREDUCE-3251: This won't br

[jira] [Commented] (MAPREDUCE-2747) [MR-279] [Security] Cleanup LinuxContainerExecutor binary sources

2011-10-24 Thread Hudson (Commented) (JIRA)
Reporter: Vinod Kumar Vavilapalli >Assignee: Robert Joseph Evans >Priority: Blocker > Fix For: 0.23.0, 0.24.0 > > Attachments: MAPREDUCE-2747-20111024-branch-0.23.txt, > MAPREDUCE-2747-20111024.txt, MAPREDUCE-2747.patch, MR-27

[jira] [Commented] (MAPREDUCE-2747) [MR-279] [Security] Cleanup LinuxContainerExecutor binary sources

2011-10-24 Thread Hudson (Commented) (JIRA)
Reporter: Vinod Kumar Vavilapalli >Assignee: Robert Joseph Evans >Priority: Blocker > Fix For: 0.23.0, 0.24.0 > > Attachments: MAPREDUCE-2747-20111024-branch-0.23.txt, > MAPREDUCE-2747-20111024.txt, MAPREDUCE-2747.patch, MR-2747-branch-0.

[jira] [Updated] (MAPREDUCE-2747) [MR-279] [Security] Cleanup LinuxContainerExecutor binary sources

2011-10-24 Thread Vinod Kumar Vavilapalli (Updated) (JIRA)
gt;Reporter: Vinod Kumar Vavilapalli >Assignee: Robert Joseph Evans >Priority: Blocker > Fix For: 0.23.0, 0.24.0 > > Attachments: MAPREDUCE-2747-20111024-branch-0.23.txt, > MAPREDUCE-2747-20111024.txt, MAPREDUCE-2747.patch, MR-2

  1   2   >