[jira] [Resolved] (MAPREDUCE-5406) Improve logging around Task Tracker exiting with JVM manager inconsistent state

2013-07-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved MAPREDUCE-5406. -- Resolution: Fixed Fix Version/s: 1.3.0 1-win I committed

[jira] [Updated] (MAPREDUCE-5406) Improve logging around Task Tracker exiting with JVM manager inconsistent state

2013-07-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated MAPREDUCE-5406: - Issue Type: Improvement (was: Bug) > Improve logging around Task Tracker exiting

[jira] [Commented] (MAPREDUCE-2038) Making reduce tasks locality-aware

2013-07-19 Thread Yan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13713968#comment-13713968 ] Yan Zhou commented on MAPREDUCE-2038: - For the HBase bulk load case, it actually a

[jira] [Commented] (MAPREDUCE-5405) Job recovery can fail if task log directory symlink from prior run still exists

2013-07-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13713951#comment-13713951 ] Chris Nauroth commented on MAPREDUCE-5405: -- This is most easily repro'd as an

[jira] [Commented] (MAPREDUCE-5404) MAPREDUCE-5265 should have used ephemeral port

2013-07-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13714122#comment-13714122 ] Ted Yu commented on MAPREDUCE-5404: --- This is what I did: built tip of hadoop-2 with

[jira] [Commented] (MAPREDUCE-5405) Job recovery can fail if task log directory symlink from prior run still exists

2013-07-19 Thread Xi Fang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13714194#comment-13714194 ] Xi Fang commented on MAPREDUCE-5405: Sounds good to me! I also did some tests on U

[jira] [Updated] (MAPREDUCE-5406) Improve logging around Task Tracker exiting with JVM manager inconsistent state

2013-07-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated MAPREDUCE-5406: - Summary: Improve logging around Task Tracker exiting with JVM manager inconsiste

[jira] [Updated] (MAPREDUCE-5406) improve logging around Task Tracker exiting with JVM manager inconsistent state

2013-07-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated MAPREDUCE-5406: - Summary: improve logging around Task Tracker exiting with JVM manager inconsistent st

[jira] [Commented] (MAPREDUCE-5406) Improve logging around Task Tracker exiting with JVM manager inconsistent state

2013-07-19 Thread Chelsey Chang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13714218#comment-13714218 ] Chelsey Chang commented on MAPREDUCE-5406: -- Thank you Chris for adding the cl

[jira] [Commented] (MAPREDUCE-5377) JobID is not displayed truly by "hadoop job -history" command

2013-07-19 Thread Shinichi Yamashita (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13714114#comment-13714114 ] Shinichi Yamashita commented on MAPREDUCE-5377: --- When this patch applies

[jira] [Updated] (MAPREDUCE-5406) Task Tracker exiting with JVM manager inconsistent state

2013-07-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated MAPREDUCE-5406: - Component/s: tasktracker Target Version/s: 1-win, 1.3.0 Affects Version

[jira] [Updated] (MAPREDUCE-5402) DynamicInputFormat should allow overriding of MAX_CHUNKS_TOLERABLE

2013-07-19 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated MAPREDUCE-5402: -- Assignee: Tsuyoshi OZAWA Status: Patch Available (was: Open) > DynamicIn

[jira] [Updated] (MAPREDUCE-5402) DynamicInputFormat should allow overriding of MAX_CHUNKS_TOLERABLE

2013-07-19 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated MAPREDUCE-5402: -- Attachment: MAPREDUCE-5402.1.patch Thanks for reporting, David. I attached the earl

[jira] [Updated] (MAPREDUCE-5376) The value of the Counters at Map/Reduce column shows wrong values as "0" in jobdetails.jsp

2013-07-19 Thread Shinichi Yamashita (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shinichi Yamashita updated MAPREDUCE-5376: -- Summary: The value of the Counters at Map/Reduce column shows wrong values

[jira] [Commented] (MAPREDUCE-5404) MAPREDUCE-5265 should have used ephemeral port

2013-07-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13714128#comment-13714128 ] Ted Yu commented on MAPREDUCE-5404: --- {code} [INFO] HBase ...

[jira] [Updated] (MAPREDUCE-5377) JobID is not displayed truly by "hadoop job -history" command

2013-07-19 Thread Shinichi Yamashita (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shinichi Yamashita updated MAPREDUCE-5377: -- Priority: Minor (was: Major) > JobID is not displayed truly by "hadoop

[jira] [Updated] (MAPREDUCE-5377) JobID is not displayed truly by "hadoop job -history" command

2013-07-19 Thread Shinichi Yamashita (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shinichi Yamashita updated MAPREDUCE-5377: -- Labels: newbie (was: ) > JobID is not displayed truly by "hadoop job -

[jira] [Updated] (MAPREDUCE-5377) JobID is not displayed truly by "hadoop job -history" command

2013-07-19 Thread Shinichi Yamashita (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shinichi Yamashita updated MAPREDUCE-5377: -- Description: JobID output by "hadoop job -history" command is wrong string.

[jira] [Created] (MAPREDUCE-5406) Task Tracker exiting with JVM manager inconsistent state

2013-07-19 Thread Chelsey Chang (JIRA)
Chelsey Chang created MAPREDUCE-5406: Summary: Task Tracker exiting with JVM manager inconsistent state Key: MAPREDUCE-5406 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5406 Project: Hadoop

[jira] [Updated] (MAPREDUCE-4661) Add HTTPS for WebUIs on Branch-1

2013-07-19 Thread Michael Weng (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Weng updated MAPREDUCE-4661: Attachment: branch-1.2-patch.txt5 Thanks Devaraj. Here is the new patch with changes m

[jira] [Updated] (MAPREDUCE-5406) Task Tracker exiting with JVM manager inconsistent state

2013-07-19 Thread Chelsey Chang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chelsey Chang updated MAPREDUCE-5406: - Attachment: MAPREDUCE-5406.branch-1-win.1.patch > Task Tracker exiting with JVM m

[jira] [Updated] (MAPREDUCE-5406) Task Tracker exiting with JVM manager inconsistent state

2013-07-19 Thread Chelsey Chang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chelsey Chang updated MAPREDUCE-5406: - Attachment: (was: MAPREDUCE-5406.branch-1-win.1.patch.patch) > Task Tracker e

[jira] [Commented] (MAPREDUCE-5406) Task Tracker exiting with JVM manager inconsistent state

2013-07-19 Thread Chelsey Chang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13714090#comment-13714090 ] Chelsey Chang commented on MAPREDUCE-5406: -- Looking at the logs, it seems lik

[jira] [Updated] (MAPREDUCE-5377) JobID is not displayed truly by "hadoop job -history" command

2013-07-19 Thread Shinichi Yamashita (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shinichi Yamashita updated MAPREDUCE-5377: -- Summary: JobID is not displayed truly by "hadoop job -history" command (wa

[jira] [Commented] (MAPREDUCE-4661) Add HTTPS for WebUIs on Branch-1

2013-07-19 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13714067#comment-13714067 ] Devaraj Das commented on MAPREDUCE-4661: Some comments: 1. HTTP_MAX_THREADS is

[jira] [Updated] (MAPREDUCE-5406) Task Tracker exiting with JVM manager inconsistent state

2013-07-19 Thread Chelsey Chang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chelsey Chang updated MAPREDUCE-5406: - Attachment: MAPREDUCE-5406.branch-1-win.1.patch.patch > Task Tracker exiting with

[jira] [Updated] (MAPREDUCE-5404) MAPREDUCE-5265 should have used ephemeral port

2013-07-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated MAPREDUCE-5404: -- Attachment: (was: mapreduce-5404-v1.txt) > MAPREDUCE-5265 should have used ephemeral port >

[jira] [Updated] (MAPREDUCE-5377) HistoryViewer.java sJobets wrong jobId

2013-07-19 Thread Shinichi Yamashita (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shinichi Yamashita updated MAPREDUCE-5377: -- Summary: HistoryViewer.java sJobets wrong jobId (was: HistoryViewer.java s

[jira] [Updated] (MAPREDUCE-5406) Task Tracker exiting with JVM manager inconsistent state

2013-07-19 Thread Chelsey Chang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chelsey Chang updated MAPREDUCE-5406: - Description: Looks like we are reaching JVM manager inconsistent state which cases TT

[jira] [Updated] (MAPREDUCE-5406) Task Tracker exiting with JVM manager inconsistent state

2013-07-19 Thread Chelsey Chang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chelsey Chang updated MAPREDUCE-5406: - Attachment: hadoop-tasktracker-RD00155D61582F-short.log > Task Tracker exiting wi

[jira] [Updated] (MAPREDUCE-4424) The 'mapred job -list' command should show the job name as well

2013-07-19 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated MAPREDUCE-4424: - Assignee: Akira AJISAKA > The 'mapred job -list' command should show the job name

[jira] [Updated] (MAPREDUCE-5405) Job recovery can fail if task log directory symlink from prior run still exists

2013-07-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated MAPREDUCE-5405: - Attachment: MAPREDUCE-5405.branch-1.1.patch I'm attaching a patch that does the follo

[jira] [Commented] (MAPREDUCE-5403) Get rid of yarn.application.classpath

2013-07-19 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13713958#comment-13713958 ] Sandy Ryza commented on MAPREDUCE-5403: --- MR uses it as well, adding both yarn.ap

[jira] [Created] (MAPREDUCE-5405) Job recovery can fail if task log directory symlink from prior run still exists

2013-07-19 Thread Chris Nauroth (JIRA)
Chris Nauroth created MAPREDUCE-5405: Summary: Job recovery can fail if task log directory symlink from prior run still exists Key: MAPREDUCE-5405 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5405

[jira] [Commented] (MAPREDUCE-5376) The display of the counter of Map column and Reduce column uses displayName in jobdetails.jsp

2013-07-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13713983#comment-13713983 ] Hadoop QA commented on MAPREDUCE-5376: -- {color:red}-1 overall{color}. Here are t

[jira] [Updated] (MAPREDUCE-5376) The display of the counter of Map column and Reduce column uses displayName in jobdetails.jsp

2013-07-19 Thread Shinichi Yamashita (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shinichi Yamashita updated MAPREDUCE-5376: -- Attachment: jobsummary-before.png jobsummary-after.png I at

[jira] [Commented] (MAPREDUCE-5403) Get rid of yarn.application.classpath

2013-07-19 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13713889#comment-13713889 ] Bikas Saha commented on MAPREDUCE-5403: --- >From what I understand its meant for a

[jira] [Commented] (MAPREDUCE-5402) DynamicInputFormat should allow overriding of MAX_CHUNKS_TOLERABLE

2013-07-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13713861#comment-13713861 ] Hadoop QA commented on MAPREDUCE-5402: -- {color:red}-1 overall{color}. Here are t

[jira] [Commented] (MAPREDUCE-5247) FileInputFormat should filter files with '._COPYING_' sufix

2013-07-19 Thread Stan Rosenberg (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13713843#comment-13713843 ] Stan Rosenberg commented on MAPREDUCE-5247: --- Robert, what is the intended op

[jira] [Commented] (MAPREDUCE-4493) Distibuted Cache Compatability Issues

2013-07-19 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13713786#comment-13713786 ] Omkar Vinit Joshi commented on MAPREDUCE-4493: -- [~revans2] sounds good..

[jira] [Updated] (MAPREDUCE-5124) AM lacks flow control for task events

2013-07-19 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated MAPREDUCE-5124: -- Attachment: MAPREDUCE-5124-proto.2.txt I attached a rough prototype to restrict one

[jira] [Resolved] (MAPREDUCE-5247) FileInputFormat should filter files with '._COPYING_' sufix

2013-07-19 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans resolved MAPREDUCE-5247. Resolution: Won't Fix I am happy to hear arguments as to why this is re

[jira] [Commented] (MAPREDUCE-5247) FileInputFormat should filter files with '._COPYING_' sufix

2013-07-19 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13713743#comment-13713743 ] Robert Joseph Evans commented on MAPREDUCE-5247: Why are you running a

[jira] [Commented] (MAPREDUCE-4493) Distibuted Cache Compatability Issues

2013-07-19 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13713706#comment-13713706 ] Robert Joseph Evans commented on MAPREDUCE-4493: [~ojoshi] By opening

[jira] [Commented] (MAPREDUCE-5386) Refresh job retention time,job cleaner interval, enable/disable cleaner

2013-07-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13713702#comment-13713702 ] Hadoop QA commented on MAPREDUCE-5386: -- {color:red}-1 overall{color}. Here are t

[jira] [Updated] (MAPREDUCE-5386) Refresh job retention time,job cleaner interval, enable/disable cleaner

2013-07-19 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated MAPREDUCE-5386: -- Attachment: JOB_RETENTION-2.txt > Refresh job retention time,job cleaner interv

[jira] [Commented] (MAPREDUCE-5404) MAPREDUCE-5265 should have used ephemeral port

2013-07-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13713436#comment-13713436 ] Hadoop QA commented on MAPREDUCE-5404: -- {color:red}-1 overall{color}. Here are t

[jira] [Commented] (MAPREDUCE-5404) MAPREDUCE-5265 should have used ephemeral port

2013-07-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13713411#comment-13713411 ] Hadoop QA commented on MAPREDUCE-5404: -- {color:red}-1 overall{color}. Here are t

[jira] [Updated] (MAPREDUCE-5404) MAPREDUCE-5265 should have used ephemeral port

2013-07-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated MAPREDUCE-5404: -- Attachment: mapreduce-5404-v3.txt Thanks for the comment, Devaraj. Here is a new patch.

[jira] [Commented] (MAPREDUCE-5404) MAPREDUCE-5265 should have used ephemeral port

2013-07-19 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13713394#comment-13713394 ] Devaraj K commented on MAPREDUCE-5404: -- Hi Ted/Tsuyoshi, Here trying to a