[jira] Commented: (MAPREDUCE-2213) [Gridmix] Gridmix doesnt work with LocalJobRunner

2010-12-07 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12969205#action_12969205 ] Amar Kamat commented on MAPREDUCE-2213: --- There are 2 issues - Gridmix's Generat

[jira] Created: (MAPREDUCE-2213) [Gridmix] Gridmix doesnt work with LocalJobRunner

2010-12-07 Thread Amar Kamat (JIRA)
[Gridmix] Gridmix doesnt work with LocalJobRunner - Key: MAPREDUCE-2213 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2213 Project: Hadoop Map/Reduce Issue Type: Bug Components

[jira] Updated: (MAPREDUCE-1908) DistributedRaidFileSystem does not handle ChecksumException correctly

2010-12-07 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-1908: - Component/s: contrib/raid > DistributedRaidFileSystem does not handle ChecksumExcepti

[jira] Updated: (MAPREDUCE-2146) Raid should not affect access time of a source file

2010-12-07 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-2146: - Component/s: contrib/raid > Raid should not affect access time of a source file > ---

[jira] Commented: (MAPREDUCE-2212) MapTask and ReduceTask should only compress/decompress the final map output file

2010-12-07 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12969152#action_12969152 ] Joydeep Sen Sarma commented on MAPREDUCE-2212: -- Todd - do you know for sur

[jira] Commented: (MAPREDUCE-2212) MapTask and ReduceTask should only compress/decompress the final map output file

2010-12-07 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12969142#action_12969142 ] Todd Lipcon commented on MAPREDUCE-2212: We've found that even on single rack c

[jira] Commented: (MAPREDUCE-2212) MapTask and ReduceTask should only compress/decompress the final map output file

2010-12-07 Thread Scott Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12969137#action_12969137 ] Scott Chen commented on MAPREDUCE-2212: --- bq. In our case, the resource is usually

[jira] Commented: (MAPREDUCE-2212) MapTask and ReduceTask should only compress/decompress the final map output file

2010-12-07 Thread Scott Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12969099#action_12969099 ] Scott Chen commented on MAPREDUCE-2212: --- In our case, the resource is usually CPU

[jira] Commented: (MAPREDUCE-2212) MapTask and ReduceTask should only compress/decompress the final map output file

2010-12-07 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12969085#action_12969085 ] Chris Douglas commented on MAPREDUCE-2212: -- Todd's point on disk bandwidth mat

[jira] Commented: (MAPREDUCE-2212) MapTask and ReduceTask should only compress/decompress the final map output file

2010-12-07 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12969071#action_12969071 ] Joydeep Sen Sarma commented on MAPREDUCE-2212: -- makes sense - hadn't thoug

[jira] Commented: (MAPREDUCE-2212) MapTask and ReduceTask should only compress/decompress the final map output file

2010-12-07 Thread Mahadev konar (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12969049#action_12969049 ] Mahadev konar commented on MAPREDUCE-2212: -- joydeep, shouldnt that be the def

[jira] Commented: (MAPREDUCE-2212) MapTask and ReduceTask should only compress/decompress the final map output file

2010-12-07 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12969034#action_12969034 ] Joydeep Sen Sarma commented on MAPREDUCE-2212: -- we should have a separate

[jira] Commented: (MAPREDUCE-2212) MapTask and ReduceTask should only compress/decompress the final map output file

2010-12-07 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12969021#action_12969021 ] Todd Lipcon commented on MAPREDUCE-2212: Do we have data to confirm that interm

[jira] Updated: (MAPREDUCE-2212) MapTask and ReduceTask should only compress/decompress the final map output file

2010-12-07 Thread Scott Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-2212: -- Description: Currently if we set mapred.map.output.compression.codec 1. MapTask will compre

[jira] Created: (MAPREDUCE-2212) MapTask and ReduceTask should only compress/decompress the final map output file

2010-12-07 Thread Scott Chen (JIRA)
MapTask and ReduceTask should only compress/decompress the final map output file Key: MAPREDUCE-2212 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2212 Project: Ha

[jira] Commented: (MAPREDUCE-2210) Preemption does not obey job priority

2010-12-07 Thread Scott Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12968902#action_12968902 ] Scott Chen commented on MAPREDUCE-2210: --- Hi Adam, Actually preemption does kill b

[jira] Commented: (MAPREDUCE-2198) Allow FairScheduler to control the number of slots on each TaskTracker

2010-12-07 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12968862#action_12968862 ] Joydeep Sen Sarma commented on MAPREDUCE-2198: -- +1 on Matei's previous com

[jira] Commented: (MAPREDUCE-2211) java.lang.OutOfMemoryError occurred while running the high ram streaming job.

2010-12-07 Thread Faraz Ahmad (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12968788#action_12968788 ] Faraz Ahmad commented on MAPREDUCE-2211: Does this error occur with any value o

[jira] Commented: (MAPREDUCE-2192) Implement gridmix system tests with different time intervals for MR streaming job traces.

2010-12-07 Thread Ranjit Mathew (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12968673#action_12968673 ] Ranjit Mathew commented on MAPREDUCE-2192: -- Just a minor comment: Instead of s

[jira] Commented: (MAPREDUCE-2139) Gridmix test for submitting jobs with different traces and runtime options.

2010-12-07 Thread Ranjit Mathew (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12968671#action_12968671 ] Ranjit Mathew commented on MAPREDUCE-2139: -- This looks OK to me in conjunction

[jira] Commented: (MAPREDUCE-2138) Gridmix tests with different time interval mr traces (1min, 3min and 5min).

2010-12-07 Thread Ranjit Mathew (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12968666#action_12968666 ] Ranjit Mathew commented on MAPREDUCE-2138: -- Thanks for making the changes and