[jira] Commented: (MAPREDUCE-1374) Reduce memory footprint of FileSplit

2010-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12800171#action_12800171 ] Hadoop QA commented on MAPREDUCE-1374: -- -1 overall. Here are the results of

[jira] Commented: (MAPREDUCE-1218) Collecting cpu and memory usage for TaskTrackers

2010-01-14 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12800220#action_12800220 ] dhruba borthakur commented on MAPREDUCE-1218: - TestTTMemoryReporting was a

[jira] Commented: (MAPREDUCE-1375) TestFileArgs fails intermittently

2010-01-14 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12800237#action_12800237 ] Todd Lipcon commented on MAPREDUCE-1375: Was this local or on Hudson? Do you

[jira] Updated: (MAPREDUCE-1309) I want to change the rumen job trace generator to use a more modular internal structure, to allow for more input log formats

2010-01-14 Thread Dick King (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dick King updated MAPREDUCE-1309: - Status: Patch Available (was: Open) I want to change the rumen job trace generator to use

[jira] Commented: (MAPREDUCE-815) Add AvroInputFormat and AvroOutputFormat so that hadoop can use Avro Serialization

2010-01-14 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12800267#action_12800267 ] Doug Cutting commented on MAPREDUCE-815: This looks great! A few nits: - in

[jira] Commented: (MAPREDUCE-815) Add AvroInputFormat and AvroOutputFormat so that hadoop can use Avro Serialization

2010-01-14 Thread Aaron Kimball (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12800309#action_12800309 ] Aaron Kimball commented on MAPREDUCE-815: - The only reason I could think of to

[jira] Commented: (MAPREDUCE-815) Add AvroInputFormat and AvroOutputFormat so that hadoop can use Avro Serialization

2010-01-14 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12800312#action_12800312 ] Doug Cutting commented on MAPREDUCE-815: That having been said, we can't use

[jira] Commented: (MAPREDUCE-1309) I want to change the rumen job trace generator to use a more modular internal structure, to allow for more input log formats

2010-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12800337#action_12800337 ] Hadoop QA commented on MAPREDUCE-1309: -- -1 overall. Here are the results of

[jira] Updated: (MAPREDUCE-815) Add AvroInputFormat and AvroOutputFormat so that hadoop can use Avro Serialization

2010-01-14 Thread Aaron Kimball (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Kimball updated MAPREDUCE-815: Attachment: MAPREDUCE-815.2.patch New patch per code-review. * HADOOP-6492 has been

[jira] Updated: (MAPREDUCE-1302) TrackerDistributedCacheManager can delete file asynchronously

2010-01-14 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated MAPREDUCE-1302: -- Attachment: MAPREDUCE-1302.branch-0.20.on.top.of.MAPREDUCE-1213.3.patch Fixed some unit

[jira] Commented: (MAPREDUCE-815) Add AvroInputFormat and AvroOutputFormat so that hadoop can use Avro Serialization

2010-01-14 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12800401#action_12800401 ] Doug Cutting commented on MAPREDUCE-815: - those javadoc @deprecated lines

[jira] Updated: (MAPREDUCE-1309) I want to change the rumen job trace generator to use a more modular internal structure, to allow for more input log formats

2010-01-14 Thread Dick King (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dick King updated MAPREDUCE-1309: - Attachment: mapreduce-1309--2009-01-14-a.patch I want to change the rumen job trace

[jira] Updated: (MAPREDUCE-815) Add AvroInputFormat and AvroOutputFormat so that hadoop can use Avro Serialization

2010-01-14 Thread Aaron Kimball (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Kimball updated MAPREDUCE-815: Attachment: MAPREDUCE-815.3.patch New patch; fixed javadoc. Also includes an avro

[jira] Updated: (MAPREDUCE-1309) I want to change the rumen job trace generator to use a more modular internal structure, to allow for more input log formats

2010-01-14 Thread Dick King (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dick King updated MAPREDUCE-1309: - Status: Patch Available (was: Open) I want to change the rumen job trace generator to use

[jira] Commented: (MAPREDUCE-1342) Potential JT deadlock in faulty TT tracking

2010-01-14 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12800446#action_12800446 ] Arun C Murthy commented on MAPREDUCE-1342: -- A discussion with Owen convinced

[jira] Updated: (MAPREDUCE-1342) Potential JT deadlock in faulty TT tracking

2010-01-14 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-1342: - Environment: Fixed a potential deadlock in the global blacklist of tasktrackers

[jira] Commented: (MAPREDUCE-1342) Potential JT deadlock in faulty TT tracking

2010-01-14 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12800455#action_12800455 ] Todd Lipcon commented on MAPREDUCE-1342: bq. A discussion with Owen convinced

[jira] Updated: (MAPREDUCE-1342) Potential JT deadlock in faulty TT tracking

2010-01-14 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-1342: - Environment: (was: Fixed a potential deadlock in the global blacklist of

[jira] Commented: (MAPREDUCE-1342) Potential JT deadlock in faulty TT tracking

2010-01-14 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12800460#action_12800460 ] Arun C Murthy commented on MAPREDUCE-1342: -- Apologies, I should have been more

[jira] Updated: (MAPREDUCE-815) Add AvroInputFormat and AvroOutputFormat so that hadoop can use Avro Serialization

2010-01-14 Thread Aaron Kimball (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Kimball updated MAPREDUCE-815: Attachment: MAPREDUCE-815.4.patch end-to-end test was accidentally excluded from patch

[jira] Updated: (MAPREDUCE-1212) Mapreduce contrib project ivy dependencies are not included in binary target

2010-01-14 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated MAPREDUCE-1212: - Resolution: Fixed Fix Version/s: 0.22.0 Hadoop Flags: [Reviewed]

[jira] Commented: (MAPREDUCE-815) Add AvroInputFormat and AvroOutputFormat so that hadoop can use Avro Serialization

2010-01-14 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12800477#action_12800477 ] Doug Cutting commented on MAPREDUCE-815: In the end-to-end-test validation, you

[jira] Updated: (MAPREDUCE-815) Add AvroInputFormat and AvroOutputFormat so that hadoop can use Avro Serialization

2010-01-14 Thread Aaron Kimball (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Kimball updated MAPREDUCE-815: Attachment: MAPREDUCE-815.5.patch Now uses DataStreamReader Add AvroInputFormat and

[jira] Created: (MAPREDUCE-1376) Support for varied user submission in Gridmix

2010-01-14 Thread Chris Douglas (JIRA)
Support for varied user submission in Gridmix - Key: MAPREDUCE-1376 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1376 Project: Hadoop Map/Reduce Issue Type: Improvement

[jira] Updated: (MAPREDUCE-1372) ConcurrentModificationException in JobInProgress

2010-01-14 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-1372: - Attachment: M1372-1.patch Same idea as the previous patch, but using

[jira] Commented: (MAPREDUCE-1372) ConcurrentModificationException in JobInProgress

2010-01-14 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12800510#action_12800510 ] Arun C Murthy commented on MAPREDUCE-1372: -- Thanks Chris. I started

[jira] Updated: (MAPREDUCE-1376) Support for varied user submission in Gridmix

2010-01-14 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-1376: - Assignee: Chris Douglas Status: Patch Available (was: Open) Support for

[jira] Commented: (MAPREDUCE-1376) Support for varied user submission in Gridmix

2010-01-14 Thread Hong Tang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12800516#action_12800516 ] Hong Tang commented on MAPREDUCE-1376: -- Nice feature to have. This would be useful

[jira] Created: (MAPREDUCE-1377) Port of HDFS-587 to mapreduce project.

2010-01-14 Thread Sreekanth Ramakrishnan (JIRA)
Port of HDFS-587 to mapreduce project. -- Key: MAPREDUCE-1377 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1377 Project: Hadoop Map/Reduce Issue Type: Bug Components: test Affects

[jira] Commented: (MAPREDUCE-1377) Port of HDFS-587 to mapreduce project.

2010-01-14 Thread Sreekanth Ramakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12800530#action_12800530 ] Sreekanth Ramakrishnan commented on MAPREDUCE-1377: --- +1 to Eric's

[jira] Updated: (MAPREDUCE-1377) Port of HDFS-587 to mapreduce project.

2010-01-14 Thread Sreekanth Ramakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreekanth Ramakrishnan updated MAPREDUCE-1377: -- Attachment: jira.HDFS-587.mapreduce.branch-0.22.patch Attaching

[jira] Assigned: (MAPREDUCE-1377) Port of HDFS-587 to mapreduce project.

2010-01-14 Thread V.V.Chaitanya Krishna (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] V.V.Chaitanya Krishna reassigned MAPREDUCE-1377: Assignee: V.V.Chaitanya Krishna Port of HDFS-587 to mapreduce

[jira] Commented: (MAPREDUCE-1332) Ant tasks for job submission

2010-01-14 Thread Kay Kay (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12800532#action_12800532 ] Kay Kay commented on MAPREDUCE-1332: So - what is the current status / interest in

[jira] Assigned: (MAPREDUCE-1377) Port of HDFS-587 to mapreduce project.

2010-01-14 Thread V.V.Chaitanya Krishna (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] V.V.Chaitanya Krishna reassigned MAPREDUCE-1377: Assignee: (was: Sreekanth Ramakrishnan) Port of HDFS-587

[jira] Commented: (MAPREDUCE-1309) I want to change the rumen job trace generator to use a more modular internal structure, to allow for more input log formats

2010-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12800534#action_12800534 ] Hadoop QA commented on MAPREDUCE-1309: -- -1 overall. Here are the results of

[jira] Created: (MAPREDUCE-1378) Args in job details links on jobhistory.jsp are not URL encoded

2010-01-14 Thread E. Sammer (JIRA)
Args in job details links on jobhistory.jsp are not URL encoded --- Key: MAPREDUCE-1378 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1378 Project: Hadoop Map/Reduce Issue

[jira] Updated: (MAPREDUCE-1378) Args in job details links on jobhistory.jsp are not URL encoded

2010-01-14 Thread E. Sammer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] E. Sammer updated MAPREDUCE-1378: - Attachment: MAPREDUCE-1378.patch Args in job details links on jobhistory.jsp are not URL

[jira] Commented: (MAPREDUCE-1376) Support for varied user submission in Gridmix

2010-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12800556#action_12800556 ] Hadoop QA commented on MAPREDUCE-1376: -- -1 overall. Here are the results of

[jira] Created: (MAPREDUCE-1379) Limit both numMapTasks and numReduceTasks

2010-01-14 Thread Bochun Bai (JIRA)
Limit both numMapTasks and numReduceTasks - Key: MAPREDUCE-1379 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1379 Project: Hadoop Map/Reduce Issue Type: New Feature Components:

[jira] Updated: (MAPREDUCE-1376) Support for varied user submission in Gridmix

2010-01-14 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-1376: - Status: Open (was: Patch Available) Support for varied user submission in Gridmix

[jira] Updated: (MAPREDUCE-1376) Support for varied user submission in Gridmix

2010-01-14 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-1376: - Attachment: M1376-1.patch Removed unused field. Support for varied user submission

[jira] Updated: (MAPREDUCE-1376) Support for varied user submission in Gridmix

2010-01-14 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-1376: - Status: Patch Available (was: Open) Support for varied user submission in Gridmix

[jira] Updated: (MAPREDUCE-1379) Limit both numMapTasks and numReduceTasks

2010-01-14 Thread Bochun Bai (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bochun Bai updated MAPREDUCE-1379: -- Attachment: limit-both-numMapTasks-and-numReduceTasks.patch Limit both numMapTasks and

[jira] Updated: (MAPREDUCE-1379) Limit both numMapTasks and numReduceTasks

2010-01-14 Thread Bochun Bai (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bochun Bai updated MAPREDUCE-1379: -- Affects Version/s: (was: 0.20.1) 0.22.0 Limit both numMapTasks

[jira] Updated: (MAPREDUCE-1379) Limit both numMapTasks and numReduceTasks

2010-01-14 Thread Bochun Bai (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bochun Bai updated MAPREDUCE-1379: -- Status: Patch Available (was: Open) submit patch Limit both numMapTasks and

[jira] Commented: (MAPREDUCE-1379) Limit both numMapTasks and numReduceTasks

2010-01-14 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12800591#action_12800591 ] Arun C Murthy commented on MAPREDUCE-1379: -- Bochun, when you can limit them

[jira] Updated: (MAPREDUCE-1358) Utils.OutputLogFilter incorrectly filters for _logs

2010-01-14 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated MAPREDUCE-1358: --- Status: Patch Available (was: Open) Resubmitting same patch - I don't think the test

[jira] Updated: (MAPREDUCE-1358) Utils.OutputLogFilter incorrectly filters for _logs

2010-01-14 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated MAPREDUCE-1358: --- Status: Open (was: Patch Available) Utils.OutputLogFilter incorrectly filters for

[jira] Commented: (MAPREDUCE-1379) Limit both numMapTasks and numReduceTasks

2010-01-14 Thread Bochun Bai (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12800594#action_12800594 ] Bochun Bai commented on MAPREDUCE-1379: --- Arun, this patch added

[jira] Updated: (MAPREDUCE-1379) Limit both numMapTasks and numReduceTasks

2010-01-14 Thread Bochun Bai (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bochun Bai updated MAPREDUCE-1379: -- Description: In some environment, the number of concurrent running process is very

[jira] Commented: (MAPREDUCE-1377) Port of HDFS-587 to mapreduce project.

2010-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12800601#action_12800601 ] Hadoop QA commented on MAPREDUCE-1377: -- -1 overall. Here are the results of

[jira] Updated: (MAPREDUCE-1372) ConcurrentModificationException in JobInProgress

2010-01-14 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-1372: - Attachment: M1372-2.patch Updated Chris's patch to fix the other synchronization bug

[jira] Commented: (MAPREDUCE-1379) Limit both numMapTasks and numReduceTasks

2010-01-14 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12800605#action_12800605 ] Matei Zaharia commented on MAPREDUCE-1379: -- Is the goal to be able to set