[jira] Commented: (MAPREDUCE-1198) Alternatively schedule different types of tasks in fair share scheduler

[ https://issues.apache.org/jira/browse/MAPREDUCE-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12780477#action_12780477 ] Matei Zaharia commented on MAPREDUCE-1198: -- This looks good, the two hashsets

[jira] Updated: (MAPREDUCE-913) TaskRunner crashes with NPE resulting in held up slots, UNINITIALIZED tasks and hung TaskTracker

[ https://issues.apache.org/jira/browse/MAPREDUCE-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod K V updated MAPREDUCE-913: Attachment: MAPREDUCE-913-20091120.1.txt Updated patch fixing the findBugs warning, including Am

[jira] Created: (MAPREDUCE-1225) TT successfully localizes a task even though the corresponding cache-file has already changed on DFS.

TT successfully localizes a task even though the corresponding cache-file has already changed on DFS. - Key: MAPREDUCE-1225 URL: https://issues.apache.org/jira/bro

[jira] Updated: (MAPREDUCE-913) TaskRunner crashes with NPE resulting in held up slots, UNINITIALIZED tasks and hung TaskTracker

[ https://issues.apache.org/jira/browse/MAPREDUCE-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod K V updated MAPREDUCE-913: Status: Open (was: Patch Available) > TaskRunner crashes with NPE resulting in held up slots, U

[jira] Commented: (MAPREDUCE-1222) [Mumak] We should not include nodes with numeric ips in cluster topology.

educe > Issue Type: Bug > Components: contrib/mumak >Affects Versions: 0.21.0, 0.22.0 >Reporter: Hong Tang >Assignee: Hong Tang > Fix For: 0.21.0, 0.22.0 > > Attachments: mapreduce-1222-20091119.patch > > &g

[jira] Updated: (MAPREDUCE-1044) Ability to automatically move machines from one MR compute cluster to another

[ https://issues.apache.org/jira/browse/MAPREDUCE-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmytro Molkov updated MAPREDUCE-1044: - Attachment: DCD.pdf I am attaching the initial proposal of the way to do this. I wou

[jira] Commented: (MAPREDUCE-1176) Contribution: FixedLengthInputFormat and FixedLengthRecordReader

[ https://issues.apache.org/jira/browse/MAPREDUCE-1176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12780367#action_12780367 ] BitsOfInfo commented on MAPREDUCE-1176: --- >>>Why can't you just keep defaultSize a

[jira] Commented: (MAPREDUCE-1224) Calling "SELECT t.* from AS t" to get meta information is too expensive for big tables

[ https://issues.apache.org/jira/browse/MAPREDUCE-1224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12780349#action_12780349 ] Todd Lipcon commented on MAPREDUCE-1224: Perhaps this could be changed to add "

[jira] Created: (MAPREDUCE-1224) Calling "SELECT t.* from AS t" to get meta information is too expensive for big tables

Calling "SELECT t.* from AS t" to get meta information is too expensive for big tables -- Key: MAPREDUCE-1224 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1224

[jira] Updated: (MAPREDUCE-1198) Alternatively schedule different types of tasks in fair share scheduler

[ https://issues.apache.org/jira/browse/MAPREDUCE-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1198: -- Attachment: MAPREDUCE-1198-v5.patch 1. I have changed mapAssigned and reduceAssigned variab

[jira] Commented: (MAPREDUCE-1026) Shuffle should be secure

[ https://issues.apache.org/jira/browse/MAPREDUCE-1026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12780285#action_12780285 ] Hadoop QA commented on MAPREDUCE-1026: -- +1 overall. Here are the results of testi

[jira] Commented: (MAPREDUCE-1198) Alternatively schedule different types of tasks in fair share scheduler

[ https://issues.apache.org/jira/browse/MAPREDUCE-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12780281#action_12780281 ] Matei Zaharia commented on MAPREDUCE-1198: -- A couple of comments: * I think in

[jira] Updated: (MAPREDUCE-1198) Alternatively schedule different types of tasks in fair share scheduler

[ https://issues.apache.org/jira/browse/MAPREDUCE-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1198: -- Attachment: MAPREDUCE-1198-v4.patch I have revised the code according to Matei's suggestion

[jira] Commented: (MAPREDUCE-1176) Contribution: FixedLengthInputFormat and FixedLengthRecordReader

[ https://issues.apache.org/jira/browse/MAPREDUCE-1176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12780225#action_12780225 ] Todd Lipcon commented on MAPREDUCE-1176: Hi, Just had a chance to look at your

[jira] Commented: (MAPREDUCE-1222) [Mumak] We should not include nodes with numeric ips in cluster topology.

s of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12425489/mapreduce-1222-20091119.patch against trunk revision 881673. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 6 new or modified tests.

[jira] Created: (MAPREDUCE-1223) CompositeInputFormat doesn't consider all tuples when run in a local task tracker

CompositeInputFormat doesn't consider all tuples when run in a local task tracker - Key: MAPREDUCE-1223 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1223 Project:

[jira] Commented: (MAPREDUCE-1198) Alternatively schedule different types of tasks in fair share scheduler

[ https://issues.apache.org/jira/browse/MAPREDUCE-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12780186#action_12780186 ] Scott Chen commented on MAPREDUCE-1198: --- I agree with all these points. They are

[jira] Commented: (MAPREDUCE-1222) [Mumak] We should not include nodes with numeric ips in cluster topology.

: Hong Tang >Assignee: Hong Tang > Fix For: 0.21.0, 0.22.0 > > Attachments: mapreduce-1222-20091119.patch > > > Rumen infers cluster topology by parsing input split locations from job > history logs. Due to HDFS-778, a cluster node may appea

[jira] Commented: (MAPREDUCE-1198) Alternatively schedule different types of tasks in fair share scheduler

[ https://issues.apache.org/jira/browse/MAPREDUCE-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12780178#action_12780178 ] Matei Zaharia commented on MAPREDUCE-1198: -- I've looked at the patch in more d

[jira] Updated: (MAPREDUCE-1026) Shuffle should be secure

[ https://issues.apache.org/jira/browse/MAPREDUCE-1026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1026: -- Status: Patch Available (was: Open) > Shuffle should be secure > -

[jira] Updated: (MAPREDUCE-1026) Shuffle should be secure

[ https://issues.apache.org/jira/browse/MAPREDUCE-1026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1026: -- Status: Open (was: Patch Available) > Shuffle should be secure > -

[jira] Updated: (MAPREDUCE-1026) Shuffle should be secure

[ https://issues.apache.org/jira/browse/MAPREDUCE-1026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1026: -- Attachment: MAPREDUCE-1026-14.patch addressed minor findbug nit > Shuffle should b

[jira] Commented: (MAPREDUCE-913) TaskRunner crashes with NPE resulting in held up slots, UNINITIALIZED tasks and hung TaskTracker

[ https://issues.apache.org/jira/browse/MAPREDUCE-913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12780083#action_12780083 ] Hadoop QA commented on MAPREDUCE-913: - -1 overall. Here are the results of testing

[jira] Updated: (MAPREDUCE-1222) [Mumak] We should not include nodes with numeric ips in cluster topology.

gt; Attachments: mapreduce-1222-20091119.patch > > > Rumen infers cluster topology by parsing input split locations from job > history logs. Due to HDFS-778, a cluster node may appear both as a numeric ip > or as a host name in job history logs. We should exclude nodes app

[jira] Updated: (MAPREDUCE-1222) [Mumak] We should not include nodes with numeric ips in cluster topology.

[ https://issues.apache.org/jira/browse/MAPREDUCE-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Tang updated MAPREDUCE-1222: - Attachment: mapreduce-1222-20091119.patch > [Mumak] We should not include nodes with nume

[jira] Assigned: (MAPREDUCE-1222) [Mumak] We should not include nodes with numeric ips in cluster topology.

Components: contrib/mumak >Affects Versions: 0.21.0, 0.22.0 >Reporter: Hong Tang >Assignee: Hong Tang > Fix For: 0.21.0, 0.22.0 > > Attachments: mapreduce-1222-20091119.patch > > > Rumen infers cluster topology by par

[jira] Created: (MAPREDUCE-1222) [Mumak] We should not include nodes with numeric ips in cluster topology.

[Mumak] We should not include nodes with numeric ips in cluster topology. - Key: MAPREDUCE-1222 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1222 Project: Hadoop Map/Reduc

[jira] Commented: (MAPREDUCE-1222) [Mumak] We should not include nodes with numeric ips in cluster topology.

[ https://issues.apache.org/jira/browse/MAPREDUCE-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12780002#action_12780002 ] Hong Tang commented on MAPREDUCE-1222: -- BTW, we should still maintain the mapping

[jira] Commented: (MAPREDUCE-1176) Contribution: FixedLengthInputFormat and FixedLengthRecordReader

[ https://issues.apache.org/jira/browse/MAPREDUCE-1176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12779998#action_12779998 ] BitsOfInfo commented on MAPREDUCE-1176: --- What is the next step for this issue? Do

[jira] Commented: (MAPREDUCE-1221) Kill tasks on a node if the free physical memory on that machine falls below a configured threshold

[ https://issues.apache.org/jira/browse/MAPREDUCE-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12779992#action_12779992 ] Hong Tang commented on MAPREDUCE-1221: -- Is it a duplicate of MAPREDUCE-257? > Kil

[jira] Resolved: (MAPREDUCE-927) Cleanup of task-logs should happen in TaskTracker instead of the Child

[ https://issues.apache.org/jira/browse/MAPREDUCE-927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod K V resolved MAPREDUCE-927. - Resolution: Duplicate Will be incorporated by MAPREDUCE-1100. > Cleanup of task-logs should h

[jira] Commented: (MAPREDUCE-1018) Document changes to the memory management and scheduling model

[ https://issues.apache.org/jira/browse/MAPREDUCE-1018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12779967#action_12779967 ] rahul k singh commented on MAPREDUCE-1018: -- incorporated vinod's comments. >

[jira] Updated: (MAPREDUCE-1110) Currently QueueManager API's return JobQueueInfo , instead it should return QueueInfo, similarly wher ever we are using JobQueueInfo as view , we should use QueueInfo

gt; Components: jobtracker >Affects Versions: 0.21.0 >Reporter: rahul k singh >Assignee: Vinod K V >Priority: Blocker > Fix For: 0.21.0 > > Attachments: MAPREDUCE-1110-20091119.1.txt, > MAPREDUCE-1110-200911

[jira] Updated: (MAPREDUCE-1110) Currently QueueManager API's return JobQueueInfo , instead it should return QueueInfo, similarly wher ever we are using JobQueueInfo as view , we should use QueueInfo

0 >Reporter: rahul k singh >Assignee: Vinod K V >Priority: Blocker > Fix For: 0.21.0 > > Attachments: MAPREDUCE-1110-20091119.txt > > -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.

[jira] Commented: (MAPREDUCE-1140) Per cache-file refcount can become negative when tasks release distributed-cache files

[ https://issues.apache.org/jira/browse/MAPREDUCE-1140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12779954#action_12779954 ] V.Karthikeyan commented on MAPREDUCE-1140: -- Test Scenario: Configure local.ca

[jira] Updated: (MAPREDUCE-913) TaskRunner crashes with NPE resulting in held up slots, UNINITIALIZED tasks and hung TaskTracker

[ https://issues.apache.org/jira/browse/MAPREDUCE-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod K V updated MAPREDUCE-913: Status: Patch Available (was: Open) > TaskRunner crashes with NPE resulting in held up slots, U

[jira] Updated: (MAPREDUCE-913) TaskRunner crashes with NPE resulting in held up slots, UNINITIALIZED tasks and hung TaskTracker

[ https://issues.apache.org/jira/browse/MAPREDUCE-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod K V updated MAPREDUCE-913: Attachment: MAPREDUCE-913-20091119.2.txt > TaskRunner crashes with NPE resulting in held up slot

[jira] Updated: (MAPREDUCE-913) TaskRunner crashes with NPE resulting in held up slots, UNINITIALIZED tasks and hung TaskTracker

[ https://issues.apache.org/jira/browse/MAPREDUCE-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod K V updated MAPREDUCE-913: Status: Open (was: Patch Available) Argh.. the git prefixes. Will upload a new patch. > TaskRu

[jira] Commented: (MAPREDUCE-1220) Implement an in-cluster LocalJobRunner

[ https://issues.apache.org/jira/browse/MAPREDUCE-1220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12779946#action_12779946 ] Aaron Kimball commented on MAPREDUCE-1220: -- Arun, My concerns are primarily b

[jira] Commented: (MAPREDUCE-913) TaskRunner crashes with NPE resulting in held up slots, UNINITIALIZED tasks and hung TaskTracker

[ https://issues.apache.org/jira/browse/MAPREDUCE-913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12779945#action_12779945 ] Hadoop QA commented on MAPREDUCE-913: - -1 overall. Here are the results of testing

[jira] Commented: (MAPREDUCE-1110) Currently QueueManager API's return JobQueueInfo , instead it should return QueueInfo, similarly wher ever we are using JobQueueInfo as view , we should use QueueIn

s of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12425444/MAPREDUCE-1110-20091119.txt against trunk revision 881673. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 24 new or modified tests.

[jira] Commented: (MAPREDUCE-1219) JobTracker Metrics causes undue load on JobTracker

[ https://issues.apache.org/jira/browse/MAPREDUCE-1219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12779941#action_12779941 ] Amareshwari Sriramadasu commented on MAPREDUCE-1219: All tests pass

[jira] Commented: (MAPREDUCE-1219) JobTracker Metrics causes undue load on JobTracker

[ https://issues.apache.org/jira/browse/MAPREDUCE-1219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12779940#action_12779940 ] Amareshwari Sriramadasu commented on MAPREDUCE-1219: test-patch res

[jira] Commented: (MAPREDUCE-913) TaskRunner crashes with NPE resulting in held up slots, UNINITIALIZED tasks and hung TaskTracker

[ https://issues.apache.org/jira/browse/MAPREDUCE-913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12779932#action_12779932 ] Amareshwari Sriramadasu commented on MAPREDUCE-913: --- {code} - LOG

[jira] Updated: (MAPREDUCE-913) TaskRunner crashes with NPE resulting in held up slots, UNINITIALIZED tasks and hung TaskTracker

[ https://issues.apache.org/jira/browse/MAPREDUCE-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod K V updated MAPREDUCE-913: Attachment: MAPREDUCE-913-20091119.1.txt The previous patch by Sreekanth still leaves other poss

[jira] Updated: (MAPREDUCE-913) TaskRunner crashes with NPE resulting in held up slots, UNINITIALIZED tasks and hung TaskTracker

[ https://issues.apache.org/jira/browse/MAPREDUCE-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod K V updated MAPREDUCE-913: Status: Patch Available (was: Open) > TaskRunner crashes with NPE resulting in held up slots, U

[jira] Commented: (MAPREDUCE-1219) JobTracker Metrics causes undue load on JobTracker

[ https://issues.apache.org/jira/browse/MAPREDUCE-1219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12779922#action_12779922 ] V.Karthikeyan commented on MAPREDUCE-1219: -- Verified the Job metrics using Fil

[jira] Commented: (MAPREDUCE-1007) MAPREDUCE-777 breaks the UI for hierarchial Queues.

[ https://issues.apache.org/jira/browse/MAPREDUCE-1007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12779896#action_12779896 ] Hadoop QA commented on MAPREDUCE-1007: -- +1 overall. Here are the results of testi

[jira] Updated: (MAPREDUCE-1018) Document changes to the memory management and scheduling model

[ https://issues.apache.org/jira/browse/MAPREDUCE-1018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rahul k singh updated MAPREDUCE-1018: - Attachment: MAPRED-1018-3.patch > Document changes to the memory management and sched

[jira] Commented: (MAPREDUCE-1140) Per cache-file refcount can become negative when tasks release distributed-cache files

[ https://issues.apache.org/jira/browse/MAPREDUCE-1140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12779869#action_12779869 ] Amareshwari Sriramadasu commented on MAPREDUCE-1140: test-patch res

[jira] Updated: (MAPREDUCE-1110) Currently QueueManager API's return JobQueueInfo , instead it should return QueueInfo, similarly wher ever we are using JobQueueInfo as view , we should use QueueInfo

[ https://issues.apache.org/jira/browse/MAPREDUCE-1110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod K V updated MAPREDUCE-1110: - Attachment: MAPREDUCE-1110-20091119.txt Innocuous patch that replaces all instances of

[jira] Updated: (MAPREDUCE-1110) Currently QueueManager API's return JobQueueInfo , instead it should return QueueInfo, similarly wher ever we are using JobQueueInfo as view , we should use QueueInfo

0 >Reporter: rahul k singh >Assignee: Vinod K V >Priority: Blocker > Fix For: 0.21.0 > > Attachments: MAPREDUCE-1110-20091119.txt > > -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.

[jira] Updated: (MAPREDUCE-1110) Currently QueueManager API's return JobQueueInfo , instead it should return QueueInfo, similarly wher ever we are using JobQueueInfo as view , we should use QueueInfo

[ https://issues.apache.org/jira/browse/MAPREDUCE-1110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod K V updated MAPREDUCE-1110: - Attachment: MAPREDUCE-1110-20091119.txt Innocuous patch that replaces all instances of

[jira] Updated: (MAPREDUCE-1110) Currently QueueManager API's return JobQueueInfo , instead it should return QueueInfo, similarly wher ever we are using JobQueueInfo as view , we should use QueueInfo

[ https://issues.apache.org/jira/browse/MAPREDUCE-1110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod K V updated MAPREDUCE-1110: - Attachment: (was: MAPREDUCE-1110-20091119.txt) > Currently QueueManager API'

[jira] Updated: (MAPREDUCE-1110) Currently QueueManager API's return JobQueueInfo , instead it should return QueueInfo, similarly wher ever we are using JobQueueInfo as view , we should use QueueInfo

0.21.0 >Reporter: rahul k singh >Assignee: Vinod K V >Priority: Blocker > Fix For: 0.21.0 > > Attachments: MAPREDUCE-1110-20091119.txt > > -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.

[jira] Assigned: (MAPREDUCE-1110) Currently QueueManager API's return JobQueueInfo , instead it should return QueueInfo, similarly wher ever we are using JobQueueInfo as view , we should use QueueInf

[ https://issues.apache.org/jira/browse/MAPREDUCE-1110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod K V reassigned MAPREDUCE-1110: Assignee: Vinod K V > Currently QueueManager API's return JobQueueInfo , instead it sho