[jira] Commented: (HADOOP-5075) Potential infinite loop in updateMinSlots

[ https://issues.apache.org/jira/browse/HADOOP-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12665659#action_12665659 ] Matei Zaharia commented on HADOOP-5075: --- By the way, the reason I think the break is

[jira] Commented: (HADOOP-5075) Potential infinite loop in updateMinSlots

[ https://issues.apache.org/jira/browse/HADOOP-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12665717#action_12665717 ] Matei Zaharia commented on HADOOP-5075: --- That makes a lot of sense. I'll add a

[jira] Updated: (HADOOP-5075) Potential infinite loop in updateMinSlots

[ https://issues.apache.org/jira/browse/HADOOP-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-5075: -- Attachment: hadoop-5075-v4.patch Here's a new patch. If there are no objections I'll commit

[jira] Updated: (HADOOP-5075) Potential infinite loop in updateMinSlots

[ https://issues.apache.org/jira/browse/HADOOP-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-5075: -- Attachment: hadoop-5075-v2.patch I think I found the cause for this now. The problem was with

[jira] Updated: (HADOOP-5075) Potential infinite loop in updateMinSlots

[ https://issues.apache.org/jira/browse/HADOOP-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-5075: -- Status: Patch Available (was: Open) Potential infinite loop in updateMinSlots

[jira] Updated: (HADOOP-5075) Potential infinite loop in updateMinSlots

[ https://issues.apache.org/jira/browse/HADOOP-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-5075: -- Attachment: hadoop-5075-v3.patch Updated patch to do this in a more consistent way with how

[jira] Updated: (HADOOP-5075) Potential infinite loop in updateMinSlots

[ https://issues.apache.org/jira/browse/HADOOP-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-5075: -- Status: Open (was: Patch Available) Potential infinite loop in updateMinSlots

[jira] Updated: (HADOOP-5075) Potential infinite loop in updateMinSlots

[ https://issues.apache.org/jira/browse/HADOOP-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-5075: -- Fix Version/s: 0.21.0 0.20.0 0.19.1 Potential infinite

[jira] Commented: (HADOOP-4665) Add preemption to the fair scheduler

[ https://issues.apache.org/jira/browse/HADOOP-4665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12664655#action_12664655 ] Matei Zaharia commented on HADOOP-4665: --- Those are good points Joydeep. I will

[jira] Updated: (HADOOP-5075) Potential infinite loop in updateMinSlots

[ https://issues.apache.org/jira/browse/HADOOP-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-5075: -- Attachment: hadoop-5075.patch Potential infinite loop in updateMinSlots

[jira] Updated: (HADOOP-5075) Potential infinite loop in updateMinSlots

[ https://issues.apache.org/jira/browse/HADOOP-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-5075: -- Status: Patch Available (was: Open) Potential infinite loop in updateMinSlots

[jira] Created: (HADOOP-5075) Potential infinite loop in updateMinSlots

Potential infinite loop in updateMinSlots - Key: HADOOP-5075 URL: https://issues.apache.org/jira/browse/HADOOP-5075 Project: Hadoop Core Issue Type: Bug Components: contrib/fair-share

[jira] Commented: (HADOOP-4667) Global scheduling in the Fair Scheduler

[ https://issues.apache.org/jira/browse/HADOOP-4667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12664409#action_12664409 ] Matei Zaharia commented on HADOOP-4667: --- That sounds like a good way to do it. What

[jira] Commented: (HADOOP-4667) Global scheduling in the Fair Scheduler

[ https://issues.apache.org/jira/browse/HADOOP-4667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12663983#action_12663983 ] Matei Zaharia commented on HADOOP-4667: --- How to set the waits is an interesting

[jira] Issue Comment Edited: (HADOOP-4667) Global scheduling in the Fair Scheduler

[ https://issues.apache.org/jira/browse/HADOOP-4667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12663983#action_12663983 ] matei edited comment on HADOOP-4667 at 1/14/09 6:42 PM:

[jira] Updated: (HADOOP-4667) Global scheduling in the Fair Scheduler

[ https://issues.apache.org/jira/browse/HADOOP-4667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-4667: -- Description: The current schedulers in Hadoop all examine a single job on every heartbeat

[jira] Commented: (HADOOP-4943) fair share scheduler does not utilize all slots if the task trackers are configured heterogeneously

[ https://issues.apache.org/jira/browse/HADOOP-4943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12663088#action_12663088 ] Matei Zaharia commented on HADOOP-4943: --- I just committed this. Thanks Zheng! I

[jira] Updated: (HADOOP-4789) Change fair scheduler to share between pools by default, not between invidual jobs

[ https://issues.apache.org/jira/browse/HADOOP-4789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-4789: -- Resolution: Fixed Release Note: Fair scheduler now divides resources equally between

[jira] Updated: (HADOOP-4943) fair share scheduler does not utilize all slots if the task trackers are configured heterogeneously

[ https://issues.apache.org/jira/browse/HADOOP-4943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-4943: -- Attachment: hadoop-4943-2.patch Here's a patch that includes a unit test. fair share

[jira] Created: (HADOOP-5005) Create a mock MapReduce cluster simulator to test schedulers

Create a mock MapReduce cluster simulator to test schedulers Key: HADOOP-5005 URL: https://issues.apache.org/jira/browse/HADOOP-5005 Project: Hadoop Core Issue Type: Test

[jira] Commented: (HADOOP-5005) Create a mock MapReduce cluster simulator to test schedulers

[ https://issues.apache.org/jira/browse/HADOOP-5005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12662634#action_12662634 ] Matei Zaharia commented on HADOOP-5005: --- I actually saw that, but this is meant to

[jira] Commented: (HADOOP-4789) Change fair scheduler to share between pools by default, not between invidual jobs

[ https://issues.apache.org/jira/browse/HADOOP-4789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12662160#action_12662160 ] Matei Zaharia commented on HADOOP-4789: --- I just committed this. The two failed tests

[jira] Updated: (HADOOP-4789) Change fair scheduler to share between pools by default, not between invidual jobs

[ https://issues.apache.org/jira/browse/HADOOP-4789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-4789: -- Fix Version/s: (was: 0.19.1) 0.20.0 Change fair scheduler to share

[jira] Commented: (HADOOP-1338) Improve the shuffle phase by using the connection: keep-alive and doing batch transfers of files

[ https://issues.apache.org/jira/browse/HADOOP-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12661665#action_12661665 ] Matei Zaharia commented on HADOOP-1338: --- I think explicitly fetching multiple maps

[jira] Updated: (HADOOP-4665) Add preemption to the fair scheduler

[ https://issues.apache.org/jira/browse/HADOOP-4665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-4665: -- Attachment: fs-preemption-v0.patch Here is an initial version of the patch for review. The

[jira] Updated: (HADOOP-4665) Add preemption to the fair scheduler

[ https://issues.apache.org/jira/browse/HADOOP-4665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-4665: -- Status: Patch Available (was: Open) Add preemption to the fair scheduler

[jira] Commented: (HADOOP-4665) Add preemption to the fair scheduler

[ https://issues.apache.org/jira/browse/HADOOP-4665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12661860#action_12661860 ] Matei Zaharia commented on HADOOP-4665: --- Yikes, forgot to add, this patch also

[jira] Updated: (HADOOP-4667) Global scheduling in the Fair Scheduler

[ https://issues.apache.org/jira/browse/HADOOP-4667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-4667: -- Attachment: fs-global-v0.patch Here's a preliminary version of this patch. It includes the

[jira] Commented: (HADOOP-4665) Add preemption to the fair scheduler

[ https://issues.apache.org/jira/browse/HADOOP-4665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12661864#action_12661864 ] Matei Zaharia commented on HADOOP-4665: --- There is also one change here that is

[jira] Created: (HADOOP-4977) Deadlock between reclaimCapacity and assignTasks

Deadlock between reclaimCapacity and assignTasks Key: HADOOP-4977 URL: https://issues.apache.org/jira/browse/HADOOP-4977 Project: Hadoop Core Issue Type: Bug Components:

[jira] Updated: (HADOOP-4977) Deadlock between reclaimCapacity and assignTasks

[ https://issues.apache.org/jira/browse/HADOOP-4977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-4977: -- Attachment: jstack.txt I managed to reproduce this, here's the full jstack output. Deadlock

[jira] Updated: (HADOOP-4789) Change fair scheduler to share between pools by default, not between invidual jobs

[ https://issues.apache.org/jira/browse/HADOOP-4789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-4789: -- Status: Open (was: Patch Available) Change fair scheduler to share between pools by

[jira] Updated: (HADOOP-4789) Change fair scheduler to share between pools by default, not between invidual jobs

[ https://issues.apache.org/jira/browse/HADOOP-4789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-4789: -- Status: Patch Available (was: Open) Resubmitted patch for Hudson.. Change fair scheduler

[jira] Commented: (HADOOP-4943) fair share scheduler does not utilize all slots if the task trackers are configured heterogeneously

[ https://issues.apache.org/jira/browse/HADOOP-4943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12659713#action_12659713 ] Matei Zaharia commented on HADOOP-4943: --- Looks good to me. This is an issue that

[jira] Commented: (HADOOP-4803) large pending jobs hog resources

[ https://issues.apache.org/jira/browse/HADOOP-4803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12656738#action_12656738 ] Matei Zaharia commented on HADOOP-4803: --- I agree, I think the catching up idea could

[jira] Commented: (HADOOP-3136) Assign multiple tasks per TaskTracker heartbeat

[ https://issues.apache.org/jira/browse/HADOOP-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12656266#action_12656266 ] Matei Zaharia commented on HADOOP-3136: --- I had one comment.. is it possible to

[jira] Updated: (HADOOP-4789) Change fair scheduler to share between pools by default, not between invidual jobs

[ https://issues.apache.org/jira/browse/HADOOP-4789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-4789: -- Status: Open (was: Patch Available) The failed tests seem to be unrelated to the fair

[jira] Updated: (HADOOP-4789) Change fair scheduler to share between pools by default, not between invidual jobs

[ https://issues.apache.org/jira/browse/HADOOP-4789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-4789: -- Status: Patch Available (was: Open) Change fair scheduler to share between pools by

[jira] Commented: (HADOOP-4768) Dynamic Priority Scheduler that allows queue shares to be controlled dynamically by a currency

[ https://issues.apache.org/jira/browse/HADOOP-4768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12655130#action_12655130 ] Matei Zaharia commented on HADOOP-4768: --- Thanks for the clarifications, Thomas, and

[jira] Created: (HADOOP-4804) Create Forrest documentation for the fair scheduler

Create Forrest documentation for the fair scheduler --- Key: HADOOP-4804 URL: https://issues.apache.org/jira/browse/HADOOP-4804 Project: Hadoop Core Issue Type: New Feature

[jira] Updated: (HADOOP-4789) Change fair scheduler to share between pools by default, not between invidual jobs

[ https://issues.apache.org/jira/browse/HADOOP-4789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-4789: -- Attachment: hadoop-4789-v1.patch Here is a patch for this issue with included documentation

[jira] Updated: (HADOOP-4789) Change fair scheduler to share between pools by default, not between invidual jobs

[ https://issues.apache.org/jira/browse/HADOOP-4789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-4789: -- Status: Patch Available (was: Open) Change fair scheduler to share between pools by

[jira] Commented: (HADOOP-4768) Dynamic Priority Scheduler that allows queue shares to be controlled dynamically by a currency

[ https://issues.apache.org/jira/browse/HADOOP-4768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12654036#action_12654036 ] Matei Zaharia commented on HADOOP-4768: --- Hi Thomas, I haven't had a chance to look

[jira] Created: (HADOOP-4767) Provide sample fair scheduler config file in conf/ and set config file property to point to this by default

Provide sample fair scheduler config file in conf/ and set config file property to point to this by default --- Key: HADOOP-4767 URL:

[jira] Commented: (HADOOP-4666) Launch reduces only after a few maps have run in the Fair Scheduler

[ https://issues.apache.org/jira/browse/HADOOP-4666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12650249#action_12650249 ] Matei Zaharia commented on HADOOP-4666: --- Thanks Johan for the quick commit. Launch

[jira] Commented: (HADOOP-4698) TestMapRed fails with 64bit JDK

[ https://issues.apache.org/jira/browse/HADOOP-4698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12650053#action_12650053 ] Matei Zaharia commented on HADOOP-4698: --- Why not increase the memory limit used by

[jira] Commented: (HADOOP-4012) Providing splitting support for bzip2 compressed files

[ https://issues.apache.org/jira/browse/HADOOP-4012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12650054#action_12650054 ] Matei Zaharia commented on HADOOP-4012: --- I looked at the test failures and they do

[jira] Updated: (HADOOP-4666) Launch reduces only after a few maps have run in the Fair Scheduler

[ https://issues.apache.org/jira/browse/HADOOP-4666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-4666: -- Attachment: fairscheduler-reduce-launch-condition.patch Here is a patch for this issue that

[jira] Updated: (HADOOP-4666) Launch reduces only after a few maps have run in the Fair Scheduler

[ https://issues.apache.org/jira/browse/HADOOP-4666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-4666: -- Status: Patch Available (was: Open) Launch reduces only after a few maps have run in the

[jira] Created: (HADOOP-4712) Make fair scheduler's per-job scheduling info visible in the default web UI

Make fair scheduler's per-job scheduling info visible in the default web UI --- Key: HADOOP-4712 URL: https://issues.apache.org/jira/browse/HADOOP-4712 Project: Hadoop Core

[jira] Commented: (HADOOP-1338) Improve the shuffle phase by using the connection: keep-alive and doing batch transfers of files

[ https://issues.apache.org/jira/browse/HADOOP-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12649177#action_12649177 ] Matei Zaharia commented on HADOOP-1338: --- I think you don't have to pull all of them.

[jira] Commented: (HADOOP-1338) Improve the shuffle phase by using the connection: keep-alive and doing batch transfers of files

[ https://issues.apache.org/jira/browse/HADOOP-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12649282#action_12649282 ] Matei Zaharia commented on HADOOP-1338: --- Ah that makes sense. Perhaps the max data

[jira] Commented: (HADOOP-1338) Improve the shuffle phase by using the connection: keep-alive and doing batch transfers of files

[ https://issues.apache.org/jira/browse/HADOOP-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12648910#action_12648910 ] Matei Zaharia commented on HADOOP-1338: --- I think pipelining requests should make

[jira] Updated: (HADOOP-4664) Parallelize job initialization

[ https://issues.apache.org/jira/browse/HADOOP-4664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-4664: -- Attachment: parallel-job-init-v1.patch Here is a patch for this issue. The patch adds

[jira] Updated: (HADOOP-4664) Parallelize job initialization

[ https://issues.apache.org/jira/browse/HADOOP-4664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-4664: -- Status: Patch Available (was: Open) Parallelize job initialization

[jira] Commented: (HADOOP-4664) Parallelize job initialization

[ https://issues.apache.org/jira/browse/HADOOP-4664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12648085#action_12648085 ] Matei Zaharia commented on HADOOP-4664: --- In some initial testing of this patch on a

[jira] Issue Comment Edited: (HADOOP-4664) Parallelize job initialization

[ https://issues.apache.org/jira/browse/HADOOP-4664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12648085#action_12648085 ] matei edited comment on HADOOP-4664 at 11/16/08 10:12 PM: --

[jira] Commented: (HADOOP-4522) Capacity Scheduler needs to re-read its configuration

[ https://issues.apache.org/jira/browse/HADOOP-4522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12648087#action_12648087 ] Matei Zaharia commented on HADOOP-4522: --- That makes sense. Out of curiosity, is

[jira] Commented: (HADOOP-4522) Capacity Scheduler needs to re-read its configuration

[ https://issues.apache.org/jira/browse/HADOOP-4522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12647910#action_12647910 ] Matei Zaharia commented on HADOOP-4522: --- One other difference between the config in

[jira] Created: (HADOOP-4665) Add preemption to the fair scheduler

Add preemption to the fair scheduler Key: HADOOP-4665 URL: https://issues.apache.org/jira/browse/HADOOP-4665 Project: Hadoop Core Issue Type: New Feature Components: contrib/fair-share

[jira] Created: (HADOOP-4666) Launch reduces only after a few maps have run in the Fair Scheduler

Launch reduces only after a few maps have run in the Fair Scheduler --- Key: HADOOP-4666 URL: https://issues.apache.org/jira/browse/HADOOP-4666 Project: Hadoop Core Issue Type:

[jira] Updated: (HADOOP-4666) Launch reduces only after a few maps have run in the Fair Scheduler

[ https://issues.apache.org/jira/browse/HADOOP-4666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-4666: -- Issue Type: Improvement (was: New Feature) Launch reduces only after a few maps have run in

[jira] Created: (HADOOP-4667) Global scheduling in the Fair Scheduler

Global scheduling in the Fair Scheduler --- Key: HADOOP-4667 URL: https://issues.apache.org/jira/browse/HADOOP-4667 Project: Hadoop Core Issue Type: New Feature Components: contrib/fair-share

[jira] Created: (HADOOP-4664) Parallelize job initialization

Parallelize job initialization -- Key: HADOOP-4664 URL: https://issues.apache.org/jira/browse/HADOOP-4664 Project: Hadoop Core Issue Type: Improvement Components: mapred Reporter: Matei

[jira] Commented: (HADOOP-4627) gridmix version 2

[ https://issues.apache.org/jira/browse/HADOOP-4627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12647383#action_12647383 ] Matei Zaharia commented on HADOOP-4627: --- I'm not sure whether this is the right

[jira] Commented: (HADOOP-4627) gridmix version 2

[ https://issues.apache.org/jira/browse/HADOOP-4627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12647489#action_12647489 ] Matei Zaharia commented on HADOOP-4627: --- I don't think some of the issues I brought

[jira] Commented: (HADOOP-4627) gridmix version 2

[ https://issues.apache.org/jira/browse/HADOOP-4627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12647493#action_12647493 ] Matei Zaharia commented on HADOOP-4627: --- Thanks for explaining that Runping;

[jira] Commented: (HADOOP-3687) Ability to pause/resume tasks

[ https://issues.apache.org/jira/browse/HADOOP-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12646425#action_12646425 ] Matei Zaharia commented on HADOOP-3687: --- The really hard challenge with pausing, in

[jira] Commented: (HADOOP-4035) Modify the capacity scheduler (HADOOP-3445) to schedule tasks based on memory requirements and task trackers free memory

[ https://issues.apache.org/jira/browse/HADOOP-4035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12644657#action_12644657 ] Matei Zaharia commented on HADOOP-4035: --- That makes sense Vivek. I'd be very glad to

[jira] Commented: (HADOOP-3970) Counters written to the job history cannot be recovered back

[ https://issues.apache.org/jira/browse/HADOOP-3970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12644637#action_12644637 ] Matei Zaharia commented on HADOOP-3970: --- Will this be a standardized format for

[jira] Commented: (HADOOP-4035) Modify the capacity scheduler (HADOOP-3445) to schedule tasks based on memory requirements and task trackers free memory

[ https://issues.apache.org/jira/browse/HADOOP-4035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12644335#action_12644335 ] Matei Zaharia commented on HADOOP-4035: --- +1 on putting it in

[jira] Commented: (HADOOP-2560) Processing multiple input splits per mapper task

[ https://issues.apache.org/jira/browse/HADOOP-2560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12644062#action_12644062 ] Matei Zaharia commented on HADOOP-2560: --- Instead of using a limit N on the number of

[jira] Commented: (HADOOP-4035) Modify the capacity scheduler (HADOOP-3445) to schedule tasks based on memory requirements and task trackers free memory

[ https://issues.apache.org/jira/browse/HADOOP-4035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12642967#action_12642967 ] Matei Zaharia commented on HADOOP-4035: --- Maybe we can specify an amount of memory to

[jira] Updated: (HADOOP-3708) Provide accounting functionality for Hadoop resource manager

[ https://issues.apache.org/jira/browse/HADOOP-3708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-3708: -- Attachment: history-scripts-0.16.tgz Here is a set of scripts for Hadoop 0.16, for those

[jira] Updated: (HADOOP-3708) Provide accounting functionality for Hadoop resource manager

[ https://issues.apache.org/jira/browse/HADOOP-3708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-3708: -- Attachment: history-scripts-0.18.tgz Here are some modified scripts for 0.18 too. It looks

[jira] Updated: (HADOOP-3708) Provide accounting functionality for Hadoop resource manager

[ https://issues.apache.org/jira/browse/HADOOP-3708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-3708: -- Attachment: history-scripts.patch I've attached a patch with the scripts I built at Facebook.

[jira] Commented: (HADOOP-3708) Provide accounting functionality for Hadoop resource manager

[ https://issues.apache.org/jira/browse/HADOOP-3708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12640635#action_12640635 ] Matei Zaharia commented on HADOOP-3708: --- A lot of this data is available in the job

[jira] Updated: (HADOOP-3746) A fair sharing job scheduler

[ https://issues.apache.org/jira/browse/HADOOP-3746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-3746: -- Attachment: fairscheduler-0.18.1.patch For those interested, here is a patch for 0.18.1,

[jira] Updated: (HADOOP-3746) A fair sharing job scheduler

[ https://issues.apache.org/jira/browse/HADOOP-3746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-3746: -- Attachment: fairscheduler-0.17.2.patch A fair sharing job scheduler

[jira] Commented: (HADOOP-3746) A fair sharing job scheduler

[ https://issues.apache.org/jira/browse/HADOOP-3746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12637387#action_12637387 ] Matei Zaharia commented on HADOOP-3746: --- Hi Eric, Are you trying to use the patch

[jira] Commented: (HADOOP-3136) Assign multiple tasks per TaskTracker heartbeat

[ https://issues.apache.org/jira/browse/HADOOP-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12634398#action_12634398 ] Matei Zaharia commented on HADOOP-3136: --- Eric, regarding the cluster overloading,

[jira] Commented: (HADOOP-3136) Assign multiple tasks per TaskTracker heartbeat

[ https://issues.apache.org/jira/browse/HADOOP-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12631663#action_12631663 ] Matei Zaharia commented on HADOOP-3136: --- At the very least, it would help to

[jira] Commented: (HADOOP-3136) Assign multiple tasks per TaskTracker heartbeat

[ https://issues.apache.org/jira/browse/HADOOP-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12631667#action_12631667 ] Matei Zaharia commented on HADOOP-3136: --- If you guys have a Gridmix cluster lying

[jira] Commented: (HADOOP-4100) Scheduler.assignTasks should not be dealing with cleanupTask

[ https://issues.apache.org/jira/browse/HADOOP-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12629182#action_12629182 ] Matei Zaharia commented on HADOOP-4100: --- Looks good to me. Scheduler.assignTasks

[jira] Commented: (HADOOP-3150) Move task file promotion into the task

[ https://issues.apache.org/jira/browse/HADOOP-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12628695#action_12628695 ] Matei Zaharia commented on HADOOP-3150: --- Hi Devaraj, Thanks for pinging me about

[jira] Updated: (HADOOP-4050) TestFairScheduler failed on Linux

[ https://issues.apache.org/jira/browse/HADOOP-4050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-4050: -- Attachment: HADOOP-4050-v3.patch Good point about running without ant. Here's a patch that

[jira] Commented: (HADOOP-4050) TestFairScheduler failed on Linux

[ https://issues.apache.org/jira/browse/HADOOP-4050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12627848#action_12627848 ] Matei Zaharia commented on HADOOP-4050: --- You are right, calling mkdir on . is

[jira] Updated: (HADOOP-4050) TestFairScheduler failed on Linux

[ https://issues.apache.org/jira/browse/HADOOP-4050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-4050: -- Attachment: HADOOP-4050-v2.patch Here's a patch that calls the mkdir in the build file, see

[jira] Commented: (HADOOP-4050) TestFairScheduler failed on Linux

[ https://issues.apache.org/jira/browse/HADOOP-4050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12627501#action_12627501 ] Matei Zaharia commented on HADOOP-4050: --- Steve - the path is obtained by calling new

[jira] Commented: (HADOOP-4050) TestFairScheduler failed on Linux

[ https://issues.apache.org/jira/browse/HADOOP-4050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12627321#action_12627321 ] Matei Zaharia commented on HADOOP-4050: --- This is odd because TestFairScheduler

[jira] Commented: (HADOOP-4050) TestFairScheduler failed on Linux

[ https://issues.apache.org/jira/browse/HADOOP-4050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12627328#action_12627328 ] Matei Zaharia commented on HADOOP-4050: --- By the way, you may also want to try

[jira] Commented: (HADOOP-3746) A fair sharing job scheduler

[ https://issues.apache.org/jira/browse/HADOOP-3746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12627038#action_12627038 ] Matei Zaharia commented on HADOOP-3746: --- Thanks Owen! When HADOOP-3930 is finalized,

[jira] Issue Comment Edited: (HADOOP-3445) Implementing core scheduler functionality in Resource Manager (V1) for Hadoop

[ https://issues.apache.org/jira/browse/HADOOP-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12627042#action_12627042 ] [EMAIL PROTECTED] edited comment on HADOOP-3445 at 8/29/08 10:27 AM:

[jira] Commented: (HADOOP-3445) Implementing core scheduler functionality in Resource Manager (V1) for Hadoop

[ https://issues.apache.org/jira/browse/HADOOP-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12627042#action_12627042 ] Matei Zaharia commented on HADOOP-3445: --- Vivek - some of the unit test code I took

[jira] Commented: (HADOOP-3937) Job history may get disabled due to overly long job names

[ https://issues.apache.org/jira/browse/HADOOP-3937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12624863#action_12624863 ] Matei Zaharia commented on HADOOP-3937: --- There seems to be an issue with Hudson

[jira] Commented: (HADOOP-3930) Decide how to integrate scheduler info into CLI and job tracker web page

[ https://issues.apache.org/jira/browse/HADOOP-3930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12624895#action_12624895 ] Matei Zaharia commented on HADOOP-3930: --- That's a good idea, and should make the

[jira] Updated: (HADOOP-3746) A fair sharing job scheduler

[ https://issues.apache.org/jira/browse/HADOOP-3746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-3746: -- Status: Open (was: Patch Available) A fair sharing job scheduler

[jira] Updated: (HADOOP-3746) A fair sharing job scheduler

[ https://issues.apache.org/jira/browse/HADOOP-3746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-3746: -- Status: Patch Available (was: Open) Resubmitting patch because auto-tester seemed to be

[jira] Commented: (HADOOP-3937) Job history may get disabled due to overly long job names

[ https://issues.apache.org/jira/browse/HADOOP-3937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12622249#action_12622249 ] Matei Zaharia commented on HADOOP-3937: --- Isn't the combination of start time and job

[jira] Updated: (HADOOP-3930) Decide how to integrate scheduler info into CLI and job tracker web page

[ https://issues.apache.org/jira/browse/HADOOP-3930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-3930: -- Description: We need a way for job schedulers such as HADOOP-3445 and HADOOP-3476 to provide

<    5   6   7   8   9   10   11   >