[jira] [Updated] (YARN-1024) Define a CPU resource(s) unambigiously

2013-09-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1024: - Summary: Define a CPU resource(s) unambigiously (was: Define a virtual core unambigiously) > Define a CP

[jira] [Updated] (YARN-976) Document the meaning of a virtual core

2013-09-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-976: Issue Type: Sub-task (was: Task) Parent: YARN-1024 > Document the meaning of a virtual core > --

[jira] [Updated] (YARN-1089) Add YARN compute units alongside virtual cores

2013-09-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1089: - Issue Type: Sub-task (was: Improvement) Parent: YARN-1024 > Add YARN compute units alongside virt

[jira] [Updated] (YARN-976) Document the meaning of a virtual core

2013-09-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-976: Attachment: YARN-976.patch > Document the meaning of a virtual core > --

[jira] [Commented] (YARN-1241) In Fair Scheduler maxRunningApps does not work for non-leaf queues

2013-09-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13782566#comment-13782566 ] Sandy Ryza commented on YARN-1241: -- Uploaded patch to fix the new findbugs warnings > In

[jira] [Updated] (YARN-1241) In Fair Scheduler maxRunningApps does not work for non-leaf queues

2013-09-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1241: - Attachment: YARN-1241-3.patch > In Fair Scheduler maxRunningApps does not work for non-leaf queues > -

[jira] [Created] (YARN-1259) In Fair Scheduler web UI, queue num pending and num active apps switched

2013-09-30 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1259: Summary: In Fair Scheduler web UI, queue num pending and num active apps switched Key: YARN-1259 URL: https://issues.apache.org/jira/browse/YARN-1259 Project: Hadoop YARN

[jira] [Commented] (YARN-1010) FairScheduler: decouple container scheduling from nodemanager heartbeats

2013-09-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13782473#comment-13782473 ] Sandy Ryza commented on YARN-1010: -- This looks almost there to me. A few nits: {code} +

[jira] [Created] (YARN-1258) Allow configuring the Fair Scheduler root queue

2013-09-30 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1258: Summary: Allow configuring the Fair Scheduler root queue Key: YARN-1258 URL: https://issues.apache.org/jira/browse/YARN-1258 Project: Hadoop YARN Issue Type: Improve

[jira] [Updated] (YARN-1241) In Fair Scheduler maxRunningApps does not work for non-leaf queues

2013-09-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1241: - Attachment: YARN-1241-2.patch > In Fair Scheduler maxRunningApps does not work for non-leaf queues > -

[jira] [Commented] (YARN-1241) In Fair Scheduler maxRunningApps does not work for non-leaf queues

2013-09-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13782448#comment-13782448 ] Sandy Ryza commented on YARN-1241: -- Uploaded patch to fix findbugs warnings > In Fair Sch

[jira] [Commented] (YARN-1221) With Fair Scheduler, reserved MB reported in RM web UI increases indefinitely

2013-09-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13782322#comment-13782322 ] Sandy Ryza commented on YARN-1221: -- I just committed this to trunk, branch-2, and branch-2

[jira] [Commented] (YARN-1241) In Fair Scheduler maxRunningApps does not work for non-leaf queues

2013-09-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13782319#comment-13782319 ] Sandy Ryza commented on YARN-1241: -- Rebased on trunk > In Fair Scheduler maxRunningApps d

[jira] [Updated] (YARN-1221) With Fair Scheduler, reserved MB reported in RM web UI increases indefinitely

2013-09-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1221: - Assignee: Siqi Li > With Fair Scheduler, reserved MB reported in RM web UI increases indefinitely > --

[jira] [Updated] (YARN-1241) In Fair Scheduler maxRunningApps does not work for non-leaf queues

2013-09-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1241: - Attachment: YARN-1241-1.patch > In Fair Scheduler maxRunningApps does not work for non-leaf queues > -

[jira] [Commented] (YARN-1221) With Fair Scheduler, reserved MB reported in RM web UI increases indefinitely

2013-09-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13782283#comment-13782283 ] Sandy Ryza commented on YARN-1221: -- +1 > With Fair Scheduler, reserved MB reported in RM

[jira] [Updated] (YARN-1241) In Fair Scheduler maxRunningApps does not work for non-leaf queues

2013-09-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1241: - Attachment: YARN-1241.patch > In Fair Scheduler maxRunningApps does not work for non-leaf queues > ---

[jira] [Commented] (YARN-1221) With Fair Scheduler, reserved MB reported in RM web UI increases indefinitely

2013-09-26 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13779516#comment-13779516 ] Sandy Ryza commented on YARN-1221: -- Thanks [~l201514]! Good point about the rootQueueMetr

[jira] [Commented] (YARN-1221) With Fair Scheduler, reserved MB reported in RM web UI increases indefinitely

2013-09-26 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13779173#comment-13779173 ] Sandy Ryza commented on YARN-1221: -- bq. It will affect the amount shown in the web UI, sin

[jira] [Commented] (YARN-1241) In Fair Scheduler maxRunningApps does not work for non-leaf queues

2013-09-26 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13778967#comment-13778967 ] Sandy Ryza commented on YARN-1241: -- Currently this property works by starting all apps as

[jira] [Commented] (YARN-1221) With Fair Scheduler, reserved MB reported in RM web UI increases indefinitely

2013-09-25 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13778208#comment-13778208 ] Sandy Ryza commented on YARN-1221: -- bq. The reason I removed the code above is that there

[jira] [Created] (YARN-1241) In Fair Scheduler maxRunningApps does not work for non-leaf queues

2013-09-25 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1241: Summary: In Fair Scheduler maxRunningApps does not work for non-leaf queues Key: YARN-1241 URL: https://issues.apache.org/jira/browse/YARN-1241 Project: Hadoop YARN

[jira] [Commented] (YARN-1221) With Fair Scheduler, reserved MB reported in RM web UI increases indefinitely

2013-09-25 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13778174#comment-13778174 ] Sandy Ryza commented on YARN-1221: -- {code} -this.totalMB = availableMB + reservedMB +

[jira] [Updated] (YARN-1228) Clean up Fair Scheduler configuration loading

2013-09-25 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1228: - Attachment: YARN-1228-2.patch > Clean up Fair Scheduler configuration loading > --

[jira] [Commented] (YARN-1228) Clean up Fair Scheduler configuration loading

2013-09-25 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13777661#comment-13777661 ] Sandy Ryza commented on YARN-1228: -- Updated patch adds license header to test-fair-schedul

[jira] [Updated] (YARN-1236) FairScheduler setting queue name in RMApp is not working

2013-09-25 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1236: - Attachment: YARN-1236.patch > FairScheduler setting queue name in RMApp is not working >

[jira] [Created] (YARN-1236) FairScheduler setting queue name in RMApp is not working

2013-09-25 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1236: Summary: FairScheduler setting queue name in RMApp is not working Key: YARN-1236 URL: https://issues.apache.org/jira/browse/YARN-1236 Project: Hadoop YARN Issue Typ

[jira] [Commented] (YARN-1228) Clean up Fair Scheduler configuration loading

2013-09-25 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13777572#comment-13777572 ] Sandy Ryza commented on YARN-1228: -- Updated patch includes a test > Clean

[jira] [Updated] (YARN-1228) Clean up Fair Scheduler configuration loading

2013-09-25 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1228: - Attachment: YARN-1228-1.patch > Clean up Fair Scheduler configuration loading > --

[jira] [Updated] (YARN-1128) FifoPolicy.computeShares throws NPE on empty list of Schedulables

2013-09-24 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1128: - Hadoop Flags: Reviewed Committed to trunk, branch-2, and branch-2.1-beta > FifoPolicy.com

[jira] [Commented] (YARN-1089) Add YARN compute units alongside virtual cores

2013-09-24 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13777071#comment-13777071 ] Sandy Ryza commented on YARN-1089: -- As was requested, I posted a summary of the proposal o

[jira] [Commented] (YARN-1089) Add YARN compute units alongside virtual cores

2013-09-24 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13777034#comment-13777034 ] Sandy Ryza commented on YARN-1089: -- I'm ok with with waiting until 2.3. In case it's not

[jira] [Created] (YARN-1230) Fair scheduler aclSubmitApps does not handle acls with only groups

2013-09-23 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1230: Summary: Fair scheduler aclSubmitApps does not handle acls with only groups Key: YARN-1230 URL: https://issues.apache.org/jira/browse/YARN-1230 Project: Hadoop YARN

[jira] [Commented] (YARN-1228) Clean up Fair Scheduler configuration loading

2013-09-23 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13775769#comment-13775769 ] Sandy Ryza commented on YARN-1228: -- Existing tests verify that absolute paths and not givi

[jira] [Updated] (YARN-1228) Clean up Fair Scheduler configuration loading

2013-09-23 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1228: - Attachment: YARN-1228.patch > Clean up Fair Scheduler configuration loading >

[jira] [Updated] (YARN-1228) Clean up Fair Scheduler configuration loading

2013-09-23 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1228: - Description: Currently the Fair Scheduler is configured in two ways * An allocations file that has a diffe

[jira] [Updated] (YARN-1228) Clean up Fair Scheduler configuration loading

2013-09-23 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1228: - Summary: Clean up Fair Scheduler configuration loading (was: Don't allow other file than fair-scheduler.x

[jira] [Updated] (YARN-1227) Update Single Cluster doc to use yarn.resourcemanager.hostname

2013-09-23 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1227: - Labels: newbie (was: ) > Update Single Cluster doc to use yarn.resourcemanager.hostname > ---

[jira] [Updated] (YARN-1188) The context of QueueMetrics becomes 'default' when using FairScheduler

2013-09-23 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1188: - Assignee: Tsuyoshi OZAWA > The context of QueueMetrics becomes 'default' when using FairScheduler > --

[jira] [Created] (YARN-1228) Don't allow other file than fair-scheduler.xml to be Fair Scheduler allocations file

2013-09-23 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1228: Summary: Don't allow other file than fair-scheduler.xml to be Fair Scheduler allocations file Key: YARN-1228 URL: https://issues.apache.org/jira/browse/YARN-1228 Project: Had

[jira] [Created] (YARN-1227) Update Single Cluster doc to use yarn.resourcemanager.hostname

2013-09-23 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1227: Summary: Update Single Cluster doc to use yarn.resourcemanager.hostname Key: YARN-1227 URL: https://issues.apache.org/jira/browse/YARN-1227 Project: Hadoop YARN Iss

[jira] [Commented] (YARN-1188) The context of QueueMetrics becomes 'default' when using FairScheduler

2013-09-23 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13774344#comment-13774344 ] Sandy Ryza commented on YARN-1188: -- I just committed this to trunk and branch-2. Thanks T

[jira] [Updated] (YARN-1188) The context of QueueMetrics becomes 'default' when using FairScheduler

2013-09-23 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1188: - Assignee: (was: Akira AJISAKA) > The context of QueueMetrics becomes 'default' when using FairSche

[jira] [Updated] (YARN-1188) The context of QueueMetrics becomes 'default' when using FairScheduler

2013-09-23 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1188: - Assignee: Akira AJISAKA > The context of QueueMetrics becomes 'default' when using FairScheduler > ---

[jira] [Commented] (YARN-1188) The context of QueueMetrics becomes 'default' when using FairScheduler

2013-09-23 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13774336#comment-13774336 ] Sandy Ryza commented on YARN-1188: -- +1 > The context of QueueMetrics beco

[jira] [Updated] (YARN-1089) Add YARN compute units alongside virtual cores

2013-09-19 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1089: - Attachment: YARN-1089-1.patch Updated patch should fix TestFairScheduler and TestSchedulerUtils. The Tes

[jira] [Created] (YARN-1221) With Fair Scheduler, reserved MB reported in RM web UI increases indefinitely

2013-09-18 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1221: Summary: With Fair Scheduler, reserved MB reported in RM web UI increases indefinitely Key: YARN-1221 URL: https://issues.apache.org/jira/browse/YARN-1221 Project: Hadoop YAR

[jira] [Commented] (YARN-1128) FifoPolicy.computeShares throws NPE on empty list of Schedulables

2013-09-18 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13770823#comment-13770823 ] Sandy Ryza commented on YARN-1128: -- +1 > FifoPolicy.computeShares throws

[jira] [Created] (YARN-1213) Add an equivalent of mapred.fairscheduler.allow.undeclared.pools to the Fair Scheduler

2013-09-17 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1213: Summary: Add an equivalent of mapred.fairscheduler.allow.undeclared.pools to the Fair Scheduler Key: YARN-1213 URL: https://issues.apache.org/jira/browse/YARN-1213 Project: H

[jira] [Updated] (YARN-1089) Add YARN compute units alongside virtual cores

2013-09-17 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1089: - Attachment: YARN-1089.patch > Add YARN compute units alongside virtual cores > ---

[jira] [Updated] (YARN-1089) Add YARN compute units alongside virtual cores

2013-09-17 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1089: - Attachment: (was: YARN-1089.patch) > Add YARN compute units alongside virtual cores >

[jira] [Updated] (YARN-1089) Add YARN compute units alongside virtual cores

2013-09-17 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1089: - Attachment: YARN-1089.patch > Add YARN compute units alongside virtual cores > ---

[jira] [Commented] (YARN-1206) Container logs link is broken on RM web UI after application finished

2013-09-17 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13770430#comment-13770430 ] Sandy Ryza commented on YARN-1206: -- Did this work differently prior to YARN-649? My impre

[jira] [Updated] (YARN-1206) Container logs link is broken on RM web UI after application finished

2013-09-17 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1206: - Labels: (was: 2.1.1-beta) > Container logs link is broken on RM web UI after application finished >

[jira] [Created] (YARN-1212) Add a Scheduling Concepts page to the web doc

2013-09-17 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1212: Summary: Add a Scheduling Concepts page to the web doc Key: YARN-1212 URL: https://issues.apache.org/jira/browse/YARN-1212 Project: Hadoop YARN Issue Type: Improveme

[jira] [Updated] (YARN-1184) ClassCastException is thrown during preemption When a huge job is submitted to a queue B whose resources is used by a job in queueA

2013-09-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1184: - Component/s: capacityscheduler > ClassCastException is thrown during preemption When a huge job is sub

[jira] [Commented] (YARN-938) Hadoop 2 benchmarking

2013-09-10 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13763829#comment-13763829 ] Sandy Ryza commented on YARN-938: - On vacation now, but I'll try to assemble them into a pre

[jira] [Commented] (YARN-938) Hadoop 2 benchmarking

2013-09-10 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13763798#comment-13763798 ] Sandy Ryza commented on YARN-938: - Thanks for working on these, [~mayank_bansal]. The resul

[jira] [Created] (YARN-1171) Add defaultQueueSchedulingPolicy to Fair Scheduler documentation

2013-09-09 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1171: Summary: Add defaultQueueSchedulingPolicy to Fair Scheduler documentation Key: YARN-1171 URL: https://issues.apache.org/jira/browse/YARN-1171 Project: Hadoop YARN

[jira] [Commented] (YARN-1049) ContainerExistStatus should define a status for preempted containers

2013-09-07 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13761164#comment-13761164 ] Sandy Ryza commented on YARN-1049: -- +1 > ContainerExistStatus should defi

[jira] [Commented] (YARN-910) Allow auxiliary services to listen for container starts and completions

2013-09-05 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759511#comment-13759511 ] Sandy Ryza commented on YARN-910: - Can we add in the initializeContainer doc exactly when th

[jira] [Commented] (YARN-1100) Giving multiple commands to ContainerLaunchContext doesn't work as expected

2013-09-03 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13756795#comment-13756795 ] Sandy Ryza commented on YARN-1100: -- In the MR and distributed shell code, the command list

[jira] [Commented] (YARN-649) Make container logs available over HTTP in plain text

2013-09-03 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13756793#comment-13756793 ] Sandy Ryza commented on YARN-649: - Thanks Vinod! > Make container logs avai

[jira] [Commented] (YARN-1135) Revisit log message levels in FairScheduler.

2013-09-02 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13755977#comment-13755977 ] Sandy Ryza commented on YARN-1135: -- Agreed > Revisit log message levels i

[jira] [Commented] (YARN-1090) Job does not get into Pending State

2013-08-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13755368#comment-13755368 ] Sandy Ryza commented on YARN-1090: -- Ah, ok, makes total sense > Job does

[jira] [Commented] (YARN-1090) Job does not get into Pending State

2013-08-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13755219#comment-13755219 ] Sandy Ryza commented on YARN-1090: -- My understanding was that an application is "Pending"

[jira] [Created] (YARN-1128) FifoPolicy.computeShares throws NPE on empty list of Schedulables

2013-08-30 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1128: Summary: FifoPolicy.computeShares throws NPE on empty list of Schedulables Key: YARN-1128 URL: https://issues.apache.org/jira/browse/YARN-1128 Project: Hadoop YARN

[jira] [Commented] (YARN-1122) FairScheduler user-as-default-queue always defaults to 'default'

2013-08-29 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13753804#comment-13753804 ] Sandy Ryza commented on YARN-1122: -- Thanks for taking this up, [~lohit]. Would it be poss

[jira] [Updated] (YARN-1034) Remove "experimental" in the Fair Scheduler documentation

2013-08-28 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1034: - Fix Version/s: 2.1.1-beta > Remove "experimental" in the Fair Scheduler documentation > --

[jira] [Commented] (YARN-1034) Remove "experimental" in the Fair Scheduler documentation

2013-08-28 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13753194#comment-13753194 ] Sandy Ryza commented on YARN-1034: -- +1 > Remove "experimental" in the Fai

[jira] [Created] (YARN-1110) NodeManager doesn't complete container after transition from LOCALIZED to KILLING

2013-08-27 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1110: Summary: NodeManager doesn't complete container after transition from LOCALIZED to KILLING Key: YARN-1110 URL: https://issues.apache.org/jira/browse/YARN-1110 Project: Hadoop

[jira] [Created] (YARN-1109) Consider throttling or demoting NodeManager "Sending out status for container" logs

2013-08-27 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1109: Summary: Consider throttling or demoting NodeManager "Sending out status for container" logs Key: YARN-1109 URL: https://issues.apache.org/jira/browse/YARN-1109 Project: Hado

[jira] [Updated] (YARN-832) Update Resource javadoc to clarify units for memory

2013-08-27 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-832: Target Version/s: 2.3.0 > Update Resource javadoc to clarify units for memory > -

[jira] [Updated] (YARN-832) Update Resource javadoc to clarify units for memory

2013-08-27 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-832: Labels: newbie (was: ) > Update Resource javadoc to clarify units for memory > -

[jira] [Updated] (YARN-832) Update Resource javadoc to clarify units for memory

2013-08-27 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-832: Fix Version/s: (was: 2.3.0) > Update Resource javadoc to clarify units for memory > -

[jira] [Commented] (YARN-723) Yarn default value of physical cpu cores to virtual core is 2

2013-08-27 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13751775#comment-13751775 ] Sandy Ryza commented on YARN-723: - Resolving as invalid now that YARN-782 removed the vcores

[jira] [Resolved] (YARN-723) Yarn default value of physical cpu cores to virtual core is 2

2013-08-27 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved YARN-723. - Resolution: Invalid > Yarn default value of physical cpu cores to virtual core is 2 > -

[jira] [Created] (YARN-1100) Giving multiple commands to ContainerLaunchContext doesn't work as expected

2013-08-26 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1100: Summary: Giving multiple commands to ContainerLaunchContext doesn't work as expected Key: YARN-1100 URL: https://issues.apache.org/jira/browse/YARN-1100 Project: Hadoop YARN

[jira] [Updated] (YARN-649) Make container logs available over HTTP in plain text

2013-08-26 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-649: Attachment: YARN-649-7.patch > Make container logs available over HTTP in plain text > --

[jira] [Updated] (YARN-942) In Fair Scheduler documentation, inconsistency on which properties have prefix

2013-08-26 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-942: Assignee: Akira AJISAKA > In Fair Scheduler documentation, inconsistency on which properties have prefix

[jira] [Commented] (YARN-1093) Corrections to Fair Scheduler documentation

2013-08-26 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13750489#comment-13750489 ] Sandy Ryza commented on YARN-1093: -- I just committed this to trunk, branch-2, and branch-2

[jira] [Updated] (YARN-942) In Fair Scheduler documentation, inconsistency on which properties have prefix

2013-08-26 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-942: Labels: documentation newbie (was: docuentation newbie) > In Fair Scheduler documentation, inconsistency

[jira] [Updated] (YARN-1093) Corrections to Fair Scheduler documentation

2013-08-26 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1093: - Hadoop Flags: Reviewed > Corrections to Fair Scheduler documentation > ---

[jira] [Updated] (YARN-1093) Corrections to fair scheduler documentation

2013-08-26 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1093: - Summary: Corrections to fair scheduler documentation (was: corrections to fair scheduler documentation)

[jira] [Updated] (YARN-1093) Corrections to Fair Scheduler documentation

2013-08-26 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1093: - Summary: Corrections to Fair Scheduler documentation (was: Corrections to fair scheduler documentation)

[jira] [Commented] (YARN-1024) Define a virtual core unambigiously

2013-08-26 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13750286#comment-13750286 ] Sandy Ryza commented on YARN-1024: -- bq. It seems to me that the only time you'd want a YCU

[jira] [Commented] (YARN-905) Add state filters to nodes CLI

2013-08-23 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749142#comment-13749142 ] Sandy Ryza commented on YARN-905: - I just committed this before Vinod's comment. I don't th

[jira] [Commented] (YARN-942) In Fair Scheduler documentation, inconsistency on which properties have prefix

2013-08-23 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13748988#comment-13748988 ] Sandy Ryza commented on YARN-942: - Thanks [~ajisakaa]. +1 pending jenkins.

[jira] [Commented] (YARN-1093) corrections to fair scheduler documentation

2013-08-23 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13748879#comment-13748879 ] Sandy Ryza commented on YARN-1093: -- Thanks Wing Yew! +1 pendings Jenkins.

[jira] [Updated] (YARN-1093) corrections to fair scheduler documentation

2013-08-23 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1093: - Fix Version/s: (was: 2.1.0-beta) > corrections to fair scheduler documentation > -

[jira] [Updated] (YARN-1024) Define a virtual core unambigiously

2013-08-22 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1024: - Attachment: CPUasaYARNresource.pdf > Define a virtual core unambigiously > ---

[jira] [Commented] (YARN-1024) Define a virtual core unambigiously

2013-08-22 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13748062#comment-13748062 ] Sandy Ryza commented on YARN-1024: -- I wrote up a more detailed proposal and attached a PDF

[jira] [Commented] (YARN-1089) Add YARN compute units alongside virtual cores

2013-08-22 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13747881#comment-13747881 ] Sandy Ryza commented on YARN-1089: -- Yeah, I'll write up a document and post it on YARN-102

[jira] [Updated] (YARN-1089) Add YARN compute units alongside virtual cores

2013-08-22 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1089: - Description: Based on discussion in YARN-1024, we will add YARN compute units as a resource for requesting

[jira] [Commented] (YARN-1024) Define a virtual core unambigiously

2013-08-22 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13747701#comment-13747701 ] Sandy Ryza commented on YARN-1024: -- Filed YARN-1089 for adding YCUs. > De

[jira] [Created] (YARN-1089) Add YARN compute units alongside virtual cores

2013-08-21 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1089: Summary: Add YARN compute units alongside virtual cores Key: YARN-1089 URL: https://issues.apache.org/jira/browse/YARN-1089 Project: Hadoop YARN Issue Type: Improvem

[jira] [Resolved] (YARN-972) Allow requests and scheduling for fractional virtual cores

2013-08-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved YARN-972. - Resolution: Won't Fix > Allow requests and scheduling for fractional virtual cores > --

[jira] [Commented] (YARN-972) Allow requests and scheduling for fractional virtual cores

2013-08-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13747142#comment-13747142 ] Sandy Ryza commented on YARN-972: - Based on the approach we've agreed upon in YARN-1024 that

[jira] [Updated] (YARN-649) Make container logs available over HTTP in plain text

2013-08-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-649: Attachment: YARN-649-6.patch > Make container logs available over HTTP in plain text > --

[jira] [Commented] (YARN-649) Make container logs available over HTTP in plain text

2013-08-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13746880#comment-13746880 ] Sandy Ryza commented on YARN-649: - Uploading a new patch that * Puts IOUtils.skipFully(logBy

<    4   5   6   7   8   9   10   11   12   13   >