[jira] [Updated] (YARN-1241) In Fair Scheduler maxRunningApps does not work for non-leaf queues

2013-11-26 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1241: - Attachment: YARN-1241-10.patch In Fair Scheduler maxRunningApps does not work for non-leaf queues

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2013-11-25 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13831848#comment-13831848 ] Sandy Ryza commented on YARN-1197: -- +1 to what Bikas said. Would also be good to have a

[jira] [Commented] (YARN-1445) Separate FINISHING and FINISHED state in YarnApplicationState

2013-11-25 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13831909#comment-13831909 ] Sandy Ryza commented on YARN-1445: -- Is there a rationale for why they are currently a

[jira] [Updated] (YARN-1444) RM crashes when node resource request sent without corresponding rack request

2013-11-25 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1444: - Summary: RM crashes when node resource request sent without corresponding rack request (was: RM crashes

[jira] [Commented] (YARN-1434) Single Job can affect fairshare of others

2013-11-24 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13831180#comment-13831180 ] Sandy Ryza commented on YARN-1434: -- Srikanth, this would happen if the AM can return

[jira] [Commented] (YARN-1423) Support queue placement by secondary group in the Fair Scheduler

2013-11-24 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13831185#comment-13831185 ] Sandy Ryza commented on YARN-1423: -- +1 Support queue placement by secondary group in the

[jira] [Commented] (YARN-1440) Yarn aggregated logs should be stored in a simpler format

2013-11-24 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13831187#comment-13831187 ] Sandy Ryza commented on YARN-1440: -- Would it be helpful for YARN to supply a public API

[jira] [Updated] (YARN-1423) Support queue placement by secondary group in the Fair Scheduler

2013-11-24 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1423: - Assignee: Ted Malaska Support queue placement by secondary group in the Fair Scheduler

[jira] [Commented] (YARN-1423) Support queue placement by secondary group in the Fair Scheduler

2013-11-24 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13831203#comment-13831203 ] Sandy Ryza commented on YARN-1423: -- I just committed this. Thanks Ted! Support queue

[jira] [Commented] (YARN-1423) Support queue placement by secondary group in the Fair Scheduler

2013-11-22 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13830128#comment-13830128 ] Sandy Ryza commented on YARN-1423: -- Thanks for working on this Ted, The patch is looking

[jira] [Commented] (YARN-1434) Single Job can affect fairshare of others

2013-11-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13829761#comment-13829761 ] Sandy Ryza commented on YARN-1434: -- This seems possible. To further spell this out:

[jira] [Resolved] (YARN-936) RMWebServices filtering apps by states uses RMAppState instead of YarnAppilcationState.

2013-11-20 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved YARN-936. - Resolution: Duplicate RMWebServices filtering apps by states uses RMAppState instead of

[jira] [Commented] (YARN-1407) RM Web UI and REST APIs should uniformly use YarnApplicationState

2013-11-20 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13827443#comment-13827443 ] Sandy Ryza commented on YARN-1407: -- Didn't notice that - yeah, looks like it is. Just

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2013-11-20 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13828106#comment-13828106 ] Sandy Ryza commented on YARN-1197: -- +1 on the current design. If possible it would be

[jira] [Created] (YARN-1429) YARN_CLASSPATH is referenced in yarn command comments but doesn't do anything

2013-11-20 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1429: Summary: YARN_CLASSPATH is referenced in yarn command comments but doesn't do anything Key: YARN-1429 URL: https://issues.apache.org/jira/browse/YARN-1429 Project: Hadoop

[jira] [Updated] (YARN-584) In scheduler web UIs, queues unexpand on refresh

2013-11-19 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-584: Summary: In scheduler web UIs, queues unexpand on refresh (was: In fair scheduler web UI, queues unexpand

[jira] [Created] (YARN-1423) Support queue placement by secondary group in the Fair Scheduler

2013-11-19 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1423: Summary: Support queue placement by secondary group in the Fair Scheduler Key: YARN-1423 URL: https://issues.apache.org/jira/browse/YARN-1423 Project: Hadoop YARN

[jira] [Commented] (YARN-786) Expose application resource usage in RM REST API

2013-11-19 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13826703#comment-13826703 ] Sandy Ryza commented on YARN-786: - I'll look into this today. Expose application resource

[jira] [Updated] (YARN-786) Expose application resource usage in RM REST API

2013-11-19 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-786: Attachment: YARN-786-addendum.patch Expose application resource usage in RM REST API

[jira] [Created] (YARN-1424) RMAppAttemptImpl should have a dummy ApplicationResourceUsageReport to return when

2013-11-19 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1424: Summary: RMAppAttemptImpl should have a dummy ApplicationResourceUsageReport to return when Key: YARN-1424 URL: https://issues.apache.org/jira/browse/YARN-1424 Project:

[jira] [Commented] (YARN-786) Expose application resource usage in RM REST API

2013-11-19 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13826927#comment-13826927 ] Sandy Ryza commented on YARN-786: - Thanks Jason. Committing this now and filed YARN-1424

[jira] [Commented] (YARN-1332) In TestAMRMClient, replace assertTrue with assertEquals where possible

2013-11-19 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13827032#comment-13827032 ] Sandy Ryza commented on YARN-1332: -- Thanks Sebastian. The last thing is that, for

[jira] [Commented] (YARN-584) In fair scheduler web UI, queues unexpand on refresh

2013-11-18 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13825804#comment-13825804 ] Sandy Ryza commented on YARN-584: - +1 In fair scheduler web UI, queues unexpand on refresh

[jira] [Updated] (YARN-584) In fair scheduler web UI, queues unexpand on refresh

2013-11-18 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-584: Assignee: Harshit Daga In fair scheduler web UI, queues unexpand on refresh

[jira] [Updated] (YARN-1403) Separate out configuration loading from QueueManager in the Fair Scheduler

2013-11-18 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1403: - Attachment: YARN-1403-2.patch Separate out configuration loading from QueueManager in the Fair Scheduler

[jira] [Resolved] (YARN-754) Allow for black-listing resources in FS

2013-11-18 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved YARN-754. - Resolution: Duplicate Closing as duplicate of YARN-1333 Allow for black-listing resources in FS

[jira] [Resolved] (YARN-384) add virtual cores info to the queue metrics

2013-11-18 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved YARN-384. - Resolution: Duplicate Closing as duplicate of YARN-598 add virtual cores info to the queue metrics

[jira] [Commented] (YARN-584) In fair scheduler web UI, queues unexpand on refresh

2013-11-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13823989#comment-13823989 ] Sandy Ryza commented on YARN-584: - Thanks for making these changes. The nodes in ExpandNode

[jira] [Commented] (YARN-1332) In TestAMRMClient, replace assertTrue with assertEquals where possible

2013-11-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13824032#comment-13824032 ] Sandy Ryza commented on YARN-1332: -- Thanks for picking this up Sebastian. There are a few

[jira] [Updated] (YARN-1407) RM Web UI and REST APIs should uniformly use YarnApplicationState

2013-11-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1407: - Attachment: YARN-1407-2.patch RM Web UI and REST APIs should uniformly use YarnApplicationState

[jira] [Commented] (YARN-1407) RM Web UI and REST APIs should uniformly use YarnApplicationState

2013-11-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13824094#comment-13824094 ] Sandy Ryza commented on YARN-1407: -- Thanks Zhijie, good catch. Uploading a new aptch.

[jira] [Updated] (YARN-1403) Separate out configuration loading from QueueManager in the Fair Scheduler

2013-11-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1403: - Attachment: YARN-1403.patch Separate out configuration loading from QueueManager in the Fair Scheduler

[jira] [Updated] (YARN-1241) In Fair Scheduler maxRunningApps does not work for non-leaf queues

2013-11-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1241: - Attachment: YARN-1241-9.patch In Fair Scheduler maxRunningApps does not work for non-leaf queues

[jira] [Commented] (YARN-1241) In Fair Scheduler maxRunningApps does not work for non-leaf queues

2013-11-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13824146#comment-13824146 ] Sandy Ryza commented on YARN-1241: -- Rebased patch after YARN-1392 In Fair Scheduler

[jira] [Commented] (YARN-1415) In scheduler UI, including used memory in Memory Total seems to be inaccurate

2013-11-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13824161#comment-13824161 ] Sandy Ryza commented on YARN-1415: -- availableMB is meant to only include non-allocated

[jira] [Commented] (YARN-1332) In TestAMRMClient, replace assertTrue with assertEquals where possible

2013-11-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13824187#comment-13824187 ] Sandy Ryza commented on YARN-1332: -- Yes please. In TestAMRMClient, replace assertTrue

[jira] [Updated] (YARN-1403) Separate out configuration loading from QueueManager in the Fair Scheduler

2013-11-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1403: - Attachment: YARN-1403-1.patch Separate out configuration loading from QueueManager in the Fair Scheduler

[jira] [Commented] (YARN-1403) Separate out configuration loading from QueueManager in the Fair Scheduler

2013-11-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13824194#comment-13824194 ] Sandy Ryza commented on YARN-1403: -- Uploaded a patch that should fix the findbugs warning.

[jira] [Updated] (YARN-1401) With zero sleep-delay-before-sigkill.ms, no signal is ever sent

2013-11-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1401: - Assignee: Gera Shegalov With zero sleep-delay-before-sigkill.ms, no signal is ever sent

[jira] [Updated] (YARN-1392) Allow sophisticated app-to-queue placement policies in the Fair Scheduler

2013-11-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1392: - Attachment: YARN-1392-1.patch Allow sophisticated app-to-queue placement policies in the Fair Scheduler

[jira] [Commented] (YARN-1404) Add support for unmanaged containers

2013-11-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13821592#comment-13821592 ] Sandy Ryza commented on YARN-1404: -- [~vinodkv], a lightweight RM is not sufficient because

[jira] [Commented] (YARN-1392) Allow sophisticated app-to-queue placement policies in the Fair Scheduler

2013-11-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13821881#comment-13821881 ] Sandy Ryza commented on YARN-1392: -- Uploading a patch that addresses these comments.

[jira] [Updated] (YARN-1392) Allow sophisticated app-to-queue placement policies in the Fair Scheduler

2013-11-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1392: - Attachment: YARN-1392-2.patch Allow sophisticated app-to-queue placement policies in the Fair Scheduler

[jira] [Commented] (YARN-1407) apps REST API filters queries by YarnApplicationState, but includes RMAppStates in response

2013-11-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13821916#comment-13821916 ] Sandy Ryza commented on YARN-1407: -- Uploading a patch that fixes the test, updates the

[jira] [Updated] (YARN-1407) apps REST API filters queries by YarnApplicationState, but includes RMAppStates in response

2013-11-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1407: - Attachment: YARN-1407-1.patch apps REST API filters queries by YarnApplicationState, but includes

[jira] [Updated] (YARN-1241) In Fair Scheduler maxRunningApps does not work for non-leaf queues

2013-11-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1241: - Attachment: YARN-1241-7.patch In Fair Scheduler maxRunningApps does not work for non-leaf queues

[jira] [Commented] (YARN-1241) In Fair Scheduler maxRunningApps does not work for non-leaf queues

2013-11-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13821922#comment-13821922 ] Sandy Ryza commented on YARN-1241: -- Uploaded a rebased patch In Fair Scheduler

[jira] [Updated] (YARN-1392) Allow sophisticated app-to-queue placement policies in the Fair Scheduler

2013-11-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1392: - Attachment: YARN-1392-3.patch Allow sophisticated app-to-queue placement policies in the Fair Scheduler

[jira] [Commented] (YARN-1392) Allow sophisticated app-to-queue placement policies in the Fair Scheduler

2013-11-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13822018#comment-13822018 ] Sandy Ryza commented on YARN-1392: -- Uploaded a patch that addresses latest comments.

[jira] [Updated] (YARN-1241) In Fair Scheduler maxRunningApps does not work for non-leaf queues

2013-11-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1241: - Attachment: YARN-1241-8.patch In Fair Scheduler maxRunningApps does not work for non-leaf queues

[jira] [Commented] (YARN-891) Store completed application information in RM state store

2013-11-12 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13820701#comment-13820701 ] Sandy Ryza commented on YARN-891: - It looks like this patch removes an RMAppState

[jira] [Commented] (YARN-891) Store completed application information in RM state store

2013-11-12 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13820746#comment-13820746 ] Sandy Ryza commented on YARN-891: - Oh, looks like YarnApplicationState is now used for app

[jira] [Commented] (YARN-1392) Allow sophisticated app-to-queue placement policies in the Fair Scheduler

2013-11-12 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13820848#comment-13820848 ] Sandy Ryza commented on YARN-1392: -- Attached patch. Still need to add doc. Allow

[jira] [Updated] (YARN-1392) Allow sophisticated app-to-queue placement policies in the Fair Scheduler

2013-11-12 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1392: - Attachment: YARN-1392.patch Allow sophisticated app-to-queue placement policies in the Fair Scheduler

[jira] [Created] (YARN-1407) apps REST API filters queries by YarnApplicationState, but includes RMAppStates in response

2013-11-12 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1407: Summary: apps REST API filters queries by YarnApplicationState, but includes RMAppStates in response Key: YARN-1407 URL: https://issues.apache.org/jira/browse/YARN-1407

[jira] [Updated] (YARN-1392) Allow sophisticated app-to-queue placement policies in the Fair Scheduler

2013-11-12 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1392: - Attachment: YARN-1392-1.patch Allow sophisticated app-to-queue placement policies in the Fair Scheduler

[jira] [Updated] (YARN-1392) Allow sophisticated app-to-queue placement policies in the Fair Scheduler

2013-11-12 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1392: - Attachment: (was: YARN-1392-1.patch) Allow sophisticated app-to-queue placement policies in the Fair

[jira] [Commented] (YARN-1392) Allow sophisticated app-to-queue placement policies in the Fair Scheduler

2013-11-12 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13820980#comment-13820980 ] Sandy Ryza commented on YARN-1392: -- Updated patch includes javadoc and fixes reject rule

[jira] [Updated] (YARN-1392) Allow sophisticated app-to-queue placement policies in the Fair Scheduler

2013-11-12 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1392: - Attachment: YARN-1392-1.patch Allow sophisticated app-to-queue placement policies in the Fair Scheduler

[jira] [Updated] (YARN-1407) apps REST API filters queries by YarnApplicationState, but includes RMAppStates in response

2013-11-12 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1407: - Attachment: YARN-1407.patch apps REST API filters queries by YarnApplicationState, but includes

[jira] [Updated] (YARN-1407) apps REST API filters queries by YarnApplicationState, but includes RMAppStates in response

2013-11-12 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1407: - Target Version/s: 2.2.1 apps REST API filters queries by YarnApplicationState, but includes

[jira] [Commented] (YARN-1387) RMWebServices should use ClientRMService for filtering applications

2013-11-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13819316#comment-13819316 ] Sandy Ryza commented on YARN-1387: -- A few stylistic comments. Otherwise, looks good to

[jira] [Commented] (YARN-1387) RMWebServices should use ClientRMService for filtering applications

2013-11-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13819380#comment-13819380 ] Sandy Ryza commented on YARN-1387: -- Yeah, I've definitely seen this as well. Karthik,

[jira] [Commented] (YARN-1387) RMWebServices should use ClientRMService for filtering applications

2013-11-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13819399#comment-13819399 ] Sandy Ryza commented on YARN-1387: -- Applied the patch locally and it built fine. +1.

[jira] [Commented] (YARN-1387) RMWebServices should use ClientRMService for filtering applications

2013-11-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13819461#comment-13819461 ] Sandy Ryza commented on YARN-1387: -- I just committed this. Thanks Karthik! RMWebServices

[jira] [Commented] (YARN-1401) With zero sleep-delay-before-sigkill.ms, no signal is ever sent

2013-11-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13819758#comment-13819758 ] Sandy Ryza commented on YARN-1401: -- Are you able to write a test for this? With zero

[jira] [Moved] (YARN-1403) Separate out configuration loading from QueueManager in the Fair Scheduler

2013-11-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza moved MAPREDUCE-5619 to YARN-1403: - Affects Version/s: (was: 2.2.0) 2.2.0

[jira] [Commented] (YARN-584) In fair scheduler web UI, queues unexpand on refresh

2013-11-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13817928#comment-13817928 ] Sandy Ryza commented on YARN-584: - bq. One question can't we put this in some already

[jira] [Commented] (YARN-807) When querying apps by queue, iterating over all apps is inefficient and limiting

2013-11-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13817985#comment-13817985 ] Sandy Ryza commented on YARN-807: - Attaching a rebased patch. It also modifies

[jira] [Updated] (YARN-807) When querying apps by queue, iterating over all apps is inefficient and limiting

2013-11-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-807: Attachment: YARN-807-1.patch When querying apps by queue, iterating over all apps is inefficient and

[jira] [Commented] (YARN-807) When querying apps by queue, iterating over all apps is inefficient and limiting

2013-11-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13817995#comment-13817995 ] Sandy Ryza commented on YARN-807: - Build is failing because of the runaway process / javah

[jira] [Commented] (YARN-584) In fair scheduler web UI, queues unexpand on refresh

2013-11-07 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13816444#comment-13816444 ] Sandy Ryza commented on YARN-584: - Thanks the picking this up, Harshit. It seems like it

[jira] [Created] (YARN-1392) Allow sophisticated app-to-queue placement policies in the Fair Scheduler

2013-11-06 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1392: Summary: Allow sophisticated app-to-queue placement policies in the Fair Scheduler Key: YARN-1392 URL: https://issues.apache.org/jira/browse/YARN-1392 Project: Hadoop YARN

[jira] [Commented] (YARN-1391) Lost node list contains many active node with different port

2013-11-05 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13814272#comment-13814272 ] Sandy Ryza commented on YARN-1391: -- This is related to YARN-1382 Lost node list contains

[jira] [Reopened] (YARN-1330) Fair Scheduler: defaultQueueSchedulingPolicy does not take effect

2013-11-05 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reopened YARN-1330: -- It looks like this can lead to NPEs in the Fair Scheduler during certain initialization conditions. Will

[jira] [Resolved] (YARN-832) Update Resource javadoc to clarify units for memory

2013-11-05 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved YARN-832. - Resolution: Duplicate This was fixed in YARN-976 Update Resource javadoc to clarify units for memory

[jira] [Commented] (YARN-1388) fair share do not display info in the scheduler page

2013-11-04 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13812975#comment-13812975 ] Sandy Ryza commented on YARN-1388: -- +1 fair share do not display info in the scheduler

[jira] [Commented] (YARN-445) Ability to signal containers

2013-11-04 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13813463#comment-13813463 ] Sandy Ryza commented on YARN-445: - In 0.21, when a task was going to be killed due to

[jira] [Commented] (YARN-445) Ability to signal containers

2013-11-04 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13813464#comment-13813464 ] Sandy Ryza commented on YARN-445: - To expand on that, it would be nice not to require

[jira] [Commented] (YARN-445) Ability to signal containers

2013-11-04 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13813470#comment-13813470 ] Sandy Ryza commented on YARN-445: - Very true Ability to signal containers

[jira] [Commented] (YARN-445) Ability to signal containers

2013-11-04 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13813471#comment-13813471 ] Sandy Ryza commented on YARN-445: - Oops didn't realize that that feature was the original

[jira] [Commented] (YARN-1323) Set HTTPS webapp address along with other RPC addresses

2013-11-04 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13813529#comment-13813529 ] Sandy Ryza commented on YARN-1323: -- +1 Set HTTPS webapp address along with other RPC

[jira] [Updated] (YARN-1323) Set HTTPS webapp address along with other RPC addresses in HAUtil

2013-11-04 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1323: - Summary: Set HTTPS webapp address along with other RPC addresses in HAUtil (was: Set HTTPS webapp

[jira] [Updated] (YARN-1388) Fair Scheduler page always displays blank fair share

2013-11-04 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1388: - Summary: Fair Scheduler page always displays blank fair share (was: fair share do not display info in

[jira] [Commented] (YARN-1388) Fair Scheduler page always displays blank fair share

2013-11-04 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13813566#comment-13813566 ] Sandy Ryza commented on YARN-1388: -- I just committed this. THanks [~liangly]! Fair

[jira] [Commented] (YARN-786) Expose application resource usage in RM REST API

2013-11-01 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1388#comment-1388 ] Sandy Ryza commented on YARN-786: - Committed this to trunk and branch-2. Expose

[jira] [Commented] (YARN-1383) Remove node updates from the Fair Scheduler event log

2013-11-01 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13811413#comment-13811413 ] Sandy Ryza commented on YARN-1383: -- Do you remember in what way the node updates were

[jira] [Updated] (YARN-786) Expose application resource usage in RM REST API

2013-10-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-786: Attachment: YARN-786-1.patch Expose application resource usage in RM REST API

[jira] [Commented] (YARN-786) Expose application resource usage in RM REST API

2013-10-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13810652#comment-13810652 ] Sandy Ryza commented on YARN-786: - Uploaded a new patch with updated documentation. Expose

[jira] [Updated] (YARN-786) Expose application resource usage in RM REST API

2013-10-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-786: Attachment: YARN-786-2.patch Expose application resource usage in RM REST API

[jira] [Created] (YARN-1383) Remove node updates from the Fair Scheduler event log

2013-10-31 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1383: Summary: Remove node updates from the Fair Scheduler event log Key: YARN-1383 URL: https://issues.apache.org/jira/browse/YARN-1383 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-1383) Remove node updates from the Fair Scheduler event log

2013-10-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1383: - Attachment: YARN-1383.patch Remove node updates from the Fair Scheduler event log

[jira] [Commented] (YARN-546) mapred.fairscheduler.eventlog.enabled removed from Hadoop 2.0

2013-10-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13810828#comment-13810828 ] Sandy Ryza commented on YARN-546: - I think the issue still exists. Just filed YARN-1383 to

[jira] [Updated] (YARN-1306) Clean up hadoop-sls sample-conf according to YARN-1228

2013-10-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1306: - Hadoop Flags: Reviewed Clean up hadoop-sls sample-conf according to YARN-1228

[jira] [Commented] (YARN-1290) Let continuous scheduling achieve more balanced task assignment

2013-10-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13809678#comment-13809678 ] Sandy Ryza commented on YARN-1290: -- [~ywskycn], the current patch no longer applies.

[jira] [Commented] (YARN-786) Expose application resource usage in RM REST API

2013-10-29 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13808327#comment-13808327 ] Sandy Ryza commented on YARN-786: - The patch includes changes that make fetching these

[jira] [Commented] (YARN-1109) Consider throttling or demoting NodeManager Sending out status for container logs

2013-10-28 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13806587#comment-13806587 ] Sandy Ryza commented on YARN-1109: -- Thanks for working on this [~haosd...@gmail.com]. As

[jira] [Commented] (YARN-1109) Consider throttling or demoting NodeManager Sending out status for container logs

2013-10-28 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13806634#comment-13806634 ] Sandy Ryza commented on YARN-1109: -- One tiny nitpick: {code} + if

[jira] [Commented] (YARN-1109) Consider throttling or demoting NodeManager Sending out status for container logs

2013-10-28 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13806936#comment-13806936 ] Sandy Ryza commented on YARN-1109: -- Will commit this later today Consider throttling or

[jira] [Updated] (YARN-1109) Demote NodeManager Sending out status for container logs to debug

2013-10-28 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1109: - Summary: Demote NodeManager Sending out status for container logs to debug (was: Consider throttling or

<    1   2   3   4   5   6   7   8   9   10   >