[jira] [Commented] (YARN-1923) Make FairScheduler resource ratio calculations terminate faster

[ https://issues.apache.org/jira/browse/YARN-1923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13967229#comment-13967229 ] Sandy Ryza commented on YARN-1923: -- +1 Make FairScheduler resource ratio calculations

[jira] [Commented] (YARN-1931) Private API change in YARN-1824 in 2.4 broke compatibility with previous releases

[ https://issues.apache.org/jira/browse/YARN-1931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13967322#comment-13967322 ] Sandy Ryza commented on YARN-1931: -- bq. Please don't do this. Two wrongs make a right.

[jira] [Commented] (YARN-1931) Private API change in YARN-1824 in 2.4 broke compatibility with previous releases

[ https://issues.apache.org/jira/browse/YARN-1931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13967328#comment-13967328 ] Sandy Ryza commented on YARN-1931: -- To be clear, when I say these APIs, I don't mean all

[jira] [Commented] (YARN-1921) Allow to override queue prefix, where new queues created

[ https://issues.apache.org/jira/browse/YARN-1921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13965695#comment-13965695 ] Sandy Ryza commented on YARN-1921: -- Hi [~octo47], thanks for the patch, this is a feature

[jira] [Commented] (YARN-1864) Fair Scheduler Dynamic Hierarchical User Queues

[ https://issues.apache.org/jira/browse/YARN-1864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13965792#comment-13965792 ] Sandy Ryza commented on YARN-1864: -- [~octo47], a design goal is to be able to have

[jira] [Commented] (YARN-1923) Make FairScheduler resource ratio calculations terminate faster

[ https://issues.apache.org/jira/browse/YARN-1923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13965919#comment-13965919 ] Sandy Ryza commented on YARN-1923: -- A couple nits. Otherwise, LGTM. There's a false

[jira] [Commented] (YARN-1913) With Fair Scheduler, cluster can logjam when all resources are consumed by AMs

[ https://issues.apache.org/jira/browse/YARN-1913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963164#comment-13963164 ] Sandy Ryza commented on YARN-1913: -- This is a Fair Scheduler issue. We need to add an

[jira] [Updated] (YARN-1913) With Fair Scheduler, cluster can logjam when all resources are consumed by AMs

[ https://issues.apache.org/jira/browse/YARN-1913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1913: - Summary: With Fair Scheduler, cluster can logjam when all resources are consumed by AMs (was: Cluster

[jira] [Commented] (YARN-596) In fair scheduler, intra-application container priorities affect inter-application preemption decisions

[ https://issues.apache.org/jira/browse/YARN-596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963271#comment-13963271 ] Sandy Ryza commented on YARN-596: - bq. Sandy Ryza, so here the ''safe'' means usage.memory

[jira] [Commented] (YARN-1909) FairScheduler isStartvedForFairShare does not work when fairShare == 1

[ https://issues.apache.org/jira/browse/YARN-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13962349#comment-13962349 ] Sandy Ryza commented on YARN-1909: -- This looks like an MR1 issue, so moving it to

[jira] [Commented] (YARN-1899) Capacity Scheduler Usage History

[ https://issues.apache.org/jira/browse/YARN-1899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13957854#comment-13957854 ] Sandy Ryza commented on YARN-1899: -- This may be a duplicate of, or related to YARN-415,

[jira] [Commented] (YARN-1889) avoid creating new objects on each fair scheduler call to AppSchedulable comparator

[ https://issues.apache.org/jira/browse/YARN-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13955762#comment-13955762 ] Sandy Ryza commented on YARN-1889: -- +1 avoid creating new objects on each fair scheduler

[jira] [Updated] (YARN-1889) avoid creating new objects on each fair scheduler call to AppSchedulable comparator

[ https://issues.apache.org/jira/browse/YARN-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1889: - Assignee: Hong Zhiguo avoid creating new objects on each fair scheduler call to AppSchedulable

[jira] [Updated] (YARN-1889) avoid creating new objects on each fair scheduler call to AppSchedulable comparator

[ https://issues.apache.org/jira/browse/YARN-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1889: - Description: In fair scheduler, in each scheduling attempt, a full sort is performed on List of

[jira] [Commented] (YARN-596) In fair scheduler, intra-application container priorities affect inter-application preemption decisions

[ https://issues.apache.org/jira/browse/YARN-596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13955960#comment-13955960 ] Sandy Ryza commented on YARN-596: - Thanks. The patch is looking almost done. I like that

[jira] [Commented] (YARN-596) In fair scheduler, intra-application container priorities affect inter-application preemption decisions

[ https://issues.apache.org/jira/browse/YARN-596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13951040#comment-13951040 ] Sandy Ryza commented on YARN-596: - Cloning the full queue/app tree makes preemption O(apps)

[jira] [Commented] (YARN-1889) avoid creating new objects on each fair scheduler call to AppSchedulable comparator

[ https://issues.apache.org/jira/browse/YARN-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13951002#comment-13951002 ] Sandy Ryza commented on YARN-1889: -- Another nit: Priority.newInstance should be used

[jira] [Commented] (YARN-1889) avoid creating new objects on each fair scheduler call to AppSchedulable comparator

[ https://issues.apache.org/jira/browse/YARN-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13950999#comment-13950999 ] Sandy Ryza commented on YARN-1889: -- When you say gc pressure, which is going down? The

[jira] [Commented] (YARN-1864) Fair Scheduler Dynamic Hierarchical User Queues

[ https://issues.apache.org/jira/browse/YARN-1864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13951458#comment-13951458 ] Sandy Ryza commented on YARN-1864: -- With your proposal, would it be possible to choose

[jira] [Commented] (YARN-1864) Fair Scheduler Dynamic Hierarchical User Queues

[ https://issues.apache.org/jira/browse/YARN-1864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13948162#comment-13948162 ] Sandy Ryza commented on YARN-1864: -- Hey Ashwin, Thanks for working on this. This is

[jira] [Commented] (YARN-1612) Change Fair Scheduler to not disable delay scheduling by default

[ https://issues.apache.org/jira/browse/YARN-1612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13948170#comment-13948170 ] Sandy Ryza commented on YARN-1612: -- Hi [~airbots], That first observation is correct.

[jira] [Commented] (YARN-596) In fair scheduler, intra-application container priorities affect inter-application preemption decisions

[ https://issues.apache.org/jira/browse/YARN-596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13948574#comment-13948574 ] Sandy Ryza commented on YARN-596: - Thanks for working on this, Wei. {code} +// Collect

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13934189#comment-13934189 ] Sandy Ryza commented on YARN-796: - Makes a lot of sense to me. One nit: bq. Each scheduler

[jira] [Commented] (YARN-1064) YarnConfiguration scheduler configuration constants are not consistent

[ https://issues.apache.org/jira/browse/YARN-1064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13930438#comment-13930438 ] Sandy Ryza commented on YARN-1064: -- I think we should just change this to Won't Fix. It

[jira] [Commented] (YARN-1815) RM should recover only Managed AMs

[ https://issues.apache.org/jira/browse/YARN-1815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13931015#comment-13931015 ] Sandy Ryza commented on YARN-1815: -- +1 RM should recover only Managed AMs

[jira] [Commented] (YARN-1821) NPE on registerNodeManager if the request has containers for UnmanagedAMs

[ https://issues.apache.org/jira/browse/YARN-1821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13931027#comment-13931027 ] Sandy Ryza commented on YARN-1821: -- +1 NPE on registerNodeManager if the request has

[jira] [Commented] (YARN-1774) FS: Submitting to non-leaf queue throws NPE

[ https://issues.apache.org/jira/browse/YARN-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13924267#comment-13924267 ] Sandy Ryza commented on YARN-1774: -- +1 FS: Submitting to non-leaf queue throws NPE

[jira] [Updated] (YARN-1790) Fair Scheduler UI not showing apps table

[ https://issues.apache.org/jira/browse/YARN-1790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1790: - Summary: Fair Scheduler UI not showing apps table (was: FairSchedule UI not showing apps table) Fair

[jira] [Commented] (YARN-1790) FairSchedule UI not showing apps table

[ https://issues.apache.org/jira/browse/YARN-1790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13923306#comment-13923306 ] Sandy Ryza commented on YARN-1790: -- +1 FairSchedule UI not showing apps table

[jira] [Commented] (YARN-1771) many getFileStatus calls made from node manager for localizing a public distributed cache resource

[ https://issues.apache.org/jira/browse/YARN-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13916516#comment-13916516 ] Sandy Ryza commented on YARN-1771: -- MAPREDUCE-4907 fixed a similar issue (redundant

[jira] [Created] (YARN-1772) Fair Scheduler documentation should indicate that admin ACLs also give submit permissions

Sandy Ryza created YARN-1772: Summary: Fair Scheduler documentation should indicate that admin ACLs also give submit permissions Key: YARN-1772 URL: https://issues.apache.org/jira/browse/YARN-1772

[jira] [Commented] (YARN-1771) many getFileStatus calls made from node manager for localizing a public distributed cache resource

[ https://issues.apache.org/jira/browse/YARN-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1391#comment-1391 ] Sandy Ryza commented on YARN-1771: -- bq. Do you worry about the stats for directories

[jira] [Commented] (YARN-1760) TestRMAdminService assumes CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13916936#comment-13916936 ] Sandy Ryza commented on YARN-1760: -- +1 TestRMAdminService assumes CapacityScheduler

[jira] [Commented] (YARN-1528) ZKRMStateStore and EmbeddedElector should allow setting ZK auth information

[ https://issues.apache.org/jira/browse/YARN-1528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13915467#comment-13915467 ] Sandy Ryza commented on YARN-1528: -- Can those helpers just go in ZKUtil? LGTM otherwise.

[jira] [Commented] (YARN-1760) TestRMAdminService assumes the use of CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13911797#comment-13911797 ] Sandy Ryza commented on YARN-1760: -- +1 TestRMAdminService assumes the use of

[jira] [Commented] (YARN-1330) Fair Scheduler: defaultQueueSchedulingPolicy does not take effect

[ https://issues.apache.org/jira/browse/YARN-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13910789#comment-13910789 ] Sandy Ryza commented on YARN-1330: -- The above issue was fixed by the

[jira] [Resolved] (YARN-1330) Fair Scheduler: defaultQueueSchedulingPolicy does not take effect

[ https://issues.apache.org/jira/browse/YARN-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved YARN-1330. -- Resolution: Fixed Fix Version/s: (was: 2.4.0) 2.3.0 Fair Scheduler:

[jira] [Commented] (YARN-1760) TestRMAdminService assumes the use of CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13910944#comment-13910944 ] Sandy Ryza commented on YARN-1760: -- A couple nits: * The same configuration is used for

[jira] [Commented] (YARN-1760) TestRMAdminService assumes the use of CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13911038#comment-13911038 ] Sandy Ryza commented on YARN-1760: -- Thanks. One more thing:

[jira] [Commented] (YARN-1760) TestRMAdminService assumes the use of CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13911094#comment-13911094 ] Sandy Ryza commented on YARN-1760: -- The goal here is just to make the use of the Capacity

[jira] [Commented] (YARN-1760) TestRMAdminService assumes the use of CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13911102#comment-13911102 ] Sandy Ryza commented on YARN-1760: -- I assume that YARN-1679 will have

[jira] [Created] (YARN-1745) Add yarn.dispatcher.exit-on-error to yarn-default.xml

Sandy Ryza created YARN-1745: Summary: Add yarn.dispatcher.exit-on-error to yarn-default.xml Key: YARN-1745 URL: https://issues.apache.org/jira/browse/YARN-1745 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-1171) Add default queue properties to Fair Scheduler documentation

[ https://issues.apache.org/jira/browse/YARN-1171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13905831#comment-13905831 ] Sandy Ryza commented on YARN-1171: -- +1, LGTM. Thanks Naren! Add default queue

[jira] [Updated] (YARN-1171) Add default queue properties to Fair Scheduler documentation

[ https://issues.apache.org/jira/browse/YARN-1171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1171: - Assignee: Naren Koneru (was: Karthik Kambatla) Add default queue properties to Fair Scheduler

[jira] [Updated] (YARN-1171) Add default queue properties to Fair Scheduler documentation

[ https://issues.apache.org/jira/browse/YARN-1171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1171: - Fix Version/s: (was: 2.5.0) 2.4.0 Add default queue properties to Fair Scheduler

[jira] [Commented] (YARN-1171) Add default queue properties to Fair Scheduler documentation

[ https://issues.apache.org/jira/browse/YARN-1171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13906128#comment-13906128 ] Sandy Ryza commented on YARN-1171: -- and branch-2.4 Add default queue properties to Fair

[jira] [Created] (YARN-1736) In Fair Scheduler, AppSchedulable.assignContainer Priority argument is redundant with ResourceRequest

Sandy Ryza created YARN-1736: Summary: In Fair Scheduler, AppSchedulable.assignContainer Priority argument is redundant with ResourceRequest Key: YARN-1736 URL: https://issues.apache.org/jira/browse/YARN-1736

[jira] [Updated] (YARN-1678) Fair scheduler gabs incessantly about reservations

[ https://issues.apache.org/jira/browse/YARN-1678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1678: - Attachment: YARN-1678-1.patch Fair scheduler gabs incessantly about reservations

[jira] [Updated] (YARN-1721) When moving app between queues in Fair Scheduler, grab lock on FSSchedulerApp

[ https://issues.apache.org/jira/browse/YARN-1721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1721: - Priority: Critical (was: Major) When moving app between queues in Fair Scheduler, grab lock on

[jira] [Commented] (YARN-1724) Race condition in Fair Scheduler when continuous scheduling is turned on

[ https://issues.apache.org/jira/browse/YARN-1724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13904321#comment-13904321 ] Sandy Ryza commented on YARN-1724: -- The rationale for adding the sort is in YARN-1290. Wei

[jira] [Updated] (YARN-1724) Race condition in Fair Scheduler when continuous scheduling is turned on

[ https://issues.apache.org/jira/browse/YARN-1724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1724: - Priority: Critical (was: Major) Race condition in Fair Scheduler when continuous scheduling is turned

[jira] [Updated] (YARN-1724) Race condition in Fair Scheduler when continuous scheduling is turned on

[ https://issues.apache.org/jira/browse/YARN-1724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1724: - Attachment: YARN-1724-1.patch Race condition in Fair Scheduler when continuous scheduling is turned on

[jira] [Updated] (YARN-1721) When moving app between queues in Fair Scheduler, grab lock on FSSchedulerApp

[ https://issues.apache.org/jira/browse/YARN-1721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1721: - Attachment: YARN-1721-1.patch When moving app between queues in Fair Scheduler, grab lock on

[jira] [Commented] (YARN-1721) When moving app between queues in Fair Scheduler, grab lock on FSSchedulerApp

[ https://issues.apache.org/jira/browse/YARN-1721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13902522#comment-13902522 ] Sandy Ryza commented on YARN-1721: -- Attached a new patch. Modified your suggested comment

[jira] [Commented] (YARN-1296) schedulerAllocateTimer is accessed without holding samplerLock in ResourceSchedulerWrapper

[ https://issues.apache.org/jira/browse/YARN-1296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13899578#comment-13899578 ] Sandy Ryza commented on YARN-1296: -- I'm not super familiar with this code, but [~ywskycn]

[jira] [Commented] (YARN-1692) ConcurrentModificationException in fair scheduler AppSchedulable

[ https://issues.apache.org/jira/browse/YARN-1692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13899718#comment-13899718 ] Sandy Ryza commented on YARN-1692: -- +1 ConcurrentModificationException in fair scheduler

[jira] [Created] (YARN-1721) When moving app between queues in Fair Scheduler, grab lock on FSSchedulerApp

Sandy Ryza created YARN-1721: Summary: When moving app between queues in Fair Scheduler, grab lock on FSSchedulerApp Key: YARN-1721 URL: https://issues.apache.org/jira/browse/YARN-1721 Project: Hadoop

[jira] [Commented] (YARN-1721) When moving app between queues in Fair Scheduler, grab lock on FSSchedulerApp

[ https://issues.apache.org/jira/browse/YARN-1721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13899729#comment-13899729 ] Sandy Ryza commented on YARN-1721: -- To avoid deadlocks, we'll need to make sure that if we

[jira] [Updated] (YARN-1721) When moving app between queues in Fair Scheduler, grab lock on FSSchedulerApp

[ https://issues.apache.org/jira/browse/YARN-1721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1721: - Attachment: YARN-1721.patch When moving app between queues in Fair Scheduler, grab lock on

[jira] [Commented] (YARN-1721) When moving app between queues in Fair Scheduler, grab lock on FSSchedulerApp

[ https://issues.apache.org/jira/browse/YARN-1721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13899809#comment-13899809 ] Sandy Ryza commented on YARN-1721: -- My above comment does not appear to be issue, as we

[jira] [Created] (YARN-1724) Race condition in Fair Scheduler when continuous scheduling is turned on

Sandy Ryza created YARN-1724: Summary: Race condition in Fair Scheduler when continuous scheduling is turned on Key: YARN-1724 URL: https://issues.apache.org/jira/browse/YARN-1724 Project: Hadoop YARN

[jira] [Updated] (YARN-1724) Race condition in Fair Scheduler when continuous scheduling is turned on

[ https://issues.apache.org/jira/browse/YARN-1724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1724: - Attachment: YARN-1724.patch Race condition in Fair Scheduler when continuous scheduling is turned on

[jira] [Updated] (YARN-1297) Miscellaneous Fair Scheduler speedups

[ https://issues.apache.org/jira/browse/YARN-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1297: - Attachment: YARN-1297-2.patch Miscellaneous Fair Scheduler speedups

[jira] [Commented] (YARN-1297) Miscellaneous Fair Scheduler speedups

[ https://issues.apache.org/jira/browse/YARN-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13899976#comment-13899976 ] Sandy Ryza commented on YARN-1297: -- Ran more rigorous benchmarks and the FairSharePolicy

[jira] [Commented] (YARN-1725) RM should provide an easier way for the app to reject a bad allocation

[ https://issues.apache.org/jira/browse/YARN-1725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1380#comment-1380 ] Sandy Ryza commented on YARN-1725: -- +1 to this. Can it be accomplished on the AMRMClient

[jira] [Created] (YARN-1718) Fix a couple isTerminals in Fair Scheduler queue placement rules

Sandy Ryza created YARN-1718: Summary: Fix a couple isTerminals in Fair Scheduler queue placement rules Key: YARN-1718 URL: https://issues.apache.org/jira/browse/YARN-1718 Project: Hadoop YARN

[jira] [Updated] (YARN-1718) Fix a couple isTerminals in Fair Scheduler queue placement rules

[ https://issues.apache.org/jira/browse/YARN-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1718: - Attachment: YARN-1718.patch Fix a couple isTerminals in Fair Scheduler queue placement rules

[jira] [Commented] (YARN-1495) Allow moving apps between queues

[ https://issues.apache.org/jira/browse/YARN-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13898568#comment-13898568 ] Sandy Ryza commented on YARN-1495: -- bq. From an API point of view, there should be a way

[jira] [Commented] (YARN-1641) ZK store should attempt a write periodically to ensure it is still Active

[ https://issues.apache.org/jira/browse/YARN-1641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13898633#comment-13898633 ] Sandy Ryza commented on YARN-1641: -- The added thread should be given a name. Otherwise,

[jira] [Commented] (YARN-1641) ZK store should attempt a write periodically to ensure it is still Active

[ https://issues.apache.org/jira/browse/YARN-1641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13898895#comment-13898895 ] Sandy Ryza commented on YARN-1641: -- +1 ZK store should attempt a write periodically to

[jira] [Commented] (YARN-1637) Implement a client library for java users to post entities+events

[ https://issues.apache.org/jira/browse/YARN-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13897013#comment-13897013 ] Sandy Ryza commented on YARN-1637: -- In other JIRAs you mean? That's fine with me, but can

[jira] [Commented] (YARN-1637) Implement a client library for java users to post entities+events

[ https://issues.apache.org/jira/browse/YARN-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13897024#comment-13897024 ] Sandy Ryza commented on YARN-1637: -- Thanks! Also, is there a JIRA for standardizing on

[jira] [Commented] (YARN-1495) Allow moving apps between queues

[ https://issues.apache.org/jira/browse/YARN-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13894826#comment-13894826 ] Sandy Ryza commented on YARN-1495: -- With the bulk of this implemented and tested, I'm

[jira] [Commented] (YARN-1495) Allow moving apps between queues

[ https://issues.apache.org/jira/browse/YARN-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13894908#comment-13894908 ] Sandy Ryza commented on YARN-1495: -- The changes for the Capacity Scheduler aren't yet

[jira] [Commented] (YARN-1495) Allow moving apps between queues

[ https://issues.apache.org/jira/browse/YARN-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13895112#comment-13895112 ] Sandy Ryza commented on YARN-1495: -- While I would argue that preemption is actually more

[jira] [Created] (YARN-1697) NodeManager reports negative running containers

Sandy Ryza created YARN-1697: Summary: NodeManager reports negative running containers Key: YARN-1697 URL: https://issues.apache.org/jira/browse/YARN-1697 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-1697) NodeManager reports negative running containers

[ https://issues.apache.org/jira/browse/YARN-1697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13895298#comment-13895298 ] Sandy Ryza commented on YARN-1697: -- Attaching a patch to fix the issue. Verified that the

[jira] [Updated] (YARN-1697) NodeManager reports negative running containers

[ https://issues.apache.org/jira/browse/YARN-1697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1697: - Attachment: YARN-1697.patch NodeManager reports negative running containers

[jira] [Commented] (YARN-1689) Resource Manager becomes unusable

[ https://issues.apache.org/jira/browse/YARN-1689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13893204#comment-13893204 ] Sandy Ryza commented on YARN-1689: -- +1, makes sense to me. Resource Manager becomes

[jira] [Commented] (YARN-1414) with Fair Scheduler reserved MB in WebUI is leaking when killing waiting jobs

[ https://issues.apache.org/jira/browse/YARN-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13893208#comment-13893208 ] Sandy Ryza commented on YARN-1414: -- The user string is not used to locate a leaf queue.

[jira] [Commented] (YARN-1689) Resource Manager becomes unusable

[ https://issues.apache.org/jira/browse/YARN-1689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13892736#comment-13892736 ] Sandy Ryza commented on YARN-1689: -- This looks related to MAPREDUCE-5719 Resource

[jira] [Commented] (YARN-1637) Implement a client library for java users to post entities+events

[ https://issues.apache.org/jira/browse/YARN-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13892755#comment-13892755 ] Sandy Ryza commented on YARN-1637: -- With regards to what Vinod said above, can we make

[jira] [Updated] (YARN-1499) Fair Scheduler changes for moving apps between queues

[ https://issues.apache.org/jira/browse/YARN-1499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1499: - Attachment: YARN-1499-2.patch Updated patch addresses Karthik's comments and adds some documentation to

[jira] [Updated] (YARN-1497) Expose moving apps between queues on the command line

[ https://issues.apache.org/jira/browse/YARN-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1497: - Attachment: YARN-1497-1.patch Expose moving apps between queues on the command line

[jira] [Commented] (YARN-1497) Expose moving apps between queues on the command line

[ https://issues.apache.org/jira/browse/YARN-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13891332#comment-13891332 ] Sandy Ryza commented on YARN-1497: -- NMClient failure is not realted. Uploaded patch to

[jira] [Commented] (YARN-1497) Expose moving apps between queues on the command line

[ https://issues.apache.org/jira/browse/YARN-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13891581#comment-13891581 ] Sandy Ryza commented on YARN-1497: -- The javadoc warnings appear to be unrelated Expose

[jira] [Commented] (YARN-1499) Fair Scheduler changes for moving apps between queues

[ https://issues.apache.org/jira/browse/YARN-1499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13891578#comment-13891578 ] Sandy Ryza commented on YARN-1499: -- The javadoc warnings appear to be unrelated Fair

[jira] [Updated] (YARN-1497) Expose moving apps between queues on the command line

[ https://issues.apache.org/jira/browse/YARN-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1497: - Attachment: YARN-1497.patch Expose moving apps between queues on the command line

[jira] [Updated] (YARN-1497) Expose moving apps between queues on the command line

[ https://issues.apache.org/jira/browse/YARN-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1497: - Attachment: YARN-1497.patch Expose moving apps between queues on the command line

[jira] [Commented] (YARN-1637) Implement a client library for java users to post entities+events

[ https://issues.apache.org/jira/browse/YARN-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13890172#comment-13890172 ] Sandy Ryza commented on YARN-1637: -- I'd like to take a quick look at this. Will do it

[jira] [Commented] (YARN-1637) Implement a client library for java users to post entities+events

[ https://issues.apache.org/jira/browse/YARN-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13890224#comment-13890224 ] Sandy Ryza commented on YARN-1637: -- What's the need for the PutErrors and Events classes?

[jira] [Commented] (YARN-1637) Implement a client library for java users to post entities+events

[ https://issues.apache.org/jira/browse/YARN-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13890254#comment-13890254 ] Sandy Ryza commented on YARN-1637: -- If that's the case, we should explain that in a

[jira] [Commented] (YARN-1637) Implement a client library for java users to post entities+events

[ https://issues.apache.org/jira/browse/YARN-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13890261#comment-13890261 ] Sandy Ryza commented on YARN-1637: -- bq. Like I mentioned in the design doc, ecosystem

[jira] [Updated] (YARN-1499) Fair Scheduler changes for moving apps between queues

[ https://issues.apache.org/jira/browse/YARN-1499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1499: - Attachment: YARN-1499-1.patch Fair Scheduler changes for moving apps between queues

[jira] [Updated] (YARN-1498) Common scheduler changes for moving apps between queues

[ https://issues.apache.org/jira/browse/YARN-1498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1498: - Attachment: YARN-1498-addendum.patch Common scheduler changes for moving apps between queues

[jira] [Commented] (YARN-1498) Common scheduler changes for moving apps between queues

[ https://issues.apache.org/jira/browse/YARN-1498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13888439#comment-13888439 ] Sandy Ryza commented on YARN-1498: -- Good catch. Attached addendum patch. Common

[jira] [Updated] (YARN-1499) Fair Scheduler changes for moving apps between queues

[ https://issues.apache.org/jira/browse/YARN-1499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1499: - Attachment: YARN-1499.patch Fair Scheduler changes for moving apps between queues

[jira] [Updated] (YARN-1504) RM changes for moving apps between queues

[ https://issues.apache.org/jira/browse/YARN-1504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1504: - Attachment: YARN-1504-1.patch RM changes for moving apps between queues

[jira] [Commented] (YARN-1504) RM changes for moving apps between queues

[ https://issues.apache.org/jira/browse/YARN-1504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13886921#comment-13886921 ] Sandy Ryza commented on YARN-1504: -- Attached a patch that addresses Karthik's comments.

[jira] [Commented] (YARN-1498) Common scheduler changes for moving apps between queues

[ https://issues.apache.org/jira/browse/YARN-1498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13887043#comment-13887043 ] Sandy Ryza commented on YARN-1498: -- bq. AppSchedulingInfo: Not sure I understand the

<    1   2   3   4   5   6   7   8   9   10   >