[ https://issues.apache.org/jira/browse/YARN-10335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149843#comment-17149843 ]
Bibin Chundatt edited comment on YARN-10335 at 7/2/20, 4:45 AM: ---------------------------------------------------------------- Thank you for showing interest in the JIRA [~cyrusjackson25] Adding what i have in mind about the health detail. Node manager has node health service which returns a boolean value .Sends UNHEALTHY if the node health script return error / If we don't have any healthy local directories. We will introduce field/fields which returns detailed node health value about the node along with the NodeHealthStatus. Example: {quote} message NodeHealthStatusProto { optional bool isHealthy = 1; optional string nodeHealthDescription = 2; optional string exceptionString = 3; optional NodeHealthDetail nodehealthDetail=4; optional StringIntMapProto nodeHealthdetail=5; } message StringStringMapProto { optional string key = 1; optional int32 value = 2; } keys could be - overall , ssd, non ssd, etc.. {quote} Also make the NodeHealthService pluggable to support custom implementations of NodeHealthServices. was (Author: bibinchundatt): Thank you for showing interest in the JIRA [~cyrusjackson25] Adding the thought what i have in mind about the health value. Node manager has node health service which returns a boolean value . Sends UNHEALTHY if the node health script return error / If we don't have any healthy local directories. We want to introduce field/fields which returns detailed node health value about the node along with the NodeHealthStatus. Example: {quote} message NodeHealthStatusProto { optional bool isHealthy = 1; optional string nodeHealthDescription = 2; optional string exceptionString = 3; optional NodeHealthDetail nodehealthDetail=4; optional StringIntMapProto nodeHealthdetail=5; } message StringStringMapProto { optional string key = 1; optional int32 value = 2; } keys could be - overall , ssd, non ssd, etc.. {quote} Also make the NodeHealthService pluggable to support custom implementations of NodeHealthServices. > Improve scheduling of containers based on node health > ----------------------------------------------------- > > Key: YARN-10335 > URL: https://issues.apache.org/jira/browse/YARN-10335 > Project: Hadoop YARN > Issue Type: Improvement > Reporter: Bibin Chundatt > Assignee: Cyrus Jackson > Priority: Major > > YARN-7494 supports providing interface to choose nodeset for scheduler > allocation. > We could leverage the same to support allocation of containers based on node > health value send from nodemanagers -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org