[jira] [Commented] (YARN-4206) Add life time value in Application report and web UI
[ https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15552580#comment-15552580 ] Gour Saha commented on YARN-4206: - It will be very helpful from an end-user perspective to provide the *remaining-timeouts* of the application in the report. For example, _remaining-lifetime_ of an application will let the app-owner understand that he/she needs to extend the lifetime because the initial estimate of completing a task was not accurate. Note, timeouts update is going to supported as per YARN-5611. It might not be easy or straightforward to calculate the remaining-timeouts for all ApplicationTimeoutTypes (we now support multiple timeouts). However we should try to provide them for whichever ones we can. The reason I am adding this note is because, we should not discard the idea of providing the remaining-timeouts, just because remaining-timeout for one of the _ApplicationTimeoutType_ cannot be calculated or does not makes sense. > Add life time value in Application report and web UI > > > Key: YARN-4206 > URL: https://issues.apache.org/jira/browse/YARN-4206 > Project: Hadoop YARN > Issue Type: Sub-task > Components: scheduler >Reporter: nijel >Assignee: nijel > -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-4206) Add life time value in Application report and web UI
[ https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15653125#comment-15653125 ] Rohith Sharma K S commented on YARN-4206: - Thanks [~gsaha] for bringing out point remaining time for an application. I think application-report should contains absoluteTimeout value i.e when it gets expired. To the client, there could be new API {{ApplicationClientProtocol#getApplicationRemainingTime(ApplicationId)}} which gets remaining timeout in seconds. Thoughts? [~sunilg] [~jianhe] [~vinodkv] > Add life time value in Application report and web UI > > > Key: YARN-4206 > URL: https://issues.apache.org/jira/browse/YARN-4206 > Project: Hadoop YARN > Issue Type: Sub-task > Components: scheduler >Reporter: nijel >Assignee: nijel > -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-4206) Add life time value in Application report and web UI
[ https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15655155#comment-15655155 ] Jian He commented on YARN-4206: --- The remaining time can be inferred from the absolute timeout value ? If so, I don't think we need an additional API in ApplicationClientProtocol to get that. > Add life time value in Application report and web UI > > > Key: YARN-4206 > URL: https://issues.apache.org/jira/browse/YARN-4206 > Project: Hadoop YARN > Issue Type: Sub-task > Components: scheduler >Reporter: nijel >Assignee: nijel > -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-4206) Add life time value in Application report and web UI
[ https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15663383#comment-15663383 ] Rohith Sharma K S commented on YARN-4206: - bq. I don't think we need an additional API in ApplicationClientProtocol to get that. Thats true. We do not really require new client API. Additionally If I look at the user use cases, user would require both absolute time and remaining time. Say if timeout is less than a day or half a day, then remaining timeout would be sufficient. If timeout is 3-4 days later, user might interested in knowing which day it will get time out. So, How about new object ApplicationTimeout which gives both absolute-time and remaining-time for given ApplicationTimeoutType? The ApplicationReport would consists of Map. Thoughts? > Add life time value in Application report and web UI > > > Key: YARN-4206 > URL: https://issues.apache.org/jira/browse/YARN-4206 > Project: Hadoop YARN > Issue Type: Sub-task > Components: scheduler >Reporter: nijel >Assignee: nijel > -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-4206) Add life time value in Application report and web UI
[ https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15664437#comment-15664437 ] Gour Saha commented on YARN-4206: - Isn't absolute timeout going to be inaccurate? Given that we know the remaining timeout of an application, what we don't know is that going forward will it be pre-empted or not. If it is, then the absolute value will move further down? Is my understanding incorrect? > Add life time value in Application report and web UI > > > Key: YARN-4206 > URL: https://issues.apache.org/jira/browse/YARN-4206 > Project: Hadoop YARN > Issue Type: Sub-task > Components: scheduler >Reporter: nijel >Assignee: nijel > -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-4206) Add life time value in Application report and web UI
[ https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15664479#comment-15664479 ] Rohith Sharma K S commented on YARN-4206: - bq. Isn't absolute timeout going to be inaccurate? No, It will be fixed time. Lets say, I have submitted application with 10seconds timeout. Assume job submitted time is 10:10:10 PM. So absolute time for application to get timed out is 10:10:20. After 3 seconds, if user request for app-report, then both 10:10:20 PM as absolute time and 7 secs as remaining time could be sent. Absolute time never changes, but remaining time changes on each user request. > Add life time value in Application report and web UI > > > Key: YARN-4206 > URL: https://issues.apache.org/jira/browse/YARN-4206 > Project: Hadoop YARN > Issue Type: Sub-task > Components: scheduler >Reporter: nijel >Assignee: nijel > -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-4206) Add life time value in Application report and web UI
[ https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15664495#comment-15664495 ] Gour Saha commented on YARN-4206: - What happens when the app gets pre-empted at 10:10:15 for 20 secs? > Add life time value in Application report and web UI > > > Key: YARN-4206 > URL: https://issues.apache.org/jira/browse/YARN-4206 > Project: Hadoop YARN > Issue Type: Sub-task > Components: scheduler >Reporter: nijel >Assignee: nijel > -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-4206) Add life time value in Application report and web UI
[ https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15664521#comment-15664521 ] Rohith Sharma K S commented on YARN-4206: - Thats a good question:-) For the applications which are completed or applications which are not enabled with timeout, report should have special value i.e -1 which indicates either application is completed or timeout not enabled. In your case, timeout value will be set to -1 which indicates application is in completing states. > Add life time value in Application report and web UI > > > Key: YARN-4206 > URL: https://issues.apache.org/jira/browse/YARN-4206 > Project: Hadoop YARN > Issue Type: Sub-task > Components: scheduler >Reporter: nijel >Assignee: nijel > -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-4206) Add life time value in Application report and web UI
[ https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15664537#comment-15664537 ] Gour Saha commented on YARN-4206: - When the app is back into RUNNING state at 10:10:35 what will the value of remaining timeout and absolute timeout be? > Add life time value in Application report and web UI > > > Key: YARN-4206 > URL: https://issues.apache.org/jira/browse/YARN-4206 > Project: Hadoop YARN > Issue Type: Sub-task > Components: scheduler >Reporter: nijel >Assignee: nijel > -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-4206) Add life time value in Application report and web UI
[ https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15664560#comment-15664560 ] Rohith Sharma K S commented on YARN-4206: - ahh.. In LIFETIME monitoring, application attempt might get pre-empted, but lifetime timeout is considered from app submitted to app finished. So, in between any number of application-attempt can launch and preempt, its not an issue because app state is still running. Above mentioned(your comment) scenario need to think of for other types of timeout that we are planning to support. > Add life time value in Application report and web UI > > > Key: YARN-4206 > URL: https://issues.apache.org/jira/browse/YARN-4206 > Project: Hadoop YARN > Issue Type: Sub-task > Components: scheduler >Reporter: nijel >Assignee: nijel > -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-4206) Add life time value in Application report and web UI
[ https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670064#comment-15670064 ] Rohith Sharma K S commented on YARN-4206: - In this JIRA, lets handle ApplicationReport changes and CLI part. For the yarn web UI, it is required to change for both new and old UI, so lets handle it YARN-5650 separately. I will update JIRA summary to reflect the same. > Add life time value in Application report and web UI > > > Key: YARN-4206 > URL: https://issues.apache.org/jira/browse/YARN-4206 > Project: Hadoop YARN > Issue Type: Sub-task > Components: scheduler >Reporter: nijel >Assignee: nijel > -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org