[jira] [Commented] (YARN-4206) Add life time value in Application report and web UI

2016-10-06 Thread Gour Saha (JIRA) 

[ 
https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15552580#comment-15552580
 ] 

Gour Saha commented on YARN-4206:
-

It will be very helpful from an end-user perspective to provide the 
*remaining-timeouts* of the application in the report. For example, 
_remaining-lifetime_ of an application will let the app-owner understand that 
he/she needs to extend the lifetime because the initial estimate of completing 
a task was not accurate. Note, timeouts update is going to supported as per 
YARN-5611.

It might not be easy or straightforward to calculate the remaining-timeouts for 
all ApplicationTimeoutTypes (we now support multiple timeouts). However we 
should try to provide them for whichever ones we can. The reason I am adding 
this note is because, we should not discard the idea of providing the 
remaining-timeouts, just because remaining-timeout for one of the 
_ApplicationTimeoutType_ cannot be calculated or does not makes sense.


> Add life time value in Application report and web UI
> 
>
> Key: YARN-4206
> URL: https://issues.apache.org/jira/browse/YARN-4206
> Project: Hadoop YARN
>  Issue Type: Sub-task
>  Components: scheduler
>Reporter: nijel
>Assignee: nijel
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Commented] (YARN-4206) Add life time value in Application report and web UI

2016-11-09 Thread Rohith Sharma K S (JIRA) 

[ 
https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15653125#comment-15653125
 ] 

Rohith Sharma K S commented on YARN-4206:
-

Thanks [~gsaha] for bringing out point remaining time for an application. I 
think application-report should contains absoluteTimeout value i.e when it gets 
expired.  To the client, there could be new API 
{{ApplicationClientProtocol#getApplicationRemainingTime(ApplicationId)}} which 
gets remaining timeout in seconds. Thoughts? [~sunilg] [~jianhe] [~vinodkv] 

> Add life time value in Application report and web UI
> 
>
> Key: YARN-4206
> URL: https://issues.apache.org/jira/browse/YARN-4206
> Project: Hadoop YARN
>  Issue Type: Sub-task
>  Components: scheduler
>Reporter: nijel
>Assignee: nijel
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Commented] (YARN-4206) Add life time value in Application report and web UI

2016-11-10 Thread Jian He (JIRA) 

[ 
https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15655155#comment-15655155
 ] 

Jian He commented on YARN-4206:
---

The remaining time can be inferred from the absolute timeout value ? If so,  I 
don't think we need an additional API in ApplicationClientProtocol to get that.

> Add life time value in Application report and web UI
> 
>
> Key: YARN-4206
> URL: https://issues.apache.org/jira/browse/YARN-4206
> Project: Hadoop YARN
>  Issue Type: Sub-task
>  Components: scheduler
>Reporter: nijel
>Assignee: nijel
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Commented] (YARN-4206) Add life time value in Application report and web UI

2016-11-14 Thread Rohith Sharma K S (JIRA) 

[ 
https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15663383#comment-15663383
 ] 

Rohith Sharma K S commented on YARN-4206:
-

bq. I don't think we need an additional API in ApplicationClientProtocol to get 
that.
Thats true. We do not really require new client API. 

Additionally If I look at the user use cases, user would require both absolute 
time and remaining time. Say if timeout is less than a day or half a day, then 
remaining timeout would be sufficient. If timeout is 3-4 days later, user might 
interested in knowing which day it will get time out. So, How about new object 
ApplicationTimeout which gives both absolute-time and remaining-time for given 
ApplicationTimeoutType? The ApplicationReport would consists of 
Map. Thoughts?

> Add life time value in Application report and web UI
> 
>
> Key: YARN-4206
> URL: https://issues.apache.org/jira/browse/YARN-4206
> Project: Hadoop YARN
>  Issue Type: Sub-task
>  Components: scheduler
>Reporter: nijel
>Assignee: nijel
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Commented] (YARN-4206) Add life time value in Application report and web UI

2016-11-14 Thread Gour Saha (JIRA) 

[ 
https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15664437#comment-15664437
 ] 

Gour Saha commented on YARN-4206:
-

Isn't absolute timeout going to be inaccurate? Given that we know the remaining 
timeout of an application, what we don't know is that going forward will it be 
pre-empted or not. If it is, then the absolute value will move further down? Is 
my understanding incorrect?

> Add life time value in Application report and web UI
> 
>
> Key: YARN-4206
> URL: https://issues.apache.org/jira/browse/YARN-4206
> Project: Hadoop YARN
>  Issue Type: Sub-task
>  Components: scheduler
>Reporter: nijel
>Assignee: nijel
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Commented] (YARN-4206) Add life time value in Application report and web UI

2016-11-14 Thread Rohith Sharma K S (JIRA) 

[ 
https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15664479#comment-15664479
 ] 

Rohith Sharma K S commented on YARN-4206:
-

bq. Isn't absolute timeout going to be inaccurate?
No, It will be fixed time. Lets say, I have submitted application with 
10seconds timeout. Assume job submitted time is 10:10:10 PM. So absolute time 
for application to get timed out is 10:10:20. After 3 seconds, if user request 
for app-report, then both 10:10:20 PM as absolute time and 7 secs as remaining 
time could be sent. Absolute time never changes, but remaining time changes on 
each user request. 

> Add life time value in Application report and web UI
> 
>
> Key: YARN-4206
> URL: https://issues.apache.org/jira/browse/YARN-4206
> Project: Hadoop YARN
>  Issue Type: Sub-task
>  Components: scheduler
>Reporter: nijel
>Assignee: nijel
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Commented] (YARN-4206) Add life time value in Application report and web UI

2016-11-14 Thread Gour Saha (JIRA) 

[ 
https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15664495#comment-15664495
 ] 

Gour Saha commented on YARN-4206:
-

What happens when the app gets pre-empted at 10:10:15 for 20 secs?

> Add life time value in Application report and web UI
> 
>
> Key: YARN-4206
> URL: https://issues.apache.org/jira/browse/YARN-4206
> Project: Hadoop YARN
>  Issue Type: Sub-task
>  Components: scheduler
>Reporter: nijel
>Assignee: nijel
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Commented] (YARN-4206) Add life time value in Application report and web UI

2016-11-14 Thread Rohith Sharma K S (JIRA) 

[ 
https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15664521#comment-15664521
 ] 

Rohith Sharma K S commented on YARN-4206:
-

Thats a good question:-) For the applications which are completed or 
applications which are not enabled with timeout, report should have special 
value i.e -1 which indicates either application is completed or timeout not 
enabled. In your case, timeout value will be set to -1 which indicates 
application is  in completing states. 

> Add life time value in Application report and web UI
> 
>
> Key: YARN-4206
> URL: https://issues.apache.org/jira/browse/YARN-4206
> Project: Hadoop YARN
>  Issue Type: Sub-task
>  Components: scheduler
>Reporter: nijel
>Assignee: nijel
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Commented] (YARN-4206) Add life time value in Application report and web UI

2016-11-14 Thread Gour Saha (JIRA) 

[ 
https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15664537#comment-15664537
 ] 

Gour Saha commented on YARN-4206:
-

When the app is back into RUNNING state at 10:10:35 what will the value of 
remaining timeout and absolute timeout be?

> Add life time value in Application report and web UI
> 
>
> Key: YARN-4206
> URL: https://issues.apache.org/jira/browse/YARN-4206
> Project: Hadoop YARN
>  Issue Type: Sub-task
>  Components: scheduler
>Reporter: nijel
>Assignee: nijel
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Commented] (YARN-4206) Add life time value in Application report and web UI

2016-11-14 Thread Rohith Sharma K S (JIRA) 

[ 
https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15664560#comment-15664560
 ] 

Rohith Sharma K S commented on YARN-4206:
-

ahh.. In LIFETIME monitoring, application attempt might get pre-empted, but 
lifetime timeout is considered from app submitted to app finished. So, in 
between any number of application-attempt can launch and preempt, its not an 
issue because app state is still running. Above mentioned(your comment) 
scenario need to think of for other types of timeout that we are planning to 
support. 

> Add life time value in Application report and web UI
> 
>
> Key: YARN-4206
> URL: https://issues.apache.org/jira/browse/YARN-4206
> Project: Hadoop YARN
>  Issue Type: Sub-task
>  Components: scheduler
>Reporter: nijel
>Assignee: nijel
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Commented] (YARN-4206) Add life time value in Application report and web UI

2016-11-16 Thread Rohith Sharma K S (JIRA) 

[ 
https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15670064#comment-15670064
 ] 

Rohith Sharma K S commented on YARN-4206:
-

In this JIRA, lets handle ApplicationReport changes and CLI part. For the yarn 
web UI, it is required to change for both new and old UI, so lets handle it 
YARN-5650 separately. I will update JIRA summary to reflect the same. 

> Add life time value in Application report and web UI
> 
>
> Key: YARN-4206
> URL: https://issues.apache.org/jira/browse/YARN-4206
> Project: Hadoop YARN
>  Issue Type: Sub-task
>  Components: scheduler
>Reporter: nijel
>Assignee: nijel
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org