[ 
https://issues.apache.org/jira/browse/OOZIE-1716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13932669#comment-13932669
 ] 

purshotam shah commented on OOZIE-1716:
---------------------------------------

[~rkanter] Are you working on this? I am working on OOZIE-1737, I can take this 
as well.

> Add a way to stream the logs for only the last x hours
> ------------------------------------------------------
>
>                 Key: OOZIE-1716
>                 URL: https://issues.apache.org/jira/browse/OOZIE-1716
>             Project: Oozie
>          Issue Type: New Feature
>    Affects Versions: trunk
>            Reporter: Robert Kanter
>            Assignee: Robert Kanter
>
> When a user has a busy cluster and long running coordinator jobs, streaming 
> the logs can be really slow.  In this situation, the user is typically only 
> interested in the latest logs and doesn't care about logs from a while ago.  
> So, we can speed this up by adding a parameter or something to the log 
> streaming API to only fetch the logs from the last x hours.  The log files 
> roll over every hour, so this should be pretty straightforward.  We can also 
> prepend a message to the logs streamed back mentioning that only the last x 
> hours of logs are included.  The existing way of getting all of the logs 
> should remain unaffected and still work.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to