[
https://issues.apache.org/jira/browse/OOZIE-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17030593#comment-17030593
]
Junfan Zhang commented on OOZIE-2425:
-------------------------------------
[~asalamon74] In fact, this problem about {{LIFO}} still exists, and we may
need to rewrite the {{LIFO}} execution rule to support some catch-up tasks.
Solve the problem with the ideas [~rkanter] described
In addition, I think the coordinator does not support the minute-level tasks
very well. The materizalization is too slow. Do you have any good ideas? Maybe
we can do something together.
> LIFO executes action 1 and then does the LIFO behavior
> ------------------------------------------------------
>
> Key: OOZIE-2425
> URL: https://issues.apache.org/jira/browse/OOZIE-2425
> Project: Oozie
> Issue Type: Bug
> Components: coordinator
> Affects Versions: trunk
> Reporter: Robert Kanter
> Priority: Major
>
> When using LIFO execution order, Oozie should run the latest READY action
> first. This includes when you start your Coordinator in the past, and Oozie
> plays "catch-up". However, Oozie will materialize 12 actions (the default),
> but will do @1 and then do the LIFO behavior (i.e. @12, @11, etc). This is
> likely due to a race condition about when the other actions are
> materialized/READY vs when Oozie checks to run an action, as the actions are
> materialized in FIFO order.
> {noformat}
> ID Status Ext ID
> Err Code Created Nominal Time
> 0000113-151009113906602-oozie-oozi-C@1 SUCCEEDED
> 0000114-151009113906602-oozie-oozi-W - 2015-10-16 20:42 GMT
> 2015-10-15 11:30 GMT
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000113-151009113906602-oozie-oozi-C@2 READY -
> - 2015-10-16 20:42 GMT 2015-10-15 11:35 GMT
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000113-151009113906602-oozie-oozi-C@3 READY -
> - 2015-10-16 20:42 GMT 2015-10-15 11:40 GMT
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000113-151009113906602-oozie-oozi-C@4 READY -
> - 2015-10-16 20:42 GMT 2015-10-15 11:45 GMT
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000113-151009113906602-oozie-oozi-C@5 READY -
> - 2015-10-16 20:42 GMT 2015-10-15 11:50 GMT
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000113-151009113906602-oozie-oozi-C@6 READY -
> - 2015-10-16 20:42 GMT 2015-10-15 11:55 GMT
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000113-151009113906602-oozie-oozi-C@7 RUNNING
> 0000132-151009113906602-oozie-oozi-W - 2015-10-16 20:42 GMT
> 2015-10-15 12:00 GMT
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000113-151009113906602-oozie-oozi-C@8 SUCCEEDED
> 0000119-151009113906602-oozie-oozi-W - 2015-10-16 20:42 GMT
> 2015-10-15 12:05 GMT
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000113-151009113906602-oozie-oozi-C@9 SUCCEEDED
> 0000118-151009113906602-oozie-oozi-W - 2015-10-16 20:42 GMT
> 2015-10-15 12:10 GMT
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000113-151009113906602-oozie-oozi-C@10 SUCCEEDED
> 0000117-151009113906602-oozie-oozi-W - 2015-10-16 20:42 GMT
> 2015-10-15 12:15 GMT
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000113-151009113906602-oozie-oozi-C@11 SUCCEEDED
> 0000116-151009113906602-oozie-oozi-W - 2015-10-16 20:42 GMT
> 2015-10-15 12:20 GMT
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000113-151009113906602-oozie-oozi-C@12 SUCCEEDED
> 0000115-151009113906602-oozie-oozi-W - 2015-10-16 20:42 GMT
> 2015-10-15 12:25 GMT
> ------------------------------------------------------------------------------------------------------------------------------------
> {noformat}
> The Coordinator was super simple. It was set to LIFO, and was running a
> workflow with a Shell action that would run sleep with an argument of 10
> seconds.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
