[
https://issues.apache.org/jira/browse/OOZIE-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203617#comment-15203617
]
Robert Kanter commented on OOZIE-2425:
--------------------------------------
In fact, thinking about this again, I think when using LIFO with "catch-up",
Oozie should materialize the newest actions first and go backwards. For
example, if you have a coordinator that runs a job every 10 minutes, and you
start it 360 minutes in the past, it should materialize the newest 12 actions
first, and then the previous 12 actions, and finally the first 12 actions.
i.e. @36 - @25, then @24 - @13, and finally @12 - @1 instead of the other way
around.
> LIFO executes action 1 and then does the LIFO behavior
> ------------------------------------------------------
>
> Key: OOZIE-2425
> URL: https://issues.apache.org/jira/browse/OOZIE-2425
> Project: Oozie
> Issue Type: Bug
> Components: coordinator
> Affects Versions: trunk
> Reporter: Robert Kanter
>
> When using LIFO execution order, Oozie should run the latest READY action
> first. This includes when you start your Coordinator in the past, and Oozie
> plays "catch-up". However, Oozie will materialize 12 actions (the default),
> but will do @1 and then do the LIFO behavior (i.e. @12, @11, etc). This is
> likely due to a race condition about when the other actions are
> materialized/READY vs when Oozie checks to run an action, as the actions are
> materialized in FIFO order.
> {noformat}
> ID Status Ext ID
> Err Code Created Nominal Time
> 0000113-151009113906602-oozie-oozi-C@1 SUCCEEDED
> 0000114-151009113906602-oozie-oozi-W - 2015-10-16 20:42 GMT
> 2015-10-15 11:30 GMT
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000113-151009113906602-oozie-oozi-C@2 READY -
> - 2015-10-16 20:42 GMT 2015-10-15 11:35 GMT
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000113-151009113906602-oozie-oozi-C@3 READY -
> - 2015-10-16 20:42 GMT 2015-10-15 11:40 GMT
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000113-151009113906602-oozie-oozi-C@4 READY -
> - 2015-10-16 20:42 GMT 2015-10-15 11:45 GMT
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000113-151009113906602-oozie-oozi-C@5 READY -
> - 2015-10-16 20:42 GMT 2015-10-15 11:50 GMT
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000113-151009113906602-oozie-oozi-C@6 READY -
> - 2015-10-16 20:42 GMT 2015-10-15 11:55 GMT
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000113-151009113906602-oozie-oozi-C@7 RUNNING
> 0000132-151009113906602-oozie-oozi-W - 2015-10-16 20:42 GMT
> 2015-10-15 12:00 GMT
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000113-151009113906602-oozie-oozi-C@8 SUCCEEDED
> 0000119-151009113906602-oozie-oozi-W - 2015-10-16 20:42 GMT
> 2015-10-15 12:05 GMT
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000113-151009113906602-oozie-oozi-C@9 SUCCEEDED
> 0000118-151009113906602-oozie-oozi-W - 2015-10-16 20:42 GMT
> 2015-10-15 12:10 GMT
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000113-151009113906602-oozie-oozi-C@10 SUCCEEDED
> 0000117-151009113906602-oozie-oozi-W - 2015-10-16 20:42 GMT
> 2015-10-15 12:15 GMT
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000113-151009113906602-oozie-oozi-C@11 SUCCEEDED
> 0000116-151009113906602-oozie-oozi-W - 2015-10-16 20:42 GMT
> 2015-10-15 12:20 GMT
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000113-151009113906602-oozie-oozi-C@12 SUCCEEDED
> 0000115-151009113906602-oozie-oozi-W - 2015-10-16 20:42 GMT
> 2015-10-15 12:25 GMT
> ------------------------------------------------------------------------------------------------------------------------------------
> {noformat}
> The Coordinator was super simple. It was set to LIFO, and was running a
> workflow with a Shell action that would run sleep with an argument of 10
> seconds.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
