Re: Dynamic parallel tasks in Oozie

2014-02-21 Thread Virag Kothari
Yes, I think that should be added. Its been waiting on RB for a long time :) Thanks, virag On 2/20/14 2:24 PM, "Alejandro Abdelnur" wrote: >This is what I refer as sharding, it can be seen as a special type of >fork/join where all shards are doing the same actions on different >datasets >and th

Re: Dynamic parallel tasks in Oozie

2014-02-20 Thread Alejandro Abdelnur
This is what I refer as sharding, it can be seen as a special type of fork/join where all shards are doing the same actions on different datasets and the number of shards depends on the number of datasets. A while ago I've rewritten the workflow lib, cleanning it up a bit and adding this capabilit