Re: Support for workflow actions running across multiple big data frameworks in parallel?

2013-06-19 Thread Alejandro Abdelnur
or if you don't want to go into writing a custom action executor for now, you could use the Oozie shell or ssh actions to start your mesos job. On Wed, Jun 19, 2013 at 1:58 PM, Mona Chitnis wrote: > That is an interesting use case Som! Oozie is tightly coupled with Hadoop > right now. You might

Re: Support for workflow actions running across multiple big data frameworks in parallel?

2013-06-19 Thread Mona Chitnis
That is an interesting use case Som! Oozie is tightly coupled with Hadoop right now. You might be able to use custom ActionExecutor class and plug it in to perform your Step2 to a Spark job in S3, the first step to "launching" that action is still going to be a Hadoop Map task by Oozie. And there w

Re: Support for workflow actions running across multiple big data frameworks in parallel?

2013-06-19 Thread Som Satpathy
Any body has anything to share here? Thanks, Som On Mon, Jun 17, 2013 at 3:25 PM, Som Satpathy wrote: > Hi, > > I had a question regarding a use case where a user might want to design > and execute workflows on YARN/Mesos which runs hadoop and spark in > parallel. Does Oozie currently support o