Hi Pandees, can you kindly explain what you are trying to achieve by incorporating Spark streaming with workflow orchestration. Is this some form of back-to-back seamless integration.
I have not used it myself but would be interested in knowing more about your use case. Cheers, Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* http://talebzadehmich.wordpress.com On 22 June 2016 at 15:54, pandees waran <pande...@gmail.com> wrote: > Hi Mich, please let me know if you have any thoughts on the below. > > ---------- Forwarded message ---------- > From: pandees waran <pande...@gmail.com> > Date: Wed, Jun 22, 2016 at 7:53 AM > Subject: spark streaming questions > To: user@spark.apache.org > > > Hello all, > > I have few questions regarding spark streaming : > > * I am wondering anyone uses spark streaming with workflow orchestrators > such as data pipeline/SWF/any other framework. Is there any advantages > /drawbacks on using a workflow orchestrator for spark streaming? > > *How do you guys manage the cluster(bringing down /creating a new cluster > ) without any data loss in streaming? > > I would like to hear your thoughts on this. > > > > > -- > Thanks, > Pandeeswaran >
