Hello all, I have few questions regarding spark streaming :
* I am wondering anyone uses spark streaming with workflow orchestrators such as data pipeline/SWF/any other framework. Is there any advantages /drawbacks on using a workflow orchestrator for spark streaming? *How do you guys manage the cluster(bringing down /creating a new cluster ) without any data loss in streaming? I would like to hear your thoughts on this.
