Re: Multiple Spark Streaming receiver model

to be heavyweight and OOM can occur. Creating a pool of StreamingContext seems not an elegant solution. I'm in a bind as well as to the best approach for multiple sources. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Multiple-Spark-Streaming-receiver

Re: Multiple Spark Streaming receiver model

Hi Manjul, Each StreamingContext will have its own batch size. If that doesn’t work for the different sources you have then you would have to create different streaming apps. You can only create a new StreamingContext in the same Spark app, once you’ve stopped the previous one. Spark

Multiple Spark Streaming receiver model

application design and if you can have some example for complex application which you can share may some URL reference or whatever ; it is very appreciated. Thanks Manjul -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Multiple-Spark-Streaming-receiver