Re: how many topics spark streaming can handle

Hello Ashok, We're consuming from more than 10 topics in some Spark streaming applications. Topic management is a concern (what is read from where, etc), but I have seen no issues from Spark itself. Regards, Bryan Jeffrey Get Outlook for Android On Mon, Jun 19, 2017 at

Re: how many topics spark streaming can handle

thank you in the following example    val topics = "test1,test2,test3"     val brokers = "localhost:9092"     val topicsSet = topics.split(",").toSet     val sparkConf = new SparkConf().setAppName("KafkaDroneCalc").setMaster("local") //spark://localhost:7077     val sc = new

Re: how many topics spark streaming can handle

I don't think that there is really a Spark specific limit here. It would be a function of the size of your spark / kafka clusters and the type of processing you are trying to do. On Mon, Jun 19, 2017 at 12:00 PM, Ashok Kumar wrote: > Hi Gurus, > > Within one Spark

how many topics spark streaming can handle

Hi Gurus, Within one Spark streaming process how many topics can be handled? I have not tried more than one topic. Thanks