thank you
in the following example
val topics = "test1,test2,test3"
val brokers = "localhost:9092"
val topicsSet = topics.split(",").toSet
val sparkConf = new
SparkConf().setAppName("KafkaDroneCalc").setMaster("local")
//spark://localhost:7077
val sc = new SparkContext(sparkConf)
val ssc = new StreamingContext(sc, Seconds(30))
val kafkaParams = Map[String, String]("metadata.broker.list" -> brokers)
val messages = KafkaUtils.createDirectStream[String, String, StringDecoder,
StringDecoder] (ssc, kafkaParams, topicsSet)
it is possible to have three topics or many topics?
On Monday, 19 June 2017, 20:10, Michael Armbrust <[email protected]>
wrote:
I don't think that there is really a Spark specific limit here. It would be a
function of the size of your spark / kafka clusters and the type of processing
you are trying to do.
On Mon, Jun 19, 2017 at 12:00 PM, Ashok Kumar <[email protected]>
wrote:
Hi Gurus,
Within one Spark streaming process how many topics can be handled? I have not
tried more than one topic.
Thanks
