Hi All,
Using Spark 2.2.0 on YARN cluster.
I am running the Kafka Direct Stream wordcount example code (pasted below my
signature). My topic consists of 400 partitions. And the Spark Job tracker page
shows 26 executors to process the corresponding 400 tasks.
When I check the execution
Hello,
Using Spark 2.2.0. Interested in seeing the action of dynamic topic
subscription.
Tried this example: streaming.DirectKafkaWordCount (which uses
org.apache.spark.streaming.kafka010)
I start with 8 Kafka partitions in my topic and found that Spark Streaming
executes 8 tasks (one per
