If you have 1 topic, that means you have 1 DStream, which will have a series of RDDs for each batch interval. In receiver-based integration, there is no direct relationship b/w Kafka paritions with spark partitions. in Direct approach, 1 partition will be created for each kafka partition.
On Fri, Aug 21, 2015 at 12:48 PM, Gaurav Agarwal <gaurav130...@gmail.com> wrote: > Hello > > Regarding Spark Streaming and Kafka Partitioning > > When i send message on kafka topic with 3 partitions and listens on > kafkareceiver with local value[4] . how will i come to know in Spark > Streaming that different Dstreams are created according to partitions of > kafka messages . > > Thanks > > -- Best Regards, Ayan Guha
