Thanks Luis and Tobias.
On Tue, Jul 1, 2014 at 11:39 PM, Tobias Pfeiffer <t...@preferred.jp> wrote: > Hi, > > On Wed, Jul 2, 2014 at 1:57 AM, Chen Song <chen.song...@gmail.com> wrote: >> >> * Is there a way to control how far Kafka Dstream can read on >> topic-partition (via offset for example). By setting this to a small >> number, it will force DStream to read less data initially. >> > > Please see the post at > > http://mail-archives.apache.org/mod_mbox/incubator-spark-user/201406.mbox/%3ccaph-c_m2ppurjx-n_tehh0bvqe_6la-rvgtrf1k-lwrmme+...@mail.gmail.com%3E > Kafka's auto.offset.reset parameter may be what you are looking for. > > Tobias > > -- Chen Song