On 04/15/15 09:31, Manoj Khangaonkar wrote: > # I looked the documents of kafka and I see that there is no way a >> consume instance can >> read specific messages from partition. >> > > With Kafka you read messages from the beginning multiple times. Since you > say later that > you do not have many messages per topic, you can iterate over the message > and read the ones > that you need. Of course this might not the be the most efficient. >
couldn't you also store the offset of the last read message, then resume reading messages after that offset to ensure your consumer does not consume the same message twice? Cheers, -pete -- Pete Wright Lead Systems Architect Rubicon Project pwri...@rubiconproject.com 310.309.9298