Re: CreateMessageStream API

2014-06-02 Thread Neha Narkhede
Pradeep, Kafka guarantees ordering of data per partition. So if you have several producers that send data with a key, you will have all messages for the same key ordered in a single partition. If you attach a consumer to one partition, you can then consume data in order per key. It will help to kn

Re: CreateMessageStream API

2014-06-02 Thread Jun Rao
Currently, that's probably what you have to do. We are designing a consumer with better apis ( https://cwiki.apache.org/confluence/display/KAFKA/Kafka+0.9+Consumer+Rewrite+Design ). Thanks, Jun On Mon, Jun 2, 2014 at 1:14 AM, Kumar Pradeep wrote: > Hi, > I need to create a single partition fr

CreateMessageStream API

2014-06-02 Thread Kumar Pradeep
Hi, I need to create a single partition from a single topic in Kafka. I am doing this because the order of messages coming from my Kafka producer is very important to me (if I tried to have multiple partition with multiple threads doing I/O, my ordering of messages is not guaranteed; at least th