MULTI FETCH RESPONSE Wire Format for Kafka 0.7.1

2012-09-28 Thread Milind Parikh
What is the wire format for MULTI-FETCH *RESPONSE* *given *that the SINGLE-FETCH RESPONSE LOOKS like this: RESPONSE_HEADER ResponseLength:32/integer ErrorCode:16/integer MESSAGES

Re: MULTI FETCH RESPONSE Wire Format for Kafka 0.7.1

2012-09-28 Thread Milind Parikh
After doing a little wire-snooping of the data, it appears that the MULTI-FETCH RESPONSE is EXACTLY the same as the SINGLE-FETCH. If this is correct, how does one advance to the next offset for each one of the topic-partition combo if reading multiple topic-partitions in parallel; given that the i

Re: MULTI FETCH RESPONSE Wire Format for Kafka 0.7.1

2012-09-29 Thread Jun Rao
You can figure out the corresponding topic-partition from the multiFetchRequest itself. The topic/partition ordering in the response is the same as that in the request. In 0.8, topic/partition will be included in the response itself. Thanks, Jun On Fri, Sep 28, 2012 at 3:56 PM, Milind Parikh wro