RE: Partial Message Read by Consumer

2013-12-11 Thread Sybrandy, Casey
@kafka.apache.org Subject: Re: Partial Message Read by Consumer Having a partial message transfer over the network is the design of Kafka 0.7.x (I can't speak to 0.8.x, though it may still be). When the request is made, you tell the server the partition number, the byte offset into that partition

Re: Partial Message Read by Consumer

2013-12-11 Thread Jun Rao
: Tuesday, December 10, 2013 7:10 PM To: users@kafka.apache.org Subject: Re: Partial Message Read by Consumer Having a partial message transfer over the network is the design of Kafka 0.7.x (I can't speak to 0.8.x, though it may still be). When the request is made, you tell the server

RE: Partial Message Read by Consumer

2013-12-11 Thread Sybrandy, Casey
. For this consumer, I'm only working with one stream. I tried 2, but no change. Casey From: Guozhang Wang [wangg...@gmail.com] Sent: Wednesday, December 11, 2013 11:31 AM To: users@kafka.apache.org Subject: Re: Partial Message Read by Consumer Casey, Just

Re: Partial Message Read by Consumer

2013-12-11 Thread Guozhang Wang
From: Guozhang Wang [wangg...@gmail.com] Sent: Wednesday, December 11, 2013 11:31 AM To: users@kafka.apache.org Subject: Re: Partial Message Read by Consumer Casey, Just to confirm, you saw a partial message output from the iterator.next() call, not from the consumer's fetch response, correct

RE: Partial Message Read by Consumer

2013-12-11 Thread Sybrandy, Casey
to look there since it is working in other places. Casey From: Guozhang Wang [wangg...@gmail.com] Sent: Wednesday, December 11, 2013 12:09 PM To: users@kafka.apache.org Subject: Re: Partial Message Read by Consumer Do you have compression turned

Re: Partial Message Read by Consumer

2013-12-10 Thread Tom Brown
Having a partial message transfer over the network is the design of Kafka 0.7.x (I can't speak to 0.8.x, though it may still be). When the request is made, you tell the server the partition number, the byte offset into that partition, and the size of response that you want. The server finds that