RE: Partial Message Read by Consumer

2013-12-11 Thread Sybrandy, Casey
en thought to look there since it is working in other places. Casey From: Guozhang Wang [wangg...@gmail.com] Sent: Wednesday, December 11, 2013 12:09 PM To: users@kafka.apache.org Subject: Re: Partial Message Read by Consumer Do you have compression turned

Re: Partial Message Read by Consumer

2013-12-11 Thread Guozhang Wang
started seeing this issue. For this consumer, > I'm only working with one stream. I tried 2, but no change. > > Casey > ____ > From: Guozhang Wang [wangg...@gmail.com] > Sent: Wednesday, December 11, 2013 11:31 AM > To: users@kafka.apache.org

RE: Partial Message Read by Consumer

2013-12-11 Thread Sybrandy, Casey
arted seeing this issue. For this consumer, I'm only working with one stream. I tried 2, but no change. Casey From: Guozhang Wang [wangg...@gmail.com] Sent: Wednesday, December 11, 2013 11:31 AM To: users@kafka.apache.org Subject: Re: Partial Message Re

Re: Partial Message Read by Consumer

2013-12-11 Thread Guozhang Wang
t's like adding > > magical print statements. > > > > Hope this helps. I need it. > > > > Casey > > > > > > From: Tom Brown [tombrow...@gmail.com] > > Sent: Tuesday, December 10, 2013 7:10 PM >

Re: Partial Message Read by Consumer

2013-12-11 Thread Jun Rao
ps. I need it. > > Casey > > > From: Tom Brown [tombrow...@gmail.com] > Sent: Tuesday, December 10, 2013 7:10 PM > To: users@kafka.apache.org > Subject: Re: Partial Message Read by Consumer > > Having a partial message transfer ove

RE: Partial Message Read by Consumer

2013-12-11 Thread Sybrandy, Casey
10 PM To: users@kafka.apache.org Subject: Re: Partial Message Read by Consumer Having a partial message transfer over the network is the design of Kafka 0.7.x (I can't speak to 0.8.x, though it may still be). When the request is made, you tell the server the partition number, the byte offset into

Re: Partial Message Read by Consumer

2013-12-10 Thread Tom Brown
Having a partial message transfer over the network is the design of Kafka 0.7.x (I can't speak to 0.8.x, though it may still be). When the request is made, you tell the server the partition number, the byte offset into that partition, and the size of response that you want. The server finds that o

Re: Partial Message Read by Consumer

2013-12-10 Thread Guozhang Wang
Hello Casey, What do you mean by "part of a message is being read"? Could you upload the output and also the log of the consumer here? Guozhang On Tue, Dec 10, 2013 at 12:26 PM, Sybrandy, Casey < casey.sybra...@six3systems.com> wrote: > Hello, > > First, I'm using version 0.7.2. > > I'm trying

Partial Message Read by Consumer

2013-12-10 Thread Sybrandy, Casey
Hello, First, I'm using version 0.7.2. I'm trying to read some messages from a broker, but looking at wireshark, it appears that only part of a message is being read by the consumer. After that, no other data is read and I can verify that there are 10 messages on the broker. I have the consu