Re: Need help determining consumer group offsets

2017-03-23 Thread Greg Lloyd
> Hi Greg!! > > Are you using offset auto commit or do you commit manually? > > 2017-03-22 22:21 GMT+01:00 Greg Lloyd : > > > I have a 0.8.2.2 cluster which has been configured > > with offsets.storage=kafka. We are experiencing some issues after a few > > nodes we

Need help determining consumer group offsets

2017-03-22 Thread Greg Lloyd
I have a 0.8.2.2 cluster which has been configured with offsets.storage=kafka. We are experiencing some issues after a few nodes went down and wrong nodes were brought up in their place, fortunately not production. I am trying to determine what the current offsets are for a consumer group and can't

Re: New Producer API - batched sync mode support

2015-06-17 Thread Greg Lloyd
@Shapira You are correct from my perspective. We are using kafka for a system where panels can send multiple events in a single message. The current contract is such that all events fail or succeed as a whole. If there is a failure the panel resends all the events. The existing producer api support

Re: consumer groups

2014-12-17 Thread Greg Lloyd
or "smallest" (all messages) , with simple > consumer you can pick specific offsets. > > > On Wed, Dec 17, 2014 at 2:33 PM, Greg Lloyd wrote: > > Thanks for the reply, > > > > So if I wanted to add a new group of consumers 6 months into the lifespan > >

Re: consumer groups

2014-12-17 Thread Greg Lloyd
ally constant with the amount of > data it stores, storing terabytes of data for months is not uncommon. > > Gwen > > On Tue, Dec 16, 2014 at 1:09 PM, Greg Lloyd wrote: > > Hi, > > > > I am planning to use kafka for a work queue type use case with multiple > >

consumer groups

2014-12-16 Thread Greg Lloyd
for that group? Thanks for any clarification, Greg Lloyd