Re: [DISCUSS] KIP 141 - ProducerRecordBuilder Interface

t a basic copy/paste exercise (bangs head on wall) > > Try again: > > > > On 18 May 2017, at 18:29, Andrew Coates <andy.coa...@apple.com> wrote: > > > > Hi all, > > > > The `ProducerRecord` type has many optional fields and the list has

Re: Java Client Builder pattern for ProducerRecord - thoughts?

Thanks Mike On Thu, 18 May 2017 at 21:33, Michael André Pearce < michael.andre.pea...@me.com> wrote: > Hi Andrew, > > There is already a kip discussion exactly around this if you look for KIP > 141 discuss thread. > > Cheers > Mike > > Sent from my iPhone >

Java Client Builder pattern for ProducerRecord - thoughts?

Hi all, The `ProducerRecord` type has many optional fields and the list has grown over different revisions of Kafka. Kafka supports `ProducerInterceptor`s, which often need to construct new `ProducerRecord`s, based on those passed in, copying most fields from the old to the new record, e.g.:

Can someone assign, or give me permission to assign myself to a Jira please?

Hi, I have a patch for KAFKA-5246 , but don’t yet have permissions to assign the Jira to myself. Would someone mind either assigning it, or giving me permissions to assign it to myself? Thanks, Andy

Re: [jira] [Commented] (KAFKA-3919) Broker faills to start after ungraceful shutdown due to non-monotonically incrementing offsets in logs

Hi [~junrao], has there been any more discussion or progress on this issue? Thanks, Andy On Tue, 12 Jul 2016 at 10:11, Andy Coates (JIRA) wrote: > > [ >

Re: [DISCUSS] KIP-54 Sticky Partition Assignment Strategy

I'm still very interested in seeing this KIP progress ... On Tue, 2 Aug 2016 at 20:09, Vahid S Hashemian wrote: > I would like to revive this thread and ask for additional feedback on this > KIP. > > There have already been some feedback, mostly in favor, plus some

Re: [jira] [Commented] (KAFKA-3919) Broker faills to start after ungraceful shutdown due to non-monotonically incrementing offsets in logs

[~junrao] i thought that the indexer took the offset of the first record in a compressed set. Looking at `LogSegment.recover` in the 0.9.0.1 code base that does indeed seen to be the case. I haven't dumped the offsets again, but I can of you still need it? On Wed, 6 Jul 2016, 09:04 Andrew Coates

Re: [jira] [Commented] (KAFKA-3919) Broker faills to start after ungraceful shutdown due to non-monotonically incrementing offsets in logs

[~junrao] will double check On Tue, 5 Jul 2016, 18:53 Jun Rao (JIRA), wrote: > > [ > https://issues.apache.org/jira/browse/KAFKA-3919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15362865#comment-15362865 > ] > > Jun Rao commented on KAFKA-3919: >

Re: [DISCUSS] KIP-54 Sticky Partition Assignment Strategy

ird consumer with not have any partitions assigned. This > should > > be fixed by the 'fair' part of the strategy, but it would be good to see > > this covered explicitly in the KIP. > > > This would be true for range assignment, but with 4 partitions total, > round-robin

Re: [DISCUSS] KIP-54 Sticky Partition Assignment Strategy

Hi all, I think sticky assignment is immensely important / useful in many situations. Apps that use Kafka are many and varied. Any app that stores any state, either in the form of data from incoming messages, cached results from previous out-of-process calls or expensive operations, (and let's

Re: [jira] [Commented] (KAFKA-3775) Throttle maximum number of tasks assigned to a single KafkaStreams

Good to hear! On the network bandwidth issue... if you're running other processes on the box and what to stop your streaming app from monopolizing the available bandwidth on the box, then I'd suggest looking at some QOS / packet shaping tools to control this outside of Kafka. On Sun, 12 Jun

Wiki edit permissions.

Hi, Can I get edit permissions for the wiki please? Just wanting to correct the duplicate ‘log.cleaner.min.cleanable.ratio‘ config setting at the bottom of https://cwiki.apache.org/confluence/display/KAFKA/Log+Compaction Username: bigandy Thanks, Andy