Re: [VOTE] KIP-126 - Allow KafkaProducer to split and resend oversized batches.

[Becket Qin]

Thanks everyone for voting.

KIP-126 has passed with +3 binding (Joel, Jason and me) and +3 non-binding
(Dong, Bill, Michael)

Thanks,

Jiangjie (Becket) Qin



On Mon, May 8, 2017 at 10:06 AM, Jason Gustafson  wrote:

> +1
>
> On Thu, May 4, 2017 at 9:11 PM, Michael Pearce 
> wrote:
>
> > +1
> >
> >
> > 
> > From: Joel Koshy 
> > Sent: Friday, May 5, 2017 4:32:42 AM
> > To: dev@kafka.apache.org
> > Subject: Re: [VOTE] KIP-126 - Allow KafkaProducer to split and resend
> > oversized batches.
> >
> > +1
> >
> > On Thu, May 4, 2017 at 7:00 PM Becket Qin  wrote:
> >
> > > Bump.
> > >
> > > On Tue, Apr 25, 2017 at 3:17 PM, Bill Bejeck 
> wrote:
> > >
> > > > +1
> > > >
> > > > On Tue, Apr 25, 2017 at 4:43 PM, Dong Lin 
> wrote:
> > > >
> > > > > +1 (non-binding)
> > > > >
> > > > > On Tue, Apr 25, 2017 at 12:33 PM, Becket Qin  >
> > > > wrote:
> > > > >
> > > > > > Hi,
> > > > > >
> > > > > > I would like to start the voting on KIP-126. The KIP is intended
> to
> > > > solve
> > > > > > the problem that RecordTooLargeExceptions are thrown from the
> > > producer
> > > > > due
> > > > > > to inaccurate estimation of the compression ratio. The solution
> is
> > to
> > > > > split
> > > > > > and resend the over sized batches if possible. A new metric is
> > > > introduced
> > > > > > to the producer to show the batch split rate.
> > > > > >
> > > > > > The KIP wiki is following:
> > > > > > *https://cwiki.apache.org/confluence/pages/viewpage.
> > > > > action?pageId=68715855
> > > > > > <https://cwiki.apache.org/confluence/pages/viewpage.
> > > > > action?pageId=68715855
> > > > > > >*
> > > > > >
> > > > > > We have been running a producer with this patch for some time in
> > our
> > > > > mirror
> > > > > > maker and it looks working fine.
> > > > > >
> > > > > > Thanks,
> > > > > >
> > > > > > Jiangjie (Becket) Qin
> > > > > >
> > > > >
> > > >
> > >
> > --
> > Sent from Gmail Mobile
> > The information contained in this email is strictly confidential and for
> > the use of the addressee only, unless otherwise indicated. If you are not
> > the intended recipient, please do not read, copy, use or disclose to
> others
> > this message or any attachment. Please also notify the sender by replying
> > to this email or by telephone (+44(020 7896 0011) and then delete the
> email
> > and any copies of it. Opinions, conclusion (etc) that do not relate to
> the
> > official business of this company shall be understood as neither given
> nor
> > endorsed by it. IG is a trading name of IG Markets Limited (a company
> > registered in England and Wales, company number 04008957) and IG Index
> > Limited (a company registered in England and Wales, company number
> > 01190902). Registered address at Cannon Bridge House, 25 Dowgate Hill,
> > London EC4R 2YA. Both IG Markets Limited (register number 195355) and IG
> > Index Limited (register number 114059) are authorised and regulated by
> the
> > Financial Conduct Authority.
> >
>

Re: [VOTE] KIP-126 - Allow KafkaProducer to split and resend oversized batches.

[Jason Gustafson]

+1

On Thu, May 4, 2017 at 9:11 PM, Michael Pearce 
wrote:

> +1
>
>
> 
> From: Joel Koshy 
> Sent: Friday, May 5, 2017 4:32:42 AM
> To: dev@kafka.apache.org
> Subject: Re: [VOTE] KIP-126 - Allow KafkaProducer to split and resend
> oversized batches.
>
> +1
>
> On Thu, May 4, 2017 at 7:00 PM Becket Qin  wrote:
>
> > Bump.
> >
> > On Tue, Apr 25, 2017 at 3:17 PM, Bill Bejeck  wrote:
> >
> > > +1
> > >
> > > On Tue, Apr 25, 2017 at 4:43 PM, Dong Lin  wrote:
> > >
> > > > +1 (non-binding)
> > > >
> > > > On Tue, Apr 25, 2017 at 12:33 PM, Becket Qin 
> > > wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > I would like to start the voting on KIP-126. The KIP is intended to
> > > solve
> > > > > the problem that RecordTooLargeExceptions are thrown from the
> > producer
> > > > due
> > > > > to inaccurate estimation of the compression ratio. The solution is
> to
> > > > split
> > > > > and resend the over sized batches if possible. A new metric is
> > > introduced
> > > > > to the producer to show the batch split rate.
> > > > >
> > > > > The KIP wiki is following:
> > > > > *https://cwiki.apache.org/confluence/pages/viewpage.
> > > > action?pageId=68715855
> > > > > <https://cwiki.apache.org/confluence/pages/viewpage.
> > > > action?pageId=68715855
> > > > > >*
> > > > >
> > > > > We have been running a producer with this patch for some time in
> our
> > > > mirror
> > > > > maker and it looks working fine.
> > > > >
> > > > > Thanks,
> > > > >
> > > > > Jiangjie (Becket) Qin
> > > > >
> > > >
> > >
> >
> --
> Sent from Gmail Mobile
> The information contained in this email is strictly confidential and for
> the use of the addressee only, unless otherwise indicated. If you are not
> the intended recipient, please do not read, copy, use or disclose to others
> this message or any attachment. Please also notify the sender by replying
> to this email or by telephone (+44(020 7896 0011) and then delete the email
> and any copies of it. Opinions, conclusion (etc) that do not relate to the
> official business of this company shall be understood as neither given nor
> endorsed by it. IG is a trading name of IG Markets Limited (a company
> registered in England and Wales, company number 04008957) and IG Index
> Limited (a company registered in England and Wales, company number
> 01190902). Registered address at Cannon Bridge House, 25 Dowgate Hill,
> London EC4R 2YA. Both IG Markets Limited (register number 195355) and IG
> Index Limited (register number 114059) are authorised and regulated by the
> Financial Conduct Authority.
>

Re: [VOTE] KIP-126 - Allow KafkaProducer to split and resend oversized batches.

[Michael Pearce]

+1



From: Joel Koshy 
Sent: Friday, May 5, 2017 4:32:42 AM
To: dev@kafka.apache.org
Subject: Re: [VOTE] KIP-126 - Allow KafkaProducer to split and resend oversized 
batches.

+1

On Thu, May 4, 2017 at 7:00 PM Becket Qin  wrote:

> Bump.
>
> On Tue, Apr 25, 2017 at 3:17 PM, Bill Bejeck  wrote:
>
> > +1
> >
> > On Tue, Apr 25, 2017 at 4:43 PM, Dong Lin  wrote:
> >
> > > +1 (non-binding)
> > >
> > > On Tue, Apr 25, 2017 at 12:33 PM, Becket Qin 
> > wrote:
> > >
> > > > Hi,
> > > >
> > > > I would like to start the voting on KIP-126. The KIP is intended to
> > solve
> > > > the problem that RecordTooLargeExceptions are thrown from the
> producer
> > > due
> > > > to inaccurate estimation of the compression ratio. The solution is to
> > > split
> > > > and resend the over sized batches if possible. A new metric is
> > introduced
> > > > to the producer to show the batch split rate.
> > > >
> > > > The KIP wiki is following:
> > > > *https://cwiki.apache.org/confluence/pages/viewpage.
> > > action?pageId=68715855
> > > > <https://cwiki.apache.org/confluence/pages/viewpage.
> > > action?pageId=68715855
> > > > >*
> > > >
> > > > We have been running a producer with this patch for some time in our
> > > mirror
> > > > maker and it looks working fine.
> > > >
> > > > Thanks,
> > > >
> > > > Jiangjie (Becket) Qin
> > > >
> > >
> >
>
--
Sent from Gmail Mobile
The information contained in this email is strictly confidential and for the 
use of the addressee only, unless otherwise indicated. If you are not the 
intended recipient, please do not read, copy, use or disclose to others this 
message or any attachment. Please also notify the sender by replying to this 
email or by telephone (+44(020 7896 0011) and then delete the email and any 
copies of it. Opinions, conclusion (etc) that do not relate to the official 
business of this company shall be understood as neither given nor endorsed by 
it. IG is a trading name of IG Markets Limited (a company registered in England 
and Wales, company number 04008957) and IG Index Limited (a company registered 
in England and Wales, company number 01190902). Registered address at Cannon 
Bridge House, 25 Dowgate Hill, London EC4R 2YA. Both IG Markets Limited 
(register number 195355) and IG Index Limited (register number 114059) are 
authorised and regulated by the Financial Conduct Authority.

Re: [VOTE] KIP-126 - Allow KafkaProducer to split and resend oversized batches.

[Joel Koshy]

+1

On Thu, May 4, 2017 at 7:00 PM Becket Qin  wrote:

> Bump.
>
> On Tue, Apr 25, 2017 at 3:17 PM, Bill Bejeck  wrote:
>
> > +1
> >
> > On Tue, Apr 25, 2017 at 4:43 PM, Dong Lin  wrote:
> >
> > > +1 (non-binding)
> > >
> > > On Tue, Apr 25, 2017 at 12:33 PM, Becket Qin 
> > wrote:
> > >
> > > > Hi,
> > > >
> > > > I would like to start the voting on KIP-126. The KIP is intended to
> > solve
> > > > the problem that RecordTooLargeExceptions are thrown from the
> producer
> > > due
> > > > to inaccurate estimation of the compression ratio. The solution is to
> > > split
> > > > and resend the over sized batches if possible. A new metric is
> > introduced
> > > > to the producer to show the batch split rate.
> > > >
> > > > The KIP wiki is following:
> > > > *https://cwiki.apache.org/confluence/pages/viewpage.
> > > action?pageId=68715855
> > > >  > > action?pageId=68715855
> > > > >*
> > > >
> > > > We have been running a producer with this patch for some time in our
> > > mirror
> > > > maker and it looks working fine.
> > > >
> > > > Thanks,
> > > >
> > > > Jiangjie (Becket) Qin
> > > >
> > >
> >
>
-- 
Sent from Gmail Mobile

Re: [VOTE] KIP-126 - Allow KafkaProducer to split and resend oversized batches.

[Becket Qin]

Bump.

On Tue, Apr 25, 2017 at 3:17 PM, Bill Bejeck  wrote:

> +1
>
> On Tue, Apr 25, 2017 at 4:43 PM, Dong Lin  wrote:
>
> > +1 (non-binding)
> >
> > On Tue, Apr 25, 2017 at 12:33 PM, Becket Qin 
> wrote:
> >
> > > Hi,
> > >
> > > I would like to start the voting on KIP-126. The KIP is intended to
> solve
> > > the problem that RecordTooLargeExceptions are thrown from the producer
> > due
> > > to inaccurate estimation of the compression ratio. The solution is to
> > split
> > > and resend the over sized batches if possible. A new metric is
> introduced
> > > to the producer to show the batch split rate.
> > >
> > > The KIP wiki is following:
> > > *https://cwiki.apache.org/confluence/pages/viewpage.
> > action?pageId=68715855
> > >  > action?pageId=68715855
> > > >*
> > >
> > > We have been running a producer with this patch for some time in our
> > mirror
> > > maker and it looks working fine.
> > >
> > > Thanks,
> > >
> > > Jiangjie (Becket) Qin
> > >
> >
>

Re: [VOTE] KIP-126 - Allow KafkaProducer to split and resend oversized batches.

[Bill Bejeck]

+1

On Tue, Apr 25, 2017 at 4:43 PM, Dong Lin  wrote:

> +1 (non-binding)
>
> On Tue, Apr 25, 2017 at 12:33 PM, Becket Qin  wrote:
>
> > Hi,
> >
> > I would like to start the voting on KIP-126. The KIP is intended to solve
> > the problem that RecordTooLargeExceptions are thrown from the producer
> due
> > to inaccurate estimation of the compression ratio. The solution is to
> split
> > and resend the over sized batches if possible. A new metric is introduced
> > to the producer to show the batch split rate.
> >
> > The KIP wiki is following:
> > *https://cwiki.apache.org/confluence/pages/viewpage.
> action?pageId=68715855
> >  action?pageId=68715855
> > >*
> >
> > We have been running a producer with this patch for some time in our
> mirror
> > maker and it looks working fine.
> >
> > Thanks,
> >
> > Jiangjie (Becket) Qin
> >
>

Re: [VOTE] KIP-126 - Allow KafkaProducer to split and resend oversized batches.

[Dong Lin]

+1 (non-binding)

On Tue, Apr 25, 2017 at 12:33 PM, Becket Qin  wrote:

> Hi,
>
> I would like to start the voting on KIP-126. The KIP is intended to solve
> the problem that RecordTooLargeExceptions are thrown from the producer due
> to inaccurate estimation of the compression ratio. The solution is to split
> and resend the over sized batches if possible. A new metric is introduced
> to the producer to show the batch split rate.
>
> The KIP wiki is following:
> *https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=68715855
>  >*
>
> We have been running a producer with this patch for some time in our mirror
> maker and it looks working fine.
>
> Thanks,
>
> Jiangjie (Becket) Qin
>

[VOTE] KIP-126 - Allow KafkaProducer to split and resend oversized batches.

[Becket Qin]

Hi,

I would like to start the voting on KIP-126. The KIP is intended to solve
the problem that RecordTooLargeExceptions are thrown from the producer due
to inaccurate estimation of the compression ratio. The solution is to split
and resend the over sized batches if possible. A new metric is introduced
to the producer to show the batch split rate.

The KIP wiki is following:
*https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=68715855
*

We have been running a producer with this patch for some time in our mirror
maker and it looks working fine.

Thanks,

Jiangjie (Becket) Qin