Re: [DISCUSS] KIP-720: Deprecate MirrorMaker v1

2021-03-17 Thread Ben Stopford
ote: > > > Hey y'all, I'd like to start the discussion on KIP-720, which proposes to > > deprecate the original MirrorMaker in the upcoming 3.0 major release. > > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-720%3A+Deprecate+MirrorMaker+v1 > > > > Thanks! > > Ryanne > > > -- Ben Stopford

Re: [DISCUSS] KIP idea: Support of multipart messages

2020-09-08 Thread Ben Stopford
If all that makes sense, I'll create a full fledged KIP document and expand > the idea. > > Thanks, > A. > -- Ben Stopford

Re: virtual KIP meeting for KIP-405

2020-08-24 Thread Ben Stopford
t; and > > > > > outstanding issues, starting from this coming Tuesday at 9am PT. If > > you > > > > are > > > > > interested in attending, please let Harsha or me know. > > > > > > > > > > The recording of the meeting will be posted in > > > > > > > > > > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals > > > > > . > > > > > > > > > > Thanks, > > > > > > > > > > Jun > > > > > > > > > > -- Ben Stopford

Re: [VOTE] KIP-657: Add Customized Kafka Streams Logo

2020-08-20 Thread Ben Stopford
gt; > > > > > > > > On Tuesday, 18 August, 2020, 11:44:20 pm IST, Guozhang > Wang < > > > > > > wangg...@gmail.com> wrote: > > > > > > > > > > > > > > I'm leaning towards design B primarily because it reminds me > of > > > the > > > > > > Firefox > > > > > > > logo which I like a lot. But I also share Adam's concern that > it > > > > should > > > > > > > better not obscure the Kafka logo --- so if we can tweak a bit > to > > > fix > > > > > it > > > > > > my > > > > > > > vote goes to B, otherwise A :) > > > > > > > > > > > > > > > > > > > > > Guozhang > > > > > > > > > > > > > > On Tue, Aug 18, 2020 at 9:48 AM Bruno Cadonna < > > br...@confluent.io> > > > > > > wrote: > > > > > > > > > > > > > >> Thanks for the KIP! > > > > > > >> > > > > > > >> I am +1 (non-binding) for A. > > > > > > >> > > > > > > >> I would also like to hear opinions whether the logo should be > > > > > colorized > > > > > > >> or just black and white. > > > > > > >> > > > > > > >> Best, > > > > > > >> Bruno > > > > > > >> > > > > > > >> > > > > > > >> On 15.08.20 16:05, Adam Bellemare wrote: > > > > > > >>> I prefer Design B, but given that I missed the discussion > > > thread, I > > > > > > think > > > > > > >>> it would be better without the Otter obscuring any part of > the > > > > Kafka > > > > > > >> logo. > > > > > > >>> > > > > > > >>> On Thu, Aug 13, 2020 at 6:31 PM Boyang Chen < > > > > > > reluctanthero...@gmail.com> > > > > > > >>> wrote: > > > > > > >>> > > > > > > >>>> Hello everyone, > > > > > > >>>> > > > > > > >>>> I would like to start a vote thread for KIP-657: > > > > > > >>>> > > > > > > >>>> > > > > > > >> > > > > > > > > > > > > > > > > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-657%3A+Add+Customized+Kafka+Streams+Logo > > > > > > >>>> > > > > > > >>>> This KIP is aiming to add a new logo for the Kafka Streams > > > > library. > > > > > > And > > > > > > >> we > > > > > > >>>> prepared two candidates with a cute otter. You could look up > > the > > > > KIP > > > > > > to > > > > > > >>>> find those logos. > > > > > > >>>> > > > > > > >>>> > > > > > > >>>> Please post your vote against these two customized logos. > For > > > > > > example, I > > > > > > >>>> would vote for *design-A (binding)*. > > > > > > >>>> > > > > > > >>>> This vote thread shall be open for one week to collect > enough > > > > votes > > > > > to > > > > > > >> call > > > > > > >>>> for a winner. Still, feel free to post any question you may > > have > > > > > > >> regarding > > > > > > >>>> this KIP, thanks! > > > > > > >>>> > > > > > > >>> > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > Michael G. Noll > > > > Principal Technologist, Office of the CTO > > > > <https://www.confluent.io> > > > > > -- > > <https://www.confluent.io> > > Antony Stubbs > > Principal Consulting Engineer / Solutions Architect > > > Follow us: Blog > < > https://confluent.io/blog?utm_source=footer&utm_medium=email&utm_campaign=ch.email-signature_type.community_content.blog > > > • Slack <https://slackpass.io/confluentcommunity> • Twitter > <https://twitter.com/ConfluentInc> • YouTube < > https://youtube.com/confluent> > -- Ben Stopford Lead Technologist, Office of the CTO <https://www.confluent.io>

Re: New Website Layout

2020-08-12 Thread Ben Stopford
uot; section is rendering as > > > > $1 class="anchor-heading">$8$9$10 > > <https://kafka.apache.org/documentation.html#$4> > > > > with the . Similar thing in > > https://kafka.apache.org/documentation.html#design_quotas. The source > HTML >

Re: New Website Layout

2020-08-10 Thread Ben Stopford
> meaning you can't click on the link to copy and paste the URL. Could the > > old behaviour be restored? > > > > Thanks, > > > > Tom > > > > On Wed, Aug 5, 2020 at 12:43 PM Luke Chen wrote: > > > > > When entering stream

Re: New Website Layout

2020-08-05 Thread Ben Stopford
onsole. I opened a PR to remove the > console.log() call: https://github.com/apache/kafka-site/pull/278 > > On Wed, Aug 5, 2020 at 9:45 AM Ben Stopford wrote: > > > > The new website layout has gone live as you may have seen. There are a > > couple of rendering issues in the strea

Re: New Website Layout

2020-08-05 Thread Ben Stopford
The new website layout has gone live as you may have seen. There are a couple of rendering issues in the streams developer guide that we're getting addressed. If anyone spots anything else could they please reply to this thread. Thanks Ben On Fri, 26 Jun 2020 at 11:48, Ben Stopford

Re: New Website Layout

2020-08-04 Thread Ben Stopford
cs pages to also use most of the page. For instance, config > and > > metrics tables could look more readable using more space. > > Would it be possible to make the left menu expand/collapse, similar to > > current Confluence wiki menu? > > > > Thanks, > &g

Re: [VOTE] KIP-595: A Raft Protocol for the Metadata Quorum

2020-08-03 Thread Ben Stopford
; notified of such changes. > > For me personally, this is super exciting since we have been thinking about > this work ever since I started working on Kafka! I am +1 of course. > > Best, > Jason > -- Ben Stopford Lead Technologist, Office of the CTO <https://www.confluent.io>

New Website Layout

2020-06-26 Thread Ben Stopford
Hey folks We've made some updates to the website's look and feel. There is a staged version in the link below. https://ec2-13-57-18-236.us-west-1.compute.amazonaws.com/ username: kafka password: streaming Comments welcomed. Ben

Re: [VOTE] KIP-279: Fix log divergence between leader and follower after fast leader fail over

2018-04-16 Thread Ben Stopford
+1 thanks Anna On Mon, Apr 16, 2018 at 5:37 PM Jason Gustafson wrote: > +1 Thanks for the KIP! > > On Sun, Apr 15, 2018 at 4:04 PM, Damian Guy wrote: > > > Thanks Anna +1 > > On Sun, 15 Apr 2018 at 15:40, Guozhang Wang wrote: > > > > > Anna, thanks for the KIP! +1 from me. > > > > > > Just one

Re: [DISCUSS] KIP-218: Make KafkaFuture.Function java 8 lambda compatible

2017-11-10 Thread Ben Stopford
Sounds like a good middle ground to me. What do you think Steven? On Mon, Nov 6, 2017 at 8:18 PM Colin McCabe wrote: > It would definitely be nice to use the jdk8 CompletableFuture. I think > that's a bit of a separate discussion, though, since it has such heavy > compatibility implications. >

[jira] [Resolved] (KAFKA-5178) Potential Performance Degradation in Kafka Producer when using Multiple Threads

2017-05-05 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford resolved KAFKA-5178. - Resolution: Not A Problem > Potential Performance Degradation in Kafka Producer when us

[jira] [Updated] (KAFKA-5178) Potential Performance Degradation in Kafka Producer when using Multiple Threads

2017-05-05 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-5178: Attachment: (was: TestDetails.pdf) > Potential Performance Degradation in Kafka Producer w

[jira] [Updated] (KAFKA-5178) Potential Performance Degradation in Kafka Producer when using Multiple Threads

2017-05-05 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-5178: Description: There is evidence that the Kafka Producer drops performance as we increase the number

[jira] [Created] (KAFKA-5178) Potential Performance Degradation in Kafka Producer when using Multiple Threads

2017-05-05 Thread Ben Stopford (JIRA)
Ben Stopford created KAFKA-5178: --- Summary: Potential Performance Degradation in Kafka Producer when using Multiple Threads Key: KAFKA-5178 URL: https://issues.apache.org/jira/browse/KAFKA-5178 Project

[jira] [Updated] (KAFKA-4623) Change Default unclean.leader.election.enabled from True to False

2017-05-02 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-4623: Issue Type: New Feature (was: Task) > Change Default unclean.leader.election.enabled from True

[jira] [Updated] (KAFKA-4623) Change Default unclean.leader.election.enabled from True to False

2017-05-02 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-4623: Issue Type: Improvement (was: New Feature) > Change Default unclean.leader.election.enabled f

[jira] [Updated] (KAFKA-4623) Change Default unclean.leader.election.enabled from True to False

2017-05-02 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-4623: Issue Type: Task (was: Improvement) > Change Default unclean.leader.election.enabled from True

[jira] [Assigned] (KAFKA-4623) Change Default unclean.leader.election.enabled from True to False

2017-05-02 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford reassigned KAFKA-4623: --- Assignee: Ben Stopford (was: Sharad) > Change Default unclean.leader.election.enabled f

[jira] [Assigned] (KAFKA-4623) Change Default unclean.leader.election.enabled from True to False

2017-05-02 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford reassigned KAFKA-4623: --- Assignee: Ben Stopford (was: Sharad) > Change Default unclean.leader.election.enabled f

[jira] [Comment Edited] (KAFKA-5036) Followups from KIP-101

2017-04-10 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15962827#comment-15962827 ] Ben Stopford edited comment on KAFKA-5036 at 4/10/17 6:4

[jira] [Updated] (KAFKA-5036) Followups from KIP-101

2017-04-10 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-5036: Description: 1. It would be safer to hold onto the leader lock in Partition while serving an

[jira] [Commented] (KAFKA-5036) Followups from KIP-101

2017-04-10 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15962827#comment-15962827 ] Ben Stopford commented on KAFKA-5036: - Points 2, 5 are addressed in PR: h

[jira] [Resolved] (KAFKA-4825) Likely Data Loss in ReassignPartitionsTest System Test

2017-03-09 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford resolved KAFKA-4825. - Resolution: Later Resolving this as it will be fixed by KIP-101 in 3.3 > Likely Data Loss

[jira] [Commented] (KAFKA-4825) Likely Data Loss in ReassignPartitionsTest System Test

2017-03-09 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15902877#comment-15902877 ] Ben Stopford commented on KAFKA-4825: - Thanks Jun. Makes sense. > Likely Da

[jira] [Comment Edited] (KAFKA-4825) Likely Data Loss in ReassignPartitionsTest System Test

2017-03-02 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15890661#comment-15890661 ] Ben Stopford edited comment on KAFKA-4825 at 3/2/17 2:5

[jira] [Commented] (KAFKA-4825) Likely Data Loss in ReassignPartitionsTest System Test

2017-03-01 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15890661#comment-15890661 ] Ben Stopford commented on KAFKA-4825: - This could be a result of KIP-101 (h

[jira] [Created] (KAFKA-4825) Likely Data Loss in ReassignPartitionsTest System Test

2017-03-01 Thread Ben Stopford (JIRA)
Ben Stopford created KAFKA-4825: --- Summary: Likely Data Loss in ReassignPartitionsTest System Test Key: KAFKA-4825 URL: https://issues.apache.org/jira/browse/KAFKA-4825 Project: Kafka Issue

Re: KIP-122: Add a tool to Reset Consumer Group Offsets

2017-02-08 Thread Ben Stopford
Yes - using a tool like this to skip a set of consumer groups over a corrupt/bad message is definitely appealing. B On Wed, Feb 8, 2017 at 9:37 PM Gwen Shapira wrote: > I like the --reset-to-earliest and --reset-to-latest. In general, > since the JSON route is the most challenging for users, we

Re: [VOTE] KIP-115: Enforce offsets.topic.replication.factor

2017-01-26 Thread Ben Stopford
+1 Ben Stopford Confluent, http://www.confluent.io <http://www.confluent.io/> > On 26 Jan 2017, at 07:45, James Cheng wrote: > > +1 > >> On Jan 25, 2017, at 9:48 PM, Ewen Cheslack-Postava wrote: >> >> +1 >> >> On Wed, Jan 25, 2017 at 9:23 PM

Re: [DISCUSS] KIP-110: Add Codec for ZStandard Compression

2017-01-25 Thread Ben Stopford
Is there more discussion to be had on this KIP, or should it be taken to a vote? On Mon, Jan 16, 2017 at 6:37 AM Dongjin Lee wrote: > I updated KIP-110 with JMH-measured benchmark results. Please have a review > when you are free. (The overall result is not different yet.) > > Regards, > Dongjin

[jira] [Assigned] (KAFKA-2363) ProducerSendTest.testCloseWithZeroTimeoutFromCallerThread Transient Failure

2017-01-23 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford reassigned KAFKA-2363: --- Assignee: (was: Ben Stopford

[jira] [Updated] (KAFKA-4596) KIP-73 rebalance throttling breaks on plans for specific partitions

2017-01-18 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-4596: Status: Patch Available (was: In Progress) > KIP-73 rebalance throttling breaks on plans

[jira] [Work started] (KAFKA-4596) KIP-73 rebalance throttling breaks on plans for specific partitions

2017-01-18 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4596 started by Ben Stopford. --- > KIP-73 rebalance throttling breaks on plans for specific partiti

Re: [VOTE] KIP-106 - Default unclean.leader.election.enabled True => False

2017-01-11 Thread Ben Stopford
Thanks all. We can consider this accepted. B On Wed, 11 Jan 2017 at 19:49, Apurva Mehta wrote: > +1 (non-binding) > > On Wed, Jan 11, 2017 at 11:45 AM, Gwen Shapira wrote: > > > +1 > > > > On Wed, Jan 11, 2017 at 10:56 AM, Ben Stopford wrote: > > > Looks

Re: [ANNOUNCE] New committer: Grant Henke

2017-01-11 Thread Ben Stopford
Congrats Grant!! On Wed, 11 Jan 2017 at 20:01, Ismael Juma wrote: > Congratulations Grant, well deserved. :) > > Ismael > > On 11 Jan 2017 7:51 pm, "Gwen Shapira" wrote: > > > The PMC for Apache Kafka has invited Grant Henke to join as a > > committer and we are pleased to announce that he has a

[VOTE] KIP-106 - Default unclean.leader.election.enabled True => False

2017-01-11 Thread Ben Stopford
Looks like there was a good consensus on the discuss thread for KIP-106 so lets move to a vote. Please chime in if you would like to change the default for unclean.leader.election.enabled from true to false. https://cwiki.apache.org/confluence/display/KAFKA/%5BWIP%5D+KIP-106+-+Change+Default+uncl

Re: [VOTE] Vote for KIP-101 - Leader Epochs

2017-01-11 Thread Ben Stopford
OK - my mistake was mistaken! There is consensus. This KIP has been accepted. On Wed, Jan 11, 2017 at 6:48 PM Ben Stopford wrote: > Sorry - my mistake. Looks like I still need one more binding vote. Is > there a committer out there that could add their vote? > > B > > On Wed,

Re: [VOTE] Vote for KIP-101 - Leader Epochs

2017-01-11 Thread Ben Stopford
Sorry - my mistake. Looks like I still need one more binding vote. Is there a committer out there that could add their vote? B On Wed, Jan 11, 2017 at 6:44 PM Ben Stopford wrote: > So I believe we can mark this as Accepted. I've updated the KIP page. > Thanks for the input everyone.

Re: [VOTE] Vote for KIP-101 - Leader Epochs

2017-01-11 Thread Ben Stopford
So I believe we can mark this as Accepted. I've updated the KIP page. Thanks for the input everyone. On Fri, Jan 6, 2017 at 9:31 AM Ben Stopford wrote: > Thanks Joel. I'll fix up the pics to make them consistent on nomenclature. > > > B > > On Fri, Jan 6, 2017

Re: [VOTE] Vote for KIP-101 - Leader Epochs

2017-01-06 Thread Ben Stopford
t; 1) In OffsetForLeaderEpochResponse, start_offset probably should be > >> end_offset since it's the end offset of that epoch. > >> 3) That's fine. We can fix KAFKA-1120 separately. > >> > >> Jun > >> > >> > >> On Thu, Jan 5, 20

Re: [VOTE] Vote for KIP-101 - Leader Epochs

2017-01-05 Thread Ben Stopford
/[partitionId]/state in ZK? > > 4. Since there are a few other KIPs involving message format too, it would > be useful to consider if we could combine the message format changes in the > same release. > > Thanks, > > Jun > > > On Wed, Jan 4, 2017 at 9:24 AM, Ben Stopfo

[VOTE] Vote for KIP-101 - Leader Epochs

2017-01-04 Thread Ben Stopford
Hi All We’re having some problems with this thread being subsumed by the [Discuss] thread. Hopefully this one will appear distinct. If you see more than one, please use this one. KIP-101 should now be ready for a vote. As a reminder the KIP proposes a change to the replication protocol to rem

[VOTE] KIP-101: Alter Replication Protocol to use Leader Generation rather than High Watermark for Truncation

2017-01-04 Thread Ben Stopford
Hi All Happy New Year! Hopefully everyone has had an opportunity to review this KIP now, if they wished to, so I'd like to call a vote. As a reminder the KIP proposes a change to the replication protocol to remove the potential for replicas to diverge. https://cwiki.apache.org/confluence/displa

Re: [VOTE] KIP-101: Alter Replication Protocol to use Leader Generation rather than High Watermark for Truncation

2017-01-04 Thread Ben Stopford
Closing this thread. On Tue, Jan 3, 2017 at 6:00 PM Ben Stopford wrote: > Hi All > > Happy New Year! > > Hopefully everyone has had an opportunity to review this KIP now, if they > wished to, so I'd like to call a vote. > > As a reminder the KIP proposes a change t

[DISCUSS] KIP-106 - Change Default unclean.leader.election.enabled from True to False

2017-01-03 Thread Ben Stopford
+unclean.leader.election.enabled+from+True+to+False <https://cwiki.apache.org/confluence/display/KAFKA/[WIP]+KIP-106+-+Change+Default+unclean.leader.election.enabled+from+True+to+False> Thanks B Ben Stopford Confluent, http://www.confluent.io <http://www.confluent.io/>

[VOTE] KIP-101: Alter Replication Protocol to use Leader Generation rather than High Watermark for Truncation

2017-01-03 Thread Ben Stopford
uence/display/KAFKA/KIP-101+-+Alter+Replication+Protocol+to+use+Leader+Epoch+rather+than+High+Watermark+for+Truncation Thanks B On Wed, Dec 21, 2016 at 1:55 PM Ben Stopford wrote: > Thanks Apurva - yes that's one of those funny english phrases which are > often read one way, but are really

Re: [DISCUSS] KIP-101: Alter Replication Protocol to use Leader Generation rather than High Watermark for Truncation

2016-12-21 Thread Ben Stopford
anks, Apurva On Sun, Dec 11, 2016 at 4:30 AM, Ben Stopford wrote: > Hi All > > Please find the below KIP which describes a proposed solution to a couple > of issues that have been observed with the replication protocol. > > In short, the proposal replaces the

Re: [DISCUSS] KIP-101: Alter Replication Protocol to use Leader Generation rather than High Watermark for Truncation

2016-12-20 Thread Ben Stopford
nd up with 2 > notions > > of representing a leader's generation. When we added the epoch, we wanted > > to add it to the log but we didn't. Now that we are adding the generation > > id to the log, I think we should revisit calling it the epoch at all. > Have > &g

[jira] [Commented] (KAFKA-1120) Controller could miss a broker state change

2016-12-15 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750982#comment-15750982 ] Ben Stopford commented on KAFKA-1120: - [~junrao] added this comment on a mail th

[jira] [Commented] (KAFKA-4522) Using Disruptor instead of Array Blocking queue in Kafka Producer

2016-12-14 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15748169#comment-15748169 ] Ben Stopford commented on KAFKA-4522: - It'd be good to have some empirical

Re: [DISCUSS] KIP-101: Alter Replication Protocol to use Leader Generation rather than High Watermark for Truncation

2016-12-14 Thread Ben Stopford
the Jira comments: https://issues.apache.org/jira/browse/KAFKA-1120 <https://issues.apache.org/jira/browse/KAFKA-1120>. Strictly speaking this is a separate issue though and I’ve updated the KIP accordingly. B Ben Stopford Confluent, http://www.confluent.io <http://www.confluent.io/

Re: [DISCUSS] KIP-101: Alter Replication Protocol to use Leader Generation rather than High Watermark for Truncation

2016-12-14 Thread Ben Stopford
Thanks Onur. That’s correct, we no longer nee that extra mapping. I’ll update the KIP. B Ben Stopford Confluent, http://www.confluent.io <http://www.confluent.io/> > On 11 Dec 2016, at 23:54, Onur Karaman wrote: > > Pretty happy to see a KIP tackling this problem! On

Re: [DISCUSS] KIP-101: Alter Replication Protocol to use Leader Generation rather than High Watermark for Truncation

2016-12-14 Thread Ben Stopford
suggest ditch LeaderGeneration. I’ll update the KIP. B Ben Stopford Confluent, http://www.confluent.io <http://www.confluent.io/> > On 11 Dec 2016, at 22:30, Neha Narkhede wrote: > > Good to see this KIP being proposed. Back when I added the epoch to the > replication prot

[DISCUSS] KIP-101: Alter Replication Protocol to use Leader Generation rather than High Watermark for Truncation

2016-12-11 Thread Ben Stopford
+to+use+Leader+Generation+rather+than+High+Watermark+for+Truncation> All comments and suggestions greatly appreciated. Ben Stopford Confluent, http://www.confluent.io <http://www.confluent.io/>

[jira] [Commented] (KAFKA-4178) Replication Throttling: Consolidate Rate Classes

2016-11-23 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15691178#comment-15691178 ] Ben Stopford commented on KAFKA-4178: - Yes, that should be fine. > Repl

[jira] [Created] (KAFKA-4330) Leader/Follower Quota Rates in JMX have ambiguous names

2016-10-21 Thread Ben Stopford (JIRA)
Ben Stopford created KAFKA-4330: --- Summary: Leader/Follower Quota Rates in JMX have ambiguous names Key: KAFKA-4330 URL: https://issues.apache.org/jira/browse/KAFKA-4330 Project: Kafka Issue

[jira] [Created] (KAFKA-4309) Allow "pluggable" properties in KafkaService in System Tests

2016-10-17 Thread Ben Stopford (JIRA)
Ben Stopford created KAFKA-4309: --- Summary: Allow "pluggable" properties in KafkaService in System Tests Key: KAFKA-4309 URL: https://issues.apache.org/jira/browse/KAFKA-4309 Proj

[jira] [Created] (KAFKA-4282) View / Delete Replication Quotas via Config Command EntityName Wildcards for Topic/Broker

2016-10-10 Thread Ben Stopford (JIRA)
Ben Stopford created KAFKA-4282: --- Summary: View / Delete Replication Quotas via Config Command EntityName Wildcards for Topic/Broker Key: KAFKA-4282 URL: https://issues.apache.org/jira/browse/KAFKA-4282

[jira] [Updated] (KAFKA-4266) Replication Quota Tests: Ensure ZK updated before tests start

2016-10-08 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-4266: Description: Alter temporal test in ReassignPartitionsClusterTest so that it doesn't fail i

[jira] [Assigned] (KAFKA-4266) Replication Quota Tests: Ensure ZK updated before tests start

2016-10-07 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford reassigned KAFKA-4266: --- Assignee: Ben Stopford > Replication Quota Tests: Ensure ZK updated before tests st

[jira] [Created] (KAFKA-4266) Replication Quota Tests: Ensure ZK updated before tests start

2016-10-07 Thread Ben Stopford (JIRA)
Ben Stopford created KAFKA-4266: --- Summary: Replication Quota Tests: Ensure ZK updated before tests start Key: KAFKA-4266 URL: https://issues.apache.org/jira/browse/KAFKA-4266 Project: Kafka

[jira] [Created] (KAFKA-4239) Replication Quotas: kafka-configs.sh should allow the throttled rate to be set using broker wildcards

2016-09-30 Thread Ben Stopford (JIRA)
Ben Stopford created KAFKA-4239: --- Summary: Replication Quotas: kafka-configs.sh should allow the throttled rate to be set using broker wildcards Key: KAFKA-4239 URL: https://issues.apache.org/jira/browse/KAFKA-4239

[jira] [Updated] (KAFKA-4225) Replication Quotas: Control Leader & Follower Limit Separately

2016-09-27 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-4225: Description: As we split the throttled replicas into Leader and Follower configs, it makes sense

[jira] [Updated] (KAFKA-4225) Replication Quotas: Control Leader & Follower Limit Separately

2016-09-27 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-4225: Assignee: Ben Stopford Affects Version/s: 0.10.1.0 > Replication Quotas: Cont

[jira] [Created] (KAFKA-4225) Replication Quotas: Control Leader & Follower Limit Separately

2016-09-27 Thread Ben Stopford (JIRA)
Ben Stopford created KAFKA-4225: --- Summary: Replication Quotas: Control Leader & Follower Limit Separately Key: KAFKA-4225 URL: https://issues.apache.org/jira/browse/KAFKA-4225 Project: K

[jira] [Updated] (KAFKA-4216) Replication Quotas: Control Leader & Follower Throttled Replicas Separately

2016-09-26 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-4216: Status: Patch Available (was: In Progress) > Replication Quotas: Control Leader & F

[jira] [Work started] (KAFKA-4216) Replication Quotas: Control Leader & Follower Throttled Replicas Separately

2016-09-26 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4216 started by Ben Stopford. --- > Replication Quotas: Control Leader & Follower Throttled Replicas Sep

[jira] [Updated] (KAFKA-4216) Replication Quotas: Control Leader & Follower Throttled Replicas Separately

2016-09-25 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-4216: Summary: Replication Quotas: Control Leader & Follower Throttled Replicas Separately

[DISCUSS] KIP-73: Replication Quotas

2016-09-25 Thread Ben Stopford
Hi All We’ve made an adjustment to KIP-73: Replication Quotas which I’d like to open up to the community for approval. Previously the admin passed a list of replicas to be throttled: quota.replication.throttled.replicas = [partId]:[replica],[partId]:[replica],[partId]:[replica] etc T

[jira] [Updated] (KAFKA-4216) Replication Throttling: Leader may not be throttled if it is not "moving"

2016-09-25 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-4216: Description: The current algorithm in kafka-reassign-partitions applies a throttle to all moving

[jira] [Updated] (KAFKA-4216) Replication Throttling: Leader may not be throttled if it is not "moving"

2016-09-24 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-4216: Description: The current algorithm in kafka-reassign-partitions applies a throttle to all moving

[jira] [Created] (KAFKA-4216) Replication Throttling: Leader may not be throttled if it is not "moving"

2016-09-24 Thread Ben Stopford (JIRA)
Ben Stopford created KAFKA-4216: --- Summary: Replication Throttling: Leader may not be throttled if it is not "moving" Key: KAFKA-4216 URL: https://issues.apache.org/jira/browse/KAFKA-4216 Proj

[jira] [Created] (KAFKA-4210) Improve Replication Follower Throttling Stability By Checking Quota During Backoff

2016-09-23 Thread Ben Stopford (JIRA)
Ben Stopford created KAFKA-4210: --- Summary: Improve Replication Follower Throttling Stability By Checking Quota During Backoff Key: KAFKA-4210 URL: https://issues.apache.org/jira/browse/KAFKA-4210

[jira] [Commented] (KAFKA-4178) Replication Throttling: Consolidate Rate Classes

2016-09-22 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15512485#comment-15512485 ] Ben Stopford commented on KAFKA-4178: - Thanks Joel. Actually this comment, from

[jira] [Updated] (KAFKA-4200) Minor issue with throttle argument in kafka-reassign-partitions.sh

2016-09-21 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-4200: Status: Patch Available (was: In Progress) > Minor issue with throttle argument in kafka-reass

[jira] [Work started] (KAFKA-4200) Minor issue with throttle argument in kafka-reassign-partitions.sh

2016-09-21 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4200 started by Ben Stopford. --- > Minor issue with throttle argument in kafka-reassign-partitions

[jira] [Assigned] (KAFKA-4200) Minor issue with throttle argument in kafka-reassign-partitions.sh

2016-09-20 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford reassigned KAFKA-4200: --- Assignee: Ben Stopford > Minor issue with throttle argument in kafka-reassign-partitions

[jira] [Created] (KAFKA-4200) Minor issue with throttle argument in kafka-reassign-partitions.sh

2016-09-20 Thread Ben Stopford (JIRA)
Ben Stopford created KAFKA-4200: --- Summary: Minor issue with throttle argument in kafka-reassign-partitions.sh Key: KAFKA-4200 URL: https://issues.apache.org/jira/browse/KAFKA-4200 Project: Kafka

[jira] [Commented] (KAFKA-4197) Make ReassignPartitionsTest System Test move data

2016-09-20 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15506446#comment-15506446 ] Ben Stopford commented on KAFKA-4197: - https://github.com/apache/kafka/pull/

[jira] [Updated] (KAFKA-4197) Make ReassignPartitionsTest System Test move data

2016-09-20 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-4197: Assignee: Ben Stopford Status: Patch Available (was: Open) > Make ReassignPartitionsT

[jira] [Created] (KAFKA-4197) Make ReassignPartitionsTest System Test move data

2016-09-20 Thread Ben Stopford (JIRA)
Ben Stopford created KAFKA-4197: --- Summary: Make ReassignPartitionsTest System Test move data Key: KAFKA-4197 URL: https://issues.apache.org/jira/browse/KAFKA-4197 Project: Kafka Issue Type

[jira] [Commented] (KAFKA-4177) Replication Throttling: Remove ThrottledReplicationRateLimit from Server Config

2016-09-19 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15504230#comment-15504230 ] Ben Stopford commented on KAFKA-4177: - Patch submitted here: https://github

[jira] [Updated] (KAFKA-4177) Replication Throttling: Remove ThrottledReplicationRateLimit from Server Config

2016-09-19 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-4177: Status: Patch Available (was: In Progress) > Replication Throttling: Rem

[jira] [Updated] (KAFKA-4193) FetcherTest fails intermittently

2016-09-19 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-4193: Status: Patch Available (was: In Progress) > FetcherTest fails intermitten

[jira] [Work started] (KAFKA-4193) FetcherTest fails intermittently

2016-09-19 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4193 started by Ben Stopford. --- > FetcherTest fails intermitten

[jira] [Created] (KAFKA-4193) FetcherTest fails intermittently in the presence of the fixed message size change

2016-09-19 Thread Ben Stopford (JIRA)
Ben Stopford created KAFKA-4193: --- Summary: FetcherTest fails intermittently in the presence of the fixed message size change Key: KAFKA-4193 URL: https://issues.apache.org/jira/browse/KAFKA-4193

[jira] [Assigned] (KAFKA-4193) FetcherTest fails intermittently

2016-09-19 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford reassigned KAFKA-4193: --- Assignee: Ben Stopford > FetcherTest fails intermitten

[jira] [Updated] (KAFKA-4193) FetcherTest fails intermittently

2016-09-19 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-4193: Summary: FetcherTest fails intermittently (was: FetcherTest fails intermittently in the presence

[jira] [Work started] (KAFKA-4184) Test failure in ReplicationQuotasTest.shouldBootstrapTwoBrokersWithFollowerThrottle

2016-09-17 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4184 started by Ben Stopford. --- > Test failure

[jira] [Commented] (KAFKA-3438) Rack Aware Replica Reassignment should warn of overloaded brokers

2016-09-16 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15498293#comment-15498293 ] Ben Stopford commented on KAFKA-3438: - Sorry, missed your original comment. Go fo

[jira] [Assigned] (KAFKA-4177) Replication Throttling: Remove ThrottledReplicationRateLimit from Server Config

2016-09-16 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford reassigned KAFKA-4177: --- Assignee: Ben Stopford > Replication Throttling: Remove ThrottledReplicationRateLimit f

[jira] [Work started] (KAFKA-4177) Replication Throttling: Remove ThrottledReplicationRateLimit from Server Config

2016-09-16 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4177 started by Ben Stopford. --- > Replication Throttling: Remove ThrottledReplicationRateLimit from Ser

[jira] [Updated] (KAFKA-4179) Replication Throttling: Add Usability Metrics PartitionBytesInRate & SumReplicaLag

2016-09-16 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-4179: Affects Version/s: 0.10.1.0 Description: Add two new metrics to Kafka

[jira] [Created] (KAFKA-4179) Replication Throttling: Add Usability Metrics PartitionBytesInRate & SumReplicaLag

2016-09-16 Thread Ben Stopford (JIRA)
Ben Stopford created KAFKA-4179: --- Summary: Replication Throttling: Add Usability Metrics PartitionBytesInRate & SumReplicaLag Key: KAFKA-4179 URL: https://issues.apache.org/jira/browse/KAFKA-

[jira] [Created] (KAFKA-4178) Replication Throttling: Consolidate Rate Classes

2016-09-16 Thread Ben Stopford (JIRA)
Ben Stopford created KAFKA-4178: --- Summary: Replication Throttling: Consolidate Rate Classes Key: KAFKA-4178 URL: https://issues.apache.org/jira/browse/KAFKA-4178 Project: Kafka Issue Type

[jira] [Created] (KAFKA-4177) Replication Throttling: Remove ThrottledReplicationRateLimit from Server Config

2016-09-16 Thread Ben Stopford (JIRA)
Ben Stopford created KAFKA-4177: --- Summary: Replication Throttling: Remove ThrottledReplicationRateLimit from Server Config Key: KAFKA-4177 URL: https://issues.apache.org/jira/browse/KAFKA-4177 Project

Re: [VOTE] KIP-73 - Replication Quotas

2016-08-23 Thread Ben Stopford
ff-thread) > > On Fri, Aug 19, 2016 at 1:21 AM, Ben Stopford wrote: > >> I’d like to initiate the voting process for KIP-73: >> https://cwiki.apache.org/confluence/display/KAFKA/KIP- >> 73+Replication+Quotas <https://cwiki.apache.org/ >> confluence/display/KAFKA/KIP-73+Replication+Quotas> >> >> Ben

  1   2   3   >