Re: [DISCUSS] KIP-345: Reduce multiple consumer rebalances by specifying member id

2018-08-20 Thread Boyang Chen
Thanks Matthias for the input. Sorry I was busy recently and haven't got time to update this thread. To summarize what we come up so far, here is a draft updated plan: Introduce a new config called `member.name` which is supposed to be provided uniquely by the consumer client. The broker will

Jenkins build is back to normal : kafka-trunk-jdk8 #2911

2018-08-20 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk10 #420

2018-08-20 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-5891; Proper handling of LogicalTypes in Cast (#4633) -- [...truncated 1.54 MB...] kafka.coordinator.transaction.TransactionCoordinatorTest >

Build failed in Jenkins: kafka-1.1-jdk7 #184

2018-08-20 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-5891; Proper handling of LogicalTypes in Cast (#4633) -- [...truncated 1.93 MB...]

[jira] [Created] (KAFKA-7316) Use of filter method in KTable.scala may result in StackOverflowError

2018-08-20 Thread Ted Yu (JIRA)
Ted Yu created KAFKA-7316: - Summary: Use of filter method in KTable.scala may result in StackOverflowError Key: KAFKA-7316 URL: https://issues.apache.org/jira/browse/KAFKA-7316 Project: Kafka Issue

[jira] [Created] (KAFKA-7317) Use collections subscription for main consumer to reduce metadata

2018-08-20 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created KAFKA-7317: -- Summary: Use collections subscription for main consumer to reduce metadata Key: KAFKA-7317 URL: https://issues.apache.org/jira/browse/KAFKA-7317 Project: Kafka

[jira] [Resolved] (KAFKA-5891) Cast transformation fails if record schema contains timestamp field

2018-08-20 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-5891. Resolution: Fixed Fix Version/s: 2.0.1 1.1.2

Build failed in Jenkins: kafka-trunk-jdk10 #419

2018-08-20 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-7311: Reset next batch expiry time on each poll loop [jason] KAFKA-6312; Document --reset-offsets option for consumer group tool --

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

2018-08-20 Thread Mayuresh Gharat
Congrats Dong !!! Thanks, Mayuresh On Mon, Aug 20, 2018 at 1:36 PM Gwen Shapira wrote: > Congrats Dong Lin! Well deserved! > > On Mon, Aug 20, 2018, 3:55 AM Ismael Juma wrote: > > > Hi everyone, > > > > Dong Lin became a committer in March 2018. Since then, he has remained > > active in the

Build failed in Jenkins: kafka-trunk-jdk8 #2910

2018-08-20 Thread Apache Jenkins Server
See Changes: [junrao] KAFKA-6835: Enable topic unclean leader election to be enabled without [jason] KAFKA-7278; replaceSegments() should not call asyncDeleteSegment() for [wangguoz] KAFKA-7311: Reset next

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

2018-08-20 Thread Gwen Shapira
Congrats Dong Lin! Well deserved! On Mon, Aug 20, 2018, 3:55 AM Ismael Juma wrote: > Hi everyone, > > Dong Lin became a committer in March 2018. Since then, he has remained > active in the community and contributed a number of patches, reviewed > several pull requests and participated in

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

2018-08-20 Thread Vahid Hashemian
Congratulations Dong! --Vahid On Mon, Aug 20, 2018 at 1:08 PM Guozhang Wang wrote: > Congratulations Dong! > > On Mon, Aug 20, 2018 at 10:59 AM, Matthias J. Sax > wrote: > > > Congrats Dong! > > > > -Matthias > > > > On 8/20/18 3:54 AM, Ismael Juma wrote: > > > Hi everyone, > > > > > > Dong

Jenkins build is back to normal : kafka-trunk-jdk8 #2909

2018-08-20 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-7315) Streams serialization docs contain a broken link for Avro

2018-08-20 Thread John Roesler (JIRA)
John Roesler created KAFKA-7315: --- Summary: Streams serialization docs contain a broken link for Avro Key: KAFKA-7315 URL: https://issues.apache.org/jira/browse/KAFKA-7315 Project: Kafka Issue

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

2018-08-20 Thread Guozhang Wang
Congratulations Dong! On Mon, Aug 20, 2018 at 10:59 AM, Matthias J. Sax wrote: > Congrats Dong! > > -Matthias > > On 8/20/18 3:54 AM, Ismael Juma wrote: > > Hi everyone, > > > > Dong Lin became a committer in March 2018. Since then, he has remained > > active in the community and contributed a

[jira] [Resolved] (KAFKA-7311) Sender should reset next batch expiry time between poll loops

2018-08-20 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-7311. -- Resolution: Fixed > Sender should reset next batch expiry time between poll loops >

Jenkins build is back to normal : kafka-trunk-jdk10 #417

2018-08-20 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-7314) MirrorMaker example in documentation does not work

2018-08-20 Thread John Wilkinson (JIRA)
John Wilkinson created KAFKA-7314: - Summary: MirrorMaker example in documentation does not work Key: KAFKA-7314 URL: https://issues.apache.org/jira/browse/KAFKA-7314 Project: Kafka Issue

[jira] [Resolved] (KAFKA-7278) replaceSegments() should not call asyncDeleteSegment() for segments which have been removed from segments list

2018-08-20 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-7278. Resolution: Fixed Fix Version/s: 2.0.1 > replaceSegments() should not call

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

2018-08-20 Thread Matthias J. Sax
Congrats Dong! -Matthias On 8/20/18 3:54 AM, Ismael Juma wrote: > Hi everyone, > > Dong Lin became a committer in March 2018. Since then, he has remained > active in the community and contributed a number of patches, reviewed > several pull requests and participated in numerous KIP discussions.

Re: [DISCUSS] KIP-358: Migrate Streams API to Duration instead of long ms times

2018-08-20 Thread Nikolay Izhikov
Hello, Ted. Thanks for the comment. I've edit KIP and change proposal to `windowSize`. Guys, any other comments? В Вс, 19/08/2018 в 14:57 -0700, Ted Yu пишет: > bq. // or just Duration windowSize(); > > +1 to the above choice. > The duration is obvious from the return type. For getter

[jira] [Resolved] (KAFKA-7303) Kafka client is stuck when specifying wrong brokers

2018-08-20 Thread Chun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chun Zhang resolved KAFKA-7303. --- Resolution: Duplicate > Kafka client is stuck when specifying wrong brokers >

[jira] [Resolved] (KAFKA-6835) Enable topic unclean leader election to be enabled without controller change

2018-08-20 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-6835. Resolution: Fixed Merged the PR to trunk. > Enable topic unclean leader election to be enabled without

[jira] [Resolved] (KAFKA-7298) Concurrent DeleteRecords can lead to fatal OutOfSequence error in producer

2018-08-20 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-7298. Resolution: Fixed Fix Version/s: 2.0.1 > Concurrent DeleteRecords can lead to fatal

Re: [DISCUSS] KIP-291: Have separate queues for control requests and data requests

2018-08-20 Thread Eno Thereska
Hi folks, I looked at the previous numbers that Lucas provided (thanks!) but it's still not clear to me whether the performance benefits justify the added complexity. I'm looking for some intuition here (a graph would be great but not required): for a small/medium/large cluster, what are the

Build failed in Jenkins: kafka-trunk-jdk8 #2908

2018-08-20 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-7210: Add system test to verify log compaction (#5226) -- [...truncated 2.48 MB...]

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

2018-08-20 Thread Attila Sasvári
Congratulations Dong! Well deserved. Regards, Attila Paolo Patierno ezt írta (időpont: 2018. aug. 20., H 15:09): > Congratulations Dong! > > Paolo Patierno > Principal Software Engineer (IoT) @ Red Hat > Microsoft MVP on Azure & IoT > Microsoft Azure Advisor > > Twitter :

Re: [DISCUSS] KIP-291: Have separate queues for control requests and data requests

2018-08-20 Thread Becket Qin
Hi Lucas, In KIP-103, we introduced a convention to define and look up the listeners. So it would be good if the later KIPs can follow the same convention. >From what I understand, the advertised.listeners is actually designed for our purpose, i.e. providing a list of listeners that can be used

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

2018-08-20 Thread Paolo Patierno
Congratulations Dong! Paolo Patierno Principal Software Engineer (IoT) @ Red Hat Microsoft MVP on Azure & IoT Microsoft Azure Advisor Twitter : @ppatierno Linkedin : paolopatierno Blog :

Build failed in Jenkins: kafka-trunk-jdk10 #416

2018-08-20 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-7210: Add system test to verify log compaction (#5226) -- [...truncated 1.54 MB...] kafka.coordinator.transaction.TransactionCoordinatorTest

Re: [VOTE] KIP-349 Priorities for Source Topics

2018-08-20 Thread Thomas Becker
I agree with Jan. A strategy interface for choosing processing order is nice, and would hopefully be a step towards getting this in streams. -Tommy On Mon, 2018-08-20 at 12:52 +0200, Jan Filipiak wrote: On 20.08.2018 00:19, Matthias J. Sax wrote: @Nick: A KIP is only accepted if it got 3

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

2018-08-20 Thread Dongjin Lee
Congratulations!! On Mon, Aug 20, 2018 at 9:22 PM Mickael Maison wrote: > Congratulations Dong! > On Mon, Aug 20, 2018 at 12:46 PM Manikumar > wrote: > > > > Congrats, Dong Lin! > > > > On Mon, Aug 20, 2018 at 4:25 PM Ismael Juma wrote: > > > > > Hi everyone, > > > > > > Dong Lin became a

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

2018-08-20 Thread Mickael Maison
Congratulations Dong! On Mon, Aug 20, 2018 at 12:46 PM Manikumar wrote: > > Congrats, Dong Lin! > > On Mon, Aug 20, 2018 at 4:25 PM Ismael Juma wrote: > > > Hi everyone, > > > > Dong Lin became a committer in March 2018. Since then, he has remained > > active in the community and contributed a

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

2018-08-20 Thread Manikumar
Congrats, Dong Lin! On Mon, Aug 20, 2018 at 4:25 PM Ismael Juma wrote: > Hi everyone, > > Dong Lin became a committer in March 2018. Since then, he has remained > active in the community and contributed a number of patches, reviewed > several pull requests and participated in numerous KIP

[ANNOUNCE] New Kafka PMC member: Dong Lin

2018-08-20 Thread Ismael Juma
Hi everyone, Dong Lin became a committer in March 2018. Since then, he has remained active in the community and contributed a number of patches, reviewed several pull requests and participated in numerous KIP discussions. I am happy to announce that Dong is now a member of the Apache Kafka PMC.

Re: [VOTE] KIP-349 Priorities for Source Topics

2018-08-20 Thread Jan Filipiak
On 20.08.2018 00:19, Matthias J. Sax wrote: @Nick: A KIP is only accepted if it got 3 binding votes, ie, votes from committers. If you close the vote before that, the KIP would not be accepted. Note that committers need to pay attention to a lot of KIPs and it can take a while until people can

[jira] [Resolved] (KAFKA-7210) Add system test for log compaction

2018-08-20 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-7210. Resolution: Fixed > Add system test for log compaction > -- > >