Re: max.task.idle.ms behavior

2019-01-15 Thread Matthias J. Sax
The parameter applies too all three topics (input, intermediate, repartitions topics) and it's a global config. About the blocking behavior: If one partitions becomes empty, all other partitions are paused() and Streams only poll() for the empty partition. If no data is returned within the

Re: [ANNOUNCE] New Committer: Vahid Hashemian

2019-01-15 Thread Dongjin Lee
Congratulations, Vahid!! On Wed, Jan 16, 2019 at 3:32 PM Dong Lin wrote: > Congratulations Vahid! > > On Tue, Jan 15, 2019 at 2:45 PM Jason Gustafson > wrote: > > > Hi All, > > > > The PMC for Apache Kafka has invited Vahid Hashemian as a project > > committer and > > we are > > pleased to

Re: [ANNOUNCE] New Committer: Vahid Hashemian

2019-01-15 Thread Jan Filipiak
Congratz! On 15.01.2019 23:44, Jason Gustafson wrote: > Hi All, > > The PMC for Apache Kafka has invited Vahid Hashemian as a project committer > and > we are > pleased to announce that he has accepted! > > Vahid has made numerous contributions to the Kafka community over the past > few years.

Re: [ANNOUNCE] New Committer: Vahid Hashemian

2019-01-15 Thread Suman B N
Congrats Vahid! On Wed, Jan 16, 2019 at 12:02 PM Dong Lin wrote: > Congratulations Vahid! > > On Tue, Jan 15, 2019 at 2:45 PM Jason Gustafson > wrote: > > > Hi All, > > > > The PMC for Apache Kafka has invited Vahid Hashemian as a project > > committer and > > we are > > pleased to announce

Re: [ANNOUNCE] New Committer: Vahid Hashemian

2019-01-15 Thread Dong Lin
Congratulations Vahid! On Tue, Jan 15, 2019 at 2:45 PM Jason Gustafson wrote: > Hi All, > > The PMC for Apache Kafka has invited Vahid Hashemian as a project > committer and > we are > pleased to announce that he has accepted! > > Vahid has made numerous contributions to the Kafka community

Re: [ANNOUNCE] New Committer: Vahid Hashemian

2019-01-15 Thread Alex D
Congrats, Vahid! On Wed, 16 Jan 2019, 05:54 Gwen Shapira Congrats, Vahid. Thank you for all your contribution! > > On Tue, Jan 15, 2019, 2:45 PM Jason Gustafson > > Hi All, > > > > The PMC for Apache Kafka has invited Vahid Hashemian as a project > > committer and > > we are > > pleased to

Re: [ANNOUNCE] New Committer: Vahid Hashemian

2019-01-15 Thread Gwen Shapira
Congrats, Vahid. Thank you for all your contribution! On Tue, Jan 15, 2019, 2:45 PM Jason Gustafson Hi All, > > The PMC for Apache Kafka has invited Vahid Hashemian as a project > committer and > we are > pleased to announce that he has accepted! > > Vahid has made numerous contributions to the

Re: [ANNOUNCE] New Committer: Vahid Hashemian

2019-01-15 Thread hacker win7
Congrats! > On Jan 16, 2019, at 10:08, Srinivas Reddy wrote: > > Congratulation Vahid!!! > > >> On 16 Jan 2019, at 9:58 AM, Manikumar wrote: >> >> Congrats, Vahid! >> >> On Wed 16 Jan, 2019, 6:53 AM Ismael Juma > >>> Congratulations Vahid! >>> >>> On Tue, Jan 15, 2019, 2:45 PM Jason

Re: [ANNOUNCE] New Committer: Vahid Hashemian

2019-01-15 Thread Srinivas Reddy
Congratulation Vahid!!! > On 16 Jan 2019, at 9:58 AM, Manikumar wrote: > > Congrats, Vahid! > > On Wed 16 Jan, 2019, 6:53 AM Ismael Juma >> Congratulations Vahid! >> >> On Tue, Jan 15, 2019, 2:45 PM Jason Gustafson > >>> Hi All, >>> >>> The PMC for Apache Kafka has invited Vahid

Re: [ANNOUNCE] New Committer: Vahid Hashemian

2019-01-15 Thread Manikumar
Congrats, Vahid! On Wed 16 Jan, 2019, 6:53 AM Ismael Juma Congratulations Vahid! > > On Tue, Jan 15, 2019, 2:45 PM Jason Gustafson > > Hi All, > > > > The PMC for Apache Kafka has invited Vahid Hashemian as a project > > committer and > > we are > > pleased to announce that he has accepted! > >

Re: [ANNOUNCE] New Committer: Vahid Hashemian

2019-01-15 Thread Ismael Juma
Congratulations Vahid! On Tue, Jan 15, 2019, 2:45 PM Jason Gustafson Hi All, > > The PMC for Apache Kafka has invited Vahid Hashemian as a project > committer and > we are > pleased to announce that he has accepted! > > Vahid has made numerous contributions to the Kafka community over the past >

Re: [ANNOUNCE] New Committer: Vahid Hashemian

2019-01-15 Thread Martin Gainty
Բարի գալուստ (Bari Galust) From: Satish Duggana Sent: Tuesday, January 15, 2019 7:54 PM To: dev Cc: Kafka Users Subject: Re: [ANNOUNCE] New Committer: Vahid Hashemian Congratulations Vahid! On Tue, Jan 15, 2019 at 5:47 PM Yishun Guan wrote: > >

Re: [ANNOUNCE] New Committer: Vahid Hashemian

2019-01-15 Thread Satish Duggana
Congratulations Vahid! On Tue, Jan 15, 2019 at 5:47 PM Yishun Guan wrote: > > Congratulations! > > On Tue, Jan 15, 2019, 16:46 James Cheng wrote: > > > Congrats, Vahid!! > > > > -James > > > > > On Jan 15, 2019, at 2:44 PM, Jason Gustafson wrote: > > > > > > Hi All, > > > > > > The PMC for

Re: [ANNOUNCE] New Committer: Vahid Hashemian

2019-01-15 Thread Yishun Guan
Congratulations! On Tue, Jan 15, 2019, 16:46 James Cheng wrote: > Congrats, Vahid!! > > -James > > > On Jan 15, 2019, at 2:44 PM, Jason Gustafson wrote: > > > > Hi All, > > > > The PMC for Apache Kafka has invited Vahid Hashemian as a project > committer and > > we are > > pleased to announce

Re: [ANNOUNCE] New Committer: Vahid Hashemian

2019-01-15 Thread James Cheng
Congrats, Vahid!! -James > On Jan 15, 2019, at 2:44 PM, Jason Gustafson wrote: > > Hi All, > > The PMC for Apache Kafka has invited Vahid Hashemian as a project committer > and > we are > pleased to announce that he has accepted! > > Vahid has made numerous contributions to the Kafka

Re: [ANNOUNCE] New Committer: Vahid Hashemian

2019-01-15 Thread Jun Rao
Congratulations, Vahid. Thanks, Jun On Tue, Jan 15, 2019 at 2:45 PM Jason Gustafson wrote: > Hi All, > > The PMC for Apache Kafka has invited Vahid Hashemian as a project > committer and > we are > pleased to announce that he has accepted! > > Vahid has made numerous contributions to the

Re: [ANNOUNCE] New Committer: Vahid Hashemian

2019-01-15 Thread Guozhang Wang
Congratulations Vahid! Guozhang On Tue, Jan 15, 2019 at 2:58 PM Bill Bejeck wrote: > Congrats! > > On Tue, Jan 15, 2019 at 5:50 PM Rajini Sivaram > wrote: > > > Congratulations, Vahid! Well deserved!! > > > > Regards, > > > > Rajini > > > > On Tue, Jan 15, 2019 at 10:45 PM Jason Gustafson >

Re: [ANNOUNCE] New Committer: Vahid Hashemian

2019-01-15 Thread Bill Bejeck
Congrats! On Tue, Jan 15, 2019 at 5:50 PM Rajini Sivaram wrote: > Congratulations, Vahid! Well deserved!! > > Regards, > > Rajini > > On Tue, Jan 15, 2019 at 10:45 PM Jason Gustafson > wrote: > > > Hi All, > > > > The PMC for Apache Kafka has invited Vahid Hashemian as a project > > committer

Re: [ANNOUNCE] New Committer: Vahid Hashemian

2019-01-15 Thread Rajini Sivaram
Congratulations, Vahid! Well deserved!! Regards, Rajini On Tue, Jan 15, 2019 at 10:45 PM Jason Gustafson wrote: > Hi All, > > The PMC for Apache Kafka has invited Vahid Hashemian as a project > committer and > we are > pleased to announce that he has accepted! > > Vahid has made numerous

[ANNOUNCE] New Committer: Vahid Hashemian

2019-01-15 Thread Jason Gustafson
Hi All, The PMC for Apache Kafka has invited Vahid Hashemian as a project committer and we are pleased to announce that he has accepted! Vahid has made numerous contributions to the Kafka community over the past few years. He has authored 13 KIPs with core improvements to the consumer and the

Subscribe me, please

2019-01-15 Thread Javier Arias Losada

Question on librdkafka.Dll rd_kafka_topic_result_error

2019-01-15 Thread Super User
The number on threads grows as application continue on pooling message. I got almost 1000 threads hanging and a thousands of connection established. Here is the stack for a thread: 0x ntdll.dll!NtWaitForSingleObject+0x14 mswsock.dll!Tcpip4_WSHOpenSocket2+0x332

Does Kafka batch when using broker-side compression?

2019-01-15 Thread Sven Ludwig
Hi, does a Kafka broker batch messages together in order to improve compression when using broker-side compression only? If so, what are the prerequisites to get that behavior? Perhaps a batching of messages at a producer might be beneficial or even mandatory in order to get batches in the

Re: max.task.idle.ms behavior

2019-01-15 Thread Peter Levart
Another question about this parameter. Does that parameter apply just to input topics to the KafkaStreams topology or also to intermediate (repartitioning) topics or to intermediate topics configured with KStream.through() directive? Is it possible to control the behavior on a per-topic

max.task.idle.ms behavior

2019-01-15 Thread Peter Levart
Hello! I'm trying to understand the behavior of Kafka Streams consumers with regards to max.task.idle.ms configuration parameter (default 0). The documentation says: max.task.idle.ms     Medium     Maximum amount of time a stream task will stay idle when not all of its partition buffers