Re: Kafka Connector for Solr

2016-04-24 Thread Gwen Shapira
Thank you, Surendra. I've added your connector to the Connector Hub page: http://www.confluent.io/developers/connectors On Fri, Apr 22, 2016 at 10:11 PM, Surendra , Manchikanti wrote: > Hi Jay, > > Thanks!! Can you please share the contact person to include this in > Confluent Coneector Hub pag

Re: How to "buffer" a stream with high churn and output only at the end of a window?

2016-04-24 Thread Guozhang Wang
Henry, Thanks for the great feedbacks. I'm making some proposal for adding the control mechanism for latency v.s. data volume tradeoffs, which I will put up to wiki once it is done: https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Streams+Discussions We can continue the discussion from th

Re: poll() semantics

2016-04-24 Thread Richard Rodseth
Thanks. Yes I get that it's bytes. Good to know about the new setting. On Sun, Apr 24, 2016 at 10:19 AM, Jens Rantil wrote: > Hi Richard, > > > which defaults to a very large large number, will affect the number of > records returned by each call to poll() > > No, it will affect the total sum of

Re: poll method thread

2016-04-24 Thread Liquan Pei
Hi Spico, Kafka Consumer is single threaded which means all operations such as sending heart beat, fech records and maintain group membership are done in the same thread as the caller. Also, poll() is a blocking method with timeout and you can interrupt it with the wakeup method in Kafka Consumer

poll method thread

2016-04-24 Thread Spico Florin
hi! i would like to ask if the kafka consumer poll method is done in aseprated thread than the caller or in the same thread as the caller? it is syncriunous blocking method or asynch? thank you florin

Re: poll() semantics

2016-04-24 Thread Jens Rantil
Hi Richard, > which defaults to a very large large number, will affect the number of records returned by each call to poll() No, it will affect the total sum of the message sizes fetched. This is not the same as "number of messages". The upcoming release of 9.1 (not out yet) will contain a settin