Re: New client commitAsync problem

2016-02-06 Thread Jason Gustafson
> > - is it cost something? is it any network activity to pause/resume? That is a great question. The pause() method sets an internal flag which tells the consumer not to send any more fetches. If a fetch was in progress and returned while the partition was still paused, then the fetched data wil

Re: Detecting broker version programmatically

2016-02-06 Thread marko
This sounds like a good approach, since it does not depend on JMX. There doesn't seem to be an easy way to make these API calls using the new Java-client, though. Everything is kind of hidden behind the KafkaConsumer and KafkaProducer classes. Marko www.kafkatool.com > I think it is possible to i

Re: New client commitAsync problem

2016-02-06 Thread Alexey Romanchuk
Hi Jason! Thanks for reply. I try to implement it and looks like it works. Few moments about pause/resume: - is it cost something? is it any network activity to pause/resume? - there is no API to get information of current status of resume/pause for client. Am I wrong? What about having such API?

Re: MongoDB Kafka Connect driver

2016-02-06 Thread Sunny Shah
Hello Everyone, Thanks a lot for your valuable responses. We will use external database to store Key and Kafka-offset, We won't set any preference on which database to use, We will leave it to the driver-user by using a flexible data-access-model like Apache Metamodel. @James, Even for MongoDB c