Re: Async Non Blocking Kafka Producer

2017-06-07 Thread Ankit Jain
Thanks hans. It would work but producer will start loosing the data even the Cluster is available. Thanks Ankit Jain On Wed, Jun 7, 2017 at 12:56 PM, Hans Jespersen wrote: > Try adding props.put("max.block.ms", "0"); > > -hans > > > > > On

Async Non Blocking Kafka Producer

2017-06-07 Thread Ankit Jain
Hi, We want to use the non blocking Kafka producer. The producer thread should not block if the Kafka is cluster is down or not reachable. Currently, we are setting following properties but the Producer thread is still blocking if the Kafka cluster goes gown or unreachable. * props.put("block.on

Kafka 0.9 Spout

2016-03-01 Thread Ankit Jain
Hi All, We would need to use the SSL feature of Kafka and that would require the Kafka Spout upgrade from version 0.8.x to 0.9.x as the SSL is only supported by new consumer API. Please share any URL for the same. -- Thanks, Ankit

Re: Kafka Cluster behind Proxy

2015-08-17 Thread Ankit Jain
Sent with Airmail > > On August 17, 2015 at 12:28:19 AM, Ankit Jain (ankitjainc...@gmail.com) > wrote: > > Hi All, > > We want to deploy the Kafka cluster behind the proxy. We are exposing the > proxy IP to client. The client is using the proxy IP to connect to > zookeepe

Kafka Cluster behind Proxy

2015-08-17 Thread Ankit Jain
ectly communicate to Kafka Cluster. The IP's return by zookeeper are Kafka IP's and which are not open for client. We want to provide all the access through proxy only. Please let me know, how we can use Kafka Cluster behind Proxy. -- Thanks, Ankit Jain

Get replication and partition count of a topic

2015-01-12 Thread Ankit Jain
Hi All, I want to get the replication and partition count of a topic. I tried the following piece of code: java.util.Set topics = new HashSet(); topics.add("topicName"); Set topicMetadatas = AdminUtils.fetchTopicMetadataFromZk(JavaConversions.asScalaSet(topics), zkCli

Kafka replication factor mode

2014-12-05 Thread Ankit Jain
Hi All, I have two nodes kafka cluster and using replication factor 2. If both the node is running, then i am able to push data, but if any nodes goes down, then getting exception. I explored and found that, the default replication factor mode is quorum, means at least (f+1) node must be availa

Kafka 0.8 High level consumer : Stream Iterator is blocking

2013-07-10 Thread Ankit Jain
/confluence/display/KAFKA/0.8.0+SimpleConsumer+Example The configuration for High Level consumer is default configuration. Thanks for your help in advance. Regards, Ankit Jain NOTE: This message may contain information that is confidential, proprietary

Zero downtime upgrade

2013-06-25 Thread Ankit Jain
Hi All, I would like to know about the ways to upgrade or apply new patches in Kafka with zero downtime. Thanks, Ankit Jain NOTE: This message may contain information that is confidential, proprietary, privileged or otherwise protected by law. The

C++ Kafka producer library for windows

2013-05-02 Thread Ankit Jain
ow to connect to Kafka using Zookeeper or directly? If possible please suggest some C++ libraries for writing Kafka producer that would run fine on Windows. Thanks a lot in Advance. Regards, Ankit Jain NOTE: This message may contain information th

Kafka log retentions

2013-04-01 Thread Ankit Jain
Hi All, Once the message is consumed by consumer, we want it to delete from message broker as well. I was exploring the kafka configuration, but not sure which configuration would full my need. Guys, I need your help. Thanks .. -- Thanks, Ankit Jain