Re: commitSync with new Subscriber API

2015-12-11 Thread Kevin Carr
I was using a FastMap from javalution. It seemed to have a problem with isEmpty inside the commitSync code. I changed to use a regular HashMap and everything is fine now. Sorry for the post. On Thu, Dec 10, 2015, 9:33 PM Guozhang Wang wrote: > Can you paste your list

Re: Mirrormaker issue with Kafka 0.9 (confluent platform 2.0)

2015-12-11 Thread Ismael Juma
On Fri, Dec 11, 2015 at 3:31 AM, Guozhang Wang wrote: > As Ewen said in KAFKA-1650 we removed the support of multiple consumer > configs in MM, so that you cannot get one MM instance to pull from multiple > origin clusters, but instead you need to use one MM instance for each

Re: SSL - kafka producer cannot publish to topic

2015-12-11 Thread Ismael Juma
Hi Shrikant, On Thu, Dec 10, 2015 at 9:03 PM, Shrikant Patel wrote: > Figured it out. > > I was adding the ssl properties to producer.properties. We need to add > this to separate file and provide that file as input to procuder bat\sh > script --producer.config

Re: Mirrormaker issue with Kafka 0.9 (confluent platform 2.0)

2015-12-11 Thread Meghana Narasimhan
Thanks Ewen and Guozhang for the details ! On Thu, Dec 10, 2015 at 10:31 PM, Guozhang Wang wrote: > Meghana, > > As Ewen said in KAFKA-1650 we removed the support of multiple consumer > configs in MM, so that you cannot get one MM instance to pull from multiple > origin

kafka connection with zookeeper

2015-12-11 Thread sadanand.kulkarni
Hi there! Couldn’t find anything so far! please help.. - Can Kafka broker communicates with Zookeeper using secure (SSL/TLLS) protocol? If yes, which zookeeper and Kafka versions supports it? Thanks a ton! Appreciate for your time and help! Regards Sadanand The information contained in

Re: SSL - kafka producer cannot publish to topic

2015-12-11 Thread Ben Stopford
Yes - that’s correct Ismael. I think what Shri was saying was that he got it working when he added the SSL properties to the file he passed into the Console Producer. > On 11 Dec 2015, at 17:06, Ismael Juma wrote: > > Hi Shrikant, > > On Thu, Dec 10, 2015 at 9:03 PM,

Re: Per Topic Metrics

2015-12-11 Thread Otis Gospodnetić
Hi Fabian, Hmmm, there are certainly per-topic metrics. You can see it in this SPM demo for Kafka monitoring: * click on https://apps.sematext.com/demo to get into the demo account * go into any SPM app with "kafka" in the name, like

Low-latency, high message size variance

2015-12-11 Thread Jens Rantil
Hi, We've been experimenting a little with running Kafka internally for better handling temporary throughput peaks of asynchronous tasks. However, we've had a big issues making Kafka work for us and I am starting to question whether its a good fit. Our usecase: - High latency. At peaks, each