Re: Kafka SSL error

2017-12-21 Thread sham singh
mmtest1 --security-protocol SSL --broker-list host1:9093 --producer.config /usr/hdp/2.5.3.0-37/kafka/mirror-maker/client-ssl.properties * I'm using Kafka 0.10 .. anyone else faced similar issues ? btw, i'm using Hortonworks distribution. On Thu, Dec 21, 2017 at 1:06 PM, sham singh wrote

Re: Kafka SSL error

2017-12-21 Thread sham singh
u, Dec 21, 2017 at 12:49 PM, Ted Yu wrote: > Since you're using a Vendor's distro, can you post on their community page > ? > > BTW do you notice any difference in settings between the working cluster > and this cluster ? > > Cheers > > On Thu, Dec 21, 2017 at

Kafka SSL error

2017-12-21 Thread sham singh
Hello All - I'm getting this error, when publishing messages to Kafka topic using SSL mode, Command to publish messages : */usr/hdp/2.5.3.0-37/kafka/bin/kafka-producer-perf-test.sh --messages 100 --message-size 1000 --topics mmtest4 \* *--broker-list :9093,:9093,:9093, \* *--threads 1 --compr

Re: messages not being displayed on Console, when using console producer/consumer

2017-12-20 Thread sham singh
btw, one thing i noticed - the behavior when i used Confluent Kafka is different from what i see on Apache Kafka, with Confluent Kafka - i was able to see the messages on the console, also the command-line options seem to be different On Wed, Dec 20, 2017 at 7:19 PM, sham singh wrote: > He

messages not being displayed on Console, when using console producer/consumer

2017-12-20 Thread sham singh
Hello - i'm using Kafka 0.10 & am trying to use the kafka-console-consumer.sh to consume/display the messages produced by kafka-producer-perf-test.sh This seems to be working fine, except that the console is not displaying the text produced. Command used : Console Producer : */usr/hdp/2.5.3.0-37

MirrorMaker optimization - num.streams vs. MM processes

2017-12-19 Thread sham singh
Hello - i've a question on optimizing MirrorMaker setup... I've 2 topics, each with 12 partitions and i'm setting up MirrorMaker for the two topics. Is it preferable to have 3 Mirror Maker processes (on different m/c), with num.streams = 4 (or 8) OR Have a singe Mirror Maker process, with num.strea

Kafka Producer HA - using Kafka Connect

2017-11-30 Thread sham singh
We are looking at implementing Kafka Producer HA .. i.e there are 2 producers which can produce the same data .. The objective is to have High Availability implemented for the Kafka Producer .. i.e. if Producer1 goes down, the Producer2 kick starts and produces data starting from the offset commi