Hi All - here is the update on this.
I was able to fix the following warnings -
1) WARN Property bootstrap.servers is not valid
(kafka.utils.VerifiableProperties)
-> removed bootstrap.servers from mmConsumer.config (IT IS REQUIRED
ONLY IN mmProducer.config)
2) zk.connectiontimeout.ms is not valid
(kafka.utils.VerifiableProperties)
replaced zk.connectiontimeout.ms with ->
zookeeper.connection.timeout.ms=1000000 (in mmConsumer.config)
3) #queue.enqueueTimeout.ms=-1
replaced with queue.enqueue.timeout.ms=-1 (in
mmProducer.config)
However, couple are still pending ->
a) producer.type = async was supplied but isn't a known config
*How do i ensure the producer is an "async" producer ?*
b) queue.time = 1000000 was supplied but isn't a known config
*What needs to be done for this ?*
On Tue, Jun 20, 2017 at 12:40 PM, karan alang <[email protected]> wrote:
> Hi All - i've setup Kafka MirrorMaker using link - Kafka Mirror Maker
> best Practices
> <https://community.hortonworks.com/articles/79891/kafka-mirror-maker-best-practices.html>
> ,
>
> and am getting the following warnings ->
>
> [2017-06-20 12:29:31,381] WARN The configuration queue.time = 1000000 was
> supplied but isn't a known config. (org.apache.kafka.clients.
> producer.ProducerConfig)
> [2017-06-20 12:29:31,381] WARN The configuration producer.type = async was
> supplied but isn't a known config. (org.apache.kafka.clients.
> producer.ProducerConfig)
> [2017-06-20 12:29:31,381] WARN The configuration queue.enqueueTimeout.ms
> = -1 was supplied but isn't a known config. (org.apache.kafka.clients.
> producer.ProducerConfig)
> [2017-06-20 12:29:31,460] WARN Property bootstrap.servers is not valid
> (kafka.utils.VerifiableProperties)
> [2017-06-20 12:29:31,460] WARN Property zk.connectiontimeout.ms is not
> valid (kafka.utils.VerifiableProperties)
> [2017-06-20 12:29:31,627] WARN Property bootstrap.servers is not valid
> (kafka.utils.VerifiableProperties)
> [2017-06-20 12:29:31,627] WARN Property zk.connectiontimeout.ms is not
> valid (kafka.utils.VerifiableProperties)
> [2017-06-20 12:29:31,635] WARN Property bootstrap.servers is not valid
> (kafka.utils.VerifiableProperties)
> [2017-06-20 12:29:31,636] WARN Property zk.connectiontimeout.ms is not
> valid (kafka.utils.VerifiableProperties)
>
>
>
> *Kafka version - 0.9*
>
> *Producer Config ->*
>
> bootstrap.servers=localhost:7092,localhost:7093,localhost:
> 7094,localhost:7095
> producer.type=async
> queue.time=1000000
> queue.enqueueTimeout.ms=-1
>
> *Consumer Config :*
>
> zookeeper.connect=localhost:2181
> zk.connectiontimeout.ms=1000000
> bootstrap.servers=localhost:9092,localhost:9093,localhost:
> 9094,localhost:9095
> consumer.timeout.ms=-1
> #security.protocol=PLAINTEXTSASL
> group.id=kafka-mirror
>
>
> Command used to start Mirror Maker :
>
> $KAFKA_HOME1/bin/kafka-run-class.sh kafka.tools.MirrorMaker
> --consumer.config $KAFKA_HOME1/config/mmConsumer.config --num.streams 3
> --producer.config $KAFKA_HOME1/config/mmProducer.config
> --whitelist="mmtopic" --abort.on.send.failure true
>
>
> Any ideas what needs to be done to remove these warning .. i'm trying to
> test the optimizations specified in the link above.
>
>
>
