[ 
https://issues.apache.org/jira/browse/KAFKA-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15621249#comment-15621249
 ] 

Emanuele Cesena commented on KAFKA-4350:
----------------------------------------

[~hachikuji] Sorry, I'm a bit confused. I need to replicate from Kafka 0.9 to 
0.10.

I don't think MM 0.9 works for writing to Kafka 0.10, or at least I've tried it 
in my settings (i.e., K 0.9 -> MM 0.9 -> K 0.10), it didn't work, then I read 
around and always saw recommendations to use the new MM against the old broker, 
not viceversa.

So I went for MM 0.10: K 0.9 -> MM 0.10 -> K 0.10.
In this case, I can use either the new client or the old client (setting 
bootstrap.servers vs zookeeper.connect).
I understand that the new client may not work for reading from K 0.9.

But supposedly, the old client (in MM 0.10) should work, shouldn't it? This is 
the core of the issue I'm reporting, I'm getting errors even with the old 
client.

> Can't mirror from Kafka 0.9 to Kafka 0.10.1
> -------------------------------------------
>
>                 Key: KAFKA-4350
>                 URL: https://issues.apache.org/jira/browse/KAFKA-4350
>             Project: Kafka
>          Issue Type: Bug
>            Reporter: Emanuele Cesena
>
> I'm running 2 clusters: K9 with Kafka 0.9 and K10 with Kafka 0.10.1.
> In K10, I've set up mirror maker to clone a topic from K9 to K10.
> Mirror maker immediately fails while starting, any suggestion? Following 
> error message and configs.
> Error message:
> {code:java} 
> [2016-10-26 23:54:01,663] FATAL [mirrormaker-thread-0] Mirror maker thread 
> failure due to  (kafka.tools.MirrorMaker$MirrorMakerThread)
> org.apache.kafka.common.protocol.types.SchemaException: Error reading field 
> 'cluster_id': Error reading string of length 418, only 43 bytes available
>         at org.apache.kafka.common.protocol.types.Schema.read(Schema.java:73)
>         at 
> org.apache.kafka.clients.NetworkClient.parseResponse(NetworkClient.java:380)
>         at 
> org.apache.kafka.clients.NetworkClient.handleCompletedReceives(NetworkClient.java:449)
>         at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:269)
>         at 
> org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:232)
>         at 
> org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:180)
>         at 
> org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureCoordinatorReady(AbstractCoordinator.java:193)
>         at 
> org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:248)
>         at 
> org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1013)
>         at 
> org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:979)
>         at 
> kafka.tools.MirrorMaker$MirrorMakerNewConsumer.receive(MirrorMaker.scala:582)
>         at 
> kafka.tools.MirrorMaker$MirrorMakerThread.run(MirrorMaker.scala:431)
> [2016-10-26 23:54:01,679] FATAL [mirrormaker-thread-0] Mirror maker thread 
> exited abnormally, stopping the whole mirror maker. 
> (kafka.tools.MirrorMaker$MirrorMakerThread)
> {code} 
> Consumer:
> {code:} 
> group.id=mirrormaker001
> client.id=mirrormaker001
> bootstrap.servers=...K9...
> security.protocol=PLAINTEXT
> auto.offset.reset=earliest
> {code} 
> (note that I first run without client.id, then tried adding a client.id 
> because -- same error in both cases)
> Producer:
> {code:}
> bootstrap.servers=...K10...
> security.protocol=PLAINTEXT
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to