Absolutely, Sai. That's exactly why we want to improve the upgrade/compatibility story.
On Thu, Oct 20, 2016 at 12:28 AM, saiprasad mishra < [email protected]> wrote: > Thanks Michael > Hopefully the upgrade story evolves as 0.10.1+ advances to maturity > > Just my 2 cents > > Decoupling the kafka streams from the core kafka changes will help so that > the broker can be upgraded without notice and streaming apps can evolve to > newer streaming features on their own pace > > Regards > Sai > > > On Wednesday, October 19, 2016, Michael Noll <[email protected]> wrote: > > > Apps built with Kafka Streams 0.10.1 only work against Kafka clusters > > running 0.10.1+. This explains your error message above. > > > > Unfortunately, Kafka's current upgrade story means you need to upgrade > your > > cluster in this situation. Moving forward, we're planning to improve the > > upgrade/compatibility story of Kafka so that you could, for example, run > a > > newer version of Kafka Streams (or any other Kafka client) against an > older > > version of Kafka. > > > > > > > > On Tue, Oct 18, 2016 at 10:56 PM, saiprasad mishra < > > [email protected]> wrote: > > > > > Hi All > > > > > > Was testing with 0.10.1.0 rc3 build for my new streams app > > > > > > Seeing issues starting my kafk streams app( 0.10.1.0) on the old > version > > > broker 0.10.0.1. I dont know if it is supposed to work as is. Will > > upgrade > > > the broker to same version and see whether it goes away > > > > > > client side issues > > > > > > ================== > > > > > > java.io.EOFException > > > > > > at > > > org.apache.kafka.common.network.NetworkReceive. > readFromReadableChannel( > > > NetworkReceive.java:83) > > > ~[kafka-clients-0.10.1.0.jar!/:?] > > > > > > at > > > org.apache.kafka.common.network.NetworkReceive. > > > readFrom(NetworkReceive.java:71) > > > ~[kafka-clients-0.10.1.0.jar!/:?] > > > > > > at > > > org.apache.kafka.common.network.KafkaChannel.receive( > > > KafkaChannel.java:154) > > > ~[kafka-clients-0.10.1.0.jar!/:?] > > > > > > at org.apache.kafka.common.network.KafkaChannel.read( > > > KafkaChannel.java:135) > > > ~[kafka-clients-0.10.1.0.jar!/:?] > > > > > > at > > > org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector. > > > java:343) > > > [kafka-clients-0.10.1.0.jar!/:?] > > > > > > at org.apache.kafka.common.network.Selector.poll(Selector.java:291) > > > [kafka-clients-0.10.1.0.jar!/:?] > > > > > > at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:260) > > > [kafka-clients-0.10.1.0.jar!/:?] > > > > > > at > > > org.apache.kafka.clients.consumer.internals. > ConsumerNetworkClient.poll( > > > ConsumerNetworkClient.java:232) > > > [kafka-clients-0.10.1.0.jar!/:?] > > > > > > at > > > org.apache.kafka.clients.consumer.internals. > ConsumerNetworkClient.poll( > > > ConsumerNetworkClient.java:209) > > > [kafka-clients-0.10.1.0.jar!/:?] > > > > > > at > > > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient. > > > awaitMetadataUpdate(ConsumerNetworkClient.java:148) > > > [kafka-clients-0.10.1.0.jar!/:?] > > > > > > at > > > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient. > > > awaitMetadataUpdate(ConsumerNetworkClient.java:136) > > > [kafka-clients-0.10.1.0.jar!/:?] > > > > > > at > > > org.apache.kafka.clients.consumer.internals.AbstractCoordinator. > > > ensureCoordinatorReady(AbstractCoordinator.java:197) > > > [kafka-clients-0.10.1.0.jar!/:?] > > > > > > at > > > org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll( > > > ConsumerCoordinator.java:248) > > > [kafka-clients-0.10.1.0.jar!/:?] > > > > > > at > > > org.apache.kafka.clients.consumer.KafkaConsumer. > > > pollOnce(KafkaConsumer.java:1013) > > > [kafka-clients-0.10.1.0.jar!/:?] > > > > > > at > > > org.apache.kafka.clients.consumer.KafkaConsumer.poll( > > > KafkaConsumer.java:979) > > > [kafka-clients-0.10.1.0.jar!/:?] > > > > > > at > > > org.apache.kafka.streams.processor.internals.StreamThread.runLoop( > > > StreamThread.java:407) > > > [kafka-streams-0.10.1.0.jar!/:?] > > > > > > at > > > org.apache.kafka.streams.processor.internals. > > > StreamThread.run(StreamThread.java:242) > > > [kafka-streams-0.10.1.0.jar!/:?] > > > > > > > > > > > > On the broker side the following message appears > > > > > > ============================================= > > > > > > kafka.network.InvalidRequestException: Error getting request for > > apiKey: 3 > > > and apiVersion: 2 > > > > > > at > > > kafka.network.RequestChannel$Request.liftedTree2$1( > > > RequestChannel.scala:95) > > > > > > at kafka.network.RequestChannel$Request.<init>(RequestChannel. > scala:87) > > > > > > at > > > kafka.network.Processor$$anonfun$processCompletedReceives$1. > > > apply(SocketServer.scala:488) > > > > > > at > > > kafka.network.Processor$$anonfun$processCompletedReceives$1. > > > apply(SocketServer.scala:483) > > > > > > at scala.collection.Iterator$class.foreach(Iterator.scala:893) > > > > > > at scala.collection.AbstractIterator.foreach(Iterator.scala:1336) > > > > > > at scala.collection.IterableLike$class.foreach(IterableLike.scala:72) > > > > > > at scala.collection.AbstractIterable.foreach(Iterable.scala:54) > > > > > > at kafka.network.Processor.processCompletedReceives( > > > SocketServer.scala:483) > > > > > > at kafka.network.Processor.run(SocketServer.scala:413) > > > > > > at java.lang.Thread.run(Thread.java:745) > > > > > > Caused by: java.lang.IllegalArgumentException: Invalid version for API > > key > > > 3: 2 > > > > > > at org.apache.kafka.common.protocol.ProtoUtils.schemaFor( > > > ProtoUtils.java:31) > > > > > > at > > > org.apache.kafka.common.protocol.ProtoUtils.requestSchema( > > ProtoUtils.java: > > > 44) > > > > > > at > > > org.apache.kafka.common.protocol.ProtoUtils.parseRequest( > > ProtoUtils.java: > > > 60) > > > > > > at > > > org.apache.kafka.common.requests.MetadataRequest. > > > parse(MetadataRequest.java:96) > > > > > > at > > > org.apache.kafka.common.requests.AbstractRequest. > > > getRequest(AbstractRequest.java:48) > > > > > > at > > > kafka.network.RequestChannel$Request.liftedTree2$1( > > > RequestChannel.scala:92) > > > > > > Regards > > > > > > Sai > > > > > >
