Re: trouble upgrading from 0.8.2.1 to 0.9.0.0: invalid message

2016-01-24 Thread Dave Peterson
On Wed, Jan 20, 2016 at 11:43 PM, Joel Koshy wrote: > Yes - compaction is a topic-level property. You can use --describe to > verify that the topic is compacted or not and if you didn't intend it to be > compacted you can alter the configuration. > I tried using the --describe option with kafka-

Re: trouble upgrading from 0.8.2.1 to 0.9.0.0: invalid message

2016-01-21 Thread Ismael Juma
Thanks Dave and Joel. I created a PR to add this note to the Upgrade Notes: https://github.com/apache/kafka/pull/798 Please take a look. Ismael On Thu, Jan 21, 2016 at 7:43 AM, Joel Koshy wrote: > Hi Dave, > > This change was introduced in > https://issues.apache.org/jira/browse/KAFKA-1755 fo

Re: trouble upgrading from 0.8.2.1 to 0.9.0.0: invalid message

2016-01-20 Thread Joel Koshy
Hi Dave, This change was introduced in https://issues.apache.org/jira/browse/KAFKA-1755 for compacted topics. > > Interestingly, none of the messages currently going to the topic use > message > compaction (i.e. they all have empty keys), although at some time in the > past > I may have sent a fe

Re: trouble upgrading from 0.8.2.1 to 0.9.0.0: invalid message

2016-01-20 Thread Dave Peterson
Hi Ismael, I looked again at the problem where I get ACK error 2 (InvalidMessage). When the error occurs, I see the error message with stack trace shown below. For the 8-partition topic "shown_news_stories" which I am sending messages to, only partition 7 has its lead replica on the broker running

Re: trouble upgrading from 0.8.2.1 to 0.9.0.0: invalid message

2016-01-19 Thread Dave Peterson
I'll try again and look for logged errors. The problem I saw with kafka-console-producer.sh did occur with a mixed version cluster, so that is likely the problem. I'll try again with the 0.8.2.1 version. Thanks, Dave On 1/19/2016 2:50 AM, Ismael Juma wrote: Hi Dave, Do you get any errors lo

Re: trouble upgrading from 0.8.2.1 to 0.9.0.0: invalid message

2016-01-19 Thread Ismael Juma
Hi Dave, Do you get any errors logged in the broker when you get ACK error 2 (InvalidMessage) while producing requests to a mixed version cluster? It would be helpful to see them. With regards to the kafka-console-producer.sh error, did you use the 0.9.0.0 console producer with a mixed version cl

Re: trouble upgrading from 0.8.2.1 to 0.9.0.0: invalid message

2016-01-15 Thread Dave Peterson
Hi Ismael, I'm using bruce (https://github.com/ifwe/bruce) to send the produce requests, with a RequiredAcks value of 1. Everything works fine when all brokers are running 0.8.2.1. Also if I set up a new 0.9.0.0 cluster from scratch rather than trying to upgrade, everything works fine. The prob

Re: trouble upgrading from 0.8.2.1 to 0.9.0.0: invalid message

2016-01-15 Thread Ismael Juma
Hi Dave, On Fri, Jan 15, 2016 at 2:04 AM, Dave Peterson wrote: > I was trying to upgrade an 0.8.2.1 broker cluster to 0.9.0.0 by following > the instructions here: > > http://kafka.apache.org/documentation.html#upgrade > > After upgrading one broker, with inter.broker.protocol.version=0.8.2.

trouble upgrading from 0.8.2.1 to 0.9.0.0: invalid message

2016-01-14 Thread Dave Peterson
I was trying to upgrade an 0.8.2.1 broker cluster to 0.9.0.0 by following the instructions here: http://kafka.apache.org/documentation.html#upgrade After upgrading one broker, with inter.broker.protocol.version=0.8.2.X set, I get ACK error 2 (InvalidMessage) when I try to send produce request