Re: Larger Size Error Message

2016-03-06 Thread John Dennison
Guozhang, Do you know the ticket for for changing the "batching criterion from #.messages to bytes." I am unable to find it. Working on porting a similar change to pykafka. John On Sat, Mar 5, 2016 at 4:29 PM, Guozhang Wang wrote: > Hello, > > Did you have compression

test-log4j.properties purpose

2016-03-06 Thread Stevo Slavić
Hello Apache Kafka community, Is config/test-log4j.properties used for tests only? If so, would it make sense to remove it from binary distribution archive? It's in kafka_2.11-0.9.0.1.tgz Kind regards, Stevo Slavic.

Re: Kafka broker decommission steps

2016-03-06 Thread Alexis Midon
also: . the command line tool packaging is not ideal, you have to download the (big) kafka zip, set paths, etc. . the details of the zk cluster and kafka cluster must be repeated on the command line. with kafkat, you can use `gem install`, and a store the cluster details in a config file. On

Re: Kafka broker decommission steps

2016-03-06 Thread Alexis Midon
My recollection is that you have to come up with the partition assignment yourself, and pass the json file as an argument. This is quite error prone, especially during an outage. we quickly wrote kafkat to have a simple commands that would let us express needs without having to deal with the

Re: session.timeout.ms limit

2016-03-06 Thread Ofra Pavlovitz
Hi Vanessa, The workaround we use in this case is closing the consumer and then opening it again when required. In addition you can increase the heartbeat timeout (heartbeat.interval.ms) - see more details in the documentaton. Thanks, Ofra 2016-03-02 16:09 GMT+02:00 Gligor Vanessa

Re: Consumer Offsets Topic cleanup.policy

2016-03-06 Thread Achanta Vamsi Subhash
Hi, We tested this on our stage environment and works fine if we change the policy to delete from compact. Will there be any side effects if we change it to delete for the __consumer_offsets topic? On Wed, Mar 2, 2016 at 4:43 PM, Achanta Vamsi Subhash < achanta.va...@flipkart.com> wrote: > Hi