Re: Switching compression codec at runtime

2017-11-23 Thread Sameer Kumar
ok..got it..thanks Manikumar...😀 On Thu, Nov 23, 2017 at 2:58 PM, Manikumar wrote: > topic-level config "compression.type" takes precedence over producer > compression code. > By default topic-level config "compression.type" is "producer", which means > retain > the original compression codec se

Re: Switching compression codec at runtime

2017-11-23 Thread Manikumar
topic-level config "compression.type" takes precedence over producer compression code. By default topic-level config "compression.type" is "producer", which means retain the original compression codec set by the producer. If you set topic-level config "compression.type" to any other compression co

Re: Switching compression codec at runtime

2017-11-23 Thread Sameer Kumar
Ok. So you mean stop all producers, change the compress type for topic at runtime and switch the compression type for producers and have them start again. On Thu, Nov 23, 2017 at 12:46 PM, Manikumar wrote: > You can dynamically change topic level configs on brokers. > http://kafka.apache.org/doc

Re: Switching compression codec at runtime

2017-11-22 Thread Manikumar
You can dynamically change topic level configs on brokers. http://kafka.apache.org/documentation.html#topicconfigs On Thu, Nov 23, 2017 at 12:38 PM, Sameer Kumar wrote: > I am not too sure if I can have different compression types for both > producer and broker. It has to be same. > > This is po

Re: Switching compression codec at runtime

2017-11-22 Thread Sameer Kumar
I am not too sure if I can have different compression types for both producer and broker. It has to be same. This is possible by stopping all brokers, producers and changing values. But for that broker cluster has to be done. I was looking if there is any way we can do that in a running cluster.

Re: Switching compression codec at runtime

2017-11-22 Thread Manikumar
You can set topic specific compression type by setting topic level config "compression.type" another option is change compression type config on producer side. On Wed, Nov 22, 2017 at 4:56 PM, Sameer Kumar wrote: > Hi, > > Is it possible to switch from gzip to lz4 at runtime on kafka brokers. M

Switching compression codec at runtime

2017-11-22 Thread Sameer Kumar
Hi, Is it possible to switch from gzip to lz4 at runtime on kafka brokers. My servers are currently running on gzip, and I want to switch them to lz4. -Sameer.