Re: Does adding ConsumerTimeoutException make the code more robust?

Yes, I have configured consumer timeout config. Let me put my query other way. Is it possible that it.hasNext() could be blocked even when there are messages available, In which case using Consumer Timeout could help? Thanks, Rahul. On Saturday 29 November 2014 09:56 PM, Jun Rao wrote: By d

Re: how many brokers to set in kafka

thanks a lot > On Nov 29, 2014, at 8:29 AM, Jun Rao wrote: > > Typically, you will just have one broker per server. If you do want to set > up multiple brokers on the same server, ideally you need to give each > broker dedicated storage. > > Thanks, > > Jun > > On Thu, Nov 27, 2014 at 11:09 AM

Re: kafka 0.8.1 socket leak? (file descriptor outage)

These logs don't indicate new socket connections. You need to look for debug logs like "Accepted connection from". Are those connections from a producer or a consumer? Is it possible that a client didn't call close() properly? Thanks, Jun On Thu, Nov 27, 2014 at 7:17 PM, Daniel Liu wrote: > Hi

Re: kafka web console running error

You will need to contact the owner of that project directly. Thanks, Jun On Thu, Nov 27, 2014 at 11:40 AM, Sa Li wrote: > I am using https://github.com/claudemamo/kafka-web-console version, and do > you mind to tell where about to make such modification? > > thanks > > Alec > > On Mon, Nov 24,

Re: how many brokers to set in kafka

Typically, you will just have one broker per server. If you do want to set up multiple brokers on the same server, ideally you need to give each broker dedicated storage. Thanks, Jun On Thu, Nov 27, 2014 at 11:09 AM, Sa Li wrote: > Hi, all > > We are having 3 production server to setup for kaf

Re: Does adding ConsumerTimeoutException make the code more robust?

By default, it.hasNext() blocks when there is no more message to consume. So catching ConsumerTimeoutException doesn't make any difference. You only need to handle ConsumerTimeoutException if you have customized the consumer timeout config. Thanks, Jun On Thu, Nov 27, 2014 at 7:48 AM, Rahul Amar

Re: Kafka 0.8.2 log cleaner

Yes, log cleaner is in 0.8.2. You just need to set the retention policy of a topic to "compact". Thanks, Jun On Thu, Nov 27, 2014 at 5:20 AM, Khandygo, Evgeny (EXT) < evgeny.khandygo@siemens.com> wrote: > I’m wondering if you could tell me whether log cleaner implemented in > 0.8.2 because

Re: isr never update

Could you check the state-change log of the follower replica and see if it received the corresponding LeaderAndIsr request? If so, could you check the max lag jmx (http://kafka.apache.org/documentation.html) in the follower replica to see what the lag is? Thanks, Jun On Thu, Nov 27, 2014 at 4:03