RE: OutOfMemory error on broker when rolling logs

2015-05-15 Thread Jeff Field
Found it. SELinux was running on the box but not showing any events in the audit log, however, the kernel log is another story entirely: INFO: task java:4693 blocked for more than 120 seconds. Not tainted 2.6.32-504.8.1.el6.x86_64 #1 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disabl

Error while moving some partitions to OnlinePartition state

2015-05-15 Thread chenlax
first,i increase some partitions for a topic,and is ok, then i do kafka-reassign-partitions.sh ,and it speed long times to replicated data, and a partition status as "partition: 68 leader: 5 replicas: 8,0,5,1 isr: 5,1" so i do kafka-preferred-replica-election.sh & kafka-reassign-par

Re: how to Update message content kafka

2015-05-15 Thread Guozhang Wang
Hi, You cannot update message content after it has already been sent to Kafka. One workaround would be using keyed messages, and send a new message with the same key whenever you want to "update the value correspondent to the key". And turn on log compaction so that obsoleted messages with the sa

Re: Log end offset

2015-05-15 Thread Achanta Vamsi Subhash
Hi, The broker is healthy with no exceptions but the OffsetRequest in getOffsetsBefore method fails with ClosedChannelException. This usually happens after 2-3 hours of the app restart. I have looked at the code of ConsumerOffsetChecker and I use the same logic. I do connect to the leader to issue

how to Update message content kafka

2015-05-15 Thread Snehalata Nagaje
Hi , I want to update message content posted in kafka at particular offset? is there any API available for it? Thanks, Snehalata