Kafka 0.8 delete log failed

Hi All, I'm use Kafka 0.8 release build with 1 partition, 1 replica. My OS is Windows server 2012 and JDK is 1.7. I got below error when Kafka delete logs. Any guidance would be of great help. [2013-12-09 04:00:10,525] ERROR error in loggedRunnable

Re: Anyone working on a Kafka book?

Is there a book or this was just an idea? On Mon, Mar 25, 2013 at 12:42 PM, Chris Curtin curtin.ch...@gmail.comwrote: Thanks Jun, I've updated the example with this information. I've also removed some of the unnecessary newlines. Thanks, Chris On Mon, Mar 25, 2013 at 12:04 PM, Jun

error from adding a partition

Hi folks, I got this error when I tried to test the partition addition tool. bin/kafka-add-partitions.sh --partition 1 --topic libotesttopic --zookeeper xx.xxx.xxx.xx: adding partitions failed because of

Re: Anyone working on a Kafka book?

I forget but think Chetan was with oreilly On Dec 10, 2013, at 7:01, S Ahmed sahmed1...@gmail.com wrote: Is there a book or this was just an idea? On Mon, Mar 25, 2013 at 12:42 PM, Chris Curtin curtin.ch...@gmail.comwrote: Thanks Jun, I've updated the example with this information.

Data generator losses some data if kafka is restarted

Hi All, I am using kafka 0.8. My producers configurations are as follows kafka8.bytearray.producer.type=sync kafka8.producer.batch.num.messages=100 kafka8.producer.topic.metadata.refresh.interval.ms=60 kafka8.producer.retry.backoff.ms=100

Re: error from adding a partition

Tried this on the 0.8.0 release and it works for me. Could you make sure there are no duplicated kafka jars? Thanks, Jun On Tue, Dec 10, 2013 at 7:08 AM, Yu, Libo libo...@citi.com wrote: Hi folks, I got this error when I tried to test the partition addition tool.

Re: Data generator losses some data if kafka is restarted

You will need to configure request.required.acks properly. See http://kafka.apache.org/documentation.html#producerconfigs for details. Thanks, Jun On Tue, Dec 10, 2013 at 1:55 AM, Nishant Kumar nish.a...@gmail.com wrote: Hi All, I am using kafka 0.8. My producers configurations are as

Re: Anyone working on a Kafka book?

I'll let chetan comment if he's up for it. -Steve On Tue, Dec 10, 2013 at 8:40 AM, David Arthur mum...@gmail.com wrote: There was some talk a few months ago, not sure what the current status is. On 12/10/13 10:01 AM, S Ahmed wrote: Is there a book or this was just an idea? On Mon, Mar

Re: Anyone working on a Kafka book?

Hey Guys Yes, Ben Lorica (Oreilly) and I are planning to pen a Beginning Kafka book. We only finalized this late October are hoping to start this mid-month Chetan On Tue, Dec 10, 2013 at 8:45 AM, Steve Morin st...@stevemorin.com wrote: I'll let chetan comment if he's up for it. -Steve

Re: Anyone working on a Kafka book?

Great, so its not even at MEAP stage then :(, let me guess, it is going to take 6 months to decide on what animal to put on the cover! :) Looking forward to in though! On Tue, Dec 10, 2013 at 12:15 PM, chetan conikee coni...@gmail.com wrote: Hey Guys Yes, Ben Lorica (Oreilly) and I are

Re: Anyone working on a Kafka book?

Hey Guys, I would love to contribute to the book specially in the portion of Kafka-Spark integration or parts of kafka in general. Am building a Kafka-Spark Real-time framework here at Gree Intl Inc processing order of MBs of data per second. My profile:

Re: Anyone working on a Kafka book?

Shafaq, What does the architecture of what your building look like? -Steve On Tue, Dec 10, 2013 at 10:19 AM, Shafaq s.abdullah...@gmail.com wrote: Hey Guys, I would love to contribute to the book specially in the portion of Kafka-Spark integration or parts of kafka in general. Am

Re: Kafka 0.8 delete log failed

What is your configuration for data.dirs (the path where data is) and what is the set of disks/volumes on the machine? -Jay On Tue, Dec 10, 2013 at 12:50 AM, CuiLiang cuilian...@gmail.com wrote: Hi All, I'm use Kafka 0.8 release build with 1 partition, 1 replica. My OS is Windows server

Re: Partial Message Read by Consumer

Having a partial message transfer over the network is the design of Kafka 0.7.x (I can't speak to 0.8.x, though it may still be). When the request is made, you tell the server the partition number, the byte offset into that partition, and the size of response that you want. The server finds that

Re: Anyone working on a Kafka book?

Hi Steve, The first phase would be pretty simple, essentially hooking up the Kafka-DStream-consumer to perform KPI aggregation over the streamed data from Kafka Broker cluster in real-time. We would like to maximize the throughput by choosing the right message payload size, correct kafka

Re: How to set kafka path in zk

Please try 10.237.0.1:2181,10.237.0.2:2181,10.237.0.3:2181/kafka. Thanks, Liang Cui 2013/12/6 Yonghui Zhao zhaoyong...@gmail.com Hi, If I don't want to register kafka in zk root and I want to make it under a namespace, for example kafka1. If I set only one host in zk property something