FailedToSendMessageException on kafka producer

Hi, I wrote a java client to send data from file to kafka,(this code worked when ran in local) got following error $ java -cp kafka-0.0.1-SNAPSHOT.jar KafkaProducerFromFile [2016-05-04 03:39:24,996] ERROR Failed to collate messages by topic, partition due to: Failed to fetch topic metadata for to

Query - Compression

Hi, If i compress the data in producer as snappy, while consuming should i decompress it ? Thankz

Re: How to run Kafka in background

try it as nohup ./kafka-server-start.sh ../config/server.1.properties & On Wed, Jun 24, 2015 at 4:14 PM, bit1...@163.com wrote: > Hi, > > I am using kafak 0.8.2.1 , and when I startup Kafka with the script: > ./kafka-server-start.sh ../config/server.1.properties & > > I think it will run as bac

Warning in producer performance test

kafka-producer-perf-test.sh --broker-list 192.168.1.107:9092 --message-size 600 --messages 17000 --topic jun8 start.time, end.time, compression, message.size, batch.size, total.data.sent.in.MB, MB.sec, total.data.sent.in.nMsg, nMsg.sec [2015-06-19 14:07:46,196] WARN Failed to send producer req

Re: async

test > > Aditya > > ________ > From: ram kumar [ramkumarro...@gmail.com] > Sent: Sunday, May 31, 2015 10:18 PM > To: users@kafka.apache.org > Subject: async > > hi, > > is this the way to run async producer > > bin/kafka-console-producer.sh --property

async

hi, is this the way to run async producer bin/kafka-console-producer.sh --property producer.type=async batch.num.messages=10 --broker-list localhost:9092 --topic test thanks

questions

hi, can i consume messages after a particular size is stored ?

Re: questions

max size of partition On Fri, May 22, 2015 at 12:04 PM, Carles Sistaré < carles.sist...@googlemail.com> wrote: > Hi, > If I understood it good, u need to specify the maximal size of a partition? > Or you just need to know the actual size of your partitions.? > Le 22 mai 2015 8

Re: questions

thanks for the reply, but i need to know the per partition size(bytes) On Fri, May 22, 2015 at 11:47 AM, Warren Henning wrote: > Yes, you can specify the partition count when creating a topic. > > http://kafka.apache.org/documentation.html#quickstart > > On Thu, May 21, 2015 a

questions

Hi, can v specify the partition size of a particular topic

questions

hi, How can i send data from a log file to kafka server? Can i use kafka with flume. or is there any other way to do it Thanks