Re: 0.9.0.0 RC4

We are waiting for this. On Mon, Nov 23, 2015 at 8:49 PM, Jun Rao wrote: > Thanks everyone for voting. > > The following are the results of the votes. > > +1 binding = 4 votes (Neha Narkhede, Sriharsha Chintalapani, Guozhang Wang, > Jun Rao) > +1 non-binding = 3 votes > -1 = 0 votes > 0 = 0 vote

Re: Re: Re: Re: Re: Kafka lost data issue

the > count, logging or anything else. I recommend taking a look at the callback > API for sending data and improving your test to at least record send > failures. > > Gwen > > > On Thu, Nov 12, 2015 at 11:10 AM, Hawin Jiang > wrote: > > > Hi Pradeep > >

Re: Re: Re: Re: Re: Kafka lost data issue

roducer = new KafkaProducer<>(properties, new > ByteArraySerializer(), > >> new ByteArraySerializer()); > >> kafkaProducer.flush(); > >> you can call the flush after sending every few messages; > >> > >> > >> > >> > >>

Re: Re: Re: Kafka lost data issue

> > > > > > > > At 2015-11-12 16:43:54, "Hawin Jiang" wrote: > >Hi Jinxing > > > >I don't think we can resolve this issue by increasing producers. if I > >increased more producers, it should lost more messages. > > > >I just test

Re: Re: Kafka lost data issue

xception; > > > note that, to increase the producer sending rate, you must have enough > producer 'power'; > > > in my case, I have 50 producer sending message at the same time : ) > > > > > > > > At 2015-11-12 16:16:23, "Hawin Jian

Re: Kafka lost data issue

ucer 'send' API is not > reliable; > > > only successful sent message will trigger the callback, but the failed > ones don't; > > > you saw this? > > > > > > > > > At 2015-11-12 16:01:17, "Hawin Jiang" wrote: > >Hi All >

Kafka lost data issue

Hi All I have sent messages to Kafka for one minute. I found 97446 messages in producer side and 96896 messages in consumer side for Case 1. I also tried case 2. I have faced the same issues. The number is not match between producer and consumer. Can someone take a look at this issue? Thanks.

Re: future of Camus?

Very useful information for us. Thanks Guozhang. On Oct 22, 2015 2:02 PM, "Guozhang Wang" wrote: > Hi Adrian, > > Another alternative approach is to use Kafka's own Copycat framework for > data ingressing / egressing. It will be released in our 0.9.0 version > expected in Nov. > > Under Copycat u

Re: remote Kafka producer configuration and kafka.common.FailedToSendMessageException

if you want to connect remote kafka producer. Maybe you can try to use IP to start your producer. Making sure your producer and consumer are working fine. Then trying advertised host name to connect it. props.put("*metadata.broker.list", "I P to start your producer")

Re: Consumer that consumes only local partition?

Hi Robert Here is the kafka benchmark for your reference. if you want to use Flink, Storm, Samza or Spark, the performance will be going down. 821,557 records/sec(78.3 MB/sec) https://engineering.linkedin.com/kafka/benchmarking-apache-kafka-2-million-writes-second-three-cheap-machines Best

Re: Trying to access Kafka behind NAT, java.io.BrokenPipe error

Hi Su Maybe you can try to use own public IP if you want to set host name to public IP. Or you can use private IP with load balancing configuration. Thanks. Best regards Hawin On Tue, Jul 7, 2015 at 11:09 AM, Su She wrote: > Hello Everyone, > > I am in a tricky situation. > > I am running Ka

Re: Kafka bottleneck issue

nd?) ? > > Aditya > > ____ > From: Hawin Jiang [hawin.ji...@gmail.com] > Sent: Thursday, July 02, 2015 5:58 PM > To: users@kafka.apache.org > Subject: Kafka bottleneck issue > > Hi Admin > > I have executed a performance test on one single node.The TPS never over > 4000

Kafka bottleneck issue

Hi Admin I have executed a performance test on one single node.The TPS never over 4000 events per sec on one producer.Please help me. Thanks in advance. Here is my code and configuration *Producer code*** public void run() { int messag