Re: KIP-162: Enable topic deletion by default

2017-05-27 Thread Vahid S Hashemian
Sure, that sounds good. I suggested that to keep command line behavior consistent. Plus, removal of ACL access is something that can be easily undone, but topic deletion is not reversible. So, perhaps a new follow-up JIRA to this KIP to add the confirmation for topic deletion. Thanks. --Vahid

Re: Producer Async Issue

2017-05-27 Thread Hans Jespersen
So you just want to not block and just silently throw away the messages and lose them forever? Kafka's persistence is all in the broker so there is no client side storing of data on disk. The client will send in async mode until the client memory buffer is full. Only then does it block, and

Re: Efficient way of Searching Messages By Timestamp - Kafka

2017-05-27 Thread SenthilKumar K
Hi Team , Any help here Pls ? Cheers, Senthil On Sat, May 27, 2017 at 8:25 PM, SenthilKumar K wrote: > Hello Kafka Developers , Users , > > We are exploring the SearchMessageByTimestamp feature in Kafka for our > use case . > > Use Case : Kafka will be realtime

Re: Kafka Streams Usage Patterns

2017-05-27 Thread Jay Kreps
This is great! -Jay On Sat, May 27, 2017 at 12:47 PM, Michal Borowiecki < michal.borowie...@openbet.com> wrote: > Hi all, > > I've updated the wiki page with a draft pattern for consecutively growing > time-windowed aggregations which was discussed some time ago on this > mailing list. > > I'm

Re: Kafka Streams Usage Patterns

2017-05-27 Thread Michal Borowiecki
Hi all, I've updated the wiki page with a draft pattern for consecutively growing time-windowed aggregations which was discussed some time ago on this mailing list. I'm yet to add the part that cleans up the stores using punctuations. Stay tuned. On a somewhat similar subject, I've been

Re: Producer Async Issue

2017-05-27 Thread Abhimanyu Nagrath
HI Hans, What exactly I meant by asynchronous is that when my Kafka broker is down and I am trying to produce the message . It is getting stuck till the configured max.block.ms and after that further code is executed. What I am looking for is that whether the broker is down or not it should not

Re: KIP-162: Enable topic deletion by default

2017-05-27 Thread Gwen Shapira
Thanks Vahid, Do you mind if we leave the command-line out of scope for this? I can see why adding confirmations, options to bypass confirmations, etc would be an improvement. However, I've seen no complaints about the current behavior of the command-line and the KIP doesn't change it at all. So

Re: Producer Async Issue

2017-05-27 Thread Hans Jespersen
The producer is asynchronous (assuming you mean the Java Producer) https://kafka.apache.org/0102/javadoc/index.html?org/apache/kafka/clients/producer/KafkaProducer.html -hans > On May 27, 2017, at 5:15 AM, Abhimanyu Nagrath > wrote: > > Hi, > I am using Kafka

Efficient way of Searching Messages By Timestamp - Kafka

2017-05-27 Thread SenthilKumar K
Hello Kafka Developers , Users , We are exploring the SearchMessageByTimestamp feature in Kafka for our use case . Use Case : Kafka will be realtime message bus , users should be able to pull Logs by specifying start_date and end_date or Pull me last five minutes data etc ... I did POC

Re: Trouble with querying offsets when using new consumer groups API

2017-05-27 Thread Abhimanyu Nagrath
Hi Jerry, I am also facing the same issue. Did you found the solution? Regards, Abhimanyu On Fri, May 26, 2017 at 7:24 PM, Jerry George wrote: > Hi > > I had question about the new consumer APIs. > > I am having trouble retrieving the offsets once the consumers are >

Producer Async Issue

2017-05-27 Thread Abhimanyu Nagrath
Hi, I am using Kafka 0.10.2 single node cluster and I want to know Kafka producer completely asynchronous. So what configuration I need to change in order to make producer completely asynchronous. Regards, Abhimanyu