Re: [DISCUSS] KIP-382: MirrorMaker 2.0

2018-12-24 Thread Becket Qin
Hi Ryanne, Thanks for the reply. Please see a few more comments below. 1. Reserved character for topic names. > I think the limitations on topic names are imposed by Kafka itself (beyond > those from Zookeeper and the file system), so it might be possible to add a > reserved character for this

Re: KIP-408: Add Asynchronous Processing to Kafka Streams

2018-12-24 Thread Richard Yu
Sorry, just making a correction. Even if we are processing records out of order, we will still have to checkpoint offset ranges. So it doesn't really change anything even if we are doing in-order processing. Thinking this over, I'm leaning slightly towards maintaining the ordering guarantee.

Re: KIP-408: Add Asynchronous Processing to Kafka Streams

2018-12-24 Thread Richard Yu
Hi Boyang, I could see where you are going with this. Well, I suppose I should have added this to alternatives, but I might as well mention it now. It had crossed my mind that we consider returning in-order even if there are multiple threads processing on the same thread. But for this to happen,

Re: KIP-408: Add Asynchronous Processing to Kafka Streams

2018-12-24 Thread Boyang Chen
Hey Richard, thanks for the explanation! After some thinking, I do understand more about this KIP. The motivation was to increase the throughput and put heavy lifting RPC calls or IO operations to the background. While I feel the ordering is hard to guarantee for async task, it is better to be

Re: [VOTE] KIP-382 MirrorMaker 2.0

2018-12-24 Thread Stephane Maarek
+1 ! Great stuff Stephane On Mon., 24 Dec. 2018, 12:07 pm Edoardo Comar +1 non-binding > > thanks for the KIP > -- > > Edoardo Comar > > IBM Event Streams > > > Harsha wrote on 21/12/2018 20:17:03: > > > From: Harsha > > To: dev@kafka.apache.org

[jira] [Created] (KAFKA-7767) Console consumer should be able to print headers and partition/offsets

2018-12-24 Thread Noam Berman (JIRA)
Noam Berman created KAFKA-7767: -- Summary: Console consumer should be able to print headers and partition/offsets Key: KAFKA-7767 URL: https://issues.apache.org/jira/browse/KAFKA-7767 Project: Kafka

Read Oracle queue data stream using Apache Kafka Connect.

2018-12-24 Thread Amol Badgujar
Hello Experts, For my project requirement i would like to read a continious data stream from Oracle Queue using Kafka connect. Can someone please point me to a sample code or a material where i can see what configuration is requires to achieve this. We are already succeeded to read a data from

Re: confirm subscribe to dev@kafka.apache.org

2018-12-24 Thread Amol Badgujar
Please add amol.badgu...@gmail.com to dev mailing list for Apache Kafka. On Mon, Dec 24, 2018 at 7:06 PM wrote: > Hi! This is the ezmlm program. I'm managing the > dev@kafka.apache.org mailing list. > > I'm working for my owner, who can be reached > at dev-ow...@kafka.apache.org. > > To confirm

Re: [VOTE] KIP-382 MirrorMaker 2.0

2018-12-24 Thread Edoardo Comar
+1 non-binding thanks for the KIP -- Edoardo Comar IBM Event Streams Harsha wrote on 21/12/2018 20:17:03: > From: Harsha > To: dev@kafka.apache.org > Date: 21/12/2018 20:17 > Subject: Re: [VOTE] KIP-382 MirrorMaker 2.0 > > +1 (binding).

[jira] [Resolved] (KAFKA-7761) CLONE - Add broker configuration to set minimum value for segment.bytes and segment.ms

2018-12-24 Thread Edoardo Comar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edoardo Comar resolved KAFKA-7761. -- Resolution: Duplicate if there is a valid reason for a duplicate, feel free to repoen > CLONE