Re: Kafka stream or ksql design question

2018-07-16 Thread Guozhang Wang
Hello Will,

Your question is very high-level and hence I felt less guilty to give you a
general answer :)

You can read the web docs on on Kafka Streams achieve high throughput via
data parallelism here:

https://kafka.apache.org/11/documentation/streams/architecture


Regarding KSQL, you can look at the github issues for asked features and
tentative roadmap tasks:

https://github.com/confluentinc/ksql/issues


Guozhang


On Mon, Jul 16, 2018 at 5:06 AM, Will Du  wrote:

> Hi folks,
> As far as I know, Kafka Stream is a separate process by reading data from
> topic, transform, and writing to another topic if needed. In this case, how
> this process supports high throughout stream as well as load balance in
> terms of message traffic and computing resource for stream processing?
>
> Regarding to KSL, is there any query optimization in place or in roadmap?
>
> Thanks,
> Will
>
>


-- 
-- Guozhang


Kafka stream or ksql design question

2018-07-16 Thread Will Du
Hi folks,
As far as I know, Kafka Stream is a separate process by reading data from 
topic, transform, and writing to another topic if needed. In this case, how 
this process supports high throughout stream as well as load balance in terms 
of message traffic and computing resource for stream processing?

Regarding to KSL, is there any query optimization in place or in roadmap?

Thanks,
Will