Re: Whey does the window final result is not emitted after the window has elapsed?

2019-01-04 Thread jingguo yao
Guozhang: Thanks for your kind help. Guozhang Wang 于2019年1月5日周六 上午3:28写道: > > Thanks for the detailed description. > > 1) Yes the stream time is advancable by any records. > 2) Given your description, another way to work around the situation is to > let your class send a final record with

Re: Declarative Kafka Configuration As Code

2019-01-04 Thread Ryanne Dolan
Brian, you can use AdminClient to configure Kafka topics programmatically. You might consider using a jvm language like Scala that can embed a DSL for configuration. Ryanne On Fri, Jan 4, 2019, 5:38 PM Brian Attwell I'm setting up our Kafka cluster at a new company, and I think it would be >

Declarative Kafka Configuration As Code

2019-01-04 Thread Brian Attwell
I'm setting up our Kafka cluster at a new company, and I think it would be beneficial if topic/partitioning/schemas are configured in code as opposed to by running ad-hoc kafka commands or using something like Kafka Manager. Has anyone had a good experience writing a declarative kafka config

Re: Whey does the window final result is not emitted after the window has elapsed?

2019-01-04 Thread Guozhang Wang
Thanks for the detailed description. 1) Yes the stream time is advancable by any records. 2) Given your description, another way to work around the situation is to let your class send a final record with timestamp set as the class-end-time plus a small delta (think of it as a sentinel "tick"

One partitions segment files in different log-dirs

2019-01-04 Thread margus
Hi In example if I have /kafka-log1 and /kafka-log2 Can kafka distribute one partitions segment files between different logs directories? Br, Margus Roo