Re: Kafka Streams vs Spark Streaming : reduce by window

2017-06-18 Thread Michal Borowiecki
If confusion is the problem, then totally agree no point adding more knobs. Perhaps you're right that users don't /really/ want processing-time semantics. Just /think/ they want them until they start considering replay/catch-up scenarios. I guess people rarely think about those from the start (

Re: Kafka Streams vs Spark Streaming : reduce by window

2017-06-18 Thread Paolo Patierno
I'm just thinking that having output into a topic every X seconds thanks to the windowing could be a useful feature without using something interactive queries that are really powerful (I love them) but aren't so useful in this scenario. Using the caching parameter isn't useful in such scenario

Re: Scala type mismatch after upgrade to 0.10.2.1

2017-06-18 Thread Eno Thereska
Hi there, Yeah with 0.10.2 some Scala applications need to explicitly declare the type of certain variables. See this: http://docs.confluent.io/current/streams/upgrade-guide.html#scala Thanks Eno > On Jun 17, 2017, at 10:03

How to shutdown Kafka Connect worker running in distributed mode?

2017-06-18 Thread mayank rathi
Hello All, Besides using "kill" command, is their any other graceful way to shutdown Kafka Connect worker running in distributed mode? Thanks!!

Re: Scala type mismatch after upgrade to 0.10.2.1

2017-06-18 Thread Björn Häuser
Thanks! I came up with a solution, the .map / .transform just need the return types assigned: .transform[String, ContentDataDto](filterMainCoverSupplier, FilterMainCoverSupplier.StateStoreName) Thanks! Björn > On 18. Jun 2017, at 16:56, Eno Thereska wrote: > > Hi there, > > Yeah with 0.10

Max message size and compression

2017-06-18 Thread Eli Jordan
Hi max.message.bytes controls the maximum message size the kafka server will process message.max.bytes controls the maximum message size the consumer will process max.request.size controls the maximum request size for the producer Whats not clear to me (and I can't find documented anywhere) i

[VOTE] 0.11.0.0 RC1

2017-06-18 Thread Ismael Juma
Hello Kafka users, developers and client-developers, This is the second candidate for release of Apache Kafka 0.11.0.0. This is a major version release of Apache Kafka. It includes 32 new KIPs. See the release notes and release plan (https://cwiki.apache.org/conf luence/display/KAFKA/Release+Plan

Re: [VOTE] 0.11.0.0 RC1

2017-06-18 Thread Magnus Edenhill
+1 (non-binding) Passes librdkafka integration tests (v0.9.5 and master) 2017-06-19 0:32 GMT+02:00 Ismael Juma : > Hello Kafka users, developers and client-developers, > > This is the second candidate for release of Apache Kafka 0.11.0.0. > > This is a major version release of Apache Kafka. It