Re: Flink vs Kafka streams

2019-11-08 Thread Peter Groesbeck
We use EMR instead of ECS but if that’s an option for your team, you can configure auto scaling rules in your cloud formation so that your task/job load dynamically controls cluster sizing. Sent from my iPhone > On Nov 8, 2019, at 1:40 AM, Navneeth Krishnan > wrote: > > Hello All, > > I ha

Idempotent Producers and Exactly Once Consumers

2019-08-30 Thread Peter Groesbeck
For a producer that emits messages to a single topic (i.e. no single message is sent to multiple topics), will enabling idempotency but not transactions provide exactly once guarantees for downstream consumers of said topic? Ordering is not important I just want to make sure consumers only consume