If you are not doing any transformation or filtering of the data before writing it to the db, then you’re probably better off with a consumer or Kafka Connect.
Kafka Streams shines when you have processing to do on the data as it is consumed. Especially if you do any stateful transformations, since Streams will safely manage that state for you. But Streams and Consumer are just libraries, so start with Consumer and if you find yourself doing more processing, consider moving to Kafka Streams. Either way, it’s a lot of fun! Dave > On Jun 25, 2021, at 5:09 PM, Samson Adeyemi <adesamso...@gmail.com> wrote: > > Hi, > > I'm looking over your documentation at docs.confluent.io on Kafka Streams, > but I couldn't find the information I'm looking for. What I need to know > are: > > 1. When should one use Kafka Stream instead of regular Kafka Consumer? > 2. If I'm not performing data transformation, but simply reading from Kafka > and saving the data to a DB, should I use Kafka Stream? What advantages do > I have over Kafka Consumer? > 3. How does Kafka Stream provide fault tolerance over regular Kafka > Consumer? > > Please advise. Thanks. > > Samson
