Hi Mike I'm don't have much experience with Kafka Streams yet, but from the common sense point of view, maybe it would be easier to model as Kafka Stream for actual data processing with output to another topic, that would be consumed by Kafka Connect's sinks? I see one in discussion for HBase (https://issues.apache.org/jira/browse/HBASE-15320), although I wasn't able to find the similar for Solr...
Mike Thomsen at "Mon, 14 Mar 2016 12:55:00 -0400" wrote: MT> I was reading a bit about Kafka Streams and was wondering if it is MT> appropriate for my team's use. We ingest data using Kafka and Storm. Data MT> gets pulled by Storm and sent off to bolts that publish the data into HBase MT> and Solr. One of the things we need is something analogous to Storm's MT> ability to fail a message retrieved from Kafka if it was never processed to MT> completion. Does Kafka Streams provide similar capabilities? Basically, all MT> we need is the ability to consume a bunch of events from Kafka and if we MT> can't write them, tell the API that something failed and to not commit that MT> offset so it can be replayed. MT> Thanks, MT> Mike -- With best wishes, Alex Ott http://alexott.blogspot.com/ http://alexott.net/ http://alexott-ru.blogspot.com/ Skype: alex.ott
