Hi David, One option would be to first output your info to a topic using Kafka Streams, and then use Connect again (as a sink) to read from the topic and write to a file in the file system.
Eno > On 15 Jul 2016, at 08:24, David Newberger <[email protected]> > wrote: > > Hello All, > > I'm curious if I can output to a .txt file after doing some stream processing > using Kafka Streams. The scenario I'm trying to implement is a simple web log > processing application with alerts on specific criteria. I know I can ingest > log files from the local filesystem into Kafka using connect. I also believe > I can use Kafka Streams to process the logs looking for the specific criteria > to be met. > > Where I'm having difficulty is telling if I can either output the info which > meets the criteria to one local file system .txt file and the raw unprocessed > logs to another local file system text file directly from Kafka Steams or > Kafka Connect. I'd like to output the 2 files to the local file system > because this is a simple proof of concept application which I'd like to keep > from using other tools in the chain if possible. > > Cheers! > > David Newberger >
