wifi questions

2018-05-02 Thread Clay Teahouse
Hello All, 1) Why would one need both nifi and Kafka in an environment, considering that NiFi can handle back pressure, set up and deal with queues? I have an environment where I would be collecting data via NiFi and I would need to write the data to hdfs after some post processing. Can't I just p

Re: NiFi questions

2018-05-03 Thread Clay Teahouse
> https://hortonworks.com/webinar/apache-kafka-apache-nifi-better-together/ > https://hortonworks.com/tutorial/realtime-event-processing-in-hadoop-with- > nifi-kafka-and-storm/ > > Andy LoPresto > alopre...@apache.org > *alopresto.apa...@gmail.com * > PGP Fingerprint: 70EC B3E5

Re: NiFi questions

2018-05-03 Thread Clay Teahouse
r/apache-kafka-apache-nifi-better-together/ > https://hortonworks.com/tutorial/realtime-event-processing-in-hadoop-with- > nifi-kafka-and-storm/ > > Andy LoPresto > alopre...@apache.org > *alopresto.apa...@gmail.com * > PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2

NiFi remote connections

2018-09-24 Thread Clay Teahouse
Hi All, Are the connections between the primary node and RPG persistent, and if no, is there a way to make them persistent? Similarly, are the http connection from PostHTTP and InvokeHTTP to the destination persistent, meaning keep-alive is set to true? thanks a lot Clay

Re: NiFi remote connections

2018-09-25 Thread Clay Teahouse
. > If you are looking for a solution to distribute FlowFiles based on > some rules, NIFI-5516 will be useful (under development). > https://issues.apache.org/jira/browse/NIFI-5516 > > Hope this helps. > > Thanks, > Koji > On Tue, Sep 25, 2018 at 12:07 PM Clay Teahouse &g

nifi questions

2017-07-04 Thread Clay Teahouse
Hello All, I am new to nifi. I'd appreciate your help with some questions. 1) Is there a processor like TCP Listen that would work with protobuf messages? In particular, I am interested in processing protobuf messages prefixed with the length of the message. I 2) Is there a processor like Consu

Re: nifi questions

2017-07-05 Thread Clay Teahouse
ta as well. Just depends on > >> your configuration, needs, and what the appropriate execution model > >> is. NiFi offers you a data broker in which you put the logic for how > >> to handle otherwise decoupled producers and consumers. Driving data > >> into o

ListenTcpRecord

2017-10-04 Thread Clay Teahouse
Hi All, Does anyone have an example of ListenTcpRecord processor in action, say for example, with a json or protobuf reader? I am specifically wondering about the record length/prefix. thanks Clay

Re: ListenTcpRecord

2017-10-05 Thread Clay Teahouse
record reader so that currently isn't an option. > > Let us know if you have any other questions. > > -Bryan > > [1] https://bryanbende.com/development/2017/10/04/apache- > nifi-processing-multiline-logs > > On Wed, Oct 4, 2017 at 8:39 AM, Clay Teahouse > wrote: &g

Re: ListenTcpRecord

2017-10-07 Thread Clay Teahouse
thing fails. > > -Bryan > > > On Thu, Oct 5, 2017 at 7:05 AM, Clay Teahouse > wrote: > > Thanks Bryan, for the feedback. > > > > I don't seem to be able to replicate the example in your blog. So, is > the > > flow GenerateFlowFile -> TCPPUT -