SQL Result to Attributes

I would like to add a sql query result to attributes but I don't see a way to do this currently. Anyone know of a processor I am missing or have a workaround? Preferably the result columns would become attributes. I think I cuuld use exctract test to move the current flowfile contents into

Re: ExecuteScript Javascript flowFile.getAttributes()

ot; + attr.getValue()); > } > session.transfer(flowFile, REL_SUCCESS); > } > > Regards, > Matt > > > On Thu, Apr 12, 2018 at 2:18 PM, Nick Carenza > <nick.care...@thecontrolgroup.com> wrote: > > Hey users, > > > > I am having trouble getting attri

ExecuteScript Javascript flowFile.getAttributes()

Hey users, I am having trouble getting attributes from my flowfiles as described here https://community.hortonworks.com/articles/75032/executescript-cookbook-part-1.html . Does anyone have a working example they could share of getting and iterating through all of a flowfile's attributes in

Re: Problems with ListenBeats 1.3.0

It seemed to hold up a little bit better but I ended up getting the same errors. On Thu, Aug 24, 2017 at 11:35 AM, Nick Carenza < nick.care...@thecontrolgroup.com> wrote: > Okay, thank you Andre! > > - Nick > > On Wed, Aug 23, 2017 at 4:03 PM, Andre <andre-li...@fu

Re: Problems with ListenBeats 1.3.0

ng between none and 3 should work) and/or reduce the > number of messages batched on a single beats payload. > > Cheers > > On 23 Aug 2017 09:11, "Nick Carenza" <nick.care...@thecontrolgroup.com> > wrote: > >> I am trying to cut Logstash out of my stack

Monitoring attributes

Hey users, Does anyone know a way to achieve something like MonitorActivity but for all possible values of an attribute? I use nifi to process logs and the hostname of the origin server is included in the log. I want to make an alert for whenever the flow hasn't seen a log from any given server

Re: [EXT] Parsing Email Attachments

> Nick, > > > > Try escaping your \n’s, see if that helps. > > > > (?s)(.*\\n\\n${boundary}\\nContent-Type: text\/plain; > charset="UTF-8"\\n\\n)(.*?)(\\n\\n${boundary}.*) > > > > *From:* Nick Carenza [mailto:nick.care...@thecontrolgroup.co

Parsing Email Attachments

Hey Nifi-ers, I haven't been having any luck trying to parse email after consuming them with pop3. I am composing a simple message with gmail with just plain text and it comes out like this (with many headers removed): Delivered-To: sl...@company.com Return-Path:

Re: Deadletter

> sent to this PG, which essentially is a Dead Letter Storage. > > Are you asking about how do you get more information from the failed Flow > Files (i.e., failure location, reason etc)? > > Cheers > Oleg > > On Mar 1, 2017, at 3:21 PM, Nick Carenza <nick.care...@thecon

Deadletter

I have a lot of processors in my flow, all of which can, and do, route flowfiles to their failure relationships at some point. In the first iteration of my flow, I routed every failure relationship to an inactive DebugFlow but monitoring these was difficult, I wouldn't get notifications when

Re: ConsumeKafka processor erroring when held up by full queue

Any feedback would be appreciated. Thanks! > > Koji > > On Fri, Feb 10, 2017 at 7:22 AM, Nick Carenza > <nick.care...@thecontrolgroup.com> wrote: > > Thank you guys, I will look to see what I can do to contribute. > > > > On Thu, Feb 9, 2017 at 1:19 PM, J

Re: ConsumeKafka processor erroring when held up by full queue

most > > once processing). > > > > So the error is happening on #4 and NiFi has already produced a flow > > file with the message, but then Kafka says it can't update the offset, > > and then another consumer will likely pull that same message again and > > produce an

Re: ConsumeKafka processor erroring when held up by full queue

>> Also, I checked the ConsumerLease and ConsumeKafka_0_10 source code, > >> those warning and error message is logged because NiFi received > >> KafkaException when it tried to commit offset to Kafka. > >> > >> Were there anything in Kafka server logs? I su

ControlRate across cluster

I have been running a standalone instance of Nifi and am preparing a move into a cluster configuration. One aspect I am curious about is how ControlRate is going to operate with n nodes. I am using control rate to satisfy rate-limit requirements for external services. My flow looks something

Re: Expression language access to flowfile content?

t; You can learn more about the different repositories by reading this doc[1]. > > [1] https://nifi.apache.org/docs/nifi-docs/html/nifi-in-depth.html > > Joe > > On Mon, Jan 16, 2017 at 3:15 PM, Nick Carenza < > nick.care...@thecontrolgroup.com> wrote: > >> I found

Expression language access to flowfile content?

Is there any way to access flowfile content with expression language? I am trying to use monitor activity with putslack but monitor activity creates flowfiles with confiugrable content but putslack requires you to supply a message property using expression language which as far as i can tell

Re: Json Validation for mandatory fields

I have been considering contributing a ValidateJsonSchema processor myself. According to json-schema.org, there are 3 validators in Java. Does anyone have experience with any of them and could support using one of another? http://json-schema.org/implementations On Thu, Jan 12, 2017 at 8:29 AM,

Re: converting date string to timestamp in json document

} > > You could also do the date conversion directly in Javascript with > something like: > > contentObj.time = new Date(contentObj.time).valueOf() / 1000; > > > Thanks, > > James > > On Mon, Jan 9, 2017 at 1:52 PM, Nick Carenza < > nick.care...@thecontrolg

converting date string to timestamp in json document

Hey folks, I am having a hard time figuring out how to work with date values in json documents using the standard processors available in Nifi. example flowfile: { "time": "2017-01-01T01:14:55+00:00", "any": { "nested": "data" } } what i want: { "time": 1483233295, "any":

Re: Flow seized, cannot list flow files for full queue

talls. You could probably connect JVisualVM to > one of your NiFi JVM processes and see if the GC activity graph is spiking > up. > > -Bryan > > > On Thu, Dec 22, 2016 at 11:36 AM, Nick Carenza < > nick.care...@thecontrolgroup.com> wrote: > >> I replaced

Re: Flow seized, cannot list flow files for full queue

e the Kafka processor from the list of possible problems by > testing with PublishKafka_0_10. > > -Bryan > > On Wed, Dec 21, 2016 at 2:25 PM, Nick Carenza < > nick.care...@thecontrolgroup.com> wrote: > >> Hey Brian, >> >> Thanks for taking the time! &

Re: Flow seized, cannot list flow files for full queue

firming. > > Thanks, > > Bryan > > > On Wed, Dec 21, 2016 at 2:00 PM, Nick Carenza < > nick.care...@thecontrolgroup.com> wrote: > >> I am running into an issue where a processor will stop receiving flow >> files from it's queue. >> >> flow: tcp --(100