I would like to add a sql query result to attributes but I don't see a way
to do this currently. Anyone know of a processor I am missing or have a
workaround?
Preferably the result columns would become attributes.
I think I cuuld use exctract test to move the current flowfile contents
into an
MonitorActivity -> ExtractText -> PutSlack
>
> Thanks,
> Koji
>
> On Wed, May 9, 2018 at 9:03 AM, Nick Carenza
> wrote:
> > Hey all,
> >
> > I can't find a way to send messages with PutSlack from the
> MonitorActivity
> > processor. MonitorActivity
Hey all,
I can't find a way to send messages with PutSlack from the MonitorActivity
processor. MonitorActivity only writes to content and PutSlack only reads
from attributes and expression language doesn't provide a way to bridge the
two. What is the best way to make these processors communicate?
r.getValue());
> }
> session.transfer(flowFile, REL_SUCCESS);
> }
>
> Regards,
> Matt
>
>
> On Thu, Apr 12, 2018 at 2:18 PM, Nick Carenza
> wrote:
> > Hey users,
> >
> > I am having trouble getting attributes from my flowfiles as described
> here
> > ht
Hey users,
I am having trouble getting attributes from my flowfiles as described here
https://community.hortonworks.com/articles/75032/executescript-cookbook-part-1.html
.
Does anyone have a working example they could share of getting and
iterating through all of a flowfile's attributes in javasc
It seemed to hold up a little bit better but I ended up getting the same
errors.
On Thu, Aug 24, 2017 at 11:35 AM, Nick Carenza <
nick.care...@thecontrolgroup.com> wrote:
> Okay, thank you Andre!
>
> - Nick
>
> On Wed, Aug 23, 2017 at 4:03 PM, Andre wrote:
>
>> N
ld work) and/or reduce the
> number of messages batched on a single beats payload.
>
> Cheers
>
> On 23 Aug 2017 09:11, "Nick Carenza"
> wrote:
>
>> I am trying to cut Logstash out of my stack because i have moved all of
>> its functionality into Nifi but
I am trying to cut Logstash out of my stack because i have moved all of its
functionality into Nifi but I haven't been able to get Filebeat to play
nicely with the ListenBeats processor so I have to keep Logstash around
just to forward messages to Nifi.
I am using latest stable 5.5.2 but the List
Hey users,
Does anyone know a way to achieve something like MonitorActivity but for
all possible values of an attribute?
I use nifi to process logs and the hostname of the origin server is
included in the log. I want to make an alert for whenever the flow hasn't
seen a log from any given server i
t;
> Try escaping your \n’s, see if that helps.
>
>
>
> (?s)(.*\\n\\n${boundary}\\nContent-Type: text\/plain;
> charset="UTF-8"\\n\\n)(.*?)(\\n\\n${boundary}.*)
>
>
>
> *From:* Nick Carenza [mailto:nick.care...@thecontrolgroup.com]
> *Sent:* Thursday, May 18, 2
Hey Nifi-ers,
I haven't been having any luck trying to parse email after consuming them
with pop3.
I am composing a simple message with gmail with just plain text and it
comes out like this (with many headers removed):
Delivered-To: sl...@company.com
Return-Path:
MIME-Version: 1.0
Received: by
ships are
> sent to this PG, which essentially is a Dead Letter Storage.
>
> Are you asking about how do you get more information from the failed Flow
> Files (i.e., failure location, reason etc)?
>
> Cheers
> Oleg
>
> On Mar 1, 2017, at 3:21 PM, Nick Carenza
> wrote:
>
I have a lot of processors in my flow, all of which can, and do, route
flowfiles to their failure relationships at some point.
In the first iteration of my flow, I routed every failure relationship to
an inactive DebugFlow but monitoring these was difficult, I wouldn't get
notifications when somet
e/resume sounds reasonable,
> I am going to add more synchronization, start/stop processor handling,
> and make it work more properly with onTrigger so that it only try to
> retain when there hasn't been any polling activity for some period of
> time.
>
> How do you think?
> Any
> So the error is happening on #4 and NiFi has already produced a flow
> > file with the message, but then Kafka says it can't update the offset,
> > and then another consumer will likely pull that same message again and
> > produce another flow file with the same message.
&g
#x27;t be scheduled.
> >>
> >> After I started UpdateAttribute and the queued flow files went
> >> through, ConsumeKafka was executed again and received the 11th
> >> message.
> >>
> >> Also, I checked the ConsumerLease and ConsumeKafka_0_10 source
Hey team, I have a ConsumeKafka_0_10 running which normally operates
without problems. I had a queue back up due to a downstream processor and I
started getting these bulletins.
01:16:01 UTC WARNING a46d13dd-3231-1bff-1a99-1eaf5f37e1d2
ConsumeKafka_0_10[id=a46d13dd-3231-1bff-1a99-1eaf5f37e1d2] Dup
I have been running a standalone instance of Nifi and am preparing a move
into a cluster configuration. One aspect I am curious about is how
ControlRate is going to operate with n nodes. I am using control rate to
satisfy rate-limit requirements for external services.
My flow looks something like:
Hey Prabhu, I just finished up a csv processing flow myself and it looks
like this:
CSV Flowfile -> InferAvroSchema -> ConvertCSVToAvro -> ConvertAvroToJson
You can then use the ConvertJSONToSQL processor to finish things up.
I would have liked to be able to go directly from CSV to JSON but I don
bout the different repositories by reading this doc[1].
>
> [1] https://nifi.apache.org/docs/nifi-docs/html/nifi-in-depth.html
>
> Joe
>
> On Mon, Jan 16, 2017 at 3:15 PM, Nick Carenza <
> nick.care...@thecontrolgroup.com> wrote:
>
>> I found a section in the nifi ex
I found a section in the nifi expression language documentation of
Subjectless Functions. Could/should this feature be added as one of those?
On Mon, Jan 16, 2017 at 11:53 AM, Nick Carenza <
nick.care...@thecontrolgroup.com> wrote:
> Thanks Bryan, that is what I ended up doing. PutEm
familiar with
> that processor to really say if it is a good idea.
>
> -Bryan
>
>
> On Mon, Jan 16, 2017 at 1:40 PM, Nick Carenza <
> nick.care...@thecontrolgroup.com> wrote:
>
>> Is there any way to access flowfile content with expression language?
>>
&g
Is there any way to access flowfile content with expression language?
I am trying to use monitor activity with putslack but monitor activity
creates flowfiles with confiugrable content but putslack requires you to
supply a message property using expression language which as far as i can
tell doesn
I have been considering contributing a ValidateJsonSchema processor myself.
According to json-schema.org, there are 3 validators in Java. Does anyone
have experience with any of them and could support using one of another?
http://json-schema.org/implementations
On Thu, Jan 12, 2017 at 8:29 AM, Ma
u could also do the date conversion directly in Javascript with
> something like:
>
> contentObj.time = new Date(contentObj.time).valueOf() / 1000;
>
>
> Thanks,
>
> James
>
> On Mon, Jan 9, 2017 at 1:52 PM, Nick Carenza <
> nick.care...@thecontrolgroup.com> wr
Hey folks,
I am having a hard time figuring out how to work with date values in json
documents using the standard processors available in Nifi.
example flowfile:
{
"time": "2017-01-01T01:14:55+00:00",
"any": {
"nested": "data"
}
}
what i want:
{
"time": 1483233295,
"any":
could probably connect JVisualVM to
> one of your NiFi JVM processes and see if the GC activity graph is spiking
> up.
>
> -Bryan
>
>
> On Thu, Dec 22, 2016 at 11:36 AM, Nick Carenza <
> nick.care...@thecontrolgroup.com> wrote:
>
>> I replaced the Kafka proce
inate the Kafka processor from the list of possible problems by
> testing with PublishKafka_0_10.
>
> -Bryan
>
> On Wed, Dec 21, 2016 at 2:25 PM, Nick Carenza <
> nick.care...@thecontrolgroup.com> wrote:
>
>> Hey Brian,
>>
>> Thanks for taking the time!
>&g
Bryan
>
>
> On Wed, Dec 21, 2016 at 2:00 PM, Nick Carenza <
> nick.care...@thecontrolgroup.com> wrote:
>
>> I am running into an issue where a processor will stop receiving flow
>> files from it's queue.
>>
>> flow: tcp --(100,000)--> evaljs
29 matches
Mail list logo
