Re: Controls order of execution in a queue?

2016-06-05 Thread Huagen peng
Thanks, Mark and Matthew. Huagen > 在 2016年6月5日,下午9:34,Matthew Clarke 写道: > > The default priority is not FIFO, but rather oldest FlowFile first. You can > change the priority order on a connection through that connections > configuration. Theresa are a list of

Re: Controls order of execution in a queue?

2016-06-05 Thread Mark Payne
Huagen, NiFi provides the concept of Prioritizers to determine how data is Prioritized / sorted. You can right-click on a connection and click Configure. From the Settings tab, you can drag and drop to select which prioritizers are used and in what order. For instance, you can drag the First

RE: Custom processor is failing for concurrency

2016-06-05 Thread Kumiko Yada
Thank you, Bryan. I’m working with Microsoft on this issue. Will keep you guys updated. Thanks Kumiko From: Bryan Bende [mailto:bbe...@gmail.com] Sent: Friday, June 3, 2016 2:32 PM To: users@nifi.apache.org Subject: Re: Custom processor is failing for concurrency It is hard to say for sure,

Controls order of execution in a queue?

2016-06-05 Thread Huagen peng
Hi, I notice that the order of execution in an incoming queue is not FIFO (first in first out). For example, I have a ExecuteStreamCommand processor, which at one point may have more than 20 flowflies waiting. It appears that the processor just randomly select a flowfile from the queue after

Nifi & Parsey McParseface! RegEx in a Processor...

2016-06-05 Thread Pat Trainor
I have had success with using ReplaceText processor out of the box to modify the output of a nifi-called script. I'm applying nifi to running the parsey mcparseface system (Syntaxnet) from google. The ouput of the application looks like this: \--- Input: It is to two English scholars ,

Re: Best way to generate a new filename

2016-06-05 Thread Joe Witt
You could generate a unique filename with that extension by using the following in Update Attribute Add property: property name: filename property value: ${uuid}.json You can also set a directory structure with time stamping this way as well. For instance set another attribute on that

Re: Excessive logging

2016-06-05 Thread Oleg Zhurakousky
Huagen, it appears you have DEBUG level logging enabled. Oleg On Jun 4, 2016, at 21:27, Huagen peng > wrote: Hi, I got excessive logging from my NiFi instance. I suddenly see logging like the following going into nidi-bootstrap.log very

Re: Processor Question

2016-06-05 Thread Leslie Hartman
Matthew:     The modifyBytes processor would be the best if it would allow one to specify the bytes to keep. I could calculate the number of bytes to delete, but when I try and place a variable in the End Offset it says it is not in the format.