Re: GetSFTP with dynamic file filter

2015-11-24 Thread Aldrin Piri
Michael, Are you using 0.3.0? If so, the functionality you are looking for is absent from that version. That requested functionality is what led to https://issues.apache.org/jira/browse/NIFI-673 and the introduction of List/FetchSFTP. I am not sure I have any good suggestions for 0.3.0 to achie

Re: MergeContent Processor

2015-11-24 Thread Aldrin Piri
Hi Elli, The best way to frame it in its current implementation is that it is primarily time window driven. In terms of unsuccessful attempts, these are documented as being attempts to put an item into a bin, with the perspective that the respective bin may be too close to its max size to accommo

Re: queued files

2015-11-24 Thread Joe Percivall
Not a problem, I'd be interested in any follow-up details. I agree that it should be a separate processor since this is an almost atomic unit of work that can be used in many different work-flows. I created a jira for this new processor: https://issues.apache.org/jira/browse/NIFI-1217 Joe - -

Re: queued files

2015-11-24 Thread Charlie Frasure
Interesting. Thanks for the update and the template. I use osx as a playground, but this will have to be implemented on RHEL. I'll see about downloading or building this and testing. Performance will be critical due to the volume of data; I've run into some python-based detection libraries that

Re: Output port and 2 way SSL

2015-11-24 Thread Joe Witt
Hello, Ports on the root group automatically become remote group ports. Input ports can receive input from external sources and output ports can be used by external sources to pull data. So long as those external sources are using the site-to-site client lib you should be good. A longer descript

Re: Output port and 2 way SSL

2015-11-24 Thread Sumanth Chinthagunta
I had the same problem when I tried to create output port in sub-processor group. I have to create output port in root processor group and link from sub-processor group to this port. > On Nov 24, 2015, at 8:25 AM, Aurélien DEHAY wrote: > > Hello. > > I've configured my nifi to use 2 Way SSL

Re: queued files

2015-11-24 Thread Joe Percivall
Hello Charlie, I was looking back through and saw this wasn't totally resolved yet. Couple questions. First, what system are you using? There are a couple of options for the stream command depending on what you're using. Also are you able to get new commands (using yum or brew)? The key thin

Output port and 2 way SSL

2015-11-24 Thread Aurélien DEHAY
Hello. I've configured my nifi to use 2 Way SSL for user authentication, without cluster. I want to create an output port to send data to Spark. Nifi complains that "output connection for port is not defined". How, and where, do I configure that port? I did not find any information about

Re: MergeContent/SplitText - Performance against large CSV files

2015-11-24 Thread Bryan Bende
Mark, As far as I know, no one is working the RouteCSV processor yet. There is a JIRA for it though: https://issues.apache.org/jira/browse/NIFI-1161 -Bryan On Mon, Nov 23, 2015 at 4:58 PM, Mark Petronic wrote: > Mark Payne stated, "We should have a RouteCSV processor as well." > > I am wonderi