RE: Reg: Nifi Clustering

2016-05-09 Thread Sourav Gulati
Hello Team, We are doing some poc with Nifi . IF successful, we may be using it in production some time in future. We are using site-to-site in our poc. As Joe, in the upcoming 1.0 release work is being done to eliminate this notion of master/slave altogether. Will site-to-site be still suppo

Reg: Get files from ftp

2016-05-09 Thread Sourav Gulati
Hi Team, I need a suggestion. I want to get files from ftp server for which GetFtp processor is available. However, as I cannot delete files from source, I need to put a check that this processor does not pick a file more than once. What is the best way to do that? Regards, Sourav Gulati ___

Re: Reg: Nifi Clustering

2016-05-09 Thread Mark Payne
Sourav, Absolutely, Site-to-Site is a key enabler of NiFi and certainly will continue to be supported. Whereas right now you enter the URL of the NCM, you would simply enter the URL of any of the nodes in the cluster. Your instance would then reach out to that node and get a list of other nodes

Re: Reg: Get files from ftp

2016-05-09 Thread Mark Payne
Sourav, We have begun transitioning from many of the Get*** Processors to List*** and Fetch*** Processors. There is a ListSFTP / FetchSFTP processor set but not currently a List/Fetch FTP. Is SFTP a possibility for you? Would you be interested in working on a List/Fetch FTP Processor set? Thank

[GitHub] nifi pull request: NIFI-1860 Added ContainerRequestFilter to redir...

2016-05-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/nifi/pull/422 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enable

[GitHub] nifi pull request: NIFI-1860 Added ContainerRequestFilter to redir...

2016-05-09 Thread mcgilman
Github user mcgilman commented on the pull request: https://github.com/apache/nifi/pull/422#issuecomment-217849959 Thanks @ijokarumawak ! This has been pushed to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] nifi pull request: [WIP] NIFI-1857 Added HTTP(S) support for Site-...

2016-05-09 Thread ijokarumawak
GitHub user ijokarumawak opened a pull request: https://github.com/apache/nifi/pull/423 [WIP] NIFI-1857 Added HTTP(S) support for Site-to-Site. Hello, it's not fully done yet, but there's so many lines of codes already, so I'd like to share it. Any comment would be appreciated,

[GitHub] nifi pull request: NIFI-1850 - Initial Commit for JSON-to-JSON Sch...

2016-05-09 Thread YolandaMDavis
GitHub user YolandaMDavis opened a pull request: https://github.com/apache/nifi/pull/424 NIFI-1850 - Initial Commit for JSON-to-JSON Schema Converter Editor This is an initial commit for review of the TransformJson Advanced Editor. Please see https://issues.apache.org/jira/browse/NI

[GitHub] nifi pull request: [NIFI-1707] upgradeable angular components

2016-05-09 Thread scottyaslan
GitHub user scottyaslan opened a pull request: https://github.com/apache/nifi/pull/425 [NIFI-1707] upgradeable angular components You can merge this pull request into a Git repository by running: $ git pull https://github.com/scottyaslan/nifi responsiveDevBranch Alternatively

[GitHub] nifi pull request: NIFI-1858 Adding SiteToSiteProvenanceReportingT...

2016-05-09 Thread mosermw
Github user mosermw commented on a diff in the pull request: https://github.com/apache/nifi/pull/419#discussion_r62505265 --- Diff: nifi-nar-bundles/nifi-site-to-site-reporting-bundle/nifi-site-to-site-reporting-task/src/main/java/org/apache/nifi/reporting/AbstractSiteToSiteReportingTa

[GitHub] nifi pull request: NIFI-1858 Adding SiteToSiteProvenanceReportingT...

2016-05-09 Thread bbende
Github user bbende commented on a diff in the pull request: https://github.com/apache/nifi/pull/419#discussion_r62505576 --- Diff: nifi-nar-bundles/nifi-site-to-site-reporting-bundle/nifi-site-to-site-reporting-task/src/main/java/org/apache/nifi/reporting/AbstractSiteToSiteReportingTas

[GitHub] nifi pull request: NIFI-1862 Corrections to User Guide

2016-05-09 Thread andrewmlim
GitHub user andrewmlim opened a pull request: https://github.com/apache/nifi/pull/426 NIFI-1862 Corrections to User Guide You can merge this pull request into a Git repository by running: $ git pull https://github.com/andrewmlim/nifi patch-3 Alternatively you can review and a

[GitHub] nifi pull request: NIFI-1862 Corrections to User Guide

2016-05-09 Thread andrewmlim
Github user andrewmlim closed the pull request at: https://github.com/apache/nifi/pull/426 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

[GitHub] nifi pull request: NIFI-1862 User Guide corrections/improvements

2016-05-09 Thread andrewmlim
GitHub user andrewmlim opened a pull request: https://github.com/apache/nifi/pull/427 NIFI-1862 User Guide corrections/improvements Made multiple edits to the User Guide documentation for correcting errors (spelling/grammatical) and improving readability. You can merge this pull re

deploying the web layer

2016-05-09 Thread karthik Narayanan
Hi, I was successfully able to build the NIFI project from source . I was working an issue that i see on the NIFI web ui. When i right click on a process that is on the edge of my screen, the popup dialog, goes outside the screen, which makes the menus unselectable. I have fixed the js code so it

Re: deploying the web layer

2016-05-09 Thread Matt Gilman
Karthik, The WARs are unpacked into the working directory which defaults to /work/jetty. You should be able to replace the JS file that's there. Alternatively, you could just build the nifi-web-ui and the nifi-framework-nar and then copy the resulting framework NAR file into /lib. Matt On Mon, M

[GitHub] nifi pull request: NIFI-1862 User Guide corrections/improvements

2016-05-09 Thread alopresto
Github user alopresto commented on the pull request: https://github.com/apache/nifi/pull/427#issuecomment-217917476 Reviewing. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

Re: deploying the web layer

2016-05-09 Thread Andy LoPresto
Karthik, Thanks for your message. Please also consider raising a issue for this bug [1] and contributing your fix back to the community [2] if you are so inclined. [1] https://issues.apache.org/jira/browse/NIFI [2] https://cwiki.apache.org/confluence

[GitHub] nifi pull request: NIFI-1862 User Guide corrections/improvements

2016-05-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/nifi/pull/427 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enable

Re: [DISCUSS] Removal of FlowFilePrioritizer as first-class extension point

2016-05-09 Thread Michael Moser
+1 as long as the existing 4 prioritizers remain as options. I have seen people use all of them. I have also seen someone hack together what was effectively a SmallestFileFirstPrioritizer and a LargestFileFirstPrioritizer by using RouteOnAttribute on different ${fileSize} values. The use case wa

Re: [DISCUSS] Removal of FlowFilePrioritizer as first-class extension point

2016-05-09 Thread Aldrin Piri
+1 for this. It also occurred to me that these are currently not shown in the generated docs and only in the user guide. Mike, As far as sorting by size, do you think there is merit beyond the PriorityAttributePrioritizer for this case? An update attribute "copying" fileSize to "priority" shoul

Re: [DISCUSS] Removal of FlowFilePrioritizer as first-class extension point

2016-05-09 Thread Michael Moser
I do think there is (a little) merit to a separate sort by file size, but only because adding UpdateAttribute feels like a work around. Having it as a native prioritizer should give people the impression that we thought about it and consider it a valid use case. -- Mike On Mon, May 9, 2016 at 1

[GitHub] nifi pull request: NIFI-1858 Adding SiteToSiteProvenanceReportingT...

2016-05-09 Thread bbende
Github user bbende commented on a diff in the pull request: https://github.com/apache/nifi/pull/419#discussion_r62548156 --- Diff: nifi-nar-bundles/nifi-site-to-site-reporting-bundle/nifi-site-to-site-reporting-task/src/main/java/org/apache/nifi/reporting/SiteToSiteProvenanceReportingT

[GitHub] nifi pull request: [NIFI-1707] upgradeable angular components

2016-05-09 Thread mcgilman
Github user mcgilman commented on the pull request: https://github.com/apache/nifi/pull/425#issuecomment-217962785 Merged to master. Thanks @scottyaslan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project doe

[GitHub] nifi pull request: [NIFI-1707] upgradeable angular components

2016-05-09 Thread scottyaslan
Github user scottyaslan closed the pull request at: https://github.com/apache/nifi/pull/425 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is e

[GitHub] nifi pull request: NIFI-1863 extended caught exception in cleaning...

2016-05-09 Thread pvillard31
GitHub user pvillard31 opened a pull request: https://github.com/apache/nifi/pull/428 NIFI-1863 extended caught exception in cleaning task for HTTPContextMap You can merge this pull request into a Git repository by running: $ git pull https://github.com/pvillard31/nifi NIFI-18

RE: Reg: Nifi Clustering

2016-05-09 Thread Sourav Gulati
Thanks Mark for the information Regards, Sourav Gulati -Original Message- From: Mark Payne [mailto:marka...@hotmail.com] Sent: Monday, May 09, 2016 5:33 PM To: dev@nifi.apache.org Subject: Re: Reg: Nifi Clustering Sourav, Absolutely, Site-to-Site is a key enabler of NiFi and certainly w

RE: Reg: Get files from ftp

2016-05-09 Thread Sourav Gulati
Sure Mark. I am interested to work on it. Please provide some pointers regarding that. Also, I will check if Sftp can be used. So ListSFTP / FetchSFTP won't pick files more than once? Regards, Sourav Gulati -Original Message- From: Mark Payne [mailto:marka...@hotmail.com] Sent: Monday,